== sanity-flr test 70a: flr mode fsx test ================ 08:12:37 (1787573557) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 3559 skipping zero size read skipping zero length zero range truncating to largest ever: 0x34c72 000003 1787573559.801165 trunc from 00000000 to 0x034c71 (0x34c72 bytes) 000004 1787573559.822277 trunc from 0x014b3e to 0x01659e (0x1a61 bytes) 000005 1787573559.827206 trunc from 0x011d9f to 0x01b35e (0x95c0 bytes) 000006 1787573559.832701 read 0x00e3a7 thru 0x00f903 (0x155d bytes) 000007 1787573559.839285 read 0x0337a9 thru 0x034c71 (0x14c9 bytes) 000008 1787573559.857308 punch from 0x0063b8 to 0x012bf2 (0xc83b bytes) 000010 1787573559.873484 mapwrite 0x024dc4 thru 0x027223 (0x2460 bytes) 000011 1787573559.892864 mapwrite 0x03053a thru 0x03a99d (0xa464 bytes) 000012 1787573559.937046 mapread 0x035406 thru 0x03a99d (0x5598 bytes) 000013 1787573559.938527 write 0x025cd4 thru 0x0325c2 (0xc8ef bytes) 000015 1787573559.942270 mapread 0x033424 thru 0x033cbd (0x89a bytes) 000016 1787573559.943593 write 0x039353 thru 0x03dc96 (0x4944 bytes) 000018 1787573559.945272 write 0x02d138 thru 0x03c578 (0xf441 bytes) 000019 1787573559.947713 trunc from 0x029524 to 0x02fe55 (0x6932 bytes) 000020 1787573559.971645 fallocate 0x000e4d thru 0x00b287 (0xa43b bytes) 000021 1787573559.989333 read 0x03a7c3 thru 0x03dc96 (0x34d4 bytes) 000022 1787573559.989977 punch from 0x015fad to 0x018452 (0x24a6 bytes) 000024 1787573560.002102 punch from 0x0047f7 to 0x0111ad (0xc9b7 bytes) 000025 1787573560.008313 trunc from 0x03dc97 to 0x016d6d (0x26f29 bytes) 000027 1787573560.034345 MIRROR_EXTEND to 2 mirrors fallocating to largest ever: 0x3a355 000028 1787573560.693609 fallocate 0x02ccd8 thru 0x03a354 (0xd67d bytes) 000029 1787573560.721635 write 0x0140b9 thru 0x01e8b8 (0xa800 bytes) 000031 1787573560.735912 write 0x0184d3 thru 0x019b04 (0x1632 bytes) 000032 1787573560.736796 trunc from 0x018040 to 0x01e8b8 (0x6879 bytes) 000033 1787573560.757542 punch from 0x004cc2 to 0x014923 (0xfc62 bytes) 000034 1787573560.763473 punch from 0x01c19b to 0x01e8b8 (0x271e bytes) 000035 1787573560.773276 MIRROR_RESYNC 2 mirrors 000036 1787573561.380517 punch from 0x00d177 to 0x015d96 (0x8c20 bytes) 000037 1787573561.413541 write 0x034c7c thru 0x03ac5b (0x5fe0 bytes) 000038 1787573561.415327 mapwrite 0x014492 thru 0x01718f (0x2cfe bytes) 000039 1787573561.456531 punch from 0x02612f to 0x0340c8 (0xdf9a bytes) 000040 1787573561.463285 mapwrite 0x03f230 thru 0x03ffff (0xdd0 bytes) 000041 1787573561.557182 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) 000043 1787573561.793240 fallocate 0x019131 thru 0x01bd48 (0x2c18 bytes) 000044 1787573561.808210 write 0x03c9c6 thru 0x03ffff (0x363a bytes) 000045 1787573561.829142 trunc from 0x040000 to 0x036916 (0x96e9 bytes) 000046 1787573561.861543 mapwrite 0x003956 thru 0x00d98d (0xa038 bytes) 000047 1787573561.943785 punch from 0x00a7b0 to 0x014e82 (0xa6d3 bytes) 000048 1787573561.955688 mapwrite 0x0341b0 thru 0x03ffff (0xbe50 bytes) 000049 1787573562.027712 punch from 0x006cc7 to 0x0168cb (0xfc05 bytes) 000051 1787573562.038575 fallocate 0x00fac5 thru 0x01c4b2 (0xc9ee bytes) 000052 1787573562.054192 write 0x029af2 thru 0x0399f5 (0xff04 bytes) zero_range to largest ever: 0x3bb35 000053 1787573562.075421 trunc from 0x02d26b to 0x03bb34 (0xe8ca bytes) 000054 1787573562.098658 punch from 0x00f6f2 to 0x011132 (0x1a41 bytes) 000055 1787573562.110042 trunc from 0x02ae70 to 0x0379b0 (0xcb41 bytes) 000056 1787573562.120419 write 0x01d8e1 thru 0x029bad (0xc2cd bytes) 000057 1787573562.127145 mapwrite 0x019cef thru 0x0201da (0x64ec bytes) 000058 1787573562.157497 read 0x00719a thru 0x015630 (0xe497 bytes) 000059 1787573562.171569 trunc from 0x040000 to 0x023d74 (0x1c28b bytes) 000060 1787573562.184214 mapread 0x01f65d thru 0x023d74 (0x4718 bytes) 000061 1787573562.185055 mapread 0x00132e thru 0x00fc42 (0xe915 bytes) 000062 1787573562.190354 mapread 0x019dc4 thru 0x023d74 (0x9fb1 bytes) 000063 1787573562.191891 trunc from 0x01fee0 to 0x021e14 (0x1f35 bytes) 000064 1787573562.196398 punch from 0x020f9c to 0x023d74 (0x2dd9 bytes) 000065 1787573562.201029 punch from 0x0018bc to 0x00ee38 (0xd57d bytes) 000066 1787573562.206037 mapwrite 0x030fb3 thru 0x03eaed (0xdb3b bytes) 000067 1787573562.262397 mapwrite 0x0038e9 thru 0x007f6e (0x4686 bytes) 000068 1787573562.296018 mapread 0x037eb8 thru 0x03e0ee (0x6237 bytes) 000070 1787573562.297306 mapwrite 0x03ea9e thru 0x03ffff (0x1562 bytes) 000071 1787573562.329660 read 0x01134e thru 0x011a4d (0x700 bytes) 000072 1787573562.330454 write 0x031c6a thru 0x03290c (0xca3 bytes) 000073 1787573562.332439 write 0x032700 thru 0x03b741 (0x9042 bytes) 000074 1787573562.334669 read 0x00d295 thru 0x00d921 (0x68d bytes) 000075 1787573562.335883 mapwrite 0x03bb51 thru 0x03ffff (0x44af bytes) 000076 1787573562.359396 write 0x02f410 thru 0x03bb50 (0xc741 bytes) 000077 1787573562.360926 mapwrite 0x004070 thru 0x00d285 (0x9216 bytes) 000078 1787573562.385769 punch from 0x02ef09 to 0x032930 (0x3a28 bytes) 000079 1787573562.391577 trunc from 0x0250dd to 0x02bb80 (0x6aa4 bytes) 000080 1787573562.396956 punch from 0x000f6b to 0x009028 (0x80be bytes) 000081 1787573562.402665 mapread 0x028352 thru 0x0320a4 (0x9d53 bytes) 000082 1787573562.412517 mapwrite 0x0369e2 thru 0x03ffff (0x961e bytes) 000083 1787573562.433495 read 0x02d557 thru 0x03d05b (0xfb05 bytes) 000085 1787573562.436561 read 0x01e3c4 thru 0x02873f (0xa37c bytes) 000086 1787573562.437799 mapread 0x00046f thru 0x000b82 (0x714 bytes) 000087 1787573562.440121 mapread 0x03019d thru 0x033814 (0x3678 bytes) 000088 1787573562.442130 mapwrite 0x00a65d thru 0x012060 (0x7a04 bytes) 000089 1787573562.465224 punch from 0x00a96a to 0x00f7e3 (0x4e7a bytes) 000090 1787573562.475434 MIRROR_EXTEND to 2 mirrors 000091 1787573563.330632 fallocate 0x0073f5 thru 0x011ac9 (0xa6d5 bytes) 000092 1787573563.406624 mapwrite 0x010227 thru 0x011e70 (0x1c4a bytes) 000093 1787573563.433396 trunc from 0x040000 to 0x0104c7 (0x2fb38 bytes) 000094 1787573563.500985 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x104c8): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x104c8): Mirror 2: 0x7e5fc0ee (stale) CRC-32 checksum value for chunk [0, 0x104c8): Mirror 1: 0x22e0b876 Mirror 3: 0x22e0b876 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x104c8: skipped 000096 1787573564.321981 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x104c8): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x104c8): Mirror 2: 0x7e5fc0ee (stale) CRC-32 checksum value for chunk [0, 0x104c8): Mirror 1: 0x22e0b876 Mirror 3: 0x22e0b876 Mirror 4: 0x22e0b876 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x104c8: skipped 000098 1787573565.328964 punch from 0x00f249 to 0x0104c7 (0x127f bytes) 000099 1787573565.437901 trunc from 0x0096e4 to 0x00f332 (0x5c4f bytes) 000100 1787573565.449101 fallocate 0x029edf thru 0x02eb1e (0x4c40 bytes) 000101 1787573565.454373 write 0x005f2b thru 0x0084d9 (0x25af bytes) 000102 1787573565.468115 read 0x002f8a thru 0x00f671 (0xc6e8 bytes) 000103 1787573565.483312 mapwrite 0x00d36c thru 0x014f37 (0x7bcc bytes) 000104 1787573565.583510 read 0x002e68 thru 0x00b4dc (0x8675 bytes) 000105 1787573565.584371 punch from 0x003fdf to 0x010261 (0xc283 bytes) 000106 1787573565.588232 write 0x0325d0 thru 0x03ffff (0xda30 bytes) 000107 1787573565.589957 read 0x0185b0 thru 0x024b49 (0xc59a bytes) 000108 1787573565.600796 read 0x02ed63 thru 0x037b1c (0x8dba bytes) 000109 1787573565.601629 mapwrite 0x03ce38 thru 0x03df73 (0x113c bytes) 000110 1787573565.614514 mapread 0x010779 thru 0x0149a1 (0x4229 bytes) 000111 1787573565.615762 punch from 0x00f9d0 to 0x01e32d (0xe95e bytes) 000112 1787573565.625285 MIRROR_RESYNC 4 mirrors 000113 1787573566.487333 punch from 0x026326 to 0x02cb1d (0x67f8 bytes) 000114 1787573566.530133 mapread 0x03e0ad thru 0x03ffff (0x1f53 bytes) 000115 1787573566.541289 trunc from 0x040000 to 0x00317b (0x3ce84 bytes) 000116 1787573566.564408 mapread 0x001037 thru 0x001ba8 (0xb72 bytes) 000117 1787573566.573409 trunc from 0x00317c to 0x02e135 (0x2afba bytes) 000119 1787573566.595749 trunc from 0x02e136 to 0x025c8a (0x84ab bytes) 000120 1787573566.611991 read 0x01b542 thru 0x02294c (0x740b bytes) 000121 1787573566.628102 mapread 0x006991 thru 0x00ef01 (0x8571 bytes) 000122 1787573566.657579 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x25c8b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25c8b): Mirror 2: 0xe1ff959a (stale) Mirror 3: 0xe1ff959a (stale) Mirror 4: 0xe1ff959a (stale) CRC-32 checksum value for chunk [0, 0x25c8b): Mirror 1: 0xe1ff959a Mirror 5: 0xe1ff959a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25c8b: skipped 000123 1787573567.415395 trunc from 0x004881 to 0x011522 (0xcca2 bytes) 000124 1787573567.477594 punch from 0x01dc17 to 0x022b03 (0x4eed bytes) 000125 1787573567.482394 trunc from 0x025c8b to 0x01ee78 (0x6e12 bytes) 000126 1787573567.570024 fallocate 0x005777 thru 0x011e94 (0xc71e bytes) 000127 1787573567.582246 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ee79): Mirror 2: 0x4eb20b24 (stale) Mirror 3: 0x4eb20b24 (stale) Mirror 4: 0x4eb20b24 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ee79): Mirror 2: 0x4eb20b24 (stale) Mirror 3: 0x4eb20b24 (stale) Mirror 4: 0x4eb20b24 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ee79: skipped 000128 1787573567.925111 trunc from 0x01ee79 to 0x0179d6 (0x74a2 bytes) 000129 1787573567.957717 punch from 0x011cf9 to 0x0179d6 (0x5cde bytes) 000130 1787573567.963267 mapread 0x00d5d3 thru 0x01616c (0x8b9a bytes) 000131 1787573567.993101 write 0x031483 thru 0x03e835 (0xd3b3 bytes) 000132 1787573567.998869 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e836): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e836): Mirror 2: 0x127b201 (stale) Mirror 3: 0x127b201 (stale) Mirror 4: 0x127b201 (stale) CRC-32 checksum value for chunk [0, 0x3e836): Mirror 1: 0x1bafdf1e Mirror 5: 0x1bafdf1e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e836: skipped 000133 1787573569.018966 read 0x021934 thru 0x02a112 (0x87df bytes) 000135 1787573569.050487 write 0x02cb3e thru 0x036cd4 (0xa197 bytes) 000136 1787573569.130330 mapread 0x02c046 thru 0x02c6cb (0x686 bytes) 000137 1787573569.132105 mapwrite 0x0300d2 thru 0x035cdc (0x5c0b bytes) 000138 1787573569.155024 read 0x034438 thru 0x03aa95 (0x665e bytes) 000140 1787573569.171000 fallocate 0x003db0 thru 0x0088f4 (0x4b45 bytes) 000141 1787573569.176767 mapread 0x009429 thru 0x015ba9 (0xc781 bytes) 000142 1787573569.183181 MIRROR_RESYNC 5 mirrors 000143 1787573570.146435 write 0x01b33b thru 0x026e8f (0xbb55 bytes) 000144 1787573570.196119 read 0x001355 thru 0x00aa07 (0x96b3 bytes) 000145 1787573570.207513 punch from 0x03cdae to 0x03e835 (0x1a88 bytes) 000146 1787573570.212067 write 0x006577 thru 0x00fbd5 (0x965f bytes) 000147 1787573570.216918 punch from 0x009b61 to 0x0137af (0x9c4f bytes) 000148 1787573570.230392 trunc from 0x03e836 to 0x0273c7 (0x1746e bytes) 000149 1787573570.274017 fallocate 0x032142 thru 0x03b14e (0x900d bytes) 000150 1787573570.282838 write 0x0105f0 thru 0x01cf00 (0xc911 bytes) 000152 1787573570.300048 fallocate 0x01bea6 thru 0x028265 (0xc3c0 bytes) 000153 1787573570.308080 trunc from 0x013bcc to 0x017a64 (0x3e99 bytes) 000154 1787573570.328846 write 0x028e63 thru 0x0359ae (0xcb4c bytes) 000155 1787573570.340300 trunc from 0x03b14f to 0x00bf24 (0x2f22a bytes) 000156 1787573570.353011 write 0x027e74 thru 0x02ab19 (0x2ca6 bytes) 000157 1787573570.354346 mapwrite 0x02415d thru 0x02df34 (0x9dd8 bytes) 000158 1787573570.397437 mapwrite 0x008399 thru 0x00bcbd (0x3925 bytes) 000159 1787573570.413929 fallocate 0x010b7e thru 0x012dcb (0x224e bytes) 000160 1787573570.417182 trunc from 0x02df35 to 0x00d3c6 (0x20b6e bytes) 000161 1787573570.429412 read 0x002240 thru 0x006506 (0x42c7 bytes) 000162 1787573570.430210 read 0x0090bd thru 0x00d3c6 (0x430a bytes) 000163 1787573570.431025 mapread 0x005455 thru 0x00ae50 (0x59fc bytes) 000164 1787573570.432989 punch from 0x00496e to 0x0060b0 (0x1743 bytes) 000165 1787573570.437348 trunc from 0x003cb1 to 0x00a84a (0x6b9a bytes) 000166 1787573570.442182 punch from 0x005e7c to 0x00d3c6 (0x754b bytes) 000167 1787573570.447130 trunc from 0x00d3c7 to 0x012f69 (0x5ba3 bytes) 000168 1787573570.462134 read 0x006a1a thru 0x011c4b (0xb232 bytes) 000169 1787573570.470581 punch from 0x0024fc to 0x002ebd (0x9c2 bytes) 000170 1787573570.475022 mapread 0x0032b6 thru 0x0088cf (0x561a bytes) 000171 1787573570.476271 mapread 0x001ecf thru 0x004d85 (0x2eb7 bytes) 000172 1787573570.481062 punch from 0x012ee7 to 0x012f69 (0x83 bytes) 000173 1787573570.485259 read 0x003912 thru 0x012418 (0xeb07 bytes) 000174 1787573570.490209 write 0x0116fd thru 0x01741d (0x5d21 bytes) 000175 1787573570.492244 read 0x011751 thru 0x01741d (0x5ccd bytes) 000176 1787573570.492937 trunc from 0x00a606 to 0x00e71c (0x4117 bytes) 000177 1787573570.497352 trunc from 0x00529a to 0x0061c5 (0xf2c bytes) 000178 1787573570.501212 read 0x016d53 thru 0x01741d (0x6cb bytes) 000179 1787573570.501949 fallocate 0x0349d1 thru 0x0352d0 (0x900 bytes) 000180 1787573570.505988 punch from 0x005e72 to 0x00c9e6 (0x6b75 bytes) 000181 1787573570.515013 MIRROR_RESYNC 5 mirrors 000182 1787573571.536320 read 0x00314b thru 0x00e742 (0xb5f8 bytes) 000183 1787573571.549217 fallocate 0x01cbba thru 0x01e1e4 (0x162b bytes) 000184 1787573571.617881 read 0x0131ee thru 0x014541 (0x1354 bytes) 000185 1787573571.636538 MIRROR_RESYNC 5 mirrors 000187 1787573572.605113 mapread 0x008cbb thru 0x011346 (0x868c bytes) 000188 1787573572.620973 write 0x035828 thru 0x037966 (0x213f bytes) 000189 1787573572.648059 punch from 0x026485 to 0x03489c (0xe418 bytes) 000190 1787573572.652172 write 0x01e7e4 thru 0x022595 (0x3db2 bytes) 000191 1787573572.660999 read 0x017568 thru 0x01ae0f (0x38a8 bytes) 000192 1787573572.666067 punch from 0x00baef to 0x00c8ad (0xdbf bytes) 000193 1787573572.670229 mapwrite 0x01a022 thru 0x01da6e (0x3a4d bytes) fallocating to largest ever: 0x40000 000194 1787573572.694042 fallocate 0x03bf7f thru 0x03ffff (0x4081 bytes) 000195 1787573572.698322 trunc from 0x040000 to 0x01c763 (0x2389c bytes) 000197 1787573572.718311 read 0x000a8f thru 0x0089bb (0x7f2d bytes) 000198 1787573572.732984 read 0x013ac5 thru 0x01c763 (0x8c9f bytes) 000200 1787573572.744050 MIRROR_RESYNC 5 mirrors 000201 1787573573.657709 read 0x01a920 thru 0x01c763 (0x1e44 bytes) 000202 1787573573.671703 write 0x0360d7 thru 0x037bca (0x1af4 bytes) 000203 1787573573.719302 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x37bcb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37bcb): Mirror 2: 0x8b182a1c (stale) Mirror 3: 0x8b182a1c (stale) Mirror 4: 0x8b182a1c (stale) Mirror 5: 0x8b182a1c (stale) CRC-32 checksum value for chunk [0, 0x37bcb): Mirror 1: 0x12246623 Mirror 6: 0x12246623 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37bcb: skipped 000204 1787573574.630609 trunc from 0x037bcb to 0x02e946 (0x9284 bytes) 000205 1787573574.671359 trunc from 0x001aed to 0x00cde5 (0xb2f9 bytes) 000206 1787573574.675975 write 0x00dd9e thru 0x00fb9e (0x1e01 bytes) 000207 1787573574.685714 mapwrite 0x013353 thru 0x01b48b (0x8139 bytes) 000208 1787573574.776654 mapread 0x000f77 thru 0x008a77 (0x7b01 bytes) 000209 1787573574.797687 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2e947): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e947): Mirror 2: 0x2f88ed54 (stale) Mirror 3: 0x2f88ed54 (stale) Mirror 4: 0x2f88ed54 (stale) Mirror 5: 0x2f88ed54 (stale) Mirror 6: 0x2f88ed54 (stale) CRC-32 checksum value for chunk [0, 0x2e947): Mirror 1: 0x8b19f1a5 Mirror 7: 0x8b19f1a5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e947: skipped 000210 1787573576.168217 read 0x01f874 thru 0x025063 (0x57f0 bytes) 000211 1787573576.178920 fallocate 0x007d77 thru 0x0149ee (0xcc78 bytes) 000212 1787573576.212207 MIRROR_RESYNC 7 mirrors 000213 1787573577.630887 punch from 0x00339e to 0x0121b2 (0xee15 bytes) 000214 1787573577.678275 trunc from 0x0264a7 to 0x02699a (0x4f4 bytes) 000215 1787573577.684232 trunc from 0x0074df to 0x00b8fd (0x441f bytes) 000216 1787573577.689589 trunc from 0x00977f to 0x0139a2 (0xa224 bytes) 000217 1787573577.696340 trunc from 0x02e947 to 0x03596f (0x7029 bytes) 000220 1787573577.726159 mapwrite 0x01b13c thru 0x01caa8 (0x196d bytes) 000221 1787573577.745403 write 0x03747a thru 0x03ffff (0x8b86 bytes) 000222 1787573577.747835 trunc from 0x03d9c3 to 0x03ffff (0x263d bytes) 000223 1787573577.761730 trunc from 0x040000 to 0x02d842 (0x127bd bytes) 000224 1787573577.778191 fallocate 0x01cdb7 thru 0x02a8fa (0xdb44 bytes) 000225 1787573577.789273 trunc from 0x021c34 to 0x022a11 (0xdde bytes) 000226 1787573577.798254 trunc from 0x028cbb to 0x02d842 (0x4b88 bytes) 000227 1787573577.804610 mapwrite 0x00f7ae thru 0x012a82 (0x32d5 bytes) 000228 1787573577.854449 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2d843): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d843): Mirror 2: 0xde20cad8 (stale) Mirror 3: 0xde20cad8 (stale) Mirror 4: 0xde20cad8 (stale) Mirror 5: 0xde20cad8 (stale) Mirror 6: 0xde20cad8 (stale) Mirror 7: 0xde20cad8 (stale) CRC-32 checksum value for chunk [0, 0x2d843): Mirror 1: 0x28b30e75 Mirror 8: 0x28b30e75 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d843: skipped 000229 1787573578.836256 mapwrite 0x015a51 thru 0x020819 (0xadc9 bytes) 000230 1787573578.992133 punch from 0x01d23f to 0x027380 (0xa142 bytes) 000231 1787573578.997944 read 0x00ba38 thru 0x012a3b (0x7004 bytes) 000232 1787573579.006009 punch from 0x011daa to 0x012bb6 (0xe0d bytes) 000233 1787573579.014592 trunc from 0x009c68 to 0x0197af (0xfb48 bytes) 000234 1787573579.020348 trunc from 0x02d843 to 0x0124b8 (0x1b38a bytes) 000235 1787573579.072027 trunc from 0x0124b9 to 0x007091 (0xb427 bytes) 000236 1787573579.100256 write 0x022470 thru 0x028552 (0x60e3 bytes) 000237 1787573579.106076 mapwrite 0x01499b thru 0x0157c7 (0xe2d bytes) 000238 1787573579.134630 punch from 0x01f110 to 0x024e52 (0x5d43 bytes) 000239 1787573579.141554 mapwrite 0x03fdbd thru 0x03ffff (0x243 bytes) 000240 1787573579.188214 mapread 0x02d5a9 thru 0x03503e (0x7a96 bytes) 000241 1787573579.199317 mapwrite 0x01e499 thru 0x01f128 (0xc90 bytes) 000242 1787573579.222290 trunc from 0x01d517 to 0x022e48 (0x5932 bytes) 000243 1787573579.227599 read 0x02edac thru 0x0306da (0x192f bytes) 000244 1787573579.228248 read 0x004b3c thru 0x011c04 (0xd0c9 bytes) 000245 1787573579.239103 mapwrite 0x02220a thru 0x02591e (0x3715 bytes) 000246 1787573579.256654 trunc from 0x040000 to 0x027cdb (0x18324 bytes) 000247 1787573579.279312 mapread 0x010603 thru 0x013c15 (0x3613 bytes) 000249 1787573579.287405 MIRROR_RESYNC 8 mirrors 000251 1787573580.949277 read 0x019b74 thru 0x025a14 (0xbea1 bytes) 000253 1787573580.962544 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) 000254 1787573581.494691 trunc from 0x027cdc to 0x024716 (0x35c5 bytes) 000255 1787573581.547234 punch from 0x005653 to 0x00b57a (0x5f28 bytes) 000256 1787573581.554275 read 0x019866 thru 0x024716 (0xaeb1 bytes) 000257 1787573581.568963 trunc from 0x012714 to 0x01f854 (0xd141 bytes) 000259 1787573581.577939 mapwrite 0x018f57 thru 0x027ec6 (0xef70 bytes) 000260 1787573581.687190 fallocate 0x00bc8a thru 0x0104a0 (0x4817 bytes) 000261 1787573581.693159 trunc from 0x025fd2 to 0x027ec6 (0x1ef5 bytes) 000262 1787573581.699893 mapwrite 0x010d35 thru 0x0162d0 (0x559c bytes) 000263 1787573581.728991 fallocate 0x0194ed thru 0x020ee0 (0x79f4 bytes) 000264 1787573581.734338 fallocate 0x03a44b thru 0x03ffff (0x5bb5 bytes) 000266 1787573581.741358 fallocate 0x019ab9 thru 0x01be71 (0x23b9 bytes) 000267 1787573581.747331 punch from 0x03b458 to 0x03ffff (0x4ba8 bytes) 000268 1787573581.754605 read 0x017879 thru 0x022c65 (0xb3ed bytes) 000269 1787573581.756225 fallocate 0x01df06 thru 0x025cfe (0x7df9 bytes) 000270 1787573581.762747 write 0x01f8c2 thru 0x02d3fe (0xdb3d bytes) 000271 1787573581.781099 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1d05494d (stale) Mirror 4: 0x1d05494d (stale) Mirror 5: 0x1d05494d (stale) Mirror 6: 0x1d05494d (stale) Mirror 7: 0x1d05494d (stale) Mirror 8: 0x1d05494d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x87d459d5 Mirror 9: 0x87d459d5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000272 1787573582.866393 trunc from 0x01fe25 to 0x02a8ce (0xaaaa bytes) 000274 1787573582.904593 mapread 0x00e305 thru 0x015759 (0x7455 bytes) 000275 1787573582.934190 read 0x0226d8 thru 0x029091 (0x69ba bytes) 000276 1787573582.946302 mapread 0x030cbc thru 0x03cce3 (0xc028 bytes) 000278 1787573582.967335 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1d05494d (stale) Mirror 5: 0x1d05494d (stale) Mirror 6: 0x1d05494d (stale) Mirror 7: 0x1d05494d (stale) Mirror 8: 0x1d05494d (stale) Mirror 9: 0x87d459d5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1d05494d (stale) Mirror 5: 0x1d05494d (stale) Mirror 6: 0x1d05494d (stale) Mirror 7: 0x1d05494d (stale) Mirror 8: 0x1d05494d (stale) Mirror 9: 0x87d459d5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000279 1787573583.461474 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1d05494d (stale) Mirror 6: 0x1d05494d (stale) Mirror 7: 0x1d05494d (stale) Mirror 8: 0x1d05494d (stale) Mirror 9: 0x87d459d5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1d05494d (stale) Mirror 6: 0x1d05494d (stale) Mirror 7: 0x1d05494d (stale) Mirror 8: 0x1d05494d (stale) Mirror 9: 0x87d459d5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000280 1787573583.998778 trunc from 0x040000 to 0x02afc7 (0x15038 bytes) 000282 1787573584.047037 mapread 0x00c171 thru 0x012a5e (0x68ee bytes) 000283 1787573584.066785 trunc from 0x008df6 to 0x00eb1d (0x5d28 bytes) 000284 1787573584.071671 write 0x0392a9 thru 0x039bff (0x957 bytes) 000286 1787573584.073259 trunc from 0x022f4e to 0x02385a (0x90d bytes) 000287 1787573584.078772 write 0x01271f thru 0x017ae4 (0x53c6 bytes) 000288 1787573584.090187 MIRROR_RESYNC 6 mirrors 000289 1787573585.893121 fallocate 0x02c289 thru 0x03bb69 (0xf8e1 bytes) 000290 1787573585.927446 punch from 0x019df9 to 0x01a155 (0x35d bytes) 000291 1787573585.933541 trunc from 0x039c00 to 0x005e1c (0x33de3 bytes) 000292 1787573585.952840 mapwrite 0x030d95 thru 0x03b52b (0xa797 bytes) 000293 1787573586.008096 trunc from 0x016be1 to 0x01d19c (0x65bc bytes) 000295 1787573586.016792 MIRROR_RESYNC 6 mirrors 000296 1787573586.950311 punch from 0x015f53 to 0x021e60 (0xbf0e bytes) 000297 1787573586.983042 punch from 0x035d41 to 0x03b52b (0x57eb bytes) 000298 1787573586.989347 write 0x025b02 thru 0x032300 (0xc7ff bytes) 000299 1787573587.009420 MIRROR_RESYNC 6 mirrors 000300 1787573588.162482 mapwrite 0x004867 thru 0x00c665 (0x7dff bytes) 000301 1787573588.253580 mapread 0x002cd6 thru 0x007b84 (0x4eaf bytes) 000302 1787573588.254941 mapwrite 0x014901 thru 0x017d2d (0x342d bytes) 000303 1787573588.282109 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3b52c): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b52c): Mirror 4: 0x9f5183ee (stale) Mirror 6: 0x9f5183ee (stale) Mirror 7: 0x9f5183ee (stale) Mirror 8: 0x9f5183ee (stale) Mirror 9: 0x9f5183ee (stale) CRC-32 checksum value for chunk [0, 0x3b52c): Mirror 1: 0xc4aa601d Mirror 10: 0xc4aa601d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b52c: skipped 000304 1787573589.230516 mapwrite 0x02de54 thru 0x039047 (0xb1f4 bytes) 000306 1787573589.355688 mapread 0x00275c thru 0x00847a (0x5d1f bytes) 000307 1787573589.372469 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b52c): Mirror 4: 0x9f5183ee (stale) Mirror 6: 0x9f5183ee (stale) Mirror 7: 0x9f5183ee (stale) Mirror 9: 0x9f5183ee (stale) Mirror 10: 0xc4aa601d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b52c): Mirror 4: 0x9f5183ee (stale) Mirror 6: 0x9f5183ee (stale) Mirror 7: 0x9f5183ee (stale) Mirror 9: 0x9f5183ee (stale) Mirror 10: 0xc4aa601d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b52c: skipped 000308 1787573590.113205 fallocate 0x0264b6 thru 0x02cec2 (0x6a0d bytes) 000309 1787573590.121785 trunc from 0x03b52c to 0x01eba4 (0x1c987 bytes) 000310 1787573590.221579 fallocate 0x038ae6 thru 0x03b5ee (0x2b09 bytes) 000312 1787573590.229712 mapwrite 0x031bad thru 0x03ffff (0xe453 bytes) 000314 1787573590.299715 trunc from 0x015ada to 0x01f327 (0x984e bytes) 000315 1787573590.306123 read 0x0180c2 thru 0x019401 (0x1340 bytes) 000316 1787573590.313511 trunc from 0x040000 to 0x03a4d4 (0x5b2b bytes) 000317 1787573590.333567 mapwrite 0x005a01 thru 0x00b4c9 (0x5ac9 bytes) 000318 1787573590.363205 trunc from 0x03a4d5 to 0x00c011 (0x2e4c3 bytes) 000320 1787573590.382422 trunc from 0x00c012 to 0x03db35 (0x31b24 bytes) 000321 1787573590.400042 mapwrite 0x005b7f thru 0x00740a (0x188c bytes) 000323 1787573590.412519 mapread 0x035243 thru 0x03db35 (0x88f3 bytes) 000324 1787573590.424650 read 0x03b1b8 thru 0x03db35 (0x297e bytes) 000325 1787573590.426552 punch from 0x031572 to 0x0388b9 (0x7348 bytes) 000326 1787573590.430510 mapwrite 0x02d0cc thru 0x035d54 (0x8c89 bytes) 000327 1787573590.458615 trunc from 0x03db36 to 0x02f6ce (0xe467 bytes) 000328 1787573590.471658 write 0x021d7f thru 0x0317e4 (0xfa66 bytes) 000329 1787573590.474489 mapread 0x00c956 thru 0x012fda (0x6685 bytes) 000331 1787573590.477599 trunc from 0x024243 to 0x02f167 (0xaf25 bytes) 000332 1787573590.496283 punch from 0x01762e to 0x024a95 (0xd468 bytes) 000333 1787573590.506467 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x317e5): Mirror 4: 0xddc509ca (stale) Mirror 6: 0xddc509ca (stale) Mirror 9: 0xddc509ca (stale) Mirror 10: 0x1bf9bb99 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x317e5): Mirror 4: 0xddc509ca (stale) Mirror 6: 0xddc509ca (stale) Mirror 9: 0xddc509ca (stale) Mirror 10: 0x1bf9bb99 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x317e5: skipped 000334 1787573590.996746 read 0x00be27 thru 0x01537e (0x9558 bytes) 000335 1787573591.006472 fallocate 0x01e5f9 thru 0x0233b1 (0x4db9 bytes) 000336 1787573591.012547 mapread 0x02338d thru 0x02f124 (0xbd98 bytes) 000337 1787573591.038199 mapwrite 0x03dd32 thru 0x03ffff (0x22ce bytes) 000338 1787573591.093942 mapread 0x01e103 thru 0x01ee4b (0xd49 bytes) 000339 1787573591.095488 punch from 0x01d1aa to 0x02483e (0x7695 bytes) 000340 1787573591.104321 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x7f95c296 (stale) Mirror 9: 0x7f95c296 (stale) Mirror 10: 0xa2ef4d30 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x7f95c296 (stale) Mirror 9: 0x7f95c296 (stale) Mirror 10: 0xa2ef4d30 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000341 1787573591.454534 mapwrite 0x017306 thru 0x0259c7 (0xe6c2 bytes) 000342 1787573591.500698 mapread 0x0166e6 thru 0x01d4c5 (0x6de0 bytes) 000343 1787573591.502379 mapread 0x03b685 thru 0x03d789 (0x2105 bytes) 000344 1787573591.510494 punch from 0x025c47 to 0x027d4a (0x2104 bytes) 000345 1787573591.515232 write 0x02e315 thru 0x03be9f (0xdb8b bytes) 000346 1787573591.525496 mapread 0x02004d thru 0x02bf3c (0xbef0 bytes) 000347 1787573591.535765 trunc from 0x040000 to 0x039997 (0x6668 bytes) 000348 1787573591.549587 read 0x022090 thru 0x0254ea (0x345b bytes) 000349 1787573591.550604 fallocate 0x02047a thru 0x023780 (0x3307 bytes) 000350 1787573591.559941 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39998): Mirror 9: 0x33ab62a1 (stale) Mirror 10: 0xf95107b1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39998): Mirror 9: 0x33ab62a1 (stale) Mirror 10: 0xf95107b1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39998: skipped 000351 1787573591.813554 punch from 0x0361ee to 0x039997 (0x37aa bytes) 000352 1787573591.818714 trunc from 0x00866d to 0x00c9c8 (0x435c bytes) 000353 1787573591.824394 fallocate 0x03d332 thru 0x03ffff (0x2cce bytes) 000354 1787573591.829104 fallocate 0x0002a6 thru 0x00f068 (0xedc3 bytes) 000355 1787573591.833653 punch from 0x02ceca to 0x02eec8 (0x1fff bytes) 000356 1787573591.837744 read 0x031fd3 thru 0x033d37 (0x1d65 bytes) 000357 1787573591.842943 punch from 0x006a14 to 0x00b17f (0x476c bytes) 000358 1787573591.848409 trunc from 0x040000 to 0x0188ca (0x27735 bytes) 000359 1787573591.870186 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x188cb): Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x188cb): Mirror 9: 0x5dde2adb (stale) Mirror 10: 0xa87e7b1f (stale) CRC-32 checksum value for chunk [0, 0x188cb): Mirror 1: 0x3440b42b Mirror 11: 0x3440b42b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x188cb: skipped 000360 1787573592.882223 mapwrite 0x02d0db thru 0x02d5be (0x4e4 bytes) 000361 1787573593.030798 trunc from 0x01f255 to 0x01f918 (0x6c4 bytes) 000362 1787573593.050134 write 0x02a59d thru 0x02fce1 (0x5745 bytes) 000363 1787573593.072664 trunc from 0x0001cd to 0x00d5bd (0xd3f1 bytes) 000364 1787573593.084153 fallocate 0x00f241 thru 0x01bc68 (0xca28 bytes) 000365 1787573593.099805 punch from 0x00bbb0 to 0x01b49a (0xf8eb bytes) 000366 1787573593.115386 fallocate 0x03c7fc thru 0x03ffff (0x3804 bytes) 000367 1787573593.126521 trunc from 0x02ca2c to 0x02fce1 (0x32b6 bytes) 000368 1787573593.147133 read 0x0070f5 thru 0x00a00c (0x2f18 bytes) 000369 1787573593.166524 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fce2): Mirror 10: 0x4a027c84 (stale) Mirror 11: 0x2b4f468e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fce2): Mirror 10: 0x4a027c84 (stale) Mirror 11: 0x2b4f468e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fce2: skipped 000370 1787573593.590982 trunc from 0x02fce2 to 0x02654c (0x9795 bytes) 000371 1787573593.614067 fallocate 0x031f96 thru 0x03f04b (0xd0b6 bytes) 000372 1787573593.620589 fallocate 0x0030eb thru 0x011201 (0xe117 bytes) 000373 1787573593.629534 MIRROR_RESYNC 3 mirrors 000374 1787573594.390467 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) 000375 1787573594.813799 mapwrite 0x0345af thru 0x039e38 (0x588a bytes) 000376 1787573594.975980 read 0x01e0ea thru 0x01e297 (0x1ae bytes) 000377 1787573594.986530 write 0x03adea thru 0x03ffff (0x5216 bytes) 000378 1787573594.998484 mapwrite 0x012680 thru 0x015e73 (0x37f4 bytes) 000379 1787573595.035435 punch from 0x025b30 to 0x03462a (0xeafb bytes) 000381 1787573595.053190 write 0x03c6a7 thru 0x03ffff (0x3959 bytes) 000382 1787573595.058798 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) 000383 1787573595.223493 trunc from 0x005b1f to 0x00810a (0x25ec bytes) 000384 1787573595.228434 read 0x00e193 thru 0x016067 (0x7ed5 bytes) 000385 1787573595.243482 punch from 0x00871c to 0x00f536 (0x6e1b bytes) 000386 1787573595.250108 mapwrite 0x01efb6 thru 0x026473 (0x74be bytes) 000387 1787573595.289873 mapwrite 0x00826d thru 0x00e3a0 (0x6134 bytes) 000388 1787573595.318947 mapread 0x02d58b thru 0x03462f (0x70a5 bytes) 000389 1787573595.329942 write 0x039040 thru 0x03ffff (0x6fc0 bytes) 000390 1787573595.340891 write 0x01f687 thru 0x021695 (0x200f bytes) 000391 1787573595.342017 mapwrite 0x02667a thru 0x02cfb6 (0x693d bytes) 000392 1787573595.366444 mapwrite 0x034738 thru 0x0372ed (0x2bb6 bytes) 000394 1787573595.386676 fallocate 0x021d72 thru 0x02276f (0x9fe bytes) 000396 1787573595.391399 read 0x00cae1 thru 0x01321b (0x673b bytes) 000397 1787573595.392414 fallocate 0x002cfa thru 0x003f82 (0x1289 bytes) 000398 1787573595.397611 trunc from 0x040000 to 0x0130a6 (0x2cf59 bytes) 000400 1787573595.439401 fallocate 0x02fc8d thru 0x038d7a (0x90ee bytes) 000401 1787573595.445172 trunc from 0x020240 to 0x0298fa (0x96bb bytes) 000402 1787573595.450533 write 0x032c4f thru 0x03aa55 (0x7e07 bytes) 000403 1787573595.461564 fallocate 0x004fc8 thru 0x0128f8 (0xd931 bytes) 000404 1787573595.466430 trunc from 0x03aa56 to 0x03e858 (0x3e03 bytes) 000405 1787573595.493238 mapwrite 0x021992 thru 0x02b372 (0x99e1 bytes) 000406 1787573595.510469 mapwrite 0x036681 thru 0x039f42 (0x38c2 bytes) 000407 1787573595.522474 trunc from 0x03e859 to 0x01e4c8 (0x20390 bytes) 000409 1787573595.536559 fallocate 0x0382bc thru 0x03ffff (0x7d44 bytes) 000411 1787573595.546434 fallocate 0x02bbdb thru 0x03ab22 (0xef48 bytes) 000412 1787573595.550986 trunc from 0x03ab23 to 0x002da0 (0x37d82 bytes) 000413 1787573595.564005 trunc from 0x001646 to 0x002da0 (0x175b bytes) 000414 1787573595.575466 trunc from 0x001fcc to 0x002da0 (0xdd5 bytes) 000415 1787573595.579441 mapwrite 0x0086cb thru 0x00a8c9 (0x21ff bytes) 000416 1787573595.624771 trunc from 0x007a67 to 0x00a8c9 (0x2e63 bytes) 000417 1787573595.630546 fallocate 0x021210 thru 0x02985b (0x864c bytes) 000419 1787573595.639395 mapwrite 0x035ed6 thru 0x03ba9c (0x5bc7 bytes) 000420 1787573595.704389 write 0x017fc0 thru 0x01feee (0x7f2f bytes) 000421 1787573595.722520 MIRROR_EXTEND to 2 mirrors 000422 1787573596.703175 MIRROR_RESYNC 2 mirrors 000423 1787573597.151993 read 0x027ad7 thru 0x031a9e (0x9fc8 bytes) 000425 1787573597.179422 trunc from 0x006030 to 0x014f32 (0xef03 bytes) 000426 1787573597.211881 mapwrite 0x021409 thru 0x02d680 (0xc278 bytes) 000427 1787573597.249637 trunc from 0x00126a to 0x0043d2 (0x3169 bytes) 000428 1787573597.255056 write 0x01b0f6 thru 0x026b4b (0xba56 bytes) 000429 1787573597.263879 mapread 0x00fa12 thru 0x010c75 (0x1264 bytes) 000430 1787573597.275446 fallocate 0x033088 thru 0x03eaa4 (0xba1d bytes) 000431 1787573597.279452 trunc from 0x03b064 to 0x03ba9c (0xa39 bytes) 000432 1787573597.284068 trunc from 0x03ba9d to 0x0150d4 (0x269c8 bytes) 000433 1787573597.301561 punch from 0x00edb3 to 0x0150d4 (0x6322 bytes) 000435 1787573597.306942 fallocate 0x014c76 thru 0x023062 (0xe3ed bytes) 000436 1787573597.311653 read 0x001dda thru 0x00ba60 (0x9c87 bytes) 000437 1787573597.321235 mapwrite 0x0325da thru 0x039caf (0x76d6 bytes) 000438 1787573597.362568 write 0x032160 thru 0x03729c (0x513d bytes) 000439 1787573597.363752 fallocate 0x035fdd thru 0x03ffff (0xa023 bytes) 000440 1787573597.372685 MIRROR_RESYNC 2 mirrors 000441 1787573598.152887 trunc from 0x039cb0 to 0x011f48 (0x27d67 bytes) 000442 1787573598.260192 fallocate 0x00e9be thru 0x010544 (0x1b87 bytes) 000443 1787573598.272928 mapread 0x01074f thru 0x011f48 (0x17fa bytes) 000444 1787573598.300548 read 0x00de8b thru 0x011f48 (0x40be bytes) 000445 1787573598.311595 fallocate 0x01c39c thru 0x01d8fa (0x155f bytes) 000446 1787573598.326465 fallocate 0x0292f5 thru 0x02de30 (0x4b3c bytes) 000447 1787573598.331575 mapread 0x001622 thru 0x00bb46 (0xa525 bytes) 000448 1787573598.363201 mapwrite 0x027947 thru 0x033341 (0xb9fb bytes) 000449 1787573598.478486 punch from 0x0041fe to 0x007d8c (0x3b8f bytes) 000450 1787573598.487870 trunc from 0x033342 to 0x03611b (0x2dda bytes) 000451 1787573598.529491 punch from 0x0024b4 to 0x0062d2 (0x3e1f bytes) 000452 1787573598.546793 mapwrite 0x03ca5f thru 0x03ffff (0x35a1 bytes) 000453 1787573598.621324 trunc from 0x040000 to 0x03219a (0xde65 bytes) 000454 1787573598.651858 fallocate 0x020919 thru 0x025187 (0x486f bytes) 000455 1787573598.666060 trunc from 0x03219b to 0x022b9a (0xf600 bytes) 000456 1787573598.686799 trunc from 0x022b9b to 0x03bea2 (0x19308 bytes) 000457 1787573598.712754 trunc from 0x0118ff to 0x01564d (0x3d4f bytes) 000458 1787573598.724073 mapwrite 0x010dec thru 0x0206a5 (0xf8ba bytes) 000459 1787573598.790292 trunc from 0x014601 to 0x015396 (0xd96 bytes) 000460 1787573598.803187 punch from 0x02ccd9 to 0x03462d (0x7955 bytes) 000462 1787573598.813661 fallocate 0x033c85 thru 0x03ffff (0xc37b bytes) 000463 1787573598.828978 fallocate 0x0103a3 thru 0x0196a8 (0x9306 bytes) 000464 1787573598.842134 write 0x01e0b8 thru 0x020687 (0x25d0 bytes) 000465 1787573598.861899 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) 000466 1787573599.132514 fallocate 0x00de31 thru 0x01ab67 (0xcd37 bytes) 000467 1787573599.140753 write 0x008a58 thru 0x014456 (0xb9ff bytes) 000468 1787573599.174981 mapread 0x034949 thru 0x03bea2 (0x755a bytes) 000469 1787573599.205863 trunc from 0x010dcb to 0x01e9ee (0xdc24 bytes) 000470 1787573599.227360 punch from 0x0173f7 to 0x01bb24 (0x472e bytes) 000472 1787573599.234233 write 0x03434b thru 0x03c967 (0x861d bytes) 000473 1787573599.235616 read 0x022fb4 thru 0x0277b7 (0x4804 bytes) 000474 1787573599.247426 mapread 0x035549 thru 0x03735f (0x1e17 bytes) 000475 1787573599.252897 MIRROR_EXTEND to 2 mirrors 000476 1787573600.109345 mapwrite 0x0384b6 thru 0x03e55c (0x60a7 bytes) 000477 1787573600.294481 punch from 0x0263fc to 0x0314f1 (0xb0f6 bytes) 000478 1787573600.304350 trunc from 0x037ea4 to 0x03c743 (0x48a0 bytes) 000479 1787573600.316917 fallocate 0x0006cd thru 0x00965c (0x8f90 bytes) 000480 1787573600.327908 mapwrite 0x02591d thru 0x030fbd (0xb6a1 bytes) 000482 1787573600.382770 mapwrite 0x01f7b3 thru 0x02f2eb (0xfb39 bytes) 000483 1787573600.446540 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e55d): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e55d): Mirror 2: 0xead8500e (stale) CRC-32 checksum value for chunk [0, 0x3e55d): Mirror 1: 0x7d316e45 Mirror 3: 0x7d316e45 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e55d: skipped 000484 1787573602.032000 MIRROR_RESYNC 3 mirrors 000485 1787573603.102016 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) 000486 1787573603.387444 read 0x035c39 thru 0x03cf46 (0x730e bytes) 000488 1787573603.400605 write 0x010abb thru 0x0123ef (0x1935 bytes) 000489 1787573603.476493 MIRROR_RESYNC 2 mirrors 000490 1787573604.205885 read 0x016cbc thru 0x0209f7 (0x9d3c bytes) 000491 1787573604.218117 trunc from 0x03e55d to 0x02ee90 (0xf6cc bytes) 000492 1787573604.266284 trunc from 0x01e9c0 to 0x023c54 (0x5295 bytes) 000493 1787573604.272464 trunc from 0x00d536 to 0x013539 (0x6004 bytes) 000494 1787573604.278744 mapwrite 0x03ec0c thru 0x03ffff (0x13f4 bytes) 000495 1787573604.329465 write 0x00eb4a thru 0x01bb43 (0xcffa bytes) 000496 1787573604.343602 read 0x03516b thru 0x0396c9 (0x455f bytes) 000497 1787573604.364295 punch from 0x034a13 to 0x036499 (0x1a87 bytes) 000498 1787573604.371430 punch from 0x029a30 to 0x032ee4 (0x94b5 bytes) 000499 1787573604.380286 mapread 0x00786e thru 0x010cf1 (0x9484 bytes) 000500 1787573604.383513 mapread 0x0197c7 thru 0x01dbb5 (0x43ef bytes) 000501 1787573604.386801 trunc from 0x03ef28 to 0x03ffff (0x10d8 bytes) 000502 1787573604.396047 fallocate 0x01439a thru 0x0156e1 (0x1348 bytes) 000503 1787573604.401852 write 0x01fcbd thru 0x02b721 (0xba65 bytes) 000504 1787573604.408796 punch from 0x006ca7 to 0x01308a (0xc3e4 bytes) 000505 1787573604.433431 trunc from 0x0131dc to 0x01b444 (0x8269 bytes) 000506 1787573604.442800 read 0x024802 thru 0x02579f (0xf9e bytes) 000507 1787573604.443865 trunc from 0x01a7df to 0x01eec3 (0x46e5 bytes) 000508 1787573604.450694 fallocate 0x01eefe thru 0x02e393 (0xf496 bytes) 000509 1787573604.461707 mapread 0x014f40 thru 0x01668b (0x174c bytes) 000511 1787573604.513470 read 0x00c247 thru 0x010355 (0x410f bytes) 000512 1787573604.514540 fallocate 0x01b35b thru 0x0211b7 (0x5e5d bytes) 000513 1787573604.521755 fallocate 0x00921d thru 0x00a1d0 (0xfb4 bytes) 000514 1787573604.527270 fallocate 0x024260 thru 0x027f09 (0x3caa bytes) 000515 1787573604.534782 mapwrite 0x024661 thru 0x025774 (0x1114 bytes) 000516 1787573604.576535 fallocate 0x003a98 thru 0x00ed19 (0xb282 bytes) 000517 1787573604.591779 write 0x03fef7 thru 0x03ffff (0x109 bytes) 000519 1787573604.593601 trunc from 0x031e15 to 0x032d29 (0xf15 bytes) 000520 1787573604.621006 read 0x03f012 thru 0x03ffff (0xfee bytes) 000521 1787573604.621568 trunc from 0x01d292 to 0x029335 (0xc0a4 bytes) 000522 1787573604.640250 trunc from 0x037e5d to 0x03a531 (0x26d5 bytes) 000523 1787573604.649929 read 0x015faf thru 0x0205d9 (0xa62b bytes) 000524 1787573604.678007 mapread 0x02aad3 thru 0x03823d (0xd76b bytes) 000525 1787573604.686081 mapread 0x0212e9 thru 0x02996c (0x8684 bytes) 000526 1787573604.693754 read 0x03959d thru 0x03fe8b (0x68ef bytes) 000527 1787573604.698361 write 0x023936 thru 0x02e2bd (0xa988 bytes) 000528 1787573604.701742 punch from 0x037295 to 0x03ffff (0x8d6b bytes) 000529 1787573604.724605 trunc from 0x040000 to 0x01b647 (0x249b8 bytes) 000530 1787573604.753697 punch from 0x000d23 to 0x007205 (0x64e3 bytes) 000531 1787573604.773450 read 0x00659c thru 0x0153d7 (0xee3c bytes) 000532 1787573604.797161 trunc from 0x01abef to 0x01b647 (0xa59 bytes) 000533 1787573604.805735 mapwrite 0x009601 thru 0x014d63 (0xb763 bytes) 000534 1787573604.845770 mapwrite 0x01769f thru 0x017aef (0x451 bytes) 000535 1787573604.876730 MIRROR_RESYNC 2 mirrors 000536 1787573605.739774 write 0x022109 thru 0x02c8e3 (0xa7db bytes) 000537 1787573605.759939 mapwrite 0x030e0c thru 0x034cab (0x3ea0 bytes) 000539 1787573605.819689 fallocate 0x008a16 thru 0x00a815 (0x1e00 bytes) 000540 1787573605.824236 fallocate 0x026c6e thru 0x033c1d (0xcfb0 bytes) 000541 1787573605.828739 punch from 0x01b3df to 0x024937 (0x9559 bytes) 000543 1787573605.837209 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) 000544 1787573605.963479 trunc from 0x021089 to 0x0215d1 (0x549 bytes) 000546 1787573605.977209 MIRROR_EXTEND to 2 mirrors 000547 1787573607.052262 trunc from 0x003978 to 0x003c0d (0x296 bytes) 000548 1787573607.124012 read 0x01086b thru 0x01d067 (0xc7fd bytes) 000549 1787573607.142045 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x34cac): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34cac): Mirror 2: 0xf3a69574 (stale) CRC-32 checksum value for chunk [0, 0x34cac): Mirror 1: 0xf3a69574 Mirror 3: 0xf3a69574 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34cac: skipped 000550 1787573608.629892 mapread 0x001f22 thru 0x011943 (0xfa22 bytes) 000551 1787573608.672746 punch from 0x019879 to 0x019b52 (0x2da bytes) 000552 1787573608.713640 trunc from 0x033130 to 0x034cab (0x1b7c bytes) 000553 1787573608.717738 write 0x03af6a thru 0x03ffff (0x5096 bytes) 000554 1787573608.722243 read 0x028e0d thru 0x03152d (0x8721 bytes) 000555 1787573608.730104 trunc from 0x02de81 to 0x03077b (0x28fb bytes) 000556 1787573608.734893 write 0x03c871 thru 0x03ffff (0x378f bytes) 000557 1787573608.736418 trunc from 0x02aa4d to 0x031b4a (0x70fe bytes) 000558 1787573608.742230 mapwrite 0x01dc9d thru 0x027d2f (0xa093 bytes) 000560 1787573608.786143 mapread 0x0076c2 thru 0x00be51 (0x4790 bytes) 000561 1787573608.798195 read 0x02a3c9 thru 0x036fcc (0xcc04 bytes) 000562 1787573608.810706 fallocate 0x001d35 thru 0x00970e (0x79da bytes) 000563 1787573608.815578 write 0x016905 thru 0x01c98e (0x608a bytes) 000564 1787573608.816638 mapwrite 0x00804b thru 0x00dc70 (0x5c26 bytes) 000565 1787573608.841345 mapread 0x020126 thru 0x026f0a (0x6de5 bytes) 000566 1787573608.842162 mapread 0x020492 thru 0x02bb1d (0xb68c bytes) 000567 1787573608.842948 trunc from 0x0313c8 to 0x03c90b (0xb544 bytes) 000568 1787573608.852116 read 0x03a7a4 thru 0x03d9ac (0x3209 bytes) 000569 1787573608.867091 read 0x013286 thru 0x01734b (0x40c6 bytes) 000571 1787573608.869429 mapread 0x03c165 thru 0x03ffff (0x3e9b bytes) 000572 1787573608.871311 mapwrite 0x03ca0c thru 0x03ffff (0x35f4 bytes) 000573 1787573608.886569 trunc from 0x040000 to 0x019b72 (0x2648d bytes) 000574 1787573608.912318 write 0x02fecf thru 0x03d221 (0xd353 bytes) 000575 1787573608.915586 fallocate 0x01134b thru 0x0168d9 (0x558f bytes) 000576 1787573608.921246 trunc from 0x032ba8 to 0x03b93f (0x8d98 bytes) 000577 1787573608.933539 write 0x0370a0 thru 0x03ffff (0x8f60 bytes) 000578 1787573608.968726 trunc from 0x01e29c to 0x029bb5 (0xb91a bytes) 000579 1787573608.973321 mapread 0x0189bc thru 0x0283ce (0xfa13 bytes) 000580 1787573609.020124 fallocate 0x02d522 thru 0x0390e4 (0xbbc3 bytes) 000581 1787573609.024358 write 0x0239e0 thru 0x02db2a (0xa14b bytes) 000582 1787573609.026286 write 0x00c769 thru 0x012382 (0x5c1a bytes) 000583 1787573609.027569 mapread 0x017143 thru 0x0207c3 (0x9681 bytes) 000584 1787573609.029614 trunc from 0x040000 to 0x01bd73 (0x2428c bytes) 000586 1787573609.055466 write 0x0335b8 thru 0x036ba0 (0x35e9 bytes) 000587 1787573609.056590 punch from 0x014a97 to 0x016129 (0x1693 bytes) 000588 1787573609.081209 write 0x027087 thru 0x033c81 (0xcbfb bytes) 000589 1787573609.092154 write 0x023dbe thru 0x030ed4 (0xd117 bytes) 000591 1787573609.103716 trunc from 0x028f36 to 0x036ba0 (0xdc6b bytes) 000592 1787573609.131523 trunc from 0x036ba1 to 0x02dcf5 (0x8eab bytes) 000593 1787573609.158104 fallocate 0x03b916 thru 0x03ffff (0x46ea bytes) 000594 1787573609.184076 MIRROR_RESYNC 3 mirrors 000595 1787573610.139497 fallocate 0x0146f1 thru 0x023542 (0xee52 bytes) 000596 1787573610.191867 punch from 0x02ec8f to 0x03b93d (0xccaf bytes) 000597 1787573610.197589 trunc from 0x026fcd to 0x02d39c (0x63d0 bytes) 000598 1787573610.204553 mapread 0x027703 thru 0x0368f0 (0xf1ee bytes) 000599 1787573610.296071 read 0x034102 thru 0x035f02 (0x1e01 bytes) 000600 1787573610.300606 read 0x037409 thru 0x03fb32 (0x872a bytes) 000601 1787573610.316649 write 0x010fec thru 0x01f8cf (0xe8e4 bytes) 000602 1787573610.321159 mapread 0x034908 thru 0x03e2c5 (0x99be bytes) 000603 1787573610.324581 write 0x02d801 thru 0x033011 (0x5811 bytes) 000604 1787573610.326567 fallocate 0x004519 thru 0x004f26 (0xa0e bytes) 000605 1787573610.336769 trunc from 0x02b489 to 0x036ef4 (0xba6c bytes) 000606 1787573610.362101 read 0x008ccf thru 0x015957 (0xcc89 bytes) 000607 1787573610.363000 write 0x02ab9e thru 0x039141 (0xe5a4 bytes) 000608 1787573610.400231 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x260780de (stale) Mirror 3: 0x260780de (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x611b2c1f Mirror 4: 0x611b2c1f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000609 1787573611.409499 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x260780de (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x260780de (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x611b2c1f Mirror 4: 0x611b2c1f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000610 1787573612.028397 trunc from 0x040000 to 0x009220 (0x36ddf bytes) 000611 1787573612.143688 mapwrite 0x002e23 thru 0x00e1a3 (0xb381 bytes) 000612 1787573612.223679 read 0x00106f thru 0x005eb6 (0x4e48 bytes) 000613 1787573612.224792 mapwrite 0x02ab91 thru 0x0358eb (0xad5b bytes) 000614 1787573612.350243 mapread 0x017932 thru 0x01bafc (0x41cb bytes) 000615 1787573612.364065 mapread 0x0327dd thru 0x0358eb (0x310f bytes) 000616 1787573612.365408 mapread 0x002ef6 thru 0x00da75 (0xab80 bytes) 000617 1787573612.367712 punch from 0x013b5b to 0x01eb58 (0xaffe bytes) 000618 1787573612.374190 trunc from 0x0358ec to 0x01c134 (0x197b7 bytes) 000619 1787573612.396704 mapread 0x011c62 thru 0x015406 (0x37a5 bytes) 000620 1787573612.414118 read 0x00640a thru 0x0086a1 (0x2298 bytes) 000621 1787573612.415037 punch from 0x00ca06 to 0x01497a (0x7f75 bytes) 000622 1787573612.422399 read 0x000cbd thru 0x004856 (0x3b9a bytes) 000623 1787573612.439197 fallocate 0x013941 thru 0x01652c (0x2bec bytes) 000624 1787573612.446976 fallocate 0x03afce thru 0x03f73c (0x476f bytes) 000625 1787573612.462801 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3f73d): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f73d): Mirror 2: 0x45df1b90 (stale) Mirror 4: 0x93102063 (stale) CRC-32 checksum value for chunk [0, 0x3f73d): Mirror 1: 0xde93a5fc Mirror 5: 0xde93a5fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f73d: skipped 000626 1787573613.534015 MIRROR_RESYNC 4 mirrors 000627 1787573614.372062 read 0x0146da thru 0x022caf (0xe5d6 bytes) 000628 1787573614.386788 punch from 0x003f6c to 0x0115e8 (0xd67d bytes) 000629 1787573614.474100 trunc from 0x02828c to 0x030013 (0x7d88 bytes) 000630 1787573614.483149 mapread 0x018b9a thru 0x020b50 (0x7fb7 bytes) 000631 1787573614.508942 write 0x01b242 thru 0x02747b (0xc23a bytes) 000632 1787573614.521963 trunc from 0x0220df to 0x027fe7 (0x5f09 bytes) 000633 1787573614.542511 fallocate 0x01a41d thru 0x025680 (0xb264 bytes) 000635 1787573614.553682 read 0x019270 thru 0x023005 (0x9d96 bytes) 000636 1787573614.578787 fallocate 0x037f57 thru 0x03ffff (0x80a9 bytes) 000637 1787573614.596556 trunc from 0x00f939 to 0x01c7db (0xcea3 bytes) 000639 1787573614.609302 read 0x029f9f thru 0x03302b (0x908d bytes) 000640 1787573614.612389 trunc from 0x040000 to 0x017622 (0x289dd bytes) 000641 1787573614.690941 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x17623): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17623): Mirror 2: 0x15e019b9 (stale) Mirror 4: 0x15e019b9 (stale) Mirror 5: 0x15e019b9 (stale) CRC-32 checksum value for chunk [0, 0x17623): Mirror 1: 0x7956cdae Mirror 6: 0x7956cdae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17623: skipped 000642 1787573615.387715 punch from 0x00ef8c to 0x010c45 (0x1cba bytes) 000643 1787573615.445416 write 0x001b90 thru 0x0024b7 (0x928 bytes) 000644 1787573615.463340 mapread 0x011228 thru 0x016576 (0x534f bytes) 000645 1787573615.494060 mapwrite 0x010af3 thru 0x014f43 (0x4451 bytes) 000646 1787573615.512013 mapread 0x00c42d thru 0x012532 (0x6106 bytes) 000647 1787573615.513217 fallocate 0x039a84 thru 0x03ffff (0x657c bytes) 000648 1787573615.518144 mapread 0x00bb49 thru 0x017622 (0xbada bytes) 000649 1787573615.530381 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x17623): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17623): Mirror 2: 0x15e019b9 (stale) Mirror 4: 0x15e019b9 (stale) Mirror 5: 0x15e019b9 (stale) Mirror 6: 0x7956cdae (stale) CRC-32 checksum value for chunk [0, 0x17623): Mirror 1: 0x34ca8863 Mirror 7: 0x34ca8863 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17623: skipped 000650 1787573616.326116 trunc from 0x00141b to 0x00b682 (0xa268 bytes) 000651 1787573616.378473 punch from 0x0072eb to 0x0131fc (0xbf12 bytes) 000652 1787573616.392737 punch from 0x00309d to 0x0042c2 (0x1226 bytes) 000653 1787573616.397637 read 0x012f94 thru 0x017622 (0x468f bytes) 000654 1787573616.406526 punch from 0x00670c to 0x00c296 (0x5b8b bytes) 000657 1787573616.412085 trunc from 0x017623 to 0x03dec2 (0x268a0 bytes) 000658 1787573616.472384 fallocate 0x021681 thru 0x024a60 (0x33e0 bytes) 000659 1787573616.477750 mapwrite 0x014101 thru 0x019777 (0x5677 bytes) 000660 1787573616.516461 trunc from 0x03dec3 to 0x0296ee (0x147d4 bytes) 000661 1787573616.533002 mapread 0x013c18 thru 0x018c9f (0x5088 bytes) 000662 1787573616.540934 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x296ef): Mirror 4: 0x5568e005 (stale) Mirror 5: 0x5568e005 (stale) Mirror 6: 0xe0d7945 (stale) Mirror 7: 0x94bb2d66 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x296ef): Mirror 4: 0x5568e005 (stale) Mirror 5: 0x5568e005 (stale) Mirror 6: 0xe0d7945 (stale) Mirror 7: 0x94bb2d66 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x296ef: skipped 000663 1787573616.916442 write 0x008ca4 thru 0x00b0e9 (0x2446 bytes) 000664 1787573616.938465 trunc from 0x01fedf to 0x026bea (0x6d0c bytes) 000666 1787573616.944606 mapread 0x027895 thru 0x0296ee (0x1e5a bytes) 000667 1787573616.973496 fallocate 0x016894 thru 0x019d0d (0x347a bytes) 000668 1787573616.983423 mapwrite 0x001988 thru 0x0021b0 (0x829 bytes) 000669 1787573617.045920 mapwrite 0x03dfe1 thru 0x03ffff (0x201f bytes) 000670 1787573617.098171 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x52ea6697 (stale) Mirror 5: 0x52ea6697 (stale) Mirror 6: 0xa7fa0bc4 (stale) Mirror 7: 0x6341c569 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8a8dcb80 Mirror 8: 0x8a8dcb80 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000671 1787573617.936389 mapwrite 0x00ae3b thru 0x00d8a6 (0x2a6c bytes) 000672 1787573618.169983 mapread 0x038ce3 thru 0x03ffff (0x731d bytes) 000674 1787573618.202410 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x52ea6697 (stale) Mirror 5: 0x52ea6697 (stale) Mirror 6: 0xa7fa0bc4 (stale) Mirror 8: 0x8a8dcb80 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x52ea6697 (stale) Mirror 5: 0x52ea6697 (stale) Mirror 6: 0xa7fa0bc4 (stale) Mirror 8: 0x8a8dcb80 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000675 1787573618.697523 trunc from 0x000e95 to 0x00bb35 (0xaca1 bytes) 000676 1787573618.707559 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x52ea6697 (stale) Mirror 5: 0x52ea6697 (stale) Mirror 8: 0x8a8dcb80 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x52ea6697 (stale) Mirror 5: 0x52ea6697 (stale) Mirror 8: 0x8a8dcb80 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000677 1787573619.092486 read 0x025446 thru 0x02e12d (0x8ce8 bytes) 000678 1787573619.109063 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x52ea6697 (stale) Mirror 8: 0x8a8dcb80 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x52ea6697 (stale) Mirror 8: 0x8a8dcb80 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000679 1787573619.383901 mapread 0x0142a7 thru 0x0206eb (0xc445 bytes) 000680 1787573619.407243 trunc from 0x02f70a to 0x032a3e (0x3335 bytes) 000681 1787573619.412325 trunc from 0x024cdc to 0x02faa8 (0xadcd bytes) 000682 1787573619.416612 trunc from 0x040000 to 0x021cb0 (0x1e34f bytes) 000683 1787573619.462956 trunc from 0x01236c to 0x021b7f (0xf814 bytes) 000684 1787573619.467444 write 0x006873 thru 0x0118db (0xb069 bytes) 000685 1787573619.472442 read 0x01637b thru 0x021cb0 (0xb936 bytes) 000686 1787573619.479342 fallocate 0x0097c0 thru 0x010a20 (0x7261 bytes) 000687 1787573619.488670 trunc from 0x021cb1 to 0x02d499 (0xb7e9 bytes) 000688 1787573619.499682 trunc from 0x02d49a to 0x011f1e (0x1b57b bytes) 000689 1787573619.521891 trunc from 0x011f1f to 0x018231 (0x6313 bytes) 000690 1787573619.567136 write 0x038b56 thru 0x03ffff (0x74aa bytes) 000691 1787573619.575368 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x8a8dcb80 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x8a8dcb80 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000692 1787573619.978211 trunc from 0x040000 to 0x03ab21 (0x54de bytes) 000693 1787573619.995009 punch from 0x004d34 to 0x009f5c (0x5229 bytes) 000694 1787573620.004356 MIRROR_RESYNC 2 mirrors 000695 1787573620.672207 mapwrite 0x01f09b thru 0x01f15d (0xc3 bytes) 000696 1787573620.771418 read 0x00b049 thru 0x00b76d (0x725 bytes) 000697 1787573620.816461 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) 000698 1787573621.034491 punch from 0x0011f7 to 0x00f123 (0xdf2d bytes) 000700 1787573621.045998 read 0x03930f thru 0x03ab21 (0x1813 bytes) 000702 1787573621.061528 trunc from 0x01be0f to 0x0233f5 (0x75e7 bytes) 000703 1787573621.073282 read 0x033f82 thru 0x03ab21 (0x6ba0 bytes) 000704 1787573621.092966 write 0x037e08 thru 0x03ffff (0x81f8 bytes) 000706 1787573621.107921 write 0x00d514 thru 0x0170ae (0x9b9b bytes) 000707 1787573621.110464 write 0x02cead thru 0x033ac2 (0x6c16 bytes) 000709 1787573621.114943 fallocate 0x014284 thru 0x01d10f (0x8e8c bytes) 000710 1787573621.123884 trunc from 0x0382ed to 0x03ffff (0x7d13 bytes) 000711 1787573621.141219 punch from 0x02242a to 0x02adfa (0x89d1 bytes) 000712 1787573621.144944 trunc from 0x010536 to 0x018098 (0x7b63 bytes) 000714 1787573621.148969 mapwrite 0x025d25 thru 0x02d720 (0x79fc bytes) 000715 1787573621.198342 write 0x0192d9 thru 0x026003 (0xcd2b bytes) 000717 1787573621.204527 read 0x0142c1 thru 0x01aee6 (0x6c26 bytes) 000718 1787573621.216063 trunc from 0x040000 to 0x030f71 (0xf08e bytes) 000719 1787573621.238221 mapwrite 0x032eca thru 0x03ce2b (0x9f62 bytes) 000720 1787573621.367445 fallocate 0x031602 thru 0x032111 (0xb10 bytes) 000721 1787573621.383669 mapread 0x0189aa thru 0x01ff5b (0x75b2 bytes) 000722 1787573621.384638 write 0x026de5 thru 0x02ff6a (0x9186 bytes) 000723 1787573621.385803 mapread 0x038499 thru 0x03ce2b (0x4993 bytes) 000725 1787573621.389987 mapwrite 0x00a051 thru 0x00e72c (0x46dc bytes) 000726 1787573621.413645 write 0x02b1be thru 0x02ba1a (0x85d bytes) 000727 1787573621.414889 read 0x00a5c8 thru 0x0152a4 (0xacdd bytes) 000729 1787573621.418240 write 0x02be3c thru 0x033839 (0x79fe bytes) 000730 1787573621.420417 trunc from 0x03ce2c to 0x03c596 (0x895 bytes) 000732 1787573621.436624 trunc from 0x03c597 to 0x039aae (0x2ae8 bytes) 000734 1787573621.466280 fallocate 0x028b22 thru 0x0378b3 (0xed92 bytes) 000735 1787573621.472629 trunc from 0x039aaf to 0x008586 (0x31528 bytes) 000738 1787573621.515438 mapread 0x007ddb thru 0x008586 (0x7ac bytes) 000739 1787573621.518619 read 0x00436c thru 0x005839 (0x14ce bytes) 000740 1787573621.524314 mapwrite 0x007384 thru 0x00dbc6 (0x6843 bytes) 000741 1787573621.638965 fallocate 0x01f445 thru 0x02e19f (0xed5b bytes) 000742 1787573621.655451 punch from 0x003cac to 0x00b414 (0x7769 bytes) 000743 1787573621.669318 mapwrite 0x02621c thru 0x0322e7 (0xc0cc bytes) 000744 1787573621.745417 mapread 0x012155 thru 0x012f97 (0xe43 bytes) 000745 1787573621.750256 mapwrite 0x028067 thru 0x032ed1 (0xae6b bytes) 000746 1787573621.817116 mapread 0x00f493 thru 0x01261f (0x318d bytes) 000747 1787573621.820171 mapread 0x001eaf thru 0x007d11 (0x5e63 bytes) 000748 1787573621.863211 trunc from 0x032ed2 to 0x02266d (0x10864 bytes) 000750 1787573621.887953 write 0x03f065 thru 0x03ffff (0xf9b bytes) 000751 1787573621.889323 mapread 0x0345cf thru 0x03ba5c (0x748e bytes) 000753 1787573621.900995 mapread 0x02042e thru 0x02f8d7 (0xf4aa bytes) 000756 1787573621.950535 trunc from 0x007ae1 to 0x015404 (0xd924 bytes) 000757 1787573621.955033 punch from 0x008e5b to 0x013e4a (0xaff0 bytes) 000758 1787573621.959434 fallocate 0x00993b thru 0x00cb9d (0x3263 bytes) 000759 1787573621.963445 write 0x0385ad thru 0x03ffff (0x7a53 bytes) 000761 1787573621.965531 trunc from 0x0344ed to 0x03f1f6 (0xad0a bytes) 000762 1787573621.981597 read 0x00af5d thru 0x014420 (0x94c4 bytes) 000763 1787573621.992054 mapwrite 0x02c6e4 thru 0x03638c (0x9ca9 bytes) 000764 1787573622.013019 trunc from 0x040000 to 0x006138 (0x39ec7 bytes) 000765 1787573622.038873 fallocate 0x024aaa thru 0x02acbd (0x6214 bytes) 000766 1787573622.049945 read 0x009cc9 thru 0x00b6b0 (0x19e8 bytes) 000767 1787573622.066729 mapread 0x00700d thru 0x0145ee (0xd5e2 bytes) 000768 1787573622.067650 read 0x00699a thru 0x0143a5 (0xda0c bytes) 000769 1787573622.068170 write 0x03b22e thru 0x03ffff (0x4dd2 bytes) 000770 1787573622.069203 read 0x0188c0 thru 0x01c88b (0x3fcc bytes) 000771 1787573622.072201 fallocate 0x038d9f thru 0x03ffff (0x7261 bytes) 000772 1787573622.079271 mapwrite 0x005e49 thru 0x00fa34 (0x9bec bytes) 000773 1787573622.111295 mapread 0x010d23 thru 0x018855 (0x7b33 bytes) 000775 1787573622.115558 trunc from 0x040000 to 0x019b11 (0x264ee bytes) 000777 1787573622.134200 punch from 0x000586 to 0x00228c (0x1d07 bytes) 000778 1787573622.139622 punch from 0x008ff5 to 0x00b175 (0x2181 bytes) 000779 1787573622.146038 fallocate 0x024145 thru 0x02e556 (0xa412 bytes) 000780 1787573622.151054 mapwrite 0x00d083 thru 0x0120fa (0x5078 bytes) 000782 1787573622.174526 trunc from 0x02e557 to 0x038030 (0x9ada bytes) 000783 1787573622.196012 trunc from 0x0245af to 0x03342e (0xee80 bytes) 000784 1787573622.201506 trunc from 0x011b4a to 0x01bc27 (0xa0de bytes) 000786 1787573622.208964 mapwrite 0x029c8f thru 0x02b065 (0x13d7 bytes) 000787 1787573622.239638 trunc from 0x038031 to 0x02186d (0x167c3 bytes) 000788 1787573622.256628 mapread 0x01fd70 thru 0x02186d (0x1afe bytes) 000789 1787573622.261031 trunc from 0x02186e to 0x03daef (0x1c282 bytes) 000790 1787573622.287233 mapwrite 0x02696e thru 0x02d5b1 (0x6c44 bytes) 000791 1787573622.357190 mapread 0x039a51 thru 0x03daef (0x409f bytes) 000793 1787573622.359518 punch from 0x00535c to 0x013429 (0xe0ce bytes) 000794 1787573622.371519 MIRROR_EXTEND to 2 mirrors 000795 1787573623.107068 write 0x014b37 thru 0x01cfe7 (0x84b1 bytes) 000796 1787573623.158347 fallocate 0x008b96 thru 0x00a258 (0x16c3 bytes) 000797 1787573623.164001 trunc from 0x03daf0 to 0x02a0ea (0x13a05 bytes) 000798 1787573623.204071 punch from 0x0228dd to 0x02a0ea (0x780e bytes) 000800 1787573623.210021 punch from 0x002ea9 to 0x00f90d (0xca65 bytes) 000801 1787573623.220548 trunc from 0x02a0eb to 0x02246a (0x7c80 bytes) 000802 1787573623.243359 punch from 0x008010 to 0x00df1f (0x5f10 bytes) 000803 1787573623.247643 read 0x01d859 thru 0x01dfb6 (0x75e bytes) 000804 1787573623.252938 punch from 0x006a28 to 0x007d83 (0x135c bytes) 000805 1787573623.257944 mapwrite 0x0059eb thru 0x009340 (0x3956 bytes) 000806 1787573623.324062 trunc from 0x021ce0 to 0x02246a (0x78b bytes) 000807 1787573623.338699 trunc from 0x02246b to 0x00e6b6 (0x13db4 bytes) 000808 1787573623.368247 trunc from 0x00e6b7 to 0x0177a1 (0x90eb bytes) 000809 1787573623.383434 write 0x006125 thru 0x00fb94 (0x9a70 bytes) 000810 1787573623.391875 trunc from 0x00f04b to 0x01113c (0x20f2 bytes) 000811 1787573623.407893 trunc from 0x0177a2 to 0x0091a6 (0xe5fb bytes) 000812 1787573623.476296 trunc from 0x0091a7 to 0x033810 (0x2a66a bytes) 000813 1787573623.517612 read 0x0068ac thru 0x00c7af (0x5f04 bytes) 000814 1787573623.544846 trunc from 0x033811 to 0x02903d (0xa7d3 bytes) 000815 1787573623.565741 mapread 0x012c03 thru 0x0158b1 (0x2caf bytes) 000816 1787573623.574395 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2903e): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2903e): Mirror 2: 0x2e4aba66 (stale) CRC-32 checksum value for chunk [0, 0x2903e): Mirror 1: 0xd76abd38 Mirror 3: 0xd76abd38 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2903e: skipped 000817 1787573624.597123 mapwrite 0x00e6ac thru 0x01aa3a (0xc38f bytes) 000818 1787573624.751965 read 0x023a19 thru 0x02903d (0x5625 bytes) 000819 1787573624.770451 trunc from 0x02903e to 0x027735 (0x1908 bytes) 000820 1787573624.836906 punch from 0x010e3c to 0x01e86b (0xda30 bytes) 000821 1787573624.846013 read 0x01706d thru 0x0221cb (0xb15f bytes) 000822 1787573624.868242 write 0x0126dd thru 0x014b44 (0x2468 bytes) 000823 1787573624.869375 mapwrite 0x015786 thru 0x01d06c (0x78e7 bytes) 000824 1787573624.921355 punch from 0x018920 to 0x01a3d4 (0x1ab5 bytes) 000825 1787573624.938423 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x27736): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27736): Mirror 2: 0x8d06c341 (stale) Mirror 3: 0xe0433f74 (stale) CRC-32 checksum value for chunk [0, 0x27736): Mirror 1: 0xb270dc99 Mirror 4: 0xb270dc99 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27736: skipped 000827 1787573626.180713 mapwrite 0x00c6c3 thru 0x014c8e (0x85cc bytes) 000828 1787573626.322729 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x27736): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27736): Mirror 2: 0x8d06c341 (stale) Mirror 3: 0xe0433f74 (stale) Mirror 4: 0xb270dc99 (stale) CRC-32 checksum value for chunk [0, 0x27736): Mirror 1: 0xb1b68a90 Mirror 5: 0xb1b68a90 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27736: skipped 000829 1787573627.651630 mapwrite 0x03d54e thru 0x03ffff (0x2ab2 bytes) 000830 1787573627.739195 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd2837c50 (stale) Mirror 4: 0xd8bef986 (stale) Mirror 5: 0xffb9ea32 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd2837c50 (stale) Mirror 4: 0xd8bef986 (stale) Mirror 5: 0xffb9ea32 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000831 1787573628.132033 mapread 0x03e913 thru 0x03ffff (0x16ed bytes) 000832 1787573628.148861 mapread 0x006575 thru 0x00b744 (0x51d0 bytes) 000833 1787573628.160185 mapwrite 0x03adb3 thru 0x03e0a9 (0x32f7 bytes) 000834 1787573628.200159 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd2837c50 (stale) Mirror 4: 0xd8bef986 (stale) Mirror 5: 0xffb9ea32 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9688ae1 Mirror 6: 0x9688ae1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000835 1787573629.453748 trunc from 0x00f9f6 to 0x012ccb (0x32d6 bytes) 000836 1787573629.554438 trunc from 0x0332d1 to 0x03f979 (0xc6a9 bytes) 000837 1787573629.566024 trunc from 0x03245d to 0x036356 (0x3efa bytes) 000838 1787573629.575622 write 0x0326f1 thru 0x0398ab (0x71bb bytes) 000839 1787573629.599258 read 0x01493f thru 0x021945 (0xd007 bytes) 000840 1787573629.615313 trunc from 0x02eef4 to 0x038b81 (0x9c8e bytes) 000841 1787573629.638714 trunc from 0x040000 to 0x00e5a8 (0x31a57 bytes) 000842 1787573629.716750 trunc from 0x003f7d to 0x00bd07 (0x7d8b bytes) 000843 1787573629.728280 read 0x00000d thru 0x00423c (0x4230 bytes) 000844 1787573629.753582 read 0x0073ce thru 0x00e5a8 (0x71db bytes) 000845 1787573629.758685 MIRROR_RESYNC 5 mirrors 000846 1787573631.189439 trunc from 0x00e5a9 to 0x02889e (0x1a2f6 bytes) 000847 1787573631.247238 trunc from 0x01440b to 0x01ec00 (0xa7f6 bytes) 000848 1787573631.267726 read 0x003ea4 thru 0x00991a (0x5a77 bytes) 000849 1787573631.283419 trunc from 0x02889f to 0x000c04 (0x27c9a bytes) 000850 1787573631.324347 punch from 0x000ac6 to 0x000c04 (0x13f bytes) 000851 1787573631.333768 trunc from 0x0008c8 to 0x000c04 (0x33d bytes) 000852 1787573631.353210 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xc05): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc05): Mirror 3: 0xed211b1 (stale) Mirror 4: 0xed211b1 (stale) Mirror 5: 0xed211b1 (stale) Mirror 6: 0xed211b1 (stale) CRC-32 checksum value for chunk [0, 0xc05): Mirror 1: 0xed211b1 Mirror 7: 0xed211b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc05: skipped 000854 1787573632.512200 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xc05): Mirror 3: 0xed211b1 (stale) Mirror 4: 0xed211b1 (stale) Mirror 5: 0xed211b1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc05): Mirror 3: 0xed211b1 (stale) Mirror 4: 0xed211b1 (stale) Mirror 5: 0xed211b1 (stale) CRC-32 checksum value for chunk [0, 0xc05): Mirror 1: 0xed211b1 Mirror 7: 0xed211b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc05: skipped 000855 1787573633.678192 fallocate 0x00589e thru 0x0063fa (0xb5d bytes) 000856 1787573633.739178 trunc from 0x0063fb to 0x02e0a1 (0x27ca7 bytes) 000857 1787573633.859661 read 0x008cf6 thru 0x00b669 (0x2974 bytes) 000858 1787573633.890969 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2e0a2): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e0a2): Mirror 3: 0x45c219f4 (stale) Mirror 4: 0x45c219f4 (stale) Mirror 5: 0x45c219f4 (stale) Mirror 7: 0xec770f10 (stale) CRC-32 checksum value for chunk [0, 0x2e0a2): Mirror 1: 0xec770f10 Mirror 8: 0xec770f10 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e0a2: skipped 000859 1787573634.933490 read 0x010146 thru 0x012764 (0x261f bytes) 000860 1787573634.944878 trunc from 0x02e0a2 to 0x039168 (0xb0c7 bytes) 000861 1787573635.028784 mapwrite 0x036d7e thru 0x03f778 (0x89fb bytes) 000863 1787573635.134048 fallocate 0x02365b thru 0x02e8da (0xb280 bytes) 000865 1787573635.146117 mapread 0x010120 thru 0x0154d5 (0x53b6 bytes) 000867 1787573635.174701 trunc from 0x03f779 to 0x019516 (0x26262 bytes) 000868 1787573635.204933 trunc from 0x019517 to 0x0051d6 (0x14340 bytes) 000869 1787573635.223397 trunc from 0x00471c to 0x0051d6 (0xabb bytes) 000870 1787573635.239862 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x51d7): Mirror 4: 0x8ef99f0c (stale) Mirror 5: 0x8ef99f0c (stale) Mirror 7: 0x8ef99f0c (stale) Mirror 8: 0x8ef99f0c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x51d7): Mirror 4: 0x8ef99f0c (stale) Mirror 5: 0x8ef99f0c (stale) Mirror 7: 0x8ef99f0c (stale) Mirror 8: 0x8ef99f0c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x51d7: skipped 000871 1787573635.665614 fallocate 0x00137e thru 0x0030ae (0x1d31 bytes) 000872 1787573635.670480 mapwrite 0x00ac6b thru 0x014077 (0x940d bytes) 000873 1787573635.738025 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x14078): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14078): Mirror 4: 0x8cace61a (stale) Mirror 5: 0x8cace61a (stale) Mirror 7: 0x864d2888 (stale) Mirror 8: 0x864d2888 (stale) CRC-32 checksum value for chunk [0, 0x14078): Mirror 1: 0xdd4a5086 Mirror 9: 0xdd4a5086 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14078: skipped 000874 1787573636.587196 trunc from 0x01107b to 0x014077 (0x2ffd bytes) 000875 1787573636.629288 write 0x037b78 thru 0x03d0ec (0x5575 bytes) 000876 1787573636.635235 trunc from 0x029ab2 to 0x0382ee (0xe83d bytes) 000877 1787573636.647310 trunc from 0x03d0ed to 0x03ac44 (0x24a8 bytes) 000878 1787573636.663534 punch from 0x025916 to 0x0266ee (0xdd9 bytes) 000879 1787573636.667188 mapwrite 0x036685 thru 0x03cb7b (0x64f7 bytes) 000880 1787573636.713912 mapread 0x015cc9 thru 0x01f890 (0x9bc8 bytes) 000881 1787573636.731709 trunc from 0x024ec2 to 0x027e91 (0x2fd0 bytes) 000883 1787573636.737948 trunc from 0x03cb7c to 0x019306 (0x23875 bytes) 000884 1787573636.754357 mapwrite 0x016c6b thru 0x0199c1 (0x2d57 bytes) 000885 1787573636.794603 fallocate 0x01cbf8 thru 0x028093 (0xb49c bytes) 000886 1787573636.800475 mapread 0x0161a4 thru 0x0199c1 (0x381e bytes) 000888 1787573636.806757 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x199c2): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x199c2): Mirror 4: 0x968ff710 (stale) Mirror 5: 0x968ff710 (stale) Mirror 7: 0x904449ed (stale) Mirror 8: 0x904449ed (stale) Mirror 9: 0x7cfeea1f (stale) CRC-32 checksum value for chunk [0, 0x199c2): Mirror 1: 0x9340d864 Mirror 10: 0x9340d864 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x199c2: skipped 000889 1787573637.906967 fallocate 0x01565a thru 0x01add7 (0x577e bytes) 000890 1787573637.954303 write 0x01ca7a thru 0x0253cb (0x8952 bytes) 000891 1787573637.962999 fallocate 0x00f6ef thru 0x0121a9 (0x2abb bytes) 000892 1787573637.969146 write 0x023735 thru 0x02bdff (0x86cb bytes) 000893 1787573637.973113 mapwrite 0x039fd4 thru 0x03ffff (0x602c bytes) 000894 1787573638.032918 trunc from 0x004390 to 0x0086c0 (0x4331 bytes) 000895 1787573638.039029 mapread 0x02bb95 thru 0x03218b (0x65f7 bytes) 000896 1787573638.063196 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x8caf5894 (stale) Mirror 5: 0x8caf5894 (stale) Mirror 7: 0xe20eea22 (stale) Mirror 9: 0xc7a1e23a (stale) Mirror 10: 0xb373bf6b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x8caf5894 (stale) Mirror 5: 0x8caf5894 (stale) Mirror 7: 0xe20eea22 (stale) Mirror 9: 0xc7a1e23a (stale) Mirror 10: 0xb373bf6b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000897 1787573638.496686 punch from 0x01cad6 to 0x0203d8 (0x3903 bytes) 000898 1787573638.504964 trunc from 0x040000 to 0x02d1be (0x12e41 bytes) 000899 1787573638.540250 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2d1bf): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d1bf): Mirror 4: 0xadb4170e (stale) Mirror 5: 0xadb4170e (stale) Mirror 7: 0x1e0b04f0 (stale) Mirror 9: 0x5f2db245 (stale) Mirror 10: 0x65c5a995 (stale) CRC-32 checksum value for chunk [0, 0x2d1bf): Mirror 1: 0x8a737e62 Mirror 11: 0x8a737e62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d1bf: skipped 000900 1787573640.565453 read 0x00d6fb thru 0x01aa8f (0xd395 bytes) 000901 1787573640.587943 mapwrite 0x005a9e thru 0x0114a6 (0xba09 bytes) 000902 1787573640.731613 write 0x030683 thru 0x03d6be (0xd03c bytes) 000903 1787573640.741196 fallocate 0x00d867 thru 0x0165c4 (0x8d5e bytes) 000904 1787573640.746891 read 0x010b5d thru 0x0197e9 (0x8c8d bytes) 000905 1787573640.748031 mapread 0x015593 thru 0x01a655 (0x50c3 bytes) 000906 1787573640.759655 mapread 0x02a821 thru 0x02f5fd (0x4ddd bytes) 000907 1787573640.760959 read 0x0275c1 thru 0x03378e (0xc1ce bytes) 000909 1787573640.763108 read 0x027871 thru 0x033015 (0xb7a5 bytes) 000910 1787573640.764373 mapwrite 0x037e78 thru 0x03a551 (0x26da bytes) 000912 1787573640.784308 fallocate 0x006723 thru 0x00d64e (0x6f2c bytes) 000913 1787573640.794533 read 0x0073bf thru 0x00f378 (0x7fba bytes) 000914 1787573640.795648 mapread 0x03750b thru 0x03d6be (0x61b4 bytes) 000915 1787573640.796679 fallocate 0x00b49b thru 0x00b7b7 (0x31d bytes) 000916 1787573640.802904 mapwrite 0x028798 thru 0x038496 (0xfcff bytes) 000917 1787573640.837152 fallocate 0x027b01 thru 0x02e7d5 (0x6cd5 bytes) 000918 1787573640.840684 read 0x02643c thru 0x02717b (0xd40 bytes) 000919 1787573640.841376 trunc from 0x012165 to 0x018994 (0x6830 bytes) 000920 1787573640.845415 read 0x029513 thru 0x02c63e (0x312c bytes) 000922 1787573640.846472 trunc from 0x03d6bf to 0x00117b (0x3c543 bytes) 000923 1787573640.877943 read 0x000e90 thru 0x00117b (0x2ec bytes) 000924 1787573640.878621 read 0x000381 thru 0x00117b (0xdfb bytes) 000925 1787573640.879024 fallocate 0x01ee1b thru 0x02be54 (0xd03a bytes) 000926 1787573640.895290 fallocate 0x03b20d thru 0x03ffff (0x4df3 bytes) 000927 1787573640.928309 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x117c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x117c): Mirror 4: 0x526502f2 (stale) Mirror 5: 0x526502f2 (stale) Mirror 7: 0x526502f2 (stale) Mirror 9: 0x526502f2 (stale) Mirror 10: 0x526502f2 (stale) Mirror 11: 0x526502f2 (stale) CRC-32 checksum value for chunk [0, 0x117c): Mirror 1: 0x526502f2 Mirror 12: 0x526502f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x117c: skipped 000928 1787573641.806679 read 0x000bf7 thru 0x00117b (0x585 bytes) 000929 1787573641.816191 mapread 0x00087a thru 0x00117b (0x902 bytes) 000930 1787573641.828549 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x117c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x117c): Mirror 4: 0x526502f2 (stale) Mirror 5: 0x526502f2 (stale) Mirror 7: 0x526502f2 (stale) Mirror 9: 0x526502f2 (stale) Mirror 10: 0x526502f2 (stale) Mirror 11: 0x526502f2 (stale) CRC-32 checksum value for chunk [0, 0x117c): Mirror 1: 0x526502f2 Mirror 12: 0x526502f2 Mirror 13: 0x526502f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x117c: skipped 000931 1787573642.371255 punch from 0x0004e4 to 0x00117b (0xc98 bytes) 000932 1787573642.415520 trunc from 0x00117c to 0x015f3a (0x14dbf bytes) 000933 1787573642.435469 punch from 0x00ad6e to 0x011703 (0x6996 bytes) 000934 1787573642.439617 read 0x00dc64 thru 0x015f3a (0x82d7 bytes) 000935 1787573642.453477 mapwrite 0x02fe65 thru 0x035591 (0x572d bytes) 000936 1787573642.519880 mapwrite 0x02588c thru 0x033c7b (0xe3f0 bytes) 000937 1787573642.603282 read 0x02a65c thru 0x035591 (0xaf36 bytes) 000938 1787573642.603913 mapread 0x0322e5 thru 0x035437 (0x3153 bytes) 000939 1787573642.604701 write 0x01c65f thru 0x01dcd0 (0x1672 bytes) 000940 1787573642.618028 punch from 0x00663a to 0x00924e (0x2c15 bytes) 000941 1787573642.623492 mapread 0x000fef thru 0x004cbd (0x3ccf bytes) 000942 1787573642.624118 punch from 0x01c838 to 0x01fcae (0x3477 bytes) 000943 1787573642.635593 trunc from 0x035592 to 0x0014be (0x340d3 bytes) 000944 1787573642.654113 read 0x00093a thru 0x0014be (0xb85 bytes) 000945 1787573642.654642 write 0x005534 thru 0x013361 (0xde2e bytes) 000947 1787573642.664751 mapread 0x00f76e thru 0x013361 (0x3bf4 bytes) 000948 1787573642.667096 write 0x026de4 thru 0x033b5a (0xcd77 bytes) 000949 1787573642.669388 trunc from 0x033b5b to 0x01fc2d (0x13f2d bytes) 000950 1787573642.698586 punch from 0x0089d9 to 0x009ba7 (0x11cf bytes) 000951 1787573642.721009 write 0x02a633 thru 0x02f569 (0x4f37 bytes) 000952 1787573642.726845 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2f56a): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f56a): Mirror 4: 0x3743846a (stale) Mirror 5: 0x3743846a (stale) Mirror 7: 0xf8524216 (stale) Mirror 9: 0x3919a88f (stale) Mirror 10: 0x71ebfa12 (stale) Mirror 11: 0x3f97cbe4 (stale) Mirror 12: 0xf8524216 (stale) Mirror 13: 0xf8524216 (stale) CRC-32 checksum value for chunk [0, 0x2f56a): Mirror 1: 0x993b4d4f Mirror 14: 0x993b4d4f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f56a: skipped 000953 1787573643.595959 write 0x01ce91 thru 0x020611 (0x3781 bytes) 000954 1787573643.632184 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2f56a): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f56a): Mirror 4: 0x3743846a (stale) Mirror 5: 0x3743846a (stale) Mirror 7: 0xf8524216 (stale) Mirror 9: 0x3919a88f (stale) Mirror 10: 0x71ebfa12 (stale) Mirror 11: 0x3f97cbe4 (stale) Mirror 12: 0xf8524216 (stale) Mirror 13: 0xf8524216 (stale) Mirror 14: 0x993b4d4f (stale) CRC-32 checksum value for chunk [0, 0x2f56a): Mirror 1: 0x4526ac7e Mirror 15: 0x4526ac7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f56a: skipped 000955 1787573644.657907 write 0x00087d thru 0x01034c (0xfad0 bytes) 000956 1787573644.697614 MIRROR_RESYNC 11 mirrors 000957 1787573646.368208 trunc from 0x011e44 to 0x016727 (0x48e4 bytes) 000958 1787573646.409994 punch from 0x01de2b to 0x029084 (0xb25a bytes) 000959 1787573646.415494 mapread 0x011f5e thru 0x0204de (0xe581 bytes) 000960 1787573646.442467 read 0x00cbe7 thru 0x0194b2 (0xc8cc bytes) 000961 1787573646.443185 punch from 0x014304 to 0x023810 (0xf50d bytes) 000962 1787573646.456178 MIRROR_RESYNC 11 mirrors 000963 1787573648.168802 punch from 0x02ebf2 to 0x02f569 (0x978 bytes) 000964 1787573648.202176 mapwrite 0x039a89 thru 0x03ffff (0x6577 bytes) 000965 1787573648.270502 trunc from 0x004842 to 0x007738 (0x2ef7 bytes) 000966 1787573648.279084 mapread 0x02630f thru 0x02c626 (0x6318 bytes) 000967 1787573648.302606 mapread 0x012b34 thru 0x019d86 (0x7253 bytes) 000969 1787573648.320161 write 0x0148a4 thru 0x01b9ed (0x714a bytes) 000971 1787573648.326689 write 0x00243d thru 0x011d91 (0xf955 bytes) 000972 1787573648.343104 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xba75eeb1 (stale) Mirror 7: 0xba75eeb1 (stale) Mirror 9: 0xba75eeb1 (stale) Mirror 10: 0xba75eeb1 (stale) Mirror 11: 0xba75eeb1 (stale) Mirror 12: 0xba75eeb1 (stale) Mirror 13: 0xba75eeb1 (stale) Mirror 14: 0xba75eeb1 (stale) Mirror 15: 0xba75eeb1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xba75eeb1 (stale) Mirror 7: 0xba75eeb1 (stale) Mirror 9: 0xba75eeb1 (stale) Mirror 10: 0xba75eeb1 (stale) Mirror 11: 0xba75eeb1 (stale) Mirror 12: 0xba75eeb1 (stale) Mirror 13: 0xba75eeb1 (stale) Mirror 14: 0xba75eeb1 (stale) Mirror 15: 0xba75eeb1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000973 1787573648.900159 mapread 0x00ebfd thru 0x01271f (0x3b23 bytes) 000974 1787573648.919588 read 0x031443 thru 0x0360a1 (0x4c5f bytes) 000977 1787573648.929193 mapwrite 0x02a039 thru 0x02d871 (0x3839 bytes) 000978 1787573648.955000 write 0x0178f4 thru 0x01b36d (0x3a7a bytes) 000979 1787573648.967931 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xba75eeb1 (stale) Mirror 9: 0xba75eeb1 (stale) Mirror 10: 0xba75eeb1 (stale) Mirror 11: 0xba75eeb1 (stale) Mirror 12: 0xba75eeb1 (stale) Mirror 13: 0xba75eeb1 (stale) Mirror 14: 0xba75eeb1 (stale) Mirror 15: 0xba75eeb1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xba75eeb1 (stale) Mirror 9: 0xba75eeb1 (stale) Mirror 10: 0xba75eeb1 (stale) Mirror 11: 0xba75eeb1 (stale) Mirror 12: 0xba75eeb1 (stale) Mirror 13: 0xba75eeb1 (stale) Mirror 14: 0xba75eeb1 (stale) Mirror 15: 0xba75eeb1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000981 1787573649.482694 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1a8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xba75eeb1 (stale) Mirror 10: 0xba75eeb1 (stale) Mirror 11: 0xba75eeb1 (stale) Mirror 12: 0xba75eeb1 (stale) Mirror 13: 0xba75eeb1 (stale) Mirror 14: 0xba75eeb1 (stale) Mirror 15: 0xba75eeb1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xba75eeb1 (stale) Mirror 10: 0xba75eeb1 (stale) Mirror 11: 0xba75eeb1 (stale) Mirror 12: 0xba75eeb1 (stale) Mirror 13: 0xba75eeb1 (stale) Mirror 14: 0xba75eeb1 (stale) Mirror 15: 0xba75eeb1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000982 1787573649.884618 trunc from 0x0017b9 to 0x001d47 (0x58f bytes) 000984 1787573649.891794 trunc from 0x040000 to 0x00a107 (0x35ef8 bytes) 000985 1787573649.917778 punch from 0x001d34 to 0x002c57 (0xf24 bytes) 000986 1787573649.924795 write 0x031d58 thru 0x039b63 (0x7e0c bytes) 000987 1787573649.926617 trunc from 0x0025ec to 0x008bd2 (0x65e7 bytes) 000988 1787573649.930879 mapwrite 0x001dca thru 0x00b8b4 (0x9aeb bytes) 000989 1787573649.967003 trunc from 0x039b64 to 0x029e98 (0xfccb bytes) 000990 1787573649.984449 punch from 0x00d032 to 0x010e37 (0x3e06 bytes) 000992 1787573649.991798 mapwrite 0x01c4b5 thru 0x023fd0 (0x7b1c bytes) 000993 1787573650.033556 mapwrite 0x006d7f thru 0x00ac91 (0x3f13 bytes) 000994 1787573650.049563 trunc from 0x00128b to 0x00afa3 (0x9d19 bytes) 000995 1787573650.055103 mapwrite 0x019262 thru 0x022f28 (0x9cc7 bytes) 000996 1787573650.076840 mapwrite 0x02f235 thru 0x032411 (0x31dd bytes) 000997 1787573650.137579 trunc from 0x021d0a to 0x02fe0e (0xe105 bytes) 000998 1787573650.142863 write 0x0157c3 thru 0x01a3ae (0x4bec bytes) 000999 1787573650.144648 mapwrite 0x02443e thru 0x0274c4 (0x3087 bytes) All operations completed A-OK!