== sanity-flr test 70a: flr mode fsx test ================ 09:32:55 (1786800775) Seed set to 777 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1873c 000005 1786800777.370616 trunc from 00000000 to 0x01873b (0x1873c bytes) 000007 1786800777.395723 read 0x013b30 thru 0x01620b (0x26dc bytes) 000008 1786800777.403454 read 0x0032b1 thru 0x012ac5 (0xf815 bytes) 000009 1786800777.418176 read 0x007f56 thru 0x00d234 (0x52df bytes) 000010 1786800777.419314 mapread 0x005a68 thru 0x01551c (0xfab5 bytes) 000012 1786800777.427661 write 0x02ac11 thru 0x039e1f (0xf20f bytes) 000014 1786800777.432592 write 0x02aed4 thru 0x02b432 (0x55f bytes) truncating to largest ever: 0x39e0a 000016 1786800777.435518 trunc from 0x039e20 to 0x039e09 (0x16 bytes) 000017 1786800777.458658 write 0x022de7 thru 0x02eb77 (0xbd91 bytes) 000020 1786800777.508735 mapread 0x035630 thru 0x039114 (0x3ae5 bytes) 000022 1786800777.529572 MIRROR_EXTEND to 2 mirrors 000024 1786800778.473145 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000025 1786800778.684225 read 0x0010cb thru 0x0095c1 (0x84f7 bytes) 000026 1786800778.693692 read 0x0159dc thru 0x022e4a (0xd46f bytes) 000027 1786800778.710575 write 0x039106 thru 0x03ffff (0x6efa bytes) 000028 1786800778.728835 trunc from 0x040000 to 0x00b229 (0x34dd6 bytes) 000030 1786800778.746254 read 0x00649e thru 0x00b229 (0x4d8c bytes) 000033 1786800778.762629 write 0x029ddf thru 0x0365ef (0xc811 bytes) 000035 1786800778.765850 trunc from 0x0365f0 to 0x02111a (0x154d5 bytes) 000036 1786800778.790283 mapwrite 0x010a68 thru 0x0119d6 (0xf6f bytes) 000039 1786800778.872174 read 0x0085d8 thru 0x013304 (0xad2d bytes) 000040 1786800778.873234 write 0x02cf88 thru 0x0348d6 (0x794f bytes) 000042 1786800778.877326 mapwrite 0x026f25 thru 0x029f9d (0x3079 bytes) 000043 1786800778.948698 read 0x01ea63 thru 0x01fbef (0x118d bytes) 000047 1786800778.957135 mapread 0x01a7cb thru 0x0232d3 (0x8b09 bytes) 000051 1786800778.963812 mapread 0x00542a thru 0x00f238 (0x9e0f bytes) 000053 1786800778.970083 write 0x022b01 thru 0x032630 (0xfb30 bytes) 000054 1786800778.974151 read 0x02efda thru 0x0348d6 (0x58fd bytes) 000056 1786800778.976903 read 0x031a68 thru 0x0348d6 (0x2e6f bytes) 000058 1786800778.979387 mapread 0x005bf2 thru 0x00919c (0x35ab bytes) 000066 1786800778.992588 trunc from 0x0348d7 to 0x026257 (0xe67f bytes) 000067 1786800779.023755 MIRROR_EXTEND to 2 mirrors 000068 1786800779.862257 write 0x027816 thru 0x031cde (0xa4c9 bytes) 000070 1786800779.972521 write 0x00e148 thru 0x0161e3 (0x809c bytes) 000071 1786800779.990457 read 0x015f25 thru 0x01dac8 (0x7ba4 bytes) 000074 1786800779.998224 mapread 0x01286d thru 0x0206c3 (0xde57 bytes) 000076 1786800780.026950 MIRROR_RESYNC 2 mirrors 000077 1786800780.516224 mapwrite 0x01b537 thru 0x01f9ed (0x44b7 bytes) 000079 1786800780.666711 mapwrite 0x02fe24 thru 0x032e31 (0x300e bytes) 000080 1786800780.761203 trunc from 0x032e32 to 0x0072b7 (0x2bb7a bytes) 000081 1786800780.784121 MIRROR_RESYNC 2 mirrors 000082 1786800781.537858 write 0x030693 thru 0x03d8cf (0xd23d bytes) 000083 1786800781.619205 mapwrite 0x0134e7 thru 0x01bbb8 (0x86d2 bytes) 000085 1786800781.720313 read 0x02e42d thru 0x03462a (0x61fe bytes) 000086 1786800781.729003 mapread 0x01bf4a thru 0x02162b (0x56e2 bytes) 000087 1786800781.746329 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000088 1786800781.883929 read 0x001439 thru 0x010157 (0xed1f bytes) 000089 1786800781.898505 mapread 0x016f5c thru 0x01c889 (0x592e bytes) 000090 1786800781.923610 mapwrite 0x01187d thru 0x013422 (0x1ba6 bytes) 000091 1786800781.969714 read 0x03211f thru 0x03a3d5 (0x82b7 bytes) 000092 1786800781.981982 mapread 0x0192fb thru 0x01f62e (0x6334 bytes) 000095 1786800781.984213 trunc from 0x03d8d0 to 0x00323a (0x3a695 bytes) 000096 1786800782.020685 mapread 0x001864 thru 0x00323a (0x19d7 bytes) 000097 1786800782.022626 mapread 0x00209a thru 0x00323a (0x11a1 bytes) 000098 1786800782.026297 mapread 0x0009e7 thru 0x00323a (0x2854 bytes) 000101 1786800782.033686 trunc from 0x00323b to 0x0202bc (0x1d082 bytes) 000102 1786800782.057421 write 0x013a09 thru 0x01ccd7 (0x92cf bytes) 000103 1786800782.070937 write 0x00bd46 thru 0x016329 (0xa5e4 bytes) 000104 1786800782.076767 mapread 0x011eb6 thru 0x0202bc (0xe407 bytes) 000105 1786800782.107683 read 0x017e12 thru 0x0202b3 (0x84a2 bytes) 000107 1786800782.113835 mapread 0x011f0d thru 0x013fe0 (0x20d4 bytes) 000108 1786800782.116446 write 0x0249dd thru 0x027da7 (0x33cb bytes) 000109 1786800782.119245 mapwrite 0x02d098 thru 0x0321a3 (0x510c bytes) truncating to largest ever: 0x3b473 000110 1786800782.207863 trunc from 0x0321a4 to 0x03b472 (0x92cf bytes) 000112 1786800782.228347 mapwrite 0x03c0fb thru 0x03ffff (0x3f05 bytes) 000113 1786800782.293767 trunc from 0x040000 to 0x0289de (0x17621 bytes) 000114 1786800782.309552 read 0x002860 thru 0x0078c4 (0x5065 bytes) 000118 1786800782.313633 read 0x012dcf thru 0x0150c7 (0x22f9 bytes) 000120 1786800782.316823 write 0x036b1a thru 0x038661 (0x1b48 bytes) 000122 1786800782.319673 mapwrite 0x011fb4 thru 0x0195f1 (0x763e bytes) 000123 1786800782.402947 read 0x003308 thru 0x0124ab (0xf1a4 bytes) 000125 1786800782.404716 write 0x02fcf2 thru 0x03f3b7 (0xf6c6 bytes) 000128 1786800782.428087 mapread 0x0097e8 thru 0x019507 (0xfd20 bytes) 000132 1786800782.432323 write 0x007649 thru 0x00e367 (0x6d1f bytes) 000133 1786800782.434098 mapwrite 0x01d762 thru 0x02980a (0xc0a9 bytes) 000134 1786800782.550705 write 0x020964 thru 0x025d2e (0x53cb bytes) 000135 1786800782.555285 trunc from 0x03f3b8 to 0x032c72 (0xc745 bytes) 000138 1786800782.589313 mapread 0x032732 thru 0x032c72 (0x541 bytes) 000140 1786800782.593588 mapwrite 0x02e407 thru 0x03a0ec (0xbce6 bytes) 000141 1786800782.714631 read 0x00508d thru 0x007e3c (0x2db0 bytes) 000145 1786800782.718498 read 0x01de42 thru 0x021d66 (0x3f25 bytes) 000147 1786800782.721438 mapwrite 0x01242f thru 0x01596f (0x3541 bytes) 000148 1786800782.770193 mapread 0x01fe40 thru 0x0283e0 (0x85a1 bytes) 000150 1786800782.772660 mapread 0x026e0f thru 0x0299f2 (0x2be4 bytes) 000156 1786800782.782041 mapread 0x0239cf thru 0x0260d7 (0x2709 bytes) 000157 1786800782.783868 read 0x015b47 thru 0x022d26 (0xd1e0 bytes) 000158 1786800782.785069 mapread 0x01a609 thru 0x0202d0 (0x5cc8 bytes) 000160 1786800782.787324 read 0x0146ca thru 0x0191e1 (0x4b18 bytes) 000162 1786800782.788774 mapwrite 0x01b466 thru 0x01f1f8 (0x3d93 bytes) 000164 1786800782.845697 write 0x01c877 thru 0x02b462 (0xebec bytes) 000167 1786800782.850861 mapread 0x009f8d thru 0x013913 (0x9987 bytes) 000168 1786800782.852120 write 0x0375e9 thru 0x03a58e (0x2fa6 bytes) 000170 1786800782.855454 trunc from 0x03a58f to 0x001ec6 (0x386c8 bytes) 000171 1786800782.879742 write 0x0324ea thru 0x039925 (0x743c bytes) 000172 1786800782.882827 mapwrite 0x01aca1 thru 0x01e630 (0x3990 bytes) 000178 1786800782.966757 read 0x0028f4 thru 0x00c208 (0x9915 bytes) 000180 1786800782.969181 write 0x032dd0 thru 0x036820 (0x3a51 bytes) 000182 1786800782.975818 MIRROR_EXTEND to 2 mirrors 000184 1786800784.104881 mapread 0x0396a1 thru 0x039925 (0x285 bytes) 000185 1786800784.112540 mapwrite 0x01cc88 thru 0x0210f1 (0x446a bytes) 000187 1786800784.407920 read 0x02fe05 thru 0x035a27 (0x5c23 bytes) 000188 1786800784.451913 MIRROR_RESYNC 2 mirrors 000189 1786800785.312823 write 0x027c82 thru 0x02b29e (0x361d bytes) 000191 1786800785.442590 MIRROR_RESYNC 2 mirrors 000196 1786800785.982189 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000197 1786800786.110646 mapread 0x02e738 thru 0x039925 (0xb1ee bytes) 000198 1786800786.134423 write 0x0131e7 thru 0x021cca (0xeae4 bytes) 000201 1786800786.166819 mapwrite 0x030448 thru 0x037d6e (0x7927 bytes) 000205 1786800786.223239 write 0x03c09a thru 0x03ffff (0x3f66 bytes) 000207 1786800786.226309 read 0x018131 thru 0x0268cc (0xe79c bytes) 000211 1786800786.229937 write 0x029e49 thru 0x036be3 (0xcd9b bytes) 000212 1786800786.232402 write 0x02382a thru 0x02c114 (0x88eb bytes) 000215 1786800786.247764 read 0x039de1 thru 0x03ffff (0x621f bytes) 000219 1786800786.262474 read 0x03ba88 thru 0x03dd1c (0x2295 bytes) 000220 1786800786.263376 write 0x006384 thru 0x007d94 (0x1a11 bytes) 000221 1786800786.266566 read 0x02e736 thru 0x03b80e (0xd0d9 bytes) 000222 1786800786.269288 read 0x01a876 thru 0x02a255 (0xf9e0 bytes) 000224 1786800786.273476 trunc from 0x040000 to 0x024ebc (0x1b143 bytes) 000227 1786800786.293087 mapwrite 0x034558 thru 0x03e2e8 (0x9d91 bytes) 000229 1786800786.362672 read 0x003ddb thru 0x00be34 (0x805a bytes) 000231 1786800786.365334 mapwrite 0x033f18 thru 0x03454a (0x633 bytes) 000232 1786800786.404192 mapread 0x006a15 thru 0x00e6d6 (0x7cc2 bytes) 000235 1786800786.406494 mapread 0x00f970 thru 0x01c6d5 (0xcd66 bytes) 000236 1786800786.409060 mapwrite 0x01328d thru 0x01e7eb (0xb55f bytes) 000237 1786800786.462569 mapread 0x008112 thru 0x00bc26 (0x3b15 bytes) 000239 1786800786.464117 mapread 0x01a603 thru 0x0269f6 (0xc3f4 bytes) 000241 1786800786.467498 read 0x01e91b thru 0x0257c5 (0x6eab bytes) 000243 1786800786.469131 write 0x01fd05 thru 0x023988 (0x3c84 bytes) 000244 1786800786.470623 mapread 0x01d0e7 thru 0x01e9ba (0x18d4 bytes) 000246 1786800786.473053 read 0x03c6cf thru 0x03e2e8 (0x1c1a bytes) 000248 1786800786.475089 read 0x006d0e thru 0x016655 (0xf948 bytes) 000249 1786800786.476129 mapwrite 0x0122cb thru 0x014089 (0x1dbf bytes) 000250 1786800786.522523 trunc from 0x03e2e9 to 0x005565 (0x38d83 bytes) 000251 1786800786.543542 read 0x002f59 thru 0x005565 (0x260d bytes) 000252 1786800786.544465 trunc from 0x005566 to 0x00d5bd (0x8058 bytes) 000255 1786800786.562291 mapwrite 0x033234 thru 0x03718d (0x3f5a bytes) 000258 1786800786.631071 trunc from 0x03718e to 0x0188a2 (0x1e8eb bytes) 000259 1786800786.653331 trunc from 0x0188a3 to 0x013dc7 (0x4adb bytes) 000260 1786800786.676386 MIRROR_EXTEND to 2 mirrors 000262 1786800787.619978 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000264 1786800787.742743 mapread 0x002f39 thru 0x00acc7 (0x7d8f bytes) 000265 1786800787.764662 trunc from 0x013dc8 to 0x02724b (0x13484 bytes) 000266 1786800787.796952 MIRROR_EXTEND to 2 mirrors 000269 1786800788.784230 write 0x03468a thru 0x03cda1 (0x8718 bytes) 000270 1786800788.856626 read 0x00b944 thru 0x01360c (0x7cc9 bytes) 000271 1786800788.873395 MIRROR_RESYNC 2 mirrors 000272 1786800789.614511 read 0x02e444 thru 0x037d5f (0x991c bytes) 000273 1786800789.624945 write 0x012255 thru 0x01c2e6 (0xa092 bytes) 000274 1786800789.704131 read 0x01d2da thru 0x02c426 (0xf14d bytes) 000275 1786800789.718205 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000278 1786800789.845489 mapread 0x00ff67 thru 0x01b864 (0xb8fe bytes) 000281 1786800789.880547 trunc from 0x03cda2 to 0x018ead (0x23ef4 bytes) 000282 1786800789.899137 trunc from 0x018eae to 0x01b732 (0x2885 bytes) 000283 1786800789.913181 write 0x01c3c3 thru 0x01d3a8 (0xfe6 bytes) 000284 1786800789.914238 read 0x003d6c thru 0x013549 (0xf7de bytes) 000285 1786800789.924424 trunc from 0x01d3a9 to 0x02e718 (0x11370 bytes) 000287 1786800789.940395 trunc from 0x02e719 to 0x03aacc (0xc3b4 bytes) 000289 1786800789.961440 write 0x000267 thru 0x00b6f3 (0xb48d bytes) 000290 1786800789.968649 mapread 0x010ebd thru 0x0193bf (0x8503 bytes) 000291 1786800789.977130 mapwrite 0x018bb5 thru 0x01aa63 (0x1eaf bytes) 000292 1786800790.021087 read 0x008613 thru 0x00cefb (0x48e9 bytes) 000294 1786800790.022971 read 0x033c5b thru 0x03aacc (0x6e72 bytes) 000295 1786800790.033165 mapwrite 0x02a7e7 thru 0x038412 (0xdc2c bytes) 000296 1786800790.091488 mapwrite 0x01c029 thru 0x01e66d (0x2645 bytes) 000297 1786800790.126545 mapwrite 0x02cba7 thru 0x031588 (0x49e2 bytes) 000299 1786800790.176542 trunc from 0x03aacd to 0x021fa3 (0x18b29 bytes) 000300 1786800790.198780 trunc from 0x021fa4 to 0x00a47e (0x17b25 bytes) 000303 1786800790.222062 mapwrite 0x03cc6f thru 0x03ffff (0x3391 bytes) 000304 1786800790.285158 mapread 0x023b1c thru 0x02991b (0x5e00 bytes) truncating to largest ever: 0x3c400 000305 1786800790.319486 trunc from 0x040000 to 0x03c3ff (0x3c00 bytes) 000307 1786800790.337570 mapread 0x00954b thru 0x013f75 (0xaa2b bytes) 000309 1786800790.390395 trunc from 0x03c400 to 0x00f875 (0x2cb8a bytes) 000311 1786800790.413627 read 0x000e0e thru 0x001106 (0x2f9 bytes) 000313 1786800790.416062 read 0x00e366 thru 0x00f875 (0x1510 bytes) 000318 1786800790.420496 mapread 0x00cb11 thru 0x00f875 (0x2d65 bytes) 000321 1786800790.423649 write 0x039924 thru 0x03e78a (0x4e67 bytes) 000322 1786800790.425457 read 0x03c334 thru 0x03e78a (0x2457 bytes) 000324 1786800790.426658 mapwrite 0x015285 thru 0x02132e (0xc0aa bytes) 000325 1786800790.480850 mapwrite 0x01e7bd thru 0x020212 (0x1a56 bytes) 000326 1786800790.534771 mapwrite 0x00a203 thru 0x014e3e (0xac3c bytes) 000327 1786800790.592784 mapread 0x03a045 thru 0x03d215 (0x31d1 bytes) 000328 1786800790.594609 write 0x0076ce thru 0x00c372 (0x4ca5 bytes) 000331 1786800790.599308 write 0x00a9ed thru 0x011cad (0x72c1 bytes) 000332 1786800790.601413 read 0x02058e thru 0x02419b (0x3c0e bytes) 000333 1786800790.603242 trunc from 0x03e78b to 0x01a625 (0x24165 bytes) 000335 1786800790.635778 write 0x0304c0 thru 0x0354bb (0x4ffc bytes) 000336 1786800790.637964 write 0x02f472 thru 0x035a3b (0x65ca bytes) 000337 1786800790.648605 trunc from 0x035a3c to 0x007636 (0x2e405 bytes) 000338 1786800790.673921 write 0x0145fe thru 0x0170f2 (0x2af5 bytes) 000339 1786800790.688551 MIRROR_EXTEND to 2 mirrors 000341 1786800791.380282 MIRROR_EXTEND to 3 mirrors 000344 1786800792.354469 trunc from 0x0170f3 to 0x030ff6 (0x19f04 bytes) 000346 1786800792.436590 write 0x014777 thru 0x0242f4 (0xfb7e bytes) 000347 1786800792.449379 trunc from 0x030ff7 to 0x017698 (0x1995e bytes) 000349 1786800792.484075 MIRROR_RESYNC 3 mirrors 000351 1786800793.353629 write 0x036bcf thru 0x03ffff (0x9431 bytes) 000353 1786800793.413093 read 0x00f67d thru 0x010da3 (0x1727 bytes) 000354 1786800793.419895 write 0x0370f5 thru 0x039549 (0x2455 bytes) 000355 1786800793.420909 write 0x001b2b thru 0x00833b (0x6811 bytes) 000358 1786800793.442996 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xeb5bc656 (stale) Mirror 3: 0xeb5bc656 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd437f49c Mirror 4: 0xd437f49c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000359 1786800794.571316 write 0x029b73 thru 0x03195b (0x7de9 bytes) 000361 1786800794.712731 write 0x01d1b9 thru 0x027b9f (0xa9e7 bytes) 000362 1786800794.726933 mapwrite 0x01297d thru 0x01c7dd (0x9e61 bytes) 000364 1786800794.878890 MIRROR_RESYNC 4 mirrors 000366 1786800796.188694 write 0x0302a8 thru 0x039ce6 (0x9a3f bytes) 000367 1786800796.265688 mapwrite 0x01525c thru 0x01a783 (0x5528 bytes) 000368 1786800796.351695 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x87f8008 (stale) Mirror 3: 0x87f8008 (stale) Mirror 4: 0x87f8008 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x99893ae8 Mirror 5: 0x99893ae8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000369 1786800797.089447 write 0x011707 thru 0x020922 (0xf21c bytes) 000371 1786800797.188239 mapwrite 0x02aa52 thru 0x03945b (0xea0a bytes) 000372 1786800797.275393 mapwrite 0x02041f thru 0x02e141 (0xdd23 bytes) 000374 1786800797.348491 mapwrite 0x02e55c thru 0x03039e (0x1e43 bytes) 000375 1786800797.467114 write 0x006562 thru 0x00a720 (0x41bf bytes) 000376 1786800797.514313 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x87f8008 (stale) Mirror 3: 0x87f8008 (stale) Mirror 4: 0x87f8008 (stale) Mirror 5: 0x99893ae8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1c6c291a Mirror 6: 0x1c6c291a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000380 1786800798.535927 read 0x01fbec thru 0x027f0a (0x831f bytes) 000381 1786800798.552665 read 0x037083 thru 0x03c564 (0x54e2 bytes) 000383 1786800798.589471 read 0x037c4a thru 0x03cee6 (0x529d bytes) 000384 1786800798.593286 read 0x0258e6 thru 0x0317f9 (0xbf14 bytes) 000385 1786800798.597008 mapwrite 0x00c87e thru 0x0188be (0xc041 bytes) 000386 1786800798.799510 trunc from 0x040000 to 0x013a8c (0x2c573 bytes) 000389 1786800798.826721 write 0x003480 thru 0x0110bb (0xdc3c bytes) 000391 1786800798.829334 read 0x00536e thru 0x0062f3 (0xf86 bytes) 000392 1786800798.830915 write 0x03435f thru 0x03ffff (0xbca1 bytes) 000393 1786800798.833065 mapread 0x02dd16 thru 0x033884 (0x5b6f bytes) 000394 1786800798.845693 trunc from 0x040000 to 0x00fb01 (0x304fe bytes) 000395 1786800798.863587 write 0x01aa9b thru 0x023947 (0x8ead bytes) 000402 1786800798.870179 write 0x02b29b thru 0x03796f (0xc6d5 bytes) 000403 1786800798.872358 read 0x0001e8 thru 0x0058c5 (0x56de bytes) 000404 1786800798.878707 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x37970): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37970): Mirror 2: 0x7e18f90b (stale) Mirror 3: 0x7e18f90b (stale) Mirror 4: 0x7e18f90b (stale) Mirror 5: 0x2e071621 (stale) Mirror 6: 0x189eb21a (stale) CRC-32 checksum value for chunk [0, 0x37970): Mirror 1: 0x93d5b9f5 Mirror 7: 0x93d5b9f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37970: skipped 000405 1786800799.878416 mapwrite 0x023d9e thru 0x0328da (0xeb3d bytes) 000407 1786800800.066911 read 0x001ebe thru 0x0117c8 (0xf90b bytes) 000409 1786800800.077707 read 0x0306c8 thru 0x03796f (0x72a8 bytes) 000410 1786800800.087521 trunc from 0x037970 to 0x028543 (0xf42c bytes) 000412 1786800800.111091 read 0x01d9cd thru 0x022dee (0x5422 bytes) 000417 1786800800.115170 read 0x005e2d thru 0x008e65 (0x3039 bytes) 000419 1786800800.119915 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x28544): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28544): Mirror 2: 0xe104f34b (stale) Mirror 3: 0xe104f34b (stale) Mirror 4: 0xe104f34b (stale) Mirror 5: 0x5ef84b19 (stale) Mirror 6: 0x92133dc1 (stale) Mirror 7: 0xc5cc1033 (stale) CRC-32 checksum value for chunk [0, 0x28544): Mirror 1: 0x6d2b8082 Mirror 8: 0x6d2b8082 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28544: skipped 000421 1786800801.009173 mapwrite 0x01f90c thru 0x01fde0 (0x4d5 bytes) 000422 1786800801.207812 mapwrite 0x015a1c thru 0x01a93e (0x4f23 bytes) 000423 1786800801.312068 mapread 0x01397a thru 0x01a330 (0x69b7 bytes) 000424 1786800801.315110 trunc from 0x028544 to 0x0198f9 (0xec4a bytes) 000425 1786800801.363328 mapread 0x003d1c thru 0x00945e (0x5743 bytes) 000426 1786800801.380090 trunc from 0x0198fa to 0x0088ed (0x1100c bytes) 000428 1786800801.404598 write 0x03d280 thru 0x03ffff (0x2d80 bytes) 000431 1786800801.409358 mapread 0x03fa1c thru 0x03ffff (0x5e4 bytes) 000433 1786800801.422192 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x87f8008 (stale) Mirror 3: 0x87f8008 (stale) Mirror 4: 0x87f8008 (stale) Mirror 5: 0x99893ae8 (stale) Mirror 6: 0x1c6c291a (stale) Mirror 7: 0x758621b (stale) Mirror 8: 0x2264f208 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6d925d38 Mirror 9: 0x6d925d38 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000434 1786800802.686315 mapread 0x01be97 thru 0x027fe0 (0xc14a bytes) 000436 1786800802.735955 trunc from 0x040000 to 0x00930b (0x36cf4 bytes) 000439 1786800802.849494 mapwrite 0x02e07e thru 0x034854 (0x67d7 bytes) 000440 1786800802.947158 read 0x012179 thru 0x01d069 (0xaef1 bytes) 000441 1786800802.962159 mapwrite 0x01fa5a thru 0x028cac (0x9253 bytes) 000443 1786800803.066772 MIRROR_RESYNC 9 mirrors 000445 1786800804.926059 trunc from 0x034855 to 0x00487f (0x2ffd5 bytes) 000446 1786800805.074462 read 0x001b1c thru 0x00487f (0x2d64 bytes) 000447 1786800805.083655 read 0x000d1f thru 0x00487f (0x3b61 bytes) 000448 1786800805.089933 mapread 0x000bdd thru 0x00487f (0x3ca3 bytes) 000449 1786800805.093328 mapread 0x002b9c thru 0x00487f (0x1ce4 bytes) 000451 1786800805.096283 mapwrite 0x03c9ea thru 0x03ffff (0x3616 bytes) 000452 1786800805.366509 mapread 0x028827 thru 0x0381f0 (0xf9ca bytes) 000453 1786800805.377102 mapwrite 0x02a82b thru 0x039e8b (0xf661 bytes) 000455 1786800805.477749 trunc from 0x040000 to 0x01a0fd (0x25f02 bytes) 000456 1786800805.502468 mapwrite 0x007c48 thru 0x017bef (0xffa8 bytes) 000457 1786800805.561633 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1a0fe): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a0fe): Mirror 2: 0x587b86f2 (stale) Mirror 3: 0x587b86f2 (stale) Mirror 4: 0x587b86f2 (stale) Mirror 5: 0x587b86f2 (stale) Mirror 6: 0x587b86f2 (stale) Mirror 7: 0x587b86f2 (stale) Mirror 8: 0x587b86f2 (stale) Mirror 9: 0x587b86f2 (stale) CRC-32 checksum value for chunk [0, 0x1a0fe): Mirror 1: 0xd4930ae9 Mirror 10: 0xd4930ae9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a0fe: skipped 000458 1786800806.744638 read 0x0017ff thru 0x003098 (0x189a bytes) 000460 1786800806.757990 mapwrite 0x00ac55 thru 0x00c2bc (0x1668 bytes) 000462 1786800807.037917 mapwrite 0x016c39 thru 0x022c30 (0xbff8 bytes) 000463 1786800807.217425 mapread 0x018364 thru 0x022c30 (0xa8cd bytes) 000467 1786800807.227972 read 0x0082ed thru 0x00c0f7 (0x3e0b bytes) 000469 1786800807.233605 write 0x029c57 thru 0x02c2ef (0x2699 bytes) 000470 1786800807.239470 read 0x012671 thru 0x01509e (0x2a2e bytes) 000472 1786800807.247478 write 0x01efd9 thru 0x022451 (0x3479 bytes) 000473 1786800807.249583 mapwrite 0x01a035 thru 0x029225 (0xf1f1 bytes) 000474 1786800807.367618 write 0x03e437 thru 0x03ffff (0x1bc9 bytes) 000475 1786800807.375286 write 0x00e451 thru 0x013d39 (0x58e9 bytes) 000477 1786800807.378998 read 0x015b3c thru 0x019e85 (0x434a bytes) 000479 1786800807.392591 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xee5a7fad (stale) Mirror 3: 0xee5a7fad (stale) Mirror 4: 0xee5a7fad (stale) Mirror 5: 0xee5a7fad (stale) Mirror 6: 0xee5a7fad (stale) Mirror 7: 0xee5a7fad (stale) Mirror 8: 0xee5a7fad (stale) Mirror 9: 0xee5a7fad (stale) Mirror 10: 0x7944ad29 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x26d7c05f Mirror 11: 0x26d7c05f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000482 1786800808.543313 write 0x00162d thru 0x0029b7 (0x138b bytes) 000483 1786800808.653148 read 0x01276a thru 0x016491 (0x3d28 bytes) 000485 1786800808.676160 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xee5a7fad (stale) Mirror 3: 0xee5a7fad (stale) Mirror 4: 0xee5a7fad (stale) Mirror 5: 0xee5a7fad (stale) Mirror 6: 0xee5a7fad (stale) Mirror 7: 0xee5a7fad (stale) Mirror 8: 0xee5a7fad (stale) Mirror 9: 0xee5a7fad (stale) Mirror 10: 0x7944ad29 (stale) Mirror 11: 0x26d7c05f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4a7a4f1 Mirror 12: 0x4a7a4f1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000486 1786800810.032785 write 0x005862 thru 0x01372f (0xdece bytes) 000488 1786800810.201436 mapwrite 0x004657 thru 0x00e5a1 (0x9f4b bytes) 000491 1786800810.328315 trunc from 0x040000 to 0x008297 (0x37d68 bytes) 000492 1786800810.365112 mapwrite 0x03b2d0 thru 0x03ffff (0x4d30 bytes) 000493 1786800810.477584 mapwrite 0x03900e thru 0x03ffff (0x6ff2 bytes) 000494 1786800810.530441 read 0x0136c7 thru 0x02231d (0xec57 bytes) 000496 1786800810.549279 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xee5a7fad (stale) Mirror 3: 0xee5a7fad (stale) Mirror 4: 0xee5a7fad (stale) Mirror 5: 0xee5a7fad (stale) Mirror 6: 0xee5a7fad (stale) Mirror 7: 0xee5a7fad (stale) Mirror 8: 0xee5a7fad (stale) Mirror 9: 0xee5a7fad (stale) Mirror 10: 0x7944ad29 (stale) Mirror 12: 0x4a7a4f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xee5a7fad (stale) Mirror 3: 0xee5a7fad (stale) Mirror 4: 0xee5a7fad (stale) Mirror 5: 0xee5a7fad (stale) Mirror 6: 0xee5a7fad (stale) Mirror 7: 0xee5a7fad (stale) Mirror 8: 0xee5a7fad (stale) Mirror 9: 0xee5a7fad (stale) Mirror 10: 0x7944ad29 (stale) Mirror 12: 0x4a7a4f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000497 1786800811.286197 write 0x03e80a thru 0x03ffff (0x17f6 bytes) 000498 1786800811.292285 read 0x016fbf thru 0x017399 (0x3db bytes) 000499 1786800811.297263 read 0x0345be thru 0x038e3c (0x487f bytes) 000500 1786800811.306789 read 0x01ff08 thru 0x02c01b (0xc114 bytes) 000501 1786800811.308486 mapread 0x020e23 thru 0x030354 (0xf532 bytes) 000502 1786800811.309944 trunc from 0x040000 to 0x02d6da (0x12925 bytes) 000505 1786800811.327896 trunc from 0x02d6db to 0x02ff5e (0x2884 bytes) 000507 1786800811.350898 read 0x02354a thru 0x02668a (0x3141 bytes) 000508 1786800811.352173 mapwrite 0x01d3b4 thru 0x024359 (0x6fa6 bytes) 000509 1786800811.406210 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ff5f): Mirror 2: 0xc07b7b59 (stale) Mirror 4: 0xc07b7b59 (stale) Mirror 5: 0xc07b7b59 (stale) Mirror 6: 0xc07b7b59 (stale) Mirror 7: 0xc07b7b59 (stale) Mirror 8: 0xc07b7b59 (stale) Mirror 9: 0xc07b7b59 (stale) Mirror 10: 0x69895c8 (stale) Mirror 12: 0x185f2a1f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ff5f): Mirror 2: 0xc07b7b59 (stale) Mirror 4: 0xc07b7b59 (stale) Mirror 5: 0xc07b7b59 (stale) Mirror 6: 0xc07b7b59 (stale) Mirror 7: 0xc07b7b59 (stale) Mirror 8: 0xc07b7b59 (stale) Mirror 9: 0xc07b7b59 (stale) Mirror 10: 0x69895c8 (stale) Mirror 12: 0x185f2a1f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ff5f: skipped 000510 1786800812.328811 MIRROR_RESYNC 10 mirrors 000511 1786800814.212010 write 0x01ef12 thru 0x0252b5 (0x63a4 bytes) 000512 1786800814.291617 mapwrite 0x034768 thru 0x039a03 (0x529c bytes) 000513 1786800814.378317 mapwrite 0x03146a thru 0x03dafc (0xc693 bytes) 000515 1786800814.505549 mapwrite 0x01f03a thru 0x01fc90 (0xc57 bytes) 000519 1786800814.566752 trunc from 0x03dafd to 0x0245d6 (0x19526 bytes) 000520 1786800814.588940 mapwrite 0x0287c8 thru 0x031187 (0x89c0 bytes) 000521 1786800814.743578 write 0x025fae thru 0x033939 (0xd98c bytes) 000522 1786800814.747805 trunc from 0x03393a to 0x00eae8 (0x24e51 bytes) 000524 1786800814.777941 mapread 0x003153 thru 0x00e986 (0xb834 bytes) 000525 1786800814.835697 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xeae9): Mirror 4: 0xd3569dde (stale) Mirror 5: 0xd3569dde (stale) Mirror 6: 0xd3569dde (stale) Mirror 7: 0xd3569dde (stale) Mirror 8: 0xd3569dde (stale) Mirror 9: 0xd3569dde (stale) Mirror 10: 0xd3569dde (stale) Mirror 12: 0xd3569dde (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xeae9): Mirror 4: 0xd3569dde (stale) Mirror 5: 0xd3569dde (stale) Mirror 6: 0xd3569dde (stale) Mirror 7: 0xd3569dde (stale) Mirror 8: 0xd3569dde (stale) Mirror 9: 0xd3569dde (stale) Mirror 10: 0xd3569dde (stale) Mirror 12: 0xd3569dde (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xeae9: skipped 000531 1786800815.609062 MIRROR_RESYNC 9 mirrors 000533 1786800817.531892 trunc from 0x00eae9 to 0x00f616 (0xb2e bytes) 000534 1786800817.612421 write 0x01dc7f thru 0x02dad3 (0xfe55 bytes) 000536 1786800817.622621 mapread 0x018f37 thru 0x01b44d (0x2517 bytes) 000538 1786800817.652762 write 0x026244 thru 0x0307e3 (0xa5a0 bytes) 000540 1786800817.656150 read 0x00e167 thru 0x01254c (0x43e6 bytes) 000542 1786800817.674843 mapread 0x007b47 thru 0x01608b (0xe545 bytes) 000545 1786800817.702712 mapread 0x00fdad thru 0x01eb42 (0xed96 bytes) 000547 1786800817.708937 write 0x00d8fe thru 0x0148f3 (0x6ff6 bytes) 000549 1786800817.710947 read 0x024832 thru 0x027582 (0x2d51 bytes) 000553 1786800817.713822 read 0x025c26 thru 0x029a15 (0x3df0 bytes) 000554 1786800817.714671 mapread 0x006ff1 thru 0x00d759 (0x6769 bytes) 000555 1786800817.716144 write 0x01a8c9 thru 0x021000 (0x6738 bytes) 000556 1786800817.717684 read 0x0121ff thru 0x017451 (0x5253 bytes) 000557 1786800817.718478 mapread 0x0070b1 thru 0x01393d (0xc88d bytes) 000558 1786800817.719823 mapwrite 0x004450 thru 0x008225 (0x3dd6 bytes) 000559 1786800817.797170 trunc from 0x0307e4 to 0x02d723 (0x30c0 bytes) 000561 1786800817.819990 write 0x00344a thru 0x00d458 (0xa00f bytes) 000562 1786800817.821981 trunc from 0x02d724 to 0x035a71 (0x834e bytes) 000563 1786800817.838608 mapwrite 0x03874f thru 0x03ffff (0x78b1 bytes) 000566 1786800817.916727 read 0x007cb1 thru 0x00a902 (0x2c52 bytes) 000567 1786800817.917537 write 0x030e17 thru 0x038108 (0x72f2 bytes) 000569 1786800817.923867 MIRROR_RESYNC 9 mirrors 000570 1786800819.672108 mapwrite 0x03ae59 thru 0x03ffff (0x51a7 bytes) 000571 1786800819.941778 mapread 0x002378 thru 0x00fb14 (0xd79d bytes) 000573 1786800819.954164 read 0x0000da thru 0x004e17 (0x4d3e bytes) 000574 1786800819.960308 read 0x01129d thru 0x01d1ae (0xbf12 bytes) 000576 1786800819.990622 write 0x0363a6 thru 0x03e6af (0x830a bytes) 000578 1786800819.993439 read 0x02901b thru 0x03881d (0xf803 bytes) 000579 1786800819.994612 read 0x03a926 thru 0x03bcac (0x1387 bytes) 000580 1786800819.996205 trunc from 0x040000 to 0x024e40 (0x1b1bf bytes) 000581 1786800820.022854 trunc from 0x024e41 to 0x019fb1 (0xae8f bytes) 000582 1786800820.040311 read 0x013f8b thru 0x019fb1 (0x6027 bytes) 000584 1786800820.042005 mapread 0x018331 thru 0x019fb1 (0x1c81 bytes) 000585 1786800820.043184 trunc from 0x019fb2 to 0x0170dc (0x2ed5 bytes) truncating to largest ever: 0x3e0f7 000586 1786800820.094246 trunc from 0x0170dd to 0x03e0f6 (0x2701a bytes) 000587 1786800820.133287 read 0x01f5a4 thru 0x02688e (0x72eb bytes) 000588 1786800820.156135 trunc from 0x03e0f7 to 0x004581 (0x39b75 bytes) 000589 1786800820.180972 trunc from 0x004582 to 0x02277c (0x1e1fb bytes) 000590 1786800820.208184 write 0x003746 thru 0x007997 (0x4252 bytes) 000592 1786800820.219276 read 0x01121b thru 0x020236 (0xf01c bytes) 000594 1786800820.231851 mapwrite 0x007980 thru 0x00cfa9 (0x562a bytes) 000596 1786800820.279079 mapread 0x00512e thru 0x00583f (0x712 bytes) 000597 1786800820.280843 write 0x030c92 thru 0x03c857 (0xbbc6 bytes) 000603 1786800820.288287 write 0x01101d thru 0x01e694 (0xd678 bytes) 000607 1786800820.295234 mapread 0x02e282 thru 0x03c857 (0xe5d6 bytes) 000609 1786800820.306931 mapwrite 0x012baf thru 0x01e9d7 (0xbe29 bytes) 000612 1786800820.371931 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3c858): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c858): Mirror 4: 0xcf370b90 (stale) Mirror 5: 0xcf370b90 (stale) Mirror 6: 0xcf370b90 (stale) Mirror 7: 0xcf370b90 (stale) Mirror 8: 0xcf370b90 (stale) Mirror 9: 0xcf370b90 (stale) Mirror 10: 0xcf370b90 (stale) Mirror 12: 0xcf370b90 (stale) CRC-32 checksum value for chunk [0, 0x3c858): Mirror 1: 0x93fee35a Mirror 13: 0x93fee35a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c858: skipped 000614 1786800821.815960 trunc from 0x03c858 to 0x01a41c (0x2243b bytes) 000617 1786800821.949490 trunc from 0x01a41d to 0x0097f2 (0x10c2a bytes) 000619 1786800821.979926 read 0x008cda thru 0x0097f2 (0xb19 bytes) 000620 1786800821.987649 mapread 0x0022b8 thru 0x0097f2 (0x753b bytes) 000622 1786800822.016908 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x97f3): Mirror 5: 0x3b97edd3 (stale) Mirror 6: 0x3b97edd3 (stale) Mirror 7: 0x3b97edd3 (stale) Mirror 8: 0x3b97edd3 (stale) Mirror 9: 0x3b97edd3 (stale) Mirror 10: 0x3b97edd3 (stale) Mirror 12: 0x3b97edd3 (stale) Mirror 13: 0x437a1536 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x97f3): Mirror 5: 0x3b97edd3 (stale) Mirror 6: 0x3b97edd3 (stale) Mirror 7: 0x3b97edd3 (stale) Mirror 8: 0x3b97edd3 (stale) Mirror 9: 0x3b97edd3 (stale) Mirror 10: 0x3b97edd3 (stale) Mirror 12: 0x3b97edd3 (stale) Mirror 13: 0x437a1536 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x97f3: skipped 000623 1786800822.779440 write 0x00c43f thru 0x015f5a (0x9b1c bytes) 000624 1786800822.787684 trunc from 0x015f5b to 0x03a754 (0x247fa bytes) 000625 1786800822.841897 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a755): Mirror 5: 0x2b97acc (stale) Mirror 6: 0x2b97acc (stale) Mirror 7: 0x2b97acc (stale) Mirror 8: 0x2b97acc (stale) Mirror 9: 0x2b97acc (stale) Mirror 10: 0x2b97acc (stale) Mirror 13: 0x70ce5390 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a755): Mirror 5: 0x2b97acc (stale) Mirror 6: 0x2b97acc (stale) Mirror 7: 0x2b97acc (stale) Mirror 8: 0x2b97acc (stale) Mirror 9: 0x2b97acc (stale) Mirror 10: 0x2b97acc (stale) Mirror 13: 0x70ce5390 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a755: skipped 000626 1786800823.440917 mapwrite 0x03258a thru 0x032e91 (0x908 bytes) 000627 1786800823.556914 write 0x03c01e thru 0x03ffff (0x3fe2 bytes) 000629 1786800823.564598 mapwrite 0x032126 thru 0x03a67e (0x8559 bytes) 000630 1786800823.685347 trunc from 0x040000 to 0x02a16d (0x15e92 bytes) 000631 1786800823.717130 write 0x03cbdf thru 0x03ffff (0x3421 bytes) 000633 1786800823.731426 trunc from 0x040000 to 0x01de1d (0x221e2 bytes) 000634 1786800823.773966 write 0x036cf1 thru 0x03ffff (0x930f bytes) 000635 1786800823.783268 write 0x009733 thru 0x014644 (0xaf12 bytes) 000637 1786800823.814119 read 0x03b3c3 thru 0x03ffff (0x4c3d bytes) 000639 1786800823.820194 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xdb969e2d (stale) Mirror 7: 0xdb969e2d (stale) Mirror 8: 0xdb969e2d (stale) Mirror 9: 0xdb969e2d (stale) Mirror 10: 0xdb969e2d (stale) Mirror 13: 0x413cba05 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xdb969e2d (stale) Mirror 7: 0xdb969e2d (stale) Mirror 8: 0xdb969e2d (stale) Mirror 9: 0xdb969e2d (stale) Mirror 10: 0xdb969e2d (stale) Mirror 13: 0x413cba05 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000641 1786800824.795505 trunc from 0x040000 to 0x0016ac (0x3e953 bytes) 000642 1786800824.836873 mapread 0x00141f thru 0x0016ac (0x28e bytes) 000643 1786800824.847939 mapread 0x001632 thru 0x0016ac (0x7b bytes) 000648 1786800824.856179 mapwrite 0x018c22 thru 0x0205ed (0x79cc bytes) 000649 1786800825.009981 mapwrite 0x03f9a7 thru 0x03ffff (0x659 bytes) truncating to largest ever: 0x3f358 000652 1786800825.183004 trunc from 0x040000 to 0x03f357 (0xca8 bytes) 000654 1786800825.235915 write 0x03dceb thru 0x03ffff (0x2315 bytes) 000655 1786800825.248061 mapread 0x021efd thru 0x026386 (0x448a bytes) 000656 1786800825.287734 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xdb969e2d (stale) Mirror 7: 0xdb969e2d (stale) Mirror 8: 0xdb969e2d (stale) Mirror 9: 0xdb969e2d (stale) Mirror 10: 0xdb969e2d (stale) Mirror 13: 0x413cba05 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x821f9a5c Mirror 14: 0x821f9a5c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000657 1786800827.763767 MIRROR_RESYNC 8 mirrors 000658 1786800829.290674 write 0x019e13 thru 0x0223aa (0x8598 bytes) 000663 1786800829.421930 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x821f9a5c (stale) Mirror 7: 0x821f9a5c (stale) Mirror 8: 0x821f9a5c (stale) Mirror 9: 0x821f9a5c (stale) Mirror 10: 0x821f9a5c (stale) Mirror 14: 0x821f9a5c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x821f9a5c (stale) Mirror 7: 0x821f9a5c (stale) Mirror 8: 0x821f9a5c (stale) Mirror 9: 0x821f9a5c (stale) Mirror 10: 0x821f9a5c (stale) Mirror 14: 0x821f9a5c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000664 1786800829.901393 read 0x00092e thru 0x007a94 (0x7167 bytes) 000666 1786800829.921875 read 0x02ae76 thru 0x039bdc (0xed67 bytes) 000667 1786800829.971996 write 0x031dca thru 0x036665 (0x489c bytes) 000668 1786800829.973910 trunc from 0x040000 to 0x017c9f (0x28360 bytes) 000669 1786800829.998584 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x17ca0): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17ca0): Mirror 6: 0x42efc3f7 (stale) Mirror 7: 0x42efc3f7 (stale) Mirror 8: 0x42efc3f7 (stale) Mirror 9: 0x42efc3f7 (stale) Mirror 10: 0x42efc3f7 (stale) Mirror 14: 0x42efc3f7 (stale) CRC-32 checksum value for chunk [0, 0x17ca0): Mirror 1: 0x42efc3f7 Mirror 15: 0x42efc3f7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17ca0: skipped 000673 1786800831.506694 trunc from 0x017ca0 to 0x028350 (0x106b1 bytes) 000674 1786800831.691926 trunc from 0x028351 to 0x0113a9 (0x16fa7 bytes) 000677 1786800831.739717 write 0x02f29b thru 0x038aba (0x9820 bytes) 000678 1786800831.744039 mapread 0x0044f4 thru 0x00e807 (0xa314 bytes) 000679 1786800831.770252 mapread 0x01d8d9 thru 0x020814 (0x2f3c bytes) 000680 1786800831.778451 mapread 0x030905 thru 0x035b9a (0x5296 bytes) 000682 1786800831.781121 read 0x019f39 thru 0x01f3a3 (0x546b bytes) 000684 1786800831.791347 read 0x00d4ac thru 0x00de14 (0x969 bytes) 000685 1786800831.792000 mapwrite 0x008d5b thru 0x00f7f3 (0x6a99 bytes) 000688 1786800832.092527 trunc from 0x038abb to 0x003f27 (0x34b93 bytes) 000690 1786800832.177863 write 0x032649 thru 0x03ffff (0xd9b7 bytes) 000692 1786800832.184109 mapread 0x033189 thru 0x03f9cf (0xc847 bytes) 000694 1786800832.190541 trunc from 0x040000 to 0x00a75f (0x358a0 bytes) 000695 1786800832.245914 mapread 0x000f97 thru 0x007352 (0x63bc bytes) 000696 1786800832.267939 trunc from 0x00a760 to 0x00d3db (0x2c7c bytes) 000697 1786800832.383844 mapwrite 0x011afe thru 0x0176fe (0x5c01 bytes) 000699 1786800832.512219 mapwrite 0x0323ed thru 0x03b4aa (0x90be bytes) 000700 1786800832.682956 write 0x005bbc thru 0x009f81 (0x43c6 bytes) 000701 1786800832.687040 trunc from 0x03b4ab to 0x025324 (0x16186 bytes) 000702 1786800832.726651 mapwrite 0x008195 thru 0x00c906 (0x4772 bytes) 000703 1786800832.825867 mapwrite 0x002c73 thru 0x007793 (0x4b21 bytes) 000705 1786800832.902611 read 0x01c6f9 thru 0x025324 (0x8c2c bytes) 000707 1786800832.909206 mapwrite 0x000f4a thru 0x007f75 (0x702c bytes) 000710 1786800833.019086 write 0x01de48 thru 0x02c815 (0xe9ce bytes) 000712 1786800833.047959 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c816): Mirror 6: 0x7a83bc59 (stale) Mirror 7: 0x7a83bc59 (stale) Mirror 8: 0x7a83bc59 (stale) Mirror 9: 0x7a83bc59 (stale) Mirror 10: 0x7a83bc59 (stale) Mirror 15: 0xcbb1b36d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c816): Mirror 6: 0x7a83bc59 (stale) Mirror 7: 0x7a83bc59 (stale) Mirror 8: 0x7a83bc59 (stale) Mirror 9: 0x7a83bc59 (stale) Mirror 10: 0x7a83bc59 (stale) Mirror 15: 0xcbb1b36d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c816: skipped 000715 1786800833.984969 mapread 0x009c7b thru 0x019733 (0xfab9 bytes) 000720 1786800834.020639 trunc from 0x02c816 to 0x025277 (0x759e bytes) 000723 1786800834.053124 mapwrite 0x028f81 thru 0x02b0d3 (0x2153 bytes) 000724 1786800834.406179 write 0x0001a4 thru 0x008b8e (0x89eb bytes) 000729 1786800834.435259 trunc from 0x02b0d4 to 0x01025f (0x1ae74 bytes) 000730 1786800834.526098 write 0x03d2ff thru 0x03ffff (0x2d01 bytes) 000731 1786800834.527273 write 0x00ebd6 thru 0x019386 (0xa7b1 bytes) 000732 1786800834.553916 read 0x03d5a2 thru 0x03ffff (0x2a5e bytes) 000733 1786800834.564888 read 0x0274ee thru 0x02985f (0x2372 bytes) 000739 1786800834.661321 mapwrite 0x02d872 thru 0x03a6b2 (0xce41 bytes) 000742 1786800834.881631 mapwrite 0x003305 thru 0x00cebe (0x9bba bytes) 000743 1786800835.049187 mapread 0x0116ba thru 0x01319a (0x1ae1 bytes) 000745 1786800835.063617 write 0x03c424 thru 0x03e70f (0x22ec bytes) 000746 1786800835.067689 mapread 0x02200c thru 0x025695 (0x368a bytes) 000747 1786800835.077919 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x821f9a5c (stale) Mirror 7: 0x821f9a5c (stale) Mirror 8: 0x821f9a5c (stale) Mirror 9: 0x821f9a5c (stale) Mirror 10: 0x821f9a5c (stale) Mirror 15: 0x6f034eba (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x49b34e7e Mirror 16: 0x49b34e7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000748 1786800837.192714 write 0x03710f thru 0x03ffff (0x8ef1 bytes) 000749 1786800837.625337 read 0x00df98 thru 0x01dde5 (0xfe4e bytes) 000750 1786800837.642150 write 0x027802 thru 0x02a1bb (0x29ba bytes) 000751 1786800837.670953 trunc from 0x040000 to 0x03d39b (0x2c64 bytes) 000752 1786800837.722443 read 0x0150c2 thru 0x01fdbd (0xacfc bytes) 000753 1786800837.758917 write 0x0359e3 thru 0x03e0b3 (0x86d1 bytes) 000754 1786800837.781872 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3e0b4): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e0b4): Mirror 6: 0xec5fb7a7 (stale) Mirror 7: 0xec5fb7a7 (stale) Mirror 8: 0xec5fb7a7 (stale) Mirror 9: 0xec5fb7a7 (stale) Mirror 10: 0xec5fb7a7 (stale) Mirror 15: 0xa3b4ae48 (stale) Mirror 16: 0x610321cc (stale) CRC-32 checksum value for chunk [0, 0x3e0b4): Mirror 1: 0xd1870f50 Mirror 17: 0xd1870f50 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e0b4: skipped 000756 1786800840.806594 mapread 0x0358b5 thru 0x039fd1 (0x471d bytes) 000758 1786800840.879386 trunc from 0x03e0b4 to 0x03930d (0x4da6 bytes) 000760 1786800840.962100 trunc from 0x03930e to 0x03f24f (0x5f42 bytes) 000763 1786800840.992952 mapwrite 0x026e66 thru 0x02b6b0 (0x484b bytes) 000765 1786800841.064986 mapread 0x00655b thru 0x014dd2 (0xe878 bytes) 000766 1786800841.111877 mapwrite 0x005848 thru 0x015470 (0xfc29 bytes) 000768 1786800841.201113 mapwrite 0x0054b8 thru 0x00ffba (0xab03 bytes) 000769 1786800841.368321 mapread 0x0060c0 thru 0x00dd49 (0x7c8a bytes) 000770 1786800841.385357 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f250): Mirror 6: 0x9ba832b7 (stale) Mirror 8: 0x9ba832b7 (stale) Mirror 9: 0x9ba832b7 (stale) Mirror 10: 0x9ba832b7 (stale) Mirror 15: 0x7d29249c (stale) Mirror 16: 0xb9ed9eac (stale) Mirror 17: 0xe5dce67e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f250): Mirror 6: 0x9ba832b7 (stale) Mirror 8: 0x9ba832b7 (stale) Mirror 9: 0x9ba832b7 (stale) Mirror 10: 0x9ba832b7 (stale) Mirror 15: 0x7d29249c (stale) Mirror 16: 0xb9ed9eac (stale) Mirror 17: 0xe5dce67e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f250: skipped 000771 1786800842.427173 read 0x026778 thru 0x0346dd (0xdf66 bytes) 000772 1786800842.444750 mapread 0x01e3b1 thru 0x02333e (0x4f8e bytes) 000773 1786800842.492735 trunc from 0x03f250 to 0x0395ec (0x5c63 bytes) 000774 1786800842.540484 write 0x036866 thru 0x03745e (0xbf9 bytes) 000777 1786800842.554967 mapwrite 0x009dde thru 0x00e648 (0x486b bytes) 000778 1786800842.731550 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x395ed): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x395ed): Mirror 6: 0x440c5dfb (stale) Mirror 8: 0x440c5dfb (stale) Mirror 9: 0x440c5dfb (stale) Mirror 10: 0x440c5dfb (stale) Mirror 15: 0xf447c6b (stale) Mirror 16: 0xcc89a16b (stale) Mirror 17: 0xa42ec915 (stale) CRC-32 checksum value for chunk [0, 0x395ed): Mirror 1: 0xce21d2ee Mirror 18: 0xce21d2ee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x395ed: skipped 000781 1786800844.912822 trunc from 0x0395ed to 0x01cabf (0x1cb2d bytes) 000782 1786800845.244010 mapwrite 0x031b33 thru 0x03618a (0x4658 bytes) 000784 1786800845.363367 mapwrite 0x03e692 thru 0x03ffff (0x196e bytes) 000787 1786800845.426098 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x821f9a5c (stale) Mirror 8: 0x821f9a5c (stale) Mirror 9: 0x821f9a5c (stale) Mirror 10: 0x821f9a5c (stale) Mirror 15: 0x6f034eba (stale) Mirror 16: 0x49b34e7e (stale) Mirror 17: 0x35a2b7cb (stale) Mirror 18: 0x3f63d503 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdd057f5d Mirror 19: 0xdd057f5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000788 1786800848.186611 mapread 0x01b3da thru 0x029b60 (0xe787 bytes) 000789 1786800848.233182 write 0x02fbdd thru 0x0385f3 (0x8a17 bytes) 000791 1786800848.326690 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x821f9a5c (stale) Mirror 9: 0x821f9a5c (stale) Mirror 10: 0x821f9a5c (stale) Mirror 15: 0x6f034eba (stale) Mirror 16: 0x49b34e7e (stale) Mirror 17: 0x35a2b7cb (stale) Mirror 18: 0x3f63d503 (stale) Mirror 19: 0xdd057f5d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x821f9a5c (stale) Mirror 9: 0x821f9a5c (stale) Mirror 10: 0x821f9a5c (stale) Mirror 15: 0x6f034eba (stale) Mirror 16: 0x49b34e7e (stale) Mirror 17: 0x35a2b7cb (stale) Mirror 18: 0x3f63d503 (stale) Mirror 19: 0xdd057f5d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000793 1786800849.681385 MIRROR_RESYNC 9 mirrors 000795 1786800851.672159 read 0x005141 thru 0x00c56e (0x742e bytes) 000797 1786800851.713604 mapwrite 0x02304c thru 0x030576 (0xd52b bytes) 000799 1786800852.062844 MIRROR_RESYNC 9 mirrors 000800 1786800853.294158 mapwrite 0x019c84 thru 0x01c1f9 (0x2576 bytes) 000804 1786800853.470926 mapread 0x036f40 thru 0x03ac44 (0x3d05 bytes) 000807 1786800853.488352 write 0x03a9db thru 0x03c820 (0x1e46 bytes) 000808 1786800853.491614 mapwrite 0x023b0b thru 0x029e03 (0x62f9 bytes) 000809 1786800853.575542 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x13eb2815 (stale) Mirror 9: 0x13eb2815 (stale) Mirror 10: 0x13eb2815 (stale) Mirror 15: 0x13eb2815 (stale) Mirror 16: 0x13eb2815 (stale) Mirror 17: 0x13eb2815 (stale) Mirror 18: 0x13eb2815 (stale) Mirror 19: 0x13eb2815 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3185895 Mirror 20: 0x3185895 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000811 1786800855.288984 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x13eb2815 (stale) Mirror 9: 0x13eb2815 (stale) Mirror 10: 0x13eb2815 (stale) Mirror 15: 0x13eb2815 (stale) Mirror 16: 0x13eb2815 (stale) Mirror 17: 0x13eb2815 (stale) Mirror 18: 0x13eb2815 (stale) Mirror 19: 0x13eb2815 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3185895 Mirror 20: 0x3185895 Mirror 21: 0x3185895 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000812 1786800857.303276 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x13eb2815 (stale) Mirror 9: 0x13eb2815 (stale) Mirror 10: 0x13eb2815 (stale) Mirror 15: 0x13eb2815 (stale) Mirror 16: 0x13eb2815 (stale) Mirror 17: 0x13eb2815 (stale) Mirror 18: 0x13eb2815 (stale) Mirror 19: 0x13eb2815 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3185895 Mirror 20: 0x3185895 Mirror 21: 0x3185895 Mirror 22: 0x3185895 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000813 1786800858.638601 mapwrite 0x03a029 thru 0x03ffff (0x5fd7 bytes) 000815 1786800858.925724 read 0x026d03 thru 0x028576 (0x1874 bytes) 000816 1786800858.954912 MIRROR_RESYNC 12 mirrors 000817 1786800860.750447 mapwrite 0x012533 thru 0x013b05 (0x15d3 bytes) 000819 1786800860.939719 write 0x02f854 thru 0x03bf92 (0xc73f bytes) 000820 1786800860.954048 trunc from 0x040000 to 0x02bb21 (0x144de bytes) 000824 1786800860.982322 mapread 0x028554 thru 0x02bb21 (0x35ce bytes) 000825 1786800860.995861 trunc from 0x02bb22 to 0x01ea55 (0xd0cc bytes) 000826 1786800861.020783 mapwrite 0x00c893 thru 0x01747b (0xabe9 bytes) 000827 1786800861.066250 trunc from 0x01ea56 to 0x017cb3 (0x6da2 bytes) 000832 1786800861.091004 mapread 0x015999 thru 0x017cb3 (0x231b bytes) 000834 1786800861.093693 write 0x00ec44 thru 0x01727d (0x863a bytes) 000836 1786800861.095766 trunc from 0x017cb4 to 0x008cb8 (0xeffb bytes) 000838 1786800861.116591 read 0x005efc thru 0x008cb8 (0x2dbd bytes) 000846 1786800861.131926 mapwrite 0x027e0c thru 0x036f34 (0xf129 bytes) 000847 1786800861.278822 trunc from 0x036f35 to 0x03d49f (0x656b bytes) 000848 1786800861.316896 trunc from 0x03d4a0 to 0x03a587 (0x2f18 bytes) 000854 1786800861.376723 trunc from 0x03a588 to 0x012e95 (0x276f2 bytes) 000855 1786800861.422713 trunc from 0x012e96 to 0x015036 (0x21a1 bytes) 000856 1786800861.462553 mapwrite 0x035a5d thru 0x035f2c (0x4d0 bytes) 000857 1786800861.570946 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35f2d): Mirror 8: 0x6a3e91f4 (stale) Mirror 9: 0x6a3e91f4 (stale) Mirror 10: 0x6a3e91f4 (stale) Mirror 15: 0x6a3e91f4 (stale) Mirror 17: 0x6a3e91f4 (stale) Mirror 18: 0x6a3e91f4 (stale) Mirror 19: 0x6a3e91f4 (stale) Mirror 20: 0x6a3e91f4 (stale) Mirror 21: 0x6a3e91f4 (stale) Mirror 22: 0x6a3e91f4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35f2d): Mirror 8: 0x6a3e91f4 (stale) Mirror 9: 0x6a3e91f4 (stale) Mirror 10: 0x6a3e91f4 (stale) Mirror 15: 0x6a3e91f4 (stale) Mirror 17: 0x6a3e91f4 (stale) Mirror 18: 0x6a3e91f4 (stale) Mirror 19: 0x6a3e91f4 (stale) Mirror 20: 0x6a3e91f4 (stale) Mirror 21: 0x6a3e91f4 (stale) Mirror 22: 0x6a3e91f4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35f2d: skipped 000859 1786800862.519973 mapread 0x02c168 thru 0x02fb13 (0x39ac bytes) 000862 1786800862.553307 read 0x02884e thru 0x0354c7 (0xcc7a bytes) 000863 1786800862.555581 mapread 0x010bf7 thru 0x018073 (0x747d bytes) 000864 1786800862.568750 read 0x002542 thru 0x00be97 (0x9956 bytes) 000867 1786800862.584055 read 0x02b888 thru 0x035f2c (0xa6a5 bytes) 000868 1786800862.585521 trunc from 0x035f2d to 0x0287e0 (0xd74c bytes) 000869 1786800862.614969 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x287e1): Mirror 8: 0xcaf8ee2b (stale) Mirror 9: 0xcaf8ee2b (stale) Mirror 10: 0xcaf8ee2b (stale) Mirror 15: 0xcaf8ee2b (stale) Mirror 17: 0xcaf8ee2b (stale) Mirror 18: 0xcaf8ee2b (stale) Mirror 20: 0xcaf8ee2b (stale) Mirror 21: 0xcaf8ee2b (stale) Mirror 22: 0xcaf8ee2b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x287e1): Mirror 8: 0xcaf8ee2b (stale) Mirror 9: 0xcaf8ee2b (stale) Mirror 10: 0xcaf8ee2b (stale) Mirror 15: 0xcaf8ee2b (stale) Mirror 17: 0xcaf8ee2b (stale) Mirror 18: 0xcaf8ee2b (stale) Mirror 20: 0xcaf8ee2b (stale) Mirror 21: 0xcaf8ee2b (stale) Mirror 22: 0xcaf8ee2b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x287e1: skipped 000874 1786800863.367010 mapread 0x0006b8 thru 0x00d508 (0xce51 bytes) 000877 1786800863.393933 mapread 0x014181 thru 0x01e526 (0xa3a6 bytes) 000878 1786800863.411823 read 0x002447 thru 0x007350 (0x4f0a bytes) 000879 1786800863.417135 MIRROR_RESYNC 10 mirrors 000881 1786800865.515667 write 0x01b121 thru 0x029387 (0xe267 bytes) 000882 1786800865.579121 mapread 0x0159f5 thru 0x020556 (0xab62 bytes) 000883 1786800865.599557 read 0x01a5c7 thru 0x01ea21 (0x445b bytes) 000886 1786800865.604123 read 0x01f56c thru 0x029387 (0x9e1c bytes) 000887 1786800865.605517 mapread 0x011fca thru 0x01a2aa (0x82e1 bytes) 000889 1786800865.613409 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x29388): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29388): Mirror 8: 0x356d195f (stale) Mirror 9: 0x356d195f (stale) Mirror 10: 0x356d195f (stale) Mirror 15: 0x356d195f (stale) Mirror 17: 0x356d195f (stale) Mirror 18: 0x356d195f (stale) Mirror 20: 0x356d195f (stale) Mirror 21: 0x356d195f (stale) Mirror 22: 0x356d195f (stale) CRC-32 checksum value for chunk [0, 0x29388): Mirror 1: 0x734e878c Mirror 23: 0x734e878c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29388: skipped 000890 1786800867.173628 write 0x02eb9a thru 0x034566 (0x59cd bytes) 000891 1786800867.301282 MIRROR_RESYNC 11 mirrors 000892 1786800869.063920 trunc from 0x034567 to 0x03846c (0x3f06 bytes) 000893 1786800869.168009 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3846d): Mirror 8: 0x46edf23e (stale) Mirror 9: 0x46edf23e (stale) Mirror 10: 0x46edf23e (stale) Mirror 15: 0x46edf23e (stale) Mirror 17: 0x46edf23e (stale) Mirror 18: 0x46edf23e (stale) Mirror 20: 0x46edf23e (stale) Mirror 21: 0x46edf23e (stale) Mirror 23: 0x46edf23e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3846d): Mirror 8: 0x46edf23e (stale) Mirror 9: 0x46edf23e (stale) Mirror 10: 0x46edf23e (stale) Mirror 15: 0x46edf23e (stale) Mirror 17: 0x46edf23e (stale) Mirror 18: 0x46edf23e (stale) Mirror 20: 0x46edf23e (stale) Mirror 21: 0x46edf23e (stale) Mirror 23: 0x46edf23e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3846d: skipped 000894 1786800869.688932 read 0x020a64 thru 0x02331d (0x28ba bytes) 000896 1786800869.698407 read 0x001f0d thru 0x00d629 (0xb71d bytes) 000897 1786800869.714658 read 0x02c524 thru 0x03153b (0x5018 bytes) 000898 1786800869.724495 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3846d): Mirror 8: 0x46edf23e (stale) Mirror 9: 0x46edf23e (stale) Mirror 15: 0x46edf23e (stale) Mirror 17: 0x46edf23e (stale) Mirror 18: 0x46edf23e (stale) Mirror 20: 0x46edf23e (stale) Mirror 21: 0x46edf23e (stale) Mirror 23: 0x46edf23e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3846d): Mirror 8: 0x46edf23e (stale) Mirror 9: 0x46edf23e (stale) Mirror 15: 0x46edf23e (stale) Mirror 17: 0x46edf23e (stale) Mirror 18: 0x46edf23e (stale) Mirror 20: 0x46edf23e (stale) Mirror 21: 0x46edf23e (stale) Mirror 23: 0x46edf23e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3846d: skipped 000899 1786800870.276559 trunc from 0x03846d to 0x0356c5 (0x2da7 bytes) 000902 1786800870.309493 write 0x00b6ca thru 0x013e60 (0x8797 bytes) 000905 1786800870.325610 read 0x00f888 thru 0x0140cf (0x4848 bytes) 000906 1786800870.343854 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x356c6): Mirror 9: 0xfac2d81f (stale) Mirror 15: 0xfac2d81f (stale) Mirror 17: 0xfac2d81f (stale) Mirror 18: 0xfac2d81f (stale) Mirror 20: 0xfac2d81f (stale) Mirror 21: 0xfac2d81f (stale) Mirror 23: 0xfac2d81f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x356c6): Mirror 9: 0xfac2d81f (stale) Mirror 15: 0xfac2d81f (stale) Mirror 17: 0xfac2d81f (stale) Mirror 18: 0xfac2d81f (stale) Mirror 20: 0xfac2d81f (stale) Mirror 21: 0xfac2d81f (stale) Mirror 23: 0xfac2d81f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x356c6: skipped 000907 1786800870.975484 mapread 0x02b5c8 thru 0x0300a8 (0x4ae1 bytes) 000909 1786800870.996863 trunc from 0x0356c6 to 0x00f747 (0x25f7e bytes) 000912 1786800871.011534 trunc from 0x00f748 to 0x011437 (0x1cf0 bytes) 000913 1786800871.023159 mapread 0x00f1fb thru 0x011437 (0x223d bytes) 000914 1786800871.030926 trunc from 0x011438 to 0x00e202 (0x3235 bytes) 000915 1786800871.047314 trunc from 0x00e203 to 0x010ff4 (0x2df2 bytes) 000917 1786800871.070364 read 0x0072ff thru 0x010ff4 (0x9cf6 bytes) 000918 1786800871.082142 mapwrite 0x02bdc4 thru 0x036408 (0xa645 bytes) 000921 1786800871.271197 write 0x02146b thru 0x029e5b (0x89f1 bytes) 000922 1786800871.293107 trunc from 0x036409 to 0x00dd91 (0x28677 bytes) 000923 1786800871.329664 trunc from 0x00dd92 to 0x008f55 (0x4e3c bytes) 000929 1786800871.391197 MIRROR_RESYNC 8 mirrors 000931 1786800872.946349 mapread 0x0028fd thru 0x008f55 (0x6659 bytes) 000932 1786800872.994900 mapread 0x00059e thru 0x007774 (0x71d7 bytes) 000934 1786800873.001527 mapread 0x000c60 thru 0x008f55 (0x82f6 bytes) 000935 1786800873.003963 mapread 0x003c77 thru 0x008462 (0x47ec bytes) 000940 1786800873.008997 mapwrite 0x03f719 thru 0x03ffff (0x8e7 bytes) 000941 1786800873.178881 mapread 0x03ee1a thru 0x03ffff (0x11e6 bytes) 000942 1786800873.180010 read 0x022145 thru 0x0262c0 (0x417c bytes) 000944 1786800873.190812 write 0x02e241 thru 0x037f89 (0x9d49 bytes) 000945 1786800873.211554 read 0x033225 thru 0x037c3a (0x4a16 bytes) 000946 1786800873.218635 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xffc6cef4 (stale) Mirror 15: 0xffc6cef4 (stale) Mirror 17: 0xffc6cef4 (stale) Mirror 18: 0xffc6cef4 (stale) Mirror 20: 0xffc6cef4 (stale) Mirror 21: 0xffc6cef4 (stale) Mirror 23: 0xffc6cef4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x12c1e489 Mirror 24: 0x12c1e489 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000947 1786800874.634480 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xffc6cef4 (stale) Mirror 17: 0xffc6cef4 (stale) Mirror 18: 0xffc6cef4 (stale) Mirror 20: 0xffc6cef4 (stale) Mirror 21: 0xffc6cef4 (stale) Mirror 23: 0xffc6cef4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xffc6cef4 (stale) Mirror 17: 0xffc6cef4 (stale) Mirror 18: 0xffc6cef4 (stale) Mirror 20: 0xffc6cef4 (stale) Mirror 21: 0xffc6cef4 (stale) Mirror 23: 0xffc6cef4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x12c1e489 Mirror 24: 0x12c1e489 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000949 1786800875.770587 trunc from 0x040000 to 0x03e061 (0x1f9e bytes) 000950 1786800876.040619 read 0x000bf4 thru 0x005065 (0x4472 bytes) 000951 1786800876.057945 trunc from 0x03e062 to 0x00f362 (0x2ecff bytes) 000952 1786800876.086399 write 0x01fd31 thru 0x0296b2 (0x9982 bytes) 000953 1786800876.087932 mapwrite 0x01e8f3 thru 0x02dd39 (0xf447 bytes) 000954 1786800876.159191 mapwrite 0x005b72 thru 0x00d1b7 (0x7646 bytes) 000956 1786800876.212245 trunc from 0x02dd3a to 0x03e477 (0x1073e bytes) 000957 1786800876.225583 mapwrite 0x007bf6 thru 0x016189 (0xe594 bytes) 000960 1786800876.420789 mapread 0x027a4c thru 0x02cfaa (0x555f bytes) 000962 1786800876.425606 write 0x023770 thru 0x0253d8 (0x1c69 bytes) 000964 1786800876.427639 read 0x004499 thru 0x00d1cc (0x8d34 bytes) 000965 1786800876.432934 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e478): Mirror 17: 0x9d0bed9b (stale) Mirror 18: 0x9d0bed9b (stale) Mirror 20: 0x9d0bed9b (stale) Mirror 21: 0x9d0bed9b (stale) Mirror 23: 0x9d0bed9b (stale) Mirror 24: 0xb3c8d035 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e478): Mirror 17: 0x9d0bed9b (stale) Mirror 18: 0x9d0bed9b (stale) Mirror 20: 0x9d0bed9b (stale) Mirror 21: 0x9d0bed9b (stale) Mirror 23: 0x9d0bed9b (stale) Mirror 24: 0xb3c8d035 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e478: skipped 000966 1786800876.916417 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3e478): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e478): Mirror 17: 0x9d0bed9b (stale) Mirror 18: 0x9d0bed9b (stale) Mirror 20: 0x9d0bed9b (stale) Mirror 21: 0x9d0bed9b (stale) Mirror 23: 0x9d0bed9b (stale) Mirror 24: 0xb3c8d035 (stale) CRC-32 checksum value for chunk [0, 0x3e478): Mirror 1: 0x1eb8cc5b Mirror 25: 0x1eb8cc5b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e478: skipped 000967 1786800877.844996 mapread 0x00587e thru 0x005d0f (0x492 bytes) 000969 1786800877.885686 trunc from 0x03e478 to 0x0342a5 (0xa1d2 bytes) 000972 1786800878.021535 read 0x014215 thru 0x01f7e0 (0xb5cc bytes) 000973 1786800878.031997 read 0x00b4d5 thru 0x00fda6 (0x48d2 bytes) 000974 1786800878.041830 write 0x002439 thru 0x00b10b (0x8cd3 bytes) 000978 1786800878.045825 write 0x020b54 thru 0x02a52d (0x99da bytes) 000979 1786800878.047272 read 0x02766d thru 0x02b1e5 (0x3b79 bytes) 000981 1786800878.049067 mapread 0x00c428 thru 0x01a0a6 (0xdc7f bytes) 000982 1786800878.050663 mapwrite 0x014446 thru 0x0197a0 (0x535b bytes) 000983 1786800878.095114 read 0x026342 thru 0x0294d4 (0x3193 bytes) 000985 1786800878.097534 read 0x013baa thru 0x022cd4 (0xf12b bytes) 000987 1786800878.099143 trunc from 0x0342a6 to 0x00141a (0x32e8b bytes) 000988 1786800878.117547 trunc from 0x00141b to 0x002686 (0x126c bytes) 000989 1786800878.130847 mapwrite 0x0188fb thru 0x024316 (0xba1c bytes) 000991 1786800878.338640 trunc from 0x024317 to 0x015a8d (0xe889 bytes) 000993 1786800878.401361 mapwrite 0x00b11f thru 0x00f0f2 (0x3fd4 bytes) 000994 1786800878.515423 mapwrite 0x0217fe thru 0x02a104 (0x8907 bytes) 000995 1786800878.736826 read 0x0120ed thru 0x016e45 (0x4d59 bytes) 000997 1786800878.748604 trunc from 0x02a105 to 0x00f9a2 (0x1a762 bytes) 000998 1786800878.786720 write 0x0302b8 thru 0x03842f (0x8178 bytes) 001000 1786800878.799777 read 0x009d04 thru 0x00f7b5 (0x5ab2 bytes) All operations completed A-OK!