== sanity-flr test 70a: flr mode fsx test ================ 13:39:26 (1771439966) Seed set to 9967 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1771439967.590731 mapwrite 0x035275 thru 0x03f2f8 (0xa084 bytes) 000002 1771439967.619400 read 0x03cd01 thru 0x03d9e0 (0xce0 bytes) 000004 1771439967.620384 mapwrite 0x033e16 thru 0x039627 (0x5812 bytes) 000005 1771439967.636240 read 0x023fe5 thru 0x030357 (0xc373 bytes) 000006 1771439967.641237 read 0x00690f thru 0x00d0f6 (0x67e8 bytes) 000007 1771439967.641770 write 0x013996 thru 0x014160 (0x7cb bytes) 000009 1771439967.642829 read 0x002630 thru 0x00a400 (0x7dd1 bytes) 000010 1771439967.643325 mapread 0x02fc2b thru 0x03bce8 (0xc0be bytes) 000011 1771439967.644279 write 0x013e7e thru 0x019609 (0x578c bytes) 000012 1771439967.645159 mapread 0x031ce7 thru 0x03f2f8 (0xd612 bytes) 000013 1771439967.646028 read 0x01f7f8 thru 0x024d0a (0x5513 bytes) 000015 1771439967.647505 write 0x01ccea thru 0x0233ca (0x66e1 bytes) 000016 1771439967.648448 read 0x010012 thru 0x0168e0 (0x68cf bytes) 000019 1771439967.651621 MIRROR_EXTEND to 2 mirrors 000020 1771439967.850084 read 0x03551a thru 0x03e9dc (0x94c3 bytes) 000024 1771439967.856177 mapwrite 0x03a212 thru 0x03ffff (0x5dee bytes) 000026 1771439967.921207 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa268be17 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4ef54e23 Mirror 3: 0x4ef54e23 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000028 1771439968.199067 write 0x029039 thru 0x0386b6 (0xf67e bytes) 000029 1771439968.226521 mapread 0x020147 thru 0x025094 (0x4f4e bytes) 000030 1771439968.230492 read 0x01c9fb thru 0x02320d (0x6813 bytes) 000032 1771439968.233874 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa268be17 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa268be17 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped truncating to largest ever: 0x16cae 000033 1771439968.345167 trunc from 0x040000 to 0x016cad (0x29352 bytes) 000037 1771439968.354702 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x16cae): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16cae): Mirror 2: 0x6b928acc (stale) CRC-32 checksum value for chunk [0, 0x16cae): Mirror 1: 0x6b928acc Mirror 3: 0x6b928acc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16cae: skipped 000039 1771439968.620280 MIRROR_RESYNC 3 mirrors 000040 1771439968.806408 mapread 0x013a7c thru 0x016cad (0x3232 bytes) 000041 1771439968.812394 MIRROR_RESYNC 3 mirrors truncating to largest ever: 0x2d7b6 000043 1771439968.939211 trunc from 0x016cae to 0x02d7b5 (0x16b08 bytes) 000045 1771439968.965004 write 0x016a2e thru 0x01a67e (0x3c51 bytes) 000048 1771439968.972382 trunc from 0x02d7b6 to 0x02c831 (0xf84 bytes) 000049 1771439968.980479 read 0x00ceda thru 0x01844c (0xb573 bytes) 000050 1771439968.984470 mapread 0x01bcc1 thru 0x024d06 (0x9046 bytes) 000053 1771439968.996310 write 0x0172cd thru 0x024284 (0xcfb8 bytes) 000059 1771439969.000013 mapwrite 0x03c4aa thru 0x03ffff (0x3b56 bytes) truncating to largest ever: 0x39542 000060 1771439969.037813 trunc from 0x040000 to 0x039541 (0x6abe bytes) 000061 1771439969.049141 write 0x016603 thru 0x0217dc (0xb1da bytes) 000064 1771439969.051194 read 0x01929f thru 0x028a08 (0xf76a bytes) 000067 1771439969.053014 trunc from 0x039542 to 0x002f67 (0x365da bytes) 000069 1771439969.066244 MIRROR_RESYNC 3 mirrors 000070 1771439969.269077 MIRROR_EXTEND to 4 mirrors 000072 1771439969.488871 mapread 0x000191 thru 0x002f67 (0x2dd7 bytes) 000073 1771439969.499731 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) 000075 1771439969.600493 trunc from 0x002f68 to 0x0289fe (0x25a97 bytes) 000076 1771439969.626051 mapread 0x01c3de thru 0x0252f7 (0x8f1a bytes) 000078 1771439969.637041 mapread 0x001332 thru 0x00ad76 (0x9a45 bytes) 000079 1771439969.641551 mapread 0x01edbb thru 0x0246dd (0x5923 bytes) 000082 1771439969.645064 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x289ff): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x289ff): Mirror 3: 0x8971e15d (stale) Mirror 4: 0x8971e15d (stale) CRC-32 checksum value for chunk [0, 0x289ff): Mirror 1: 0x8971e15d Mirror 5: 0x8971e15d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x289ff: skipped 000083 1771439969.877181 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x289ff): Mirror 3: 0x8971e15d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x289ff): Mirror 3: 0x8971e15d (stale) CRC-32 checksum value for chunk [0, 0x289ff): Mirror 1: 0x8971e15d Mirror 5: 0x8971e15d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x289ff: skipped 000086 1771439970.033005 mapwrite 0x017396 thru 0x01be4e (0x4ab9 bytes) 000087 1771439970.096139 mapread 0x01e282 thru 0x0289fe (0xa77d bytes) 000088 1771439970.100781 mapwrite 0x02a92a thru 0x039025 (0xe6fc bytes) 000089 1771439970.159175 mapwrite 0x028a36 thru 0x0367cd (0xdd98 bytes) 000090 1771439970.179946 mapread 0x033f31 thru 0x036d4b (0x2e1b bytes) 000091 1771439970.182814 MIRROR_RESYNC 3 mirrors 000092 1771439970.379362 trunc from 0x039026 to 0x01b98e (0x1d697 bytes) 000094 1771439970.409200 trunc from 0x01b98f to 0x02d1e1 (0x11853 bytes) 000095 1771439970.418036 mapread 0x029249 thru 0x02d1e1 (0x3f99 bytes) 000097 1771439970.425970 read 0x00182b thru 0x009bc3 (0x8399 bytes) 000098 1771439970.429746 read 0x02393b thru 0x02d1e1 (0x98a7 bytes) 000101 1771439970.435283 trunc from 0x02d1e2 to 0x038da4 (0xbbc3 bytes) 000102 1771439970.442376 mapread 0x00288a thru 0x009ed6 (0x764d bytes) 000103 1771439970.443222 read 0x00f9c6 thru 0x0173f4 (0x7a2f bytes) 000104 1771439970.443793 write 0x03fba3 thru 0x03ffff (0x45d bytes) 000105 1771439970.444581 mapwrite 0x021cb7 thru 0x02efef (0xd339 bytes) 000108 1771439970.468780 read 0x01305d thru 0x018a1e (0x59c2 bytes) 000110 1771439970.469935 mapread 0x028529 thru 0x029ec7 (0x199f bytes) 000111 1771439970.470886 write 0x0337b1 thru 0x034ac6 (0x1316 bytes) 000112 1771439970.471718 trunc from 0x040000 to 0x005f85 (0x3a07a bytes) 000113 1771439970.479228 MIRROR_RESYNC 3 mirrors 000114 1771439970.663426 write 0x01ec30 thru 0x02368d (0x4a5e bytes) 000115 1771439970.679432 write 0x036522 thru 0x03ffff (0x9ade bytes) 000118 1771439970.681273 mapwrite 0x03c150 thru 0x03ffff (0x3eb0 bytes) 000119 1771439970.696370 trunc from 0x040000 to 0x0390d1 (0x6f2e bytes) 000120 1771439970.712998 write 0x01eee4 thru 0x0238bf (0x49dc bytes) 000121 1771439970.713974 read 0x0298dd thru 0x02f5d7 (0x5cfb bytes) 000124 1771439970.718485 trunc from 0x0390d2 to 0x036700 (0x29d1 bytes) 000128 1771439970.729184 MIRROR_RESYNC 3 mirrors 000129 1771439970.926399 mapread 0x029aab thru 0x029b2d (0x83 bytes) 000131 1771439970.928205 write 0x01699b thru 0x01d6f6 (0x6d5c bytes) 000132 1771439970.947104 mapread 0x00165f thru 0x007d2b (0x66cd bytes) 000134 1771439970.951155 mapwrite 0x00e22a thru 0x013ffc (0x5dd3 bytes) 000135 1771439970.971968 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36701): Mirror 5: 0x674542f4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36701): Mirror 5: 0x674542f4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36701: skipped 000136 1771439971.057195 mapwrite 0x013dfd thru 0x014fe5 (0x11e9 bytes) 000138 1771439971.075298 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x36701): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36701): Mirror 5: 0x674542f4 (stale) CRC-32 checksum value for chunk [0, 0x36701): Mirror 1: 0x5a44ab0f Mirror 6: 0x5a44ab0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36701: skipped 000140 1771439971.301225 read 0x016e7f thru 0x022ec8 (0xc04a bytes) 000142 1771439971.307316 mapwrite 0x00a51a thru 0x010dfe (0x68e5 bytes) 000144 1771439971.372787 read 0x005621 thru 0x014684 (0xf064 bytes) 000148 1771439971.378702 mapwrite 0x018e05 thru 0x01e2d3 (0x54cf bytes) 000151 1771439971.393169 mapread 0x02170d thru 0x02fb9b (0xe48f bytes) 000152 1771439971.395324 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x36701): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36701): Mirror 5: 0x674542f4 (stale) Mirror 6: 0x5a44ab0f (stale) CRC-32 checksum value for chunk [0, 0x36701): Mirror 1: 0x6032f909 Mirror 7: 0x6032f909 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36701: skipped 000154 1771439971.618834 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x36701): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36701): Mirror 5: 0x674542f4 (stale) Mirror 6: 0x5a44ab0f (stale) CRC-32 checksum value for chunk [0, 0x36701): Mirror 1: 0x6032f909 Mirror 7: 0x6032f909 Mirror 8: 0x6032f909 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36701: skipped 000155 1771439971.872562 write 0x03580a thru 0x03ffff (0xa7f6 bytes) 000157 1771439971.898605 write 0x01df44 thru 0x029f53 (0xc010 bytes) 000159 1771439971.903175 read 0x00e339 thru 0x010bf9 (0x28c1 bytes) 000161 1771439971.906771 mapwrite 0x019a3c thru 0x01d454 (0x3a19 bytes) 000162 1771439971.933272 mapread 0x004fde thru 0x01158d (0xc5b0 bytes) 000163 1771439971.938557 mapread 0x0267af thru 0x030f35 (0xa787 bytes) 000166 1771439971.943750 mapwrite 0x00c1dd thru 0x014a78 (0x889c bytes) 000167 1771439971.960765 mapwrite 0x02c09c thru 0x02fbd2 (0x3b37 bytes) 000168 1771439971.974204 mapwrite 0x0205d2 thru 0x027565 (0x6f94 bytes) 000169 1771439971.991186 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x1c76f40a (stale) Mirror 7: 0x582c474b (stale) Mirror 8: 0x582c474b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x1c76f40a (stale) Mirror 7: 0x582c474b (stale) Mirror 8: 0x582c474b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000171 1771439972.102182 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x1c76f40a (stale) Mirror 7: 0x582c474b (stale) Mirror 8: 0x582c474b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x959b98e3 Mirror 9: 0x959b98e3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000172 1771439972.367757 trunc from 0x040000 to 0x02ac08 (0x153f7 bytes) 000173 1771439972.392137 mapread 0x0165cd thru 0x020820 (0xa254 bytes) 000174 1771439972.408749 MIRROR_RESYNC 5 mirrors 000175 1771439972.704423 mapwrite 0x03110d thru 0x03a2db (0x91cf bytes) 000177 1771439972.769483 mapread 0x03383a thru 0x03a2db (0x6aa2 bytes) 000180 1771439972.771812 write 0x001f55 thru 0x00c84c (0xa8f8 bytes) 000181 1771439972.782624 mapwrite 0x028374 thru 0x0353e3 (0xd070 bytes) 000182 1771439972.803520 mapread 0x026d81 thru 0x02d9cc (0x6c4c bytes) 000183 1771439972.806454 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3a2dc): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a2dc): Mirror 6: 0x7e608fe3 (stale) Mirror 7: 0x7e608fe3 (stale) Mirror 8: 0x7e608fe3 (stale) Mirror 9: 0x7e608fe3 (stale) CRC-32 checksum value for chunk [0, 0x3a2dc): Mirror 1: 0x8be7a49b Mirror 10: 0x8be7a49b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a2dc: skipped 000184 1771439973.093244 read 0x019145 thru 0x01c822 (0x36de bytes) 000185 1771439973.097197 read 0x0114d9 thru 0x017f3f (0x6a67 bytes) 000188 1771439973.105529 mapread 0x024b28 thru 0x02a3bc (0x5895 bytes) 000191 1771439973.117087 mapwrite 0x00ab73 thru 0x012481 (0x790f bytes) 000192 1771439973.186138 mapread 0x01b84c thru 0x01f774 (0x3f29 bytes) 000194 1771439973.194653 read 0x01b3f2 thru 0x01c131 (0xd40 bytes) 000195 1771439973.195206 trunc from 0x03a2dc to 0x00c9dc (0x2d8ff bytes) 000196 1771439973.206439 mapwrite 0x01fdde thru 0x022b83 (0x2da6 bytes) 000197 1771439973.229640 read 0x01bc46 thru 0x01d968 (0x1d23 bytes) 000198 1771439973.231755 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22b84): Mirror 7: 0x204fdd8f (stale) Mirror 8: 0x204fdd8f (stale) Mirror 9: 0x204fdd8f (stale) Mirror 10: 0x62fa6843 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22b84): Mirror 7: 0x204fdd8f (stale) Mirror 8: 0x204fdd8f (stale) Mirror 9: 0x204fdd8f (stale) Mirror 10: 0x62fa6843 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22b84: skipped 000201 1771439973.374958 write 0x01bbf1 thru 0x01f0ab (0x34bb bytes) 000205 1771439973.380777 write 0x031a85 thru 0x03820d (0x6789 bytes) 000209 1771439973.383840 trunc from 0x03820e to 0x01139d (0x26e70 bytes) 000211 1771439973.389857 write 0x0187af thru 0x01fb16 (0x7368 bytes) 000212 1771439973.391181 read 0x008087 thru 0x011fee (0x9f68 bytes) 000213 1771439973.394883 mapread 0x00c4e7 thru 0x019ae6 (0xd600 bytes) 000214 1771439973.400586 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1fb17): Mirror 7: 0x9b221282 (stale) Mirror 8: 0x9b221282 (stale) Mirror 10: 0xe7ded377 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fb17): Mirror 7: 0x9b221282 (stale) Mirror 8: 0x9b221282 (stale) Mirror 10: 0xe7ded377 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fb17: skipped 000215 1771439973.505510 trunc from 0x01fb17 to 0x0077a0 (0x18376 bytes) 000219 1771439973.513255 trunc from 0x0077a1 to 0x02bd13 (0x24573 bytes) 000222 1771439973.522534 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2bd14): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bd14): Mirror 7: 0x4d9b209 (stale) Mirror 8: 0x4d9b209 (stale) Mirror 10: 0x618a059f (stale) CRC-32 checksum value for chunk [0, 0x2bd14): Mirror 1: 0xb1ee21f1 Mirror 11: 0xb1ee21f1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bd14: skipped 000225 1771439973.779654 trunc from 0x02bd14 to 0x02d665 (0x1952 bytes) 000227 1771439973.808138 read 0x018393 thru 0x022102 (0x9d70 bytes) 000228 1771439973.813037 MIRROR_RESYNC 5 mirrors 000231 1771439974.115577 mapwrite 0x0217f1 thru 0x028961 (0x7171 bytes) 000234 1771439974.171358 write 0x03b17b thru 0x03ffff (0x4e85 bytes) 000235 1771439974.172393 read 0x0298d2 thru 0x02fdff (0x652e bytes) 000236 1771439974.177428 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xc7b9817 (stale) Mirror 8: 0xc7b9817 (stale) Mirror 10: 0xc7b9817 (stale) Mirror 11: 0xc7b9817 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6c49cb5 Mirror 12: 0x6c49cb5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000238 1771439974.461997 write 0x037727 thru 0x03ffff (0x88d9 bytes) 000240 1771439974.484359 mapwrite 0x00f115 thru 0x01bea9 (0xcd95 bytes) 000241 1771439974.509612 write 0x01a332 thru 0x01f096 (0x4d65 bytes) 000242 1771439974.514130 MIRROR_RESYNC 6 mirrors 000244 1771439974.796626 mapread 0x03c96d thru 0x03ffff (0x3693 bytes) 000245 1771439974.802313 write 0x0313d7 thru 0x03d2e3 (0xbf0d bytes) 000250 1771439974.827522 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x684d6d36 (stale) Mirror 8: 0x684d6d36 (stale) Mirror 10: 0x684d6d36 (stale) Mirror 12: 0x684d6d36 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x684d6d36 (stale) Mirror 8: 0x684d6d36 (stale) Mirror 10: 0x684d6d36 (stale) Mirror 12: 0x684d6d36 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000251 1771439974.936732 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x684d6d36 (stale) Mirror 8: 0x684d6d36 (stale) Mirror 10: 0x684d6d36 (stale) Mirror 12: 0x684d6d36 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7a33394d Mirror 13: 0x7a33394d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000254 1771439975.232912 mapwrite 0x002b68 thru 0x00a4d3 (0x796c bytes) 000255 1771439975.289972 write 0x03cf33 thru 0x03ffff (0x30cd bytes) 000258 1771439975.295051 read 0x01de19 thru 0x01ee1c (0x1004 bytes) 000259 1771439975.297753 read 0x023ab8 thru 0x032e2e (0xf377 bytes) 000260 1771439975.302481 mapread 0x029234 thru 0x0367d2 (0xd59f bytes) 000261 1771439975.303412 mapread 0x0110d8 thru 0x013360 (0x2289 bytes) 000264 1771439975.307313 MIRROR_RESYNC 6 mirrors 000265 1771439975.633922 trunc from 0x040000 to 0x02fad8 (0x10527 bytes) 000266 1771439975.659351 MIRROR_RESYNC 6 mirrors 000269 1771439975.943362 trunc from 0x02fad9 to 0x00d021 (0x22ab7 bytes) 000270 1771439975.969974 mapwrite 0x02bb70 thru 0x02c423 (0x8b4 bytes) 000273 1771439975.993641 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c424): Mirror 7: 0x6408a150 (stale) Mirror 8: 0x6408a150 (stale) Mirror 10: 0x6408a150 (stale) Mirror 12: 0x6408a150 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c424): Mirror 7: 0x6408a150 (stale) Mirror 8: 0x6408a150 (stale) Mirror 10: 0x6408a150 (stale) Mirror 12: 0x6408a150 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c424: skipped 000274 1771439976.102436 mapwrite 0x026382 thru 0x02ced9 (0x6b58 bytes) 000276 1771439976.130273 trunc from 0x02ceda to 0x004fe2 (0x27ef7 bytes) 000278 1771439976.139964 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x4fe3): Mirror 7: 0x3d16a776 (stale) Mirror 8: 0x3d16a776 (stale) Mirror 10: 0x3d16a776 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4fe3): Mirror 7: 0x3d16a776 (stale) Mirror 8: 0x3d16a776 (stale) Mirror 10: 0x3d16a776 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4fe3: skipped 000279 1771439976.219267 mapread 0x0048e4 thru 0x004fe2 (0x6ff bytes) 000281 1771439976.222029 trunc from 0x004fe3 to 0x008e8d (0x3eab bytes) truncating to largest ever: 0x3ecd0 000284 1771439976.227314 trunc from 0x008e8e to 0x03eccf (0x35e42 bytes) 000285 1771439976.232088 mapread 0x003a1a thru 0x006b78 (0x315f bytes) 000287 1771439976.237837 write 0x037ebf thru 0x03ffff (0x8141 bytes) 000289 1771439976.242658 read 0x018bad thru 0x01f64a (0x6a9e bytes) 000290 1771439976.246275 trunc from 0x040000 to 0x0267c3 (0x1983c bytes) 000293 1771439976.253354 write 0x023b7b thru 0x02eb1f (0xafa5 bytes) 000295 1771439976.258030 write 0x003e0a thru 0x01187e (0xda75 bytes) 000300 1771439976.262883 write 0x019f3e thru 0x027e6d (0xdf30 bytes) 000301 1771439976.266248 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2eb20): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eb20): Mirror 7: 0x2c9ae5db (stale) Mirror 8: 0x2c9ae5db (stale) Mirror 10: 0x2c9ae5db (stale) CRC-32 checksum value for chunk [0, 0x2eb20): Mirror 1: 0xcf497079 Mirror 11: 0xcf497079 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eb20: skipped 000302 1771439976.503750 mapwrite 0x02c07c thru 0x033050 (0x6fd5 bytes) 000303 1771439976.544449 mapread 0x025a9f thru 0x02f624 (0x9b86 bytes) 000304 1771439976.548553 MIRROR_RESYNC 5 mirrors 000305 1771439976.801879 trunc from 0x033051 to 0x028241 (0xae0f bytes) 000306 1771439976.829972 write 0x03b80b thru 0x03be41 (0x637 bytes) 000308 1771439976.831544 mapread 0x014829 thru 0x023efd (0xf6d5 bytes) 000309 1771439976.840907 write 0x0371f9 thru 0x03ab48 (0x3950 bytes) 000310 1771439976.844029 trunc from 0x03be42 to 0x00b1f7 (0x30c4a bytes) 000312 1771439976.851259 read 0x002005 thru 0x0035ec (0x15e8 bytes) 000314 1771439976.854053 read 0x0008c4 thru 0x000d86 (0x4c3 bytes) 000316 1771439976.857500 write 0x02391a thru 0x028c35 (0x531c bytes) 000317 1771439976.858459 read 0x00d687 thru 0x01506e (0x79e8 bytes) 000320 1771439976.862432 mapread 0x01c2e0 thru 0x028c35 (0xc956 bytes) 000321 1771439976.865114 MIRROR_RESYNC 5 mirrors 000323 1771439977.106184 read 0x017d4d thru 0x01afa2 (0x3256 bytes) 000324 1771439977.110650 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) 000328 1771439977.229660 trunc from 0x028c36 to 0x0117eb (0x1744a bytes) 000332 1771439977.254880 mapread 0x00c594 thru 0x0117eb (0x5258 bytes) 000334 1771439977.262328 read 0x003243 thru 0x00b80d (0x85cb bytes) 000336 1771439977.268634 MIRROR_RESYNC 4 mirrors 000337 1771439977.503374 read 0x004553 thru 0x006660 (0x210e bytes) 000338 1771439977.505443 read 0x00474f thru 0x00ae83 (0x6735 bytes) 000340 1771439977.508498 mapread 0x0086bc thru 0x0117eb (0x9130 bytes) 000342 1771439977.509554 read 0x0046da thru 0x01125c (0xcb83 bytes) 000343 1771439977.509900 mapwrite 0x002b7a thru 0x00b622 (0x8aa9 bytes) 000344 1771439977.559868 MIRROR_RESYNC 4 mirrors 000345 1771439977.798219 trunc from 0x0117ec to 0x0397ad (0x27fc2 bytes) 000347 1771439977.832786 read 0x0213b9 thru 0x025f69 (0x4bb1 bytes) 000351 1771439977.837163 mapwrite 0x0018b2 thru 0x0018eb (0x3a bytes) 000356 1771439977.852832 mapwrite 0x029d17 thru 0x02d039 (0x3323 bytes) 000358 1771439977.872636 trunc from 0x0397ae to 0x014cf7 (0x24ab6 bytes) 000361 1771439977.883819 MIRROR_RESYNC 4 mirrors 000362 1771439978.108177 read 0x0060d6 thru 0x00d47a (0x73a5 bytes) 000365 1771439978.111526 write 0x01d5ee thru 0x027fe0 (0xa9f3 bytes) 000366 1771439978.129451 read 0x00cea6 thru 0x010b6b (0x3cc6 bytes) 000367 1771439978.133132 read 0x012730 thru 0x0149b4 (0x2285 bytes) 000368 1771439978.135698 MIRROR_RESYNC 4 mirrors 000369 1771439978.347774 mapwrite 0x018757 thru 0x018d60 (0x60a bytes) 000371 1771439978.398698 write 0x03dcbb thru 0x03ffff (0x2345 bytes) 000372 1771439978.401429 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x83d87da9 (stale) Mirror 11: 0x83d87da9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x83d87da9 (stale) Mirror 11: 0x83d87da9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000373 1771439978.503615 mapread 0x00d84e thru 0x01c650 (0xee03 bytes) 000374 1771439978.512456 read 0x0031b5 thru 0x0110cd (0xdf19 bytes) 000376 1771439978.516458 trunc from 0x040000 to 0x03aeb2 (0x514d bytes) 000377 1771439978.528310 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3aeb3): Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aeb3): Mirror 10: 0x8ed722f7 (stale) Mirror 11: 0x8ed722f7 (stale) CRC-32 checksum value for chunk [0, 0x3aeb3): Mirror 1: 0xaef0f58f Mirror 12: 0xaef0f58f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aeb3: skipped 000379 1771439978.757422 mapread 0x0107d9 thru 0x01bc18 (0xb440 bytes) 000381 1771439978.768586 trunc from 0x03aeb3 to 0x012e24 (0x2808e bytes) 000382 1771439978.808626 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x12e25): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12e25): Mirror 10: 0xf479a077 (stale) Mirror 11: 0xf479a077 (stale) Mirror 12: 0xf479a077 (stale) CRC-32 checksum value for chunk [0, 0x12e25): Mirror 1: 0xf479a077 Mirror 13: 0xf479a077 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12e25: skipped 000388 1771439979.046236 mapwrite 0x036a2c thru 0x03ffff (0x95d4 bytes) 000389 1771439979.094468 mapwrite 0x03ed40 thru 0x03ffff (0x12c0 bytes) 000390 1771439979.107893 trunc from 0x040000 to 0x013081 (0x2cf7e bytes) 000392 1771439979.117288 write 0x03b445 thru 0x03ffff (0x4bbb bytes) 000393 1771439979.118527 read 0x0158e4 thru 0x01e1fc (0x8919 bytes) 000394 1771439979.122060 write 0x01d48e thru 0x0275ce (0xa141 bytes) 000396 1771439979.125302 trunc from 0x040000 to 0x023464 (0x1cb9b bytes) 000398 1771439979.132823 write 0x00d893 thru 0x018a5f (0xb1cd bytes) 000400 1771439979.138536 read 0x0169f4 thru 0x019b8e (0x319b bytes) 000404 1771439979.140931 trunc from 0x023465 to 0x012688 (0x10ddc bytes) 000408 1771439979.151839 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x12689): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12689): Mirror 10: 0x85830e4a (stale) Mirror 11: 0x85830e4a (stale) Mirror 12: 0x85830e4a (stale) Mirror 13: 0x85830e4a (stale) CRC-32 checksum value for chunk [0, 0x12689): Mirror 1: 0xcc079e2d Mirror 14: 0xcc079e2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12689: skipped 000410 1771439979.396576 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12689): Mirror 10: 0x85830e4a (stale) Mirror 12: 0x85830e4a (stale) Mirror 13: 0x85830e4a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12689): Mirror 10: 0x85830e4a (stale) Mirror 12: 0x85830e4a (stale) Mirror 13: 0x85830e4a (stale) CRC-32 checksum value for chunk [0, 0x12689): Mirror 1: 0xcc079e2d Mirror 14: 0xcc079e2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12689: skipped 000411 1771439979.612472 write 0x009e42 thru 0x019bd5 (0xfd94 bytes) 000412 1771439979.632839 read 0x006cb6 thru 0x00e953 (0x7c9e bytes) 000415 1771439979.636127 trunc from 0x019bd6 to 0x01da00 (0x3e2b bytes) 000416 1771439979.646356 mapread 0x008aeb thru 0x016db9 (0xe2cf bytes) 000417 1771439979.647498 write 0x0116f4 thru 0x01def5 (0xc802 bytes) 000418 1771439979.650109 mapread 0x01d6c5 thru 0x01dba1 (0x4dd bytes) 000422 1771439979.652081 trunc from 0x01def6 to 0x037d2b (0x19e36 bytes) 000424 1771439979.657289 mapwrite 0x039db4 thru 0x03ffff (0x624c bytes) 000426 1771439979.683168 mapwrite 0x0340a4 thru 0x03cdb8 (0x8d15 bytes) 000429 1771439979.706057 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x83d87da9 (stale) Mirror 12: 0xeeb5bfe5 (stale) Mirror 13: 0xbd8af21b (stale) Mirror 14: 0xd6f83492 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc53e0d59 Mirror 15: 0xc53e0d59 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000431 1771439979.962084 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x83d87da9 (stale) Mirror 12: 0xeeb5bfe5 (stale) Mirror 13: 0xbd8af21b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x83d87da9 (stale) Mirror 12: 0xeeb5bfe5 (stale) Mirror 13: 0xbd8af21b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc53e0d59 Mirror 15: 0xc53e0d59 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000435 1771439980.171467 read 0x03d16b thru 0x03ffff (0x2e95 bytes) 000436 1771439980.175982 mapread 0x02de30 thru 0x0356b2 (0x7883 bytes) 000437 1771439980.187915 mapwrite 0x01d100 thru 0x02778f (0xa690 bytes) 000438 1771439980.279784 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x83d87da9 (stale) Mirror 13: 0xbd8af21b (stale) Mirror 15: 0xc53e0d59 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x83d87da9 (stale) Mirror 13: 0xbd8af21b (stale) Mirror 15: 0xc53e0d59 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000440 1771439980.410511 mapread 0x035b05 thru 0x03ffff (0xa4fb bytes) 000441 1771439980.418639 mapread 0x0254cd thru 0x0285de (0x3112 bytes) 000443 1771439980.423447 mapread 0x03ca73 thru 0x03e212 (0x17a0 bytes) 000444 1771439980.426402 MIRROR_RESYNC 4 mirrors 000447 1771439980.746387 mapread 0x002b70 thru 0x005d4a (0x31db bytes) 000448 1771439980.754392 mapread 0x01a203 thru 0x01fe1e (0x5c1c bytes) 000449 1771439980.758432 mapread 0x006970 thru 0x010755 (0x9de6 bytes) 000450 1771439980.759432 mapread 0x0290f3 thru 0x035fb5 (0xcec3 bytes) 000452 1771439980.770661 trunc from 0x040000 to 0x000636 (0x3f9c9 bytes) 000455 1771439980.806067 write 0x021fbf thru 0x02e243 (0xc285 bytes) 000456 1771439980.807703 mapwrite 0x00a8ec thru 0x010754 (0x5e69 bytes) 000458 1771439980.834453 trunc from 0x02e244 to 0x039159 (0xaf16 bytes) 000462 1771439980.849265 read 0x00f797 thru 0x0101ce (0xa38 bytes) 000463 1771439980.850018 trunc from 0x03915a to 0x024f9a (0x141bf bytes) 000464 1771439980.863845 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x24f9b): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24f9b): Mirror 10: 0x119f2d95 (stale) Mirror 13: 0x119f2d95 (stale) Mirror 15: 0x119f2d95 (stale) CRC-32 checksum value for chunk [0, 0x24f9b): Mirror 1: 0xcd0ef6f2 Mirror 16: 0xcd0ef6f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24f9b: skipped 000465 1771439981.202085 read 0x018206 thru 0x01a610 (0x240b bytes) 000466 1771439981.206142 write 0x02b52e thru 0x03300f (0x7ae2 bytes) 000468 1771439981.231849 MIRROR_RESYNC 5 mirrors 000470 1771439981.603822 MIRROR_RESYNC 5 mirrors 000472 1771439981.781005 mapwrite 0x0108dc thru 0x01b873 (0xaf98 bytes) 000473 1771439981.866462 trunc from 0x033010 to 0x02a519 (0x8af6 bytes) 000474 1771439981.882713 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2a51a): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a51a): Mirror 10: 0x8ed191f0 (stale) Mirror 13: 0x8ed191f0 (stale) Mirror 15: 0x8ed191f0 (stale) Mirror 16: 0x8ed191f0 (stale) CRC-32 checksum value for chunk [0, 0x2a51a): Mirror 1: 0xa207c41c Mirror 17: 0xa207c41c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a51a: skipped 000476 1771439982.236944 read 0x00ec77 thru 0x01bc5c (0xcfe6 bytes) 000477 1771439982.248610 mapread 0x0128c3 thru 0x012fe3 (0x721 bytes) 000479 1771439982.261576 write 0x02e8c8 thru 0x038a4e (0xa187 bytes) 000482 1771439982.289363 read 0x01f0d5 thru 0x02d531 (0xe45d bytes) 000484 1771439982.297612 mapwrite 0x0367ce thru 0x0386fc (0x1f2f bytes) 000485 1771439982.316095 write 0x0338c9 thru 0x039ed8 (0x6610 bytes) 000486 1771439982.317360 trunc from 0x039ed9 to 0x018920 (0x215b8 bytes) 000487 1771439982.325916 mapwrite 0x016068 thru 0x021806 (0xb79f bytes) 000488 1771439982.400311 write 0x005057 thru 0x0050d8 (0x82 bytes) 000489 1771439982.401304 write 0x015572 thru 0x01e480 (0x8f0f bytes) 000491 1771439982.403301 read 0x01fbdb thru 0x021806 (0x1c2c bytes) 000493 1771439982.404437 mapwrite 0x0155c4 thru 0x01bc4b (0x6688 bytes) 000494 1771439982.441502 mapread 0x01d5ea thru 0x021806 (0x421d bytes) 000497 1771439982.451706 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x21807): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21807): Mirror 10: 0x92428e2e (stale) Mirror 13: 0x92428e2e (stale) Mirror 15: 0x92428e2e (stale) Mirror 16: 0x92428e2e (stale) Mirror 17: 0xfb0bc9e0 (stale) CRC-32 checksum value for chunk [0, 0x21807): Mirror 1: 0xc2404b30 Mirror 18: 0xc2404b30 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21807: skipped 000498 1771439982.732176 read 0x001bee thru 0x0053bc (0x37cf bytes) 000499 1771439982.739165 mapread 0x00b54f thru 0x010d4d (0x57ff bytes) 000500 1771439982.749506 mapread 0x00fdc8 thru 0x01db75 (0xddae bytes) 000501 1771439982.755668 read 0x00a4a9 thru 0x010c6e (0x67c6 bytes) 000502 1771439982.757419 read 0x011078 thru 0x01d38c (0xc315 bytes) 000504 1771439982.760300 trunc from 0x021807 to 0x033c4c (0x12446 bytes) 000505 1771439982.790808 read 0x001bd0 thru 0x00bb56 (0x9f87 bytes) 000507 1771439982.795780 read 0x028a46 thru 0x033c4c (0xb207 bytes) 000508 1771439982.796472 mapwrite 0x005896 thru 0x010063 (0xa7ce bytes) 000511 1771439982.817442 trunc from 0x033c4d to 0x0264ce (0xd77e bytes) 000513 1771439982.827553 trunc from 0x0264cf to 0x010687 (0x15e47 bytes) 000514 1771439982.838164 mapread 0x00155e thru 0x010687 (0xf12a bytes) 000517 1771439982.840515 mapwrite 0x03befb thru 0x03f4f4 (0x35fa bytes) 000518 1771439982.881749 mapread 0x029f85 thru 0x0357d7 (0xb853 bytes) 000520 1771439982.883282 mapwrite 0x02c06d thru 0x032518 (0x64ac bytes) 000521 1771439982.908148 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3f4f5): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f4f5): Mirror 10: 0x5d37f95 (stale) Mirror 13: 0x5d37f95 (stale) Mirror 15: 0x5d37f95 (stale) Mirror 16: 0x5d37f95 (stale) Mirror 17: 0xd8e14cc2 (stale) Mirror 18: 0x49194466 (stale) CRC-32 checksum value for chunk [0, 0x3f4f5): Mirror 1: 0x1862e32c Mirror 19: 0x1862e32c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f4f5: skipped 000522 1771439983.231127 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3f4f5): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f4f5): Mirror 10: 0x5d37f95 (stale) Mirror 13: 0x5d37f95 (stale) Mirror 15: 0x5d37f95 (stale) Mirror 16: 0x5d37f95 (stale) Mirror 17: 0xd8e14cc2 (stale) Mirror 18: 0x49194466 (stale) CRC-32 checksum value for chunk [0, 0x3f4f5): Mirror 1: 0x1862e32c Mirror 19: 0x1862e32c Mirror 20: 0x1862e32c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f4f5: skipped 000523 1771439983.537164 mapread 0x013b84 thru 0x014752 (0xbcf bytes) 000524 1771439983.540529 mapread 0x012cee thru 0x018d82 (0x6095 bytes) 000529 1771439983.546964 MIRROR_RESYNC 9 mirrors 000535 1771439983.963472 trunc from 0x03f4f5 to 0x034274 (0xb280 bytes) 000536 1771439983.995562 mapread 0x009501 thru 0x013dfd (0xa8fd bytes) 000537 1771439984.010483 MIRROR_RESYNC 9 mirrors 000540 1771439984.496430 mapwrite 0x02ce89 thru 0x034528 (0x76a0 bytes) 000541 1771439984.549505 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x34529): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34529): Mirror 10: 0xa660ebc7 (stale) Mirror 13: 0xa660ebc7 (stale) Mirror 15: 0xa660ebc7 (stale) Mirror 16: 0xa660ebc7 (stale) Mirror 17: 0xa660ebc7 (stale) Mirror 18: 0xa660ebc7 (stale) Mirror 19: 0xa660ebc7 (stale) Mirror 20: 0xa660ebc7 (stale) CRC-32 checksum value for chunk [0, 0x34529): Mirror 1: 0x195b347b Mirror 21: 0x195b347b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34529: skipped 000542 1771439984.892593 read 0x0232e7 thru 0x030e62 (0xdb7c bytes) 000543 1771439984.902566 mapwrite 0x00040d thru 0x00f9a0 (0xf594 bytes) 000545 1771439985.005818 mapread 0x022225 thru 0x027e49 (0x5c25 bytes) 000549 1771439985.014766 MIRROR_RESYNC 10 mirrors 000551 1771439985.580911 read 0x01d6b0 thru 0x023fe1 (0x6932 bytes) 000553 1771439985.584592 mapread 0x0338f0 thru 0x034528 (0xc39 bytes) 000555 1771439985.588950 read 0x02bc54 thru 0x034528 (0x88d5 bytes) 000556 1771439985.592788 mapread 0x0157f7 thru 0x01e8f3 (0x90fd bytes) 000557 1771439985.595085 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) 000558 1771439985.730307 read 0x019c3d thru 0x023054 (0x9418 bytes) 000559 1771439985.734013 write 0x028a93 thru 0x034be6 (0xc154 bytes) 000564 1771439985.771470 trunc from 0x034be7 to 0x0374da (0x28f4 bytes) 000566 1771439985.781649 MIRROR_RESYNC 9 mirrors 000568 1771439986.158830 read 0x01e159 thru 0x0234d5 (0x537d bytes) 000569 1771439986.163133 MIRROR_RESYNC 9 mirrors 000570 1771439986.343100 mapread 0x02ebd6 thru 0x0374da (0x8905 bytes) 000572 1771439986.350853 write 0x003493 thru 0x00e60a (0xb178 bytes) 000573 1771439986.370989 mapwrite 0x00c65a thru 0x019d9d (0xd744 bytes) 000574 1771439986.394991 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x374db): Mirror 10: 0xc46c3b03 (stale) Mirror 13: 0xc46c3b03 (stale) Mirror 15: 0xc46c3b03 (stale) Mirror 17: 0xc46c3b03 (stale) Mirror 18: 0xc46c3b03 (stale) Mirror 19: 0xc46c3b03 (stale) Mirror 20: 0xc46c3b03 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x374db): Mirror 10: 0xc46c3b03 (stale) Mirror 13: 0xc46c3b03 (stale) Mirror 15: 0xc46c3b03 (stale) Mirror 17: 0xc46c3b03 (stale) Mirror 18: 0xc46c3b03 (stale) Mirror 19: 0xc46c3b03 (stale) Mirror 20: 0xc46c3b03 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x374db: skipped 000575 1771439986.559385 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x374db): Mirror 10: 0xc46c3b03 (stale) Mirror 13: 0xc46c3b03 (stale) Mirror 15: 0xc46c3b03 (stale) Mirror 17: 0xc46c3b03 (stale) Mirror 18: 0xc46c3b03 (stale) Mirror 20: 0xc46c3b03 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x374db): Mirror 10: 0xc46c3b03 (stale) Mirror 13: 0xc46c3b03 (stale) Mirror 15: 0xc46c3b03 (stale) Mirror 17: 0xc46c3b03 (stale) Mirror 18: 0xc46c3b03 (stale) Mirror 20: 0xc46c3b03 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x374db: skipped 000576 1771439986.700726 mapread 0x019b6a thru 0x02615b (0xc5f2 bytes) 000577 1771439986.709232 read 0x013bdc thru 0x01ee29 (0xb24e bytes) 000578 1771439986.711783 mapread 0x00d080 thru 0x00ea56 (0x19d7 bytes) 000579 1771439986.719255 read 0x015a72 thru 0x020044 (0xa5d3 bytes) 000581 1771439986.720475 trunc from 0x0374db to 0x03b794 (0x42ba bytes) 000583 1771439986.726334 trunc from 0x03b795 to 0x035375 (0x641f bytes) 000584 1771439986.736162 write 0x03ef2b thru 0x03ffff (0x10d5 bytes) 000585 1771439986.738877 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x39a08417 (stale) Mirror 13: 0x39a08417 (stale) Mirror 15: 0x39a08417 (stale) Mirror 17: 0x39a08417 (stale) Mirror 18: 0x39a08417 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x39a08417 (stale) Mirror 13: 0x39a08417 (stale) Mirror 15: 0x39a08417 (stale) Mirror 17: 0x39a08417 (stale) Mirror 18: 0x39a08417 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000586 1771439986.878417 mapwrite 0x01948f thru 0x023c81 (0xa7f3 bytes) 000588 1771439986.903933 read 0x004bb6 thru 0x01444b (0xf896 bytes) 000589 1771439986.908195 write 0x0280f9 thru 0x037cd2 (0xfbda bytes) 000592 1771439986.915888 read 0x03c5d8 thru 0x03d08e (0xab7 bytes) 000593 1771439986.920393 write 0x03e004 thru 0x03fd7a (0x1d77 bytes) 000594 1771439986.921355 mapread 0x0002d4 thru 0x003a23 (0x3750 bytes) 000595 1771439986.922309 mapread 0x0016bc thru 0x00c6b6 (0xaffb bytes) 000596 1771439986.923552 mapwrite 0x006719 thru 0x006b18 (0x400 bytes) 000597 1771439986.943199 read 0x008695 thru 0x009157 (0xac3 bytes) 000598 1771439986.943718 read 0x0043bb thru 0x0092a0 (0x4ee6 bytes) 000600 1771439986.944617 read 0x022545 thru 0x02d6a0 (0xb15c bytes) 000601 1771439986.945227 mapread 0x00f062 thru 0x013bf5 (0x4b94 bytes) 000602 1771439986.945930 read 0x01e9a2 thru 0x01fe97 (0x14f6 bytes) 000604 1771439986.949490 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x39a08417 (stale) Mirror 15: 0x39a08417 (stale) Mirror 17: 0x39a08417 (stale) Mirror 18: 0x39a08417 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x39a08417 (stale) Mirror 15: 0x39a08417 (stale) Mirror 17: 0x39a08417 (stale) Mirror 18: 0x39a08417 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000605 1771439987.074585 read 0x032321 thru 0x03d657 (0xb337 bytes) 000606 1771439987.079385 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x39a08417 (stale) Mirror 15: 0x39a08417 (stale) Mirror 17: 0x39a08417 (stale) Mirror 18: 0x39a08417 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2e60a6cd Mirror 19: 0x2e60a6cd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000609 1771439987.336375 write 0x016a12 thru 0x020fff (0xa5ee bytes) 000611 1771439987.361374 MIRROR_RESYNC 6 mirrors 000612 1771439987.710574 MIRROR_RESYNC 6 mirrors 000613 1771439987.877552 MIRROR_RESYNC 6 mirrors 000614 1771439988.043143 trunc from 0x040000 to 0x034a19 (0xb5e6 bytes) 000615 1771439988.079440 mapwrite 0x02c173 thru 0x037a96 (0xb924 bytes) 000616 1771439988.120819 read 0x035598 thru 0x037a96 (0x24ff bytes) 000617 1771439988.121498 read 0x00777d thru 0x008be2 (0x1466 bytes) 000619 1771439988.125891 trunc from 0x037a97 to 0x005725 (0x32371 bytes) 000620 1771439988.132313 trunc from 0x005726 to 0x009250 (0x3b2b bytes) 000622 1771439988.139639 mapwrite 0x01ffb5 thru 0x027ea4 (0x7ef0 bytes) 000624 1771439988.183414 write 0x01045b thru 0x01ebbf (0xe765 bytes) 000625 1771439988.193243 read 0x00e0e0 thru 0x0119ca (0x38eb bytes) 000628 1771439988.198995 read 0x02774e thru 0x027ea4 (0x757 bytes) 000629 1771439988.199564 trunc from 0x027ea5 to 0x034286 (0xc3e2 bytes) 000630 1771439988.207916 write 0x010032 thru 0x0173cb (0x739a bytes) 000632 1771439988.209668 mapread 0x0252c2 thru 0x02eea7 (0x9be6 bytes) 000633 1771439988.214860 trunc from 0x034287 to 0x00e8b0 (0x259d6 bytes) 000634 1771439988.221527 read 0x009b7b thru 0x00e8b0 (0x4d36 bytes) 000635 1771439988.222319 trunc from 0x00e8b1 to 0x023199 (0x148e9 bytes) 000638 1771439988.234089 MIRROR_RESYNC 6 mirrors 000640 1771439988.513834 read 0x017401 thru 0x01ab69 (0x3769 bytes) 000642 1771439988.516510 write 0x032e0a thru 0x03f746 (0xc93d bytes) 000644 1771439988.537887 mapread 0x034b07 thru 0x036569 (0x1a63 bytes) 000645 1771439988.538925 mapwrite 0x021e83 thru 0x02b6a4 (0x9822 bytes) 000648 1771439988.591135 MIRROR_RESYNC 6 mirrors 000657 1771439988.931091 mapread 0x03d83b thru 0x03f746 (0x1f0c bytes) 000658 1771439988.943861 MIRROR_EXTEND to 7 mirrors 000659 1771439989.190148 trunc from 0x03f747 to 0x023dae (0x1b998 bytes) 000661 1771439989.233119 mapread 0x003975 thru 0x00c296 (0x8922 bytes) 000662 1771439989.245523 mapread 0x003573 thru 0x007e2f (0x48bd bytes) 000663 1771439989.246522 trunc from 0x023daf to 0x0307fe (0xca50 bytes) 000666 1771439989.261644 trunc from 0x0307ff to 0x01d3b9 (0x13445 bytes) 000667 1771439989.269811 mapwrite 0x00d737 thru 0x01ab88 (0xd452 bytes) 000668 1771439989.300303 trunc from 0x01d3ba to 0x004693 (0x18d26 bytes) 000669 1771439989.310078 read 0x000213 thru 0x004693 (0x4481 bytes) 000671 1771439989.314427 read 0x00014f thru 0x004693 (0x4545 bytes) 000672 1771439989.315009 write 0x0081bd thru 0x014e14 (0xcc58 bytes) 000675 1771439989.317190 read 0x00f4e2 thru 0x014e14 (0x5933 bytes) 000676 1771439989.320256 MIRROR_RESYNC 7 mirrors 000677 1771439989.670711 read 0x00b73c thru 0x014d7a (0x963f bytes) 000678 1771439989.678363 mapread 0x002ed4 thru 0x003559 (0x686 bytes) 000680 1771439989.685413 write 0x03119e thru 0x0375eb (0x644e bytes) 000681 1771439989.719526 MIRROR_RESYNC 7 mirrors 000682 1771439990.093129 write 0x029e10 thru 0x039008 (0xf1f9 bytes) 000683 1771439990.112322 write 0x0081d4 thru 0x011053 (0x8e80 bytes) 000685 1771439990.115843 mapwrite 0x0157b6 thru 0x023292 (0xdadd bytes) 000689 1771439990.150564 mapread 0x016f3d thru 0x022b8f (0xbc53 bytes) 000691 1771439990.155093 MIRROR_RESYNC 7 mirrors 000694 1771439990.497364 MIRROR_EXTEND to 8 mirrors 000695 1771439990.697153 mapread 0x00dbac thru 0x00f3d8 (0x182d bytes) 000697 1771439990.704353 read 0x0235f0 thru 0x030648 (0xd059 bytes) 000700 1771439990.708313 write 0x02e56b thru 0x03ddc5 (0xf85b bytes) 000701 1771439990.734819 trunc from 0x03ddc6 to 0x00e593 (0x2f832 bytes) 000704 1771439990.749370 mapwrite 0x0310e3 thru 0x03ffff (0xef1d bytes) 000705 1771439990.781942 mapwrite 0x0363a3 thru 0x03c9d6 (0x6634 bytes) 000706 1771439990.800299 write 0x0005af thru 0x00f882 (0xf2d4 bytes) 000707 1771439990.805077 trunc from 0x040000 to 0x00cf26 (0x330d9 bytes) 000709 1771439990.818796 mapwrite 0x005af7 thru 0x00c1f2 (0x66fc bytes) 000710 1771439990.839456 mapwrite 0x00a0d9 thru 0x00b795 (0x16bd bytes) 000711 1771439990.859601 mapread 0x005450 thru 0x00cd20 (0x78d1 bytes) 000712 1771439990.860735 mapread 0x007b0f thru 0x00c58a (0x4a7c bytes) 000713 1771439990.862325 trunc from 0x00cf27 to 0x02102b (0x14105 bytes) 000715 1771439990.874189 write 0x02f28e thru 0x03d0b2 (0xde25 bytes) 000716 1771439990.875851 write 0x02c08e thru 0x037a3e (0xb9b1 bytes) 000717 1771439990.881379 mapread 0x026502 thru 0x035e3e (0xf93d bytes) 000718 1771439990.883245 read 0x006926 thru 0x00b11c (0x47f7 bytes) 000719 1771439990.884423 trunc from 0x03d0b3 to 0x024362 (0x18d50 bytes) 000721 1771439990.895999 mapwrite 0x020595 thru 0x02b54b (0xafb7 bytes) 000724 1771439990.944547 mapwrite 0x03ca42 thru 0x03ffff (0x35be bytes) 000725 1771439990.982806 mapwrite 0x036954 thru 0x03c9d8 (0x6085 bytes) 000727 1771439991.004243 write 0x014f3e thru 0x01dbfe (0x8cc1 bytes) 000729 1771439991.008830 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xb978b51c (stale) Mirror 17: 0xb978b51c (stale) Mirror 18: 0xb978b51c (stale) Mirror 19: 0xb978b51c (stale) Mirror 20: 0xb978b51c (stale) Mirror 21: 0xb978b51c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xb978b51c (stale) Mirror 17: 0xb978b51c (stale) Mirror 18: 0xb978b51c (stale) Mirror 19: 0xb978b51c (stale) Mirror 20: 0xb978b51c (stale) Mirror 21: 0xb978b51c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000730 1771439991.244580 mapwrite 0x004e93 thru 0x00763a (0x27a8 bytes) 000731 1771439991.268015 write 0x02965b thru 0x0322b3 (0x8c59 bytes) 000732 1771439991.273326 mapread 0x03abd9 thru 0x03ffff (0x5427 bytes) 000735 1771439991.278183 mapread 0x02e6cc thru 0x02ee24 (0x759 bytes) 000739 1771439991.281747 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xb978b51c (stale) Mirror 17: 0xb978b51c (stale) Mirror 19: 0xb978b51c (stale) Mirror 20: 0xb978b51c (stale) Mirror 21: 0xb978b51c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xb978b51c (stale) Mirror 17: 0xb978b51c (stale) Mirror 19: 0xb978b51c (stale) Mirror 20: 0xb978b51c (stale) Mirror 21: 0xb978b51c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000740 1771439991.408466 write 0x0059b4 thru 0x006a74 (0x10c1 bytes) 000741 1771439991.413203 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xb978b51c (stale) Mirror 17: 0xb978b51c (stale) Mirror 19: 0xb978b51c (stale) Mirror 20: 0xb978b51c (stale) Mirror 21: 0xb978b51c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa38fb2c2 Mirror 22: 0xa38fb2c2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000744 1771439991.679176 mapread 0x02da63 thru 0x02e8ef (0xe8d bytes) 000745 1771439991.686192 write 0x039d9a thru 0x03ffff (0x6266 bytes) 000746 1771439991.708829 mapwrite 0x0042fe thru 0x00c365 (0x8068 bytes) 000748 1771439991.729088 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0xb978b51c (stale) Mirror 19: 0xb978b51c (stale) Mirror 20: 0xb978b51c (stale) Mirror 21: 0xb978b51c (stale) Mirror 22: 0xa38fb2c2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0xb978b51c (stale) Mirror 19: 0xb978b51c (stale) Mirror 20: 0xb978b51c (stale) Mirror 21: 0xb978b51c (stale) Mirror 22: 0xa38fb2c2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000751 1771439991.848722 mapread 0x005cc6 thru 0x00f46d (0x97a8 bytes) 000752 1771439991.854482 trunc from 0x040000 to 0x03d224 (0x2ddb bytes) 000753 1771439991.859403 mapread 0x032c1e thru 0x03d224 (0xa607 bytes) 000754 1771439991.864199 mapwrite 0x001cab thru 0x010784 (0xeada bytes) 000755 1771439991.889726 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d225): Mirror 19: 0x86fb9ff6 (stale) Mirror 20: 0x86fb9ff6 (stale) Mirror 21: 0x86fb9ff6 (stale) Mirror 22: 0x3793fa79 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d225): Mirror 19: 0x86fb9ff6 (stale) Mirror 20: 0x86fb9ff6 (stale) Mirror 21: 0x86fb9ff6 (stale) Mirror 22: 0x3793fa79 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d225: skipped 000756 1771439992.008591 read 0x011f98 thru 0x017426 (0x548f bytes) 000757 1771439992.011729 mapread 0x031e8a thru 0x03d224 (0xb39b bytes) 000758 1771439992.019112 mapread 0x01d8e7 thru 0x02b92b (0xe045 bytes) 000759 1771439992.024848 mapwrite 0x00c7ef thru 0x01140a (0x4c1c bytes) 000761 1771439992.045733 trunc from 0x03d225 to 0x013eb3 (0x29371 bytes) 000762 1771439992.051587 trunc from 0x013eb4 to 0x02564e (0x1179b bytes) 000763 1771439992.059557 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2564f): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2564f): Mirror 19: 0x7fe54571 (stale) Mirror 20: 0x7fe54571 (stale) Mirror 21: 0x7fe54571 (stale) Mirror 22: 0xda00784c (stale) CRC-32 checksum value for chunk [0, 0x2564f): Mirror 1: 0x405b994b Mirror 23: 0x405b994b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2564f: skipped truncating to largest ever: 0x3f8a9 000765 1771439992.330329 trunc from 0x02564f to 0x03f8a8 (0x1a25a bytes) 000766 1771439992.362926 trunc from 0x03f8a9 to 0x0382e9 (0x75bf bytes) 000767 1771439992.369842 write 0x037c9b thru 0x03e9f7 (0x6d5d bytes) 000772 1771439992.374566 mapread 0x030c37 thru 0x033042 (0x240c bytes) 000774 1771439992.388396 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3e9f8): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e9f8): Mirror 19: 0x522ee172 (stale) Mirror 20: 0x522ee172 (stale) Mirror 21: 0x522ee172 (stale) Mirror 22: 0xc37325a5 (stale) Mirror 23: 0x3c625a52 (stale) CRC-32 checksum value for chunk [0, 0x3e9f8): Mirror 1: 0x7b1ce407 Mirror 24: 0x7b1ce407 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e9f8: skipped 000777 1771439992.651303 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3e9f8): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e9f8): Mirror 19: 0x522ee172 (stale) Mirror 20: 0x522ee172 (stale) Mirror 21: 0x522ee172 (stale) Mirror 22: 0xc37325a5 (stale) Mirror 23: 0x3c625a52 (stale) CRC-32 checksum value for chunk [0, 0x3e9f8): Mirror 1: 0x7b1ce407 Mirror 24: 0x7b1ce407 Mirror 25: 0x7b1ce407 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e9f8: skipped 000778 1771439992.903398 read 0x031641 thru 0x03ac0d (0x95cd bytes) 000779 1771439992.907510 read 0x00a3fe thru 0x0156cd (0xb2d0 bytes) 000780 1771439992.912755 write 0x03a222 thru 0x03ffff (0x5dde bytes) 000782 1771439992.940451 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xb978b51c (stale) Mirror 20: 0xb978b51c (stale) Mirror 21: 0xb978b51c (stale) Mirror 22: 0xa38fb2c2 (stale) Mirror 23: 0x4e9b3782 (stale) Mirror 24: 0xc2d445f3 (stale) Mirror 25: 0xc2d445f3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xde512093 Mirror 26: 0xde512093 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000783 1771439993.231060 mapread 0x02a981 thru 0x034115 (0x9795 bytes) 000785 1771439993.242525 MIRROR_RESYNC 9 mirrors 000788 1771439993.650665 mapwrite 0x02254a thru 0x02ea1c (0xc4d3 bytes) 000789 1771439993.716463 MIRROR_RESYNC 9 mirrors 000790 1771439994.045295 write 0x030dbf thru 0x0377b4 (0x69f6 bytes) 000794 1771439994.067219 write 0x00809b thru 0x00c49a (0x4400 bytes) 000796 1771439994.071188 mapwrite 0x03fd22 thru 0x03ffff (0x2de bytes) 000798 1771439994.091106 mapwrite 0x037999 thru 0x03ffff (0x8667 bytes) 000800 1771439994.110167 mapwrite 0x01f319 thru 0x029ee6 (0xabce bytes) 000802 1771439994.150523 write 0x02230d thru 0x029551 (0x7245 bytes) 000803 1771439994.151498 write 0x003e01 thru 0x00e8a0 (0xaaa0 bytes) 000804 1771439994.152476 mapread 0x001c13 thru 0x008ca0 (0x708e bytes) 000806 1771439994.153825 write 0x03596a thru 0x03d2de (0x7975 bytes) 000809 1771439994.157875 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xc6976005 (stale) Mirror 20: 0xc6976005 (stale) Mirror 21: 0xc6976005 (stale) Mirror 22: 0xc6976005 (stale) Mirror 23: 0xc6976005 (stale) Mirror 24: 0xc6976005 (stale) Mirror 25: 0xc6976005 (stale) Mirror 26: 0xc6976005 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9e8ec175 Mirror 27: 0x9e8ec175 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000811 1771439994.430893 read 0x02a905 thru 0x02fefb (0x55f7 bytes) 000812 1771439994.434981 trunc from 0x040000 to 0x011302 (0x2ecfd bytes) 000814 1771439994.471185 MIRROR_RESYNC 10 mirrors 000815 1771439994.835098 mapread 0x008bac thru 0x011302 (0x8757 bytes) 000822 1771439994.843042 mapwrite 0x007dfb thru 0x013bd2 (0xbdd8 bytes) 000823 1771439994.907639 trunc from 0x013bd3 to 0x000e61 (0x12d71 bytes) 000825 1771439994.915429 trunc from 0x000e62 to 0x029d16 (0x28eb5 bytes) 000826 1771439994.920469 read 0x004c9e thru 0x00f732 (0xaa95 bytes) 000828 1771439994.924423 trunc from 0x029d17 to 0x00cc59 (0x1d0bd bytes) 000829 1771439994.929533 trunc from 0x00cc5a to 0x00516b (0x7aee bytes) 000832 1771439994.934497 mapread 0x0030af thru 0x00516b (0x20bd bytes) 000833 1771439994.936744 mapread 0x004a0a thru 0x00516b (0x762 bytes) 000834 1771439994.937491 mapwrite 0x018b08 thru 0x022c25 (0xa11e bytes) 000835 1771439994.965630 write 0x02f647 thru 0x033389 (0x3d43 bytes) 000837 1771439994.967532 write 0x0332e8 thru 0x03b2e3 (0x7ffc bytes) 000840 1771439994.971870 MIRROR_RESYNC 10 mirrors 000842 1771439995.390966 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) 000843 1771439995.533570 write 0x00dea0 thru 0x017536 (0x9697 bytes) 000844 1771439995.559699 write 0x0241ba thru 0x026ca3 (0x2aea bytes) 000845 1771439995.562804 mapread 0x022fb6 thru 0x025b3c (0x2b87 bytes) 000848 1771439995.564249 mapwrite 0x0398cd thru 0x03f880 (0x5fb4 bytes) 000850 1771439995.601361 mapread 0x01356e thru 0x01cde8 (0x987b bytes) 000851 1771439995.606021 read 0x03c2af thru 0x03f880 (0x35d2 bytes) 000852 1771439995.608790 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3f881): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f881): Mirror 19: 0x7db35cf5 (stale) Mirror 20: 0x7db35cf5 (stale) Mirror 21: 0x7db35cf5 (stale) Mirror 22: 0x7db35cf5 (stale) Mirror 24: 0x7db35cf5 (stale) Mirror 25: 0x7db35cf5 (stale) Mirror 26: 0x7db35cf5 (stale) Mirror 27: 0x7db35cf5 (stale) CRC-32 checksum value for chunk [0, 0x3f881): Mirror 1: 0x5825de26 Mirror 28: 0x5825de26 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f881: skipped 000853 1771439995.934933 read 0x0097c6 thru 0x018ae2 (0xf31d bytes) 000855 1771439995.944431 trunc from 0x03f881 to 0x02fd21 (0xfb5f bytes) 000856 1771439995.977329 mapwrite 0x03b8da thru 0x03ffff (0x4726 bytes) 000860 1771439996.006121 trunc from 0x040000 to 0x0029a3 (0x3d65c bytes) 000861 1771439996.013246 MIRROR_RESYNC 10 mirrors 000862 1771439996.445318 read 0x00153d thru 0x0029a3 (0x1467 bytes) 000863 1771439996.447507 write 0x014262 thru 0x02361e (0xf3bd bytes) 000864 1771439996.469910 mapread 0x00476f thru 0x0141ca (0xfa5c bytes) 000865 1771439996.478547 mapwrite 0x022747 thru 0x027bd2 (0x548c bytes) 000866 1771439996.512483 mapwrite 0x00f436 thru 0x01b941 (0xc50c bytes) 000867 1771439996.532019 read 0x016025 thru 0x01f1e4 (0x91c0 bytes) 000868 1771439996.532741 mapwrite 0x00e309 thru 0x0134ff (0x51f7 bytes) 000870 1771439996.553092 write 0x03331c thru 0x03a119 (0x6dfe bytes) 000872 1771439996.554425 write 0x01c05b thru 0x02b4d4 (0xf47a bytes) 000873 1771439996.560390 mapread 0x000431 thru 0x0081dd (0x7dad bytes) 000876 1771439996.562731 read 0x001679 thru 0x00ec58 (0xd5e0 bytes) 000877 1771439996.563933 mapread 0x00d37c thru 0x011218 (0x3e9d bytes) 000878 1771439996.567077 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a11a): Mirror 19: 0xcf91d30f (stale) Mirror 20: 0xcf91d30f (stale) Mirror 22: 0xcf91d30f (stale) Mirror 24: 0xcf91d30f (stale) Mirror 25: 0xcf91d30f (stale) Mirror 26: 0xcf91d30f (stale) Mirror 27: 0xcf91d30f (stale) Mirror 28: 0xcf91d30f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a11a): Mirror 19: 0xcf91d30f (stale) Mirror 20: 0xcf91d30f (stale) Mirror 22: 0xcf91d30f (stale) Mirror 24: 0xcf91d30f (stale) Mirror 25: 0xcf91d30f (stale) Mirror 26: 0xcf91d30f (stale) Mirror 27: 0xcf91d30f (stale) Mirror 28: 0xcf91d30f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a11a: skipped 000879 1771439996.791083 read 0x026ab0 thru 0x02d056 (0x65a7 bytes) 000882 1771439996.796049 mapwrite 0x03e9bd thru 0x03ffff (0x1643 bytes) 000883 1771439996.827579 mapread 0x017911 thru 0x01d091 (0x5781 bytes) 000886 1771439996.836998 MIRROR_RESYNC 9 mirrors 000887 1771439997.194487 read 0x005edf thru 0x010a11 (0xab33 bytes) 000889 1771439997.197961 mapwrite 0x028fb1 thru 0x038deb (0xfe3b bytes) 000890 1771439997.254223 trunc from 0x040000 to 0x0251c7 (0x1ae38 bytes) 000892 1771439997.263356 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x251c8): Mirror 19: 0xb3a95358 (stale) Mirror 20: 0xb3a95358 (stale) Mirror 24: 0xb3a95358 (stale) Mirror 25: 0xb3a95358 (stale) Mirror 26: 0xb3a95358 (stale) Mirror 27: 0xb3a95358 (stale) Mirror 28: 0xb3a95358 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x251c8): Mirror 19: 0xb3a95358 (stale) Mirror 20: 0xb3a95358 (stale) Mirror 24: 0xb3a95358 (stale) Mirror 25: 0xb3a95358 (stale) Mirror 26: 0xb3a95358 (stale) Mirror 27: 0xb3a95358 (stale) Mirror 28: 0xb3a95358 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x251c8: skipped 000893 1771439997.418140 trunc from 0x0251c8 to 0x033945 (0xe77e bytes) 000894 1771439997.423166 mapwrite 0x03cc2d thru 0x03ffff (0x33d3 bytes) 000896 1771439997.451296 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x230203fe (stale) Mirror 20: 0x230203fe (stale) Mirror 24: 0x230203fe (stale) Mirror 25: 0x230203fe (stale) Mirror 26: 0x230203fe (stale) Mirror 27: 0x230203fe (stale) Mirror 28: 0x230203fe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x22df0024 Mirror 29: 0x22df0024 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000898 1771439997.805534 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x230203fe (stale) Mirror 20: 0x230203fe (stale) Mirror 25: 0x230203fe (stale) Mirror 26: 0x230203fe (stale) Mirror 27: 0x230203fe (stale) Mirror 28: 0x230203fe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x230203fe (stale) Mirror 20: 0x230203fe (stale) Mirror 25: 0x230203fe (stale) Mirror 26: 0x230203fe (stale) Mirror 27: 0x230203fe (stale) Mirror 28: 0x230203fe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x22df0024 Mirror 29: 0x22df0024 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000901 1771439998.089577 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x230203fe (stale) Mirror 20: 0x230203fe (stale) Mirror 25: 0x230203fe (stale) Mirror 26: 0x230203fe (stale) Mirror 27: 0x230203fe (stale) Mirror 28: 0x230203fe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x22df0024 Mirror 29: 0x22df0024 Mirror 30: 0x22df0024 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000902 1771439998.435061 write 0x02e0b1 thru 0x038705 (0xa655 bytes) 000903 1771439998.465593 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x230203fe (stale) Mirror 20: 0x230203fe (stale) Mirror 25: 0x230203fe (stale) Mirror 26: 0x230203fe (stale) Mirror 27: 0x230203fe (stale) Mirror 28: 0x230203fe (stale) Mirror 29: 0x22df0024 (stale) Mirror 30: 0x22df0024 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3f39eed2 Mirror 31: 0x3f39eed2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000906 1771439998.821612 mapread 0x0245dd thru 0x02d05a (0x8a7e bytes) 000907 1771439998.836101 read 0x00b02f thru 0x01775b (0xc72d bytes) 000910 1771439998.848952 mapwrite 0x02797c thru 0x029be6 (0x226b bytes) 000915 1771439998.905724 mapread 0x0255e1 thru 0x025c22 (0x642 bytes) 000920 1771439998.909000 write 0x002124 thru 0x003ca0 (0x1b7d bytes) 000921 1771439998.912808 mapwrite 0x023158 thru 0x02d33a (0xa1e3 bytes) 000924 1771439998.937703 trunc from 0x040000 to 0x012bbc (0x2d443 bytes) 000925 1771439998.950272 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x12bbd): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12bbd): Mirror 19: 0xea14ad1e (stale) Mirror 20: 0xea14ad1e (stale) Mirror 25: 0xea14ad1e (stale) Mirror 26: 0xea14ad1e (stale) Mirror 27: 0xea14ad1e (stale) Mirror 28: 0xea14ad1e (stale) Mirror 29: 0xea14ad1e (stale) Mirror 30: 0xea14ad1e (stale) Mirror 31: 0xea14ad1e (stale) CRC-32 checksum value for chunk [0, 0x12bbd): Mirror 1: 0xed3733 Mirror 32: 0xed3733 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12bbd: skipped 000926 1771439999.243955 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12bbd): Mirror 19: 0xea14ad1e (stale) Mirror 20: 0xea14ad1e (stale) Mirror 25: 0xea14ad1e (stale) Mirror 26: 0xea14ad1e (stale) Mirror 27: 0xea14ad1e (stale) Mirror 28: 0xea14ad1e (stale) Mirror 30: 0xea14ad1e (stale) Mirror 31: 0xea14ad1e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12bbd): Mirror 19: 0xea14ad1e (stale) Mirror 20: 0xea14ad1e (stale) Mirror 25: 0xea14ad1e (stale) Mirror 26: 0xea14ad1e (stale) Mirror 27: 0xea14ad1e (stale) Mirror 28: 0xea14ad1e (stale) Mirror 30: 0xea14ad1e (stale) Mirror 31: 0xea14ad1e (stale) CRC-32 checksum value for chunk [0, 0x12bbd): Mirror 1: 0xed3733 Mirror 32: 0xed3733 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12bbd: skipped 000927 1771439999.516630 mapread 0x0095b7 thru 0x0105af (0x6ff9 bytes) 000929 1771439999.541875 mapread 0x005d4a thru 0x00caae (0x6d65 bytes) 000930 1771439999.548410 read 0x00c686 thru 0x011331 (0x4cac bytes) 000931 1771439999.552718 write 0x029f47 thru 0x02d101 (0x31bb bytes) 000932 1771439999.573535 mapwrite 0x0270db thru 0x033434 (0xc35a bytes) 000933 1771439999.628318 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33435): Mirror 19: 0x7c02ef05 (stale) Mirror 20: 0x7c02ef05 (stale) Mirror 25: 0x7c02ef05 (stale) Mirror 26: 0x7c02ef05 (stale) Mirror 27: 0x7c02ef05 (stale) Mirror 28: 0x7c02ef05 (stale) Mirror 31: 0x9e576424 (stale) Mirror 32: 0x8ed66f88 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33435): Mirror 19: 0x7c02ef05 (stale) Mirror 20: 0x7c02ef05 (stale) Mirror 25: 0x7c02ef05 (stale) Mirror 26: 0x7c02ef05 (stale) Mirror 27: 0x7c02ef05 (stale) Mirror 28: 0x7c02ef05 (stale) Mirror 31: 0x9e576424 (stale) Mirror 32: 0x8ed66f88 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33435: skipped 000934 1771439999.825800 write 0x0182a8 thru 0x01f6d1 (0x742a bytes) 000939 1771439999.837518 mapwrite 0x02a7bc thru 0x0363ae (0xbbf3 bytes) 000940 1771439999.877625 trunc from 0x0363af to 0x01531f (0x2108f bytes) 000941 1771439999.882288 read 0x00b308 thru 0x014894 (0x958d bytes) 000943 1771439999.886058 mapread 0x00aed3 thru 0x01032c (0x545a bytes) 000947 1771439999.897913 read 0x00e840 thru 0x012833 (0x3ff4 bytes) 000949 1771439999.898627 trunc from 0x015320 to 0x00d433 (0x7eec bytes) 000952 1771439999.910328 trunc from 0x00d434 to 0x016f0d (0x9ada bytes) 000954 1771439999.918291 trunc from 0x016f0e to 0x0031e4 (0x13d29 bytes) 000955 1771439999.923315 mapread 0x00080d thru 0x0031e4 (0x29d8 bytes) 000957 1771439999.929373 MIRROR_RESYNC 9 mirrors 000958 1771440000.333987 mapwrite 0x03a350 thru 0x03ffff (0x5cb0 bytes) 000959 1771440000.399128 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xfd465261 (stale) Mirror 20: 0xfd465261 (stale) Mirror 25: 0xfd465261 (stale) Mirror 26: 0xfd465261 (stale) Mirror 27: 0xfd465261 (stale) Mirror 28: 0xfd465261 (stale) Mirror 31: 0xfd465261 (stale) Mirror 32: 0xfd465261 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd7d534cf Mirror 33: 0xd7d534cf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000960 1771440000.698756 mapread 0x03bb53 thru 0x03ffff (0x44ad bytes) 000961 1771440000.711251 MIRROR_RESYNC 10 mirrors 000963 1771440001.133967 write 0x0099cf thru 0x00e070 (0x46a2 bytes) 000964 1771440001.155840 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xd7d534cf (stale) Mirror 20: 0xd7d534cf (stale) Mirror 25: 0xd7d534cf (stale) Mirror 26: 0xd7d534cf (stale) Mirror 27: 0xd7d534cf (stale) Mirror 28: 0xd7d534cf (stale) Mirror 31: 0xd7d534cf (stale) Mirror 32: 0xd7d534cf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xd7d534cf (stale) Mirror 20: 0xd7d534cf (stale) Mirror 25: 0xd7d534cf (stale) Mirror 26: 0xd7d534cf (stale) Mirror 27: 0xd7d534cf (stale) Mirror 28: 0xd7d534cf (stale) Mirror 31: 0xd7d534cf (stale) Mirror 32: 0xd7d534cf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000967 1771440001.325434 read 0x0121cb thru 0x01d9c5 (0xb7fb bytes) 000968 1771440001.328475 mapread 0x020a15 thru 0x021449 (0xa35 bytes) 000970 1771440001.333616 MIRROR_RESYNC 9 mirrors 000971 1771440001.698315 MIRROR_RESYNC 9 mirrors 000973 1771440001.879088 mapread 0x00350d thru 0x00d155 (0x9c49 bytes) 000976 1771440001.886823 read 0x02e65e thru 0x03a313 (0xbcb6 bytes) 000977 1771440001.890377 trunc from 0x040000 to 0x0048b0 (0x3b74f bytes) 000980 1771440001.926785 trunc from 0x0048b1 to 0x03c017 (0x37767 bytes) 000981 1771440001.941100 trunc from 0x03c018 to 0x00d32c (0x2eceb bytes) 000983 1771440001.948963 MIRROR_RESYNC 9 mirrors 000984 1771440002.400128 trunc from 0x00d32d to 0x022900 (0x155d4 bytes) 000985 1771440002.420167 mapwrite 0x00ac89 thru 0x0168be (0xbc36 bytes) 000986 1771440002.451328 MIRROR_RESYNC 9 mirrors 000987 1771440002.852508 write 0x013346 thru 0x0181a9 (0x4e64 bytes) 000988 1771440002.888615 trunc from 0x022901 to 0x01cbca (0x5d36 bytes) 000990 1771440002.907212 mapwrite 0x0196ee thru 0x01a3e1 (0xcf4 bytes) 000992 1771440002.949572 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1cbcb): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cbcb): Mirror 19: 0x5ba69baf (stale) Mirror 20: 0x5ba69baf (stale) Mirror 25: 0x5ba69baf (stale) Mirror 26: 0x5ba69baf (stale) Mirror 27: 0x5ba69baf (stale) Mirror 28: 0x5ba69baf (stale) Mirror 31: 0x5ba69baf (stale) Mirror 32: 0x5ba69baf (stale) CRC-32 checksum value for chunk [0, 0x1cbcb): Mirror 1: 0x1de9298f Mirror 33: 0x1de9298f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cbcb: skipped 000993 1771440003.344820 mapwrite 0x01cf45 thru 0x027188 (0xa244 bytes) 000994 1771440003.417353 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27189): Mirror 20: 0x898c38ef (stale) Mirror 25: 0x898c38ef (stale) Mirror 26: 0x898c38ef (stale) Mirror 27: 0x898c38ef (stale) Mirror 28: 0x898c38ef (stale) Mirror 31: 0x898c38ef (stale) Mirror 32: 0x898c38ef (stale) Mirror 33: 0xa9b33a8f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27189): Mirror 20: 0x898c38ef (stale) Mirror 25: 0x898c38ef (stale) Mirror 26: 0x898c38ef (stale) Mirror 27: 0x898c38ef (stale) Mirror 28: 0x898c38ef (stale) Mirror 31: 0x898c38ef (stale) Mirror 32: 0x898c38ef (stale) Mirror 33: 0xa9b33a8f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27189: skipped 000995 1771440003.645331 mapwrite 0x02b764 thru 0x03998a (0xe227 bytes) 000997 1771440003.700777 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x473:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3998b): Mirror 25: 0x89b1ed9d (stale) Mirror 26: 0x89b1ed9d (stale) Mirror 27: 0x89b1ed9d (stale) Mirror 28: 0x89b1ed9d (stale) Mirror 31: 0x89b1ed9d (stale) Mirror 32: 0x89b1ed9d (stale) Mirror 33: 0xb8505685 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3998b): Mirror 25: 0x89b1ed9d (stale) Mirror 26: 0x89b1ed9d (stale) Mirror 27: 0x89b1ed9d (stale) Mirror 28: 0x89b1ed9d (stale) Mirror 31: 0x89b1ed9d (stale) Mirror 32: 0x89b1ed9d (stale) Mirror 33: 0xb8505685 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3998b: skipped 000999 1771440003.891379 read 0x02566a thru 0x025add (0x474 bytes) 001000 1771440003.898078 MIRROR_RESYNC 8 mirrors All operations completed A-OK!