== sanity-flr test 70a: flr mode fsx test ================ 17:27:17 (1787866037) Seed set to 6038 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1787866039.338021 mapwrite 0x0146b9 thru 0x01f32f (0xac77 bytes) 000002 1787866039.643055 mapread 0x00a4df thru 0x00d97d (0x349f bytes) 000004 1787866039.662852 mapread 0x00aa77 thru 0x0130aa (0x8634 bytes) 000005 1787866039.663821 write 0x0168a1 thru 0x0240c3 (0xd823 bytes) truncating to largest ever: 0x1dd9b 000007 1787866039.675725 trunc from 0x0240c4 to 0x01dd9a (0x6329 bytes) 000008 1787866039.720186 mapread 0x01177b thru 0x01dd9a (0xc620 bytes) 000011 1787866039.738013 write 0x01488f thru 0x0149cf (0x141 bytes) 000012 1787866039.739162 write 0x03c16b thru 0x03ffff (0x3e95 bytes) 000014 1787866039.751831 mapwrite 0x022663 thru 0x02786b (0x5209 bytes) 000015 1787866039.867705 trunc from 0x040000 to 0x001ee2 (0x3e11d bytes) 000016 1787866039.915669 mapwrite 0x03c7ef thru 0x03ffff (0x3811 bytes) 000018 1787866040.018253 write 0x032905 thru 0x03ffff (0xd6fb bytes) 000020 1787866040.028697 read 0x039969 thru 0x03b678 (0x1d10 bytes) 000022 1787866040.030051 mapread 0x02f088 thru 0x033984 (0x48fd bytes) 000024 1787866040.046673 read 0x02efdb thru 0x03a270 (0xb296 bytes) 000025 1787866040.047999 read 0x003e23 thru 0x009f15 (0x60f3 bytes) 000026 1787866040.080731 write 0x018484 thru 0x01f411 (0x6f8e bytes) 000031 1787866040.115134 trunc from 0x040000 to 0x00241f (0x3dbe0 bytes) 000033 1787866040.156654 read 0x0023ac thru 0x00241f (0x74 bytes) 000034 1787866040.157473 read 0x001de3 thru 0x00241f (0x63d bytes) 000035 1787866040.158895 mapread 0x001e04 thru 0x00241f (0x61c bytes) 000038 1787866040.168912 mapread 0x00156a thru 0x002197 (0xc2e bytes) truncating to largest ever: 0x246ee 000040 1787866040.173665 trunc from 0x002420 to 0x0246ed (0x222ce bytes) 000041 1787866040.350790 read 0x00ea4e thru 0x0164a0 (0x7a53 bytes) 000042 1787866040.384725 mapwrite 0x01146e thru 0x01c3ee (0xaf81 bytes) 000045 1787866040.573756 read 0x003d4c thru 0x0048f6 (0xbab bytes) 000046 1787866040.578000 trunc from 0x0246ee to 0x00981a (0x1aed3 bytes) 000048 1787866040.676582 write 0x0092a4 thru 0x00f5a6 (0x6303 bytes) 000054 1787866040.687812 read 0x00bce8 thru 0x00f5a6 (0x38bf bytes) truncating to largest ever: 0x2a50e 000055 1787866040.688935 trunc from 0x00f5a7 to 0x02a50d (0x1af67 bytes) 000057 1787866040.760809 read 0x00746c thru 0x0117ff (0xa394 bytes) 000059 1787866040.786765 mapread 0x00f103 thru 0x01ddb6 (0xecb4 bytes) 000060 1787866040.791140 read 0x00cc0c thru 0x00cd9e (0x193 bytes) 000061 1787866040.792311 trunc from 0x02a50e to 0x020843 (0x9cca bytes) 000062 1787866040.831004 write 0x0218ee thru 0x027824 (0x5f37 bytes) 000064 1787866040.833028 mapread 0x01ad07 thru 0x027824 (0xcb1e bytes) 000067 1787866040.845025 trunc from 0x027825 to 0x0124d9 (0x1534b bytes) 000068 1787866040.899348 read 0x0079c0 thru 0x00c48d (0x4ace bytes) 000069 1787866040.900698 mapread 0x00d497 thru 0x0124d9 (0x5043 bytes) 000070 1787866040.910702 mapread 0x00b55e thru 0x0124d9 (0x6f7c bytes) 000071 1787866040.916308 mapread 0x00e4b9 thru 0x0124d9 (0x4021 bytes) 000072 1787866040.917133 mapwrite 0x03cb1f thru 0x03ffff (0x34e1 bytes) 000073 1787866041.126113 write 0x033c10 thru 0x03ce33 (0x9224 bytes) 000074 1787866041.129534 read 0x010c2a thru 0x01c721 (0xbaf8 bytes) 000075 1787866041.131911 write 0x0224d7 thru 0x027b8b (0x56b5 bytes) 000076 1787866041.138600 mapwrite 0x01b7b4 thru 0x02856d (0xcdba bytes) 000079 1787866041.225639 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x3deaf 000080 1787866043.038344 trunc from 0x040000 to 0x03deae (0x2151 bytes) 000081 1787866043.230929 MIRROR_RESYNC 2 mirrors 000085 1787866044.730443 trunc from 0x03deaf to 0x000832 (0x3d67c bytes) 000086 1787866044.801664 trunc from 0x000833 to 0x033c54 (0x33422 bytes) 000087 1787866044.823474 mapread 0x00d6ba thru 0x00e343 (0xc8a bytes) 000088 1787866044.834853 trunc from 0x033c55 to 0x00707b (0x2cbd9 bytes) 000089 1787866044.857089 mapread 0x0062da thru 0x00707b (0xda2 bytes) 000090 1787866044.866386 read 0x00258f thru 0x004c6d (0x26df bytes) 000091 1787866044.867278 write 0x007790 thru 0x00a181 (0x29f2 bytes) 000092 1787866044.873470 MIRROR_RESYNC 2 mirrors 000094 1787866045.608515 read 0x00113f thru 0x00a181 (0x9043 bytes) 000095 1787866045.623814 mapwrite 0x03ccc8 thru 0x03ffff (0x3338 bytes) 000100 1787866045.852144 mapread 0x03c091 thru 0x03ffff (0x3f6f bytes) 000102 1787866045.853785 trunc from 0x040000 to 0x014301 (0x2bcfe bytes) 000103 1787866045.874885 trunc from 0x014302 to 0x017cd8 (0x39d7 bytes) 000104 1787866045.901578 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) 000105 1787866046.093901 mapwrite 0x023252 thru 0x028ccc (0x5a7b bytes) 000106 1787866046.178367 read 0x0042d0 thru 0x007183 (0x2eb4 bytes) 000107 1787866046.185217 read 0x0124f0 thru 0x01f0a7 (0xcbb8 bytes) 000108 1787866046.195967 mapread 0x001cb3 thru 0x003eb5 (0x2203 bytes) 000109 1787866046.197380 trunc from 0x028ccd to 0x025cdd (0x2fef bytes) 000110 1787866046.212033 read 0x01c526 thru 0x025cdd (0x97b8 bytes) 000113 1787866046.213894 write 0x000e7b thru 0x0062e3 (0x5469 bytes) 000116 1787866046.218298 write 0x032dab thru 0x03ffff (0xd255 bytes) 000119 1787866046.221999 trunc from 0x040000 to 0x01f94a (0x206b5 bytes) 000122 1787866046.239285 mapwrite 0x0245f8 thru 0x02d090 (0x8a99 bytes) 000126 1787866046.335783 read 0x010924 thru 0x0158da (0x4fb7 bytes) 000130 1787866046.340988 mapwrite 0x013407 thru 0x016d1f (0x3919 bytes) 000131 1787866046.410099 mapwrite 0x02e30a thru 0x0349d4 (0x66cb bytes) 000132 1787866046.559487 mapread 0x02b089 thru 0x0349d4 (0x994c bytes) 000133 1787866046.561095 mapread 0x0079cf thru 0x013c25 (0xc257 bytes) 000134 1787866046.563889 mapread 0x01e048 thru 0x028ef5 (0xaeae bytes) 000141 1787866046.597279 MIRROR_EXTEND to 2 mirrors 000142 1787866048.171258 read 0x014b58 thru 0x0153bf (0x868 bytes) 000143 1787866048.200812 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) 000144 1787866048.464683 trunc from 0x0349d5 to 0x02837a (0xc65a bytes) 000145 1787866048.495103 mapread 0x009f26 thru 0x01282f (0x890a bytes) 000153 1787866048.519297 read 0x0152d6 thru 0x021cb4 (0xc9df bytes) 000155 1787866048.530625 mapread 0x007ef3 thru 0x00d157 (0x5265 bytes) 000156 1787866048.531591 mapwrite 0x01e9be thru 0x02d823 (0xee66 bytes) 000158 1787866048.655226 mapwrite 0x02b446 thru 0x02b70d (0x2c8 bytes) 000160 1787866048.775079 MIRROR_EXTEND to 2 mirrors 000162 1787866050.525825 mapread 0x022a34 thru 0x02b553 (0x8b20 bytes) 000163 1787866050.555780 trunc from 0x02d824 to 0x02652f (0x72f4 bytes) 000165 1787866050.717037 mapwrite 0x021535 thru 0x02ca77 (0xb543 bytes) 000167 1787866050.939621 read 0x019166 thru 0x028540 (0xf3db bytes) 000169 1787866050.957095 mapread 0x00342d thru 0x01053d (0xd111 bytes) 000170 1787866050.980241 trunc from 0x02ca78 to 0x01308a (0x199ed bytes) 000172 1787866051.025016 read 0x002875 thru 0x0039d6 (0x1162 bytes) 000174 1787866051.035881 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1308b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1308b): Mirror 2: 0xe2be99fe (stale) CRC-32 checksum value for chunk [0, 0x1308b): Mirror 1: 0xe2be99fe Mirror 3: 0xe2be99fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1308b: skipped 000175 1787866053.238578 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1308b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1308b): Mirror 2: 0xe2be99fe (stale) CRC-32 checksum value for chunk [0, 0x1308b): Mirror 1: 0xe2be99fe Mirror 3: 0xe2be99fe Mirror 4: 0xe2be99fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1308b: skipped 000176 1787866055.803951 mapread 0x009fd1 thru 0x01308a (0x90ba bytes) 000179 1787866055.893032 trunc from 0x01308b to 0x03b8a2 (0x28818 bytes) 000180 1787866056.116795 write 0x0398f2 thru 0x03a471 (0xb80 bytes) 000186 1787866056.172527 mapwrite 0x002fd4 thru 0x00f723 (0xc750 bytes) 000187 1787866056.292360 MIRROR_RESYNC 4 mirrors 000188 1787866058.685313 write 0x0185d4 thru 0x023be6 (0xb613 bytes) 000190 1787866058.919296 write 0x030a58 thru 0x038890 (0x7e39 bytes) 000191 1787866058.943280 trunc from 0x03b8a3 to 0x0183b0 (0x234f2 bytes) 000192 1787866059.022552 write 0x02780c thru 0x034403 (0xcbf8 bytes) 000193 1787866059.024104 write 0x03e570 thru 0x03ffff (0x1a90 bytes) 000195 1787866059.035681 write 0x038b71 thru 0x03ffff (0x748f bytes) 000196 1787866059.087270 MIRROR_RESYNC 4 mirrors 000197 1787866062.389502 trunc from 0x040000 to 0x00d408 (0x32bf7 bytes) 000199 1787866062.488772 write 0x021ea1 thru 0x02b84e (0x99ae bytes) 000200 1787866062.509786 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2b84f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b84f): Mirror 2: 0x8917e1d2 (stale) Mirror 3: 0x8917e1d2 (stale) Mirror 4: 0x8917e1d2 (stale) CRC-32 checksum value for chunk [0, 0x2b84f): Mirror 1: 0xe1ad6438 Mirror 5: 0xe1ad6438 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b84f: skipped 000201 1787866064.425923 mapread 0x015e02 thru 0x01aad6 (0x4cd5 bytes) 000203 1787866064.461798 MIRROR_RESYNC 5 mirrors 000204 1787866066.310908 mapwrite 0x00800d thru 0x01767f (0xf673 bytes) 000205 1787866066.542159 read 0x00c634 thru 0x012d4e (0x671b bytes) 000206 1787866066.543703 mapwrite 0x0070f8 thru 0x00c061 (0x4f6a bytes) 000208 1787866066.600138 trunc from 0x02b84f to 0x0075ee (0x24260 bytes) 000210 1787866066.634711 mapread 0x000aea thru 0x00171e (0xc35 bytes) 000211 1787866066.648704 MIRROR_RESYNC 5 mirrors 000212 1787866067.511380 read 0x004d7c thru 0x0075ee (0x2873 bytes) 000213 1787866067.516764 mapwrite 0x01c831 thru 0x029a3d (0xd20d bytes) 000214 1787866067.648501 write 0x007c10 thru 0x00ab28 (0x2f19 bytes) 000215 1787866067.658038 mapwrite 0x0005e6 thru 0x000e58 (0x873 bytes) 000216 1787866067.708283 mapwrite 0x02b931 thru 0x031649 (0x5d19 bytes) 000218 1787866067.921557 write 0x0381bc thru 0x03ffff (0x7e44 bytes) 000220 1787866067.923193 write 0x030fcb thru 0x031c02 (0xc38 bytes) 000222 1787866067.934477 trunc from 0x040000 to 0x0054d8 (0x3ab27 bytes) 000225 1787866067.974132 mapwrite 0x036281 thru 0x03ffff (0x9d7f bytes) 000226 1787866068.114542 mapread 0x00a642 thru 0x00e0e4 (0x3aa3 bytes) 000228 1787866068.129445 mapwrite 0x02adf2 thru 0x02b2e5 (0x4f4 bytes) 000231 1787866068.210879 mapwrite 0x0274f2 thru 0x031edd (0xa9ec bytes) 000232 1787866068.288432 read 0x00a775 thru 0x00c512 (0x1d9e bytes) 000236 1787866068.291052 mapread 0x00719c thru 0x0147ae (0xd613 bytes) 000237 1787866068.302431 write 0x01b4d3 thru 0x0247ee (0x931c bytes) 000240 1787866068.305485 trunc from 0x040000 to 0x033db0 (0xc24f bytes) 000241 1787866068.321919 mapread 0x02af98 thru 0x033db0 (0x8e19 bytes) 000243 1787866068.329337 MIRROR_RESYNC 5 mirrors 000244 1787866071.049217 mapread 0x0163b5 thru 0x023e38 (0xda84 bytes) 000245 1787866071.082234 trunc from 0x033db1 to 0x029244 (0xab6c bytes) 000247 1787866071.164208 read 0x025842 thru 0x0259c1 (0x180 bytes) 000248 1787866071.173538 trunc from 0x029245 to 0x02bb75 (0x2931 bytes) 000249 1787866071.201736 write 0x01ecfd thru 0x025715 (0x6a19 bytes) 000258 1787866071.215993 mapread 0x00a2fd thru 0x01288f (0x8593 bytes) 000263 1787866071.229423 trunc from 0x02bb76 to 0x00acb6 (0x20ebf bytes) 000266 1787866071.252130 trunc from 0x00acb7 to 0x00d454 (0x279e bytes) 000268 1787866071.277801 trunc from 0x00d455 to 0x01c55f (0xf10b bytes) 000270 1787866071.301816 read 0x00c3fa thru 0x016d41 (0xa948 bytes) 000271 1787866071.315086 write 0x01b5db thru 0x020985 (0x53ab bytes) 000273 1787866071.316879 trunc from 0x020986 to 0x00aba8 (0x15ddd bytes) 000274 1787866071.349869 MIRROR_RESYNC 5 mirrors 000275 1787866073.290673 mapread 0x00a9c2 thru 0x00aba8 (0x1e7 bytes) 000276 1787866073.304080 read 0x006c09 thru 0x007914 (0xd0c bytes) 000278 1787866073.314688 mapwrite 0x00c9e3 thru 0x014987 (0x7fa5 bytes) 000279 1787866073.766150 write 0x020ad7 thru 0x02dc07 (0xd131 bytes) 000280 1787866073.767773 read 0x01f5f4 thru 0x028cf3 (0x9700 bytes) 000282 1787866073.782944 mapread 0x02cde2 thru 0x02d21f (0x43e bytes) 000283 1787866073.788798 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2dc08): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dc08): Mirror 2: 0xbc2e934d (stale) Mirror 3: 0xbc2e934d (stale) Mirror 4: 0xbc2e934d (stale) Mirror 5: 0xbc2e934d (stale) CRC-32 checksum value for chunk [0, 0x2dc08): Mirror 1: 0xf6ead242 Mirror 6: 0xf6ead242 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dc08: skipped 000284 1787866075.597749 mapread 0x02b76b thru 0x02dc07 (0x249d bytes) 000285 1787866075.622630 mapread 0x0273b0 thru 0x02dc07 (0x6858 bytes) 000286 1787866075.623613 mapwrite 0x00dc72 thru 0x01bc82 (0xe011 bytes) 000287 1787866075.933925 write 0x037e33 thru 0x03a8ff (0x2acd bytes) 000290 1787866075.946056 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a900): Mirror 3: 0x227b4a80 (stale) Mirror 4: 0x227b4a80 (stale) Mirror 5: 0x227b4a80 (stale) Mirror 6: 0x7fed549b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a900): Mirror 3: 0x227b4a80 (stale) Mirror 4: 0x227b4a80 (stale) Mirror 5: 0x227b4a80 (stale) Mirror 6: 0x7fed549b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a900: skipped 000295 1787866076.448658 MIRROR_RESYNC 5 mirrors 000297 1787866079.854077 read 0x021b66 thru 0x030926 (0xedc1 bytes) 000300 1787866079.868340 mapwrite 0x03135c thru 0x0363db (0x5080 bytes) 000301 1787866080.061623 read 0x01c835 thru 0x021954 (0x5120 bytes) 000302 1787866080.090887 mapread 0x0312e9 thru 0x03a8ff (0x9617 bytes) 000303 1787866080.094905 mapwrite 0x03b170 thru 0x03ffff (0x4e90 bytes) 000306 1787866080.184206 mapread 0x0048da thru 0x00c333 (0x7a5a bytes) 000308 1787866080.186978 write 0x030e09 thru 0x0330a6 (0x229e bytes) 000310 1787866080.189994 write 0x037f66 thru 0x03ffff (0x809a bytes) 000312 1787866080.192494 mapread 0x02ebd5 thru 0x035a82 (0x6eae bytes) 000315 1787866080.194930 read 0x02a00b thru 0x036f0e (0xcf04 bytes) 000316 1787866080.199501 read 0x00b68f thru 0x0127eb (0x715d bytes) 000317 1787866080.200491 write 0x038427 thru 0x03ffff (0x7bd9 bytes) 000319 1787866080.203376 mapread 0x002e90 thru 0x005693 (0x2804 bytes) 000320 1787866080.204748 mapwrite 0x026e64 thru 0x02efb3 (0x8150 bytes) 000321 1787866080.280149 mapread 0x0022ba thru 0x00a4e3 (0x822a bytes) 000323 1787866080.281939 trunc from 0x040000 to 0x03daaf (0x2550 bytes) 000325 1787866080.318134 write 0x035541 thru 0x03ffff (0xaabf bytes) 000327 1787866080.328085 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9effc376 (stale) Mirror 4: 0x9effc376 (stale) Mirror 5: 0x9effc376 (stale) Mirror 6: 0x9effc376 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xad0a07f4 Mirror 7: 0xad0a07f4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000328 1787866081.748127 mapread 0x022be3 thru 0x025dd5 (0x31f3 bytes) 000330 1787866081.771396 read 0x0382b5 thru 0x03ffff (0x7d4b bytes) 000332 1787866081.786831 trunc from 0x040000 to 0x010401 (0x2fbfe bytes) 000333 1787866081.921766 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x10402): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10402): Mirror 3: 0xc1e41402 (stale) Mirror 4: 0xc1e41402 (stale) Mirror 5: 0xc1e41402 (stale) Mirror 6: 0xc1e41402 (stale) Mirror 7: 0xc1e41402 (stale) CRC-32 checksum value for chunk [0, 0x10402): Mirror 1: 0xc1e41402 Mirror 8: 0xc1e41402 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10402: skipped 000335 1787866083.459669 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x10402): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10402): Mirror 3: 0xc1e41402 (stale) Mirror 4: 0xc1e41402 (stale) Mirror 5: 0xc1e41402 (stale) Mirror 6: 0xc1e41402 (stale) Mirror 7: 0xc1e41402 (stale) CRC-32 checksum value for chunk [0, 0x10402): Mirror 1: 0xc1e41402 Mirror 8: 0xc1e41402 Mirror 9: 0xc1e41402 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10402: skipped 000337 1787866085.429570 mapread 0x0077d8 thru 0x007a41 (0x26a bytes) 000339 1787866085.443014 mapread 0x006a55 thru 0x00af65 (0x4511 bytes) 000344 1787866085.472842 mapread 0x00d551 thru 0x00fd44 (0x27f4 bytes) 000345 1787866085.473641 trunc from 0x010402 to 0x039290 (0x28e8f bytes) 000347 1787866085.658970 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x39291): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39291): Mirror 3: 0x5f6c814e (stale) Mirror 4: 0x5f6c814e (stale) Mirror 5: 0x5f6c814e (stale) Mirror 6: 0x5f6c814e (stale) Mirror 7: 0x686fb49e (stale) Mirror 8: 0xb2b28a03 (stale) Mirror 9: 0xb2b28a03 (stale) CRC-32 checksum value for chunk [0, 0x39291): Mirror 1: 0xb2b28a03 Mirror 10: 0xb2b28a03 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39291: skipped 000348 1787866087.619961 MIRROR_RESYNC 9 mirrors 000349 1787866091.409710 mapread 0x0332e1 thru 0x039290 (0x5fb0 bytes) 000351 1787866091.438523 mapwrite 0x039e71 thru 0x03ffff (0x618f bytes) 000353 1787866091.772752 mapwrite 0x03e10a thru 0x03ffff (0x1ef6 bytes) 000354 1787866091.903888 trunc from 0x040000 to 0x020eda (0x1f125 bytes) 000357 1787866091.966941 MIRROR_RESYNC 9 mirrors 000358 1787866095.220135 MIRROR_RESYNC 9 mirrors 000360 1787866095.990108 mapwrite 0x01e8e5 thru 0x021e2c (0x3548 bytes) 000361 1787866096.330268 mapwrite 0x023088 thru 0x02e9fc (0xb975 bytes) 000362 1787866096.440054 trunc from 0x02e9fd to 0x033e54 (0x5458 bytes) 000364 1787866096.458971 read 0x0155dd thru 0x018467 (0x2e8b bytes) 000366 1787866096.468428 write 0x03a488 thru 0x03dd29 (0x38a2 bytes) 000371 1787866096.473163 mapwrite 0x00613c thru 0x007ebb (0x1d80 bytes) 000373 1787866096.525771 mapwrite 0x016550 thru 0x01f862 (0x9313 bytes) 000374 1787866096.586753 mapwrite 0x035676 thru 0x03a9cd (0x5358 bytes) 000376 1787866096.698439 mapwrite 0x01319f thru 0x01567e (0x24e0 bytes) 000377 1787866096.755958 mapwrite 0x02e8a3 thru 0x032e4c (0x45aa bytes) 000378 1787866096.845049 MIRROR_RESYNC 9 mirrors 000382 1787866101.926648 trunc from 0x03dd2a to 0x01e002 (0x1fd27 bytes) 000384 1787866102.169260 mapread 0x0062e5 thru 0x00e3f1 (0x810d bytes) 000385 1787866102.212072 read 0x01c512 thru 0x01e002 (0x1af1 bytes) 000386 1787866102.243832 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e003): Mirror 3: 0xf1a21832 (stale) Mirror 4: 0xf1a21832 (stale) Mirror 5: 0xf1a21832 (stale) Mirror 6: 0xf1a21832 (stale) Mirror 7: 0xf1a21832 (stale) Mirror 8: 0xf1a21832 (stale) Mirror 10: 0xf1a21832 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e003): Mirror 3: 0xf1a21832 (stale) Mirror 4: 0xf1a21832 (stale) Mirror 5: 0xf1a21832 (stale) Mirror 6: 0xf1a21832 (stale) Mirror 7: 0xf1a21832 (stale) Mirror 8: 0xf1a21832 (stale) Mirror 10: 0xf1a21832 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e003: skipped 000388 1787866103.327471 MIRROR_RESYNC 8 mirrors 000389 1787866106.875602 MIRROR_RESYNC 8 mirrors 000392 1787866108.023126 mapwrite 0x01e238 thru 0x0276fc (0x94c5 bytes) 000394 1787866108.283685 MIRROR_RESYNC 8 mirrors 000395 1787866111.520067 mapread 0x0013b3 thru 0x004f8c (0x3bda bytes) 000399 1787866111.545646 mapread 0x00bf5f thru 0x013a4c (0x7aee bytes) 000400 1787866111.555288 trunc from 0x0276fd to 0x031a19 (0xa31d bytes) 000401 1787866111.738348 trunc from 0x031a1a to 0x027ea8 (0x9b71 bytes) 000403 1787866111.788438 mapread 0x01508f thru 0x023bde (0xeb50 bytes) 000404 1787866111.851327 trunc from 0x027ea9 to 0x004d70 (0x23138 bytes) 000407 1787866111.907426 read 0x0014ce thru 0x004d70 (0x38a3 bytes) 000408 1787866111.930505 MIRROR_RESYNC 8 mirrors 000410 1787866113.756856 mapread 0x0020d2 thru 0x004d70 (0x2c9f bytes) 000413 1787866113.806410 read 0x001c6c thru 0x004d70 (0x3105 bytes) 000414 1787866113.807144 mapread 0x00016f thru 0x004d70 (0x4c02 bytes) 000416 1787866113.830457 mapwrite 0x031684 thru 0x033b6e (0x24eb bytes) 000418 1787866114.027100 mapread 0x015cc4 thru 0x019262 (0x359f bytes) 000420 1787866114.037681 trunc from 0x033b6f to 0x0256bd (0xe4b1 bytes) 000422 1787866114.072470 mapwrite 0x0075a5 thru 0x007948 (0x3a4 bytes) 000423 1787866114.182355 mapread 0x012cf1 thru 0x021247 (0xe557 bytes) 000425 1787866114.201672 mapread 0x01463e thru 0x01ab8c (0x654f bytes) 000426 1787866114.204827 mapread 0x022170 thru 0x0256bd (0x354e bytes) 000428 1787866114.210283 mapread 0x024993 thru 0x0256bd (0xd2b bytes) 000429 1787866114.212348 read 0x011a5f thru 0x0178b1 (0x5e53 bytes) 000430 1787866114.214353 trunc from 0x0256be to 0x034b75 (0xf4b8 bytes) 000434 1787866114.239699 mapwrite 0x02a975 thru 0x033156 (0x87e2 bytes) 000437 1787866114.314968 mapread 0x021c0a thru 0x02cd8b (0xb182 bytes) 000438 1787866114.317070 write 0x033dcf thru 0x036712 (0x2944 bytes) 000439 1787866114.318821 mapread 0x01a18c thru 0x01a6b7 (0x52c bytes) 000442 1787866114.322009 trunc from 0x036713 to 0x01e260 (0x184b2 bytes) 000443 1787866114.346799 mapwrite 0x03c252 thru 0x03ffff (0x3dae bytes) 000444 1787866114.511531 mapread 0x0371ec thru 0x03b377 (0x418c bytes) 000448 1787866114.517438 read 0x01f84e thru 0x022711 (0x2ec4 bytes) 000449 1787866114.537553 read 0x01fe76 thru 0x0298b2 (0x9a3d bytes) 000450 1787866114.538400 mapwrite 0x0271d5 thru 0x03603d (0xee69 bytes) 000451 1787866114.680633 write 0x00b11f thru 0x013bee (0x8ad0 bytes) 000454 1787866114.690438 mapread 0x035e7c thru 0x03ffff (0xa184 bytes) 000455 1787866114.693538 trunc from 0x040000 to 0x0182bf (0x27d40 bytes) 000456 1787866114.725903 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x182c0): Mirror 4: 0xe4f92c7d (stale) Mirror 5: 0xe4f92c7d (stale) Mirror 6: 0xe4f92c7d (stale) Mirror 7: 0xe4f92c7d (stale) Mirror 8: 0xe4f92c7d (stale) Mirror 10: 0xe4f92c7d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x182c0): Mirror 4: 0xe4f92c7d (stale) Mirror 5: 0xe4f92c7d (stale) Mirror 6: 0xe4f92c7d (stale) Mirror 7: 0xe4f92c7d (stale) Mirror 8: 0xe4f92c7d (stale) Mirror 10: 0xe4f92c7d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x182c0: skipped 000459 1787866115.196713 write 0x032e40 thru 0x03ff10 (0xd0d1 bytes) 000461 1787866115.207316 mapread 0x00b7a2 thru 0x017c1f (0xc47e bytes) 000463 1787866115.246914 trunc from 0x03ff11 to 0x00525f (0x3acb1 bytes) 000465 1787866115.270295 mapread 0x000fb0 thru 0x00525f (0x42b0 bytes) 000466 1787866115.285391 trunc from 0x005260 to 0x0216b9 (0x1c45a bytes) 000468 1787866115.308327 read 0x00a294 thru 0x0165e1 (0xc34e bytes) 000469 1787866115.329556 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x216ba): Mirror 4: 0xfbf6343f (stale) Mirror 5: 0xfbf6343f (stale) Mirror 6: 0xfbf6343f (stale) Mirror 7: 0xfbf6343f (stale) Mirror 8: 0xfbf6343f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x216ba): Mirror 4: 0xfbf6343f (stale) Mirror 5: 0xfbf6343f (stale) Mirror 6: 0xfbf6343f (stale) Mirror 7: 0xfbf6343f (stale) Mirror 8: 0xfbf6343f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x216ba: skipped 000470 1787866116.209691 read 0x012d74 thru 0x012dad (0x3a bytes) 000471 1787866116.223213 read 0x002a67 thru 0x00f78e (0xcd28 bytes) 000474 1787866116.243992 read 0x00d238 thru 0x012cba (0x5a83 bytes) 000476 1787866116.251657 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x216ba): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x216ba): Mirror 4: 0xfbf6343f (stale) Mirror 5: 0xfbf6343f (stale) Mirror 6: 0xfbf6343f (stale) Mirror 7: 0xfbf6343f (stale) Mirror 8: 0xfbf6343f (stale) CRC-32 checksum value for chunk [0, 0x216ba): Mirror 1: 0xfbf6343f Mirror 9: 0xfbf6343f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x216ba: skipped 000478 1787866117.677780 read 0x01db5e thru 0x01f284 (0x1727 bytes) 000480 1787866117.685774 mapread 0x01ef42 thru 0x0216b9 (0x2778 bytes) 000481 1787866117.698353 trunc from 0x0216ba to 0x0155ef (0xc0ca bytes) 000482 1787866117.812979 mapread 0x006c92 thru 0x00c365 (0x56d4 bytes) 000484 1787866117.828456 mapread 0x00f821 thru 0x01354c (0x3d2c bytes) 000486 1787866117.842619 mapread 0x00caa2 thru 0x0155ef (0x8b4e bytes) 000487 1787866117.845929 trunc from 0x0155f0 to 0x0003de (0x15211 bytes) 000489 1787866117.886344 mapwrite 0x03ff94 thru 0x03ffff (0x6c bytes) 000490 1787866118.035525 MIRROR_RESYNC 7 mirrors 000491 1787866120.670401 mapwrite 0x02118d thru 0x02d99a (0xc80e bytes) 000492 1787866120.873868 read 0x039bfb thru 0x03d5c1 (0x39c7 bytes) 000493 1787866120.886127 read 0x01d7ac thru 0x01fe02 (0x2657 bytes) 000494 1787866120.893333 MIRROR_RESYNC 7 mirrors 000498 1787866123.569831 mapread 0x00575c thru 0x0075ba (0x1e5f bytes) 000501 1787866123.605379 read 0x032f20 thru 0x036094 (0x3175 bytes) 000502 1787866123.624853 mapwrite 0x03c114 thru 0x03ffff (0x3eec bytes) 000504 1787866123.835683 mapwrite 0x008406 thru 0x01545b (0xd056 bytes) 000506 1787866123.896821 mapread 0x02b6c7 thru 0x033910 (0x824a bytes) 000508 1787866123.916822 trunc from 0x040000 to 0x02bee2 (0x1411d bytes) 000509 1787866123.944248 mapread 0x026362 thru 0x02bee2 (0x5b81 bytes) 000514 1787866123.949964 trunc from 0x02bee3 to 0x00f789 (0x1c759 bytes) 000517 1787866123.967980 mapread 0x003944 thru 0x0064e4 (0x2ba1 bytes) 000519 1787866123.975649 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf78a): Mirror 4: 0x195671f8 (stale) Mirror 5: 0x195671f8 (stale) Mirror 7: 0x195671f8 (stale) Mirror 8: 0x195671f8 (stale) Mirror 9: 0x195671f8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf78a): Mirror 4: 0x195671f8 (stale) Mirror 5: 0x195671f8 (stale) Mirror 7: 0x195671f8 (stale) Mirror 8: 0x195671f8 (stale) Mirror 9: 0x195671f8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf78a: skipped 000520 1787866124.524255 read 0x0038e0 thru 0x004b5c (0x127d bytes) 000521 1787866124.534856 mapwrite 0x010a2c thru 0x0188a0 (0x7e75 bytes) 000522 1787866124.714109 MIRROR_RESYNC 6 mirrors 000524 1787866126.768388 mapread 0x012386 thru 0x015d74 (0x39ef bytes) 000527 1787866126.791437 mapwrite 0x00fa2f thru 0x01e546 (0xeb18 bytes) 000528 1787866126.971087 read 0x003e70 thru 0x00b0e8 (0x7279 bytes) 000529 1787866126.982593 mapwrite 0x01fea3 thru 0x0266f2 (0x6850 bytes) 000530 1787866127.061710 mapread 0x01943e thru 0x01a219 (0xddc bytes) 000532 1787866127.064706 mapread 0x01a54c thru 0x0266f2 (0xc1a7 bytes) 000533 1787866127.067623 mapwrite 0x0208f8 thru 0x02a424 (0x9b2d bytes) 000534 1787866127.167667 mapwrite 0x02f9a2 thru 0x03d5ca (0xdc29 bytes) 000535 1787866127.281530 write 0x03f20f thru 0x03ffff (0xdf1 bytes) 000537 1787866127.283149 write 0x02b0a9 thru 0x031640 (0x6598 bytes) 000540 1787866127.293706 read 0x01b8eb thru 0x026f78 (0xb68e bytes) 000541 1787866127.295584 write 0x0161f8 thru 0x01e745 (0x854e bytes) 000546 1787866127.300472 mapread 0x01da07 thru 0x02b03f (0xd639 bytes) 000547 1787866127.302484 mapwrite 0x01edb4 thru 0x020048 (0x1295 bytes) 000551 1787866127.405612 trunc from 0x040000 to 0x02a8af (0x15750 bytes) 000552 1787866127.466606 mapread 0x01e27c thru 0x029153 (0xaed8 bytes) 000555 1787866127.472507 trunc from 0x02a8b0 to 0x031a68 (0x71b9 bytes) 000556 1787866127.549541 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x31a69): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31a69): Mirror 4: 0x7035cac6 (stale) Mirror 5: 0x7035cac6 (stale) Mirror 7: 0x7035cac6 (stale) Mirror 8: 0x7035cac6 (stale) Mirror 9: 0x7035cac6 (stale) CRC-32 checksum value for chunk [0, 0x31a69): Mirror 1: 0xe9c4bbd1 Mirror 10: 0xe9c4bbd1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31a69: skipped 000557 1787866129.452919 write 0x01a7d2 thru 0x0205aa (0x5dd9 bytes) 000558 1787866129.625692 trunc from 0x031a69 to 0x02d34e (0x471a bytes) 000564 1787866129.661352 read 0x01910f thru 0x02400c (0xaefe bytes) 000566 1787866129.683032 read 0x02401a thru 0x02d15d (0x9144 bytes) 000567 1787866129.706902 read 0x013d9c thru 0x01edff (0xb064 bytes) 000568 1787866129.710643 write 0x021ff1 thru 0x02934b (0x735b bytes) 000569 1787866129.718697 read 0x0265bb thru 0x02a244 (0x3c8a bytes) 000570 1787866129.719517 mapwrite 0x00dd25 thru 0x016049 (0x8325 bytes) 000571 1787866129.829858 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2d34f): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d34f): Mirror 4: 0xd15ebf92 (stale) Mirror 5: 0xd15ebf92 (stale) Mirror 7: 0xd15ebf92 (stale) Mirror 8: 0xd15ebf92 (stale) Mirror 9: 0xd15ebf92 (stale) Mirror 10: 0x1abc14da (stale) CRC-32 checksum value for chunk [0, 0x2d34f): Mirror 1: 0x4330153e Mirror 11: 0x4330153e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d34f: skipped 000572 1787866131.995056 trunc from 0x02d34f to 0x026415 (0x6f39 bytes) 000575 1787866132.197303 mapread 0x009d91 thru 0x00d69f (0x390f bytes) 000576 1787866132.217576 read 0x02231d thru 0x026415 (0x40f9 bytes) 000578 1787866132.227919 mapread 0x0220db thru 0x026415 (0x433b bytes) 000580 1787866132.229641 write 0x009876 thru 0x00c1fc (0x2987 bytes) 000582 1787866132.233931 read 0x00b03f thru 0x00f970 (0x4932 bytes) 000583 1787866132.235095 write 0x02ed5e thru 0x03842f (0x96d2 bytes) 000584 1787866132.244637 MIRROR_RESYNC 8 mirrors 000585 1787866136.067382 mapread 0x0375a8 thru 0x03842f (0xe88 bytes) 000586 1787866136.120561 MIRROR_RESYNC 8 mirrors 000587 1787866136.956829 MIRROR_EXTEND to 9 mirrors 000588 1787866138.584546 trunc from 0x038430 to 0x0130ec (0x25343 bytes) 000589 1787866138.730523 read 0x00abd3 thru 0x0130ec (0x851a bytes) 000591 1787866138.751789 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x130ed): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x130ed): Mirror 4: 0xe020fc43 (stale) Mirror 5: 0xe020fc43 (stale) Mirror 7: 0xe020fc43 (stale) Mirror 8: 0xe020fc43 (stale) Mirror 9: 0xe020fc43 (stale) Mirror 10: 0xe020fc43 (stale) Mirror 11: 0xe020fc43 (stale) Mirror 12: 0xe020fc43 (stale) CRC-32 checksum value for chunk [0, 0x130ed): Mirror 1: 0xe020fc43 Mirror 13: 0xe020fc43 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x130ed: skipped 000592 1787866140.121834 read 0x0028c7 thru 0x002f97 (0x6d1 bytes) 000598 1787866140.130158 trunc from 0x0130ed to 0x0333f9 (0x2030d bytes) 000601 1787866140.226991 mapread 0x019470 thru 0x01f93f (0x64d0 bytes) 000603 1787866140.249056 trunc from 0x0333fa to 0x01ba93 (0x17966 bytes) 000605 1787866140.282842 trunc from 0x01ba94 to 0x016738 (0x535b bytes) 000609 1787866140.299306 read 0x00eb00 thru 0x014316 (0x5817 bytes) 000610 1787866140.309544 MIRROR_RESYNC 10 mirrors 000611 1787866144.261493 write 0x037dbc thru 0x03ffff (0x8244 bytes) 000612 1787866144.340573 MIRROR_RESYNC 10 mirrors 000613 1787866147.527393 trunc from 0x040000 to 0x003f75 (0x3c08a bytes) 000614 1787866147.647367 MIRROR_RESYNC 10 mirrors 000616 1787866149.235468 trunc from 0x003f76 to 0x0261f7 (0x22282 bytes) 000617 1787866149.333452 mapread 0x01412e thru 0x01f10c (0xafdf bytes) 000620 1787866149.364036 write 0x0149fe thru 0x021b99 (0xd19c bytes) 000622 1787866149.366986 write 0x03b43c thru 0x03ffff (0x4bc4 bytes) 000625 1787866149.370709 write 0x03e741 thru 0x03ffff (0x18bf bytes) 000626 1787866149.372462 mapread 0x01766c thru 0x02349f (0xbe34 bytes) 000628 1787866149.374766 trunc from 0x040000 to 0x01baa4 (0x2455b bytes) 000630 1787866149.399912 trunc from 0x01baa5 to 0x00e8dd (0xd1c7 bytes) 000631 1787866149.424112 mapwrite 0x035069 thru 0x03ffff (0xaf97 bytes) 000632 1787866149.533087 trunc from 0x040000 to 0x037ec2 (0x813d bytes) 000634 1787866149.557116 write 0x00dd30 thru 0x00f3d5 (0x16a6 bytes) 000636 1787866149.575848 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37ec3): Mirror 4: 0xcf61ee68 (stale) Mirror 5: 0xcf61ee68 (stale) Mirror 7: 0xcf61ee68 (stale) Mirror 8: 0xcf61ee68 (stale) Mirror 9: 0xcf61ee68 (stale) Mirror 10: 0xcf61ee68 (stale) Mirror 12: 0xcf61ee68 (stale) Mirror 13: 0xcf61ee68 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37ec3): Mirror 4: 0xcf61ee68 (stale) Mirror 5: 0xcf61ee68 (stale) Mirror 7: 0xcf61ee68 (stale) Mirror 8: 0xcf61ee68 (stale) Mirror 9: 0xcf61ee68 (stale) Mirror 10: 0xcf61ee68 (stale) Mirror 12: 0xcf61ee68 (stale) Mirror 13: 0xcf61ee68 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37ec3: skipped 000637 1787866150.043785 mapwrite 0x005dbd thru 0x011ea2 (0xc0e6 bytes) 000639 1787866150.168584 mapwrite 0x01320f thru 0x017b89 (0x497b bytes) 000640 1787866150.234321 trunc from 0x037ec3 to 0x030dbb (0x7107 bytes) 000642 1787866150.268315 write 0x029235 thru 0x031f9b (0x8d67 bytes) 000644 1787866150.284247 mapwrite 0x024ac6 thru 0x0302c1 (0xb7fc bytes) 000645 1787866150.416338 write 0x03406a thru 0x03ffff (0xbf96 bytes) 000646 1787866150.421231 write 0x01d8df thru 0x02ad9b (0xd4bd bytes) 000648 1787866150.429737 read 0x03277e thru 0x03b2db (0x8b5e bytes) 000650 1787866150.455011 write 0x015c91 thru 0x025992 (0xfd02 bytes) 000651 1787866150.468499 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe20eea22 (stale) Mirror 5: 0xe20eea22 (stale) Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) Mirror 13: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb5def073 Mirror 14: 0xb5def073 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000653 1787866152.151911 mapwrite 0x020fdd thru 0x0278ac (0x68d0 bytes) 000654 1787866152.345238 MIRROR_RESYNC 10 mirrors 000656 1787866156.708718 mapwrite 0x00f052 thru 0x0154c0 (0x646f bytes) 000658 1787866156.912824 mapwrite 0x00c206 thru 0x015661 (0x945c bytes) 000659 1787866156.977887 read 0x00e41b thru 0x0119f3 (0x35d9 bytes) 000662 1787866156.985034 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x18e61753 (stale) Mirror 5: 0x18e61753 (stale) Mirror 7: 0x18e61753 (stale) Mirror 8: 0x18e61753 (stale) Mirror 10: 0x18e61753 (stale) Mirror 12: 0x18e61753 (stale) Mirror 13: 0x18e61753 (stale) Mirror 14: 0x18e61753 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x18e61753 (stale) Mirror 5: 0x18e61753 (stale) Mirror 7: 0x18e61753 (stale) Mirror 8: 0x18e61753 (stale) Mirror 10: 0x18e61753 (stale) Mirror 12: 0x18e61753 (stale) Mirror 13: 0x18e61753 (stale) Mirror 14: 0x18e61753 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000663 1787866157.499371 mapwrite 0x035bfc thru 0x03ab1b (0x4f20 bytes) 000667 1787866157.643282 mapread 0x03b287 thru 0x03ffff (0x4d79 bytes) 000670 1787866157.667996 MIRROR_RESYNC 9 mirrors 000671 1787866161.163127 mapwrite 0x03de3f thru 0x03ffff (0x21c1 bytes) 000672 1787866161.378832 read 0x034f7c thru 0x03ffff (0xb084 bytes) 000674 1787866161.395644 write 0x01aeea thru 0x01d0e7 (0x21fe bytes) 000675 1787866161.411636 mapwrite 0x002228 thru 0x00a541 (0x831a bytes) 000676 1787866161.483930 mapwrite 0x001dab thru 0x00fbbc (0xde12 bytes) 000677 1787866161.534203 mapwrite 0x006cc4 thru 0x00eb6f (0x7eac bytes) 000678 1787866161.579854 mapwrite 0x008de7 thru 0x00bfad (0x31c7 bytes) 000679 1787866161.623016 mapread 0x022bb3 thru 0x0257d4 (0x2c22 bytes) 000680 1787866161.633036 write 0x0324c2 thru 0x03c315 (0x9e54 bytes) 000682 1787866161.641126 trunc from 0x040000 to 0x02d134 (0x12ecb bytes) 000684 1787866161.675794 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2d135): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d135): Mirror 4: 0x7cc00a7f (stale) Mirror 5: 0x7cc00a7f (stale) Mirror 7: 0x7cc00a7f (stale) Mirror 8: 0x7cc00a7f (stale) Mirror 10: 0x7cc00a7f (stale) Mirror 12: 0x7cc00a7f (stale) Mirror 13: 0x7cc00a7f (stale) Mirror 14: 0x7cc00a7f (stale) CRC-32 checksum value for chunk [0, 0x2d135): Mirror 1: 0x1bf6c910 Mirror 15: 0x1bf6c910 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d135: skipped 000686 1787866162.791001 mapwrite 0x032b32 thru 0x033182 (0x651 bytes) 000692 1787866162.930363 write 0x02ed79 thru 0x02f503 (0x78b bytes) 000693 1787866162.940865 write 0x0270af thru 0x0357bb (0xe70d bytes) 000694 1787866162.951352 MIRROR_RESYNC 10 mirrors 000695 1787866164.671338 read 0x034f84 thru 0x0357bb (0x838 bytes) 000696 1787866164.678129 mapwrite 0x032860 thru 0x03ffff (0xd7a0 bytes) 000697 1787866164.923141 mapread 0x020dfc thru 0x029812 (0x8a17 bytes) 000698 1787866164.940992 write 0x03ed9a thru 0x03ffff (0x1266 bytes) 000699 1787866164.943312 read 0x00f671 thru 0x011412 (0x1da2 bytes) 000700 1787866164.953449 read 0x030288 thru 0x03d338 (0xd0b1 bytes) 000701 1787866164.958305 MIRROR_RESYNC 10 mirrors 000702 1787866166.804686 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) 000703 1787866167.604246 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) 000704 1787866168.131046 mapwrite 0x002007 thru 0x0091a3 (0x719d bytes) 000706 1787866168.314310 read 0x01bc53 thru 0x02899a (0xcd48 bytes) 000707 1787866168.328591 MIRROR_RESYNC 8 mirrors 000708 1787866170.051155 mapwrite 0x001fb6 thru 0x0082b3 (0x62fe bytes) 000709 1787866170.271726 write 0x012e94 thru 0x022d3d (0xfeaa bytes) 000712 1787866170.294715 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x17e410f3 (stale) Mirror 7: 0x17e410f3 (stale) Mirror 10: 0x17e410f3 (stale) Mirror 12: 0x17e410f3 (stale) Mirror 13: 0x17e410f3 (stale) Mirror 14: 0x17e410f3 (stale) Mirror 15: 0x17e410f3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x23e5358f Mirror 16: 0x23e5358f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000714 1787866171.575815 MIRROR_RESYNC 9 mirrors 000715 1787866173.814765 read 0x0250b5 thru 0x034c06 (0xfb52 bytes) 000716 1787866173.840038 MIRROR_RESYNC 9 mirrors 000717 1787866174.600562 read 0x008427 thru 0x0166d8 (0xe2b2 bytes) 000718 1787866174.614536 mapread 0x01e6c2 thru 0x026732 (0x8071 bytes) 000722 1787866174.655532 read 0x01753c thru 0x02489e (0xd363 bytes) 000724 1787866174.676646 mapwrite 0x0333a8 thru 0x036b03 (0x375c bytes) 000726 1787866174.910991 trunc from 0x040000 to 0x030b5f (0xf4a0 bytes) 000727 1787866174.947528 mapwrite 0x01e10d thru 0x02d44c (0xf340 bytes) 000728 1787866175.079829 write 0x00b434 thru 0x00b689 (0x256 bytes) 000734 1787866175.091932 read 0x00fef8 thru 0x01e0c4 (0xe1cd bytes) 000735 1787866175.102662 read 0x008a9b thru 0x01598a (0xcef0 bytes) 000736 1787866175.108411 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x30b60): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30b60): Mirror 5: 0x36d83a44 (stale) Mirror 7: 0x36d83a44 (stale) Mirror 10: 0x36d83a44 (stale) Mirror 12: 0x36d83a44 (stale) Mirror 13: 0x36d83a44 (stale) Mirror 14: 0x36d83a44 (stale) Mirror 15: 0x36d83a44 (stale) Mirror 16: 0x36d83a44 (stale) CRC-32 checksum value for chunk [0, 0x30b60): Mirror 1: 0x2010fb7c Mirror 17: 0x2010fb7c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30b60: skipped 000737 1787866176.155933 trunc from 0x030b60 to 0x039194 (0x8635 bytes) 000741 1787866176.328374 read 0x026eb9 thru 0x036cea (0xfe32 bytes) 000742 1787866176.348151 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x39195): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39195): Mirror 5: 0xc2645f22 (stale) Mirror 7: 0xc2645f22 (stale) Mirror 10: 0xc2645f22 (stale) Mirror 12: 0xc2645f22 (stale) Mirror 13: 0xc2645f22 (stale) Mirror 14: 0xc2645f22 (stale) Mirror 15: 0xc2645f22 (stale) Mirror 16: 0xc2645f22 (stale) Mirror 17: 0x5e607ad8 (stale) CRC-32 checksum value for chunk [0, 0x39195): Mirror 1: 0x5e607ad8 Mirror 18: 0x5e607ad8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39195: skipped 000747 1787866177.816882 write 0x00781f thru 0x00e648 (0x6e2a bytes) 000748 1787866177.989833 mapwrite 0x01926f thru 0x022057 (0x8de9 bytes) 000750 1787866178.078963 trunc from 0x039195 to 0x036cd1 (0x24c3 bytes) 000751 1787866178.124221 read 0x006afa thru 0x00b1ce (0x46d5 bytes) 000752 1787866178.133727 read 0x021fea thru 0x024a38 (0x2a4f bytes) 000753 1787866178.147058 mapread 0x02b8c0 thru 0x034835 (0x8f76 bytes) 000755 1787866178.149283 mapwrite 0x02f899 thru 0x03c583 (0xcceb bytes) 000757 1787866178.219081 write 0x01fba5 thru 0x027d65 (0x81c1 bytes) 000758 1787866178.220828 read 0x0070b8 thru 0x01328c (0xc1d5 bytes) 000761 1787866178.239832 MIRROR_RESYNC 11 mirrors 000762 1787866180.311913 MIRROR_RESYNC 11 mirrors 000763 1787866180.984634 mapread 0x036273 thru 0x03c583 (0x6311 bytes) 000764 1787866181.016700 mapread 0x006f76 thru 0x010da6 (0x9e31 bytes) 000765 1787866181.038656 MIRROR_RESYNC 11 mirrors 000766 1787866181.884136 mapwrite 0x00c9ef thru 0x011b34 (0x5146 bytes) 000767 1787866182.045039 read 0x014056 thru 0x01860d (0x45b8 bytes) 000769 1787866182.054031 read 0x03ad08 thru 0x03c583 (0x187c bytes) 000770 1787866182.065791 mapread 0x02c833 thru 0x030953 (0x4121 bytes) 000771 1787866182.067048 mapwrite 0x03a722 thru 0x03ffff (0x58de bytes) 000775 1787866182.137781 write 0x0097cc thru 0x00f45e (0x5c93 bytes) 000776 1787866182.139434 trunc from 0x040000 to 0x0345f3 (0xba0c bytes) 000777 1787866182.164041 trunc from 0x0345f4 to 0x026ee8 (0xd70b bytes) 000778 1787866182.191224 write 0x027850 thru 0x02cef0 (0x56a1 bytes) 000779 1787866182.194720 trunc from 0x02cef1 to 0x001122 (0x2bdce bytes) 000781 1787866182.221293 write 0x023359 thru 0x02a2c0 (0x6f68 bytes) 000785 1787866182.226311 trunc from 0x02a2c1 to 0x025b79 (0x4747 bytes) 000786 1787866182.244467 mapwrite 0x02866a thru 0x036cd2 (0xe669 bytes) 000787 1787866182.422984 mapread 0x01f8e3 thru 0x02b0a7 (0xb7c5 bytes) 000788 1787866182.460079 write 0x03d5ea thru 0x03ffff (0x2a16 bytes) 000789 1787866182.462085 read 0x007ee4 thru 0x017a70 (0xfb8d bytes) 000795 1787866182.485018 write 0x035a7a thru 0x037f0c (0x2493 bytes) 000796 1787866182.491370 mapread 0x02926b thru 0x036a04 (0xd79a bytes) 000801 1787866182.504050 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x12cea139 (stale) Mirror 7: 0x12cea139 (stale) Mirror 10: 0x12cea139 (stale) Mirror 12: 0x12cea139 (stale) Mirror 13: 0x12cea139 (stale) Mirror 14: 0x12cea139 (stale) Mirror 15: 0x12cea139 (stale) Mirror 16: 0x12cea139 (stale) Mirror 17: 0x12cea139 (stale) Mirror 18: 0x12cea139 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x615b0870 Mirror 19: 0x615b0870 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000804 1787866184.501399 write 0x01b365 thru 0x02053a (0x51d6 bytes) 000805 1787866184.611757 write 0x00a648 thru 0x017341 (0xccfa bytes) 000806 1787866184.624065 mapwrite 0x0317b1 thru 0x033870 (0x20c0 bytes) 000807 1787866184.707776 write 0x03230f thru 0x03e531 (0xc223 bytes) 000808 1787866184.714657 trunc from 0x040000 to 0x03c93b (0x36c4 bytes) 000810 1787866184.734799 mapread 0x02ae1b thru 0x02b199 (0x37f bytes) 000811 1787866184.751318 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c93c): Mirror 5: 0x6dfb48eb (stale) Mirror 7: 0x6dfb48eb (stale) Mirror 10: 0x6dfb48eb (stale) Mirror 12: 0x6dfb48eb (stale) Mirror 14: 0x6dfb48eb (stale) Mirror 15: 0x6dfb48eb (stale) Mirror 16: 0x6dfb48eb (stale) Mirror 17: 0x6dfb48eb (stale) Mirror 18: 0x6dfb48eb (stale) Mirror 19: 0xa9dbfb40 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c93c): Mirror 5: 0x6dfb48eb (stale) Mirror 7: 0x6dfb48eb (stale) Mirror 10: 0x6dfb48eb (stale) Mirror 12: 0x6dfb48eb (stale) Mirror 14: 0x6dfb48eb (stale) Mirror 15: 0x6dfb48eb (stale) Mirror 16: 0x6dfb48eb (stale) Mirror 17: 0x6dfb48eb (stale) Mirror 18: 0x6dfb48eb (stale) Mirror 19: 0xa9dbfb40 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c93c: skipped 000813 1787866185.455883 mapwrite 0x018d79 thru 0x019ca8 (0xf30 bytes) 000814 1787866185.542629 write 0x00d6fb thru 0x012671 (0x4f77 bytes) 000815 1787866185.562813 read 0x001d51 thru 0x006e3e (0x50ee bytes) 000817 1787866185.577711 write 0x00a061 thru 0x0162d8 (0xc278 bytes) 000820 1787866185.615753 trunc from 0x03c93c to 0x02330b (0x19630 bytes) truncating to largest ever: 0x3f614 000821 1787866185.674218 trunc from 0x02330c to 0x03f613 (0x1c308 bytes) 000822 1787866185.707987 mapwrite 0x03787c thru 0x03ffff (0x8784 bytes) 000824 1787866185.822015 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x12cea139 (stale) Mirror 7: 0x12cea139 (stale) Mirror 10: 0x12cea139 (stale) Mirror 12: 0x12cea139 (stale) Mirror 14: 0x12cea139 (stale) Mirror 15: 0x12cea139 (stale) Mirror 16: 0x12cea139 (stale) Mirror 18: 0x12cea139 (stale) Mirror 19: 0x615b0870 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x12cea139 (stale) Mirror 7: 0x12cea139 (stale) Mirror 10: 0x12cea139 (stale) Mirror 12: 0x12cea139 (stale) Mirror 14: 0x12cea139 (stale) Mirror 15: 0x12cea139 (stale) Mirror 16: 0x12cea139 (stale) Mirror 18: 0x12cea139 (stale) Mirror 19: 0x615b0870 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000826 1787866186.435418 mapread 0x03be36 thru 0x03ffff (0x41ca bytes) 000829 1787866186.465525 mapwrite 0x012fb0 thru 0x02265a (0xf6ab bytes) 000830 1787866186.561623 write 0x029668 thru 0x02af93 (0x192c bytes) 000831 1787866186.573803 mapwrite 0x00c41c thru 0x017b92 (0xb777 bytes) 000832 1787866186.652645 read 0x032190 thru 0x03b542 (0x93b3 bytes) 000834 1787866186.661551 trunc from 0x040000 to 0x01bc09 (0x243f6 bytes) 000835 1787866186.691824 mapwrite 0x033acb thru 0x03eab2 (0xafe8 bytes) 000837 1787866186.784738 mapwrite 0x00c4c9 thru 0x01ae72 (0xe9aa bytes) 000838 1787866186.843001 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3eab3): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eab3): Mirror 5: 0x65169ebf (stale) Mirror 7: 0x65169ebf (stale) Mirror 10: 0x65169ebf (stale) Mirror 12: 0x65169ebf (stale) Mirror 14: 0x65169ebf (stale) Mirror 15: 0x65169ebf (stale) Mirror 16: 0x65169ebf (stale) Mirror 18: 0x65169ebf (stale) Mirror 19: 0x813ac9be (stale) CRC-32 checksum value for chunk [0, 0x3eab3): Mirror 1: 0x817b1af1 Mirror 20: 0x817b1af1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eab3: skipped 000839 1787866188.701378 mapread 0x011978 thru 0x020dbe (0xf447 bytes) 000840 1787866188.761704 trunc from 0x03eab3 to 0x0200f9 (0x1e9b9 bytes) 000841 1787866188.940134 mapread 0x008d35 thru 0x00ce1e (0x40ea bytes) 000843 1787866188.951730 mapread 0x011950 thru 0x01a115 (0x87c6 bytes) 000846 1787866188.967866 read 0x00120e thru 0x001bb9 (0x9ac bytes) 000851 1787866188.971111 mapwrite 0x008c9b thru 0x00a827 (0x1b8d bytes) 000854 1787866189.030643 mapwrite 0x021c48 thru 0x02b931 (0x9cea bytes) 000855 1787866189.132668 write 0x009188 thru 0x00e05f (0x4ed8 bytes) 000857 1787866189.136535 read 0x01220e thru 0x01c788 (0xa57b bytes) 000858 1787866189.140732 mapread 0x00471d thru 0x012873 (0xe157 bytes) 000859 1787866189.144749 read 0x028c00 thru 0x02b931 (0x2d32 bytes) 000860 1787866189.151020 write 0x00d525 thru 0x01acfe (0xd7da bytes) 000861 1787866189.158117 trunc from 0x02b932 to 0x01bb88 (0xfda9 bytes) 000862 1787866189.205676 trunc from 0x01bb89 to 0x016af1 (0x5097 bytes) 000863 1787866189.239550 write 0x01e8a4 thru 0x0214e8 (0x2c45 bytes) 000865 1787866189.249622 write 0x00b9ad thru 0x014e88 (0x94dc bytes) 000869 1787866189.252357 write 0x01f1b8 thru 0x02cf75 (0xddbe bytes) 000871 1787866189.269723 write 0x030512 thru 0x033437 (0x2f26 bytes) 000872 1787866189.272801 write 0x01ff5a thru 0x02d921 (0xd9c8 bytes) 000876 1787866189.308377 mapwrite 0x036744 thru 0x037d94 (0x1651 bytes) 000877 1787866189.546567 mapwrite 0x02dfda thru 0x03699b (0x89c2 bytes) 000878 1787866189.657740 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37d95): Mirror 5: 0x21bfad43 (stale) Mirror 7: 0x21bfad43 (stale) Mirror 10: 0x21bfad43 (stale) Mirror 12: 0x21bfad43 (stale) Mirror 14: 0x21bfad43 (stale) Mirror 15: 0x21bfad43 (stale) Mirror 18: 0x21bfad43 (stale) Mirror 19: 0x83f33aa9 (stale) Mirror 20: 0x989138c1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37d95): Mirror 5: 0x21bfad43 (stale) Mirror 7: 0x21bfad43 (stale) Mirror 10: 0x21bfad43 (stale) Mirror 12: 0x21bfad43 (stale) Mirror 14: 0x21bfad43 (stale) Mirror 15: 0x21bfad43 (stale) Mirror 18: 0x21bfad43 (stale) Mirror 19: 0x83f33aa9 (stale) Mirror 20: 0x989138c1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37d95: skipped 000879 1787866190.461707 mapread 0x0037ef thru 0x00baee (0x8300 bytes) 000881 1787866190.491525 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37d95): Mirror 5: 0x21bfad43 (stale) Mirror 10: 0x21bfad43 (stale) Mirror 12: 0x21bfad43 (stale) Mirror 14: 0x21bfad43 (stale) Mirror 15: 0x21bfad43 (stale) Mirror 18: 0x21bfad43 (stale) Mirror 19: 0x83f33aa9 (stale) Mirror 20: 0x989138c1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37d95): Mirror 5: 0x21bfad43 (stale) Mirror 10: 0x21bfad43 (stale) Mirror 12: 0x21bfad43 (stale) Mirror 14: 0x21bfad43 (stale) Mirror 15: 0x21bfad43 (stale) Mirror 18: 0x21bfad43 (stale) Mirror 19: 0x83f33aa9 (stale) Mirror 20: 0x989138c1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37d95: skipped 000884 1787866191.371850 trunc from 0x037d95 to 0x0310ab (0x6ce9 bytes) 000885 1787866191.396832 mapread 0x02245f thru 0x026ad7 (0x4679 bytes) 000886 1787866191.420533 mapread 0x0283ac thru 0x02854b (0x1a0 bytes) 000888 1787866191.422985 mapread 0x030383 thru 0x0310ab (0xd29 bytes) 000890 1787866191.436041 mapread 0x0155d7 thru 0x02066e (0xb098 bytes) 000891 1787866191.453509 write 0x019426 thru 0x01b7e6 (0x23c1 bytes) 000892 1787866191.455378 write 0x02c1ab thru 0x03192b (0x5781 bytes) 000893 1787866191.458494 mapread 0x02338d thru 0x03192b (0xe59f bytes) 000894 1787866191.460669 mapwrite 0x00d280 thru 0x01ab6b (0xd8ec bytes) 000896 1787866191.570795 MIRROR_RESYNC 9 mirrors 000897 1787866194.731969 mapwrite 0x02d37d thru 0x039a35 (0xc6b9 bytes) 000901 1787866195.029297 read 0x029d2c thru 0x031df1 (0x80c6 bytes) 000902 1787866195.031624 mapwrite 0x0235a3 thru 0x02dea1 (0xa8ff bytes) 000903 1787866195.091610 trunc from 0x039a36 to 0x018870 (0x211c5 bytes) 000904 1787866195.110285 mapwrite 0x020fd5 thru 0x024d24 (0x3d50 bytes) 000905 1787866195.179057 trunc from 0x024d25 to 0x0049c0 (0x20364 bytes) 000908 1787866195.202266 mapwrite 0x00da7d thru 0x00f366 (0x18ea bytes) 000909 1787866195.259588 read 0x0096f9 thru 0x00f366 (0x5c6e bytes) 000911 1787866195.262283 write 0x00439f thru 0x00c1e7 (0x7e49 bytes) 000912 1787866195.272752 mapwrite 0x015c2e thru 0x01faf8 (0x9ecb bytes) 000913 1787866195.371989 read 0x000952 thru 0x00e413 (0xdac2 bytes) 000914 1787866195.379696 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1faf9): Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1faf9): Mirror 5: 0x28921c6b (stale) Mirror 10: 0x28921c6b (stale) Mirror 12: 0x28921c6b (stale) Mirror 14: 0x28921c6b (stale) Mirror 15: 0x28921c6b (stale) Mirror 18: 0x28921c6b (stale) Mirror 19: 0x28921c6b (stale) Mirror 20: 0x28921c6b (stale) CRC-32 checksum value for chunk [0, 0x1faf9): Mirror 1: 0xabc4e96c Mirror 21: 0xabc4e96c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1faf9: skipped 000915 1787866196.921898 trunc from 0x01faf9 to 0x01b29c (0x485c bytes) 000916 1787866197.064980 trunc from 0x01b29d to 0x02252c (0x7290 bytes) 000918 1787866197.097714 mapwrite 0x033f5b thru 0x03ffff (0xc0a5 bytes) 000919 1787866197.310319 mapwrite 0x039b58 thru 0x03ffff (0x64a8 bytes) 000920 1787866197.397855 write 0x03ae9e thru 0x03cda3 (0x1f06 bytes) 000921 1787866197.413788 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x219bf1aa (stale) Mirror 10: 0x219bf1aa (stale) Mirror 12: 0x219bf1aa (stale) Mirror 14: 0x219bf1aa (stale) Mirror 15: 0x219bf1aa (stale) Mirror 18: 0x219bf1aa (stale) Mirror 19: 0x219bf1aa (stale) Mirror 20: 0x219bf1aa (stale) Mirror 21: 0xe3899c0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x773a87ef Mirror 22: 0x773a87ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000922 1787866199.132988 trunc from 0x040000 to 0x030b24 (0xf4db bytes) 000923 1787866199.234891 trunc from 0x030b25 to 0x030156 (0x9ce bytes) 000924 1787866199.259078 write 0x022477 thru 0x0232a8 (0xe32 bytes) 000926 1787866199.271511 write 0x0187d0 thru 0x0266c3 (0xdef4 bytes) 000928 1787866199.290908 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30157): Mirror 5: 0xe14a81a9 (stale) Mirror 10: 0xe14a81a9 (stale) Mirror 14: 0xe14a81a9 (stale) Mirror 15: 0xe14a81a9 (stale) Mirror 18: 0xe14a81a9 (stale) Mirror 19: 0xe14a81a9 (stale) Mirror 20: 0xe14a81a9 (stale) Mirror 21: 0xe23319b0 (stale) Mirror 22: 0xe6669865 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30157): Mirror 5: 0xe14a81a9 (stale) Mirror 10: 0xe14a81a9 (stale) Mirror 14: 0xe14a81a9 (stale) Mirror 15: 0xe14a81a9 (stale) Mirror 18: 0xe14a81a9 (stale) Mirror 19: 0xe14a81a9 (stale) Mirror 20: 0xe14a81a9 (stale) Mirror 21: 0xe23319b0 (stale) Mirror 22: 0xe6669865 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30157: skipped 000929 1787866200.249467 mapwrite 0x022e77 thru 0x027492 (0x461c bytes) 000931 1787866200.372274 read 0x005129 thru 0x00fa36 (0xa90e bytes) 000932 1787866200.386516 read 0x012b0e thru 0x01bac7 (0x8fba bytes) 000933 1787866200.415634 MIRROR_RESYNC 10 mirrors 000935 1787866204.243484 trunc from 0x030157 to 0x014fbd (0x1b199 bytes) 000936 1787866204.366834 mapwrite 0x0115d2 thru 0x01f127 (0xdb56 bytes) 000938 1787866204.482931 trunc from 0x01f128 to 0x005a4c (0x196db bytes) 000940 1787866204.502574 write 0x03315f thru 0x03ffff (0xcea1 bytes) 000942 1787866204.506127 trunc from 0x040000 to 0x02d5b2 (0x12a4d bytes) 000946 1787866204.532472 mapwrite 0x0052e1 thru 0x00ff90 (0xacb0 bytes) 000947 1787866204.590762 MIRROR_RESYNC 10 mirrors 000948 1787866208.141735 read 0x005ad1 thru 0x007a55 (0x1f85 bytes) 000949 1787866208.158361 MIRROR_RESYNC 10 mirrors 000950 1787866209.271249 MIRROR_RESYNC 10 mirrors 000951 1787866210.220796 read 0x0218ba thru 0x02a57c (0x8cc3 bytes) 000953 1787866210.232199 mapwrite 0x00351f thru 0x0102da (0xcdbc bytes) 000955 1787866210.513205 mapwrite 0x0223e8 thru 0x02f50b (0xd124 bytes) 000957 1787866210.663068 mapwrite 0x00c22d thru 0x01121d (0x4ff1 bytes) 000958 1787866210.777697 trunc from 0x02f50c to 0x00e394 (0x21177 bytes) 000959 1787866210.849197 write 0x00b1d8 thru 0x012180 (0x6fa9 bytes) 000961 1787866210.857579 mapwrite 0x020859 thru 0x0214f5 (0xc9d bytes) 000962 1787866211.089577 write 0x00fcef thru 0x01f067 (0xf379 bytes) 000963 1787866211.106574 trunc from 0x0214f6 to 0x00c99d (0x14b58 bytes) 000964 1787866211.153288 trunc from 0x00c99e to 0x000f94 (0xba09 bytes) 000965 1787866211.200894 trunc from 0x000f95 to 0x020637 (0x1f6a3 bytes) 000967 1787866211.243411 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x180:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20638): Mirror 5: 0x6f86b1ca (stale) Mirror 10: 0x6f86b1ca (stale) Mirror 14: 0x6f86b1ca (stale) Mirror 15: 0x6f86b1ca (stale) Mirror 18: 0x6f86b1ca (stale) Mirror 19: 0x6f86b1ca (stale) Mirror 21: 0x6f86b1ca (stale) Mirror 22: 0x6f86b1ca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20638): Mirror 5: 0x6f86b1ca (stale) Mirror 10: 0x6f86b1ca (stale) Mirror 14: 0x6f86b1ca (stale) Mirror 15: 0x6f86b1ca (stale) Mirror 18: 0x6f86b1ca (stale) Mirror 19: 0x6f86b1ca (stale) Mirror 21: 0x6f86b1ca (stale) Mirror 22: 0x6f86b1ca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20638: skipped 000972 1787866212.137746 MIRROR_RESYNC 9 mirrors 000974 1787866214.407383 mapwrite 0x033473 thru 0x035d63 (0x28f1 bytes) 000975 1787866214.606626 mapread 0x01d420 thru 0x028653 (0xb234 bytes) 000976 1787866214.635162 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x35d64): Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35d64): Mirror 5: 0xf00420bf (stale) Mirror 10: 0xf00420bf (stale) Mirror 14: 0xf00420bf (stale) Mirror 15: 0xf00420bf (stale) Mirror 18: 0xf00420bf (stale) Mirror 19: 0xf00420bf (stale) Mirror 21: 0xf00420bf (stale) Mirror 22: 0xf00420bf (stale) CRC-32 checksum value for chunk [0, 0x35d64): Mirror 1: 0x136bf346 Mirror 23: 0x136bf346 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35d64: skipped 000977 1787866215.902715 read 0x025689 thru 0x02e109 (0x8a81 bytes) 000979 1787866215.915403 mapwrite 0x034968 thru 0x03ffff (0xb698 bytes) 000980 1787866216.139112 mapread 0x008577 thru 0x012323 (0x9dad bytes) 000981 1787866216.162154 mapread 0x020a84 thru 0x02b99c (0xaf19 bytes) 000982 1787866216.195399 read 0x023495 thru 0x031785 (0xe2f1 bytes) 000983 1787866216.203488 MIRROR_RESYNC 10 mirrors 000986 1787866219.195499 MIRROR_RESYNC 10 mirrors 000991 1787866220.063843 trunc from 0x040000 to 0x028283 (0x17d7c bytes) 000992 1787866220.220499 mapwrite 0x017658 thru 0x01af8f (0x3938 bytes) 000993 1787866220.374009 mapread 0x00699f thru 0x00c96a (0x5fcc bytes) 000995 1787866220.413105 MIRROR_RESYNC 10 mirrors 000996 1787866224.152801 trunc from 0x028284 to 0x02df68 (0x5ce5 bytes) 000998 1787866224.254240 read 0x02a86c thru 0x02b44e (0xbe3 bytes) 000999 1787866224.260773 trunc from 0x02df69 to 0x03ec32 (0x10cca bytes) 001000 1787866224.286064 mapwrite 0x01a059 thru 0x01f274 (0x521c bytes) All operations completed A-OK!