== sanity-flr test 70a: flr mode fsx test ================ 20:14:13 (1770686053) Seed set to 6055 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1ae63 000004 1770686055.638139 trunc from 00000000 to 0x01ae62 (0x1ae63 bytes) 000007 1770686055.665749 write 0x037e37 thru 0x03ffff (0x81c9 bytes) 000011 1770686055.676458 mapwrite 0x018ae4 thru 0x024794 (0xbcb1 bytes) 000013 1770686055.833666 read 0x005cc4 thru 0x00c34b (0x6688 bytes) 000016 1770686055.868444 mapwrite 0x0392c3 thru 0x0398f9 (0x637 bytes) 000018 1770686055.951802 mapwrite 0x0159bc thru 0x017010 (0x1655 bytes) 000022 1770686055.995321 write 0x026d51 thru 0x035b00 (0xedb0 bytes) 000023 1770686056.000951 mapread 0x03175a thru 0x033be3 (0x248a bytes) 000029 1770686056.004673 write 0x012ad3 thru 0x018383 (0x58b1 bytes) 000034 1770686056.019463 MIRROR_EXTEND to 2 mirrors 000035 1770686056.808377 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) 000037 1770686057.010624 mapread 0x030ae5 thru 0x0369c9 (0x5ee5 bytes) 000038 1770686057.035007 write 0x0142a2 thru 0x01fefb (0xbc5a bytes) 000039 1770686057.066889 mapwrite 0x0167a9 thru 0x0221fe (0xba56 bytes) 000040 1770686057.131377 read 0x017ea1 thru 0x01b58c (0x36ec bytes) 000041 1770686057.132090 write 0x03c18e thru 0x03ffff (0x3e72 bytes) 000043 1770686057.142061 mapwrite 0x035c38 thru 0x037b0a (0x1ed3 bytes) 000047 1770686057.199658 read 0x0047a7 thru 0x012aef (0xe349 bytes) truncating to largest ever: 0x1faa5 000048 1770686057.210424 trunc from 0x040000 to 0x01faa4 (0x2055b bytes) 000049 1770686057.258823 MIRROR_EXTEND to 2 mirrors 000050 1770686057.924232 trunc from 0x01faa5 to 0x0055f9 (0x1a4ab bytes) 000052 1770686058.074915 write 0x023768 thru 0x02abf7 (0x7490 bytes) 000053 1770686058.076485 mapwrite 0x0176ed thru 0x0269ad (0xf2c1 bytes) 000055 1770686058.180413 mapread 0x000fd8 thru 0x00bff7 (0xb020 bytes) 000056 1770686058.193075 trunc from 0x02abf8 to 0x000614 (0x2a5e3 bytes) 000058 1770686058.219571 write 0x002973 thru 0x011bfc (0xf28a bytes) 000059 1770686058.223731 trunc from 0x011bfd to 0x01c6e0 (0xaae4 bytes) 000060 1770686058.263831 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1c6e1): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c6e1): Mirror 2: 0x532f31ed (stale) CRC-32 checksum value for chunk [0, 0x1c6e1): Mirror 1: 0x27c445e Mirror 3: 0x27c445e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c6e1: skipped truncating to largest ever: 0x38cca 000061 1770686059.250667 trunc from 0x01c6e1 to 0x038cc9 (0x1c5e9 bytes) 000063 1770686059.401766 trunc from 0x038cca to 0x020caf (0x1801a bytes) 000064 1770686059.438272 MIRROR_RESYNC 3 mirrors 000065 1770686060.354550 read 0x01790a thru 0x01fe13 (0x850a bytes) 000069 1770686060.363075 write 0x030491 thru 0x03eec5 (0xea35 bytes) 000070 1770686060.428029 mapwrite 0x0334c3 thru 0x03ffff (0xcb3d bytes) truncating to largest ever: 0x391b1 000071 1770686060.516441 trunc from 0x040000 to 0x0391b0 (0x6e4f bytes) 000072 1770686060.543172 write 0x000cbe thru 0x00b803 (0xab46 bytes) 000073 1770686060.564560 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x391b1): Mirror 3: 0x638e318f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x391b1): Mirror 3: 0x638e318f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x391b1: skipped 000075 1770686060.899338 MIRROR_RESYNC 2 mirrors 000076 1770686061.576140 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) 000077 1770686061.793799 read 0x017049 thru 0x02662d (0xf5e5 bytes) 000081 1770686061.810673 mapread 0x0316ea thru 0x0322e9 (0xc00 bytes) 000083 1770686061.830570 write 0x03db83 thru 0x03ffff (0x247d bytes) 000085 1770686061.840511 read 0x013825 thru 0x0142c4 (0xaa0 bytes) 000086 1770686061.854275 mapwrite 0x032317 thru 0x037c73 (0x595d bytes) 000089 1770686061.904955 read 0x00263e thru 0x00bee1 (0x98a4 bytes) 000092 1770686061.907007 mapread 0x029d94 thru 0x02fb97 (0x5e04 bytes) 000093 1770686061.908165 mapread 0x03e35c thru 0x03ffff (0x1ca4 bytes) 000094 1770686061.909586 write 0x03a46c thru 0x03ffff (0x5b94 bytes) 000096 1770686061.912147 mapread 0x03a6ea thru 0x03ffff (0x5916 bytes) truncating to largest ever: 0x392ee 000098 1770686061.914467 trunc from 0x040000 to 0x0392ed (0x6d12 bytes) 000100 1770686061.932680 mapread 0x02dd2b thru 0x035eb5 (0x818b bytes) 000102 1770686061.936321 mapread 0x0009f3 thru 0x003090 (0x269e bytes) 000103 1770686061.937580 mapread 0x01319a thru 0x021f09 (0xed70 bytes) 000104 1770686061.939438 read 0x01f05e thru 0x0258dc (0x687f bytes) 000107 1770686061.942534 read 0x0024e1 thru 0x007ac6 (0x55e6 bytes) 000113 1770686061.947010 trunc from 0x0392ee to 0x00a02d (0x2f2c0 bytes) 000115 1770686061.975327 mapwrite 0x0203b9 thru 0x026bc6 (0x680e bytes) 000116 1770686062.060272 write 0x009c8d thru 0x010508 (0x687c bytes) 000119 1770686062.062458 mapwrite 0x0360d1 thru 0x03e92b (0x885b bytes) 000121 1770686062.196830 write 0x010f65 thru 0x01b8e9 (0xa985 bytes) 000122 1770686062.199056 read 0x00f908 thru 0x011fff (0x26f8 bytes) 000123 1770686062.201757 read 0x036c56 thru 0x03e92b (0x7cd6 bytes) 000126 1770686062.204878 trunc from 0x03e92c to 0x0347dd (0xa14e bytes) 000127 1770686062.230320 mapwrite 0x0159fa thru 0x022ca8 (0xd2af bytes) 000128 1770686062.292057 mapwrite 0x03ef1a thru 0x03ffff (0x10e6 bytes) 000132 1770686062.371554 MIRROR_EXTEND to 2 mirrors 000136 1770686062.937431 write 0x032a31 thru 0x03a02e (0x75fe bytes) 000140 1770686063.051561 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) 000141 1770686063.235782 mapwrite 0x001538 thru 0x00fd53 (0xe81c bytes) 000142 1770686063.345395 trunc from 0x040000 to 0x014f5b (0x2b0a4 bytes) 000143 1770686063.403464 trunc from 0x014f5c to 0x023467 (0xe50c bytes) 000144 1770686063.439803 MIRROR_EXTEND to 2 mirrors 000145 1770686064.243790 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) 000146 1770686064.392399 write 0x01de42 thru 0x01ee40 (0xfff bytes) 000147 1770686064.443431 read 0x0202ee thru 0x023467 (0x317a bytes) 000149 1770686064.455507 mapwrite 0x006384 thru 0x00d9cc (0x7649 bytes) 000150 1770686064.540534 read 0x01199d thru 0x020dee (0xf452 bytes) 000153 1770686064.553283 read 0x000689 thru 0x008727 (0x809f bytes) 000155 1770686064.555010 mapwrite 0x0035a7 thru 0x010432 (0xce8c bytes) 000158 1770686064.625633 MIRROR_EXTEND to 2 mirrors 000159 1770686065.653251 read 0x01ba67 thru 0x0201e1 (0x477b bytes) 000161 1770686065.662263 write 0x03224e thru 0x036808 (0x45bb bytes) 000163 1770686065.752453 write 0x02a48d thru 0x02ade0 (0x954 bytes) 000166 1770686065.759421 write 0x00829f thru 0x017c63 (0xf9c5 bytes) 000167 1770686065.774554 trunc from 0x036809 to 0x01e367 (0x184a1 bytes) 000171 1770686065.805567 mapwrite 0x01f82d thru 0x02e487 (0xec5b bytes) 000172 1770686065.929601 trunc from 0x02e488 to 0x024263 (0xa224 bytes) 000173 1770686065.947548 mapread 0x000556 thru 0x00cd1e (0xc7c9 bytes) 000174 1770686065.960493 mapwrite 0x024b52 thru 0x026f3e (0x23ed bytes) 000176 1770686066.036451 mapwrite 0x03ff8b thru 0x03ffff (0x75 bytes) 000177 1770686066.119947 mapwrite 0x0239cf thru 0x02d59a (0x9bcc bytes) 000178 1770686066.182746 MIRROR_RESYNC 2 mirrors 000181 1770686066.747435 mapwrite 0x005e31 thru 0x0134b0 (0xd680 bytes) 000182 1770686066.935698 mapread 0x02816e thru 0x02df36 (0x5dc9 bytes) 000183 1770686066.951227 mapread 0x01db6d thru 0x02c2dd (0xe771 bytes) 000184 1770686066.962000 mapwrite 0x023f4a thru 0x02c1cf (0x8286 bytes) 000185 1770686067.021081 write 0x02a262 thru 0x033316 (0x90b5 bytes) 000186 1770686067.037309 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) 000187 1770686067.205335 mapwrite 0x023b3e thru 0x02ba99 (0x7f5c bytes) 000189 1770686067.333116 write 0x025315 thru 0x02c8ac (0x7598 bytes) 000190 1770686067.335000 mapwrite 0x0095e0 thru 0x00a741 (0x1162 bytes) 000192 1770686067.383742 write 0x021e2c thru 0x026ba8 (0x4d7d bytes) 000197 1770686067.388964 mapwrite 0x03255d thru 0x0346f4 (0x2198 bytes) 000199 1770686067.495416 mapread 0x02c31b thru 0x035ff2 (0x9cd8 bytes) 000200 1770686067.496541 write 0x0082fe thru 0x011dbe (0x9ac1 bytes) 000201 1770686067.506139 mapwrite 0x0172cc thru 0x01daee (0x6823 bytes) 000203 1770686067.651783 read 0x02152d thru 0x02dc50 (0xc724 bytes) 000206 1770686067.653515 write 0x02bfd3 thru 0x02ec9b (0x2cc9 bytes) 000207 1770686067.655816 mapwrite 0x000780 thru 0x0017ac (0x102d bytes) 000208 1770686067.774437 mapwrite 0x0065cd thru 0x008b91 (0x25c5 bytes) 000211 1770686067.943405 mapread 0x00693a thru 0x011041 (0xa708 bytes) 000212 1770686067.946406 read 0x002f1a thru 0x009edb (0x6fc2 bytes) 000213 1770686067.947877 mapread 0x0107fd thru 0x010ae5 (0x2e9 bytes) 000214 1770686067.949875 read 0x033fbc thru 0x034741 (0x786 bytes) 000216 1770686067.951097 read 0x0315b4 thru 0x03c073 (0xaac0 bytes) 000217 1770686067.962696 write 0x028232 thru 0x02d34e (0x511d bytes) 000219 1770686067.964074 mapwrite 0x00596e thru 0x00e981 (0x9014 bytes) 000223 1770686068.026248 mapread 0x0328ee thru 0x034b38 (0x224b bytes) 000224 1770686068.026951 mapread 0x019b9b thru 0x024589 (0xa9ef bytes) 000225 1770686068.027597 trunc from 0x040000 to 0x031deb (0xe214 bytes) 000226 1770686068.060984 MIRROR_EXTEND to 2 mirrors 000229 1770686068.982707 read 0x03142a thru 0x031deb (0x9c2 bytes) 000233 1770686069.004468 mapwrite 0x02ce68 thru 0x02f625 (0x27be bytes) 000234 1770686069.205568 mapread 0x00c44a thru 0x0138fd (0x74b4 bytes) 000235 1770686069.218499 read 0x0094df thru 0x0157a5 (0xc2c7 bytes) 000236 1770686069.230105 mapread 0x01bf9e thru 0x0207b3 (0x4816 bytes) 000239 1770686069.233451 write 0x00545b thru 0x015079 (0xfc1f bytes) 000240 1770686069.239681 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x31dec): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31dec): Mirror 2: 0x606a2d02 (stale) CRC-32 checksum value for chunk [0, 0x31dec): Mirror 1: 0x88e86f85 Mirror 3: 0x88e86f85 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31dec: skipped 000242 1770686069.988359 trunc from 0x031dec to 0x0097db (0x28610 bytes) 000243 1770686070.146144 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x97dc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x97dc): Mirror 2: 0x91fb6cae (stale) Mirror 3: 0x872e0b5b (stale) CRC-32 checksum value for chunk [0, 0x97dc): Mirror 1: 0x872e0b5b Mirror 4: 0x872e0b5b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x97dc: skipped 000244 1770686070.960508 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x97dc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x97dc): Mirror 2: 0x91fb6cae (stale) Mirror 3: 0x872e0b5b (stale) CRC-32 checksum value for chunk [0, 0x97dc): Mirror 1: 0x872e0b5b Mirror 4: 0x872e0b5b Mirror 5: 0x872e0b5b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x97dc: skipped 000245 1770686071.798933 mapwrite 0x028fae thru 0x035040 (0xc093 bytes) 000246 1770686072.034033 write 0x02bf77 thru 0x0350fb (0x9185 bytes) 000247 1770686072.035720 mapwrite 0x023ce7 thru 0x025929 (0x1c43 bytes) 000248 1770686072.126705 trunc from 0x0350fc to 0x014ca5 (0x20456 bytes) 000249 1770686072.156874 mapread 0x0029cc thru 0x00c64d (0x9c82 bytes) 000251 1770686072.176066 mapread 0x012a3c thru 0x014ca5 (0x226a bytes) 000254 1770686072.187653 write 0x0243bd thru 0x0277fe (0x3442 bytes) 000255 1770686072.188680 mapwrite 0x02f91f thru 0x03983c (0x9f1e bytes) 000257 1770686072.285282 write 0x03d872 thru 0x03ffff (0x278e bytes) 000259 1770686072.287482 mapread 0x01020d thru 0x01fe98 (0xfc8c bytes) 000260 1770686072.312733 MIRROR_RESYNC 5 mirrors 000262 1770686073.532308 trunc from 0x040000 to 0x00374e (0x3c8b1 bytes) 000263 1770686073.604024 write 0x030996 thru 0x030fbd (0x628 bytes) 000264 1770686073.608610 MIRROR_RESYNC 5 mirrors 000267 1770686074.834417 mapread 0x0013d2 thru 0x011149 (0xfd78 bytes) 000268 1770686074.878730 trunc from 0x030fbe to 0x000f6c (0x30051 bytes) 000269 1770686074.940220 trunc from 0x000f6d to 0x038e9d (0x37f31 bytes) 000270 1770686074.960307 mapread 0x01d538 thru 0x021d3a (0x4803 bytes) 000271 1770686074.973157 read 0x033745 thru 0x038e9d (0x5759 bytes) 000275 1770686074.995538 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x38e9e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38e9e): Mirror 2: 0x8f0a4710 (stale) Mirror 3: 0x8f0a4710 (stale) Mirror 4: 0x8f0a4710 (stale) Mirror 5: 0x8f0a4710 (stale) CRC-32 checksum value for chunk [0, 0x38e9e): Mirror 1: 0x7f149f31 Mirror 6: 0x7f149f31 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38e9e: skipped 000277 1770686076.131532 mapread 0x02830f thru 0x02babd (0x37af bytes) 000278 1770686076.187664 mapwrite 0x017103 thru 0x01c33f (0x523d bytes) 000280 1770686076.380407 read 0x0336ac thru 0x0380b0 (0x4a05 bytes) 000281 1770686076.389073 trunc from 0x038e9e to 0x030231 (0x8c6c bytes) 000288 1770686076.420522 trunc from 0x030232 to 0x026a80 (0x97b1 bytes) 000289 1770686076.433282 trunc from 0x026a81 to 0x00fc1d (0x16e63 bytes) 000291 1770686076.449865 mapread 0x002ee0 thru 0x00fc1d (0xcd3e bytes) 000293 1770686076.467343 trunc from 0x00fc1e to 0x00fcf9 (0xdc bytes) 000294 1770686076.506840 mapread 0x001079 thru 0x002dcc (0x1d54 bytes) truncating to largest ever: 0x3c517 000295 1770686076.508937 trunc from 0x00fcfa to 0x03c516 (0x2c81d bytes) 000296 1770686076.533585 write 0x012805 thru 0x01e4b8 (0xbcb4 bytes) 000298 1770686076.561697 MIRROR_RESYNC 6 mirrors 000302 1770686077.664606 write 0x003e15 thru 0x00b471 (0x765d bytes) 000304 1770686077.729745 mapwrite 0x01ad76 thru 0x02302b (0x82b6 bytes) 000305 1770686077.839417 write 0x00c218 thru 0x00f594 (0x337d bytes) 000307 1770686077.852603 mapread 0x03070f thru 0x033fbb (0x38ad bytes) 000308 1770686077.862270 mapwrite 0x02fbba thru 0x0391b3 (0x95fa bytes) 000313 1770686077.968427 MIRROR_RESYNC 6 mirrors 000314 1770686079.016788 mapwrite 0x002aa2 thru 0x00a5d4 (0x7b33 bytes) 000315 1770686079.205767 mapread 0x033180 thru 0x038097 (0x4f18 bytes) 000316 1770686079.219302 mapwrite 0x0180d2 thru 0x01b236 (0x3165 bytes) 000317 1770686079.268836 MIRROR_RESYNC 6 mirrors 000319 1770686080.567395 write 0x032cc8 thru 0x03fb1d (0xce56 bytes) 000320 1770686080.632947 read 0x02c775 thru 0x02cdfd (0x689 bytes) 000322 1770686080.640637 write 0x0195b0 thru 0x0206af (0x7100 bytes) 000323 1770686080.651790 write 0x02207e thru 0x02eab9 (0xca3c bytes) 000325 1770686080.661786 write 0x0394f7 thru 0x03b839 (0x2343 bytes) 000326 1770686080.662578 trunc from 0x03fb1e to 0x0379f0 (0x812d bytes) 000327 1770686080.679173 read 0x02ddf5 thru 0x037598 (0x97a4 bytes) 000328 1770686080.687807 mapwrite 0x02937d thru 0x02cca1 (0x3925 bytes) 000329 1770686080.747575 write 0x02eb56 thru 0x038e62 (0xa30d bytes) 000332 1770686080.750896 read 0x00c5b2 thru 0x01affd (0xea4c bytes) truncating to largest ever: 0x3dfc2 000333 1770686080.752794 trunc from 0x038e63 to 0x03dfc1 (0x515f bytes) 000335 1770686080.776915 trunc from 0x03dfc2 to 0x0363c9 (0x7bf8 bytes) 000336 1770686080.800953 mapread 0x02bf06 thru 0x02fa6d (0x3b68 bytes) 000338 1770686080.802569 read 0x026175 thru 0x02fa82 (0x990e bytes) 000340 1770686080.804736 mapwrite 0x01fd5d thru 0x02a745 (0xa9e9 bytes) 000341 1770686080.862890 write 0x028bf8 thru 0x033e20 (0xb229 bytes) 000345 1770686080.868644 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x363ca): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x363ca): Mirror 2: 0x533cf3e4 (stale) Mirror 3: 0x533cf3e4 (stale) Mirror 4: 0x533cf3e4 (stale) Mirror 5: 0x533cf3e4 (stale) Mirror 6: 0x533cf3e4 (stale) CRC-32 checksum value for chunk [0, 0x363ca): Mirror 1: 0xe85a1d20 Mirror 7: 0xe85a1d20 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x363ca: skipped 000346 1770686081.722938 read 0x02a319 thru 0x034b64 (0xa84c bytes) 000348 1770686081.756934 mapwrite 0x03724d thru 0x03b94f (0x4703 bytes) 000350 1770686081.962620 trunc from 0x03b950 to 0x015911 (0x2603e bytes) 000352 1770686081.993328 mapwrite 0x022461 thru 0x02aad2 (0x8672 bytes) 000353 1770686082.090118 mapread 0x014726 thru 0x017038 (0x2913 bytes) 000354 1770686082.101442 write 0x00ad2f thru 0x015103 (0xa3d5 bytes) 000355 1770686082.112251 trunc from 0x02aad3 to 0x030995 (0x5ec3 bytes) 000357 1770686082.151601 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x30996): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30996): Mirror 2: 0x1ba0070b (stale) Mirror 3: 0x1ba0070b (stale) Mirror 4: 0x1ba0070b (stale) Mirror 5: 0x1ba0070b (stale) Mirror 6: 0x1ba0070b (stale) Mirror 7: 0x78b20b15 (stale) CRC-32 checksum value for chunk [0, 0x30996): Mirror 1: 0x4d155818 Mirror 8: 0x4d155818 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30996: skipped 000358 1770686083.185522 mapwrite 0x01f41b thru 0x02d73e (0xe324 bytes) 000359 1770686083.392846 mapread 0x00edab thru 0x01e897 (0xfaed bytes) 000360 1770686083.409006 trunc from 0x030996 to 0x03a1da (0x9845 bytes) 000361 1770686083.461130 mapread 0x00108d thru 0x003fb8 (0x2f2c bytes) 000364 1770686083.481042 write 0x01b954 thru 0x02a385 (0xea32 bytes) 000365 1770686083.484652 mapread 0x0310b1 thru 0x03a1da (0x912a bytes) 000366 1770686083.503203 read 0x005166 thru 0x00b25f (0x60fa bytes) 000367 1770686083.504158 mapwrite 0x002013 thru 0x00d9a1 (0xb98f bytes) 000370 1770686083.589572 read 0x02714c thru 0x02d484 (0x6339 bytes) 000371 1770686083.590785 mapread 0x009bf4 thru 0x00ad0b (0x1118 bytes) 000372 1770686083.592370 mapread 0x00a345 thru 0x0183c1 (0xe07d bytes) 000373 1770686083.594114 trunc from 0x03a1db to 0x02dc18 (0xc5c2 bytes) 000376 1770686083.625525 read 0x00b43c thru 0x013aac (0x8671 bytes) 000378 1770686083.628553 read 0x015f60 thru 0x025c7e (0xfd1f bytes) 000379 1770686083.630024 mapread 0x01c151 thru 0x02420a (0x80ba bytes) 000380 1770686083.633246 mapwrite 0x00c485 thru 0x0126a8 (0x6224 bytes) 000381 1770686083.686917 mapread 0x022a8d thru 0x026410 (0x3984 bytes) 000386 1770686083.695834 mapread 0x0234a2 thru 0x0274c0 (0x401f bytes) 000387 1770686083.698797 trunc from 0x02dc19 to 0x01e0a6 (0xfb72 bytes) 000388 1770686083.721952 mapread 0x013788 thru 0x0157cc (0x2045 bytes) 000389 1770686083.725941 trunc from 0x01e0a7 to 0x001c91 (0x1c415 bytes) 000391 1770686083.755127 write 0x00cade thru 0x01bdb4 (0xf2d7 bytes) 000392 1770686083.772954 MIRROR_RESYNC 8 mirrors 000394 1770686085.070457 write 0x003af6 thru 0x00415f (0x66a bytes) 000396 1770686085.187708 read 0x00b94f thru 0x013511 (0x7bc3 bytes) 000399 1770686085.212851 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1bdb5): Mirror 2: 0xf0195b61 (stale) Mirror 3: 0xf0195b61 (stale) Mirror 4: 0xf0195b61 (stale) Mirror 5: 0xf0195b61 (stale) Mirror 6: 0xf0195b61 (stale) Mirror 8: 0xf0195b61 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bdb5): Mirror 2: 0xf0195b61 (stale) Mirror 3: 0xf0195b61 (stale) Mirror 4: 0xf0195b61 (stale) Mirror 5: 0xf0195b61 (stale) Mirror 6: 0xf0195b61 (stale) Mirror 8: 0xf0195b61 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bdb5: skipped 000400 1770686085.708609 trunc from 0x01bdb5 to 0x02714d (0xb399 bytes) 000402 1770686085.746728 mapwrite 0x00e9ae thru 0x011d92 (0x33e5 bytes) 000405 1770686085.863361 read 0x0186cb thru 0x019cb4 (0x15ea bytes) 000406 1770686085.872682 read 0x0173ec thru 0x01d6af (0x62c4 bytes) 000407 1770686085.883767 mapread 0x00e066 thru 0x013048 (0x4fe3 bytes) 000408 1770686085.884640 write 0x010a51 thru 0x01b739 (0xace9 bytes) 000412 1770686085.888008 read 0x00343e thru 0x00fd09 (0xc8cc bytes) 000413 1770686085.888879 trunc from 0x02714e to 0x0103a6 (0x16da7 bytes) 000414 1770686085.932255 mapwrite 0x03bebe thru 0x03ffff (0x4142 bytes) 000415 1770686086.072881 mapwrite 0x016eca thru 0x01e5a4 (0x76db bytes) 000417 1770686086.174077 write 0x01a4d2 thru 0x0240d9 (0x9c08 bytes) 000419 1770686086.182770 mapwrite 0x02c237 thru 0x03469f (0x8469 bytes) 000420 1770686086.277017 trunc from 0x040000 to 0x02c03d (0x13fc2 bytes) 000422 1770686086.304817 mapread 0x025ff6 thru 0x02697e (0x989 bytes) 000423 1770686086.305899 trunc from 0x02c03e to 0x03869b (0xc65e bytes) 000424 1770686086.325235 read 0x02fde7 thru 0x0315e2 (0x17fc bytes) 000426 1770686086.338218 read 0x005c92 thru 0x0150d3 (0xf442 bytes) 000427 1770686086.340139 mapread 0x01506e thru 0x024640 (0xf5d3 bytes) 000432 1770686086.355064 MIRROR_RESYNC 7 mirrors 000434 1770686087.508063 read 0x034256 thru 0x03869b (0x4446 bytes) 000435 1770686087.515322 mapread 0x0264e0 thru 0x0289ff (0x2520 bytes) 000436 1770686087.543855 MIRROR_EXTEND to 8 mirrors 000437 1770686088.233396 mapread 0x0086ce thru 0x0126d6 (0xa009 bytes) 000440 1770686088.261173 write 0x0283ee thru 0x02c398 (0x3fab bytes) 000441 1770686088.370035 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3869c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3869c): Mirror 2: 0x987b7f45 (stale) Mirror 3: 0x987b7f45 (stale) Mirror 4: 0x987b7f45 (stale) Mirror 5: 0x987b7f45 (stale) Mirror 6: 0x987b7f45 (stale) Mirror 8: 0x987b7f45 (stale) Mirror 9: 0x987b7f45 (stale) CRC-32 checksum value for chunk [0, 0x3869c): Mirror 1: 0xbfb8300a Mirror 10: 0xbfb8300a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3869c: skipped 000442 1770686089.391772 mapwrite 0x009233 thru 0x01567c (0xc44a bytes) 000443 1770686089.577023 write 0x00189f thru 0x007a6e (0x61d0 bytes) 000444 1770686089.587052 mapwrite 0x02608d thru 0x02ea87 (0x89fb bytes) 000445 1770686089.677042 write 0x02cffb thru 0x0369fd (0x9a03 bytes) 000447 1770686089.688824 trunc from 0x03869c to 0x03106d (0x762e bytes) 000448 1770686089.734048 trunc from 0x03106e to 0x020c36 (0x10437 bytes) 000450 1770686089.769007 write 0x020649 thru 0x023ceb (0x36a3 bytes) 000451 1770686089.770248 write 0x017152 thru 0x023465 (0xc314 bytes) 000454 1770686089.773668 write 0x003fe6 thru 0x0071fb (0x3216 bytes) 000455 1770686089.778916 read 0x00e1e3 thru 0x00f8a9 (0x16c7 bytes) 000456 1770686089.780415 write 0x02d2cf thru 0x0311e7 (0x3f19 bytes) 000457 1770686089.793430 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x311e8): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x311e8): Mirror 2: 0xd64a2fe7 (stale) Mirror 3: 0xd64a2fe7 (stale) Mirror 4: 0xd64a2fe7 (stale) Mirror 5: 0xd64a2fe7 (stale) Mirror 6: 0xd64a2fe7 (stale) Mirror 8: 0xd64a2fe7 (stale) Mirror 9: 0xd64a2fe7 (stale) Mirror 10: 0x20ae16be (stale) CRC-32 checksum value for chunk [0, 0x311e8): Mirror 1: 0xf0cc30f3 Mirror 11: 0xf0cc30f3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x311e8: skipped 000459 1770686091.161706 read 0x028e1b thru 0x02cf72 (0x4158 bytes) 000462 1770686091.216007 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x311e8): Mirror 2: 0xd64a2fe7 (stale) Mirror 3: 0xd64a2fe7 (stale) Mirror 4: 0xd64a2fe7 (stale) Mirror 5: 0xd64a2fe7 (stale) Mirror 6: 0xd64a2fe7 (stale) Mirror 8: 0xd64a2fe7 (stale) Mirror 9: 0xd64a2fe7 (stale) Mirror 10: 0x20ae16be (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x311e8): Mirror 2: 0xd64a2fe7 (stale) Mirror 3: 0xd64a2fe7 (stale) Mirror 4: 0xd64a2fe7 (stale) Mirror 5: 0xd64a2fe7 (stale) Mirror 6: 0xd64a2fe7 (stale) Mirror 8: 0xd64a2fe7 (stale) Mirror 9: 0xd64a2fe7 (stale) Mirror 10: 0x20ae16be (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x311e8: skipped 000463 1770686091.803944 mapwrite 0x03ad9e thru 0x03ffff (0x5262 bytes) 000464 1770686091.904361 write 0x034482 thru 0x03ffff (0xbb7e bytes) 000466 1770686091.918808 write 0x00337b thru 0x0073ba (0x4040 bytes) 000467 1770686091.930707 trunc from 0x040000 to 0x01bbce (0x24431 bytes) 000468 1770686091.964029 read 0x000a72 thru 0x004a70 (0x3fff bytes) 000470 1770686091.978719 read 0x001715 thru 0x00bbcc (0xa4b8 bytes) 000472 1770686091.980221 trunc from 0x01bbcf to 0x010186 (0xba48 bytes) 000475 1770686092.010612 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x10187): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10187): Mirror 2: 0x7b606911 (stale) Mirror 3: 0x7b606911 (stale) Mirror 4: 0x7b606911 (stale) Mirror 5: 0x7b606911 (stale) Mirror 6: 0x7b606911 (stale) Mirror 8: 0x7b606911 (stale) Mirror 9: 0x7b606911 (stale) Mirror 10: 0x7b606911 (stale) CRC-32 checksum value for chunk [0, 0x10187): Mirror 1: 0xfc930573 Mirror 11: 0xfc930573 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10187: skipped 000476 1770686093.419034 mapread 0x00bd33 thru 0x00f7a4 (0x3a72 bytes) 000477 1770686093.463805 mapwrite 0x00bedd thru 0x00de2f (0x1f53 bytes) 000478 1770686093.682448 write 0x03cb59 thru 0x03ffff (0x34a7 bytes) 000480 1770686093.685919 read 0x0278a8 thru 0x028e2a (0x1583 bytes) 000481 1770686093.707383 read 0x0199e6 thru 0x0243a7 (0xa9c2 bytes) truncating to largest ever: 0x3e07c 000482 1770686093.722972 trunc from 0x040000 to 0x03e07b (0x1f84 bytes) 000484 1770686093.755452 read 0x037808 thru 0x03e07b (0x6874 bytes) 000485 1770686093.757989 mapread 0x03b3f8 thru 0x03e07b (0x2c84 bytes) 000486 1770686093.760576 write 0x005339 thru 0x0141e9 (0xeeb1 bytes) 000489 1770686093.763020 mapwrite 0x00be18 thru 0x01b4ea (0xf6d3 bytes) 000495 1770686093.864796 read 0x02e7ad thru 0x03e07b (0xf8cf bytes) 000496 1770686093.865804 trunc from 0x03e07c to 0x01dd01 (0x2037a bytes) 000497 1770686093.908033 trunc from 0x01dd02 to 0x0265e0 (0x88df bytes) 000501 1770686093.940642 mapwrite 0x02fe2b thru 0x039074 (0x924a bytes) 000502 1770686094.037973 mapread 0x02f301 thru 0x039074 (0x9d74 bytes) 000504 1770686094.039574 mapread 0x038cf1 thru 0x039074 (0x384 bytes) 000505 1770686094.043421 mapwrite 0x02eff3 thru 0x03738b (0x8399 bytes) 000506 1770686094.111533 write 0x0288ee thru 0x033906 (0xb019 bytes) 000510 1770686094.126862 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39075): Mirror 2: 0x1d73019f (stale) Mirror 3: 0x1d73019f (stale) Mirror 4: 0x1d73019f (stale) Mirror 5: 0x1d73019f (stale) Mirror 8: 0x1d73019f (stale) Mirror 9: 0x1d73019f (stale) Mirror 10: 0x8b8f9810 (stale) Mirror 11: 0x9a3132cb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39075): Mirror 2: 0x1d73019f (stale) Mirror 3: 0x1d73019f (stale) Mirror 4: 0x1d73019f (stale) Mirror 5: 0x1d73019f (stale) Mirror 8: 0x1d73019f (stale) Mirror 9: 0x1d73019f (stale) Mirror 10: 0x8b8f9810 (stale) Mirror 11: 0x9a3132cb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39075: skipped 000514 1770686094.854443 write 0x001c04 thru 0x01045b (0xe858 bytes) 000515 1770686094.872308 mapwrite 0x0385f9 thru 0x03ffff (0x7a07 bytes) 000516 1770686095.008052 read 0x021937 thru 0x02e815 (0xcedf bytes) 000518 1770686095.024929 mapread 0x02fb85 thru 0x030407 (0x883 bytes) 000521 1770686095.049970 trunc from 0x040000 to 0x00f2dc (0x30d23 bytes) 000523 1770686095.080424 write 0x004412 thru 0x005de8 (0x19d7 bytes) 000524 1770686095.081127 trunc from 0x00f2dd to 0x024d03 (0x15a27 bytes) 000526 1770686095.112246 read 0x002a85 thru 0x003706 (0xc82 bytes) 000527 1770686095.123389 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x24d04): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24d04): Mirror 2: 0xd87f6022 (stale) Mirror 3: 0xd87f6022 (stale) Mirror 4: 0xd87f6022 (stale) Mirror 5: 0xd87f6022 (stale) Mirror 8: 0xd87f6022 (stale) Mirror 9: 0xd87f6022 (stale) Mirror 10: 0xd87f6022 (stale) Mirror 11: 0xe63c359a (stale) CRC-32 checksum value for chunk [0, 0x24d04): Mirror 1: 0x680e7425 Mirror 12: 0x680e7425 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24d04: skipped 000529 1770686096.316894 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x24d04): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24d04): Mirror 2: 0xd87f6022 (stale) Mirror 3: 0xd87f6022 (stale) Mirror 4: 0xd87f6022 (stale) Mirror 5: 0xd87f6022 (stale) Mirror 8: 0xd87f6022 (stale) Mirror 9: 0xd87f6022 (stale) Mirror 10: 0xd87f6022 (stale) Mirror 11: 0xe63c359a (stale) CRC-32 checksum value for chunk [0, 0x24d04): Mirror 1: 0x680e7425 Mirror 12: 0x680e7425 Mirror 13: 0x680e7425 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24d04: skipped 000532 1770686097.601613 write 0x03af10 thru 0x03ffff (0x50f0 bytes) 000534 1770686097.721521 MIRROR_RESYNC 11 mirrors 000537 1770686099.718230 MIRROR_EXTEND to 12 mirrors 000539 1770686100.642837 mapread 0x030138 thru 0x03b8a2 (0xb76b bytes) 000540 1770686100.669333 mapwrite 0x03b4b7 thru 0x03ffff (0x4b49 bytes) 000541 1770686100.897672 write 0x0007d3 thru 0x00a1f0 (0x9a1e bytes) 000542 1770686100.914761 mapread 0x027267 thru 0x02fe0a (0x8ba4 bytes) 000543 1770686100.925784 read 0x001ccb thru 0x009b37 (0x7e6d bytes) 000544 1770686100.926654 write 0x03f3b8 thru 0x03ffff (0xc48 bytes) 000545 1770686100.928989 mapread 0x03d036 thru 0x03ffff (0x2fca bytes) 000546 1770686100.931456 mapread 0x020ec5 thru 0x029157 (0x8293 bytes) 000547 1770686100.934642 write 0x015ee6 thru 0x0219d9 (0xbaf4 bytes) 000548 1770686100.948509 mapwrite 0x0050cc thru 0x0069ed (0x1922 bytes) 000549 1770686101.022497 read 0x02e54e thru 0x034df9 (0x68ac bytes) 000551 1770686101.031935 mapwrite 0x02be59 thru 0x039d69 (0xdf11 bytes) 000555 1770686101.094514 write 0x0372d8 thru 0x03ad9d (0x3ac6 bytes) 000558 1770686101.098434 mapwrite 0x03a2c6 thru 0x03ffff (0x5d3a bytes) 000559 1770686101.153117 mapwrite 0x0157b9 thru 0x023956 (0xe19e bytes) 000561 1770686101.218840 mapwrite 0x035d0c thru 0x03709e (0x1393 bytes) 000563 1770686101.280921 write 0x00b5c7 thru 0x00cd1c (0x1756 bytes) 000564 1770686101.289821 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1f645c5 (stale) Mirror 3: 0x1f645c5 (stale) Mirror 4: 0x1f645c5 (stale) Mirror 8: 0x1f645c5 (stale) Mirror 9: 0x1f645c5 (stale) Mirror 10: 0x1f645c5 (stale) Mirror 11: 0x1f645c5 (stale) Mirror 12: 0x1f645c5 (stale) Mirror 13: 0x1f645c5 (stale) Mirror 14: 0x1f645c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1f645c5 (stale) Mirror 3: 0x1f645c5 (stale) Mirror 4: 0x1f645c5 (stale) Mirror 8: 0x1f645c5 (stale) Mirror 9: 0x1f645c5 (stale) Mirror 10: 0x1f645c5 (stale) Mirror 11: 0x1f645c5 (stale) Mirror 12: 0x1f645c5 (stale) Mirror 13: 0x1f645c5 (stale) Mirror 14: 0x1f645c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000567 1770686102.080374 mapread 0x002ecb thru 0x0060d2 (0x3208 bytes) 000568 1770686102.106117 write 0x03cc9c thru 0x03ffff (0x3364 bytes) 000569 1770686102.115607 trunc from 0x040000 to 0x025ffe (0x1a001 bytes) 000570 1770686102.137849 mapwrite 0x027d26 thru 0x036126 (0xe401 bytes) 000572 1770686102.235589 mapread 0x022f63 thru 0x02f104 (0xc1a2 bytes) 000573 1770686102.236614 write 0x02cfd9 thru 0x034feb (0x8013 bytes) 000574 1770686102.239358 mapread 0x00b133 thru 0x00ee79 (0x3d47 bytes) 000575 1770686102.244995 mapwrite 0x023f17 thru 0x02a341 (0x642b bytes) 000576 1770686102.372564 trunc from 0x036127 to 0x02fe73 (0x62b3 bytes) 000577 1770686102.393543 write 0x003f90 thru 0x00633d (0x23ae bytes) 000580 1770686102.396785 write 0x0270a8 thru 0x033657 (0xc5b0 bytes) 000581 1770686102.399600 write 0x028a2d thru 0x02cef5 (0x44c9 bytes) 000582 1770686102.400751 trunc from 0x033658 to 0x039fa6 (0x694f bytes) 000583 1770686102.420608 read 0x036a4e thru 0x039fa6 (0x3559 bytes) 000584 1770686102.427908 mapwrite 0x025bdb thru 0x02706c (0x1492 bytes) 000586 1770686102.477178 mapread 0x013314 thru 0x01bd1b (0x8a08 bytes) 000587 1770686102.487269 write 0x02951b thru 0x0385c7 (0xf0ad bytes) 000588 1770686102.488864 mapwrite 0x03470f thru 0x039bfb (0x54ed bytes) 000590 1770686102.549647 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x39fa7): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39fa7): Mirror 2: 0x4aca0e45 (stale) Mirror 3: 0x4aca0e45 (stale) Mirror 4: 0x4aca0e45 (stale) Mirror 8: 0x4aca0e45 (stale) Mirror 9: 0x4aca0e45 (stale) Mirror 10: 0x4aca0e45 (stale) Mirror 11: 0x4aca0e45 (stale) Mirror 12: 0x4aca0e45 (stale) Mirror 13: 0x4aca0e45 (stale) Mirror 14: 0x4aca0e45 (stale) CRC-32 checksum value for chunk [0, 0x39fa7): Mirror 1: 0x93cbbdf8 Mirror 15: 0x93cbbdf8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39fa7: skipped 000592 1770686103.560489 read 0x0279ce thru 0x02df3b (0x656e bytes) 000593 1770686103.571936 mapwrite 0x03bdd6 thru 0x03ffff (0x422a bytes) 000594 1770686103.774036 mapread 0x03013f thru 0x03d2ae (0xd170 bytes) 000595 1770686103.789422 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1f645c5 (stale) Mirror 4: 0x1f645c5 (stale) Mirror 8: 0x1f645c5 (stale) Mirror 9: 0x1f645c5 (stale) Mirror 10: 0x1f645c5 (stale) Mirror 11: 0x1f645c5 (stale) Mirror 12: 0x1f645c5 (stale) Mirror 13: 0x1f645c5 (stale) Mirror 14: 0x1f645c5 (stale) Mirror 15: 0xa14880ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1f645c5 (stale) Mirror 4: 0x1f645c5 (stale) Mirror 8: 0x1f645c5 (stale) Mirror 9: 0x1f645c5 (stale) Mirror 10: 0x1f645c5 (stale) Mirror 11: 0x1f645c5 (stale) Mirror 12: 0x1f645c5 (stale) Mirror 13: 0x1f645c5 (stale) Mirror 14: 0x1f645c5 (stale) Mirror 15: 0xa14880ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000596 1770686104.391646 mapwrite 0x02fd7b thru 0x0371b8 (0x743e bytes) 000597 1770686104.459758 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1f645c5 (stale) Mirror 4: 0x1f645c5 (stale) Mirror 8: 0x1f645c5 (stale) Mirror 9: 0x1f645c5 (stale) Mirror 11: 0x1f645c5 (stale) Mirror 12: 0x1f645c5 (stale) Mirror 13: 0x1f645c5 (stale) Mirror 14: 0x1f645c5 (stale) Mirror 15: 0xa14880ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1f645c5 (stale) Mirror 4: 0x1f645c5 (stale) Mirror 8: 0x1f645c5 (stale) Mirror 9: 0x1f645c5 (stale) Mirror 11: 0x1f645c5 (stale) Mirror 12: 0x1f645c5 (stale) Mirror 13: 0x1f645c5 (stale) Mirror 14: 0x1f645c5 (stale) Mirror 15: 0xa14880ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000599 1770686105.028606 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1f645c5 (stale) Mirror 4: 0x1f645c5 (stale) Mirror 8: 0x1f645c5 (stale) Mirror 9: 0x1f645c5 (stale) Mirror 11: 0x1f645c5 (stale) Mirror 12: 0x1f645c5 (stale) Mirror 13: 0x1f645c5 (stale) Mirror 14: 0x1f645c5 (stale) Mirror 15: 0xa14880ef (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9026ba82 Mirror 16: 0x9026ba82 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000601 1770686106.075377 mapread 0x012dab thru 0x017e44 (0x509a bytes) 000602 1770686106.117989 mapwrite 0x0064f5 thru 0x0086d1 (0x21dd bytes) 000605 1770686106.319360 trunc from 0x040000 to 0x03c4f7 (0x3b08 bytes) 000607 1770686106.345401 read 0x023eb2 thru 0x02524a (0x1399 bytes) 000608 1770686106.358385 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c4f8): Mirror 4: 0x897783a4 (stale) Mirror 8: 0x897783a4 (stale) Mirror 9: 0x897783a4 (stale) Mirror 11: 0x897783a4 (stale) Mirror 12: 0x897783a4 (stale) Mirror 13: 0x897783a4 (stale) Mirror 14: 0x897783a4 (stale) Mirror 15: 0xe6603e30 (stale) Mirror 16: 0x7565496f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c4f8): Mirror 4: 0x897783a4 (stale) Mirror 8: 0x897783a4 (stale) Mirror 9: 0x897783a4 (stale) Mirror 11: 0x897783a4 (stale) Mirror 12: 0x897783a4 (stale) Mirror 13: 0x897783a4 (stale) Mirror 14: 0x897783a4 (stale) Mirror 15: 0xe6603e30 (stale) Mirror 16: 0x7565496f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c4f8: skipped 000616 1770686106.955685 mapread 0x029b2b thru 0x02b337 (0x180d bytes) 000617 1770686106.974976 mapwrite 0x01754d thru 0x018d01 (0x17b5 bytes) 000620 1770686107.040780 write 0x00369b thru 0x008fd9 (0x593f bytes) 000621 1770686107.051161 write 0x01455a thru 0x01d8e8 (0x938f bytes) 000624 1770686107.053876 mapwrite 0x012457 thru 0x01f738 (0xd2e2 bytes) 000626 1770686107.103822 trunc from 0x03c4f8 to 0x00ce82 (0x2f675 bytes) 000627 1770686107.118986 read 0x009fae thru 0x00ce82 (0x2ed5 bytes) 000628 1770686107.119671 mapread 0x006693 thru 0x00a36d (0x3cdb bytes) 000630 1770686107.120993 read 0x00446a thru 0x007d04 (0x389b bytes) 000631 1770686107.123415 read 0x007ebd thru 0x00ce82 (0x4fc6 bytes) 000632 1770686107.124296 write 0x014d85 thru 0x01ea64 (0x9ce0 bytes) 000633 1770686107.127285 mapread 0x01cbae thru 0x01ea64 (0x1eb7 bytes) 000634 1770686107.132772 MIRROR_RESYNC 10 mirrors 000635 1770686108.799302 read 0x004618 thru 0x00746f (0x2e58 bytes) 000636 1770686108.811041 trunc from 0x01ea65 to 0x00e903 (0x10161 bytes) 000639 1770686108.988023 mapread 0x000ac2 thru 0x002d39 (0x2278 bytes) 000642 1770686109.013783 write 0x039f67 thru 0x03be6d (0x1f07 bytes) 000643 1770686109.014943 mapread 0x032094 thru 0x03676a (0x46d7 bytes) 000644 1770686109.046387 mapread 0x00fd57 thru 0x01f709 (0xf9b3 bytes) 000648 1770686109.077055 mapread 0x0185b0 thru 0x01f8f0 (0x7341 bytes) 000649 1770686109.079905 write 0x034619 thru 0x035739 (0x1121 bytes) 000650 1770686109.081749 mapwrite 0x0164e1 thru 0x018c58 (0x2778 bytes) 000651 1770686109.151553 trunc from 0x03be6e to 0x01b527 (0x20946 bytes) 000652 1770686109.176317 trunc from 0x01b528 to 0x031c44 (0x1671d bytes) 000653 1770686109.212165 trunc from 0x031c45 to 0x032d58 (0x1114 bytes) 000655 1770686109.237567 trunc from 0x032d59 to 0x00410d (0x2ec4b bytes) 000657 1770686109.268114 MIRROR_RESYNC 10 mirrors 000658 1770686110.782385 MIRROR_RESYNC 10 mirrors 000661 1770686111.519450 write 0x013c42 thru 0x018a32 (0x4df1 bytes) 000665 1770686111.594591 mapread 0x006276 thru 0x014fc8 (0xed53 bytes) 000666 1770686111.626466 trunc from 0x018a33 to 0x01c8ea (0x3eb8 bytes) 000667 1770686111.659660 mapwrite 0x004afc thru 0x008bf2 (0x40f7 bytes) 000668 1770686111.719674 read 0x007e8a thru 0x00bba4 (0x3d1b bytes) 000670 1770686111.720758 mapread 0x01a8be thru 0x01c8ea (0x202d bytes) 000671 1770686111.734702 mapwrite 0x006cf9 thru 0x006f8d (0x295 bytes) 000672 1770686111.870787 trunc from 0x01c8eb to 0x02fb42 (0x13258 bytes) 000674 1770686111.910010 mapwrite 0x02423f thru 0x026207 (0x1fc9 bytes) 000677 1770686112.019401 write 0x0322fe thru 0x038ab1 (0x67b4 bytes) 000678 1770686112.020729 trunc from 0x038ab2 to 0x02196a (0x17147 bytes) 000679 1770686112.038929 mapread 0x01c1bc thru 0x02196a (0x57af bytes) 000681 1770686112.042291 trunc from 0x02196b to 0x014204 (0xd766 bytes) 000682 1770686112.062254 mapwrite 0x03c967 thru 0x03ffff (0x3699 bytes) 000683 1770686112.137453 mapwrite 0x00279d thru 0x011c05 (0xf469 bytes) 000684 1770686112.189515 read 0x005b03 thru 0x00b505 (0x5a03 bytes) 000685 1770686112.190340 mapwrite 0x031b00 thru 0x031ece (0x3cf bytes) 000687 1770686112.236693 mapread 0x003b96 thru 0x006c07 (0x3072 bytes) 000688 1770686112.237521 read 0x009450 thru 0x017f96 (0xeb47 bytes) 000689 1770686112.238114 mapwrite 0x02c199 thru 0x03656c (0xa3d4 bytes) 000693 1770686112.287155 trunc from 0x040000 to 0x00d88f (0x32770 bytes) 000698 1770686112.307504 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0xd890): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd890): Mirror 4: 0x5f8d1367 (stale) Mirror 8: 0x5f8d1367 (stale) Mirror 9: 0x5f8d1367 (stale) Mirror 11: 0x5f8d1367 (stale) Mirror 12: 0x5f8d1367 (stale) Mirror 13: 0x5f8d1367 (stale) Mirror 14: 0x5f8d1367 (stale) Mirror 15: 0x5f8d1367 (stale) Mirror 16: 0x5f8d1367 (stale) CRC-32 checksum value for chunk [0, 0xd890): Mirror 1: 0xe8fe05bf Mirror 17: 0xe8fe05bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd890: skipped 000700 1770686112.998494 write 0x00b97d thru 0x01b3c3 (0xfa47 bytes) 000701 1770686113.088563 mapwrite 0x0007fa thru 0x00cf75 (0xc77c bytes) 000702 1770686113.152508 read 0x005a57 thru 0x0065e6 (0xb90 bytes) 000703 1770686113.153137 mapread 0x00dd5a thru 0x01537d (0x7624 bytes) 000704 1770686113.153902 mapwrite 0x00e28e thru 0x01b07e (0xcdf1 bytes) 000706 1770686113.204799 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x1b3c4): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b3c4): Mirror 4: 0x990b025c (stale) Mirror 8: 0x990b025c (stale) Mirror 9: 0x990b025c (stale) Mirror 11: 0x990b025c (stale) Mirror 12: 0x990b025c (stale) Mirror 13: 0x990b025c (stale) Mirror 14: 0x990b025c (stale) Mirror 15: 0x990b025c (stale) Mirror 16: 0x990b025c (stale) Mirror 17: 0xb690c10e (stale) CRC-32 checksum value for chunk [0, 0x1b3c4): Mirror 1: 0x898d4677 Mirror 18: 0x898d4677 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b3c4: skipped 000709 1770686114.234787 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x1b3c4): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b3c4): Mirror 4: 0x990b025c (stale) Mirror 8: 0x990b025c (stale) Mirror 9: 0x990b025c (stale) Mirror 11: 0x990b025c (stale) Mirror 12: 0x990b025c (stale) Mirror 13: 0x990b025c (stale) Mirror 14: 0x990b025c (stale) Mirror 15: 0x990b025c (stale) Mirror 16: 0x990b025c (stale) Mirror 17: 0xb690c10e (stale) CRC-32 checksum value for chunk [0, 0x1b3c4): Mirror 1: 0x898d4677 Mirror 18: 0x898d4677 Mirror 19: 0x898d4677 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b3c4: skipped 000712 1770686115.195748 MIRROR_RESYNC 13 mirrors 000714 1770686117.456532 mapwrite 0x039055 thru 0x039c26 (0xbd2 bytes) 000715 1770686117.695338 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x39c27): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39c27): Mirror 4: 0x2c90acdb (stale) Mirror 8: 0x2c90acdb (stale) Mirror 9: 0x2c90acdb (stale) Mirror 11: 0x2c90acdb (stale) Mirror 12: 0x2c90acdb (stale) Mirror 13: 0x2c90acdb (stale) Mirror 14: 0x2c90acdb (stale) Mirror 15: 0x2c90acdb (stale) Mirror 16: 0x2c90acdb (stale) Mirror 17: 0x2c90acdb (stale) Mirror 18: 0x2c90acdb (stale) Mirror 19: 0x2c90acdb (stale) CRC-32 checksum value for chunk [0, 0x39c27): Mirror 1: 0xf1429ee5 Mirror 20: 0xf1429ee5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39c27: skipped 000716 1770686118.931022 read 0x024988 thru 0x030cea (0xc363 bytes) 000717 1770686118.954338 MIRROR_SPLIT mirror 5 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39c27): Mirror 4: 0x2c90acdb (stale) Mirror 8: 0x2c90acdb (stale) Mirror 9: 0x2c90acdb (stale) Mirror 11: 0x2c90acdb (stale) Mirror 13: 0x2c90acdb (stale) Mirror 14: 0x2c90acdb (stale) Mirror 15: 0x2c90acdb (stale) Mirror 16: 0x2c90acdb (stale) Mirror 17: 0x2c90acdb (stale) Mirror 18: 0x2c90acdb (stale) Mirror 19: 0x2c90acdb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39c27): Mirror 4: 0x2c90acdb (stale) Mirror 8: 0x2c90acdb (stale) Mirror 9: 0x2c90acdb (stale) Mirror 11: 0x2c90acdb (stale) Mirror 13: 0x2c90acdb (stale) Mirror 14: 0x2c90acdb (stale) Mirror 15: 0x2c90acdb (stale) Mirror 16: 0x2c90acdb (stale) Mirror 17: 0x2c90acdb (stale) Mirror 18: 0x2c90acdb (stale) Mirror 19: 0x2c90acdb (stale) CRC-32 checksum value for chunk [0, 0x39c27): Mirror 1: 0xf1429ee5 Mirror 20: 0xf1429ee5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39c27: skipped 000718 1770686120.334912 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x39c27): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39c27): Mirror 4: 0x2c90acdb (stale) Mirror 8: 0x2c90acdb (stale) Mirror 9: 0x2c90acdb (stale) Mirror 11: 0x2c90acdb (stale) Mirror 13: 0x2c90acdb (stale) Mirror 14: 0x2c90acdb (stale) Mirror 15: 0x2c90acdb (stale) Mirror 16: 0x2c90acdb (stale) Mirror 17: 0x2c90acdb (stale) Mirror 18: 0x2c90acdb (stale) Mirror 19: 0x2c90acdb (stale) CRC-32 checksum value for chunk [0, 0x39c27): Mirror 1: 0xf1429ee5 Mirror 20: 0xf1429ee5 Mirror 21: 0xf1429ee5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39c27: skipped 000719 1770686121.911518 write 0x02bca9 thru 0x02e478 (0x27d0 bytes) 000720 1770686122.103618 read 0x018235 thru 0x025c70 (0xda3c bytes) 000721 1770686122.116488 trunc from 0x039c27 to 0x01d6dc (0x1c54a bytes) 000722 1770686122.173446 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d6dd): Mirror 8: 0xe8889610 (stale) Mirror 9: 0xe8889610 (stale) Mirror 11: 0xe8889610 (stale) Mirror 13: 0xe8889610 (stale) Mirror 14: 0xe8889610 (stale) Mirror 15: 0xe8889610 (stale) Mirror 16: 0xe8889610 (stale) Mirror 17: 0xe8889610 (stale) Mirror 18: 0xe8889610 (stale) Mirror 19: 0xe8889610 (stale) Mirror 20: 0xe8889610 (stale) Mirror 21: 0xe8889610 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d6dd): Mirror 8: 0xe8889610 (stale) Mirror 9: 0xe8889610 (stale) Mirror 11: 0xe8889610 (stale) Mirror 13: 0xe8889610 (stale) Mirror 14: 0xe8889610 (stale) Mirror 15: 0xe8889610 (stale) Mirror 16: 0xe8889610 (stale) Mirror 17: 0xe8889610 (stale) Mirror 18: 0xe8889610 (stale) Mirror 19: 0xe8889610 (stale) Mirror 20: 0xe8889610 (stale) Mirror 21: 0xe8889610 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d6dd: skipped 000723 1770686123.032732 write 0x03b937 thru 0x03ffff (0x46c9 bytes) 000724 1770686123.033816 write 0x0393cf thru 0x03ffff (0x6c31 bytes) 000725 1770686123.042131 read 0x0075ed thru 0x009931 (0x2345 bytes) 000726 1770686123.048175 mapwrite 0x011a5d thru 0x0155ad (0x3b51 bytes) 000728 1770686123.157332 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x757dc152 (stale) Mirror 9: 0x757dc152 (stale) Mirror 11: 0x757dc152 (stale) Mirror 13: 0x757dc152 (stale) Mirror 14: 0x757dc152 (stale) Mirror 15: 0x757dc152 (stale) Mirror 16: 0x757dc152 (stale) Mirror 17: 0x757dc152 (stale) Mirror 18: 0x757dc152 (stale) Mirror 19: 0x757dc152 (stale) Mirror 20: 0x3fb3d72e (stale) Mirror 21: 0x3fb3d72e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x39a6cceb Mirror 22: 0x39a6cceb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000731 1770686124.599013 write 0x012fc6 thru 0x01bbbb (0x8bf6 bytes) 000733 1770686124.740085 MIRROR_RESYNC 14 mirrors 000734 1770686126.680491 write 0x02e095 thru 0x02f096 (0x1002 bytes) 000739 1770686126.775327 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xa7f792f8 (stale) Mirror 9: 0xa7f792f8 (stale) Mirror 11: 0xa7f792f8 (stale) Mirror 13: 0xa7f792f8 (stale) Mirror 14: 0xa7f792f8 (stale) Mirror 15: 0xa7f792f8 (stale) Mirror 16: 0xa7f792f8 (stale) Mirror 17: 0xa7f792f8 (stale) Mirror 18: 0xa7f792f8 (stale) Mirror 19: 0xa7f792f8 (stale) Mirror 20: 0xa7f792f8 (stale) Mirror 21: 0xa7f792f8 (stale) Mirror 22: 0xa7f792f8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7968e5ab Mirror 23: 0x7968e5ab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000741 1770686127.786794 mapwrite 0x02be0c thru 0x02c757 (0x94c bytes) 000743 1770686128.004966 trunc from 0x040000 to 0x013a07 (0x2c5f8 bytes) 000745 1770686128.032413 read 0x000e0e thru 0x00bdaf (0xafa2 bytes) 000746 1770686128.043078 write 0x0348e2 thru 0x0398e9 (0x5008 bytes) 000748 1770686128.046404 write 0x0191d6 thru 0x0252cb (0xc0f6 bytes) 000749 1770686128.065751 MIRROR_SPLIT mirror 14 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x398ea): Mirror 8: 0x4ef542b1 (stale) Mirror 9: 0x4ef542b1 (stale) Mirror 11: 0x4ef542b1 (stale) Mirror 13: 0x4ef542b1 (stale) Mirror 14: 0x4ef542b1 (stale) Mirror 15: 0x4ef542b1 (stale) Mirror 16: 0x4ef542b1 (stale) Mirror 17: 0x4ef542b1 (stale) Mirror 18: 0x4ef542b1 (stale) Mirror 19: 0x4ef542b1 (stale) Mirror 20: 0x4ef542b1 (stale) Mirror 21: 0x4ef542b1 (stale) Mirror 22: 0x4ef542b1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x398ea): Mirror 8: 0x4ef542b1 (stale) Mirror 9: 0x4ef542b1 (stale) Mirror 11: 0x4ef542b1 (stale) Mirror 13: 0x4ef542b1 (stale) Mirror 14: 0x4ef542b1 (stale) Mirror 15: 0x4ef542b1 (stale) Mirror 16: 0x4ef542b1 (stale) Mirror 17: 0x4ef542b1 (stale) Mirror 18: 0x4ef542b1 (stale) Mirror 19: 0x4ef542b1 (stale) Mirror 20: 0x4ef542b1 (stale) Mirror 21: 0x4ef542b1 (stale) Mirror 22: 0x4ef542b1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x398ea: skipped 000752 1770686128.770912 mapwrite 0x032db8 thru 0x036f1d (0x4166 bytes) 000753 1770686128.836942 mapread 0x01e34e thru 0x0209f0 (0x26a3 bytes) 000755 1770686128.847979 trunc from 0x0398ea to 0x02db43 (0xbda6 bytes) 000756 1770686128.866415 MIRROR_SPLIT mirror 4 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2db44): Mirror 8: 0xac35462f (stale) Mirror 9: 0xac35462f (stale) Mirror 11: 0xac35462f (stale) Mirror 14: 0xac35462f (stale) Mirror 15: 0xac35462f (stale) Mirror 16: 0xac35462f (stale) Mirror 17: 0xac35462f (stale) Mirror 18: 0xac35462f (stale) Mirror 19: 0xac35462f (stale) Mirror 20: 0xac35462f (stale) Mirror 21: 0xac35462f (stale) Mirror 22: 0xac35462f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2db44): Mirror 8: 0xac35462f (stale) Mirror 9: 0xac35462f (stale) Mirror 11: 0xac35462f (stale) Mirror 14: 0xac35462f (stale) Mirror 15: 0xac35462f (stale) Mirror 16: 0xac35462f (stale) Mirror 17: 0xac35462f (stale) Mirror 18: 0xac35462f (stale) Mirror 19: 0xac35462f (stale) Mirror 20: 0xac35462f (stale) Mirror 21: 0xac35462f (stale) Mirror 22: 0xac35462f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2db44: skipped 000759 1770686129.520218 mapread 0x0033a8 thru 0x007ae1 (0x473a bytes) 000760 1770686129.546887 mapwrite 0x006345 thru 0x008819 (0x24d5 bytes) 000761 1770686129.619251 read 0x02a6bf thru 0x02db43 (0x3485 bytes) 000763 1770686129.628212 read 0x02cee0 thru 0x02db43 (0xc64 bytes) 000764 1770686129.629145 mapread 0x019e48 thru 0x020181 (0x633a bytes) 000765 1770686129.640046 mapwrite 0x01044a thru 0x01ea82 (0xe639 bytes) 000767 1770686129.701927 mapread 0x00f923 thru 0x01df3c (0xe61a bytes) 000768 1770686129.703871 trunc from 0x02db44 to 0x03d407 (0xf8c4 bytes) 000769 1770686129.735058 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3d408): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d408): Mirror 8: 0x8ca47ab (stale) Mirror 9: 0x8ca47ab (stale) Mirror 11: 0x8ca47ab (stale) Mirror 14: 0x8ca47ab (stale) Mirror 15: 0x8ca47ab (stale) Mirror 16: 0x8ca47ab (stale) Mirror 17: 0x8ca47ab (stale) Mirror 18: 0x8ca47ab (stale) Mirror 19: 0x8ca47ab (stale) Mirror 20: 0x8ca47ab (stale) Mirror 21: 0x8ca47ab (stale) Mirror 22: 0x8ca47ab (stale) CRC-32 checksum value for chunk [0, 0x3d408): Mirror 1: 0x4a6f00ff Mirror 23: 0x4a6f00ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d408: skipped 000770 1770686130.820642 MIRROR_RESYNC 14 mirrors 000772 1770686132.893792 read 0x02105e thru 0x030acb (0xfa6e bytes) 000773 1770686132.905294 write 0x0389fd thru 0x03ffff (0x7603 bytes) 000775 1770686133.014948 mapread 0x00246f thru 0x00749d (0x502f bytes) 000777 1770686133.036134 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xb0d12784 (stale) Mirror 11: 0xb0d12784 (stale) Mirror 14: 0xb0d12784 (stale) Mirror 15: 0xb0d12784 (stale) Mirror 16: 0xb0d12784 (stale) Mirror 17: 0xb0d12784 (stale) Mirror 18: 0xb0d12784 (stale) Mirror 19: 0xb0d12784 (stale) Mirror 20: 0xb0d12784 (stale) Mirror 21: 0xb0d12784 (stale) Mirror 22: 0xb0d12784 (stale) Mirror 23: 0xb0d12784 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xb0d12784 (stale) Mirror 11: 0xb0d12784 (stale) Mirror 14: 0xb0d12784 (stale) Mirror 15: 0xb0d12784 (stale) Mirror 16: 0xb0d12784 (stale) Mirror 17: 0xb0d12784 (stale) Mirror 18: 0xb0d12784 (stale) Mirror 19: 0xb0d12784 (stale) Mirror 20: 0xb0d12784 (stale) Mirror 21: 0xb0d12784 (stale) Mirror 22: 0xb0d12784 (stale) Mirror 23: 0xb0d12784 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000779 1770686133.938099 mapread 0x0244d5 thru 0x02c624 (0x8150 bytes) 000780 1770686133.962884 read 0x0262c8 thru 0x02b1eb (0x4f24 bytes) 000781 1770686133.968724 MIRROR_RESYNC 13 mirrors 000782 1770686136.168932 MIRROR_RESYNC 13 mirrors 000783 1770686136.947414 trunc from 0x040000 to 0x004ca1 (0x3b35e bytes) 000784 1770686137.082027 write 0x035de9 thru 0x03ffff (0xa217 bytes) 000785 1770686137.084782 mapwrite 0x013b85 thru 0x01c3b1 (0x882d bytes) 000787 1770686137.179601 read 0x02e3d4 thru 0x039e47 (0xba74 bytes) 000788 1770686137.189842 mapwrite 0x036b74 thru 0x03dabc (0x6f49 bytes) 000790 1770686137.239866 mapread 0x02a414 thru 0x038738 (0xe325 bytes) 000792 1770686137.249988 mapwrite 0x038c0f thru 0x03ffff (0x73f1 bytes) 000793 1770686137.315470 MIRROR_RESYNC 13 mirrors 000795 1770686139.708962 read 0x0009da thru 0x004bfd (0x4224 bytes) 000796 1770686139.713988 write 0x02bd54 thru 0x039e0d (0xe0ba bytes) 000797 1770686139.812991 read 0x02d0da thru 0x02d944 (0x86b bytes) 000799 1770686139.814029 read 0x030056 thru 0x033dcd (0x3d78 bytes) 000801 1770686139.815019 read 0x019c85 thru 0x0239af (0x9d2b bytes) 000804 1770686139.831429 mapwrite 0x01e2d9 thru 0x01eeba (0xbe2 bytes) 000805 1770686139.911402 trunc from 0x040000 to 0x0074a8 (0x38b57 bytes) 000806 1770686139.941486 write 0x03c53b thru 0x03e6c7 (0x218d bytes) 000808 1770686139.942980 trunc from 0x03e6c8 to 0x02568b (0x1903c bytes) 000809 1770686139.963279 write 0x002442 thru 0x008144 (0x5d03 bytes) 000810 1770686139.970278 read 0x017895 thru 0x01d271 (0x59dd bytes) 000812 1770686139.981604 write 0x0303f2 thru 0x0315fd (0x120c bytes) 000814 1770686139.982955 mapread 0x016e6b thru 0x020f2d (0xa0c3 bytes) 000816 1770686139.984986 mapread 0x02639f thru 0x029e7d (0x3adf bytes) 000817 1770686139.993574 trunc from 0x0315fe to 0x028515 (0x90e8 bytes) 000818 1770686140.013870 write 0x0136eb thru 0x015219 (0x1b2f bytes) 000820 1770686140.019793 read 0x00b7c6 thru 0x013b47 (0x8382 bytes) 000822 1770686140.021006 mapread 0x00888f thru 0x0142d9 (0xba4b bytes) 000826 1770686140.032507 read 0x022cfb thru 0x027fee (0x52f4 bytes) 000827 1770686140.033118 mapread 0x015809 thru 0x01b0d1 (0x58c9 bytes) 000828 1770686140.039124 write 0x02f41b thru 0x0351a6 (0x5d8c bytes) 000829 1770686140.041007 trunc from 0x0351a7 to 0x022859 (0x1294d bytes) 000830 1770686140.073955 read 0x00c67c thru 0x012ea5 (0x682a bytes) 000831 1770686140.074610 mapwrite 0x017175 thru 0x01a703 (0x358f bytes) 000833 1770686140.143600 read 0x01d0f4 thru 0x022859 (0x5766 bytes) 000837 1770686140.147228 write 0x002ad0 thru 0x00c90c (0x9e3d bytes) 000838 1770686140.153850 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2285a): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2285a): Mirror 9: 0xfda43ee8 (stale) Mirror 11: 0xfda43ee8 (stale) Mirror 14: 0xfda43ee8 (stale) Mirror 15: 0xfda43ee8 (stale) Mirror 16: 0xfda43ee8 (stale) Mirror 17: 0xfda43ee8 (stale) Mirror 18: 0xfda43ee8 (stale) Mirror 19: 0xfda43ee8 (stale) Mirror 20: 0xfda43ee8 (stale) Mirror 21: 0xfda43ee8 (stale) Mirror 22: 0xfda43ee8 (stale) Mirror 23: 0xfda43ee8 (stale) CRC-32 checksum value for chunk [0, 0x2285a): Mirror 1: 0x12b4d79a Mirror 24: 0x12b4d79a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2285a: skipped 000841 1770686141.205606 mapread 0x01b192 thru 0x01e0c1 (0x2f30 bytes) 000842 1770686141.254012 mapread 0x00e2ec thru 0x00f6fe (0x1413 bytes) 000843 1770686141.289680 MIRROR_RESYNC 14 mirrors 000845 1770686143.196872 MIRROR_RESYNC 14 mirrors 000846 1770686143.947896 MIRROR_SPLIT mirror 13 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) 000847 1770686144.710770 read 0x0136b5 thru 0x0171f7 (0x3b43 bytes) 000848 1770686144.718960 read 0x014b68 thru 0x018ef2 (0x438b bytes) 000850 1770686144.730908 write 0x03a9f2 thru 0x03c3b8 (0x19c7 bytes) 000852 1770686144.858233 write 0x0133d5 thru 0x01af79 (0x7ba5 bytes) 000853 1770686144.867484 write 0x03d168 thru 0x03ffff (0x2e98 bytes) 000855 1770686144.868967 mapread 0x03f5f9 thru 0x03ffff (0xa07 bytes) 000856 1770686144.870285 mapwrite 0x0214eb thru 0x030f0c (0xfa22 bytes) 000860 1770686144.934635 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xbce63aad (stale) Mirror 11: 0xbce63aad (stale) Mirror 14: 0xbce63aad (stale) Mirror 15: 0xbce63aad (stale) Mirror 16: 0xbce63aad (stale) Mirror 17: 0xbce63aad (stale) Mirror 18: 0xbce63aad (stale) Mirror 19: 0xbce63aad (stale) Mirror 20: 0xbce63aad (stale) Mirror 21: 0xbce63aad (stale) Mirror 22: 0xbce63aad (stale) Mirror 23: 0xbce63aad (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5049338d Mirror 24: 0x5049338d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000863 1770686146.417570 write 0x0005ff thru 0x00ae93 (0xa895 bytes) 000864 1770686146.578422 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xbce63aad (stale) Mirror 11: 0xbce63aad (stale) Mirror 14: 0xbce63aad (stale) Mirror 15: 0xbce63aad (stale) Mirror 16: 0xbce63aad (stale) Mirror 17: 0xbce63aad (stale) Mirror 18: 0xbce63aad (stale) Mirror 19: 0xbce63aad (stale) Mirror 20: 0xbce63aad (stale) Mirror 21: 0xbce63aad (stale) Mirror 22: 0xbce63aad (stale) Mirror 23: 0xbce63aad (stale) Mirror 24: 0x5049338d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x93f9ba0b Mirror 25: 0x93f9ba0b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000866 1770686148.119068 trunc from 0x040000 to 0x012eca (0x2d135 bytes) 000867 1770686148.354609 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x12ecb): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12ecb): Mirror 9: 0x9cc1360a (stale) Mirror 11: 0x9cc1360a (stale) Mirror 14: 0x9cc1360a (stale) Mirror 15: 0x9cc1360a (stale) Mirror 16: 0x9cc1360a (stale) Mirror 17: 0x9cc1360a (stale) Mirror 18: 0x9cc1360a (stale) Mirror 19: 0x9cc1360a (stale) Mirror 20: 0x9cc1360a (stale) Mirror 21: 0x9cc1360a (stale) Mirror 22: 0x9cc1360a (stale) Mirror 23: 0x9cc1360a (stale) Mirror 24: 0x9cc1360a (stale) Mirror 25: 0x63474fab (stale) CRC-32 checksum value for chunk [0, 0x12ecb): Mirror 1: 0x63474fab Mirror 26: 0x63474fab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12ecb: skipped 000869 1770686149.754869 write 0x024997 thru 0x0272f4 (0x295e bytes) 000871 1770686149.894405 mapread 0x0213dc thru 0x0272f4 (0x5f19 bytes) 000872 1770686149.944249 MIRROR_SPLIT mirror 12 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x272f5): Mirror 9: 0x5f230646 (stale) Mirror 11: 0x5f230646 (stale) Mirror 14: 0x5f230646 (stale) Mirror 15: 0x5f230646 (stale) Mirror 16: 0x5f230646 (stale) Mirror 17: 0x5f230646 (stale) Mirror 18: 0x5f230646 (stale) Mirror 19: 0x5f230646 (stale) Mirror 20: 0x5f230646 (stale) Mirror 21: 0x5f230646 (stale) Mirror 22: 0x5f230646 (stale) Mirror 24: 0xbe4bd15a (stale) Mirror 25: 0x4cdc610 (stale) Mirror 26: 0x38f39311 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x272f5): Mirror 9: 0x5f230646 (stale) Mirror 11: 0x5f230646 (stale) Mirror 14: 0x5f230646 (stale) Mirror 15: 0x5f230646 (stale) Mirror 16: 0x5f230646 (stale) Mirror 17: 0x5f230646 (stale) Mirror 18: 0x5f230646 (stale) Mirror 19: 0x5f230646 (stale) Mirror 20: 0x5f230646 (stale) Mirror 21: 0x5f230646 (stale) Mirror 22: 0x5f230646 (stale) Mirror 24: 0xbe4bd15a (stale) Mirror 25: 0x4cdc610 (stale) Mirror 26: 0x38f39311 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x272f5: skipped 000873 1770686151.019736 trunc from 0x0272f5 to 0x01df89 (0x936b bytes) 000874 1770686151.071716 mapwrite 0x034de0 thru 0x03f786 (0xa9a7 bytes) 000875 1770686151.356136 write 0x023b6e thru 0x031487 (0xd91a bytes) 000876 1770686151.389030 read 0x037dc9 thru 0x03b642 (0x387a bytes) 000877 1770686151.397139 mapwrite 0x039a69 thru 0x03ffff (0x6597 bytes) 000878 1770686151.564611 read 0x005afc thru 0x0138e6 (0xddeb bytes) 000881 1770686151.587594 mapwrite 0x02ea05 thru 0x0340d9 (0x56d5 bytes) 000882 1770686151.719979 read 0x01f558 thru 0x02ccb6 (0xd75f bytes) 000884 1770686151.721998 mapwrite 0x029bbb thru 0x036f29 (0xd36f bytes) 000888 1770686151.814862 mapwrite 0x03995c thru 0x03a5d9 (0xc7e bytes) 000889 1770686151.870923 MIRROR_SPLIT mirror 7 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xbce63aad (stale) Mirror 11: 0xbce63aad (stale) Mirror 14: 0xbce63aad (stale) Mirror 15: 0xbce63aad (stale) Mirror 16: 0xbce63aad (stale) Mirror 17: 0xbce63aad (stale) Mirror 19: 0xbce63aad (stale) Mirror 20: 0xbce63aad (stale) Mirror 21: 0xbce63aad (stale) Mirror 22: 0xbce63aad (stale) Mirror 24: 0x5049338d (stale) Mirror 25: 0x93f9ba0b (stale) Mirror 26: 0x57c0d017 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xbce63aad (stale) Mirror 11: 0xbce63aad (stale) Mirror 14: 0xbce63aad (stale) Mirror 15: 0xbce63aad (stale) Mirror 16: 0xbce63aad (stale) Mirror 17: 0xbce63aad (stale) Mirror 19: 0xbce63aad (stale) Mirror 20: 0xbce63aad (stale) Mirror 21: 0xbce63aad (stale) Mirror 22: 0xbce63aad (stale) Mirror 24: 0x5049338d (stale) Mirror 25: 0x93f9ba0b (stale) Mirror 26: 0x57c0d017 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000890 1770686152.722714 mapread 0x01bce2 thru 0x021b80 (0x5e9f bytes) 000894 1770686152.748595 MIRROR_RESYNC 14 mirrors 000895 1770686155.346731 MIRROR_EXTEND to 15 mirrors 000896 1770686156.173875 read 0x00b304 thru 0x014c31 (0x992e bytes) 000897 1770686156.187867 mapwrite 0x00370a thru 0x0087ae (0x50a5 bytes) 000898 1770686156.502669 trunc from 0x040000 to 0x037e06 (0x81f9 bytes) 000902 1770686156.566410 mapwrite 0x011a08 thru 0x01fb07 (0xe100 bytes) 000903 1770686156.679563 write 0x01931e thru 0x01afee (0x1cd1 bytes) 000906 1770686156.682895 write 0x037d85 thru 0x03ffff (0x827b bytes) 000909 1770686156.706588 MIRROR_SPLIT mirror 11 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xaaf909d6 (stale) Mirror 11: 0xaaf909d6 (stale) Mirror 14: 0xaaf909d6 (stale) Mirror 15: 0xaaf909d6 (stale) Mirror 16: 0xaaf909d6 (stale) Mirror 17: 0xaaf909d6 (stale) Mirror 19: 0xaaf909d6 (stale) Mirror 20: 0xaaf909d6 (stale) Mirror 21: 0xaaf909d6 (stale) Mirror 22: 0xaaf909d6 (stale) Mirror 25: 0xaaf909d6 (stale) Mirror 26: 0xaaf909d6 (stale) Mirror 27: 0xaaf909d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xaaf909d6 (stale) Mirror 11: 0xaaf909d6 (stale) Mirror 14: 0xaaf909d6 (stale) Mirror 15: 0xaaf909d6 (stale) Mirror 16: 0xaaf909d6 (stale) Mirror 17: 0xaaf909d6 (stale) Mirror 19: 0xaaf909d6 (stale) Mirror 20: 0xaaf909d6 (stale) Mirror 21: 0xaaf909d6 (stale) Mirror 22: 0xaaf909d6 (stale) Mirror 25: 0xaaf909d6 (stale) Mirror 26: 0xaaf909d6 (stale) Mirror 27: 0xaaf909d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000911 1770686157.649725 write 0x0183d1 thru 0x01db1a (0x574a bytes) 000912 1770686157.662883 mapwrite 0x022458 thru 0x02f3f3 (0xcf9c bytes) 000913 1770686157.754250 write 0x0376c2 thru 0x03af05 (0x3844 bytes) 000917 1770686157.769744 mapwrite 0x02cd07 thru 0x0340c0 (0x73ba bytes) 000918 1770686157.828969 trunc from 0x040000 to 0x014082 (0x2bf7d bytes) 000923 1770686157.859008 write 0x0006bf thru 0x0009e2 (0x324 bytes) 000924 1770686157.872668 trunc from 0x014083 to 0x01860b (0x4589 bytes) 000925 1770686157.908761 mapwrite 0x01135f thru 0x01abf7 (0x9899 bytes) 000927 1770686158.109950 write 0x01c5cc thru 0x02739d (0xadd2 bytes) 000931 1770686158.122933 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x2739e): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2739e): Mirror 9: 0xda7a44d3 (stale) Mirror 11: 0xda7a44d3 (stale) Mirror 14: 0xda7a44d3 (stale) Mirror 15: 0xda7a44d3 (stale) Mirror 16: 0xda7a44d3 (stale) Mirror 17: 0xda7a44d3 (stale) Mirror 19: 0xda7a44d3 (stale) Mirror 20: 0xda7a44d3 (stale) Mirror 21: 0xda7a44d3 (stale) Mirror 22: 0xda7a44d3 (stale) Mirror 25: 0xda7a44d3 (stale) Mirror 26: 0xda7a44d3 (stale) Mirror 27: 0xda7a44d3 (stale) CRC-32 checksum value for chunk [0, 0x2739e): Mirror 1: 0xfd51b0eb Mirror 28: 0xfd51b0eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2739e: skipped 000932 1770686159.534743 mapread 0x01bfe9 thru 0x01db6e (0x1b86 bytes) 000934 1770686159.574851 trunc from 0x02739e to 0x020ad9 (0x68c4 bytes) 000935 1770686159.707616 MIRROR_RESYNC 15 mirrors 000937 1770686161.921638 trunc from 0x020ada to 0x037a92 (0x16fb9 bytes) 000939 1770686162.014011 mapread 0x02b4d8 thru 0x031897 (0x63c0 bytes) 000940 1770686162.032974 mapwrite 0x009912 thru 0x016060 (0xc74f bytes) 000943 1770686162.182171 write 0x0167df thru 0x0240bc (0xd8de bytes) 000944 1770686162.204577 MIRROR_SPLIT mirror 13 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37a93): Mirror 9: 0x4d2399bf (stale) Mirror 11: 0x4d2399bf (stale) Mirror 14: 0x4d2399bf (stale) Mirror 15: 0x4d2399bf (stale) Mirror 16: 0x4d2399bf (stale) Mirror 17: 0x4d2399bf (stale) Mirror 19: 0x4d2399bf (stale) Mirror 20: 0x4d2399bf (stale) Mirror 21: 0x4d2399bf (stale) Mirror 22: 0x4d2399bf (stale) Mirror 25: 0x4d2399bf (stale) Mirror 26: 0x4d2399bf (stale) Mirror 28: 0x4d2399bf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37a93): Mirror 9: 0x4d2399bf (stale) Mirror 11: 0x4d2399bf (stale) Mirror 14: 0x4d2399bf (stale) Mirror 15: 0x4d2399bf (stale) Mirror 16: 0x4d2399bf (stale) Mirror 17: 0x4d2399bf (stale) Mirror 19: 0x4d2399bf (stale) Mirror 20: 0x4d2399bf (stale) Mirror 21: 0x4d2399bf (stale) Mirror 22: 0x4d2399bf (stale) Mirror 25: 0x4d2399bf (stale) Mirror 26: 0x4d2399bf (stale) Mirror 28: 0x4d2399bf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37a93: skipped 000945 1770686162.885095 write 0x03fdf5 thru 0x03ffff (0x20b bytes) 000946 1770686162.886168 mapread 0x0121ca thru 0x0218b4 (0xf6eb bytes) 000948 1770686162.915701 trunc from 0x040000 to 0x030989 (0xf676 bytes) 000950 1770686162.937621 trunc from 0x03098a to 0x00d572 (0x23417 bytes) 000951 1770686162.958804 read 0x004a16 thru 0x0070d0 (0x26bb bytes) 000952 1770686162.975784 MIRROR_RESYNC 14 mirrors 000955 1770686165.138745 write 0x025dbc thru 0x02819a (0x23df bytes) 000956 1770686165.222120 mapwrite 0x00ee58 thru 0x018138 (0x92e1 bytes) 000958 1770686165.297710 read 0x02591c thru 0x027eff (0x25e4 bytes) 000959 1770686165.302161 MIRROR_RESYNC 14 mirrors 000961 1770686167.167909 mapwrite 0x0048fb thru 0x0112b1 (0xc9b7 bytes) 000962 1770686167.501740 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x2819b): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2819b): Mirror 9: 0x8520af8 (stale) Mirror 11: 0x8520af8 (stale) Mirror 14: 0x8520af8 (stale) Mirror 15: 0x8520af8 (stale) Mirror 16: 0x8520af8 (stale) Mirror 17: 0x8520af8 (stale) Mirror 19: 0x8520af8 (stale) Mirror 20: 0x8520af8 (stale) Mirror 21: 0x8520af8 (stale) Mirror 22: 0x8520af8 (stale) Mirror 25: 0x8520af8 (stale) Mirror 26: 0x8520af8 (stale) Mirror 28: 0x8520af8 (stale) CRC-32 checksum value for chunk [0, 0x2819b): Mirror 1: 0xdde9e5b5 Mirror 29: 0xdde9e5b5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2819b: skipped 000965 1770686168.779595 mapwrite 0x03b1e7 thru 0x03ffff (0x4e19 bytes) 000966 1770686168.939262 mapwrite 0x03ca5a thru 0x03ffff (0x35a6 bytes) 000968 1770686168.990018 MIRROR_SPLIT mirror 12 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x165b2022 (stale) Mirror 11: 0x165b2022 (stale) Mirror 14: 0x165b2022 (stale) Mirror 15: 0x165b2022 (stale) Mirror 16: 0x165b2022 (stale) Mirror 17: 0x165b2022 (stale) Mirror 19: 0x165b2022 (stale) Mirror 20: 0x165b2022 (stale) Mirror 21: 0x165b2022 (stale) Mirror 22: 0x165b2022 (stale) Mirror 25: 0x165b2022 (stale) Mirror 28: 0x165b2022 (stale) Mirror 29: 0xa30b1e2e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x165b2022 (stale) Mirror 11: 0x165b2022 (stale) Mirror 14: 0x165b2022 (stale) Mirror 15: 0x165b2022 (stale) Mirror 16: 0x165b2022 (stale) Mirror 17: 0x165b2022 (stale) Mirror 19: 0x165b2022 (stale) Mirror 20: 0x165b2022 (stale) Mirror 21: 0x165b2022 (stale) Mirror 22: 0x165b2022 (stale) Mirror 25: 0x165b2022 (stale) Mirror 28: 0x165b2022 (stale) Mirror 29: 0xa30b1e2e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000969 1770686169.665852 mapwrite 0x01932c thru 0x01a26c (0xf41 bytes) 000970 1770686169.717762 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x165b2022 (stale) Mirror 14: 0x165b2022 (stale) Mirror 15: 0x165b2022 (stale) Mirror 16: 0x165b2022 (stale) Mirror 17: 0x165b2022 (stale) Mirror 19: 0x165b2022 (stale) Mirror 20: 0x165b2022 (stale) Mirror 21: 0x165b2022 (stale) Mirror 22: 0x165b2022 (stale) Mirror 25: 0x165b2022 (stale) Mirror 28: 0x165b2022 (stale) Mirror 29: 0xa30b1e2e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x165b2022 (stale) Mirror 14: 0x165b2022 (stale) Mirror 15: 0x165b2022 (stale) Mirror 16: 0x165b2022 (stale) Mirror 17: 0x165b2022 (stale) Mirror 19: 0x165b2022 (stale) Mirror 20: 0x165b2022 (stale) Mirror 21: 0x165b2022 (stale) Mirror 22: 0x165b2022 (stale) Mirror 25: 0x165b2022 (stale) Mirror 28: 0x165b2022 (stale) Mirror 29: 0xa30b1e2e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000974 1770686170.358458 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x165b2022 (stale) Mirror 14: 0x165b2022 (stale) Mirror 15: 0x165b2022 (stale) Mirror 16: 0x165b2022 (stale) Mirror 17: 0x165b2022 (stale) Mirror 19: 0x165b2022 (stale) Mirror 20: 0x165b2022 (stale) Mirror 21: 0x165b2022 (stale) Mirror 22: 0x165b2022 (stale) Mirror 28: 0x165b2022 (stale) Mirror 29: 0xa30b1e2e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x165b2022 (stale) Mirror 14: 0x165b2022 (stale) Mirror 15: 0x165b2022 (stale) Mirror 16: 0x165b2022 (stale) Mirror 17: 0x165b2022 (stale) Mirror 19: 0x165b2022 (stale) Mirror 20: 0x165b2022 (stale) Mirror 21: 0x165b2022 (stale) Mirror 22: 0x165b2022 (stale) Mirror 28: 0x165b2022 (stale) Mirror 29: 0xa30b1e2e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000975 1770686170.968157 mapread 0x01cb60 thru 0x026c04 (0xa0a5 bytes) 000978 1770686171.011321 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x165b2022 (stale) Mirror 14: 0x165b2022 (stale) Mirror 15: 0x165b2022 (stale) Mirror 16: 0x165b2022 (stale) Mirror 17: 0x165b2022 (stale) Mirror 19: 0x165b2022 (stale) Mirror 20: 0x165b2022 (stale) Mirror 21: 0x165b2022 (stale) Mirror 22: 0x165b2022 (stale) Mirror 28: 0x165b2022 (stale) Mirror 29: 0xa30b1e2e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb5aa2d75 Mirror 30: 0xb5aa2d75 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000981 1770686172.254822 mapread 0x0318a8 thru 0x03a281 (0x89da bytes) 000983 1770686172.304319 trunc from 0x040000 to 0x00633d (0x39cc2 bytes) 000984 1770686172.393833 trunc from 0x00633e to 0x03c394 (0x36057 bytes) 000987 1770686172.420908 trunc from 0x03c395 to 0x02b6f7 (0x10c9d bytes) 000989 1770686172.445124 MIRROR_SPLIT mirror 7 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b6f8): Mirror 11: 0x99c09b27 (stale) Mirror 14: 0x99c09b27 (stale) Mirror 15: 0x99c09b27 (stale) Mirror 16: 0x99c09b27 (stale) Mirror 17: 0x99c09b27 (stale) Mirror 19: 0x99c09b27 (stale) Mirror 21: 0x99c09b27 (stale) Mirror 22: 0x99c09b27 (stale) Mirror 28: 0x99c09b27 (stale) Mirror 29: 0xb12a6ad4 (stale) Mirror 30: 0x689fc8b9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b6f8): Mirror 11: 0x99c09b27 (stale) Mirror 14: 0x99c09b27 (stale) Mirror 15: 0x99c09b27 (stale) Mirror 16: 0x99c09b27 (stale) Mirror 17: 0x99c09b27 (stale) Mirror 19: 0x99c09b27 (stale) Mirror 21: 0x99c09b27 (stale) Mirror 22: 0x99c09b27 (stale) Mirror 28: 0x99c09b27 (stale) Mirror 29: 0xb12a6ad4 (stale) Mirror 30: 0x689fc8b9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b6f8: skipped 000991 1770686173.128292 mapwrite 0x02f23d thru 0x032d3f (0x3b03 bytes) 000992 1770686173.244482 mapread 0x032cdb thru 0x032d3f (0x65 bytes) 000993 1770686173.245417 mapwrite 0x01d0b2 thru 0x02823b (0xb18a bytes) 000995 1770686173.306536 read 0x00f096 thru 0x01b7f6 (0xc761 bytes) 000996 1770686173.314658 read 0x00da69 thru 0x01d43f (0xf9d7 bytes) 000998 1770686173.323401 trunc from 0x032d40 to 0x01df25 (0x14e1a bytes) 000999 1770686173.339643 write 0x027186 thru 0x0283f9 (0x1274 bytes) 001000 1770686173.341534 read 0x00d08b thru 0x0136ca (0x6640 bytes) All operations completed A-OK!