== sanity-flr test 70a: flr mode fsx test ================ 18:26:31 (1790979991) Seed set to 9994 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1790979994.641916 write 0x035b01 thru 0x03ade9 (0x52e9 bytes) truncating to largest ever: 0x3ed41 000002 1790979994.656700 trunc from 0x03adea to 0x03ed40 (0x3f57 bytes) 000003 1790979994.694592 read 0x034978 thru 0x03ed40 (0xa3c9 bytes) 000004 1790979994.715992 punch from 0x037b8d to 0x03ebaa (0x701e bytes) 000005 1790979994.744583 mapread 0x02e3d9 thru 0x032230 (0x3e58 bytes) 000006 1790979994.778319 write 0x019f50 thru 0x0238cb (0x997c bytes) 000008 1790979994.800315 mapwrite 0x031b88 thru 0x03d618 (0xba91 bytes) 000009 1790979994.960087 mapwrite 0x02a301 thru 0x037cf9 (0xd9f9 bytes) 000010 1790979995.068503 mapwrite 0x009c40 thru 0x0199e9 (0xfdaa bytes) 000011 1790979995.168756 read 0x02cbb4 thru 0x0398e2 (0xcd2f bytes) 000012 1790979995.169507 read 0x010e88 thru 0x01f9bf (0xeb38 bytes) 000013 1790979995.170160 punch from 0x006deb to 0x011351 (0xa567 bytes) 000016 1790979995.179781 trunc from 0x03ed41 to 0x02f8d0 (0xf470 bytes) 000018 1790979995.195638 punch from 0x00239d to 0x0076cf (0x5333 bytes) 000019 1790979995.202107 mapwrite 0x017c41 thru 0x01f116 (0x74d6 bytes) 000020 1790979995.252479 mapread 0x0167d8 thru 0x01d987 (0x71b0 bytes) 000022 1790979995.254056 trunc from 0x02f8d1 to 0x0035b7 (0x2c319 bytes) 000023 1790979995.271155 trunc from 0x0035b8 to 0x01184b (0xe294 bytes) 000025 1790979995.289804 mapwrite 0x034ba2 thru 0x03be2b (0x728a bytes) 000026 1790979995.394409 write 0x0170c4 thru 0x01c19b (0x50d8 bytes) 000027 1790979995.396757 punch from 0x00dc32 to 0x013274 (0x5643 bytes) 000030 1790979995.415822 punch from 0x012ad9 to 0x0142b2 (0x17da bytes) 000032 1790979995.421488 mapwrite 0x00b758 thru 0x0169ed (0xb296 bytes) 000034 1790979995.510046 read 0x01c5d3 thru 0x02a287 (0xdcb5 bytes) 000035 1790979995.512717 mapread 0x00887f thru 0x015ab6 (0xd238 bytes) 000036 1790979995.519212 mapwrite 0x01b8a1 thru 0x0258fa (0xa05a bytes) 000038 1790979995.585614 mapwrite 0x038f7d thru 0x03ffff (0x7083 bytes) 000039 1790979995.696537 punch from 0x01c3a5 to 0x022f86 (0x6be2 bytes) 000041 1790979995.710465 write 0x016a4e thru 0x025664 (0xec17 bytes) 000042 1790979995.713437 mapread 0x02015e thru 0x02c92a (0xc7cd bytes) 000045 1790979995.717767 mapwrite 0x002d26 thru 0x00e781 (0xba5c bytes) 000046 1790979995.803491 trunc from 0x040000 to 0x03504e (0xafb1 bytes) 000047 1790979995.843762 mapwrite 0x03a714 thru 0x03ffff (0x58ec bytes) 000048 1790979995.962920 read 0x014414 thru 0x021060 (0xcc4d bytes) 000050 1790979995.964016 mapwrite 0x0246cf thru 0x02a4f5 (0x5e27 bytes) 000051 1790979996.010187 trunc from 0x040000 to 0x006dcc (0x39233 bytes) 000052 1790979996.037668 write 0x00e683 thru 0x011e9a (0x3818 bytes) 000053 1790979996.046891 MIRROR_EXTEND to 2 mirrors 000056 1790979997.346336 read 0x006f5f thru 0x00fdb7 (0x8e59 bytes) 000057 1790979997.369347 MIRROR_EXTEND to 3 mirrors 000060 1790979998.352900 read 0x00d9a8 thru 0x00f7be (0x1e17 bytes) 000061 1790979998.375089 MIRROR_EXTEND to 4 mirrors 000062 1790979999.548574 mapread 0x00e6d9 thru 0x011e9a (0x37c2 bytes) 000065 1790979999.573523 trunc from 0x011e9b to 0x01d265 (0xb3cb bytes) 000067 1790979999.666514 mapread 0x010368 thru 0x01d1c5 (0xce5e bytes) 000068 1790979999.696555 read 0x01047c thru 0x01c3fd (0xbf82 bytes) 000069 1790979999.703975 MIRROR_RESYNC 4 mirrors 000070 1790980001.226353 mapwrite 0x000ae3 thru 0x006478 (0x5996 bytes) 000071 1790980001.501687 MIRROR_RESYNC 4 mirrors 000072 1790980003.105333 trunc from 0x01d266 to 0x035d8c (0x18b27 bytes) 000073 1790980003.195652 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x35d8d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35d8d): Mirror 2: 0xd91e62c9 (stale) Mirror 3: 0xd91e62c9 (stale) Mirror 4: 0xd91e62c9 (stale) CRC-32 checksum value for chunk [0, 0x35d8d): Mirror 1: 0xd91e62c9 Mirror 5: 0xd91e62c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35d8d: skipped 000074 1790980004.570132 trunc from 0x035d8d to 0x023742 (0x1264a bytes) 000075 1790980004.762775 read 0x0117d2 thru 0x01527d (0x3aac bytes) 000076 1790980004.791584 punch from 0x00d465 to 0x01ac2e (0xd7ca bytes) 000078 1790980004.803798 mapwrite 0x03c35d thru 0x03ffff (0x3ca3 bytes) 000079 1790980005.009234 mapread 0x01d6b9 thru 0x022e23 (0x576b bytes) 000080 1790980005.042968 trunc from 0x040000 to 0x00c706 (0x338f9 bytes) 000081 1790980005.079426 read 0x0058ed thru 0x00c706 (0x6e1a bytes) 000082 1790980005.093073 read 0x003212 thru 0x00c706 (0x94f5 bytes) 000083 1790980005.096986 write 0x017d8f thru 0x0180f1 (0x363 bytes) 000087 1790980005.107332 mapread 0x017594 thru 0x0180f1 (0xb5e bytes) 000089 1790980005.108870 read 0x00f6a9 thru 0x010810 (0x1168 bytes) 000090 1790980005.125057 trunc from 0x0180f2 to 0x005f92 (0x1215f bytes) 000091 1790980005.157683 punch from 0x004855 to 0x005f92 (0x173e bytes) 000093 1790980005.164519 read 0x0029d1 thru 0x005f92 (0x35c2 bytes) 000094 1790980005.173516 punch from 0x001625 to 0x005f92 (0x496e bytes) 000095 1790980005.183182 mapwrite 0x03e9e3 thru 0x03f465 (0xa83 bytes) 000096 1790980005.359324 trunc from 0x03f466 to 0x02c043 (0x13422 bytes) 000097 1790980005.393402 write 0x005b74 thru 0x013ee7 (0xe374 bytes) 000098 1790980005.415575 MIRROR_RESYNC 5 mirrors 000099 1790980007.005280 write 0x021d70 thru 0x02b56c (0x97fd bytes) 000100 1790980007.092280 write 0x0060a7 thru 0x014c14 (0xeb6e bytes) 000101 1790980007.103407 write 0x01856f thru 0x020fc9 (0x8a5b bytes) 000104 1790980007.115460 mapread 0x01bbad thru 0x01caf9 (0xf4d bytes) 000105 1790980007.121634 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2c044): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c044): Mirror 2: 0x637763a1 (stale) Mirror 3: 0x637763a1 (stale) Mirror 4: 0x637763a1 (stale) Mirror 5: 0x637763a1 (stale) CRC-32 checksum value for chunk [0, 0x2c044): Mirror 1: 0xb45e7f8b Mirror 6: 0xb45e7f8b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c044: skipped 000106 1790980008.081379 write 0x004729 thru 0x005228 (0xb00 bytes) 000107 1790980008.211657 read 0x008966 thru 0x00fc06 (0x72a1 bytes) 000109 1790980008.240747 mapwrite 0x004c6f thru 0x004d1b (0xad bytes) 000110 1790980008.292292 trunc from 0x02c044 to 0x023ee8 (0x815b bytes) 000111 1790980008.334314 write 0x014a05 thru 0x016f8c (0x2588 bytes) 000112 1790980008.347152 mapwrite 0x002865 thru 0x00338c (0xb28 bytes) 000113 1790980008.443146 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23ee9): Mirror 3: 0xd344b28e (stale) Mirror 4: 0xd344b28e (stale) Mirror 5: 0xd344b28e (stale) Mirror 6: 0xfcff8ae3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23ee9): Mirror 3: 0xd344b28e (stale) Mirror 4: 0xd344b28e (stale) Mirror 5: 0xd344b28e (stale) Mirror 6: 0xfcff8ae3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23ee9: skipped 000114 1790980008.933174 trunc from 0x023ee9 to 0x0202e4 (0x3c04 bytes) 000115 1790980008.966243 read 0x003f6e thru 0x004370 (0x403 bytes) 000117 1790980008.983174 mapread 0x014ddf thru 0x01e49a (0x96bc bytes) 000119 1790980009.022620 mapwrite 0x003606 thru 0x008dd2 (0x57cd bytes) 000122 1790980009.140818 read 0x008484 thru 0x013860 (0xb3dd bytes) 000124 1790980009.142512 punch from 0x002a29 to 0x0032e5 (0x8bd bytes) 000125 1790980009.150131 trunc from 0x0202e5 to 0x034cc6 (0x149e2 bytes) 000126 1790980009.182903 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34cc7): Mirror 4: 0xa49f46c6 (stale) Mirror 5: 0xa49f46c6 (stale) Mirror 6: 0x254118a5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34cc7): Mirror 4: 0xa49f46c6 (stale) Mirror 5: 0xa49f46c6 (stale) Mirror 6: 0x254118a5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34cc7: skipped 000127 1790980009.580574 mapwrite 0x01057b thru 0x01bd30 (0xb7b6 bytes) 000128 1790980009.716874 write 0x01470b thru 0x0234b3 (0xeda9 bytes) 000130 1790980009.724873 mapread 0x01b47a thru 0x020ec4 (0x5a4b bytes) 000131 1790980009.728662 trunc from 0x034cc7 to 0x00141e (0x338a8 bytes) 000132 1790980009.764021 mapread 0x00091d thru 0x00141e (0xb02 bytes) 000133 1790980009.772317 punch from 0x0007fb to 0x00141e (0xc24 bytes) 000134 1790980009.782970 punch from 0x000cc8 to 0x00141e (0x757 bytes) 000135 1790980009.797779 write 0x022368 thru 0x02782f (0x54c8 bytes) 000136 1790980009.800361 punch from 0x0061bb to 0x00af26 (0x4d6c bytes) 000137 1790980009.815370 read 0x0203a6 thru 0x02782f (0x748a bytes) 000138 1790980009.821358 punch from 0x001c98 to 0x0109ff (0xed68 bytes) 000139 1790980009.829314 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27830): Mirror 4: 0x1c536ba7 (stale) Mirror 6: 0x96c9fabf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27830): Mirror 4: 0x1c536ba7 (stale) Mirror 6: 0x96c9fabf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27830: skipped 000140 1790980010.310537 read 0x003ae5 thru 0x009374 (0x5890 bytes) 000141 1790980010.342217 mapread 0x01e8f4 thru 0x023cc2 (0x53cf bytes) 000142 1790980010.373957 trunc from 0x027830 to 0x007ed5 (0x1f95a bytes) 000143 1790980010.427061 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x7ed6): Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7ed6): Mirror 4: 0xc0a9bf35 (stale) Mirror 6: 0x85c0af57 (stale) CRC-32 checksum value for chunk [0, 0x7ed6): Mirror 1: 0x91408315 Mirror 7: 0x91408315 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7ed6: skipped 000145 1790980011.482772 read 0x001afd thru 0x007ed5 (0x63d9 bytes) 000146 1790980011.526006 trunc from 0x007ed6 to 0x027597 (0x1f6c2 bytes) 000149 1790980011.777539 read 0x0254f4 thru 0x027597 (0x20a4 bytes) 000150 1790980011.815430 write 0x0131cd thru 0x01deb1 (0xace5 bytes) 000151 1790980011.816803 mapread 0x026d71 thru 0x027015 (0x2a5 bytes) 000152 1790980011.827451 punch from 0x01b8de to 0x0240d8 (0x87fb bytes) 000154 1790980011.861953 trunc from 0x027598 to 0x01bf68 (0xb62f bytes) 000155 1790980011.930378 write 0x02cbd5 thru 0x02cfaa (0x3d6 bytes) 000156 1790980011.943012 MIRROR_RESYNC 4 mirrors 000157 1790980013.588809 read 0x02a01c thru 0x02cfaa (0x2f8f bytes) 000158 1790980013.599496 punch from 0x02b71b to 0x02cfaa (0x1890 bytes) 000159 1790980013.747123 write 0x0349fd thru 0x0373b6 (0x29ba bytes) 000160 1790980013.748335 mapread 0x02aced thru 0x02eead (0x41c1 bytes) 000161 1790980013.794231 mapwrite 0x036870 thru 0x03efa8 (0x8739 bytes) 000162 1790980013.983479 read 0x02e11c thru 0x038499 (0xa37e bytes) 000163 1790980013.984627 mapread 0x0342a6 thru 0x039417 (0x5172 bytes) 000164 1790980013.987355 trunc from 0x03efa9 to 0x013453 (0x2bb55 bytes) 000166 1790980014.008377 write 0x0376a1 thru 0x03ffff (0x895f bytes) 000167 1790980014.010531 trunc from 0x040000 to 0x017d7d (0x28282 bytes) 000168 1790980014.034289 mapread 0x00d568 thru 0x012d97 (0x5830 bytes) 000170 1790980014.048155 read 0x0048f1 thru 0x00d8fa (0x900a bytes) 000171 1790980014.049571 mapwrite 0x004910 thru 0x00de92 (0x9583 bytes) 000172 1790980014.143353 punch from 0x004f77 to 0x00557e (0x608 bytes) 000174 1790980014.152355 mapwrite 0x012068 thru 0x01eedb (0xce74 bytes) 000178 1790980014.276007 write 0x02ebd7 thru 0x02f397 (0x7c1 bytes) 000180 1790980014.301448 punch from 0x00b3a7 to 0x0175c4 (0xc21e bytes) 000181 1790980014.327962 punch from 0x001751 to 0x0084cb (0x6d7b bytes) 000184 1790980014.336694 mapread 0x02c972 thru 0x02f397 (0x2a26 bytes) 000186 1790980014.353451 mapwrite 0x01638f thru 0x017b91 (0x1803 bytes) 000188 1790980014.455302 trunc from 0x02f398 to 0x02fd31 (0x99a bytes) 000189 1790980014.477379 punch from 0x021c3a to 0x024e6d (0x3234 bytes) 000191 1790980014.483816 write 0x0016b9 thru 0x0091bd (0x7b05 bytes) 000192 1790980014.494963 punch from 0x00c3d1 to 0x013182 (0x6db2 bytes) 000194 1790980014.534754 MIRROR_RESYNC 4 mirrors 000195 1790980016.407532 mapread 0x02e907 thru 0x02fd31 (0x142b bytes) 000198 1790980016.424240 write 0x0328ce thru 0x03d3ad (0xaae0 bytes) 000199 1790980016.494517 mapwrite 0x02541e thru 0x02a527 (0x510a bytes) 000200 1790980016.618946 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d3ae): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3ae): Mirror 4: 0xdf149bb3 (stale) Mirror 6: 0xdf149bb3 (stale) Mirror 7: 0xdf149bb3 (stale) CRC-32 checksum value for chunk [0, 0x3d3ae): Mirror 1: 0x1aebff99 Mirror 8: 0x1aebff99 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3ae: skipped 000201 1790980017.789350 trunc from 0x03d3ae to 0x008f6e (0x3443f bytes) 000206 1790980017.944686 mapwrite 0x02a2c6 thru 0x02a341 (0x7c bytes) 000207 1790980018.096597 trunc from 0x02a342 to 0x03cffb (0x12cba bytes) 000208 1790980018.126407 mapwrite 0x0345dd thru 0x03ffff (0xba23 bytes) 000212 1790980018.276453 mapwrite 0x0399f8 thru 0x03a43f (0xa48 bytes) 000213 1790980018.368795 write 0x039317 thru 0x03b4d4 (0x21be bytes) 000214 1790980018.374365 punch from 0x00151a to 0x00d271 (0xbd58 bytes) 000216 1790980018.395491 mapwrite 0x02689f thru 0x035987 (0xf0e9 bytes) 000217 1790980018.533160 punch from 0x0194a7 to 0x01df77 (0x4ad1 bytes) 000218 1790980018.549489 mapread 0x00851c thru 0x00ca5f (0x4544 bytes) 000220 1790980018.569523 mapread 0x0114cd thru 0x017066 (0x5b9a bytes) 000221 1790980018.597768 mapread 0x02c6b8 thru 0x0314d0 (0x4e19 bytes) 000222 1790980018.598964 mapread 0x017e83 thru 0x02201e (0xa19c bytes) 000224 1790980018.608370 write 0x034ee4 thru 0x03ab35 (0x5c52 bytes) 000225 1790980018.609466 write 0x0308a3 thru 0x03e05e (0xd7bc bytes) 000226 1790980018.615383 write 0x0309af thru 0x03f8b7 (0xef09 bytes) 000227 1790980018.617108 trunc from 0x040000 to 0x009ab0 (0x3654f bytes) 000228 1790980018.656146 mapread 0x000301 thru 0x0065a6 (0x62a6 bytes) 000229 1790980018.669533 mapwrite 0x02bce0 thru 0x039d12 (0xe033 bytes) 000230 1790980018.817347 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39d13): Mirror 6: 0xbe32e2d2 (stale) Mirror 7: 0xbe32e2d2 (stale) Mirror 8: 0xbe60acfc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39d13): Mirror 6: 0xbe32e2d2 (stale) Mirror 7: 0xbe32e2d2 (stale) Mirror 8: 0xbe60acfc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39d13: skipped 000231 1790980019.389752 mapwrite 0x03cacf thru 0x03ffff (0x3531 bytes) 000232 1790980019.579620 mapread 0x037f0e thru 0x03ffff (0x80f2 bytes) 000234 1790980019.591770 read 0x025866 thru 0x025f88 (0x723 bytes) 000235 1790980019.613002 trunc from 0x040000 to 0x0234eb (0x1cb14 bytes) 000236 1790980019.655467 punch from 0x01ab17 to 0x01df53 (0x343d bytes) 000237 1790980019.662726 punch from 0x018d72 to 0x0234eb (0xa77a bytes) 000239 1790980019.682526 punch from 0x017939 to 0x0234eb (0xbbb3 bytes) 000241 1790980019.706361 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x234ec): Mirror 6: 0x95bc8d70 (stale) Mirror 7: 0x95bc8d70 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x234ec): Mirror 6: 0x95bc8d70 (stale) Mirror 7: 0x95bc8d70 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x234ec: skipped 000243 1790980020.079556 trunc from 0x0234ec to 0x039521 (0x16036 bytes) 000244 1790980020.096776 read 0x01d84a thru 0x022e92 (0x5649 bytes) 000245 1790980020.106366 punch from 0x00884b to 0x00c3ae (0x3b64 bytes) 000246 1790980020.114931 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39522): Mirror 6: 0xdc0aff54 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39522): Mirror 6: 0xdc0aff54 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39522: skipped 000249 1790980020.422068 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x39522): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39522): Mirror 6: 0xdc0aff54 (stale) CRC-32 checksum value for chunk [0, 0x39522): Mirror 1: 0xb97c8df0 Mirror 7: 0xb97c8df0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39522: skipped 000250 1790980021.947652 MIRROR_RESYNC 3 mirrors 000251 1790980022.858943 mapread 0x0283fd thru 0x032d7f (0xa983 bytes) 000252 1790980022.884503 mapwrite 0x030489 thru 0x034bd7 (0x474f bytes) 000254 1790980023.145557 read 0x00eae1 thru 0x01a501 (0xba21 bytes) 000257 1790980023.158446 punch from 0x039002 to 0x039521 (0x520 bytes) 000258 1790980023.163446 trunc from 0x039522 to 0x019187 (0x2039a bytes) 000259 1790980023.213244 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19188): Mirror 7: 0x9b1cca9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19188): Mirror 7: 0x9b1cca9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19188: skipped 000260 1790980023.621288 write 0x03d846 thru 0x03ffff (0x27ba bytes) 000261 1790980023.622402 write 0x00a906 thru 0x00b593 (0xc8e bytes) 000262 1790980023.632037 read 0x0374de thru 0x03ffff (0x8b22 bytes) 000264 1790980023.642323 punch from 0x001c33 to 0x0091b2 (0x7580 bytes) 000265 1790980023.654933 read 0x02bad9 thru 0x033491 (0x79b9 bytes) 000266 1790980023.664650 punch from 0x034da4 to 0x03ffff (0xb25c bytes) 000267 1790980023.669512 read 0x022fbe thru 0x02f67a (0xc6bd bytes) 000268 1790980023.670943 punch from 0x00a0a3 to 0x00a8d6 (0x834 bytes) 000269 1790980023.675435 trunc from 0x040000 to 0x01ea5e (0x215a1 bytes) 000270 1790980023.692124 write 0x0133d5 thru 0x021abd (0xe6e9 bytes) 000271 1790980023.693779 read 0x01ee43 thru 0x021abd (0x2c7b bytes) 000272 1790980023.695604 trunc from 0x021abe to 0x03de96 (0x1c3d9 bytes) 000273 1790980023.712899 read 0x004755 thru 0x009126 (0x49d2 bytes) 000274 1790980023.713678 mapwrite 0x0032e5 thru 0x003a41 (0x75d bytes) 000276 1790980023.803438 mapwrite 0x01eb8d thru 0x0238d3 (0x4d47 bytes) 000277 1790980023.887321 write 0x027749 thru 0x0306b5 (0x8f6d bytes) 000278 1790980023.888435 read 0x0115ab thru 0x01f5a2 (0xdff8 bytes) 000280 1790980023.889443 write 0x029e61 thru 0x030931 (0x6ad1 bytes) 000281 1790980023.898532 write 0x035e65 thru 0x03ffff (0xa19b bytes) 000283 1790980023.910335 punch from 0x03c94f to 0x03e988 (0x203a bytes) 000284 1790980023.966468 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x98c4545 Mirror 8: 0x98c4545 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000285 1790980025.379302 mapread 0x026a5d thru 0x026b6f (0x113 bytes) 000286 1790980025.425102 trunc from 0x040000 to 0x019d97 (0x26268 bytes) 000287 1790980025.547736 mapread 0x006779 thru 0x00cffd (0x6885 bytes) 000288 1790980025.566663 read 0x0167bd thru 0x019d97 (0x35db bytes) 000289 1790980025.577225 MIRROR_RESYNC 3 mirrors 000290 1790980026.836248 mapread 0x00b5a5 thru 0x01389a (0x82f6 bytes) 000292 1790980026.874053 read 0x008938 thru 0x013593 (0xac5c bytes) 000293 1790980026.879571 mapread 0x00172d thru 0x00fba0 (0xe474 bytes) 000294 1790980026.899315 punch from 0x013b13 to 0x01565c (0x1b4a bytes) 000295 1790980027.107579 read 0x010255 thru 0x014433 (0x41df bytes) 000298 1790980027.135188 MIRROR_RESYNC 3 mirrors 000299 1790980028.282955 mapread 0x010378 thru 0x019d97 (0x9a20 bytes) 000300 1790980028.326749 mapread 0x01366c thru 0x019d97 (0x672c bytes) 000301 1790980028.329115 punch from 0x00c95d to 0x016af1 (0xa195 bytes) 000302 1790980028.410865 mapread 0x00c7ea thru 0x014c2e (0x8445 bytes) 000303 1790980028.446656 read 0x002d72 thru 0x010957 (0xdbe6 bytes) 000305 1790980028.462503 read 0x0057af thru 0x00c296 (0x6ae8 bytes) 000307 1790980028.467471 mapread 0x015ce4 thru 0x019d97 (0x40b4 bytes) 000308 1790980028.489487 read 0x0128ce thru 0x019d97 (0x74ca bytes) 000310 1790980028.494780 write 0x011275 thru 0x01cbe0 (0xb96c bytes) 000311 1790980028.500133 write 0x02a4eb thru 0x0390b8 (0xebce bytes) 000312 1790980028.510186 mapread 0x02f4c4 thru 0x034e75 (0x59b2 bytes) 000314 1790980028.519747 mapwrite 0x035dde thru 0x03f3ba (0x95dd bytes) 000315 1790980028.781571 mapread 0x0265bb thru 0x0339cb (0xd411 bytes) 000316 1790980028.784664 mapwrite 0x0131eb thru 0x0216b3 (0xe4c9 bytes) 000317 1790980028.934560 read 0x010dd1 thru 0x01a359 (0x9589 bytes) 000319 1790980028.935728 mapread 0x00852c thru 0x00e519 (0x5fee bytes) 000320 1790980028.938810 trunc from 0x03f3bb to 0x01c5d5 (0x22de5 bytes) 000321 1790980029.001954 punch from 0x006dce to 0x014b18 (0xdd4b bytes) 000324 1790980029.014227 read 0x0010df thru 0x006173 (0x5095 bytes) 000326 1790980029.072156 write 0x03fbb1 thru 0x03ffff (0x44f bytes) 000327 1790980029.090006 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xb9368035 (stale) Mirror 8: 0xb9368035 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x21bd4ef6 Mirror 9: 0x21bd4ef6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000329 1790980030.710604 write 0x00dc7a thru 0x014c32 (0x6fb9 bytes) 000330 1790980030.891070 mapwrite 0x001b18 thru 0x001dc7 (0x2b0 bytes) 000332 1790980031.000074 write 0x012dd0 thru 0x0143d7 (0x1608 bytes) 000335 1790980031.002996 mapwrite 0x00bb0d thru 0x00e801 (0x2cf5 bytes) 000336 1790980031.087479 read 0x037013 thru 0x03efc4 (0x7fb2 bytes) 000337 1790980031.109789 mapread 0x0379a7 thru 0x03ffff (0x8659 bytes) 000338 1790980031.119759 mapread 0x031280 thru 0x034b4e (0x38cf bytes) 000340 1790980031.141019 mapwrite 0x007407 thru 0x00f2ee (0x7ee8 bytes) 000341 1790980031.248686 mapread 0x03604e thru 0x038e78 (0x2e2b bytes) 000342 1790980031.263982 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xb9368035 (stale) Mirror 9: 0x21bd4ef6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xb9368035 (stale) Mirror 9: 0x21bd4ef6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000344 1790980031.791408 mapread 0x03b5c8 thru 0x03ffff (0x4a38 bytes) 000345 1790980031.826530 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xb9368035 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xb9368035 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000346 1790980032.138505 write 0x022142 thru 0x023ddc (0x1c9b bytes) 000348 1790980032.156477 write 0x00f7da thru 0x01bd8b (0xc5b2 bytes) 000350 1790980032.173134 read 0x0155a7 thru 0x0174e4 (0x1f3e bytes) 000352 1790980032.174237 write 0x02db9f thru 0x03825d (0xa6bf bytes) 000353 1790980032.186664 trunc from 0x040000 to 0x01c704 (0x238fb bytes) 000355 1790980032.216317 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1c705): Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c705): Mirror 7: 0x84a0a79b (stale) CRC-32 checksum value for chunk [0, 0x1c705): Mirror 1: 0xe00ac051 Mirror 8: 0xe00ac051 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c705: skipped 000359 1790980033.353212 trunc from 0x01c705 to 0x039478 (0x1cd74 bytes) 000360 1790980033.510175 punch from 0x01c86c to 0x0280f4 (0xb889 bytes) 000361 1790980033.516298 mapwrite 0x019491 thru 0x025d5b (0xc8cb bytes) 000362 1790980033.709754 mapwrite 0x011e45 thru 0x0153b5 (0x3571 bytes) 000364 1790980033.823370 mapwrite 0x01168a thru 0x020639 (0xefb0 bytes) 000365 1790980033.948212 write 0x00451d thru 0x00e4d6 (0x9fba bytes) 000368 1790980033.957014 write 0x03a76b thru 0x03a9a3 (0x239 bytes) 000369 1790980033.957980 mapwrite 0x039012 thru 0x03da96 (0x4a85 bytes) 000370 1790980034.094620 trunc from 0x03da97 to 0x009638 (0x3445e bytes) 000372 1790980034.124346 mapread 0x005688 thru 0x009638 (0x3fb1 bytes) 000373 1790980034.125595 trunc from 0x009639 to 0x0371f0 (0x2dbb8 bytes) 000375 1790980034.159100 MIRROR_RESYNC 3 mirrors 000376 1790980035.369527 trunc from 0x0371f1 to 0x03db4f (0x695f bytes) 000377 1790980035.507736 trunc from 0x03db50 to 0x01f0d8 (0x1ea77 bytes) 000378 1790980035.552623 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f0d9): Mirror 8: 0xa9fb6bc1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f0d9): Mirror 8: 0xa9fb6bc1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f0d9: skipped 000379 1790980035.869577 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) 000380 1790980036.052337 read 0x004681 thru 0x0087de (0x415e bytes) 000382 1790980036.063105 mapread 0x01184d thru 0x01975a (0x7f0e bytes) 000383 1790980036.079323 write 0x00895a thru 0x00e81c (0x5ec3 bytes) 000384 1790980036.081143 punch from 0x00df30 to 0x0152f9 (0x73ca bytes) 000385 1790980036.094171 write 0x029b6e thru 0x03655b (0xc9ee bytes) 000386 1790980036.095811 write 0x0181a4 thru 0x0206c3 (0x8520 bytes) 000387 1790980036.102148 mapread 0x008fd2 thru 0x015afd (0xcb2c bytes) 000388 1790980036.115231 MIRROR_EXTEND to 2 mirrors 000389 1790980037.104758 mapwrite 0x02cb2d thru 0x033d36 (0x720a bytes) 000390 1790980037.419000 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3655c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3655c): Mirror 2: 0xefa052dd (stale) CRC-32 checksum value for chunk [0, 0x3655c): Mirror 1: 0xe7015b4f Mirror 3: 0xe7015b4f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3655c: skipped 000391 1790980038.827913 read 0x012b32 thru 0x01d697 (0xab66 bytes) 000392 1790980038.877298 write 0x00e657 thru 0x014e6a (0x6814 bytes) 000393 1790980039.061111 read 0x014056 thru 0x017a98 (0x3a43 bytes) 000394 1790980039.103571 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3655c): Mirror 2: 0xefa052dd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3655c): Mirror 2: 0xefa052dd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3655c: skipped 000395 1790980039.517755 mapread 0x02ae1f thru 0x036516 (0xb6f8 bytes) 000397 1790980039.572162 read 0x00bf7c thru 0x01155c (0x55e1 bytes) 000399 1790980039.584408 read 0x011401 thru 0x016421 (0x5021 bytes) 000400 1790980039.600232 write 0x0083d8 thru 0x010a64 (0x868d bytes) 000404 1790980039.608262 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3655c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3655c): Mirror 2: 0xefa052dd (stale) CRC-32 checksum value for chunk [0, 0x3655c): Mirror 1: 0x7fc50967 Mirror 3: 0x7fc50967 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3655c: skipped 000408 1790980040.758726 trunc from 0x03655c to 0x019928 (0x1cc33 bytes) 000409 1790980040.934204 mapwrite 0x02f846 thru 0x0369a5 (0x7160 bytes) 000414 1790980041.139349 mapread 0x020dc1 thru 0x02bdaa (0xafea bytes) 000415 1790980041.163812 mapread 0x012f5a thru 0x014745 (0x17ec bytes) 000417 1790980041.182269 punch from 0x00ade0 to 0x010db7 (0x5fd8 bytes) 000418 1790980041.193573 mapread 0x021db1 thru 0x028a4b (0x6c9b bytes) 000419 1790980041.196001 mapwrite 0x038503 thru 0x03ffff (0x7afd bytes) 000420 1790980041.405723 trunc from 0x040000 to 0x015768 (0x2a897 bytes) 000421 1790980041.446049 write 0x03c722 thru 0x03ffff (0x38de bytes) 000423 1790980041.455532 punch from 0x02488a to 0x028c18 (0x438f bytes) 000424 1790980041.470001 write 0x026e20 thru 0x031eee (0xb0cf bytes) 000425 1790980041.491756 mapwrite 0x020412 thru 0x02466a (0x4259 bytes) 000426 1790980041.615640 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa725aed2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa725aed2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000427 1790980042.108970 punch from 0x02a85e to 0x0342d2 (0x9a75 bytes) 000428 1790980042.126162 mapwrite 0x0151dd thru 0x022815 (0xd639 bytes) 000429 1790980042.261754 punch from 0x01415a to 0x01f97b (0xb822 bytes) 000431 1790980042.268290 write 0x0309ea thru 0x03f707 (0xed1e bytes) 000434 1790980042.280793 punch from 0x023c32 to 0x0316db (0xdaaa bytes) 000435 1790980042.309273 write 0x01448a thru 0x01bba6 (0x771d bytes) 000436 1790980042.321369 trunc from 0x040000 to 0x005fa2 (0x3a05d bytes) 000437 1790980042.351223 mapwrite 0x028677 thru 0x032d4b (0xa6d5 bytes) 000438 1790980042.461174 trunc from 0x032d4c to 0x019781 (0x195ca bytes) 000439 1790980042.478127 punch from 0x014f24 to 0x019781 (0x485e bytes) 000440 1790980042.494212 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x19782): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19782): Mirror 2: 0x25d8f01c (stale) CRC-32 checksum value for chunk [0, 0x19782): Mirror 1: 0xd2416a67 Mirror 3: 0xd2416a67 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19782: skipped 000441 1790980043.610768 trunc from 0x019782 to 0x01d8a4 (0x4123 bytes) 000442 1790980043.702461 mapwrite 0x03e52e thru 0x03ffff (0x1ad2 bytes) 000443 1790980043.806597 mapread 0x0151c2 thru 0x01970d (0x454c bytes) 000444 1790980043.820319 read 0x0201f0 thru 0x02ec6f (0xea80 bytes) 000445 1790980043.840373 trunc from 0x040000 to 0x030ccf (0xf330 bytes) 000448 1790980043.867949 write 0x02be3b thru 0x038088 (0xc24e bytes) 000449 1790980043.871226 trunc from 0x038089 to 0x026f66 (0x11122 bytes) 000450 1790980043.889185 punch from 0x002b45 to 0x00395a (0xe16 bytes) 000451 1790980043.894574 read 0x01a97b thru 0x01f6aa (0x4d30 bytes) 000453 1790980043.903403 mapwrite 0x03235b thru 0x03ffff (0xdca5 bytes) 000454 1790980044.005019 read 0x039c48 thru 0x03ffff (0x63b8 bytes) 000455 1790980044.006356 trunc from 0x040000 to 0x03231b (0xdce4 bytes) 000456 1790980044.025331 write 0x03825e thru 0x039298 (0x103b bytes) 000459 1790980044.028104 punch from 0x01cea4 to 0x023fa5 (0x7102 bytes) 000461 1790980044.042312 MIRROR_RESYNC 3 mirrors 000463 1790980045.481344 punch from 0x02509f to 0x02bbf7 (0x6b59 bytes) 000464 1790980045.618530 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39299): Mirror 2: 0xdeb226d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39299): Mirror 2: 0xdeb226d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39299: skipped 000465 1790980046.154439 punch from 0x03046c to 0x03247d (0x2012 bytes) 000466 1790980046.162649 mapread 0x026004 thru 0x02b07b (0x5078 bytes) 000467 1790980046.192527 read 0x0229c7 thru 0x022ea7 (0x4e1 bytes) 000468 1790980046.193343 punch from 0x032ccb to 0x039298 (0x65ce bytes) 000470 1790980046.201494 mapread 0x007bb8 thru 0x00ee2a (0x7273 bytes) 000471 1790980046.213254 punch from 0x01f714 to 0x02ec6e (0xf55b bytes) 000474 1790980046.220249 trunc from 0x039299 to 0x03b4bf (0x2227 bytes) 000476 1790980046.236735 punch from 0x019b0d to 0x020521 (0x6a15 bytes) 000477 1790980046.260295 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) 000478 1790980046.435150 mapwrite 0x0178b8 thru 0x01af93 (0x36dc bytes) 000479 1790980046.525193 read 0x010469 thru 0x01534d (0x4ee5 bytes) 000480 1790980046.535265 mapwrite 0x02aaf9 thru 0x033c75 (0x917d bytes) 000482 1790980046.688602 trunc from 0x03b4c0 to 0x02aa45 (0x10a7a bytes) 000484 1790980046.717881 punch from 0x01fbc8 to 0x028af9 (0x8f32 bytes) 000486 1790980046.737654 write 0x025522 thru 0x02a3e3 (0x4ec2 bytes) 000487 1790980046.750465 read 0x01d152 thru 0x01f577 (0x2426 bytes) 000488 1790980046.775551 mapwrite 0x018ae2 thru 0x01ea46 (0x5f65 bytes) 000489 1790980046.854613 write 0x009251 thru 0x0175ce (0xe37e bytes) 000490 1790980046.857424 mapwrite 0x03c00e thru 0x03ffff (0x3ff2 bytes) 000492 1790980046.986605 read 0x01e123 thru 0x020fbb (0x2e99 bytes) 000493 1790980046.992025 read 0x011750 thru 0x0192e8 (0x7b99 bytes) 000495 1790980046.998520 write 0x023e45 thru 0x029ade (0x5c9a bytes) 000497 1790980047.000165 read 0x01d417 thru 0x026030 (0x8c1a bytes) 000501 1790980047.005609 read 0x02ea7b thru 0x030dce (0x2354 bytes) 000502 1790980047.006910 mapread 0x03c6f8 thru 0x03f799 (0x30a2 bytes) 000505 1790980047.010060 write 0x03a9bc thru 0x03ffff (0x5644 bytes) 000506 1790980047.011567 read 0x01b343 thru 0x024aa7 (0x9765 bytes) 000507 1790980047.019137 read 0x029ae2 thru 0x02ca7f (0x2f9e bytes) 000508 1790980047.022733 write 0x0394cb thru 0x03ffff (0x6b35 bytes) 000509 1790980047.025092 write 0x0139c7 thru 0x01e57a (0xabb4 bytes) 000511 1790980047.028494 mapwrite 0x035963 thru 0x03806c (0x270a bytes) 000512 1790980047.093820 write 0x00a98f thru 0x00fe32 (0x54a4 bytes) 000513 1790980047.096464 mapread 0x01df0f thru 0x02cbc6 (0xecb8 bytes) 000516 1790980047.098771 write 0x0276aa thru 0x0295c7 (0x1f1e bytes) 000518 1790980047.107608 mapread 0x020662 thru 0x02bb18 (0xb4b7 bytes) 000519 1790980047.109466 punch from 0x02792c to 0x0328bc (0xaf91 bytes) 000520 1790980047.141576 punch from 0x00392d to 0x00a319 (0x69ed bytes) 000521 1790980047.152005 write 0x017f73 thru 0x020604 (0x8692 bytes) 000522 1790980047.153289 read 0x01dfef thru 0x02c96d (0xe97f bytes) 000523 1790980047.175285 trunc from 0x040000 to 0x02a917 (0x156e8 bytes) 000524 1790980047.203472 mapread 0x026176 thru 0x02a917 (0x47a2 bytes) 000526 1790980047.210542 trunc from 0x02a918 to 0x0199a4 (0x10f73 bytes) 000527 1790980047.257469 trunc from 0x0199a5 to 0x02627b (0xc8d7 bytes) 000529 1790980047.290709 mapread 0x026036 thru 0x02627b (0x246 bytes) 000530 1790980047.304542 read 0x009436 thru 0x016176 (0xcd41 bytes) 000533 1790980047.316155 mapwrite 0x01ebd7 thru 0x02daa6 (0xeed0 bytes) 000537 1790980047.412465 mapwrite 0x0125d6 thru 0x01b8f4 (0x931f bytes) 000538 1790980047.461321 mapwrite 0x000a2d thru 0x00c250 (0xb824 bytes) 000539 1790980047.509065 punch from 0x008dfe to 0x00e7f5 (0x59f8 bytes) 000540 1790980047.514882 trunc from 0x02daa7 to 0x03967b (0xbbd5 bytes) 000541 1790980047.543617 punch from 0x033969 to 0x03673b (0x2dd3 bytes) 000544 1790980047.549301 write 0x03a22d thru 0x03e6e2 (0x44b6 bytes) 000547 1790980047.562993 MIRROR_EXTEND to 2 mirrors 000550 1790980048.939734 trunc from 0x03e6e3 to 0x0387d2 (0x5f10 bytes) 000552 1790980049.128141 trunc from 0x0387d3 to 0x02e53a (0xa298 bytes) 000554 1790980049.191421 read 0x006a86 thru 0x00febd (0x9438 bytes) 000555 1790980049.203139 mapread 0x015997 thru 0x02400a (0xe674 bytes) 000556 1790980049.239194 punch from 0x00c6dd to 0x0171e2 (0xab06 bytes) 000558 1790980049.260102 trunc from 0x02e53b to 0x00dc15 (0x20925 bytes) 000560 1790980049.286709 mapwrite 0x0087ff thru 0x00c285 (0x3a87 bytes) 000561 1790980049.401124 mapread 0x00db4c thru 0x00dc15 (0xca bytes) 000564 1790980049.415490 trunc from 0x00dc16 to 0x03687a (0x28c65 bytes) 000565 1790980049.444336 mapwrite 0x03bd26 thru 0x03ffff (0x42da bytes) 000566 1790980049.659980 mapread 0x01c283 thru 0x0205c4 (0x4342 bytes) 000568 1790980049.678452 trunc from 0x040000 to 0x012392 (0x2dc6d bytes) 000569 1790980049.705931 mapwrite 0x03e399 thru 0x03ffff (0x1c67 bytes) 000570 1790980049.803591 punch from 0x02573f to 0x02a02c (0x48ee bytes) 000571 1790980049.809235 trunc from 0x040000 to 0x036254 (0x9dab bytes) 000572 1790980049.838399 trunc from 0x036255 to 0x01a6b9 (0x1bb9b bytes) 000574 1790980049.860932 mapread 0x008684 thru 0x00eaad (0x642a bytes) 000575 1790980049.877228 write 0x01f83d thru 0x02a461 (0xac25 bytes) 000576 1790980049.883014 punch from 0x00b1d9 to 0x010a82 (0x58aa bytes) 000578 1790980049.913886 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2a462): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a462): Mirror 2: 0x34969978 (stale) CRC-32 checksum value for chunk [0, 0x2a462): Mirror 1: 0xf3eb7bd6 Mirror 3: 0xf3eb7bd6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a462: skipped 000579 1790980051.319479 read 0x0121b7 thru 0x015da7 (0x3bf1 bytes) 000580 1790980051.338174 read 0x0124b9 thru 0x01db58 (0xb6a0 bytes) 000582 1790980051.365120 write 0x02a338 thru 0x03189d (0x7566 bytes) 000583 1790980051.471715 read 0x025926 thru 0x028b1f (0x31fa bytes) 000584 1790980051.489353 read 0x02c775 thru 0x03189d (0x5129 bytes) 000585 1790980051.491029 punch from 0x01bf7b to 0x02a48b (0xe511 bytes) 000586 1790980051.521931 mapwrite 0x0141dc thru 0x0203f2 (0xc217 bytes) 000587 1790980051.638678 trunc from 0x03189e to 0x012ddf (0x1eabe bytes) 000590 1790980051.670963 read 0x008ee5 thru 0x01073f (0x785b bytes) 000592 1790980051.678548 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x12de0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12de0): Mirror 2: 0x51bebf4a (stale) Mirror 3: 0x9a23f521 (stale) CRC-32 checksum value for chunk [0, 0x12de0): Mirror 1: 0x9a23f521 Mirror 4: 0x9a23f521 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12de0: skipped 000593 1790980053.077871 MIRROR_RESYNC 4 mirrors 000596 1790980054.030258 read 0x0066db thru 0x007b54 (0x147a bytes) 000598 1790980054.037096 mapwrite 0x0088e4 thru 0x00a866 (0x1f83 bytes) 000600 1790980054.213550 write 0x01127e thru 0x01f9a6 (0xe729 bytes) 000601 1790980054.216380 mapwrite 0x02e029 thru 0x03ba47 (0xda1f bytes) 000604 1790980054.333926 trunc from 0x03ba48 to 0x031310 (0xa737 bytes) 000606 1790980054.362774 punch from 0x0215e8 to 0x02ce55 (0xb86e bytes) 000607 1790980054.369260 punch from 0x00a51b to 0x017b0b (0xd5f1 bytes) 000610 1790980054.384509 MIRROR_RESYNC 4 mirrors 000611 1790980055.900790 read 0x004aff thru 0x00f7f0 (0xacf2 bytes) 000613 1790980055.915129 trunc from 0x031311 to 0x010bc4 (0x2074c bytes) 000614 1790980055.982409 mapwrite 0x019182 thru 0x01bdc3 (0x2c42 bytes) 000619 1790980056.081192 MIRROR_RESYNC 4 mirrors 000620 1790980057.044945 write 0x0392b4 thru 0x03e4b8 (0x5205 bytes) 000621 1790980057.143472 mapread 0x02b5f2 thru 0x02e23f (0x2c4e bytes) 000626 1790980057.171607 write 0x03151e thru 0x031aad (0x590 bytes) 000628 1790980057.176512 mapwrite 0x0083d7 thru 0x009a46 (0x1670 bytes) 000632 1790980057.268116 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e4b9): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e4b9): Mirror 2: 0x8a628df1 (stale) Mirror 3: 0x8a628df1 (stale) Mirror 4: 0x8a628df1 (stale) CRC-32 checksum value for chunk [0, 0x3e4b9): Mirror 1: 0xd9789267 Mirror 5: 0xd9789267 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e4b9: skipped 000633 1790980058.434916 write 0x03f0e7 thru 0x03ffff (0xf19 bytes) 000634 1790980058.555457 MIRROR_RESYNC 5 mirrors 000635 1790980059.925644 write 0x02ea4e thru 0x039b14 (0xb0c7 bytes) 000638 1790980060.044367 write 0x00f439 thru 0x01de0f (0xe9d7 bytes) 000640 1790980060.066512 punch from 0x01158f to 0x01836d (0x6ddf bytes) 000641 1790980060.095113 trunc from 0x040000 to 0x034fb2 (0xb04d bytes) 000642 1790980060.128007 read 0x00ae91 thru 0x00f9b3 (0x4b23 bytes) 000644 1790980060.148021 read 0x0285b2 thru 0x03163f (0x908e bytes) 000645 1790980060.184639 mapread 0x02bcc0 thru 0x034fb2 (0x92f3 bytes) 000646 1790980060.185661 read 0x028e80 thru 0x030e8e (0x800f bytes) 000647 1790980060.186240 punch from 0x00ee68 to 0x00fecd (0x1066 bytes) 000649 1790980060.193382 write 0x03acd6 thru 0x03b6af (0x9da bytes) 000650 1790980060.194622 punch from 0x02e513 to 0x02fa95 (0x1583 bytes) 000651 1790980060.210100 MIRROR_RESYNC 5 mirrors 000653 1790980062.158142 mapwrite 0x01b4b2 thru 0x01c2a8 (0xdf7 bytes) 000654 1790980062.497093 mapwrite 0x02103d thru 0x024bae (0x3b72 bytes) 000655 1790980062.575621 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b6b0): Mirror 3: 0x13b9adbd (stale) Mirror 4: 0x13b9adbd (stale) Mirror 5: 0x13b9adbd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b6b0): Mirror 3: 0x13b9adbd (stale) Mirror 4: 0x13b9adbd (stale) Mirror 5: 0x13b9adbd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b6b0: skipped 000656 1790980063.000253 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3b6b0): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b6b0): Mirror 3: 0x13b9adbd (stale) Mirror 4: 0x13b9adbd (stale) Mirror 5: 0x13b9adbd (stale) CRC-32 checksum value for chunk [0, 0x3b6b0): Mirror 1: 0xf4888455 Mirror 6: 0xf4888455 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b6b0: skipped 000658 1790980064.021509 write 0x038ae5 thru 0x03ffff (0x751b bytes) 000659 1790980064.137365 write 0x037b7b thru 0x03fcac (0x8132 bytes) 000660 1790980064.152760 MIRROR_RESYNC 5 mirrors 000661 1790980065.603101 trunc from 0x040000 to 0x00444c (0x3bbb3 bytes) 000664 1790980065.694607 read 0x00007f thru 0x00444c (0x43ce bytes) 000665 1790980065.707964 write 0x0336a9 thru 0x03d539 (0x9e91 bytes) 000666 1790980065.710410 punch from 0x006bc5 to 0x00dc7a (0x70b6 bytes) 000667 1790980065.729822 mapread 0x037961 thru 0x03d539 (0x5bd9 bytes) 000669 1790980065.734740 punch from 0x030c61 to 0x03a666 (0x9a06 bytes) 000671 1790980065.745913 mapread 0x02c925 thru 0x034dc0 (0x849c bytes) 000672 1790980065.777246 punch from 0x026d31 to 0x031b26 (0xadf6 bytes) 000675 1790980065.788167 trunc from 0x03d53a to 0x032180 (0xb3b9 bytes) 000676 1790980065.812652 punch from 0x019b72 to 0x01a3d3 (0x862 bytes) 000677 1790980065.820260 write 0x03540d thru 0x03ffff (0xabf3 bytes) 000680 1790980065.826427 write 0x015fa8 thru 0x023b2a (0xdb83 bytes) 000681 1790980065.842372 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xf64549dc (stale) Mirror 4: 0xf64549dc (stale) Mirror 5: 0xf64549dc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xf64549dc (stale) Mirror 4: 0xf64549dc (stale) Mirror 5: 0xf64549dc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000682 1790980066.319137 write 0x0354f8 thru 0x03ffff (0xab08 bytes) 000685 1790980066.331459 trunc from 0x040000 to 0x02a8fa (0x15705 bytes) 000686 1790980066.349227 trunc from 0x02a8fb to 0x03aabc (0x101c2 bytes) 000687 1790980066.401556 mapwrite 0x02a946 thru 0x032060 (0x771b bytes) 000688 1790980066.503289 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3aabd): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aabd): Mirror 3: 0x311c223d (stale) Mirror 4: 0x311c223d (stale) Mirror 5: 0x311c223d (stale) CRC-32 checksum value for chunk [0, 0x3aabd): Mirror 1: 0xaaa157ed Mirror 6: 0xaaa157ed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aabd: skipped 000689 1790980067.820588 read 0x02af95 thru 0x037f4c (0xcfb8 bytes) 000690 1790980067.872689 MIRROR_RESYNC 5 mirrors 000691 1790980069.132407 write 0x0128f9 thru 0x015c2c (0x3334 bytes) 000692 1790980069.226341 punch from 0x0046c2 to 0x006b1a (0x2459 bytes) 000693 1790980069.244954 mapwrite 0x021118 thru 0x0292ce (0x81b7 bytes) 000695 1790980069.331728 read 0x00f6bc thru 0x01bfc9 (0xc90e bytes) 000697 1790980069.349458 mapread 0x013754 thru 0x01e160 (0xaa0d bytes) 000698 1790980069.350492 trunc from 0x03aabd to 0x03a97c (0x140 bytes) 000699 1790980069.384711 mapwrite 0x021fb1 thru 0x02411b (0x216b bytes) 000700 1790980069.496407 write 0x012d15 thru 0x01c02d (0x9319 bytes) 000701 1790980069.499370 punch from 0x01a1af to 0x029827 (0xf679 bytes) 000702 1790980069.529213 read 0x03469a thru 0x03a387 (0x5cee bytes) 000703 1790980069.542071 write 0x036d20 thru 0x03ffff (0x92e0 bytes) 000704 1790980069.543400 mapwrite 0x00352f thru 0x00bfdf (0x8ab1 bytes) 000705 1790980069.607414 trunc from 0x040000 to 0x01fb1e (0x204e1 bytes) 000706 1790980069.645979 mapwrite 0x00759c thru 0x013383 (0xbde8 bytes) 000709 1790980069.741162 punch from 0x00fb6e to 0x01cb10 (0xcfa3 bytes) 000710 1790980069.758970 write 0x0244f8 thru 0x029ba9 (0x56b2 bytes) 000711 1790980069.763025 trunc from 0x029baa to 0x02f1ec (0x5643 bytes) 000713 1790980069.782323 read 0x010bb8 thru 0x016ede (0x6327 bytes) 000716 1790980069.798769 mapread 0x0207c6 thru 0x022e47 (0x2682 bytes) 000717 1790980069.800313 write 0x00a8e7 thru 0x0112e1 (0x69fb bytes) 000718 1790980069.801902 mapwrite 0x03a39e thru 0x03c83c (0x249f bytes) 000719 1790980069.934099 trunc from 0x03c83d to 0x02f76c (0xd0d0 bytes) 000720 1790980069.961034 mapread 0x00995f thru 0x019549 (0xfbeb bytes) 000721 1790980069.962033 read 0x01d826 thru 0x02bb1c (0xe2f7 bytes) 000722 1790980069.962629 mapread 0x0048fd thru 0x00897e (0x4082 bytes) 000723 1790980069.965203 read 0x022b5e thru 0x02f76c (0xcc0f bytes) 000725 1790980069.966783 punch from 0x00cf5b to 0x00d939 (0x9df bytes) 000726 1790980069.975733 mapwrite 0x000aba thru 0x001a3c (0xf83 bytes) 000730 1790980070.049737 mapwrite 0x002f11 thru 0x008a33 (0x5b23 bytes) 000731 1790980070.106026 trunc from 0x02f76d to 0x039719 (0x9fad bytes) 000732 1790980070.135296 read 0x030b47 thru 0x039719 (0x8bd3 bytes) 000736 1790980070.174616 MIRROR_RESYNC 5 mirrors 000738 1790980071.749697 trunc from 0x03971a to 0x02eebf (0xa85a bytes) 000739 1790980071.874750 punch from 0x01e115 to 0x026688 (0x8574 bytes) 000740 1790980071.890360 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2eec0): Mirror 3: 0x71b62cdf (stale) Mirror 5: 0x71b62cdf (stale) Mirror 6: 0x71b62cdf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eec0): Mirror 3: 0x71b62cdf (stale) Mirror 5: 0x71b62cdf (stale) Mirror 6: 0x71b62cdf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eec0: skipped 000741 1790980072.326103 trunc from 0x02eec0 to 0x033e16 (0x4f57 bytes) 000746 1790980072.361287 mapwrite 0x028f37 thru 0x02d3a5 (0x446f bytes) 000747 1790980072.510143 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33e17): Mirror 3: 0x3b86c65e (stale) Mirror 6: 0x3b86c65e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33e17): Mirror 3: 0x3b86c65e (stale) Mirror 6: 0x3b86c65e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33e17: skipped 000750 1790980072.882159 write 0x01ccf6 thru 0x02cb40 (0xfe4b bytes) 000751 1790980072.895193 mapwrite 0x009c18 thru 0x0190c9 (0xf4b2 bytes) 000752 1790980073.002799 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33e17): Mirror 6: 0x3b86c65e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33e17): Mirror 6: 0x3b86c65e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33e17: skipped 000754 1790980073.256248 punch from 0x008a62 to 0x00d0e1 (0x4680 bytes) 000755 1790980073.261426 mapwrite 0x03873d thru 0x039b18 (0x13dc bytes) 000756 1790980073.319933 mapwrite 0x00dace thru 0x01bac5 (0xdff8 bytes) 000757 1790980073.385939 read 0x038fb7 thru 0x039b18 (0xb62 bytes) 000759 1790980073.391308 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x39b19): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39b19): Mirror 6: 0x14279761 (stale) CRC-32 checksum value for chunk [0, 0x39b19): Mirror 1: 0x6c2c97c7 Mirror 7: 0x6c2c97c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39b19: skipped 000761 1790980074.576187 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x39b19): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39b19): Mirror 6: 0x14279761 (stale) CRC-32 checksum value for chunk [0, 0x39b19): Mirror 1: 0x6c2c97c7 Mirror 7: 0x6c2c97c7 Mirror 8: 0x6c2c97c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39b19: skipped 000762 1790980075.893545 write 0x00f9f4 thru 0x0138f0 (0x3efd bytes) 000763 1790980076.074144 read 0x001bac thru 0x004535 (0x298a bytes) 000764 1790980076.087816 punch from 0x0273a1 to 0x02f746 (0x83a6 bytes) 000768 1790980076.102063 read 0x017a20 thru 0x02595b (0xdf3c bytes) 000769 1790980076.130461 read 0x023e9f thru 0x0276e5 (0x3847 bytes) 000770 1790980076.131065 mapwrite 0x008ccd thru 0x009787 (0xabb bytes) 000771 1790980076.177699 MIRROR_RESYNC 4 mirrors 000772 1790980077.871286 write 0x010532 thru 0x01d51c (0xcfeb bytes) 000775 1790980078.088268 mapwrite 0x01058e thru 0x01e65f (0xe0d2 bytes) 000776 1790980078.189687 punch from 0x0249a2 to 0x034615 (0xfc74 bytes) 000778 1790980078.205999 trunc from 0x039b19 to 0x033dcb (0x5d4d bytes) 000779 1790980078.238893 read 0x01d7de thru 0x02828b (0xaaae bytes) 000780 1790980078.249767 write 0x019cf7 thru 0x020276 (0x6580 bytes) 000781 1790980078.251051 write 0x023f05 thru 0x030bc2 (0xccbe bytes) 000782 1790980078.257701 mapwrite 0x02fecf thru 0x038536 (0x8668 bytes) 000783 1790980078.390439 read 0x02ca66 thru 0x038536 (0xbad1 bytes) 000785 1790980078.393242 read 0x026b43 thru 0x02b5b1 (0x4a6f bytes) 000786 1790980078.401032 MIRROR_RESYNC 4 mirrors 000787 1790980079.888254 punch from 0x00c4bf to 0x016342 (0x9e84 bytes) 000788 1790980079.982253 read 0x01da62 thru 0x0201da (0x2779 bytes) 000789 1790980079.991979 write 0x03b757 thru 0x03c9f4 (0x129e bytes) 000790 1790980079.993478 read 0x02711e thru 0x0330ff (0xbfe2 bytes) 000792 1790980080.012262 mapwrite 0x02ff0e thru 0x03bf1e (0xc011 bytes) 000793 1790980080.075318 trunc from 0x03c9f5 to 0x01957c (0x23478 bytes) 000795 1790980080.099187 write 0x02d36a thru 0x03660e (0x92a5 bytes) 000797 1790980080.101873 read 0x00d4fe thru 0x017299 (0x9d9c bytes) 000798 1790980080.103330 read 0x001aa3 thru 0x00921b (0x7779 bytes) 000799 1790980080.104338 punch from 0x011f16 to 0x01f28a (0xd375 bytes) 000800 1790980080.122640 trunc from 0x03660f to 0x0263a9 (0x10265 bytes) 000802 1790980080.147605 write 0x03bd0e thru 0x03ffff (0x42f2 bytes) 000803 1790980080.150778 mapwrite 0x024c82 thru 0x02598c (0xd0b bytes) 000804 1790980080.241269 MIRROR_RESYNC 4 mirrors 000805 1790980081.743793 mapwrite 0x03c6e5 thru 0x03ffff (0x391b bytes) 000806 1790980081.911590 mapread 0x02caa3 thru 0x0380c9 (0xb627 bytes) 000809 1790980081.932085 trunc from 0x040000 to 0x025643 (0x1a9bc bytes) 000810 1790980081.959707 mapwrite 0x0276d4 thru 0x030af9 (0x9426 bytes) 000811 1790980082.184126 mapwrite 0x02dcc8 thru 0x034164 (0x649d bytes) 000812 1790980082.371073 MIRROR_RESYNC 4 mirrors 000813 1790980083.951053 MIRROR_EXTEND to 5 mirrors 000814 1790980085.458187 read 0x006d0b thru 0x00c6a6 (0x599c bytes) 000815 1790980085.477891 punch from 0x006732 to 0x0146a4 (0xdf73 bytes) 000816 1790980085.647996 trunc from 0x034165 to 0x020276 (0x13eee bytes) 000818 1790980085.697902 mapread 0x010f5d thru 0x01f942 (0xe9e6 bytes) 000819 1790980085.788080 MIRROR_RESYNC 5 mirrors 000820 1790980088.122588 punch from 0x01b49c to 0x01e394 (0x2ef9 bytes) 000823 1790980088.199612 punch from 0x0004ec to 0x00608b (0x5ba0 bytes) 000825 1790980088.207115 write 0x02a772 thru 0x02c19d (0x1a2c bytes) 000826 1790980088.208477 punch from 0x01c727 to 0x02592f (0x9209 bytes) 000827 1790980088.219678 punch from 0x012ef0 to 0x016f08 (0x4019 bytes) 000828 1790980088.224403 mapread 0x019395 thru 0x01aced (0x1959 bytes) 000829 1790980088.237923 trunc from 0x02c19e to 0x013849 (0x18954 bytes) 000831 1790980088.264929 trunc from 0x01384a to 0x032260 (0x1ea17 bytes) 000832 1790980088.286969 trunc from 0x032261 to 0x02f485 (0x2ddb bytes) 000833 1790980088.300964 mapread 0x02a46c thru 0x02f485 (0x501a bytes) 000834 1790980088.309444 mapwrite 0x0393ef thru 0x03ffff (0x6c11 bytes) 000835 1790980088.407345 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa44784d3 (stale) Mirror 7: 0xa44784d3 (stale) Mirror 8: 0xa44784d3 (stale) Mirror 9: 0xa44784d3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x94388a1 Mirror 10: 0x94388a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000836 1790980089.693645 mapread 0x02eb48 thru 0x033b40 (0x4ff9 bytes) 000837 1790980089.758760 mapwrite 0x023036 thru 0x0315f7 (0xe5c2 bytes) 000840 1790980090.165918 punch from 0x032ac0 to 0x039898 (0x6dd9 bytes) 000841 1790980090.173690 mapwrite 0x033dbf thru 0x03d1fc (0x943e bytes) 000842 1790980090.246971 read 0x00c53f thru 0x01a9b9 (0xe47b bytes) 000843 1790980090.258732 read 0x000307 thru 0x00ab8f (0xa889 bytes) 000845 1790980090.272555 trunc from 0x040000 to 0x0072a4 (0x38d5b bytes) 000846 1790980090.296173 write 0x036fef thru 0x039bff (0x2c11 bytes) 000847 1790980090.300947 punch from 0x0199f5 to 0x01fcbb (0x62c7 bytes) 000848 1790980090.322053 trunc from 0x039c00 to 0x026494 (0x1376b bytes) 000849 1790980090.356822 MIRROR_RESYNC 6 mirrors 000850 1790980092.326328 MIRROR_RESYNC 6 mirrors 000851 1790980093.070194 mapread 0x0248cc thru 0x026494 (0x1bc9 bytes) 000852 1790980093.105258 mapwrite 0x02cb4f thru 0x038c87 (0xc139 bytes) 000853 1790980093.279095 read 0x014ad1 thru 0x0222f1 (0xd821 bytes) 000855 1790980093.293220 read 0x00dc65 thru 0x0159f8 (0x7d94 bytes) 000856 1790980093.308083 mapwrite 0x01263b thru 0x020b32 (0xe4f8 bytes) 000857 1790980093.461551 punch from 0x01a622 to 0x028fd1 (0xe9b0 bytes) 000859 1790980093.475693 mapread 0x012b5c thru 0x02132e (0xe7d3 bytes) 000863 1790980093.574951 write 0x026412 thru 0x0294aa (0x3099 bytes) 000864 1790980093.585263 punch from 0x033de6 to 0x038c87 (0x4ea2 bytes) 000867 1790980093.612032 write 0x00cb04 thru 0x00f425 (0x2922 bytes) 000868 1790980093.614205 read 0x01523f thru 0x0248e9 (0xf6ab bytes) 000869 1790980093.651642 read 0x02509c thru 0x02c21e (0x7183 bytes) 000870 1790980093.656007 trunc from 0x038c88 to 0x014927 (0x24360 bytes) 000871 1790980093.690651 read 0x012754 thru 0x014927 (0x21d4 bytes) 000872 1790980093.691580 mapwrite 0x036fe3 thru 0x038336 (0x1354 bytes) 000873 1790980093.798956 read 0x02c02a thru 0x033eef (0x7ec6 bytes) 000874 1790980093.799657 write 0x03a628 thru 0x03ffff (0x59d8 bytes) 000875 1790980093.800888 write 0x0301f8 thru 0x0345b9 (0x43c2 bytes) 000876 1790980093.817190 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x541dafd1 (stale) Mirror 8: 0x541dafd1 (stale) Mirror 9: 0x541dafd1 (stale) Mirror 10: 0x541dafd1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x541dafd1 (stale) Mirror 8: 0x541dafd1 (stale) Mirror 9: 0x541dafd1 (stale) Mirror 10: 0x541dafd1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000879 1790980094.305872 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x541dafd1 (stale) Mirror 8: 0x541dafd1 (stale) Mirror 9: 0x541dafd1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x541dafd1 (stale) Mirror 8: 0x541dafd1 (stale) Mirror 9: 0x541dafd1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000880 1790980094.888560 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x541dafd1 (stale) Mirror 9: 0x541dafd1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x541dafd1 (stale) Mirror 9: 0x541dafd1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000882 1790980095.276486 trunc from 0x040000 to 0x006d88 (0x39277 bytes) 000883 1790980095.311738 mapread 0x001bcb thru 0x006d88 (0x51be bytes) 000885 1790980095.351709 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6d89): Mirror 9: 0xb646188a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6d89): Mirror 9: 0xb646188a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6d89: skipped 000889 1790980095.693686 write 0x01fa66 thru 0x029ccb (0xa266 bytes) 000891 1790980095.699818 trunc from 0x029ccc to 0x00a314 (0x1f9b7 bytes) 000892 1790980095.721771 trunc from 0x00a315 to 0x025020 (0x1ad0c bytes) 000893 1790980095.735951 read 0x018e3f thru 0x0190ad (0x26f bytes) 000896 1790980095.746657 write 0x03d913 thru 0x03ffff (0x26ed bytes) 000897 1790980095.748574 read 0x023331 thru 0x02792d (0x45fd bytes) 000898 1790980095.765211 MIRROR_RESYNC 2 mirrors 000899 1790980096.953815 punch from 0x0009ed to 0x009f0b (0x951f bytes) 000900 1790980097.005628 mapread 0x01abb3 thru 0x020db0 (0x61fe bytes) 000901 1790980097.025101 punch from 0x0104e1 to 0x011149 (0xc69 bytes) 000902 1790980097.035697 mapread 0x003b34 thru 0x012578 (0xea45 bytes) 000904 1790980097.058179 mapread 0x0144a7 thru 0x0211d0 (0xcd2a bytes) 000905 1790980097.059948 mapread 0x0377f5 thru 0x0385c6 (0xdd2 bytes) 000908 1790980097.072913 read 0x03300b thru 0x03ffff (0xcff5 bytes) 000909 1790980097.074711 mapread 0x0007a2 thru 0x008175 (0x79d4 bytes) 000910 1790980097.093385 MIRROR_RESYNC 2 mirrors 000912 1790980098.440115 punch from 0x020698 to 0x02363b (0x2fa4 bytes) 000914 1790980098.574146 trunc from 0x040000 to 0x005b93 (0x3a46c bytes) 000916 1790980098.681135 read 0x002b9a thru 0x005b93 (0x2ffa bytes) 000917 1790980098.689802 trunc from 0x005b94 to 0x01d0a5 (0x17512 bytes) 000918 1790980098.748731 read 0x00ee0d thru 0x014170 (0x5364 bytes) 000919 1790980098.775618 punch from 0x015e5a to 0x01d0a5 (0x724c bytes) 000920 1790980098.780789 read 0x01b1ef thru 0x01d0a5 (0x1eb7 bytes) 000921 1790980098.814603 punch from 0x01aa2b to 0x01d0a5 (0x267b bytes) 000922 1790980098.823665 punch from 0x000bd6 to 0x00d66a (0xca95 bytes) 000924 1790980098.838667 mapwrite 0x01b9c8 thru 0x025f07 (0xa540 bytes) 000926 1790980099.022353 read 0x010fe6 thru 0x01c14b (0xb166 bytes) 000927 1790980099.045810 trunc from 0x025f08 to 0x00ea73 (0x17494 bytes) 000931 1790980099.086068 trunc from 0x00ea74 to 0x034a21 (0x25fae bytes) 000932 1790980099.118636 mapread 0x018fe5 thru 0x01d8d0 (0x48ec bytes) 000935 1790980099.178992 trunc from 0x034a22 to 0x000338 (0x346e9 bytes) 000937 1790980099.206203 punch from 0x000271 to 0x000338 (0xc8 bytes) 000939 1790980099.217536 mapread 0x0001dd thru 0x000338 (0x15c bytes) 000940 1790980099.226678 mapread 0x0000b3 thru 0x000338 (0x286 bytes) 000941 1790980099.230312 punch from 0x00008d to 0x000338 (0x2ac bytes) 000942 1790980099.250654 punch from 0x0001e8 to 0x000338 (0x151 bytes) 000943 1790980099.259576 mapread 0x000263 thru 0x000338 (0xd6 bytes) 000944 1790980099.267148 mapread 0x0001a5 thru 0x000338 (0x194 bytes) 000945 1790980099.274741 trunc from 0x000339 to 0x0199c9 (0x19691 bytes) 000946 1790980099.331006 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x199ca): Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x199ca): Mirror 9: 0xe9abb019 (stale) CRC-32 checksum value for chunk [0, 0x199ca): Mirror 1: 0xe9abb019 Mirror 10: 0xe9abb019 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x199ca: skipped 000949 1790980100.171055 write 0x03910d thru 0x03ffff (0x6ef3 bytes) 000950 1790980100.235798 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xa1ec6db0 (stale) Mirror 10: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf60dc303 Mirror 11: 0xf60dc303 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000951 1790980101.698740 mapwrite 0x00b347 thru 0x016b3f (0xb7f9 bytes) 000952 1790980101.908867 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xa1ec6db0 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xf60dc303 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf6835a53 Mirror 12: 0xf6835a53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000954 1790980104.258341 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xa1ec6db0 (stale) Mirror 11: 0xf60dc303 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xa1ec6db0 (stale) Mirror 11: 0xf60dc303 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf6835a53 Mirror 12: 0xf6835a53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000955 1790980105.220505 punch from 0x01de27 to 0x0274bc (0x9696 bytes) 000957 1790980105.412698 trunc from 0x040000 to 0x012f4e (0x2d0b1 bytes) 000959 1790980105.480390 read 0x0048d5 thru 0x0111cc (0xc8f8 bytes) 000961 1790980105.520648 mapread 0x00e4a7 thru 0x012f4e (0x4aa8 bytes) 000962 1790980105.548422 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12f4f): Mirror 9: 0xb96a7fcd (stale) Mirror 11: 0xb96a7fcd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12f4f): Mirror 9: 0xb96a7fcd (stale) Mirror 11: 0xb96a7fcd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12f4f: skipped 000964 1790980106.199518 trunc from 0x012f4f to 0x002511 (0x10a3d bytes) 000965 1790980106.238982 mapread 0x00146e thru 0x002511 (0x10a4 bytes) 000968 1790980106.265011 read 0x000dad thru 0x002511 (0x1765 bytes) 000969 1790980106.282013 punch from 0x00130b to 0x002511 (0x1207 bytes) 000970 1790980106.311130 MIRROR_RESYNC 3 mirrors 000971 1790980107.630733 read 0x002257 thru 0x002511 (0x2bb bytes) 000972 1790980107.639730 read 0x000307 thru 0x002511 (0x220b bytes) 000973 1790980107.645212 read 0x0021ee thru 0x002511 (0x324 bytes) 000974 1790980107.654051 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) 000976 1790980107.986947 punch from 0x00061f to 0x002511 (0x1ef3 bytes) 000978 1790980108.070667 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2512): Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2512): Mirror 9: 0x9bc0c7dd (stale) CRC-32 checksum value for chunk [0, 0x2512): Mirror 1: 0x9bc0c7dd Mirror 10: 0x9bc0c7dd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2512: skipped 000979 1790980109.008191 mapread 0x00250e thru 0x002511 (0x4 bytes) 000980 1790980109.045191 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) 000981 1790980109.790181 MIRROR_RESYNC 2 mirrors 000982 1790980110.700813 write 0x03ef25 thru 0x03ffff (0x10db bytes) 000983 1790980110.891677 mapwrite 0x0096d3 thru 0x00ea82 (0x53b0 bytes) 000984 1790980111.166647 mapread 0x008af1 thru 0x01497a (0xbe8a bytes) 000985 1790980111.192895 read 0x01f140 thru 0x021116 (0x1fd7 bytes) 000986 1790980111.200411 trunc from 0x040000 to 0x006754 (0x398ab bytes) 000987 1790980111.267897 write 0x01aad5 thru 0x023c71 (0x919d bytes) 000988 1790980111.277132 punch from 0x00d210 to 0x00fb22 (0x2913 bytes) 000989 1790980111.315733 trunc from 0x023c72 to 0x00662f (0x1d642 bytes) 000990 1790980111.379484 mapwrite 0x02d049 thru 0x02fe58 (0x2e10 bytes) 000993 1790980111.577056 trunc from 0x02fe59 to 0x012ad6 (0x1d382 bytes) 000995 1790980111.658264 trunc from 0x012ad7 to 0x027644 (0x14b6e bytes) 000996 1790980111.694241 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x27645): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27645): Mirror 10: 0x3fdcec1 (stale) CRC-32 checksum value for chunk [0, 0x27645): Mirror 1: 0x3fdcec1 Mirror 11: 0x3fdcec1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27645: skipped 000997 1790980113.188050 write 0x02a6a3 thru 0x03a0e7 (0xfa45 bytes) 000998 1790980113.283964 mapwrite 0x00d908 thru 0x01335f (0x5a58 bytes) 001000 1790980113.440702 write 0x03132a thru 0x034ce1 (0x39b8 bytes) All operations completed A-OK!