== sanity-flr test 70a: flr mode fsx test ================ 17:02:05 (1789074125) Seed set to 4127 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000003 1789074127.943690 write 0x02f323 thru 0x032482 (0x3160 bytes) 000005 1789074127.951032 read 0x0034e8 thru 0x0063f0 (0x2f09 bytes) truncating to largest ever: 0x1232a 000007 1789074127.958672 trunc from 0x032483 to 0x012329 (0x20159 bytes) 000009 1789074127.977238 write 0x026c75 thru 0x02859e (0x192a bytes) 000012 1789074127.980078 mapwrite 0x010c7d thru 0x01f649 (0xe9cd bytes) 000013 1789074128.172812 write 0x02cd52 thru 0x030463 (0x3712 bytes) 000018 1789074128.186674 mapwrite 0x014808 thru 0x02126c (0xca65 bytes) truncating to largest ever: 0x2dec6 000019 1789074128.287414 trunc from 0x030464 to 0x02dec5 (0x259e bytes) 000020 1789074128.323642 trunc from 0x02dec6 to 0x015b3c (0x18389 bytes) 000024 1789074128.357208 trunc from 0x015b3d to 0x00023e (0x158fe bytes) 000025 1789074128.399523 read 0x000230 thru 0x00023e (0xf bytes) 000026 1789074128.406740 write 0x00ef31 thru 0x01538e (0x645e bytes) 000031 1789074128.411770 write 0x0364a9 thru 0x03ca82 (0x65da bytes) 000032 1789074128.414728 write 0x009943 thru 0x019321 (0xf9df bytes) 000034 1789074128.428087 mapwrite 0x03bada thru 0x03e5e5 (0x2b0c bytes) 000036 1789074128.534865 write 0x01a0d7 thru 0x025421 (0xb34b bytes) 000037 1789074128.541085 mapwrite 0x01d29e thru 0x023bd7 (0x693a bytes) 000038 1789074128.616452 trunc from 0x03e5e6 to 0x012055 (0x2c590 bytes) 000040 1789074128.638080 mapread 0x001f92 thru 0x003d94 (0x1e03 bytes) 000043 1789074128.641335 trunc from 0x012056 to 0x02914d (0x170f8 bytes) 000044 1789074128.658377 mapwrite 0x00c8f7 thru 0x01797d (0xb087 bytes) 000045 1789074128.774224 write 0x03cb4d thru 0x03ffff (0x34b3 bytes) 000047 1789074128.776063 read 0x0192af thru 0x02165d (0x83af bytes) 000048 1789074128.801613 mapwrite 0x019ec6 thru 0x02610d (0xc248 bytes) 000050 1789074128.900607 read 0x00d736 thru 0x016691 (0x8f5c bytes) truncating to largest ever: 0x2e7f2 000052 1789074128.902596 trunc from 0x040000 to 0x02e7f1 (0x1180e bytes) 000053 1789074128.921351 mapread 0x004526 thru 0x010f2b (0xca06 bytes) 000054 1789074128.922780 mapwrite 0x00d538 thru 0x017e88 (0xa951 bytes) 000056 1789074129.024750 MIRROR_EXTEND to 2 mirrors 000057 1789074130.259216 trunc from 0x02e7f2 to 0x020235 (0xe5bc bytes) 000060 1789074130.426700 write 0x025f52 thru 0x034d9a (0xee49 bytes) 000063 1789074130.432313 write 0x02294c thru 0x02c928 (0x9fdd bytes) 000066 1789074130.451547 mapread 0x016a4f thru 0x0265bb (0xfb6d bytes) 000067 1789074130.511041 mapwrite 0x033e57 thru 0x03c399 (0x8543 bytes) 000068 1789074130.669279 MIRROR_RESYNC 2 mirrors 000071 1789074131.753709 read 0x00bf00 thru 0x015a44 (0x9b45 bytes) 000074 1789074131.765223 mapwrite 0x004f92 thru 0x01287e (0xd8ed bytes) 000075 1789074131.998315 MIRROR_RESYNC 2 mirrors truncating to largest ever: 0x360fc 000076 1789074132.942623 trunc from 0x03c39a to 0x0360fb (0x629e bytes) 000077 1789074133.075975 write 0x01a2a0 thru 0x0235da (0x933b bytes) 000080 1789074133.092567 mapwrite 0x0223c7 thru 0x02a257 (0x7e91 bytes) 000081 1789074133.213214 mapwrite 0x00374e thru 0x011fe1 (0xe894 bytes) 000082 1789074133.282188 mapread 0x020614 thru 0x028962 (0x834f bytes) 000083 1789074133.283004 mapwrite 0x00df65 thru 0x015e2e (0x7eca bytes) 000084 1789074133.395811 mapwrite 0x02ffcc thru 0x0341eb (0x4220 bytes) 000086 1789074133.466018 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) 000091 1789074133.719858 mapwrite 0x006f6b thru 0x008e18 (0x1eae bytes) 000093 1789074133.862934 write 0x005c5e thru 0x007feb (0x238e bytes) 000095 1789074133.869182 write 0x037d9e thru 0x03ffff (0x8262 bytes) 000097 1789074133.878685 write 0x01735a thru 0x01cb9e (0x5845 bytes) 000099 1789074133.895226 mapwrite 0x036fa5 thru 0x038ee3 (0x1f3f bytes) 000101 1789074134.035336 mapread 0x00d70a thru 0x016179 (0x8a70 bytes) 000105 1789074134.068327 mapread 0x00ea1e thru 0x00eabb (0x9e bytes) 000106 1789074134.070066 mapwrite 0x03401e thru 0x03f12d (0xb110 bytes) 000109 1789074134.197425 mapread 0x003922 thru 0x00bad5 (0x81b4 bytes) 000110 1789074134.207286 write 0x01595f thru 0x021237 (0xb8d9 bytes) 000111 1789074134.223298 write 0x03dcaa thru 0x03ffff (0x2356 bytes) 000115 1789074134.230877 trunc from 0x040000 to 0x024437 (0x1bbc8 bytes) 000116 1789074134.260856 mapwrite 0x00d3a0 thru 0x019253 (0xbeb4 bytes) 000117 1789074134.411039 mapwrite 0x01fb36 thru 0x026cb5 (0x7180 bytes) 000118 1789074134.597215 trunc from 0x026cb6 to 0x00a94d (0x1c368 bytes) 000119 1789074134.613527 write 0x017f74 thru 0x02212c (0xa1b9 bytes) 000121 1789074134.616073 write 0x03e3de thru 0x03ebe0 (0x803 bytes) 000123 1789074134.617454 read 0x016c47 thru 0x019027 (0x23e1 bytes) 000129 1789074134.627278 write 0x011c06 thru 0x01df6a (0xc365 bytes) 000131 1789074134.661091 read 0x00705c thru 0x007b98 (0xb3d bytes) 000132 1789074134.661641 mapwrite 0x03fe02 thru 0x03ffff (0x1fe bytes) 000134 1789074134.811694 mapread 0x000955 thru 0x002a0c (0x20b8 bytes) 000135 1789074134.814954 mapread 0x0348d3 thru 0x03eb8e (0xa2bc bytes) 000136 1789074134.818302 trunc from 0x040000 to 0x02ab11 (0x154ee bytes) 000137 1789074134.855732 write 0x0038f7 thru 0x00df09 (0xa613 bytes) 000140 1789074134.866270 mapwrite 0x01e338 thru 0x02d07e (0xed47 bytes) truncating to largest ever: 0x3f133 000146 1789074135.011812 trunc from 0x02d07f to 0x03f132 (0x120b4 bytes) 000147 1789074135.029856 read 0x010ff9 thru 0x012011 (0x1019 bytes) 000148 1789074135.037762 MIRROR_EXTEND to 2 mirrors 000150 1789074136.527797 mapread 0x028354 thru 0x02ee5b (0x6b08 bytes) 000152 1789074136.568824 MIRROR_RESYNC 2 mirrors 000153 1789074137.207830 write 0x0213c0 thru 0x025046 (0x3c87 bytes) 000154 1789074137.353336 read 0x029444 thru 0x030170 (0x6d2d bytes) 000155 1789074137.385671 mapread 0x019516 thru 0x020448 (0x6f33 bytes) 000156 1789074137.409873 mapread 0x02ac0a thru 0x02af91 (0x388 bytes) 000157 1789074137.417162 read 0x02a4e3 thru 0x02fc5f (0x577d bytes) 000158 1789074137.420680 write 0x0140b6 thru 0x02093d (0xc888 bytes) 000160 1789074137.423585 read 0x00359a thru 0x00c571 (0x8fd8 bytes) 000162 1789074137.445295 mapwrite 0x022e59 thru 0x029ac5 (0x6c6d bytes) 000167 1789074137.648721 mapwrite 0x003ad6 thru 0x0116a8 (0xdbd3 bytes) 000168 1789074137.871628 write 0x01184a thru 0x01f829 (0xdfe0 bytes) 000169 1789074137.900441 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3f133): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f133): Mirror 2: 0xb97546e4 (stale) CRC-32 checksum value for chunk [0, 0x3f133): Mirror 1: 0x5d6b6e03 Mirror 3: 0x5d6b6e03 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f133: skipped 000171 1789074139.874804 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3f133): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f133): Mirror 2: 0xb97546e4 (stale) CRC-32 checksum value for chunk [0, 0x3f133): Mirror 1: 0x5d6b6e03 Mirror 3: 0x5d6b6e03 Mirror 4: 0x5d6b6e03 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f133: skipped 000172 1789074141.863420 write 0x03be93 thru 0x03ffff (0x416d bytes) 000175 1789074142.014086 read 0x0314e0 thru 0x03529e (0x3dbf bytes) 000176 1789074142.027062 mapwrite 0x024ef0 thru 0x02feb6 (0xafc7 bytes) 000178 1789074142.138039 MIRROR_RESYNC 4 mirrors 000180 1789074144.004911 read 0x037046 thru 0x03ffff (0x8fba bytes) 000182 1789074144.025327 read 0x00d041 thru 0x00d45a (0x41a bytes) 000183 1789074144.066417 MIRROR_RESYNC 4 mirrors 000184 1789074144.744197 read 0x021b7a thru 0x0230a1 (0x1528 bytes) 000185 1789074144.744590 mapread 0x0011bf thru 0x00bf57 (0xad99 bytes) 000187 1789074144.745593 trunc from 0x040000 to 0x027605 (0x189fa bytes) 000189 1789074144.937974 trunc from 0x027606 to 0x016dd5 (0x10830 bytes) 000190 1789074144.983715 mapread 0x0056c9 thru 0x011a2b (0xc363 bytes) 000191 1789074145.016794 write 0x024313 thru 0x02c209 (0x7ef7 bytes) 000192 1789074145.018556 read 0x0159f9 thru 0x01b24e (0x5856 bytes) 000193 1789074145.071183 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2c20a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c20a): Mirror 2: 0x3b991328 (stale) Mirror 3: 0x3b991328 (stale) Mirror 4: 0x3b991328 (stale) CRC-32 checksum value for chunk [0, 0x2c20a): Mirror 1: 0xa5d7b8c0 Mirror 5: 0xa5d7b8c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c20a: skipped 000194 1789074146.506767 mapwrite 0x01e4cf thru 0x027c62 (0x9794 bytes) 000196 1789074146.820490 write 0x008ac6 thru 0x00e2d0 (0x580b bytes) 000198 1789074146.839469 write 0x032489 thru 0x0376bb (0x5233 bytes) 000202 1789074146.856400 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x376bc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x376bc): Mirror 2: 0x86d9f386 (stale) Mirror 3: 0x86d9f386 (stale) Mirror 4: 0x86d9f386 (stale) Mirror 5: 0x52b14afd (stale) CRC-32 checksum value for chunk [0, 0x376bc): Mirror 1: 0x91d2b704 Mirror 6: 0x91d2b704 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x376bc: skipped 000204 1789074148.454155 mapwrite 0x036ae5 thru 0x03ffff (0x951b bytes) 000205 1789074148.696321 MIRROR_RESYNC 6 mirrors 000206 1789074151.571619 read 0x038bb3 thru 0x03ffff (0x744d bytes) 000207 1789074151.599574 trunc from 0x040000 to 0x003d9e (0x3c261 bytes) 000208 1789074151.721735 read 0x0024f9 thru 0x003d9e (0x18a6 bytes) 000209 1789074151.735873 write 0x03cb19 thru 0x03ffff (0x34e7 bytes) 000211 1789074151.757854 mapread 0x037baf thru 0x03fe70 (0x82c2 bytes) 000212 1789074151.775899 mapwrite 0x02d863 thru 0x03a8d9 (0xd077 bytes) 000214 1789074151.824984 read 0x037848 thru 0x03a213 (0x29cc bytes) 000215 1789074151.825622 mapread 0x03a8e3 thru 0x03ef13 (0x4631 bytes) 000217 1789074151.826988 trunc from 0x040000 to 0x00b43f (0x34bc0 bytes) 000218 1789074151.851625 write 0x026b6b thru 0x033b13 (0xcfa9 bytes) 000219 1789074151.853762 write 0x03526b thru 0x03fedd (0xac73 bytes) 000220 1789074151.855953 trunc from 0x03fede to 0x03ea31 (0x14ac bytes) 000221 1789074151.871043 mapread 0x022784 thru 0x02ea91 (0xc30e bytes) 000222 1789074151.881381 mapread 0x00e2d4 thru 0x0117c7 (0x34f4 bytes) 000226 1789074151.883981 trunc from 0x03ea32 to 0x0383b7 (0x667a bytes) 000227 1789074151.901473 write 0x014399 thru 0x01493b (0x5a3 bytes) 000228 1789074151.902636 trunc from 0x0383b8 to 0x02834d (0x1006a bytes) 000230 1789074151.930442 read 0x012580 thru 0x01b522 (0x8fa3 bytes) 000231 1789074151.965728 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2834e): Mirror 2: 0x19463bb9 (stale) Mirror 3: 0x19463bb9 (stale) Mirror 4: 0x19463bb9 (stale) Mirror 5: 0x19463bb9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2834e): Mirror 2: 0x19463bb9 (stale) Mirror 3: 0x19463bb9 (stale) Mirror 4: 0x19463bb9 (stale) Mirror 5: 0x19463bb9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2834e: skipped 000235 1789074152.978131 read 0x027f22 thru 0x02834d (0x42c bytes) 000236 1789074152.992447 trunc from 0x02834e to 0x00e79b (0x19bb2 bytes) 000237 1789074153.033075 mapwrite 0x032bd0 thru 0x03ffff (0xd430 bytes) 000238 1789074153.320833 trunc from 0x040000 to 0x0051ea (0x3ae15 bytes) 000240 1789074153.404651 trunc from 0x0051eb to 0x00c63d (0x7453 bytes) 000241 1789074153.436823 trunc from 0x00c63e to 0x003b75 (0x8ac8 bytes) 000242 1789074153.500765 write 0x0175a6 thru 0x02228e (0xace9 bytes) 000245 1789074153.522008 mapread 0x0196fd thru 0x01d0fd (0x3a01 bytes) 000246 1789074153.528837 mapread 0x0040ee thru 0x00d95c (0x986f bytes) 000247 1789074153.560091 mapread 0x0196d8 thru 0x021d36 (0x865f bytes) 000248 1789074153.565784 write 0x03c620 thru 0x03ffff (0x39e0 bytes) 000249 1789074153.592151 mapwrite 0x020518 thru 0x021e34 (0x191d bytes) 000250 1789074153.831156 mapread 0x01af89 thru 0x024a17 (0x9a8f bytes) 000251 1789074153.856694 trunc from 0x040000 to 0x03c1a7 (0x3e58 bytes) 000252 1789074153.893845 mapwrite 0x032886 thru 0x03ffff (0xd77a bytes) 000254 1789074154.168471 read 0x020ab0 thru 0x0225b8 (0x1b09 bytes) 000255 1789074154.169095 write 0x033bb5 thru 0x03c4bf (0x890b bytes) 000256 1789074154.188880 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3c0b9936 (stale) Mirror 4: 0x3c0b9936 (stale) Mirror 5: 0x3c0b9936 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3c0b9936 (stale) Mirror 4: 0x3c0b9936 (stale) Mirror 5: 0x3c0b9936 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000257 1789074155.118790 read 0x03dfe5 thru 0x03ffff (0x201b bytes) 000258 1789074155.138034 mapread 0x0066a9 thru 0x00c130 (0x5a88 bytes) 000259 1789074155.185827 mapwrite 0x0053a9 thru 0x009c80 (0x48d8 bytes) 000263 1789074155.403874 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3c0b9936 (stale) Mirror 5: 0x3c0b9936 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3c0b9936 (stale) Mirror 5: 0x3c0b9936 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000264 1789074156.148838 read 0x03d94a thru 0x03ffff (0x26b6 bytes) 000265 1789074156.155528 read 0x005289 thru 0x0073c4 (0x213c bytes) 000266 1789074156.177894 mapread 0x00744b thru 0x00a9dc (0x3592 bytes) 000269 1789074156.190504 mapwrite 0x024961 thru 0x02e47b (0x9b1b bytes) 000274 1789074156.313093 MIRROR_RESYNC 3 mirrors 000275 1789074158.658642 read 0x002085 thru 0x00bf63 (0x9edf bytes) 000277 1789074158.704039 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) 000279 1789074159.442584 mapread 0x02a021 thru 0x034445 (0xa425 bytes) 000281 1789074159.497212 write 0x0128b3 thru 0x02266b (0xfdb9 bytes) 000284 1789074159.682775 write 0x0178fc thru 0x01c271 (0x4976 bytes) 000285 1789074159.718347 MIRROR_RESYNC 2 mirrors 000287 1789074161.320622 MIRROR_RESYNC 2 mirrors 000288 1789074162.025166 trunc from 0x040000 to 0x007081 (0x38f7e bytes) 000290 1789074162.176898 read 0x005487 thru 0x006e25 (0x199f bytes) 000291 1789074162.185683 write 0x0240a0 thru 0x0323fa (0xe35b bytes) 000292 1789074162.198160 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x323fb): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x323fb): Mirror 4: 0xa62bcf1a (stale) CRC-32 checksum value for chunk [0, 0x323fb): Mirror 1: 0x3ef1a1bb Mirror 5: 0x3ef1a1bb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x323fb: skipped 000293 1789074164.449966 mapwrite 0x01c16f thru 0x02a862 (0xe6f4 bytes) 000294 1789074164.681374 mapwrite 0x02d013 thru 0x036011 (0x8fff bytes) 000295 1789074164.884717 trunc from 0x036012 to 0x001bc7 (0x3444a bytes) 000296 1789074164.913748 mapwrite 0x028c6f thru 0x03438b (0xb71d bytes) 000298 1789074165.055702 read 0x032ce8 thru 0x03438b (0x16a4 bytes) 000305 1789074165.070060 read 0x013393 thru 0x021ef8 (0xeb66 bytes) 000307 1789074165.086036 mapread 0x02b525 thru 0x02cf36 (0x1a12 bytes) 000308 1789074165.090443 mapread 0x00f017 thru 0x0127e8 (0x37d2 bytes) 000309 1789074165.093343 mapread 0x013a72 thru 0x018952 (0x4ee1 bytes) 000310 1789074165.094802 write 0x024127 thru 0x034071 (0xff4b bytes) 000311 1789074165.102738 MIRROR_RESYNC 3 mirrors 000312 1789074165.949676 read 0x0173bc thru 0x02069f (0x92e4 bytes) 000314 1789074165.969005 write 0x02d132 thru 0x035ebd (0x8d8c bytes) 000316 1789074166.105466 mapread 0x02feca thru 0x035ebd (0x5ff4 bytes) 000318 1789074166.112551 mapread 0x02fad2 thru 0x0308cf (0xdfe bytes) 000319 1789074166.122587 mapwrite 0x008e40 thru 0x013e7e (0xb03f bytes) 000320 1789074166.273715 mapread 0x02f978 thru 0x035ebd (0x6546 bytes) 000323 1789074166.275551 trunc from 0x035ebe to 0x01c726 (0x19797 bytes) 000327 1789074166.400755 mapread 0x009d99 thru 0x0127c4 (0x8a2c bytes) 000328 1789074166.401744 write 0x013d67 thru 0x01781d (0x3ab7 bytes) 000330 1789074166.411584 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1c727): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c727): Mirror 4: 0xeb82f6a9 (stale) Mirror 5: 0xeb82f6a9 (stale) CRC-32 checksum value for chunk [0, 0x1c727): Mirror 1: 0x723d2758 Mirror 6: 0x723d2758 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c727: skipped 000331 1789074168.531779 read 0x0029cd thru 0x00ca0f (0xa043 bytes) 000332 1789074168.548676 write 0x028b1f thru 0x032f91 (0xa473 bytes) 000333 1789074168.713750 read 0x00c71b thru 0x00eb71 (0x2457 bytes) 000334 1789074168.732007 mapwrite 0x002162 thru 0x00998b (0x782a bytes) 000335 1789074168.794223 read 0x02ea33 thru 0x032f91 (0x455f bytes) 000336 1789074168.796404 trunc from 0x032f92 to 0x037475 (0x44e4 bytes) 000337 1789074168.812850 mapread 0x02a7af thru 0x035127 (0xa979 bytes) 000338 1789074168.824927 mapread 0x021848 thru 0x02977a (0x7f33 bytes) 000339 1789074168.826221 read 0x03680c thru 0x037475 (0xc6a bytes) 000341 1789074168.827655 trunc from 0x037476 to 0x00856e (0x2ef07 bytes) 000342 1789074168.863305 write 0x0090e7 thru 0x0178c7 (0xe7e1 bytes) 000343 1789074168.873027 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x178c8): Mirror 5: 0xe1adf72a (stale) Mirror 6: 0x3136387 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x178c8): Mirror 5: 0xe1adf72a (stale) Mirror 6: 0x3136387 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x178c8: skipped 000344 1789074169.366313 trunc from 0x0178c8 to 0x00a506 (0xd3c1 bytes) 000346 1789074169.395442 mapwrite 0x03e881 thru 0x03ffff (0x177f bytes) 000347 1789074169.492639 mapwrite 0x006508 thru 0x00f08f (0x8b88 bytes) 000348 1789074169.609483 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x6be1cd86 (stale) Mirror 6: 0x279d0551 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8502c42d Mirror 7: 0x8502c42d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000354 1789074170.938979 write 0x004b9d thru 0x0088c5 (0x3d29 bytes) 000357 1789074171.013255 write 0x0061fb thru 0x00b23a (0x5040 bytes) 000358 1789074171.021214 write 0x02ae21 thru 0x039fdf (0xf1bf bytes) 000360 1789074171.036715 mapread 0x007dca thru 0x0110fa (0x9331 bytes) 000365 1789074171.056921 read 0x01d6cb thru 0x020b2f (0x3465 bytes) 000366 1789074171.065154 read 0x02fb87 thru 0x03d173 (0xd5ed bytes) 000367 1789074171.083743 mapwrite 0x01a790 thru 0x02335c (0x8bcd bytes) 000368 1789074171.169809 trunc from 0x040000 to 0x0120ac (0x2df53 bytes) 000369 1789074171.216760 mapread 0x00eb6f thru 0x00fb96 (0x1028 bytes) 000370 1789074171.217592 trunc from 0x0120ad to 0x03d7f0 (0x2b744 bytes) 000375 1789074171.262451 MIRROR_RESYNC 4 mirrors 000376 1789074172.772779 mapwrite 0x03b1a8 thru 0x03ffff (0x4e58 bytes) 000377 1789074172.924447 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x1e81cb85 (stale) Mirror 6: 0x1e81cb85 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x1e81cb85 (stale) Mirror 6: 0x1e81cb85 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000379 1789074173.331064 mapread 0x000b22 thru 0x00321d (0x26fc bytes) 000381 1789074173.372343 trunc from 0x040000 to 0x02c205 (0x13dfa bytes) 000382 1789074173.389757 trunc from 0x02c206 to 0x03e41c (0x12217 bytes) 000384 1789074173.447648 mapread 0x02f9c3 thru 0x031f3d (0x257b bytes) 000387 1789074173.476977 mapread 0x02bca2 thru 0x02fde7 (0x4146 bytes) 000388 1789074173.479081 read 0x01bce9 thru 0x01c6a1 (0x9b9 bytes) 000390 1789074173.508203 MIRROR_RESYNC 3 mirrors 000391 1789074174.980580 trunc from 0x03e41d to 0x013199 (0x2b283 bytes) 000392 1789074175.136877 MIRROR_RESYNC 3 mirrors 000393 1789074176.266423 write 0x011507 thru 0x01d35a (0xbe54 bytes) 000394 1789074176.392918 read 0x017ba1 thru 0x01d35a (0x57ba bytes) 000397 1789074176.395743 read 0x001ddd thru 0x00e7ba (0xc9de bytes) 000399 1789074176.407675 mapwrite 0x013f73 thru 0x01665a (0x26e8 bytes) 000401 1789074176.480605 trunc from 0x01d35b to 0x0150ca (0x8290 bytes) 000402 1789074176.525548 mapread 0x00ef0f thru 0x0104ac (0x159e bytes) 000404 1789074176.527675 mapwrite 0x019732 thru 0x024fbe (0xb88d bytes) 000405 1789074176.714217 trunc from 0x024fbf to 0x02f3e9 (0xa42b bytes) 000406 1789074176.736795 write 0x038bae thru 0x03f0e2 (0x6535 bytes) 000407 1789074176.739261 write 0x00c631 thru 0x019fe6 (0xd9b6 bytes) 000409 1789074176.757554 trunc from 0x03f0e3 to 0x038658 (0x6a8a bytes) 000411 1789074176.806893 trunc from 0x038659 to 0x020149 (0x1850f bytes) 000412 1789074176.827502 mapread 0x0023b2 thru 0x00b37f (0x8fce bytes) 000414 1789074176.830944 write 0x000650 thru 0x006182 (0x5b33 bytes) 000415 1789074176.837652 mapread 0x019969 thru 0x01b701 (0x1d99 bytes) 000418 1789074176.849669 mapread 0x018108 thru 0x01cb67 (0x4a60 bytes) 000425 1789074176.865928 mapwrite 0x031428 thru 0x03ffff (0xebd8 bytes) 000426 1789074177.012521 trunc from 0x040000 to 0x03931c (0x6ce3 bytes) 000427 1789074177.049627 read 0x00b755 thru 0x00e8d2 (0x317e bytes) 000434 1789074177.060159 read 0x00017f thru 0x00e73d (0xe5bf bytes) 000437 1789074177.065862 mapwrite 0x001b4e thru 0x009a55 (0x7f08 bytes) 000438 1789074177.119649 mapwrite 0x01fc1b thru 0x02a3c7 (0xa7ad bytes) 000439 1789074177.300783 MIRROR_RESYNC 3 mirrors 000441 1789074178.586861 write 0x0062d3 thru 0x012165 (0xbe93 bytes) 000442 1789074178.651958 read 0x0110e2 thru 0x012711 (0x1630 bytes) 000444 1789074178.653649 write 0x024152 thru 0x0288ec (0x479b bytes) 000445 1789074178.671383 trunc from 0x03931d to 0x03b48b (0x216f bytes) 000446 1789074178.696604 mapwrite 0x033509 thru 0x03ebc8 (0xb6c0 bytes) 000448 1789074178.800527 trunc from 0x03ebc9 to 0x01ea56 (0x20172 bytes) 000449 1789074178.825613 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ea57): Mirror 6: 0xd4231776 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ea57): Mirror 6: 0xd4231776 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ea57: skipped 000451 1789074179.456661 mapwrite 0x02701e thru 0x027e84 (0xe67 bytes) 000453 1789074179.651373 mapwrite 0x03eb6b thru 0x03ffff (0x1495 bytes) 000454 1789074179.798188 mapwrite 0x03f6ac thru 0x03ffff (0x954 bytes) 000456 1789074179.836266 write 0x03ffe0 thru 0x03ffff (0x20 bytes) 000458 1789074179.843282 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) 000459 1789074180.006763 mapwrite 0x01b157 thru 0x01de0d (0x2cb7 bytes) 000460 1789074180.097306 write 0x03fce6 thru 0x03ffff (0x31a bytes) 000465 1789074180.107361 mapread 0x02f64d thru 0x03c2a9 (0xcc5d bytes) 000467 1789074180.132568 MIRROR_EXTEND to 2 mirrors 000468 1789074181.525547 trunc from 0x040000 to 0x00490c (0x3b6f3 bytes) 000469 1789074181.682695 trunc from 0x00490d to 0x009e10 (0x5504 bytes) 000470 1789074181.702024 mapwrite 0x039abc thru 0x03ffff (0x6544 bytes) 000471 1789074181.882736 mapwrite 0x030222 thru 0x03b4a7 (0xb286 bytes) 000472 1789074182.083416 mapread 0x021ca5 thru 0x031420 (0xf77c bytes) 000475 1789074182.108507 mapwrite 0x01a11f thru 0x0204a8 (0x638a bytes) 000476 1789074182.206304 mapread 0x008acc thru 0x00c938 (0x3e6d bytes) 000477 1789074182.234718 write 0x036ca8 thru 0x039c93 (0x2fec bytes) 000478 1789074182.237631 mapread 0x018f5f thru 0x01f302 (0x63a4 bytes) 000479 1789074182.247644 mapread 0x009aed thru 0x009f30 (0x444 bytes) 000480 1789074182.248605 mapwrite 0x01a0c0 thru 0x023ba6 (0x9ae7 bytes) 000481 1789074182.304973 write 0x0295ce thru 0x03521e (0xbc51 bytes) 000482 1789074182.306460 read 0x02eaec thru 0x03352a (0x4a3f bytes) 000485 1789074182.310576 mapread 0x011c67 thru 0x015d81 (0x411b bytes) 000488 1789074182.323490 mapread 0x03ef60 thru 0x03ffff (0x10a0 bytes) 000490 1789074182.325078 trunc from 0x040000 to 0x011a30 (0x2e5cf bytes) 000491 1789074182.360545 mapwrite 0x02bfc7 thru 0x038b6f (0xcba9 bytes) 000492 1789074182.491702 mapwrite 0x039490 thru 0x03a6ab (0x121c bytes) 000493 1789074182.603493 trunc from 0x03a6ac to 0x037a70 (0x2c3b bytes) 000494 1789074182.638885 read 0x00acd7 thru 0x00da44 (0x2d6e bytes) 000495 1789074182.647337 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x37a71): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37a71): Mirror 2: 0xb0823d07 (stale) CRC-32 checksum value for chunk [0, 0x37a71): Mirror 1: 0xcc5d4896 Mirror 3: 0xcc5d4896 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37a71: skipped 000497 1789074184.225474 mapread 0x00a1e9 thru 0x0156d1 (0xb4e9 bytes) 000499 1789074184.274620 trunc from 0x037a71 to 0x02c04a (0xba26 bytes) 000500 1789074184.455493 mapwrite 0x003c59 thru 0x00d340 (0x96e8 bytes) 000502 1789074184.602430 mapread 0x01563d thru 0x021368 (0xbd2c bytes) 000503 1789074184.667495 write 0x020e1a thru 0x02c77f (0xb966 bytes) 000506 1789074184.701583 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2c780): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c780): Mirror 2: 0xe27ed0dc (stale) Mirror 3: 0x43106e7c (stale) CRC-32 checksum value for chunk [0, 0x2c780): Mirror 1: 0x5c296e13 Mirror 4: 0x5c296e13 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c780: skipped 000507 1789074186.799055 write 0x017c09 thru 0x027281 (0xf679 bytes) 000508 1789074186.924585 mapread 0x00d97e thru 0x013b52 (0x61d5 bytes) 000509 1789074186.962560 read 0x0133c7 thru 0x01d056 (0x9c90 bytes) 000510 1789074186.963796 mapwrite 0x00524c thru 0x00e8ad (0x9662 bytes) 000511 1789074187.100534 write 0x02a2ec thru 0x030329 (0x603e bytes) 000512 1789074187.115824 mapread 0x02cc29 thru 0x030329 (0x3701 bytes) 000513 1789074187.121056 mapwrite 0x015ebd thru 0x021c7a (0xbdbe bytes) 000514 1789074187.232349 mapread 0x019f70 thru 0x02607d (0xc10e bytes) 000515 1789074187.236458 write 0x01e91a thru 0x02e8a1 (0xff88 bytes) 000516 1789074187.244159 trunc from 0x03032a to 0x0153e4 (0x1af45 bytes) 000520 1789074187.281866 mapwrite 0x00d396 thru 0x018695 (0xb300 bytes) 000521 1789074187.419953 write 0x031cbc thru 0x036ddf (0x5124 bytes) 000522 1789074187.426239 mapwrite 0x01a490 thru 0x0266f3 (0xc264 bytes) 000523 1789074187.553241 mapread 0x02aac7 thru 0x02e411 (0x394b bytes) 000524 1789074187.602753 MIRROR_RESYNC 4 mirrors 000525 1789074189.349911 write 0x0325a2 thru 0x035dd2 (0x3831 bytes) 000526 1789074189.511583 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x36de0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36de0): Mirror 2: 0xc0bb35b (stale) Mirror 3: 0xc0bb35b (stale) Mirror 4: 0xc0bb35b (stale) CRC-32 checksum value for chunk [0, 0x36de0): Mirror 1: 0x93ddfe4f Mirror 5: 0x93ddfe4f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36de0: skipped 000528 1789074191.122802 mapread 0x01faf3 thru 0x01ff13 (0x421 bytes) 000529 1789074191.131675 trunc from 0x036de0 to 0x03db3f (0x6d60 bytes) 000530 1789074191.225693 write 0x0134c7 thru 0x01e1fe (0xad38 bytes) 000531 1789074191.236322 mapwrite 0x001faf thru 0x002023 (0x75 bytes) 000534 1789074191.301404 trunc from 0x03db40 to 0x00e883 (0x2f2bc bytes) 000535 1789074191.325375 mapread 0x005660 thru 0x00c21f (0x6bc0 bytes) 000540 1789074191.332422 write 0x0180d1 thru 0x018bbe (0xaee bytes) 000542 1789074191.341369 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18bbf): Mirror 3: 0xa0851aab (stale) Mirror 4: 0xa0851aab (stale) Mirror 5: 0xa0851aab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18bbf): Mirror 3: 0xa0851aab (stale) Mirror 4: 0xa0851aab (stale) Mirror 5: 0xa0851aab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18bbf: skipped 000543 1789074191.867639 read 0x0004ff thru 0x008e39 (0x893b bytes) 000545 1789074191.876503 read 0x00596e thru 0x00b7fb (0x5e8e bytes) 000553 1789074191.890291 mapwrite 0x027250 thru 0x034d71 (0xdb22 bytes) 000554 1789074191.978514 read 0x033a6a thru 0x034d71 (0x1308 bytes) 000555 1789074191.979375 mapread 0x017bc2 thru 0x023148 (0xb587 bytes) 000556 1789074191.981546 write 0x01d4a2 thru 0x02cdb4 (0xf913 bytes) 000559 1789074191.985363 write 0x02edd6 thru 0x039751 (0xa97c bytes) 000560 1789074191.987228 read 0x0390b0 thru 0x039751 (0x6a2 bytes) 000564 1789074191.990761 mapwrite 0x00a5fd thru 0x00be3b (0x183f bytes) 000565 1789074192.098495 mapwrite 0x010923 thru 0x01f921 (0xefff bytes) 000567 1789074192.212625 mapread 0x01314d thru 0x019540 (0x63f4 bytes) 000569 1789074192.214202 write 0x018bdd thru 0x024b7f (0xbfa3 bytes) 000570 1789074192.217629 trunc from 0x039752 to 0x00a2d9 (0x2f478 bytes) 000571 1789074192.287521 write 0x002e94 thru 0x00d2f5 (0xa462 bytes) 000572 1789074192.289563 read 0x00cb2b thru 0x00d2f5 (0x7cb bytes) 000573 1789074192.304527 read 0x00a3f6 thru 0x00d2f5 (0x2f00 bytes) 000575 1789074192.311639 mapwrite 0x01489d thru 0x015a15 (0x1179 bytes) 000576 1789074192.508907 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x15a16): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15a16): Mirror 3: 0x1a216e86 (stale) Mirror 4: 0x1a216e86 (stale) Mirror 5: 0x1a216e86 (stale) CRC-32 checksum value for chunk [0, 0x15a16): Mirror 1: 0xd8b2339f Mirror 6: 0xd8b2339f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15a16: skipped 000577 1789074193.672299 mapwrite 0x01dccb thru 0x01eb8d (0xec3 bytes) 000582 1789074193.981801 mapread 0x011f42 thru 0x01eb8d (0xcc4c bytes) 000585 1789074194.011434 mapread 0x00203f thru 0x01189f (0xf861 bytes) 000587 1789074194.056993 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1eb8e): Mirror 3: 0xd3e96b6d (stale) Mirror 4: 0xd3e96b6d (stale) Mirror 5: 0xd3e96b6d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1eb8e): Mirror 3: 0xd3e96b6d (stale) Mirror 4: 0xd3e96b6d (stale) Mirror 5: 0xd3e96b6d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1eb8e: skipped 000588 1789074194.531183 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1eb8e): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1eb8e): Mirror 3: 0xd3e96b6d (stale) Mirror 4: 0xd3e96b6d (stale) Mirror 5: 0xd3e96b6d (stale) CRC-32 checksum value for chunk [0, 0x1eb8e): Mirror 1: 0xfdd8671e Mirror 6: 0xfdd8671e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1eb8e: skipped 000590 1789074195.911831 mapread 0x0191b2 thru 0x01bdd1 (0x2c20 bytes) 000591 1789074195.963423 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1eb8e): Mirror 3: 0xd3e96b6d (stale) Mirror 4: 0xd3e96b6d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1eb8e): Mirror 3: 0xd3e96b6d (stale) Mirror 4: 0xd3e96b6d (stale) CRC-32 checksum value for chunk [0, 0x1eb8e): Mirror 1: 0xfdd8671e Mirror 6: 0xfdd8671e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1eb8e: skipped 000592 1789074196.478544 read 0x000ca4 thru 0x010549 (0xf8a6 bytes) 000593 1789074196.505746 write 0x03e1a5 thru 0x03ffff (0x1e5b bytes) 000594 1789074196.702829 trunc from 0x040000 to 0x000d4d (0x3f2b2 bytes) 000595 1789074196.754969 read 0x000026 thru 0x000d4d (0xd28 bytes) 000596 1789074196.770096 trunc from 0x000d4e to 0x0189ff (0x17cb2 bytes) 000599 1789074196.818535 mapread 0x0152fa thru 0x0189ff (0x3706 bytes) 000601 1789074196.857327 write 0x03f613 thru 0x03ffff (0x9ed bytes) 000602 1789074196.860227 mapread 0x02a89c thru 0x035081 (0xa7e6 bytes) 000603 1789074196.887348 read 0x010ea9 thru 0x01f22a (0xe382 bytes) 000606 1789074196.890356 write 0x018f12 thru 0x021ec9 (0x8fb8 bytes) 000610 1789074196.898858 mapwrite 0x0182d4 thru 0x01a0a2 (0x1dcf bytes) 000611 1789074196.997487 mapread 0x02f657 thru 0x030bb5 (0x155f bytes) 000613 1789074197.000650 mapread 0x01f2cb thru 0x02b271 (0xbfa7 bytes) 000614 1789074197.002388 mapread 0x007a60 thru 0x00d325 (0x58c6 bytes) 000616 1789074197.005243 mapwrite 0x03f8a0 thru 0x03ffff (0x760 bytes) 000619 1789074197.073611 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xa897a5ca (stale) Mirror 6: 0x90f6b2ca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xa897a5ca (stale) Mirror 6: 0x90f6b2ca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000620 1789074197.504942 write 0x000675 thru 0x005e0f (0x579b bytes) 000623 1789074197.524924 mapread 0x01ba48 thru 0x025a16 (0x9fcf bytes) 000624 1789074197.556464 write 0x020f91 thru 0x021e07 (0xe77 bytes) 000625 1789074197.558638 write 0x02b793 thru 0x034c5a (0x94c8 bytes) 000627 1789074197.573264 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x90f6b2ca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x90f6b2ca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000629 1789074197.886810 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x90f6b2ca (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1424b97f Mirror 7: 0x1424b97f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000630 1789074199.517166 MIRROR_RESYNC 3 mirrors 000631 1789074200.678500 mapwrite 0x01f32b thru 0x020085 (0xd5b bytes) 000634 1789074200.931233 read 0x038196 thru 0x0394dd (0x1348 bytes) 000635 1789074200.942173 mapwrite 0x0244bf thru 0x02afad (0x6aef bytes) 000636 1789074201.038933 mapread 0x03963c thru 0x03ffff (0x69c4 bytes) 000638 1789074201.047601 mapread 0x00836d thru 0x017fb9 (0xfc4d bytes) 000640 1789074201.087992 write 0x011fbc thru 0x018a8f (0x6ad4 bytes) 000641 1789074201.091006 write 0x020d54 thru 0x02c0a6 (0xb353 bytes) 000642 1789074201.096434 mapwrite 0x00ca26 thru 0x00cfb2 (0x58d bytes) 000643 1789074201.175672 trunc from 0x040000 to 0x00ac4d (0x353b2 bytes) 000647 1789074201.222906 trunc from 0x00ac4e to 0x01092a (0x5cdd bytes) 000648 1789074201.249602 mapread 0x001078 thru 0x00a64d (0x95d6 bytes) 000650 1789074201.273480 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1092b): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1092b): Mirror 6: 0xa8ba7fb0 (stale) Mirror 7: 0xa8ba7fb0 (stale) CRC-32 checksum value for chunk [0, 0x1092b): Mirror 1: 0xa8ba7fb0 Mirror 8: 0xa8ba7fb0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1092b: skipped 000651 1789074202.914231 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1092b): Mirror 7: 0xa8ba7fb0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1092b): Mirror 7: 0xa8ba7fb0 (stale) CRC-32 checksum value for chunk [0, 0x1092b): Mirror 1: 0xa8ba7fb0 Mirror 8: 0xa8ba7fb0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1092b: skipped 000652 1789074203.682579 read 0x004816 thru 0x00e97a (0xa165 bytes) 000653 1789074203.694756 mapread 0x0059af thru 0x00e20e (0x8860 bytes) 000656 1789074203.704033 trunc from 0x01092b to 0x01112b (0x801 bytes) 000657 1789074203.914711 mapwrite 0x0073c4 thru 0x00c324 (0x4f61 bytes) 000660 1789074204.050303 mapread 0x0002cc thru 0x004362 (0x4097 bytes) 000661 1789074204.056192 mapwrite 0x02de35 thru 0x03a454 (0xc620 bytes) 000664 1789074204.294696 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a455): Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a455): Mirror 7: 0x561dcbec (stale) Mirror 8: 0x5f7f9afa (stale) CRC-32 checksum value for chunk [0, 0x3a455): Mirror 1: 0x759fd846 Mirror 9: 0x759fd846 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a455: skipped 000665 1789074206.014696 mapwrite 0x02751e thru 0x02faad (0x8590 bytes) 000667 1789074206.261461 mapread 0x028f6a thru 0x0345e3 (0xb67a bytes) 000671 1789074206.274309 write 0x010fed thru 0x014f24 (0x3f38 bytes) 000672 1789074206.288826 read 0x008d8e thru 0x013cf4 (0xaf67 bytes) 000675 1789074206.300584 mapwrite 0x006794 thru 0x00d7fe (0x706b bytes) 000678 1789074206.377969 mapwrite 0x00f7fd thru 0x013875 (0x4079 bytes) 000680 1789074206.438239 mapwrite 0x010938 thru 0x014709 (0x3dd2 bytes) 000682 1789074206.535461 read 0x01f558 thru 0x02da15 (0xe4be bytes) 000684 1789074206.550850 mapwrite 0x011622 thru 0x0203ad (0xed8c bytes) 000685 1789074206.679788 mapread 0x01aaf6 thru 0x01e380 (0x388b bytes) 000687 1789074206.681297 mapread 0x003ba6 thru 0x00bff5 (0x8450 bytes) 000688 1789074206.706095 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a455): Mirror 7: 0x561dcbec (stale) Mirror 8: 0x5f7f9afa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a455): Mirror 7: 0x561dcbec (stale) Mirror 8: 0x5f7f9afa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a455: skipped 000689 1789074207.196898 trunc from 0x03a455 to 0x00787a (0x32bda bytes) 000690 1789074207.246497 read 0x000e29 thru 0x00787a (0x6a52 bytes) 000692 1789074207.263102 read 0x000161 thru 0x005d2e (0x5bce bytes) 000693 1789074207.263982 read 0x004fb8 thru 0x00787a (0x28c3 bytes) 000695 1789074207.266046 trunc from 0x00787b to 0x01442f (0xcbb5 bytes) 000696 1789074207.317278 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14430): Mirror 7: 0x3c8a619b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14430): Mirror 7: 0x3c8a619b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14430: skipped 000697 1789074207.807870 mapwrite 0x016651 thru 0x021561 (0xaf11 bytes) 000699 1789074207.902237 read 0x018355 thru 0x01d573 (0x521f bytes) 000700 1789074207.904548 write 0x01f9d5 thru 0x02a511 (0xab3d bytes) 000702 1789074207.907825 trunc from 0x02a512 to 0x011962 (0x18baf bytes) 000704 1789074207.934313 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) 000708 1789074208.175466 mapread 0x002cbe thru 0x00cf9b (0xa2de bytes) 000709 1789074208.279468 mapwrite 0x022ae6 thru 0x02a009 (0x7524 bytes) 000711 1789074208.582498 write 0x00d02f thru 0x00d939 (0x90b bytes) 000712 1789074208.583521 write 0x02238d thru 0x02ccc5 (0xa939 bytes) 000714 1789074208.602865 read 0x01f9c6 thru 0x020176 (0x7b1 bytes) 000717 1789074208.627834 mapread 0x001cdd thru 0x0046a3 (0x29c7 bytes) 000718 1789074208.628844 mapwrite 0x02aa90 thru 0x0393b7 (0xe928 bytes) 000719 1789074208.872036 write 0x03cb78 thru 0x03ffff (0x3488 bytes) 000721 1789074208.874185 mapwrite 0x02c13d thru 0x037217 (0xb0db bytes) 000722 1789074209.051808 trunc from 0x040000 to 0x026429 (0x19bd6 bytes) 000723 1789074209.088333 mapread 0x024618 thru 0x026429 (0x1e12 bytes) 000724 1789074209.089627 write 0x020e76 thru 0x021960 (0xaeb bytes) 000729 1789074209.092827 mapwrite 0x01c218 thru 0x020d0a (0x4af3 bytes) 000735 1789074209.192093 mapread 0x015d6b thru 0x01c726 (0x69bc bytes) 000736 1789074209.207682 mapread 0x011227 thru 0x01e583 (0xd35d bytes) 000738 1789074209.209207 read 0x02161c thru 0x026429 (0x4e0e bytes) 000739 1789074209.217292 trunc from 0x02642a to 0x01d41a (0x900f bytes) 000740 1789074209.249099 write 0x01fce4 thru 0x02305e (0x337b bytes) 000742 1789074209.266738 MIRROR_EXTEND to 2 mirrors 000745 1789074210.770646 mapwrite 0x0268bf thru 0x02a60a (0x3d4c bytes) 000746 1789074211.088546 mapread 0x008ab0 thru 0x010645 (0x7b96 bytes) 000747 1789074211.121863 mapwrite 0x0006b6 thru 0x001e8c (0x17d7 bytes) 000748 1789074211.286413 write 0x02b670 thru 0x02da9d (0x242e bytes) 000751 1789074211.288461 mapread 0x009c77 thru 0x018d32 (0xf0bc bytes) 000753 1789074211.329554 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) 000754 1789074211.731221 mapwrite 0x01981a thru 0x025ee5 (0xc6cc bytes) 000756 1789074211.931785 mapwrite 0x0011fe thru 0x00bbe7 (0xa9ea bytes) 000757 1789074212.082902 mapread 0x004b15 thru 0x00e32a (0x9816 bytes) 000759 1789074212.085879 read 0x020002 thru 0x029335 (0x9334 bytes) 000762 1789074212.088080 mapwrite 0x02e4a4 thru 0x03aeb8 (0xca15 bytes) 000763 1789074212.248612 read 0x0346bc thru 0x03aeb8 (0x67fd bytes) 000765 1789074212.249843 write 0x0359ba thru 0x03d8f2 (0x7f39 bytes) 000766 1789074212.257390 mapwrite 0x01db1d thru 0x02c283 (0xe767 bytes) 000769 1789074212.429191 read 0x01e2e4 thru 0x02b942 (0xd65f bytes) 000770 1789074212.429818 read 0x02e88c thru 0x030981 (0x20f6 bytes) 000772 1789074212.442773 write 0x00d784 thru 0x00f6e9 (0x1f66 bytes) 000774 1789074212.446083 mapwrite 0x03dcf8 thru 0x03ffff (0x2308 bytes) 000776 1789074212.614302 write 0x00f9aa thru 0x01a4c0 (0xab17 bytes) 000778 1789074212.625812 write 0x01974b thru 0x01abed (0x14a3 bytes) 000782 1789074212.638506 mapread 0x02ab21 thru 0x02dcbd (0x319d bytes) 000786 1789074212.645874 trunc from 0x040000 to 0x022169 (0x1de96 bytes) 000787 1789074212.684083 mapwrite 0x005a73 thru 0x008ab1 (0x303f bytes) 000788 1789074212.809409 trunc from 0x02216a to 0x0174e3 (0xac86 bytes) 000789 1789074212.844784 read 0x000b75 thru 0x007603 (0x6a8f bytes) 000790 1789074212.846329 write 0x002669 thru 0x007824 (0x51bc bytes) 000791 1789074212.849399 mapwrite 0x021669 thru 0x0237b1 (0x2149 bytes) 000795 1789074213.012840 mapread 0x0188db thru 0x01d43a (0x4b60 bytes) 000797 1789074213.019566 mapread 0x01edb9 thru 0x0237b1 (0x49f9 bytes) 000798 1789074213.023534 mapwrite 0x0340b6 thru 0x03eedb (0xae26 bytes) 000799 1789074213.187922 write 0x02e8b9 thru 0x0350bf (0x6807 bytes) 000803 1789074213.195314 read 0x011a06 thru 0x016096 (0x4691 bytes) 000804 1789074213.196269 mapread 0x020e77 thru 0x025055 (0x41df bytes) 000805 1789074213.197694 mapread 0x002217 thru 0x008f7a (0x6d64 bytes) 000806 1789074213.199297 trunc from 0x03eedc to 0x0055a4 (0x39937 bytes) 000807 1789074213.220967 read 0x0017a2 thru 0x0055a4 (0x3e03 bytes) 000808 1789074213.221646 mapread 0x0043ba thru 0x0055a4 (0x11eb bytes) 000810 1789074213.222883 mapwrite 0x020a2d thru 0x024cf1 (0x42c5 bytes) 000811 1789074213.324406 mapwrite 0x020670 thru 0x02449c (0x3e2d bytes) 000813 1789074213.427740 mapwrite 0x0163f7 thru 0x020b4f (0xa759 bytes) 000815 1789074213.589049 mapread 0x0249f8 thru 0x024cf1 (0x2fa bytes) 000816 1789074213.590224 trunc from 0x024cf2 to 0x00ac47 (0x1a0aa bytes) 000817 1789074213.633910 mapwrite 0x031e87 thru 0x03e142 (0xc2bc bytes) 000818 1789074213.742343 mapwrite 0x024694 thru 0x0253d0 (0xd3d bytes) 000819 1789074213.839828 read 0x02b9e1 thru 0x02ea09 (0x3029 bytes) 000822 1789074213.843274 mapread 0x01e43e thru 0x0209e0 (0x25a3 bytes) 000823 1789074213.878082 trunc from 0x03e143 to 0x0273cc (0x16d76 bytes) 000825 1789074213.917654 write 0x022b0d thru 0x02f21c (0xc710 bytes) 000826 1789074213.920886 trunc from 0x02f21d to 0x00b687 (0x23b95 bytes) 000828 1789074213.948196 write 0x010dce thru 0x01e4c0 (0xd6f3 bytes) 000831 1789074213.957480 mapwrite 0x03d878 thru 0x03ffff (0x2788 bytes) 000833 1789074214.112957 mapread 0x030bc0 thru 0x0331d1 (0x2612 bytes) 000835 1789074214.131971 trunc from 0x040000 to 0x000012 (0x3ffed bytes) 000836 1789074214.149223 mapwrite 0x0100ba thru 0x01c3d6 (0xc31d bytes) 000838 1789074214.431425 trunc from 0x01c3d7 to 0x031bca (0x157f4 bytes) 000840 1789074214.461004 mapread 0x0066d3 thru 0x01006c (0x999a bytes) 000843 1789074214.558138 write 0x02581e thru 0x02769a (0x1e7d bytes) 000844 1789074214.572370 mapread 0x0179e1 thru 0x02344d (0xba6d bytes) 000845 1789074214.658612 trunc from 0x031bcb to 0x019b23 (0x180a7 bytes) 000846 1789074214.727369 mapwrite 0x01c470 thru 0x0202c9 (0x3e5a bytes) 000850 1789074214.914591 MIRROR_EXTEND to 2 mirrors 000852 1789074216.527831 mapwrite 0x0025b7 thru 0x00d888 (0xb2d2 bytes) 000854 1789074216.825295 mapwrite 0x019fbb thru 0x027a1c (0xda62 bytes) 000855 1789074217.112439 read 0x02626f thru 0x027a1c (0x17ae bytes) 000856 1789074217.113051 write 0x02ad5a thru 0x033592 (0x8839 bytes) 000857 1789074217.114475 trunc from 0x033593 to 0x03ab31 (0x759f bytes) 000858 1789074217.193811 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) 000859 1789074217.433927 MIRROR_EXTEND to 2 mirrors 000861 1789074218.952908 read 0x03a3a3 thru 0x03ab31 (0x78f bytes) 000862 1789074218.965198 mapread 0x02add9 thru 0x02cc3c (0x1e64 bytes) 000864 1789074219.017454 read 0x01937a thru 0x019696 (0x31d bytes) 000865 1789074219.027702 mapread 0x0146b0 thru 0x021ead (0xd7fe bytes) 000867 1789074219.033157 MIRROR_RESYNC 2 mirrors 000868 1789074219.943406 mapwrite 0x033271 thru 0x035af4 (0x2884 bytes) 000870 1789074220.258247 read 0x003790 thru 0x00e5c8 (0xae39 bytes) 000871 1789074220.272014 read 0x011b1f thru 0x01ca38 (0xaf1a bytes) 000873 1789074220.289184 mapread 0x011d83 thru 0x01e04b (0xc2c9 bytes) 000874 1789074220.290315 mapwrite 0x00b6df thru 0x01745b (0xbd7d bytes) 000877 1789074220.443484 mapread 0x03868c thru 0x03ab31 (0x24a6 bytes) 000880 1789074220.461190 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) 000881 1789074220.897781 read 0x02e721 thru 0x034bec (0x64cc bytes) 000882 1789074220.922065 mapwrite 0x033c82 thru 0x03ffff (0xc37e bytes) 000883 1789074221.168767 trunc from 0x040000 to 0x00ce19 (0x331e6 bytes) 000885 1789074221.209246 mapread 0x006627 thru 0x00ce19 (0x67f3 bytes) 000887 1789074221.234872 MIRROR_EXTEND to 2 mirrors 000889 1789074222.794605 read 0x00bfff thru 0x00ce19 (0xe1b bytes) 000892 1789074222.808779 mapread 0x00ba36 thru 0x00ce19 (0x13e4 bytes) 000893 1789074222.809677 trunc from 0x00ce1a to 0x013a12 (0x6bf9 bytes) 000895 1789074222.992914 MIRROR_RESYNC 2 mirrors 000896 1789074224.084973 MIRROR_EXTEND to 3 mirrors 000898 1789074225.368858 write 0x00b8d0 thru 0x018f0b (0xd63c bytes) 000901 1789074225.643270 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18f0c): Mirror 3: 0xf7b962db (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18f0c): Mirror 3: 0xf7b962db (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18f0c: skipped 000902 1789074226.263621 read 0x009376 thru 0x00d655 (0x42e0 bytes) 000906 1789074226.304589 write 0x007b90 thru 0x00e54d (0x69be bytes) 000907 1789074226.324047 write 0x00e027 thru 0x01ba19 (0xd9f3 bytes) 000908 1789074226.331963 trunc from 0x01ba1a to 0x00c24b (0xf7ce bytes) 000909 1789074226.395472 write 0x0049b3 thru 0x01324d (0xe89b bytes) 000912 1789074226.440450 MIRROR_RESYNC 2 mirrors 000915 1789074228.603062 mapwrite 0x0313a1 thru 0x03fce7 (0xe947 bytes) 000916 1789074228.943644 mapwrite 0x016edf thru 0x01b6be (0x47e0 bytes) 000918 1789074229.068054 mapwrite 0x03db6b thru 0x03ffff (0x2495 bytes) 000919 1789074229.199048 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16f:0x0]: Invalid argument (22) 000923 1789074229.544053 mapwrite 0x028758 thru 0x031e1e (0x96c7 bytes) 000928 1789074229.760140 read 0x00ffbe thru 0x01793f (0x7982 bytes) 000929 1789074229.788714 mapread 0x022569 thru 0x02dcc2 (0xb75a bytes) 000930 1789074229.815457 mapread 0x023177 thru 0x031f12 (0xed9c bytes) 000931 1789074229.819554 mapread 0x039e6b thru 0x03ffff (0x6195 bytes) 000932 1789074229.836667 read 0x03f85b thru 0x03ffff (0x7a5 bytes) 000937 1789074229.846169 trunc from 0x040000 to 0x00cce1 (0x3331e bytes) 000938 1789074229.899632 write 0x029e1c thru 0x0301c1 (0x63a6 bytes) 000939 1789074229.909006 mapwrite 0x00c833 thru 0x0162da (0x9aa8 bytes) 000942 1789074230.110647 mapwrite 0x0122f8 thru 0x02032c (0xe035 bytes) 000943 1789074230.358510 write 0x011075 thru 0x0191e0 (0x816c bytes) 000944 1789074230.365694 write 0x0026a7 thru 0x007f20 (0x587a bytes) 000945 1789074230.383743 mapread 0x001751 thru 0x002557 (0xe07 bytes) 000948 1789074230.392621 write 0x00ced3 thru 0x01061e (0x374c bytes) 000949 1789074230.394380 read 0x017c7d thru 0x01dd54 (0x60d8 bytes) 000950 1789074230.394954 mapread 0x024d17 thru 0x027bf6 (0x2ee0 bytes) 000951 1789074230.408481 mapread 0x01a55f thru 0x02540f (0xaeb1 bytes) 000952 1789074230.409561 write 0x00b53a thru 0x01a06b (0xeb32 bytes) 000954 1789074230.421346 trunc from 0x0301c2 to 0x02a2f2 (0x5ecf bytes) 000957 1789074230.474813 write 0x01df4a thru 0x022924 (0x49db bytes) 000959 1789074230.488195 write 0x02efac thru 0x037b54 (0x8ba9 bytes) 000960 1789074230.489633 trunc from 0x037b55 to 0x0011c2 (0x36992 bytes) 000966 1789074230.587067 mapwrite 0x035696 thru 0x03de6a (0x87d5 bytes) 000968 1789074230.792335 mapread 0x014abc thru 0x01fa98 (0xafdd bytes) 000969 1789074230.793399 read 0x01e0a7 thru 0x01f59f (0x14f9 bytes) 000971 1789074230.794439 write 0x03b392 thru 0x03e669 (0x32d8 bytes) 000973 1789074230.806379 mapwrite 0x0350d3 thru 0x03d77e (0x86ac bytes) 000974 1789074230.886303 write 0x01f1aa thru 0x02c556 (0xd3ad bytes) 000976 1789074230.901592 trunc from 0x03e66a to 0x03e4ed (0x17c bytes) 000979 1789074230.949814 read 0x001751 thru 0x00933e (0x7bee bytes) 000980 1789074230.952996 mapwrite 0x03a562 thru 0x03ffff (0x5a9e bytes) 000981 1789074231.101990 read 0x01ccea thru 0x02b5c4 (0xe8db bytes) 000983 1789074231.103868 mapwrite 0x038cda thru 0x03ffff (0x7326 bytes) 000985 1789074231.206162 mapread 0x013887 thru 0x01f14b (0xb8c5 bytes) 000986 1789074231.215963 mapread 0x01d344 thru 0x02b36b (0xe028 bytes) 000987 1789074231.217088 mapread 0x013b0c thru 0x020d61 (0xd256 bytes) 000988 1789074231.218019 mapread 0x0120c6 thru 0x01c991 (0xa8cc bytes) 000990 1789074231.236034 read 0x03878a thru 0x03a3c9 (0x1c40 bytes) 000993 1789074231.250248 write 0x03d299 thru 0x03ffff (0x2d67 bytes) 000996 1789074231.252909 mapwrite 0x00e465 thru 0x00f14f (0xceb bytes) 000999 1789074231.404069 write 0x02e949 thru 0x031e49 (0x3501 bytes) All operations completed A-OK!