== sanity-flr test 70a: flr mode fsx test ================ 21:30:42 (1780450242) Seed set to 244 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x273c8 000001 1780450245.166499 trunc from 00000000 to 0x0273c7 (0x273c8 bytes) 000003 1780450245.185154 mapread 0x01fda6 thru 0x0273c7 (0x7622 bytes) 000007 1780450245.221341 mapread 0x00bac7 thru 0x0137e7 (0x7d21 bytes) 000009 1780450245.264807 read 0x01c806 thru 0x023d13 (0x750e bytes) 000010 1780450245.266588 read 0x010790 thru 0x014a00 (0x4271 bytes) 000012 1780450245.277926 trunc from 0x0273c8 to 0x009468 (0x1df5f bytes) 000013 1780450245.313625 write 0x0289ad thru 0x0361d0 (0xd824 bytes) 000016 1780450245.319079 write 0x018c87 thru 0x01c1e1 (0x355b bytes) 000017 1780450245.344047 mapwrite 0x01efa5 thru 0x024e06 (0x5e62 bytes) truncating to largest ever: 0x3872e 000018 1780450245.554110 trunc from 0x0361d1 to 0x03872d (0x255d bytes) 000020 1780450245.618690 write 0x03e6a4 thru 0x03ffff (0x195c bytes) 000024 1780450245.629374 trunc from 0x040000 to 0x010bbf (0x2f440 bytes) 000025 1780450245.655903 write 0x03f62a thru 0x03ffff (0x9d6 bytes) 000028 1780450245.671313 trunc from 0x040000 to 0x013085 (0x2cf7a bytes) 000029 1780450245.696518 write 0x00f35e thru 0x01e1a6 (0xee49 bytes) 000030 1780450245.708131 mapwrite 0x00035f thru 0x009348 (0x8fea bytes) 000031 1780450245.836537 MIRROR_EXTEND to 2 mirrors 000032 1780450246.628486 mapwrite 0x00111d thru 0x00b6f0 (0xa5d4 bytes) 000033 1780450246.796517 write 0x009847 thru 0x015623 (0xbddd bytes) 000035 1780450246.803133 write 0x038eb6 thru 0x039a33 (0xb7e bytes) 000037 1780450246.805636 mapwrite 0x027f82 thru 0x034a08 (0xca87 bytes) 000039 1780450246.898611 trunc from 0x039a34 to 0x01c3f0 (0x1d643 bytes) 000040 1780450246.921550 trunc from 0x01c3f1 to 0x00b90a (0x10ae6 bytes) 000045 1780450246.944553 mapwrite 0x007a54 thru 0x010e25 (0x93d2 bytes) 000047 1780450247.054274 mapread 0x008cd6 thru 0x010e25 (0x8150 bytes) 000049 1780450247.057116 mapread 0x00e3d6 thru 0x010e25 (0x2a50 bytes) 000051 1780450247.058670 write 0x03da5f thru 0x03ed5a (0x12fc bytes) 000053 1780450247.061375 mapwrite 0x036f62 thru 0x03718b (0x22a bytes) 000054 1780450247.138292 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) 000059 1780450247.371498 trunc from 0x03ed5b to 0x023f3b (0x1ae1f bytes) 000060 1780450247.402515 mapread 0x003461 thru 0x012b7e (0xf71e bytes) 000063 1780450247.453968 mapwrite 0x038028 thru 0x03c209 (0x41e2 bytes) 000064 1780450247.655720 trunc from 0x03c20a to 0x01f24b (0x1cfbe bytes) 000065 1780450247.688020 mapwrite 0x02cd2d thru 0x0374ad (0xa781 bytes) 000066 1780450247.954625 mapwrite 0x012629 thru 0x01d910 (0xb2e8 bytes) 000067 1780450248.079447 write 0x03414d thru 0x035ed1 (0x1d85 bytes) 000069 1780450248.097949 write 0x030a39 thru 0x037138 (0x6700 bytes) 000071 1780450248.112880 mapread 0x009a17 thru 0x010381 (0x696b bytes) 000072 1780450248.124962 mapread 0x0072c7 thru 0x009d4a (0x2a84 bytes) 000077 1780450248.160479 read 0x01b99e thru 0x02a429 (0xea8c bytes) 000078 1780450248.182253 mapwrite 0x001d4b thru 0x00fb3c (0xddf2 bytes) 000079 1780450248.280475 trunc from 0x0374ae to 0x028f32 (0xe57b bytes) 000081 1780450248.332360 trunc from 0x028f33 to 0x01cfec (0xbf46 bytes) 000082 1780450248.357401 trunc from 0x01cfed to 0x02cdc4 (0xfdd8 bytes) 000083 1780450248.387453 mapwrite 0x002b94 thru 0x011459 (0xe8c6 bytes) 000084 1780450248.495638 write 0x02ea67 thru 0x0385c5 (0x9b5f bytes) 000085 1780450248.505022 mapwrite 0x03305c thru 0x037f94 (0x4f39 bytes) 000090 1780450248.619063 mapread 0x02a9bf thru 0x0379f5 (0xd037 bytes) 000092 1780450248.629580 write 0x036084 thru 0x036355 (0x2d2 bytes) 000093 1780450248.630616 mapwrite 0x014bbc thru 0x0246dc (0xfb21 bytes) 000094 1780450248.761443 write 0x02ef9c thru 0x0378e0 (0x8945 bytes) 000095 1780450248.762797 mapwrite 0x000a3f thru 0x0084cf (0x7a91 bytes) 000098 1780450248.952686 read 0x02a368 thru 0x033bfc (0x9895 bytes) 000099 1780450248.957292 mapread 0x02ec5c thru 0x037de2 (0x9187 bytes) 000100 1780450248.965736 mapwrite 0x01fb89 thru 0x02d513 (0xd98b bytes) 000101 1780450249.182306 mapwrite 0x02e7d6 thru 0x03a07a (0xb8a5 bytes) 000103 1780450249.381521 trunc from 0x03a07b to 0x00c038 (0x2e042 bytes) 000104 1780450249.434217 trunc from 0x00c039 to 0x016b42 (0xab0a bytes) 000105 1780450249.478274 trunc from 0x016b43 to 0x01532d (0x1815 bytes) 000108 1780450249.515314 read 0x009fd5 thru 0x01532d (0xb359 bytes) 000109 1780450249.541034 MIRROR_EXTEND to 2 mirrors 000110 1780450250.852796 read 0x00f751 thru 0x01532d (0x5bdd bytes) 000114 1780450250.904277 mapwrite 0x01a384 thru 0x028227 (0xdea4 bytes) 000115 1780450251.212925 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) 000116 1780450251.391763 mapwrite 0x028c8a thru 0x02b45a (0x27d1 bytes) 000117 1780450251.513536 write 0x002f98 thru 0x005140 (0x21a9 bytes) 000122 1780450251.529192 write 0x03bee3 thru 0x03ffff (0x411d bytes) 000124 1780450251.531394 mapread 0x02f3e5 thru 0x0396f9 (0xa315 bytes) 000125 1780450251.564697 MIRROR_EXTEND to 2 mirrors 000128 1780450252.653567 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) 000130 1780450252.841759 MIRROR_EXTEND to 2 mirrors 000131 1780450253.902304 read 0x028afe thru 0x02a9a2 (0x1ea5 bytes) 000132 1780450253.931871 mapwrite 0x007377 thru 0x016ed9 (0xfb63 bytes) 000133 1780450254.211788 read 0x03d7b7 thru 0x03ffff (0x2849 bytes) 000135 1780450254.236490 mapwrite 0x036229 thru 0x039f3c (0x3d14 bytes) truncating to largest ever: 0x3cf2c 000136 1780450254.324255 trunc from 0x040000 to 0x03cf2b (0x30d4 bytes) 000138 1780450254.366496 mapwrite 0x0125b4 thru 0x019a01 (0x744e bytes) 000139 1780450254.451214 trunc from 0x03cf2c to 0x03662d (0x68fe bytes) 000140 1780450254.469365 mapread 0x028631 thru 0x03495f (0xc32f bytes) 000141 1780450254.471408 mapread 0x023c6b thru 0x028592 (0x4928 bytes) 000144 1780450254.479131 MIRROR_RESYNC 2 mirrors 000145 1780450255.532064 read 0x00719f thru 0x013849 (0xc6ab bytes) 000146 1780450255.564787 MIRROR_EXTEND to 3 mirrors 000148 1780450256.577501 write 0x01c3f0 thru 0x025fa1 (0x9bb2 bytes) 000150 1780450256.680677 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3662e): Mirror 2: 0x371f7f16 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3662e): Mirror 2: 0x371f7f16 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3662e: skipped 000151 1780450257.256095 write 0x0114a6 thru 0x01258d (0x10e8 bytes) 000154 1780450257.270195 read 0x0288e3 thru 0x02f070 (0x678e bytes) 000156 1780450257.283325 mapwrite 0x01d771 thru 0x02cd06 (0xf596 bytes) 000157 1780450257.429970 mapwrite 0x03d4a8 thru 0x03ffff (0x2b58 bytes) 000158 1780450257.532840 mapread 0x022e7a thru 0x0318ce (0xea55 bytes) 000159 1780450257.545289 trunc from 0x040000 to 0x033f5b (0xc0a4 bytes) 000161 1780450257.566617 write 0x00ce32 thru 0x01c030 (0xf1ff bytes) 000162 1780450257.583102 mapread 0x031c14 thru 0x033f5b (0x2348 bytes) 000163 1780450257.586750 mapread 0x024db9 thru 0x02f751 (0xa999 bytes) 000165 1780450257.598741 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x33f5c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33f5c): Mirror 2: 0x733f19ac (stale) CRC-32 checksum value for chunk [0, 0x33f5c): Mirror 1: 0x342fad1f Mirror 3: 0x342fad1f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33f5c: skipped 000166 1780450258.832744 MIRROR_RESYNC 3 mirrors 000167 1780450259.840048 trunc from 0x033f5c to 0x030bc0 (0x339b bytes) 000169 1780450259.965496 read 0x004415 thru 0x010563 (0xc14f bytes) 000172 1780450259.979738 read 0x016887 thru 0x0261c7 (0xf941 bytes) 000174 1780450259.995071 write 0x03f404 thru 0x03ffff (0xbfc bytes) 000175 1780450259.999166 mapwrite 0x009376 thru 0x013e52 (0xaadd bytes) 000176 1780450260.103736 write 0x02fe44 thru 0x031619 (0x17d6 bytes) 000177 1780450260.129623 MIRROR_RESYNC 3 mirrors 000180 1780450260.970833 trunc from 0x040000 to 0x01ab93 (0x2546c bytes) 000181 1780450261.129381 mapwrite 0x025eb5 thru 0x031c28 (0xbd74 bytes) 000182 1780450261.344573 mapwrite 0x032bd1 thru 0x03b07a (0x84aa bytes) 000184 1780450261.535610 read 0x036691 thru 0x03b07a (0x49ea bytes) 000186 1780450261.539777 mapread 0x033e5a thru 0x03b07a (0x7221 bytes) 000187 1780450261.542140 read 0x01e287 thru 0x0277da (0x9554 bytes) 000189 1780450261.557392 read 0x02429a thru 0x02c721 (0x8488 bytes) 000190 1780450261.560815 mapwrite 0x035b93 thru 0x03915c (0x35ca bytes) 000192 1780450261.640803 trunc from 0x03b07b to 0x03a3c0 (0xcba bytes) 000193 1780450261.671800 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a3c1): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a3c1): Mirror 2: 0x18ab0abf (stale) Mirror 3: 0x18ab0abf (stale) CRC-32 checksum value for chunk [0, 0x3a3c1): Mirror 1: 0x89df49a8 Mirror 4: 0x89df49a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a3c1: skipped 000195 1780450262.983263 MIRROR_RESYNC 4 mirrors 000196 1780450264.230918 mapwrite 0x027f3e thru 0x02a80c (0x28cf bytes) 000199 1780450264.464327 write 0x014ce2 thru 0x0238bf (0xebde bytes) 000200 1780450264.478463 trunc from 0x03a3c1 to 0x037616 (0x2daa bytes) 000201 1780450264.500796 mapread 0x0273a3 thru 0x02c5fd (0x525b bytes) 000205 1780450264.511065 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x37617): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37617): Mirror 2: 0xa71f7777 (stale) Mirror 3: 0xa71f7777 (stale) Mirror 4: 0xa71f7777 (stale) CRC-32 checksum value for chunk [0, 0x37617): Mirror 1: 0x7d620084 Mirror 5: 0x7d620084 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37617: skipped 000206 1780450265.729188 trunc from 0x037617 to 0x017b56 (0x1fac0 bytes) 000210 1780450265.896929 MIRROR_RESYNC 5 mirrors 000211 1780450267.126591 trunc from 0x017b57 to 0x0377dc (0x1fc86 bytes) 000213 1780450267.213638 mapread 0x035341 thru 0x0377dc (0x249c bytes) truncating to largest ever: 0x3f495 000214 1780450267.231770 trunc from 0x0377dd to 0x03f494 (0x7cb8 bytes) 000216 1780450267.254240 write 0x01beef thru 0x02598b (0x9a9d bytes) 000217 1780450267.274307 mapwrite 0x032b6e thru 0x03ffff (0xd492 bytes) 000218 1780450267.492527 trunc from 0x040000 to 0x00325c (0x3cda3 bytes) 000222 1780450267.533455 trunc from 0x00325d to 0x01d4d5 (0x1a279 bytes) 000224 1780450267.567295 mapwrite 0x03ae36 thru 0x03ffff (0x51ca bytes) 000225 1780450267.665152 mapwrite 0x020a23 thru 0x0273ee (0x69cc bytes) 000226 1780450267.744748 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfdccade1 (stale) Mirror 4: 0xfdccade1 (stale) Mirror 5: 0xfdccade1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfdccade1 (stale) Mirror 4: 0xfdccade1 (stale) Mirror 5: 0xfdccade1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000227 1780450268.156405 mapread 0x023e3f thru 0x02d55e (0x9720 bytes) 000230 1780450268.175614 write 0x01f3ec thru 0x02389d (0x44b2 bytes) 000231 1780450268.176730 mapwrite 0x02d5de thru 0x03322c (0x5c4f bytes) 000237 1780450268.252521 read 0x012afb thru 0x01ee0b (0xc311 bytes) 000239 1780450268.268504 trunc from 0x040000 to 0x032f96 (0xd069 bytes) 000240 1780450268.283487 trunc from 0x032f97 to 0x036b03 (0x3b6d bytes) 000241 1780450268.304527 write 0x0370e1 thru 0x037b71 (0xa91 bytes) 000243 1780450268.307155 trunc from 0x037b72 to 0x026b20 (0x11051 bytes) 000245 1780450268.327159 read 0x015299 thru 0x019736 (0x449e bytes) 000246 1780450268.327960 write 0x00965e thru 0x00b734 (0x20d7 bytes) 000247 1780450268.339413 trunc from 0x026b21 to 0x011243 (0x158dd bytes) 000249 1780450268.367511 mapread 0x00e3f0 thru 0x011243 (0x2e54 bytes) 000252 1780450268.371288 mapread 0x00e14f thru 0x011243 (0x30f5 bytes) 000253 1780450268.372381 mapread 0x00d66e thru 0x00d908 (0x29b bytes) 000256 1780450268.382482 MIRROR_RESYNC 4 mirrors 000257 1780450269.194565 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) 000262 1780450269.579406 mapread 0x00f3b9 thru 0x011243 (0x1e8b bytes) 000263 1780450269.646246 read 0x007068 thru 0x00e4f5 (0x748e bytes) 000264 1780450269.655828 mapwrite 0x03a2ef thru 0x03ffff (0x5d11 bytes) 000265 1780450269.898474 read 0x0183fd thru 0x022468 (0xa06c bytes) 000266 1780450269.924385 mapread 0x00b424 thru 0x01540d (0x9fea bytes) 000267 1780450269.925625 mapwrite 0x031e7d thru 0x03fe82 (0xe006 bytes) 000271 1780450269.994963 read 0x0364db thru 0x03ffff (0x9b25 bytes) 000273 1780450269.998956 mapwrite 0x00e36c thru 0x013c11 (0x58a6 bytes) 000274 1780450270.093816 read 0x03e3c3 thru 0x03ffff (0x1c3d bytes) 000277 1780450270.104096 mapread 0x031df0 thru 0x039e33 (0x8044 bytes) 000278 1780450270.111026 mapread 0x015d1f thru 0x02348f (0xd771 bytes) 000280 1780450270.116111 trunc from 0x040000 to 0x01123c (0x2edc3 bytes) 000281 1780450270.164914 mapread 0x0043cb thru 0x01123c (0xce72 bytes) 000284 1780450270.173109 read 0x002b59 thru 0x01003b (0xd4e3 bytes) 000286 1780450270.180532 MIRROR_RESYNC 3 mirrors 000291 1780450271.145107 write 0x034d15 thru 0x03dfaf (0x929b bytes) 000292 1780450271.226015 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3dfb0): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dfb0): Mirror 4: 0x86b4cb5c (stale) Mirror 5: 0x86b4cb5c (stale) CRC-32 checksum value for chunk [0, 0x3dfb0): Mirror 1: 0x21a979f7 Mirror 6: 0x21a979f7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dfb0: skipped 000294 1780450272.264441 write 0x02d0f3 thru 0x02ef7e (0x1e8c bytes) 000295 1780450272.362168 read 0x0028b8 thru 0x00dfe2 (0xb72b bytes) 000297 1780450272.379129 trunc from 0x03dfb0 to 0x00d6d9 (0x308d6 bytes) 000299 1780450272.406766 mapread 0x00d17b thru 0x00d6d9 (0x55f bytes) 000300 1780450272.407828 trunc from 0x00d6da to 0x024ac1 (0x173e8 bytes) 000301 1780450272.428309 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x24ac2): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24ac2): Mirror 4: 0x50e4becd (stale) Mirror 5: 0x50e4becd (stale) Mirror 6: 0x50e4becd (stale) CRC-32 checksum value for chunk [0, 0x24ac2): Mirror 1: 0x820fcf3f Mirror 7: 0x820fcf3f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24ac2: skipped 000302 1780450273.346036 read 0x0182c1 thru 0x019be0 (0x1920 bytes) 000303 1780450273.371400 mapread 0x01815c thru 0x019f4d (0x1df2 bytes) 000304 1780450273.394978 mapwrite 0x021cd0 thru 0x027675 (0x59a6 bytes) 000306 1780450273.663429 mapwrite 0x02c7da thru 0x039dcb (0xd5f2 bytes) 000307 1780450273.816716 read 0x035778 thru 0x035ca1 (0x52a bytes) 000308 1780450273.818247 trunc from 0x039dcc to 0x01058a (0x29841 bytes) 000309 1780450273.840585 trunc from 0x01058b to 0x011459 (0xecf bytes) 000310 1780450273.868931 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1145a): Mirror 4: 0x779cf6bf (stale) Mirror 5: 0x779cf6bf (stale) Mirror 6: 0x779cf6bf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1145a): Mirror 4: 0x779cf6bf (stale) Mirror 5: 0x779cf6bf (stale) Mirror 6: 0x779cf6bf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1145a: skipped 000311 1780450274.267622 mapread 0x004359 thru 0x00b1fa (0x6ea2 bytes) 000313 1780450274.312500 mapwrite 0x01bc2b thru 0x02759e (0xb974 bytes) 000314 1780450274.415268 read 0x010b24 thru 0x016a32 (0x5f0f bytes) 000316 1780450274.427739 trunc from 0x02759f to 0x038ba6 (0x11608 bytes) 000318 1780450274.465775 write 0x0311a9 thru 0x039787 (0x85df bytes) 000322 1780450274.479372 mapwrite 0x01e841 thru 0x02d303 (0xeac3 bytes) 000324 1780450274.585254 trunc from 0x039788 to 0x039123 (0x664 bytes) 000325 1780450274.624630 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39124): Mirror 5: 0xcfd0e616 (stale) Mirror 6: 0x7f3dabcb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39124): Mirror 5: 0xcfd0e616 (stale) Mirror 6: 0x7f3dabcb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39124: skipped 000327 1780450275.009598 mapwrite 0x01a68a thru 0x020c37 (0x65ae bytes) 000329 1780450275.110448 read 0x030847 thru 0x038e34 (0x85ee bytes) 000330 1780450275.122592 mapread 0x032558 thru 0x034301 (0x1daa bytes) 000332 1780450275.127030 trunc from 0x039124 to 0x017800 (0x21923 bytes) 000333 1780450275.152777 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x17801): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17801): Mirror 5: 0x69457345 (stale) Mirror 6: 0x69457345 (stale) CRC-32 checksum value for chunk [0, 0x17801): Mirror 1: 0x9d33046e Mirror 7: 0x9d33046e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17801: skipped 000334 1780450276.108519 write 0x00867e thru 0x015511 (0xce94 bytes) 000335 1780450276.186064 write 0x039a35 thru 0x03ffff (0x65cb bytes) 000337 1780450276.191226 mapread 0x02054a thru 0x02bbbc (0xb673 bytes) 000338 1780450276.223791 read 0x01985e thru 0x01d73d (0x3ee0 bytes) 000339 1780450276.224708 mapwrite 0x0113ed thru 0x01ff14 (0xeb28 bytes) 000341 1780450276.320474 read 0x0213bd thru 0x02f774 (0xe3b8 bytes) 000342 1780450276.322077 write 0x00893d thru 0x015bf2 (0xd2b6 bytes) 000344 1780450276.324912 trunc from 0x040000 to 0x003dae (0x3c251 bytes) 000349 1780450276.390430 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3daf): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3daf): Mirror 5: 0xb4a6f72b (stale) Mirror 6: 0xb4a6f72b (stale) Mirror 7: 0xb4a6f72b (stale) CRC-32 checksum value for chunk [0, 0x3daf): Mirror 1: 0xb4a6f72b Mirror 8: 0xb4a6f72b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3daf: skipped 000350 1780450277.164573 write 0x017cbe thru 0x023685 (0xb9c8 bytes) 000351 1780450277.255066 trunc from 0x023686 to 0x00c894 (0x16df1 bytes) 000352 1780450277.286295 write 0x01fc6c thru 0x0237fc (0x3b91 bytes) 000353 1780450277.288429 mapread 0x00a10d thru 0x016226 (0xc11a bytes) 000354 1780450277.343327 mapread 0x00b52f thru 0x011baa (0x667c bytes) 000355 1780450277.344516 read 0x01620d thru 0x018b77 (0x296b bytes) 000356 1780450277.345223 write 0x000b97 thru 0x0062b5 (0x571f bytes) 000358 1780450277.376249 MIRROR_RESYNC 5 mirrors 000359 1780450278.736382 MIRROR_EXTEND to 6 mirrors 000360 1780450279.610155 MIRROR_RESYNC 6 mirrors 000361 1780450280.065358 MIRROR_RESYNC 6 mirrors 000362 1780450280.687790 mapwrite 0x006cc7 thru 0x00dfd7 (0x7311 bytes) 000369 1780450280.929713 mapwrite 0x00f815 thru 0x01ee06 (0xf5f2 bytes) 000370 1780450281.005960 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x237fd): Mirror 5: 0x777c5fdc (stale) Mirror 7: 0x777c5fdc (stale) Mirror 8: 0x777c5fdc (stale) Mirror 9: 0x777c5fdc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x237fd): Mirror 5: 0x777c5fdc (stale) Mirror 7: 0x777c5fdc (stale) Mirror 8: 0x777c5fdc (stale) Mirror 9: 0x777c5fdc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x237fd: skipped 000371 1780450281.384517 mapwrite 0x027597 thru 0x02f744 (0x81ae bytes) 000373 1780450281.488931 mapwrite 0x01be34 thru 0x02a3ce (0xe59b bytes) 000375 1780450281.556447 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f745): Mirror 7: 0x2224350e (stale) Mirror 8: 0x2224350e (stale) Mirror 9: 0x2224350e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f745): Mirror 7: 0x2224350e (stale) Mirror 8: 0x2224350e (stale) Mirror 9: 0x2224350e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f745: skipped 000376 1780450281.905013 write 0x02d026 thru 0x038b99 (0xbb74 bytes) 000377 1780450281.919414 MIRROR_RESYNC 4 mirrors 000378 1780450282.982453 mapread 0x033329 thru 0x038b99 (0x5871 bytes) 000379 1780450283.004699 write 0x026a22 thru 0x02f62e (0x8c0d bytes) 000380 1780450283.158218 mapwrite 0x0179ce thru 0x021756 (0x9d89 bytes) 000385 1780450283.252611 MIRROR_RESYNC 4 mirrors 000387 1780450284.218676 mapwrite 0x02e7b9 thru 0x033a2b (0x5273 bytes) 000388 1780450284.589373 write 0x0390ac thru 0x03ffff (0x6f54 bytes) 000389 1780450284.592831 read 0x0100cf thru 0x018410 (0x8342 bytes) 000390 1780450284.605072 read 0x00add3 thru 0x015b9c (0xadca bytes) 000392 1780450284.628115 mapread 0x03a5cf thru 0x03ffff (0x5a31 bytes) 000393 1780450284.631892 trunc from 0x040000 to 0x025c5a (0x1a3a5 bytes) 000394 1780450284.710630 MIRROR_RESYNC 4 mirrors 000395 1780450285.393140 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) 000396 1780450285.745620 read 0x01a285 thru 0x025c5a (0xb9d6 bytes) 000397 1780450285.766415 mapwrite 0x0392d9 thru 0x03ffff (0x6d27 bytes) 000398 1780450286.004894 mapread 0x0155a4 thru 0x01eb02 (0x955f bytes) 000399 1780450286.051638 MIRROR_RESYNC 3 mirrors 000400 1780450286.888551 trunc from 0x040000 to 0x01d54e (0x22ab1 bytes) 000404 1780450287.032205 mapwrite 0x02db08 thru 0x035978 (0x7e71 bytes) 000406 1780450287.154392 write 0x03cfb2 thru 0x03ffff (0x304e bytes) 000407 1780450287.155612 trunc from 0x040000 to 0x005406 (0x3abf9 bytes) 000409 1780450287.185117 trunc from 0x005407 to 0x037532 (0x3212c bytes) 000410 1780450287.217410 read 0x028c5d thru 0x03037f (0x7723 bytes) 000412 1780450287.229616 mapwrite 0x01fd78 thru 0x02aef6 (0xb17f bytes) 000414 1780450287.311527 read 0x036c18 thru 0x037532 (0x91b bytes) 000415 1780450287.321359 trunc from 0x037533 to 0x01908d (0x1e4a5 bytes) 000417 1780450287.340048 write 0x02ede2 thru 0x030d7b (0x1f9a bytes) 000419 1780450287.345251 mapread 0x01cc9f thru 0x02b226 (0xe588 bytes) 000420 1780450287.486265 mapwrite 0x03ab01 thru 0x03ffff (0x54ff bytes) 000425 1780450287.596952 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x5f402b4 (stale) Mirror 8: 0x5f402b4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc91c7cd4 Mirror 9: 0xc91c7cd4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000428 1780450288.597018 mapwrite 0x01ca71 thru 0x022a59 (0x5fe9 bytes) 000429 1780450288.837693 read 0x031d89 thru 0x03cc12 (0xae8a bytes) 000430 1780450288.851394 mapread 0x0179ad thru 0x01b323 (0x3977 bytes) 000431 1780450288.855199 mapread 0x0180aa thru 0x01fc3d (0x7b94 bytes) 000432 1780450288.858549 mapwrite 0x021026 thru 0x02ee0d (0xdde8 bytes) 000433 1780450289.001050 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x5f402b4 (stale) Mirror 8: 0x5f402b4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x5f402b4 (stale) Mirror 8: 0x5f402b4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000434 1780450289.398690 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x5f402b4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x5f402b4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000435 1780450289.716954 write 0x01955d thru 0x020959 (0x73fd bytes) 000438 1780450289.761767 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) 000443 1780450289.930821 read 0x03c08a thru 0x03ffff (0x3f76 bytes) 000447 1780450289.943074 read 0x00f134 thru 0x013c24 (0x4af1 bytes) 000448 1780450289.966907 mapread 0x01e665 thru 0x023285 (0x4c21 bytes) 000449 1780450289.993260 MIRROR_EXTEND to 2 mirrors 000451 1780450290.926749 mapread 0x021a65 thru 0x027eef (0x648b bytes) 000454 1780450291.032334 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) 000455 1780450291.253988 mapread 0x031c13 thru 0x03ffff (0xe3ed bytes) 000457 1780450291.307869 MIRROR_EXTEND to 2 mirrors 000458 1780450292.232772 MIRROR_EXTEND to 3 mirrors 000460 1780450293.037260 write 0x02394a thru 0x02bf73 (0x862a bytes) 000461 1780450293.173951 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5b78e31c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5b78e31c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000462 1780450293.621277 write 0x01b76e thru 0x02a021 (0xe8b4 bytes) 000463 1780450293.637528 mapwrite 0x01b6f3 thru 0x01befd (0x80b bytes) 000464 1780450293.727484 read 0x0296cb thru 0x033d3c (0xa672 bytes) 000465 1780450293.737785 mapread 0x00760b thru 0x0153c0 (0xddb6 bytes) 000466 1780450293.773807 mapwrite 0x03924c thru 0x03ffff (0x6db4 bytes) 000467 1780450293.840697 trunc from 0x040000 to 0x001631 (0x3e9ce bytes) 000468 1780450293.878953 mapwrite 0x001de6 thru 0x00689f (0x4aba bytes) 000470 1780450294.030411 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) 000473 1780450294.225142 mapread 0x00664f thru 0x00689f (0x251 bytes) 000475 1780450294.233367 read 0x004c18 thru 0x00689f (0x1c88 bytes) 000476 1780450294.240320 mapread 0x0026eb thru 0x00689f (0x41b5 bytes) 000479 1780450294.259283 read 0x004a47 thru 0x00689f (0x1e59 bytes) 000482 1780450294.262415 write 0x03794e thru 0x03c52c (0x4bdf bytes) 000484 1780450294.265187 mapwrite 0x008dbe thru 0x00b20a (0x244d bytes) 000486 1780450294.339545 read 0x031c0e thru 0x03ac02 (0x8ff5 bytes) 000489 1780450294.343159 mapread 0x025459 thru 0x03477c (0xf324 bytes) 000490 1780450294.345189 read 0x00f1c6 thru 0x0132c0 (0x40fb bytes) 000493 1780450294.347608 trunc from 0x03c52d to 0x03ed81 (0x2855 bytes) 000494 1780450294.374475 write 0x00944b thru 0x00e477 (0x502d bytes) 000497 1780450294.386434 mapread 0x0186dc thru 0x023d30 (0xb655 bytes) 000498 1780450294.389264 read 0x03c70d thru 0x03ed81 (0x2675 bytes) 000499 1780450294.428974 write 0x01293b thru 0x014617 (0x1cdd bytes) 000500 1780450294.430284 trunc from 0x03ed82 to 0x01f6a6 (0x1f6db bytes) 000502 1780450294.504045 mapread 0x00754d thru 0x01115d (0x9c11 bytes) 000504 1780450294.505838 read 0x010b38 thru 0x01c6f2 (0xbbbb bytes) 000505 1780450294.506495 read 0x01dcb4 thru 0x01f6a6 (0x19f3 bytes) 000507 1780450294.507583 trunc from 0x01f6a7 to 0x0258ab (0x6205 bytes) 000508 1780450294.534531 read 0x0006fd thru 0x007a10 (0x7314 bytes) 000509 1780450294.536077 trunc from 0x0258ac to 0x02bf68 (0x66bd bytes) 000512 1780450294.565628 mapwrite 0x01e385 thru 0x02423a (0x5eb6 bytes) 000513 1780450294.657054 trunc from 0x02bf69 to 0x000152 (0x2be16 bytes) 000514 1780450294.683903 mapread 0x00001b thru 0x000152 (0x138 bytes) 000515 1780450294.691049 MIRROR_EXTEND to 2 mirrors 000519 1780450295.156629 mapwrite 0x03d398 thru 0x03ffff (0x2c68 bytes) 000520 1780450295.370383 mapread 0x019f2b thru 0x0268ba (0xc990 bytes) 000522 1780450295.405270 MIRROR_RESYNC 2 mirrors 000523 1780450296.188881 mapread 0x021d7a thru 0x02f68c (0xd913 bytes) 000524 1780450296.223006 read 0x03dc3f thru 0x03ffff (0x23c1 bytes) 000525 1780450296.228010 read 0x00deda thru 0x0197a7 (0xb8ce bytes) 000526 1780450296.237316 mapwrite 0x03c107 thru 0x03ffff (0x3ef9 bytes) 000529 1780450296.370792 write 0x03f5b4 thru 0x03ffff (0xa4c bytes) 000530 1780450296.374865 mapwrite 0x01e2cb thru 0x0230c1 (0x4df7 bytes) 000531 1780450296.463741 MIRROR_RESYNC 2 mirrors 000532 1780450297.136113 MIRROR_EXTEND to 3 mirrors 000535 1780450298.012552 mapread 0x017405 thru 0x02122e (0x9e2a bytes) 000536 1780450298.051120 trunc from 0x040000 to 0x007c72 (0x3838d bytes) 000537 1780450298.208031 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x7c73): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7c73): Mirror 2: 0xe21b4736 (stale) Mirror 3: 0xe21b4736 (stale) CRC-32 checksum value for chunk [0, 0x7c73): Mirror 1: 0xe21b4736 Mirror 4: 0xe21b4736 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7c73: skipped 000539 1780450299.368739 mapread 0x0009b5 thru 0x007c72 (0x72be bytes) 000540 1780450299.437264 write 0x006ec9 thru 0x0096b2 (0x27ea bytes) 000541 1780450299.514259 trunc from 0x0096b3 to 0x0148c5 (0xb213 bytes) 000542 1780450299.535157 mapread 0x00e0e2 thru 0x010988 (0x28a7 bytes) 000543 1780450299.546164 trunc from 0x0148c6 to 0x03f2fa (0x2aa35 bytes) 000546 1780450299.564680 mapwrite 0x02b8d9 thru 0x02ed78 (0x34a0 bytes) 000547 1780450299.687996 read 0x0208e6 thru 0x025f83 (0x569e bytes) 000548 1780450299.697931 read 0x02f88b thru 0x035205 (0x597b bytes) 000549 1780450299.739075 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3f2fb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f2fb): Mirror 2: 0x2503503a (stale) Mirror 3: 0x2503503a (stale) Mirror 4: 0x615552ee (stale) CRC-32 checksum value for chunk [0, 0x3f2fb): Mirror 1: 0x7e628b05 Mirror 5: 0x7e628b05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f2fb: skipped 000550 1780450300.624284 read 0x017831 thru 0x01a24b (0x2a1b bytes) 000551 1780450300.639005 mapread 0x03b59c thru 0x03f2fa (0x3d5f bytes) 000554 1780450300.699503 mapread 0x01d39d thru 0x02b7dc (0xe440 bytes) 000555 1780450300.750512 write 0x02bc33 thru 0x037008 (0xb3d6 bytes) 000556 1780450300.838962 read 0x034f08 thru 0x03c626 (0x771f bytes) 000559 1780450300.854291 read 0x02b42d thru 0x03a472 (0xf046 bytes) 000561 1780450300.859887 trunc from 0x03f2fb to 0x037344 (0x7fb6 bytes) 000562 1780450300.911358 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x37345): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37345): Mirror 2: 0xb553685d (stale) Mirror 3: 0xb553685d (stale) Mirror 4: 0xcf4d3e94 (stale) Mirror 5: 0x64396b69 (stale) CRC-32 checksum value for chunk [0, 0x37345): Mirror 1: 0x94790359 Mirror 6: 0x94790359 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37345: skipped 000564 1780450301.998859 trunc from 0x037345 to 0x029179 (0xe1cb bytes) 000566 1780450302.107094 read 0x01a58e thru 0x0243f4 (0x9e67 bytes) 000569 1780450302.125353 trunc from 0x02917a to 0x001612 (0x27b67 bytes) 000570 1780450302.154712 trunc from 0x001613 to 0x028320 (0x26d0e bytes) 000572 1780450302.181135 trunc from 0x028321 to 0x006c77 (0x216a9 bytes) 000574 1780450302.219790 write 0x02144c thru 0x03004f (0xec04 bytes) 000575 1780450302.236021 mapwrite 0x03c362 thru 0x03ffff (0x3c9e bytes) 000578 1780450302.385754 trunc from 0x040000 to 0x03d26c (0x2d93 bytes) 000579 1780450302.420888 write 0x0103eb thru 0x015cb0 (0x58c6 bytes) 000581 1780450302.441292 mapwrite 0x00577a thru 0x0079c2 (0x2249 bytes) 000584 1780450302.524981 read 0x004a40 thru 0x00b8a2 (0x6e63 bytes) 000585 1780450302.526405 write 0x00354b thru 0x00e51b (0xafd1 bytes) 000586 1780450302.529043 write 0x0165e9 thru 0x021441 (0xae59 bytes) 000588 1780450302.531980 mapwrite 0x01b3d8 thru 0x023496 (0x80bf bytes) 000589 1780450302.628475 write 0x002578 thru 0x0044ee (0x1f77 bytes) 000591 1780450302.634109 mapwrite 0x03e2f2 thru 0x03ffff (0x1d0e bytes) 000593 1780450302.821314 write 0x01cfcf thru 0x029b8a (0xcbbc bytes) 000595 1780450302.831223 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xda7301f2 (stale) Mirror 3: 0xda7301f2 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 5: 0x1e1de1be (stale) Mirror 6: 0x3ca74f0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9f89ee74 Mirror 7: 0x9f89ee74 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000597 1780450304.182084 MIRROR_RESYNC 7 mirrors 000598 1780450305.480869 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) 000599 1780450306.008464 write 0x02b7a3 thru 0x03b3dd (0xfc3b bytes) 000602 1780450306.150822 read 0x0069bf thru 0x00c614 (0x5c56 bytes) 000603 1780450306.170911 trunc from 0x040000 to 0x019376 (0x26c89 bytes) 000605 1780450306.207204 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19377): Mirror 2: 0x3c825f41 (stale) Mirror 3: 0x3c825f41 (stale) Mirror 4: 0x3c825f41 (stale) Mirror 7: 0x3c825f41 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19377): Mirror 2: 0x3c825f41 (stale) Mirror 3: 0x3c825f41 (stale) Mirror 4: 0x3c825f41 (stale) Mirror 7: 0x3c825f41 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19377: skipped 000607 1780450306.606798 read 0x0020fd thru 0x010531 (0xe435 bytes) 000608 1780450306.627625 mapread 0x003703 thru 0x011327 (0xdc25 bytes) 000609 1780450306.634145 trunc from 0x019377 to 0x0133f6 (0x5f80 bytes) 000610 1780450306.662621 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x133f7): Mirror 2: 0xe8460554 (stale) Mirror 3: 0xe8460554 (stale) Mirror 4: 0xe8460554 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x133f7): Mirror 2: 0xe8460554 (stale) Mirror 3: 0xe8460554 (stale) Mirror 4: 0xe8460554 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x133f7: skipped 000612 1780450307.154239 write 0x0292b5 thru 0x036cc0 (0xda0c bytes) 000614 1780450307.159442 mapread 0x027a9d thru 0x02c3b5 (0x4919 bytes) 000615 1780450307.169636 read 0x031e07 thru 0x036cc0 (0x4eba bytes) 000616 1780450307.170334 mapread 0x02ea1e thru 0x036cc0 (0x82a3 bytes) 000617 1780450307.177307 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36cc1): Mirror 2: 0x287b49ce (stale) Mirror 4: 0x287b49ce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36cc1): Mirror 2: 0x287b49ce (stale) Mirror 4: 0x287b49ce (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36cc1: skipped 000620 1780450307.470423 mapwrite 0x00bb5d thru 0x016905 (0xada9 bytes) 000621 1780450307.582230 read 0x00709b thru 0x015764 (0xe6ca bytes) 000622 1780450307.583082 trunc from 0x036cc1 to 0x037ad3 (0xe13 bytes) 000623 1780450307.602522 trunc from 0x037ad4 to 0x019e86 (0x1dc4d bytes) truncating to largest ever: 0x3f8b5 000624 1780450307.619593 trunc from 0x019e87 to 0x03f8b4 (0x25a2e bytes) 000626 1780450307.635142 write 0x00ac30 thru 0x016c42 (0xc013 bytes) 000627 1780450307.637769 mapread 0x038626 thru 0x03f8b4 (0x728f bytes) 000629 1780450307.650202 read 0x01bbad thru 0x02882f (0xcc83 bytes) 000631 1780450307.664187 trunc from 0x03f8b5 to 0x0154de (0x2a3d6 bytes) 000632 1780450307.684519 mapwrite 0x003218 thru 0x008bcc (0x59b5 bytes) 000634 1780450307.739317 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x154df): Mirror 2: 0x27d881ff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x154df): Mirror 2: 0x27d881ff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x154df: skipped 000635 1780450308.115220 write 0x01d220 thru 0x0266a9 (0x948a bytes) 000636 1780450308.116693 mapwrite 0x00e39e thru 0x01d4db (0xf13e bytes) 000638 1780450308.257857 trunc from 0x0266aa to 0x03f8a9 (0x19200 bytes) 000640 1780450308.291784 mapwrite 0x00ed50 thru 0x01d45c (0xe70d bytes) 000641 1780450308.394983 trunc from 0x03f8aa to 0x0324d8 (0xd3d1 bytes) 000642 1780450308.432709 mapread 0x01a8dc thru 0x0251dd (0xa902 bytes) 000643 1780450308.436151 mapwrite 0x0074a4 thru 0x00b45f (0x3fbc bytes) 000644 1780450308.562483 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) 000645 1780450308.792316 write 0x0151fd thru 0x01a637 (0x543b bytes) 000646 1780450308.808408 mapwrite 0x026b20 thru 0x02f622 (0x8b03 bytes) 000647 1780450308.968554 read 0x008fab thru 0x00b866 (0x28bc bytes) 000648 1780450308.979609 mapwrite 0x01f15c thru 0x01f4a0 (0x345 bytes) 000650 1780450309.057808 mapwrite 0x01ffac thru 0x024883 (0x48d8 bytes) 000653 1780450309.117820 read 0x025b3a thru 0x0324d8 (0xc99f bytes) 000656 1780450309.119942 read 0x00eb4a thru 0x01bcc2 (0xd179 bytes) 000657 1780450309.130846 trunc from 0x0324d9 to 0x00ac30 (0x278a8 bytes) 000659 1780450309.164101 read 0x004c84 thru 0x00ac30 (0x5fad bytes) 000662 1780450309.167333 read 0x002869 thru 0x00ac30 (0x83c8 bytes) 000664 1780450309.169557 read 0x00aa54 thru 0x00ac30 (0x1dd bytes) 000665 1780450309.175106 mapread 0x000b23 thru 0x00ac30 (0xa10e bytes) 000666 1780450309.179167 trunc from 0x00ac31 to 0x003b3c (0x70f4 bytes) 000667 1780450309.210315 read 0x002f23 thru 0x003b3c (0xc1a bytes) 000668 1780450309.211238 mapread 0x00181f thru 0x003b3c (0x231e bytes) 000669 1780450309.216397 trunc from 0x003b3d to 0x02d730 (0x29bf4 bytes) 000670 1780450309.253617 read 0x01759d thru 0x026644 (0xf0a8 bytes) 000671 1780450309.273196 read 0x01f136 thru 0x01ff3d (0xe08 bytes) 000672 1780450309.273993 trunc from 0x02d731 to 0x01438c (0x193a4 bytes) 000674 1780450309.302785 mapwrite 0x01cf15 thru 0x0261d7 (0x92c3 bytes) 000675 1780450309.416533 write 0x015c23 thru 0x0174c8 (0x18a6 bytes) 000677 1780450309.418910 write 0x000e5e thru 0x004c49 (0x3dec bytes) 000684 1780450309.425927 mapread 0x00800f thru 0x008c28 (0xc1a bytes) 000686 1780450309.429432 write 0x03cfee thru 0x03ffff (0x3012 bytes) 000687 1780450309.430809 mapwrite 0x01fe7a thru 0x02a13d (0xa2c4 bytes) 000689 1780450309.531813 mapwrite 0x038908 thru 0x03ffff (0x76f8 bytes) 000691 1780450309.580782 read 0x004302 thru 0x00c15a (0x7e59 bytes) 000693 1780450309.597261 MIRROR_EXTEND to 2 mirrors 000696 1780450310.406929 mapread 0x01ef93 thru 0x02bc90 (0xccfe bytes) 000698 1780450310.452991 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) 000700 1780450310.627939 write 0x017fe9 thru 0x024da9 (0xcdc1 bytes) 000701 1780450310.655209 read 0x032e07 thru 0x038ab1 (0x5cab bytes) 000702 1780450310.667497 read 0x01a231 thru 0x01fcdf (0x5aaf bytes) 000705 1780450310.670594 trunc from 0x040000 to 0x010e36 (0x2f1c9 bytes) 000706 1780450310.697681 write 0x00e950 thru 0x019cbe (0xb36f bytes) 000707 1780450310.730463 trunc from 0x019cbf to 0x00c2da (0xd9e4 bytes) 000708 1780450310.784212 mapread 0x000bbf thru 0x0029fb (0x1e3d bytes) 000710 1780450310.798158 mapwrite 0x0036b1 thru 0x00527b (0x1bcb bytes) 000713 1780450310.991118 write 0x03d208 thru 0x03d3c9 (0x1c2 bytes) 000714 1780450310.993103 trunc from 0x03d3ca to 0x001bcd (0x3b7fc bytes) 000716 1780450311.017145 mapread 0x000537 thru 0x001bcd (0x1697 bytes) 000717 1780450311.023662 write 0x010ba2 thru 0x01ca39 (0xbe98 bytes) 000719 1780450311.025798 write 0x01720d thru 0x01761c (0x410 bytes) 000721 1780450311.031504 mapread 0x002811 thru 0x009b87 (0x7377 bytes) 000722 1780450311.126754 read 0x00404b thru 0x00ab86 (0x6b3c bytes) 000723 1780450311.140589 read 0x010040 thru 0x011c7f (0x1c40 bytes) 000724 1780450311.145313 mapread 0x009d93 thru 0x0196fe (0xf96c bytes) 000727 1780450311.152018 mapread 0x013e8c thru 0x01ca39 (0x8bae bytes) 000731 1780450311.156288 mapread 0x01511c thru 0x016e95 (0x1d7a bytes) 000732 1780450311.165470 write 0x03b69e thru 0x03fbbe (0x4521 bytes) 000735 1780450311.169735 write 0x00e15a thru 0x018859 (0xa700 bytes) 000738 1780450311.183408 mapwrite 0x015e11 thru 0x01ba78 (0x5c68 bytes) 000739 1780450311.265172 mapwrite 0x011a4f thru 0x01f1c8 (0xd77a bytes) 000740 1780450311.365587 MIRROR_EXTEND to 2 mirrors 000741 1780450312.144179 mapwrite 0x0363ba thru 0x03ffff (0x9c46 bytes) 000743 1780450312.424254 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xbacb1f17 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa31db06a Mirror 3: 0xa31db06a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000744 1780450313.566741 write 0x0387ad thru 0x03ffff (0x7853 bytes) 000745 1780450313.730027 read 0x01966f thru 0x019c20 (0x5b2 bytes) 000748 1780450313.762397 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa31db06a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa31db06a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000749 1780450314.407473 write 0x0100e3 thru 0x01c604 (0xc522 bytes) 000750 1780450314.422613 mapread 0x02e25f thru 0x03c784 (0xe526 bytes) 000751 1780450314.445259 mapread 0x01b797 thru 0x020189 (0x49f3 bytes) 000752 1780450314.454278 write 0x00da87 thru 0x01020a (0x2784 bytes) 000755 1780450314.468794 mapread 0x02554f thru 0x02cfb6 (0x7a68 bytes) 000757 1780450314.478944 read 0x000978 thru 0x0012c3 (0x94c bytes) 000758 1780450314.490026 mapwrite 0x0121f8 thru 0x0185c6 (0x63cf bytes) 000759 1780450314.552733 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) 000760 1780450314.722216 mapwrite 0x02f6c3 thru 0x034381 (0x4cbf bytes) 000761 1780450314.866411 MIRROR_EXTEND to 2 mirrors 000762 1780450315.630073 MIRROR_RESYNC 2 mirrors 000764 1780450316.207101 mapread 0x00d3b6 thru 0x00e7ec (0x1437 bytes) 000765 1780450316.253115 mapwrite 0x01593e thru 0x01bf23 (0x65e6 bytes) 000767 1780450316.538159 MIRROR_RESYNC 2 mirrors 000768 1780450317.273142 trunc from 0x040000 to 0x01cbce (0x23431 bytes) 000770 1780450317.341801 mapread 0x017609 thru 0x01cbce (0x55c6 bytes) 000774 1780450317.368971 mapwrite 0x016c6a thru 0x0184d1 (0x1868 bytes) 000775 1780450317.415942 trunc from 0x01cbcf to 0x01d8b9 (0xceb bytes) 000776 1780450317.438226 write 0x023e1b thru 0x02bcbf (0x7ea5 bytes) 000777 1780450317.441260 write 0x02853d thru 0x0345c0 (0xc084 bytes) 000778 1780450317.444715 mapwrite 0x01433f thru 0x019416 (0x50d8 bytes) 000779 1780450317.509750 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x345c1): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x345c1): Mirror 2: 0x1db691f6 (stale) CRC-32 checksum value for chunk [0, 0x345c1): Mirror 1: 0xe6d9578d Mirror 3: 0xe6d9578d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x345c1: skipped 000782 1780450318.335232 read 0x004784 thru 0x00ea42 (0xa2bf bytes) 000783 1780450318.347367 mapread 0x0250b6 thru 0x029787 (0x46d2 bytes) 000784 1780450318.392832 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x345c1): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x345c1): Mirror 2: 0x1db691f6 (stale) CRC-32 checksum value for chunk [0, 0x345c1): Mirror 1: 0xe6d9578d Mirror 3: 0xe6d9578d Mirror 4: 0xe6d9578d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x345c1: skipped 000787 1780450319.552336 write 0x00446d thru 0x0058a4 (0x1438 bytes) 000788 1780450319.723801 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x345c1): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x345c1): Mirror 2: 0x1db691f6 (stale) Mirror 3: 0xe6d9578d (stale) Mirror 4: 0xe6d9578d (stale) CRC-32 checksum value for chunk [0, 0x345c1): Mirror 1: 0x22186493 Mirror 5: 0x22186493 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x345c1: skipped 000790 1780450320.767987 trunc from 0x0345c1 to 0x020b68 (0x13a58 bytes) 000794 1780450320.881240 trunc from 0x020b69 to 0x02ebfb (0xe093 bytes) 000795 1780450320.905258 mapread 0x012cbd thru 0x01e3b8 (0xb6fc bytes) 000799 1780450320.962808 mapwrite 0x0288bd thru 0x02dda2 (0x54e6 bytes) 000800 1780450321.141269 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2ebfc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ebfc): Mirror 2: 0x3f4a696f (stale) Mirror 3: 0x759e6a6b (stale) Mirror 4: 0x759e6a6b (stale) Mirror 5: 0xc38888fd (stale) CRC-32 checksum value for chunk [0, 0x2ebfc): Mirror 1: 0xa4287c7 Mirror 6: 0xa4287c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ebfc: skipped 000802 1780450322.479324 mapread 0x02413a thru 0x02ebfb (0xaac2 bytes) 000803 1780450322.561485 MIRROR_RESYNC 6 mirrors 000804 1780450324.068083 trunc from 0x02ebfc to 0x019fdf (0x14c1c bytes) 000805 1780450324.183861 trunc from 0x019fe0 to 0x02a91f (0x10940 bytes) 000807 1780450324.216501 mapwrite 0x00cc81 thru 0x0120de (0x545e bytes) 000808 1780450324.351366 write 0x014857 thru 0x01e2a9 (0x9a53 bytes) 000809 1780450324.363083 mapread 0x028619 thru 0x02a91f (0x2307 bytes) 000810 1780450324.387500 mapwrite 0x02e34c thru 0x031d26 (0x39db bytes) 000813 1780450324.514117 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x31d27): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31d27): Mirror 2: 0x7ea86455 (stale) Mirror 3: 0x7ea86455 (stale) Mirror 4: 0x7ea86455 (stale) Mirror 5: 0x7ea86455 (stale) Mirror 6: 0x7ea86455 (stale) CRC-32 checksum value for chunk [0, 0x31d27): Mirror 1: 0x82933c46 Mirror 7: 0x82933c46 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31d27: skipped 000816 1780450325.677936 mapread 0x02281c thru 0x02b043 (0x8828 bytes) 000818 1780450325.764832 write 0x012284 thru 0x01b61a (0x9397 bytes) 000819 1780450325.873084 write 0x033efa thru 0x0391ca (0x52d1 bytes) 000821 1780450325.878949 mapread 0x007ede thru 0x00918a (0x12ad bytes) 000822 1780450325.892391 mapread 0x02ef6b thru 0x0340c0 (0x5156 bytes) 000823 1780450325.907544 mapread 0x0311c3 thru 0x0391ca (0x8008 bytes) 000824 1780450325.908969 write 0x02815e thru 0x02c60d (0x44b0 bytes) 000826 1780450325.920173 read 0x00fae1 thru 0x017a04 (0x7f24 bytes) 000831 1780450325.934634 mapwrite 0x016eb9 thru 0x01aca0 (0x3de8 bytes) 000833 1780450326.056150 mapwrite 0x022ae9 thru 0x02603c (0x3554 bytes) 000834 1780450326.149900 mapread 0x008919 thru 0x011963 (0x904b bytes) 000837 1780450326.153702 trunc from 0x0391cb to 0x01eba8 (0x1a622 bytes) 000838 1780450326.219419 read 0x017856 thru 0x01d0a4 (0x584f bytes) 000839 1780450326.220269 mapread 0x006eee thru 0x00e466 (0x7579 bytes) 000840 1780450326.223492 trunc from 0x01eba9 to 0x020da5 (0x21fd bytes) 000841 1780450326.243570 read 0x016b3c thru 0x016b9b (0x60 bytes) 000844 1780450326.248035 read 0x01c81c thru 0x020da5 (0x458a bytes) 000845 1780450326.258531 write 0x006fce thru 0x014b26 (0xdb59 bytes) 000846 1780450326.261679 mapwrite 0x01cc8b thru 0x021ff5 (0x536b bytes) 000848 1780450326.382067 mapwrite 0x001329 thru 0x005aae (0x4786 bytes) 000850 1780450326.434136 mapwrite 0x0338b2 thru 0x037182 (0x38d1 bytes) 000851 1780450326.589700 read 0x00a406 thru 0x00e860 (0x445b bytes) 000852 1780450326.597048 write 0x02a630 thru 0x037a2b (0xd3fc bytes) 000853 1780450326.601196 write 0x003eb8 thru 0x005cca (0x1e13 bytes) 000854 1780450326.608029 write 0x014405 thru 0x019d15 (0x5911 bytes) 000855 1780450326.618392 write 0x034ecc thru 0x03dcdf (0x8e14 bytes) 000856 1780450326.624681 mapwrite 0x01baa4 thru 0x01f772 (0x3ccf bytes) 000859 1780450326.797367 MIRROR_RESYNC 7 mirrors 000860 1780450328.424792 read 0x00306f thru 0x00c824 (0x97b6 bytes) 000861 1780450328.435288 read 0x01da5b thru 0x02c59a (0xeb40 bytes) 000862 1780450328.451099 MIRROR_RESYNC 7 mirrors 000863 1780450329.048578 write 0x025c0c thru 0x02733f (0x1734 bytes) 000864 1780450329.139074 read 0x024412 thru 0x02daff (0x96ee bytes) 000865 1780450329.152800 trunc from 0x03dce0 to 0x01c6bc (0x21623 bytes) 000867 1780450329.181823 trunc from 0x01c6bd to 0x011ad9 (0xabe3 bytes) 000868 1780450329.209357 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x11ada): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11ada): Mirror 2: 0xb7169dd (stale) Mirror 3: 0xb7169dd (stale) Mirror 4: 0xb7169dd (stale) Mirror 5: 0xb7169dd (stale) Mirror 6: 0xb7169dd (stale) Mirror 7: 0xb7169dd (stale) CRC-32 checksum value for chunk [0, 0x11ada): Mirror 1: 0xb7169dd Mirror 8: 0xb7169dd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11ada: skipped 000871 1780450330.241120 read 0x00fed9 thru 0x011ad9 (0x1c01 bytes) 000872 1780450330.251937 read 0x0064b7 thru 0x011ad9 (0xb623 bytes) 000873 1780450330.281718 mapread 0x00c13a thru 0x011ad9 (0x59a0 bytes) 000875 1780450330.298116 write 0x023076 thru 0x02bb84 (0x8b0f bytes) 000876 1780450330.436240 trunc from 0x02bb85 to 0x02928a (0x28fa bytes) 000879 1780450330.501365 write 0x0301c1 thru 0x0348e8 (0x4728 bytes) 000881 1780450330.508756 read 0x018969 thru 0x024f22 (0xc5ba bytes) 000883 1780450330.536604 mapread 0x0307d9 thru 0x033fe8 (0x3810 bytes) 000884 1780450330.537710 mapwrite 0x03a31e thru 0x03e1e5 (0x3ec8 bytes) 000885 1780450330.701970 mapread 0x00da9f thru 0x01b742 (0xdca4 bytes) 000890 1780450330.707376 trunc from 0x03e1e6 to 0x02fdcb (0xe41a bytes) 000891 1780450330.738582 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2fdcc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fdcc): Mirror 2: 0x91ae6945 (stale) Mirror 3: 0x91ae6945 (stale) Mirror 4: 0x91ae6945 (stale) Mirror 5: 0x91ae6945 (stale) Mirror 6: 0x91ae6945 (stale) Mirror 7: 0x91ae6945 (stale) Mirror 8: 0x572734b5 (stale) CRC-32 checksum value for chunk [0, 0x2fdcc): Mirror 1: 0x11ef1b5b Mirror 9: 0x11ef1b5b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fdcc: skipped 000892 1780450332.089735 mapread 0x028c24 thru 0x02b8ea (0x2cc7 bytes) 000893 1780450332.138265 read 0x01f952 thru 0x02bf19 (0xc5c8 bytes) 000894 1780450332.159103 trunc from 0x02fdcc to 0x00714a (0x28c81 bytes) 000896 1780450332.296529 trunc from 0x00714b to 0x031411 (0x2a2c7 bytes) 000898 1780450332.338205 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31412): Mirror 2: 0xdf3a1dea (stale) Mirror 3: 0xdf3a1dea (stale) Mirror 4: 0xdf3a1dea (stale) Mirror 5: 0xdf3a1dea (stale) Mirror 6: 0xdf3a1dea (stale) Mirror 7: 0xdf3a1dea (stale) Mirror 8: 0x6e221904 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31412): Mirror 2: 0xdf3a1dea (stale) Mirror 3: 0xdf3a1dea (stale) Mirror 4: 0xdf3a1dea (stale) Mirror 5: 0xdf3a1dea (stale) Mirror 6: 0xdf3a1dea (stale) Mirror 7: 0xdf3a1dea (stale) Mirror 8: 0x6e221904 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31412: skipped 000899 1780450332.995398 write 0x03cbfb thru 0x03ffff (0x3405 bytes) 000901 1780450332.997200 write 0x03cdb9 thru 0x03ffff (0x3247 bytes) 000902 1780450333.011503 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2d5bf517 (stale) Mirror 3: 0x2d5bf517 (stale) Mirror 4: 0x2d5bf517 (stale) Mirror 5: 0x2d5bf517 (stale) Mirror 6: 0x2d5bf517 (stale) Mirror 7: 0x2d5bf517 (stale) Mirror 8: 0xf9536285 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x38fce55e Mirror 9: 0x38fce55e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000903 1780450334.374738 mapwrite 0x02153b thru 0x0294d5 (0x7f9b bytes) 000904 1780450334.609942 MIRROR_RESYNC 9 mirrors 000905 1780450336.783291 write 0x028838 thru 0x0332d7 (0xaaa0 bytes) 000906 1780450336.844580 mapwrite 0x00e4e8 thru 0x01c7cc (0xe2e5 bytes) 000907 1780450336.959687 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb185a343 (stale) Mirror 3: 0xb185a343 (stale) Mirror 4: 0xb185a343 (stale) Mirror 5: 0xb185a343 (stale) Mirror 6: 0xb185a343 (stale) Mirror 7: 0xb185a343 (stale) Mirror 8: 0xb185a343 (stale) Mirror 9: 0xb185a343 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc03310b5 Mirror 10: 0xc03310b5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000910 1780450338.125059 read 0x03839a thru 0x03ffff (0x7c66 bytes) 000912 1780450338.186627 read 0x011d8e thru 0x015026 (0x3299 bytes) 000913 1780450338.217548 write 0x01651d thru 0x021bf4 (0xb6d8 bytes) 000914 1780450338.339133 mapwrite 0x030507 thru 0x03b3b3 (0xaead bytes) 000915 1780450338.532942 mapread 0x003851 thru 0x008b47 (0x52f7 bytes) 000918 1780450338.580114 mapwrite 0x020d32 thru 0x02c1b1 (0xb480 bytes) 000922 1780450338.763276 trunc from 0x040000 to 0x01d964 (0x2269b bytes) 000923 1780450338.785157 trunc from 0x01d965 to 0x00150b (0x1c459 bytes) 000926 1780450338.811187 mapwrite 0x032d6d thru 0x0365b2 (0x3846 bytes) 000927 1780450338.918227 mapwrite 0x0292b5 thru 0x034035 (0xad81 bytes) 000929 1780450339.062075 write 0x016b7e thru 0x025c82 (0xf105 bytes) 000930 1780450339.072012 mapread 0x02d306 thru 0x036354 (0x904f bytes) 000931 1780450339.074762 mapread 0x024dcc thru 0x032797 (0xd9cc bytes) 000932 1780450339.094590 trunc from 0x0365b3 to 0x021fe0 (0x145d2 bytes) 000933 1780450339.144635 read 0x0125be thru 0x01e481 (0xbec4 bytes) 000934 1780450339.160528 trunc from 0x021fe1 to 0x023967 (0x1987 bytes) 000935 1780450339.206540 MIRROR_RESYNC 10 mirrors 000936 1780450341.244813 mapread 0x010e45 thru 0x015f7e (0x513a bytes) 000940 1780450341.276954 trunc from 0x023968 to 0x00705c (0x1c90b bytes) 000941 1780450341.391985 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x705d): Mirror 3: 0x99c834c5 (stale) Mirror 4: 0x99c834c5 (stale) Mirror 5: 0x99c834c5 (stale) Mirror 6: 0x99c834c5 (stale) Mirror 7: 0x99c834c5 (stale) Mirror 8: 0x99c834c5 (stale) Mirror 9: 0x99c834c5 (stale) Mirror 10: 0x99c834c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x705d): Mirror 3: 0x99c834c5 (stale) Mirror 4: 0x99c834c5 (stale) Mirror 5: 0x99c834c5 (stale) Mirror 6: 0x99c834c5 (stale) Mirror 7: 0x99c834c5 (stale) Mirror 8: 0x99c834c5 (stale) Mirror 9: 0x99c834c5 (stale) Mirror 10: 0x99c834c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x705d: skipped 000942 1780450341.858641 trunc from 0x00705d to 0x039b8e (0x32b32 bytes) 000946 1780450341.889952 trunc from 0x039b8f to 0x02c9d4 (0xd1ba bytes) 000947 1780450341.914055 trunc from 0x02c9d5 to 0x02e0a6 (0x16d2 bytes) 000948 1780450341.939594 mapread 0x007579 thru 0x00adc4 (0x384c bytes) 000950 1780450341.976898 write 0x03bf16 thru 0x03c7ba (0x8a5 bytes) 000951 1780450341.978542 read 0x00a068 thru 0x016ef4 (0xce8d bytes) 000955 1780450341.997063 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c7bb): Mirror 3: 0xd2a2d75c (stale) Mirror 4: 0xd2a2d75c (stale) Mirror 5: 0xd2a2d75c (stale) Mirror 7: 0xd2a2d75c (stale) Mirror 8: 0xd2a2d75c (stale) Mirror 9: 0xd2a2d75c (stale) Mirror 10: 0xd2a2d75c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c7bb): Mirror 3: 0xd2a2d75c (stale) Mirror 4: 0xd2a2d75c (stale) Mirror 5: 0xd2a2d75c (stale) Mirror 7: 0xd2a2d75c (stale) Mirror 8: 0xd2a2d75c (stale) Mirror 9: 0xd2a2d75c (stale) Mirror 10: 0xd2a2d75c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c7bb: skipped 000956 1780450342.647188 mapwrite 0x02bc0a thru 0x035357 (0x974e bytes) 000957 1780450342.888817 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3c7bb): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c7bb): Mirror 3: 0xd2a2d75c (stale) Mirror 4: 0xd2a2d75c (stale) Mirror 5: 0xd2a2d75c (stale) Mirror 7: 0xd2a2d75c (stale) Mirror 8: 0xd2a2d75c (stale) Mirror 9: 0xd2a2d75c (stale) Mirror 10: 0xd2a2d75c (stale) CRC-32 checksum value for chunk [0, 0x3c7bb): Mirror 1: 0x5615d821 Mirror 11: 0x5615d821 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c7bb: skipped 000960 1780450344.243272 read 0x00a2d5 thru 0x00d438 (0x3164 bytes) 000961 1780450344.266182 trunc from 0x03c7bb to 0x03eed3 (0x2719 bytes) 000962 1780450344.433772 mapwrite 0x00ce70 thru 0x019486 (0xc617 bytes) 000963 1780450344.607726 read 0x03739e thru 0x03eed3 (0x7b36 bytes) 000965 1780450344.624807 MIRROR_RESYNC 9 mirrors 000966 1780450346.032575 mapread 0x02ee4b thru 0x03657e (0x7734 bytes) 000967 1780450346.056590 trunc from 0x03eed4 to 0x018340 (0x26b93 bytes) 000968 1780450346.176517 trunc from 0x018341 to 0x024c4b (0xc90b bytes) 000969 1780450346.202845 read 0x01bc23 thru 0x01f500 (0x38de bytes) 000971 1780450346.214415 read 0x00b8fd thru 0x00d9a2 (0x20a6 bytes) 000972 1780450346.230033 write 0x02fa3c thru 0x03f464 (0xfa29 bytes) 000974 1780450346.234415 mapwrite 0x00cbca thru 0x012aaf (0x5ee6 bytes) 000976 1780450346.348041 trunc from 0x03f465 to 0x020974 (0x1eaf0 bytes) 000977 1780450346.379399 MIRROR_RESYNC 9 mirrors 000978 1780450348.584778 mapread 0x004e1e thru 0x013640 (0xe823 bytes) 000979 1780450348.627202 trunc from 0x020975 to 0x03808d (0x17719 bytes) 000980 1780450348.723378 mapread 0x00415f thru 0x012e20 (0xecc2 bytes) 000983 1780450348.765964 trunc from 0x03808e to 0x00e4d3 (0x29bba bytes) 000984 1780450348.803444 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe4d4): Mirror 3: 0x1b44c719 (stale) Mirror 4: 0x1b44c719 (stale) Mirror 5: 0x1b44c719 (stale) Mirror 7: 0x1b44c719 (stale) Mirror 8: 0x1b44c719 (stale) Mirror 9: 0x1b44c719 (stale) Mirror 10: 0x1b44c719 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe4d4): Mirror 3: 0x1b44c719 (stale) Mirror 4: 0x1b44c719 (stale) Mirror 5: 0x1b44c719 (stale) Mirror 7: 0x1b44c719 (stale) Mirror 8: 0x1b44c719 (stale) Mirror 9: 0x1b44c719 (stale) Mirror 10: 0x1b44c719 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe4d4: skipped 000985 1780450349.419692 mapwrite 0x01f5c5 thru 0x021c6a (0x26a6 bytes) 000986 1780450349.594512 read 0x00382e thru 0x00ad8f (0x7562 bytes) 000987 1780450349.605018 mapwrite 0x026a8a thru 0x031cc0 (0xb237 bytes) 000988 1780450349.745414 write 0x010061 thru 0x015ba2 (0x5b42 bytes) 000989 1780450349.754601 mapread 0x014a9c thru 0x014ebb (0x420 bytes) 000993 1780450349.765140 MIRROR_RESYNC 8 mirrors 000996 1780450351.076574 mapread 0x01b643 thru 0x01ee5b (0x3819 bytes) 000999 1780450351.103103 MIRROR_RESYNC 8 mirrors 001000 1780450351.672770 read 0x0214e6 thru 0x03071b (0xf236 bytes) All operations completed A-OK!