== sanity-flr test 70a: flr mode fsx test ================ 13:50:44 (1786989044) Seed set to 9046 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x6a50 000001 1786989046.525443 trunc from 00000000 to 0x006a4f (0x6a50 bytes) truncating to largest ever: 0xb3c8 000002 1786989046.554277 trunc from 0x006a50 to 0x00b3c7 (0x4978 bytes) 000003 1786989046.587662 write 0x031238 thru 0x03ba50 (0xa819 bytes) 000007 1786989046.595105 mapread 0x030858 thru 0x03362c (0x2dd5 bytes) 000009 1786989046.603341 read 0x03968f thru 0x03ba50 (0x23c2 bytes) truncating to largest ever: 0x3b28d 000010 1786989046.604581 trunc from 0x03ba51 to 0x03b28c (0x7c4 bytes) 000018 1786989046.644341 mapwrite 0x02cfd6 thru 0x03076e (0x3799 bytes) 000020 1786989046.806322 read 0x017d47 thru 0x026f3a (0xf1f4 bytes) 000023 1786989046.835617 mapwrite 0x00b707 thru 0x01418e (0x8a88 bytes) 000025 1786989046.962211 mapwrite 0x00142a thru 0x00c09e (0xac75 bytes) 000031 1786989047.072849 read 0x014732 thru 0x0209ae (0xc27d bytes) 000032 1786989047.074460 mapread 0x004405 thru 0x00550e (0x110a bytes) 000033 1786989047.076176 trunc from 0x03b28d to 0x02fdff (0xb48d bytes) 000036 1786989047.103875 write 0x03b039 thru 0x03ffff (0x4fc7 bytes) 000039 1786989047.110279 mapwrite 0x02b653 thru 0x034128 (0x8ad6 bytes) 000041 1786989047.203709 write 0x02d8e0 thru 0x036af5 (0x9216 bytes) 000044 1786989047.212626 write 0x02b0e7 thru 0x03a1cf (0xf0e9 bytes) 000045 1786989047.215014 mapwrite 0x011974 thru 0x0189bb (0x7048 bytes) 000046 1786989047.280956 write 0x033c1b thru 0x0397ae (0x5b94 bytes) 000048 1786989047.287451 trunc from 0x040000 to 0x00e8ce (0x31731 bytes) 000050 1786989047.326449 trunc from 0x00e8cf to 0x012268 (0x399a bytes) 000051 1786989047.357402 mapread 0x005be7 thru 0x009384 (0x379e bytes) 000053 1786989047.363376 MIRROR_EXTEND to 2 mirrors 000055 1786989047.922300 write 0x017724 thru 0x017b57 (0x434 bytes) 000056 1786989048.007017 write 0x021be3 thru 0x028ba1 (0x6fbf bytes) 000058 1786989048.013513 write 0x02a0ee thru 0x03202f (0x7f42 bytes) 000066 1786989048.024290 write 0x024056 thru 0x032eed (0xee98 bytes) 000067 1786989048.028000 read 0x01fa94 thru 0x02e0bc (0xe629 bytes) 000069 1786989048.048323 read 0x030670 thru 0x032eed (0x287e bytes) 000070 1786989048.049013 write 0x02e667 thru 0x03ac84 (0xc61e bytes) 000072 1786989048.053617 mapwrite 0x01f5d5 thru 0x02dc39 (0xe665 bytes) 000073 1786989048.128317 trunc from 0x03ac85 to 0x00cdd3 (0x2deb1 bytes) 000074 1786989048.194681 trunc from 0x00cdd4 to 0x00fa61 (0x2c8e bytes) 000075 1786989048.217184 trunc from 0x00fa62 to 0x00a3ef (0x5672 bytes) 000083 1786989048.242207 trunc from 0x00a3f0 to 0x02415d (0x19d6e bytes) 000084 1786989048.253536 trunc from 0x02415e to 0x0178f2 (0xc86b bytes) 000085 1786989048.277627 write 0x00b13f thru 0x0169a5 (0xb867 bytes) 000086 1786989048.313459 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x178f3): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x178f3): Mirror 2: 0x2077b746 (stale) CRC-32 checksum value for chunk [0, 0x178f3): Mirror 1: 0x189f4c19 Mirror 3: 0x189f4c19 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x178f3: skipped 000089 1786989049.271277 read 0x013504 thru 0x013bd8 (0x6d5 bytes) 000092 1786989049.278186 write 0x026916 thru 0x02d44f (0x6b3a bytes) 000093 1786989049.403117 write 0x00b903 thru 0x015f3a (0xa638 bytes) 000094 1786989049.418534 MIRROR_RESYNC 3 mirrors 000098 1786989050.176472 read 0x01c4a7 thru 0x02c1b1 (0xfd0b bytes) 000099 1786989050.185798 trunc from 0x02d450 to 0x0155c3 (0x17e8c bytes) 000105 1786989050.268836 mapread 0x013111 thru 0x0155c3 (0x24b3 bytes) 000106 1786989050.288420 mapread 0x006914 thru 0x013357 (0xca44 bytes) 000107 1786989050.299752 mapread 0x011743 thru 0x01332b (0x1be9 bytes) truncating to largest ever: 0x3e12d 000109 1786989050.301350 trunc from 0x0155c4 to 0x03e12c (0x28b69 bytes) 000111 1786989050.327444 MIRROR_RESYNC 3 mirrors 000112 1786989051.256187 mapwrite 0x002663 thru 0x0098ee (0x728c bytes) 000113 1786989051.568214 read 0x032927 thru 0x03430d (0x19e7 bytes) 000114 1786989051.574468 trunc from 0x03e12d to 0x0263da (0x17d52 bytes) 000115 1786989051.618171 trunc from 0x0263db to 0x025286 (0x1154 bytes) 000116 1786989051.661785 trunc from 0x025287 to 0x02913f (0x3eb9 bytes) 000117 1786989051.695506 mapread 0x001fd2 thru 0x010c65 (0xec94 bytes) 000119 1786989051.710307 write 0x028e73 thru 0x02bc6b (0x2df9 bytes) 000120 1786989051.726654 trunc from 0x02bc6c to 0x010e7b (0x1adf0 bytes) 000121 1786989051.784080 MIRROR_RESYNC 3 mirrors 000122 1786989052.649074 mapwrite 0x022119 thru 0x029403 (0x72eb bytes) 000123 1786989052.811582 write 0x0115ee thru 0x01ee07 (0xd81a bytes) 000124 1786989052.820576 trunc from 0x029404 to 0x02e27e (0x4e7b bytes) 000125 1786989052.853530 write 0x02d7b0 thru 0x02d7be (0xf bytes) 000128 1786989052.864444 trunc from 0x02e27f to 0x00afc2 (0x232bc bytes) 000130 1786989052.886485 write 0x00e42c thru 0x01acc1 (0xc896 bytes) 000131 1786989052.889543 mapwrite 0x022529 thru 0x0296da (0x71b2 bytes) 000133 1786989052.968341 trunc from 0x0296db to 0x01bd12 (0xd9c8 bytes) 000139 1786989052.996281 mapread 0x01b61a thru 0x01bd12 (0x6f9 bytes) 000140 1786989052.997479 write 0x03dd3b thru 0x03ffff (0x22c5 bytes) 000141 1786989052.999587 read 0x005caa thru 0x015b90 (0xfee7 bytes) 000142 1786989053.009486 mapread 0x00016d thru 0x004c40 (0x4ad4 bytes) 000143 1786989053.020603 write 0x01d259 thru 0x029db6 (0xcb5e bytes) 000144 1786989053.030001 read 0x02ee9d thru 0x032436 (0x359a bytes) 000145 1786989053.037490 mapread 0x036af5 thru 0x03ffff (0x950b bytes) 000149 1786989053.042250 mapwrite 0x0361cc thru 0x03ffff (0x9e34 bytes) 000150 1786989053.119444 mapread 0x037351 thru 0x03ffff (0x8caf bytes) 000151 1786989053.121713 mapread 0x0088ec thru 0x012ea3 (0xa5b8 bytes) 000154 1786989053.131814 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x36b6ddf9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x36b6ddf9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000155 1786989053.423949 write 0x009467 thru 0x00a7ed (0x1387 bytes) 000157 1786989053.442701 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x36b6ddf9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc6fca12b Mirror 4: 0xc6fca12b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000158 1786989054.504589 mapwrite 0x015f80 thru 0x0252f9 (0xf37a bytes) 000159 1786989054.799409 write 0x02b455 thru 0x0306df (0x528b bytes) 000160 1786989054.810498 read 0x0130fc thru 0x021d16 (0xec1b bytes) 000166 1786989054.817254 mapread 0x0265b3 thru 0x032c12 (0xc660 bytes) 000167 1786989054.832732 mapread 0x026196 thru 0x02d0f1 (0x6f5c bytes) 000169 1786989054.834663 read 0x006020 thru 0x00925d (0x323e bytes) 000171 1786989054.845547 write 0x00cda0 thru 0x016dda (0xa03b bytes) 000172 1786989054.847428 read 0x0291e9 thru 0x038500 (0xf318 bytes) 000176 1786989054.851280 trunc from 0x040000 to 0x025e6c (0x1a193 bytes) 000177 1786989054.904342 mapwrite 0x0235fc thru 0x02a23f (0x6c44 bytes) 000178 1786989054.975553 read 0x00ed12 thru 0x01b1c2 (0xc4b1 bytes) 000179 1786989054.977387 trunc from 0x02a240 to 0x027f62 (0x22dd bytes) 000180 1786989054.994310 mapread 0x019db8 thru 0x01e914 (0x4b5d bytes) 000186 1786989055.006077 mapread 0x00275f thru 0x005d61 (0x3603 bytes) 000187 1786989055.009304 trunc from 0x027f63 to 0x003851 (0x24711 bytes) 000188 1786989055.044137 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3852): Mirror 4: 0x27b070bf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3852): Mirror 4: 0x27b070bf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3852: skipped 000191 1786989055.415189 trunc from 0x003852 to 0x01d324 (0x19ad3 bytes) 000192 1786989055.437006 MIRROR_RESYNC 2 mirrors 000193 1786989056.558442 mapread 0x014f2b thru 0x01d324 (0x83fa bytes) 000194 1786989056.586309 mapwrite 0x00c9ad thru 0x010e6e (0x44c2 bytes) 000196 1786989056.814600 mapwrite 0x03e1ff thru 0x03ffff (0x1e01 bytes) 000197 1786989056.915100 trunc from 0x040000 to 0x00e8e2 (0x3171d bytes) 000198 1786989056.935457 trunc from 0x00e8e3 to 0x01c0bd (0xd7db bytes) 000199 1786989056.959407 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) 000200 1786989057.173012 mapwrite 0x02cb24 thru 0x0379d9 (0xaeb6 bytes) 000201 1786989057.365924 mapwrite 0x012b86 thru 0x01d879 (0xacf4 bytes) 000203 1786989057.497923 trunc from 0x0379da to 0x03911d (0x1744 bytes) 000204 1786989057.516040 read 0x012f50 thru 0x01b43c (0x84ed bytes) 000205 1786989057.516747 mapread 0x019505 thru 0x01e21e (0x4d1a bytes) 000206 1786989057.526445 trunc from 0x03911e to 0x00a85b (0x2e8c2 bytes) 000207 1786989057.549139 mapwrite 0x03a676 thru 0x03ffff (0x598a bytes) 000209 1786989057.610917 mapwrite 0x019c33 thru 0x0229bf (0x8d8d bytes) 000211 1786989057.694191 mapwrite 0x0252f5 thru 0x02c546 (0x7252 bytes) 000213 1786989057.754193 mapwrite 0x002d15 thru 0x0085bb (0x58a7 bytes) 000216 1786989057.829644 read 0x03499a thru 0x03e6a8 (0x9d0f bytes) 000217 1786989057.835256 mapwrite 0x010e39 thru 0x014bd6 (0x3d9e bytes) 000218 1786989057.961811 mapwrite 0x01c84a thru 0x023265 (0x6a1c bytes) 000219 1786989058.064530 trunc from 0x040000 to 0x00b337 (0x34cc8 bytes) 000220 1786989058.089569 mapwrite 0x013986 thru 0x01610f (0x278a bytes) 000221 1786989058.239186 read 0x00335c thru 0x00d22f (0x9ed4 bytes) 000222 1786989058.267966 write 0x03c449 thru 0x03ffff (0x3bb7 bytes) 000224 1786989058.275482 read 0x022259 thru 0x02df2a (0xbcd2 bytes) 000226 1786989058.298103 mapread 0x03c470 thru 0x03ffff (0x3b90 bytes) 000227 1786989058.305329 read 0x03079e thru 0x03de5c (0xd6bf bytes) 000229 1786989058.312502 read 0x008ea5 thru 0x013a3e (0xab9a bytes) 000230 1786989058.317133 mapread 0x0043bc thru 0x00ea0c (0xa651 bytes) 000231 1786989058.318659 trunc from 0x040000 to 0x01278b (0x2d874 bytes) 000232 1786989058.334015 write 0x015215 thru 0x023062 (0xde4e bytes) 000236 1786989058.346393 mapread 0x021c0c thru 0x023062 (0x1457 bytes) 000237 1786989058.350840 write 0x01f7aa thru 0x02cc73 (0xd4ca bytes) 000238 1786989058.360321 mapwrite 0x0258a0 thru 0x0309c6 (0xb127 bytes) 000239 1786989058.484991 write 0x038548 thru 0x03e5d9 (0x6092 bytes) 000241 1786989058.491314 mapwrite 0x02ecee thru 0x03c498 (0xd7ab bytes) 000243 1786989058.605288 mapwrite 0x001b4c thru 0x00d0fa (0xb5af bytes) 000247 1786989058.680718 MIRROR_EXTEND to 2 mirrors 000248 1786989059.553927 MIRROR_EXTEND to 3 mirrors 000249 1786989060.643798 write 0x0198d6 thru 0x01b62c (0x1d57 bytes) 000251 1786989060.790035 mapwrite 0x030b56 thru 0x03e0a4 (0xd54f bytes) 000252 1786989061.042613 mapread 0x036906 thru 0x036a7b (0x176 bytes) 000253 1786989061.044619 read 0x00711c thru 0x00c056 (0x4f3b bytes) 000256 1786989061.057534 read 0x01600a thru 0x01e134 (0x812b bytes) 000258 1786989061.075070 MIRROR_RESYNC 3 mirrors 000259 1786989062.041915 trunc from 0x03e5da to 0x02cd64 (0x11875 bytes) 000261 1786989062.112238 read 0x00e66f thru 0x01af6b (0xc8fd bytes) 000263 1786989062.121714 trunc from 0x02cd65 to 0x02688c (0x64d8 bytes) 000264 1786989062.148797 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2688d): Mirror 3: 0x1ab8a215 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2688d): Mirror 3: 0x1ab8a215 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2688d: skipped 000265 1786989062.419429 mapread 0x0034cf thru 0x00ec6d (0xb79f bytes) 000267 1786989062.443864 read 0x004571 thru 0x0133dd (0xee6d bytes) 000268 1786989062.449708 mapread 0x006142 thru 0x011ce7 (0xbba6 bytes) 000269 1786989062.450987 write 0x00247e thru 0x00d21a (0xad9d bytes) 000274 1786989062.457420 write 0x01ee74 thru 0x02aaba (0xbc47 bytes) 000281 1786989062.473999 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2aabb): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aabb): Mirror 3: 0x5f4bd144 (stale) CRC-32 checksum value for chunk [0, 0x2aabb): Mirror 1: 0x657ded06 Mirror 4: 0x657ded06 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aabb: skipped 000282 1786989063.268082 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2aabb): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aabb): Mirror 3: 0x5f4bd144 (stale) CRC-32 checksum value for chunk [0, 0x2aabb): Mirror 1: 0x657ded06 Mirror 4: 0x657ded06 Mirror 5: 0x657ded06 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aabb: skipped 000283 1786989064.149027 read 0x0261f3 thru 0x02aaba (0x48c8 bytes) 000284 1786989064.155656 read 0x007745 thru 0x00e34d (0x6c09 bytes) 000285 1786989064.166379 write 0x013d53 thru 0x01da5b (0x9d09 bytes) 000286 1786989064.249332 write 0x0118e5 thru 0x015f74 (0x4690 bytes) 000287 1786989064.255490 mapread 0x02a272 thru 0x02aaba (0x849 bytes) 000289 1786989064.262413 mapwrite 0x004012 thru 0x008cc5 (0x4cb4 bytes) 000290 1786989064.330240 mapwrite 0x00a2ca thru 0x018f2e (0xec65 bytes) 000291 1786989064.404849 mapwrite 0x02d68e thru 0x030d0e (0x3681 bytes) 000292 1786989064.491168 mapwrite 0x037a1c thru 0x03ffff (0x85e4 bytes) 000293 1786989064.664417 mapread 0x00536e thru 0x0138d0 (0xe563 bytes) 000294 1786989064.683985 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x479ff315 (stale) Mirror 4: 0xe161ee47 (stale) Mirror 5: 0xe161ee47 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x65a2c3e4 Mirror 6: 0x65a2c3e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000295 1786989065.764585 write 0x01f002 thru 0x020991 (0x1990 bytes) 000296 1786989065.905139 write 0x035df2 thru 0x03730f (0x151e bytes) 000297 1786989065.916065 write 0x01d5d8 thru 0x025383 (0x7dac bytes) 000298 1786989065.926221 read 0x031a39 thru 0x034430 (0x29f8 bytes) 000299 1786989065.938083 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x479ff315 (stale) Mirror 4: 0xe161ee47 (stale) Mirror 5: 0xe161ee47 (stale) Mirror 6: 0x65a2c3e4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8a6a3a22 Mirror 7: 0x8a6a3a22 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000300 1786989067.329293 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x479ff315 (stale) Mirror 4: 0xe161ee47 (stale) Mirror 5: 0xe161ee47 (stale) Mirror 6: 0x65a2c3e4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8a6a3a22 Mirror 7: 0x8a6a3a22 Mirror 8: 0x8a6a3a22 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000302 1786989068.420389 trunc from 0x040000 to 0x025da0 (0x1a25f bytes) 000303 1786989068.592406 write 0x030713 thru 0x03df0e (0xd7fc bytes) 000304 1786989068.598927 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3df0f): Mirror 3: 0xf2b82159 (stale) Mirror 5: 0xe4ede92d (stale) Mirror 6: 0xe8456156 (stale) Mirror 7: 0x711bd5d1 (stale) Mirror 8: 0x711bd5d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3df0f): Mirror 3: 0xf2b82159 (stale) Mirror 5: 0xe4ede92d (stale) Mirror 6: 0xe8456156 (stale) Mirror 7: 0x711bd5d1 (stale) Mirror 8: 0x711bd5d1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3df0f: skipped 000305 1786989069.125292 mapread 0x002317 thru 0x008da6 (0x6a90 bytes) 000306 1786989069.193527 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3df0f): Mirror 3: 0xf2b82159 (stale) Mirror 5: 0xe4ede92d (stale) Mirror 7: 0x711bd5d1 (stale) Mirror 8: 0x711bd5d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3df0f): Mirror 3: 0xf2b82159 (stale) Mirror 5: 0xe4ede92d (stale) Mirror 7: 0x711bd5d1 (stale) Mirror 8: 0x711bd5d1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3df0f: skipped 000307 1786989069.668568 mapread 0x021a4c thru 0x026905 (0x4eba bytes) 000308 1786989069.701748 mapwrite 0x035634 thru 0x03ffff (0xa9cc bytes) 000309 1786989069.775014 trunc from 0x040000 to 0x00e5fb (0x31a04 bytes) 000311 1786989069.802756 MIRROR_RESYNC 5 mirrors 000312 1786989070.833124 write 0x02d4fc thru 0x031615 (0x411a bytes) 000313 1786989070.915704 read 0x00a318 thru 0x01281a (0x8503 bytes) 000316 1786989070.931743 mapread 0x01ce8f thru 0x026f97 (0xa109 bytes) truncating to largest ever: 0x3ee27 000317 1786989070.956954 trunc from 0x031616 to 0x03ee26 (0xd811 bytes) 000319 1786989071.017673 write 0x03df25 thru 0x03ffff (0x20db bytes) 000320 1786989071.034651 MIRROR_RESYNC 5 mirrors 000321 1786989072.901142 MIRROR_EXTEND to 6 mirrors 000322 1786989073.864656 mapread 0x00420c thru 0x00e811 (0xa606 bytes) 000323 1786989073.910360 write 0x03f45c thru 0x03ffff (0xba4 bytes) 000324 1786989074.043493 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xdcfb608d (stale) Mirror 5: 0xdcfb608d (stale) Mirror 7: 0xdcfb608d (stale) Mirror 8: 0xdcfb608d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xdcfb608d (stale) Mirror 5: 0xdcfb608d (stale) Mirror 7: 0xdcfb608d (stale) Mirror 8: 0xdcfb608d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000326 1786989074.577157 read 0x030450 thru 0x0392a6 (0x8e57 bytes) 000329 1786989074.592987 mapread 0x0383fb thru 0x03ffff (0x7c05 bytes) 000330 1786989074.613930 write 0x03a9c6 thru 0x03ffff (0x563a bytes) 000331 1786989074.615283 write 0x0248b2 thru 0x03215f (0xd8ae bytes) 000334 1786989074.623479 trunc from 0x040000 to 0x0015ad (0x3ea52 bytes) 000336 1786989074.681605 MIRROR_RESYNC 5 mirrors 000337 1786989075.786805 MIRROR_EXTEND to 6 mirrors 000338 1786989076.530128 mapwrite 0x0133db thru 0x01a8a7 (0x74cd bytes) 000339 1786989076.759970 trunc from 0x01a8a8 to 0x014374 (0x6533 bytes) 000341 1786989076.824292 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14375): Mirror 3: 0xe8aa18a5 (stale) Mirror 5: 0xe8aa18a5 (stale) Mirror 7: 0xe8aa18a5 (stale) Mirror 9: 0xe8aa18a5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14375): Mirror 3: 0xe8aa18a5 (stale) Mirror 5: 0xe8aa18a5 (stale) Mirror 7: 0xe8aa18a5 (stale) Mirror 9: 0xe8aa18a5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14375: skipped 000342 1786989077.327500 mapwrite 0x03698a thru 0x03ffff (0x9676 bytes) 000343 1786989077.548267 mapwrite 0x011605 thru 0x01f909 (0xe305 bytes) 000347 1786989077.633451 write 0x00b4ca thru 0x0183b1 (0xcee8 bytes) 000348 1786989077.636634 read 0x03b010 thru 0x03cb08 (0x1af9 bytes) 000349 1786989077.637446 write 0x03e237 thru 0x03ffff (0x1dc9 bytes) 000351 1786989077.639617 read 0x027d2e thru 0x028927 (0xbfa bytes) 000352 1786989077.654664 read 0x00086e thru 0x005d4a (0x54dd bytes) 000353 1786989077.656011 read 0x02bc0d thru 0x032a29 (0x6e1d bytes) 000355 1786989077.663019 MIRROR_RESYNC 5 mirrors 000356 1786989078.841375 write 0x00b278 thru 0x00ebe6 (0x396f bytes) 000358 1786989078.913521 read 0x00e7ca thru 0x010fd4 (0x280b bytes) 000359 1786989078.919131 write 0x034f89 thru 0x0391aa (0x4222 bytes) 000361 1786989078.934038 MIRROR_RESYNC 5 mirrors 000363 1786989080.230434 mapwrite 0x0253e0 thru 0x027782 (0x23a3 bytes) 000364 1786989080.382051 trunc from 0x040000 to 0x02aed4 (0x1512b bytes) 000366 1786989080.406228 trunc from 0x02aed5 to 0x004235 (0x26c9f bytes) 000367 1786989080.428551 trunc from 0x004236 to 0x03d42a (0x391f5 bytes) 000368 1786989080.447141 mapwrite 0x01a57a thru 0x01fa31 (0x54b8 bytes) 000371 1786989080.515422 mapread 0x032cdc thru 0x03d010 (0xa335 bytes) 000372 1786989080.538927 trunc from 0x03d42b to 0x00be99 (0x31591 bytes) 000374 1786989080.561306 MIRROR_RESYNC 5 mirrors 000375 1786989081.690025 trunc from 0x00be9a to 0x01551d (0x9684 bytes) 000376 1786989081.802833 trunc from 0x01551e to 0x036c60 (0x21743 bytes) 000377 1786989081.846380 trunc from 0x036c61 to 0x02604f (0x10c11 bytes) 000378 1786989081.871872 mapwrite 0x03d16f thru 0x03e74e (0x15e0 bytes) 000383 1786989082.030690 read 0x02adcd thru 0x030c47 (0x5e7b bytes) 000385 1786989082.042266 read 0x02bf53 thru 0x033430 (0x74de bytes) 000388 1786989082.055805 mapread 0x00b0a4 thru 0x017918 (0xc875 bytes) 000389 1786989082.061744 MIRROR_RESYNC 5 mirrors 000390 1786989083.242737 trunc from 0x03e74f to 0x01fc31 (0x1eb1d bytes) 000393 1786989083.338456 read 0x004787 thru 0x008fb2 (0x482c bytes) 000397 1786989083.350360 write 0x0168d9 thru 0x018724 (0x1e4c bytes) 000399 1786989083.366197 MIRROR_RESYNC 5 mirrors 000401 1786989084.449995 mapwrite 0x01ca50 thru 0x0262f6 (0x98a7 bytes) 000407 1786989084.635502 mapwrite 0x011f05 thru 0x015789 (0x3885 bytes) 000408 1786989084.702196 read 0x00b9bf thru 0x016101 (0xa743 bytes) 000409 1786989084.707673 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x262f7): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x262f7): Mirror 3: 0xdf448aa0 (stale) Mirror 5: 0xdf448aa0 (stale) Mirror 7: 0xdf448aa0 (stale) Mirror 9: 0xdf448aa0 (stale) CRC-32 checksum value for chunk [0, 0x262f7): Mirror 1: 0x10d167e2 Mirror 10: 0x10d167e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x262f7: skipped 000411 1786989085.513532 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x262f7): Mirror 3: 0xdf448aa0 (stale) Mirror 7: 0xdf448aa0 (stale) Mirror 9: 0xdf448aa0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x262f7): Mirror 3: 0xdf448aa0 (stale) Mirror 7: 0xdf448aa0 (stale) Mirror 9: 0xdf448aa0 (stale) CRC-32 checksum value for chunk [0, 0x262f7): Mirror 1: 0x10d167e2 Mirror 10: 0x10d167e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x262f7: skipped 000412 1786989086.213351 write 0x004ff3 thru 0x00ad80 (0x5d8e bytes) 000414 1786989086.392875 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x262f7): Mirror 3: 0xdf448aa0 (stale) Mirror 7: 0xdf448aa0 (stale) Mirror 9: 0xdf448aa0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x262f7): Mirror 3: 0xdf448aa0 (stale) Mirror 7: 0xdf448aa0 (stale) Mirror 9: 0xdf448aa0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x262f7: skipped 000415 1786989086.853616 mapread 0x01ec93 thru 0x024b12 (0x5e80 bytes) 000416 1786989086.888009 read 0x010669 thru 0x011166 (0xafe bytes) 000417 1786989086.894819 mapread 0x00722c thru 0x011027 (0x9dfc bytes) 000419 1786989086.911437 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x262f7): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x262f7): Mirror 3: 0xdf448aa0 (stale) Mirror 7: 0xdf448aa0 (stale) Mirror 9: 0xdf448aa0 (stale) CRC-32 checksum value for chunk [0, 0x262f7): Mirror 1: 0x96e79ef4 Mirror 10: 0x96e79ef4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x262f7: skipped 000420 1786989088.113472 trunc from 0x0262f7 to 0x0353cb (0xf0d5 bytes) 000421 1786989088.265193 write 0x0189dc thru 0x01d6b4 (0x4cd9 bytes) 000422 1786989088.274395 write 0x03f959 thru 0x03ffff (0x6a7 bytes) 000424 1786989088.276395 mapread 0x0135a4 thru 0x02343d (0xfe9a bytes) 000428 1786989088.301761 trunc from 0x040000 to 0x0184a0 (0x27b5f bytes) 000429 1786989088.322926 trunc from 0x0184a1 to 0x010092 (0x840e bytes) 000434 1786989088.344400 mapread 0x00ae02 thru 0x010092 (0x5291 bytes) 000435 1786989088.357088 read 0x000cca thru 0x00494f (0x3c86 bytes) 000436 1786989088.362771 read 0x009037 thru 0x00e79b (0x5765 bytes) 000437 1786989088.363681 mapwrite 0x007ed2 thru 0x014608 (0xc737 bytes) 000441 1786989088.446772 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x14609): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14609): Mirror 3: 0x6a97bc55 (stale) Mirror 7: 0x6a97bc55 (stale) Mirror 9: 0x6a97bc55 (stale) Mirror 10: 0xb2335462 (stale) CRC-32 checksum value for chunk [0, 0x14609): Mirror 1: 0x18ad7d4f Mirror 11: 0x18ad7d4f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14609: skipped 000444 1786989089.423060 read 0x00fa3b thru 0x014608 (0x4bce bytes) 000445 1786989089.442784 MIRROR_RESYNC 6 mirrors 000446 1786989091.093052 MIRROR_RESYNC 6 mirrors 000450 1786989091.598384 mapread 0x009eb6 thru 0x00aa8c (0xbd7 bytes) 000451 1786989091.614454 mapwrite 0x03ef8e thru 0x03ffff (0x1072 bytes) 000452 1786989091.873796 mapwrite 0x0309f8 thru 0x03ee31 (0xe43a bytes) 000454 1786989091.967563 trunc from 0x040000 to 0x022540 (0x1dabf bytes) 000456 1786989092.034178 mapread 0x019d20 thru 0x022540 (0x8821 bytes) 000458 1786989092.065789 read 0x00a5eb thru 0x00f0a9 (0x4abf bytes) 000459 1786989092.089755 trunc from 0x022541 to 0x00432e (0x1e212 bytes) 000461 1786989092.115559 read 0x00034b thru 0x00432e (0x3fe4 bytes) 000462 1786989092.129400 write 0x037184 thru 0x03f7b6 (0x8633 bytes) 000463 1786989092.133566 trunc from 0x03f7b7 to 0x03deec (0x18ca bytes) 000464 1786989092.161454 read 0x02e2c2 thru 0x02eb90 (0x8cf bytes) 000466 1786989092.183600 trunc from 0x03deed to 0x03daf1 (0x3fb bytes) 000467 1786989092.226233 write 0x01a4b7 thru 0x01a7e8 (0x332 bytes) 000468 1786989092.227738 trunc from 0x03daf2 to 0x01b472 (0x2267f bytes) 000469 1786989092.249357 write 0x00fd5d thru 0x01a274 (0xa518 bytes) 000470 1786989092.250920 mapwrite 0x03aa2d thru 0x03ffff (0x55d3 bytes) 000471 1786989092.405188 mapwrite 0x01cb6c thru 0x025a87 (0x8f1c bytes) 000472 1786989092.591253 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x2e40fa42 (stale) Mirror 9: 0x2e40fa42 (stale) Mirror 10: 0x2e40fa42 (stale) Mirror 11: 0x2e40fa42 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x2e40fa42 (stale) Mirror 9: 0x2e40fa42 (stale) Mirror 10: 0x2e40fa42 (stale) Mirror 11: 0x2e40fa42 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000474 1786989093.095222 mapread 0x0041ed thru 0x01353a (0xf34e bytes) 000476 1786989093.133486 mapread 0x03109c thru 0x03cb27 (0xba8c bytes) 000477 1786989093.161106 mapread 0x02fb39 thru 0x030d65 (0x122d bytes) 000478 1786989093.167731 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x2e40fa42 (stale) Mirror 9: 0x2e40fa42 (stale) Mirror 11: 0x2e40fa42 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x2e40fa42 (stale) Mirror 9: 0x2e40fa42 (stale) Mirror 11: 0x2e40fa42 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000480 1786989093.707055 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x2e40fa42 (stale) Mirror 11: 0x2e40fa42 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x2e40fa42 (stale) Mirror 11: 0x2e40fa42 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000482 1786989094.178696 read 0x008677 thru 0x012fad (0xa937 bytes) 000483 1786989094.188816 trunc from 0x040000 to 0x026850 (0x197af bytes) 000484 1786989094.218339 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26851): Mirror 11: 0x563b00a0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26851): Mirror 11: 0x563b00a0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26851: skipped 000485 1786989094.551412 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x26851): Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26851): Mirror 11: 0x563b00a0 (stale) CRC-32 checksum value for chunk [0, 0x26851): Mirror 1: 0x4a4b1813 Mirror 12: 0x4a4b1813 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26851: skipped 000486 1786989095.650390 mapread 0x0109ad thru 0x01c423 (0xba77 bytes) 000489 1786989095.684023 mapwrite 0x01edb7 thru 0x028440 (0x968a bytes) 000490 1786989096.014675 mapread 0x01ba88 thru 0x028440 (0xc9b9 bytes) 000491 1786989096.021246 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x28441): Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28441): Mirror 11: 0xcc0633ed (stale) Mirror 12: 0xf5f6568e (stale) CRC-32 checksum value for chunk [0, 0x28441): Mirror 1: 0xe7672241 Mirror 13: 0xe7672241 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28441: skipped 000493 1786989096.988141 mapwrite 0x01bdbc thru 0x021a35 (0x5c7a bytes) 000494 1786989097.312688 write 0x0380ab thru 0x03c219 (0x416f bytes) 000499 1786989097.324265 read 0x00d0d2 thru 0x00f8b4 (0x27e3 bytes) 000500 1786989097.332832 mapwrite 0x003d95 thru 0x01026a (0xc4d6 bytes) 000501 1786989097.417345 mapread 0x009e7a thru 0x00b896 (0x1a1d bytes) 000502 1786989097.420129 mapread 0x02cb1e thru 0x03c219 (0xf6fc bytes) 000503 1786989097.450089 read 0x03b675 thru 0x03c219 (0xba5 bytes) 000506 1786989097.453126 trunc from 0x03c21a to 0x003c59 (0x385c0 bytes) 000509 1786989097.510459 write 0x02ab46 thru 0x0329fe (0x7eb9 bytes) 000510 1786989097.515763 trunc from 0x0329ff to 0x00a5a8 (0x28456 bytes) 000511 1786989097.567556 mapread 0x008fce thru 0x00a5a8 (0x15db bytes) 000512 1786989097.588344 trunc from 0x00a5a9 to 0x027cbf (0x1d717 bytes) 000514 1786989097.605562 trunc from 0x027cc0 to 0x03cb36 (0x14e77 bytes) 000516 1786989097.625382 trunc from 0x03cb37 to 0x039866 (0x32d0 bytes) 000520 1786989097.659428 trunc from 0x039867 to 0x01f799 (0x1a0cd bytes) 000521 1786989097.688826 read 0x013089 thru 0x0189a4 (0x591c bytes) 000523 1786989097.716608 trunc from 0x01f79a to 0x03c88c (0x1d0f3 bytes) 000524 1786989097.758258 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3c88d): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c88d): Mirror 11: 0xf900ab28 (stale) Mirror 12: 0xdcff9710 (stale) Mirror 13: 0x5c8c1736 (stale) CRC-32 checksum value for chunk [0, 0x3c88d): Mirror 1: 0x8498f5a4 Mirror 14: 0x8498f5a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c88d: skipped 000526 1786989098.941926 mapwrite 0x034927 thru 0x03ffff (0xb6d9 bytes) 000527 1786989099.199730 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xafd55a86 (stale) Mirror 13: 0x1ab94494 (stale) Mirror 14: 0x7f35f926 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xafd55a86 (stale) Mirror 13: 0x1ab94494 (stale) Mirror 14: 0x7f35f926 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000528 1786989099.558663 MIRROR_RESYNC 4 mirrors 000529 1786989101.316435 mapread 0x0296ca thru 0x02f0aa (0x59e1 bytes) 000533 1786989101.340829 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) 000535 1786989101.595219 read 0x016652 thru 0x025a2a (0xf3d9 bytes) 000538 1786989101.606023 write 0x00d36b thru 0x014269 (0x6eff bytes) 000539 1786989101.690726 trunc from 0x040000 to 0x03e800 (0x17ff bytes) 000540 1786989101.720409 mapread 0x01f830 thru 0x02bd5b (0xc52c bytes) 000542 1786989101.758595 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e801): Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e801): Mirror 12: 0x68772946 (stale) Mirror 13: 0x68772946 (stale) CRC-32 checksum value for chunk [0, 0x3e801): Mirror 1: 0x17fb6673 Mirror 14: 0x17fb6673 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e801: skipped 000543 1786989103.113536 mapread 0x01c660 thru 0x02905e (0xc9ff bytes) 000549 1786989103.159315 mapread 0x01be15 thru 0x025b59 (0x9d45 bytes) 000554 1786989103.167252 mapwrite 0x0023dc thru 0x00cf04 (0xab29 bytes) 000555 1786989103.375361 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e801): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e801): Mirror 12: 0x68772946 (stale) Mirror 13: 0x68772946 (stale) Mirror 14: 0x17fb6673 (stale) CRC-32 checksum value for chunk [0, 0x3e801): Mirror 1: 0x421ae57d Mirror 15: 0x421ae57d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e801: skipped 000558 1786989104.352710 mapread 0x02df2f thru 0x0323e4 (0x44b6 bytes) 000560 1786989104.430142 mapwrite 0x026923 thru 0x0274f9 (0xbd7 bytes) 000563 1786989104.802152 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e801): Mirror 12: 0x68772946 (stale) Mirror 13: 0x68772946 (stale) Mirror 15: 0x421ae57d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e801): Mirror 12: 0x68772946 (stale) Mirror 13: 0x68772946 (stale) Mirror 15: 0x421ae57d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e801: skipped 000567 1786989105.439244 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e801): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e801): Mirror 12: 0x68772946 (stale) Mirror 13: 0x68772946 (stale) Mirror 15: 0x421ae57d (stale) CRC-32 checksum value for chunk [0, 0x3e801): Mirror 1: 0x782e738 Mirror 16: 0x782e738 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e801: skipped 000568 1786989106.802526 write 0x00d53f thru 0x018688 (0xb14a bytes) 000569 1786989106.968781 write 0x00eed9 thru 0x01dfa4 (0xf0cc bytes) 000571 1786989106.984703 write 0x0158ae thru 0x01cfd0 (0x7723 bytes) 000573 1786989106.986504 write 0x036e81 thru 0x03f9db (0x8b5b bytes) 000574 1786989106.993746 mapread 0x00bd54 thru 0x01085a (0x4b07 bytes) 000575 1786989107.027052 trunc from 0x03f9dc to 0x00d2b9 (0x32722 bytes) 000577 1786989107.103331 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd2ba): Mirror 12: 0xce44ff0f (stale) Mirror 13: 0xce44ff0f (stale) Mirror 16: 0xe20c67ea (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd2ba): Mirror 12: 0xce44ff0f (stale) Mirror 13: 0xce44ff0f (stale) Mirror 16: 0xe20c67ea (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd2ba: skipped 000579 1786989107.485056 write 0x01b878 thru 0x02a1b1 (0xe93a bytes) 000580 1786989107.490369 mapwrite 0x00ca3c thru 0x00fc34 (0x31f9 bytes) 000582 1786989107.599646 trunc from 0x02a1b2 to 0x02373b (0x6a76 bytes) 000583 1786989107.629620 trunc from 0x02373c to 0x01aff6 (0x8745 bytes) 000585 1786989107.671757 trunc from 0x01aff7 to 0x021197 (0x61a1 bytes) 000589 1786989107.704357 trunc from 0x021198 to 0x02bca5 (0xab0e bytes) 000590 1786989107.738540 MIRROR_RESYNC 4 mirrors 000591 1786989109.079034 mapread 0x027007 thru 0x0281ee (0x11e8 bytes) 000592 1786989109.092756 trunc from 0x02bca6 to 0x00be05 (0x1fea0 bytes) 000593 1786989109.166482 write 0x02c20c thru 0x02fccf (0x3ac4 bytes) 000594 1786989109.167750 mapread 0x01f20f thru 0x0200e8 (0xeda bytes) 000595 1786989109.178641 mapread 0x00472e thru 0x008a29 (0x42fc bytes) 000596 1786989109.197946 read 0x019fff thru 0x01c3a5 (0x23a7 bytes) 000597 1786989109.198685 mapwrite 0x036c00 thru 0x03b95f (0x4d60 bytes) 000598 1786989109.302251 mapwrite 0x01cfd1 thru 0x02ac11 (0xdc41 bytes) 000600 1786989109.433867 trunc from 0x03b960 to 0x0067ba (0x351a5 bytes) 000601 1786989109.452029 read 0x004d37 thru 0x0067ba (0x1a84 bytes) 000603 1786989109.454374 mapread 0x004fbe thru 0x0067ba (0x17fd bytes) 000604 1786989109.455865 mapread 0x005489 thru 0x0067ba (0x1332 bytes) 000605 1786989109.462065 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x67bb): Mirror 13: 0xbd73467 (stale) Mirror 16: 0xbd73467 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x67bb): Mirror 13: 0xbd73467 (stale) Mirror 16: 0xbd73467 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x67bb: skipped 000609 1786989109.786312 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x67bb): Mirror 16: 0xbd73467 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x67bb): Mirror 16: 0xbd73467 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x67bb: skipped 000611 1786989110.123234 read 0x0042c9 thru 0x0067ba (0x24f2 bytes) 000615 1786989110.139289 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) 000616 1786989110.306263 trunc from 0x0067bb to 0x00644d (0x36d bytes) 000617 1786989110.336106 trunc from 0x00644e to 0x010b82 (0xa735 bytes) 000618 1786989110.370585 trunc from 0x010b83 to 0x01d943 (0xcdc1 bytes) 000621 1786989110.393707 read 0x013338 thru 0x014391 (0x105a bytes) 000626 1786989110.401589 trunc from 0x01d944 to 0x0271d9 (0x9896 bytes) 000628 1786989110.446143 mapwrite 0x00602e thru 0x0100d5 (0xa0a8 bytes) 000629 1786989110.571344 MIRROR_EXTEND to 2 mirrors 000631 1786989111.473492 MIRROR_EXTEND to 3 mirrors 000632 1786989112.458398 read 0x017c1f thru 0x01ed96 (0x7178 bytes) 000635 1786989112.481922 write 0x01072f thru 0x012213 (0x1ae5 bytes) 000636 1786989112.586953 mapread 0x01d611 thru 0x0248dc (0x72cc bytes) 000637 1786989112.604120 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x271da): Mirror 2: 0x3d38ad2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x271da): Mirror 2: 0x3d38ad2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x271da: skipped 000639 1786989112.959851 read 0x0055cb thru 0x00eccb (0x9701 bytes) 000642 1786989112.969471 trunc from 0x0271da to 0x00d9f3 (0x197e6 bytes) 000643 1786989112.998399 trunc from 0x00d9f4 to 0x005356 (0x869d bytes) 000645 1786989113.019967 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x5357): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5357): Mirror 2: 0x7500ee9c (stale) CRC-32 checksum value for chunk [0, 0x5357): Mirror 1: 0x7500ee9c Mirror 3: 0x7500ee9c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5357: skipped 000647 1786989113.742950 mapwrite 0x01ee6a thru 0x024bca (0x5d61 bytes) 000648 1786989113.914284 read 0x002a2c thru 0x004985 (0x1f5a bytes) 000649 1786989113.923918 MIRROR_RESYNC 3 mirrors 000650 1786989114.878466 read 0x013e5f thru 0x01fedc (0xc07e bytes) 000653 1786989114.914209 MIRROR_EXTEND to 4 mirrors 000656 1786989115.985273 read 0x00c339 thru 0x00ea50 (0x2718 bytes) 000657 1786989115.988662 trunc from 0x024bcb to 0x02d5b5 (0x89eb bytes) 000659 1786989116.078227 read 0x02ce20 thru 0x02d5b5 (0x796 bytes) 000660 1786989116.092164 mapwrite 0x03005c thru 0x035df2 (0x5d97 bytes) 000661 1786989116.194140 mapread 0x02aabd thru 0x030c16 (0x615a bytes) 000662 1786989116.196194 mapread 0x03548b thru 0x035df2 (0x968 bytes) 000663 1786989116.198136 write 0x02b102 thru 0x033d02 (0x8c01 bytes) 000664 1786989116.200243 mapwrite 0x019414 thru 0x01c9a5 (0x3592 bytes) 000665 1786989116.250508 write 0x03585a thru 0x03a837 (0x4fde bytes) 000666 1786989116.251857 write 0x0163eb thru 0x024ac8 (0xe6de bytes) 000667 1786989116.258517 MIRROR_RESYNC 4 mirrors 000668 1786989117.508191 write 0x028101 thru 0x0341e2 (0xc0e2 bytes) 000669 1786989117.656941 mapwrite 0x023ac6 thru 0x026c19 (0x3154 bytes) 000671 1786989117.837365 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3a838): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a838): Mirror 2: 0xad4d183c (stale) Mirror 3: 0xad4d183c (stale) Mirror 4: 0xad4d183c (stale) CRC-32 checksum value for chunk [0, 0x3a838): Mirror 1: 0xbe719ddd Mirror 5: 0xbe719ddd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a838: skipped 000672 1786989119.271365 trunc from 0x03a838 to 0x000b05 (0x39d32 bytes) 000677 1786989119.395038 write 0x003778 thru 0x003fe6 (0x86f bytes) 000678 1786989119.396974 write 0x0100dd thru 0x018538 (0x845c bytes) 000679 1786989119.399641 read 0x0056d2 thru 0x008141 (0x2a70 bytes) 000680 1786989119.423782 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x18539): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18539): Mirror 2: 0x8b19eb6b (stale) Mirror 3: 0x8b19eb6b (stale) Mirror 4: 0x8b19eb6b (stale) Mirror 5: 0x8b19eb6b (stale) CRC-32 checksum value for chunk [0, 0x18539): Mirror 1: 0x4d340de1 Mirror 6: 0x4d340de1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18539: skipped 000682 1786989121.107121 trunc from 0x018539 to 0x037c8e (0x1f756 bytes) 000683 1786989121.199231 trunc from 0x037c8f to 0x03620c (0x1a82 bytes) 000684 1786989121.219260 read 0x001d74 thru 0x01155c (0xf7e9 bytes) 000686 1786989121.227799 trunc from 0x03620d to 0x000ce5 (0x35527 bytes) 000688 1786989121.239763 trunc from 0x000ce6 to 0x03157b (0x30896 bytes) 000689 1786989121.252190 read 0x00f607 thru 0x01d40c (0xde06 bytes) 000691 1786989121.267137 write 0x039782 thru 0x03eabf (0x533e bytes) 000692 1786989121.271262 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3eac0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eac0): Mirror 2: 0xd0b49d98 (stale) Mirror 3: 0xd0b49d98 (stale) Mirror 4: 0xd0b49d98 (stale) Mirror 5: 0xf962b637 (stale) Mirror 6: 0x5681c08f (stale) CRC-32 checksum value for chunk [0, 0x3eac0): Mirror 1: 0xa023a6f0 Mirror 7: 0xa023a6f0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eac0: skipped 000693 1786989122.300420 MIRROR_RESYNC 7 mirrors 000698 1786989123.771686 trunc from 0x03eac0 to 0x0157e0 (0x292df bytes) 000699 1786989123.907182 mapwrite 0x002e47 thru 0x00377d (0x937 bytes) 000701 1786989124.018713 read 0x0105da thru 0x0152fb (0x4d22 bytes) 000704 1786989124.033129 write 0x002003 thru 0x011615 (0xf613 bytes) 000705 1786989124.036696 write 0x0174e1 thru 0x019a7a (0x259a bytes) 000707 1786989124.048661 write 0x028cb0 thru 0x038100 (0xf451 bytes) 000708 1786989124.057145 trunc from 0x038101 to 0x0271c4 (0x10f3c bytes) 000709 1786989124.100288 mapread 0x018926 thru 0x01b9f1 (0x30cc bytes) truncating to largest ever: 0x3fe90 000710 1786989124.123690 trunc from 0x0271c5 to 0x03fe8f (0x18ccb bytes) 000711 1786989124.151321 write 0x01ae34 thru 0x020e62 (0x602f bytes) 000713 1786989124.167623 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3fe90): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe90): Mirror 2: 0xee397ada (stale) Mirror 3: 0xee397ada (stale) Mirror 4: 0xee397ada (stale) Mirror 5: 0xee397ada (stale) Mirror 6: 0xee397ada (stale) Mirror 7: 0xee397ada (stale) CRC-32 checksum value for chunk [0, 0x3fe90): Mirror 1: 0xe933328a Mirror 8: 0xe933328a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe90: skipped 000715 1786989125.967025 write 0x02e2ec thru 0x034b4f (0x6864 bytes) 000716 1786989126.091263 mapwrite 0x030a83 thru 0x03d1b2 (0xc730 bytes) 000720 1786989126.204671 mapwrite 0x019002 thru 0x01a255 (0x1254 bytes) 000724 1786989126.308784 write 0x020090 thru 0x02063f (0x5b0 bytes) 000725 1786989126.350408 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fe90): Mirror 2: 0xee397ada (stale) Mirror 3: 0xee397ada (stale) Mirror 4: 0xee397ada (stale) Mirror 5: 0xee397ada (stale) Mirror 6: 0xee397ada (stale) Mirror 8: 0xe933328a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe90): Mirror 2: 0xee397ada (stale) Mirror 3: 0xee397ada (stale) Mirror 4: 0xee397ada (stale) Mirror 5: 0xee397ada (stale) Mirror 6: 0xee397ada (stale) Mirror 8: 0xe933328a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe90: skipped 000726 1786989126.991788 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fe90): Mirror 3: 0xee397ada (stale) Mirror 4: 0xee397ada (stale) Mirror 5: 0xee397ada (stale) Mirror 6: 0xee397ada (stale) Mirror 8: 0xe933328a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe90): Mirror 3: 0xee397ada (stale) Mirror 4: 0xee397ada (stale) Mirror 5: 0xee397ada (stale) Mirror 6: 0xee397ada (stale) Mirror 8: 0xe933328a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe90: skipped 000727 1786989127.685303 read 0x012039 thru 0x017f3e (0x5f06 bytes) 000728 1786989127.700477 trunc from 0x03fe90 to 0x024da3 (0x1b0ec bytes) 000729 1786989127.725088 mapwrite 0x018012 thru 0x018e1a (0xe09 bytes) 000730 1786989127.839189 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x24da4): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24da4): Mirror 3: 0xd75ea22f (stale) Mirror 4: 0xd75ea22f (stale) Mirror 5: 0xd75ea22f (stale) Mirror 6: 0xd75ea22f (stale) Mirror 8: 0x90288ea3 (stale) CRC-32 checksum value for chunk [0, 0x24da4): Mirror 1: 0x33ff2382 Mirror 9: 0x33ff2382 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24da4: skipped 000733 1786989129.064843 trunc from 0x024da4 to 0x03250b (0xd768 bytes) 000734 1786989129.291338 mapwrite 0x019260 thru 0x02425c (0xaffd bytes) 000737 1786989129.404407 mapwrite 0x005c78 thru 0x006275 (0x5fe bytes) 000741 1786989129.459706 write 0x02fc7b thru 0x0353e3 (0x5769 bytes) 000742 1786989129.468360 read 0x011d81 thru 0x0139aa (0x1c2a bytes) 000743 1786989129.474980 mapwrite 0x02862b thru 0x0340c2 (0xba98 bytes) 000745 1786989129.553756 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x353e4): Mirror 3: 0x9d9151e (stale) Mirror 5: 0x9d9151e (stale) Mirror 6: 0x9d9151e (stale) Mirror 8: 0x3d347921 (stale) Mirror 9: 0xd39517ac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x353e4): Mirror 3: 0x9d9151e (stale) Mirror 5: 0x9d9151e (stale) Mirror 6: 0x9d9151e (stale) Mirror 8: 0x3d347921 (stale) Mirror 9: 0xd39517ac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x353e4: skipped 000748 1786989130.197240 trunc from 0x0353e4 to 0x02a9b0 (0xaa33 bytes) 000749 1786989130.214391 read 0x01bfba thru 0x01fa8a (0x3ad1 bytes) 000751 1786989130.238356 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a9b1): Mirror 3: 0x745f2c4e (stale) Mirror 5: 0x745f2c4e (stale) Mirror 6: 0x745f2c4e (stale) Mirror 8: 0xb92dc75f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a9b1): Mirror 3: 0x745f2c4e (stale) Mirror 5: 0x745f2c4e (stale) Mirror 6: 0x745f2c4e (stale) Mirror 8: 0xb92dc75f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a9b1: skipped 000752 1786989130.662236 write 0x03929b thru 0x03b21c (0x1f82 bytes) 000753 1786989130.663455 trunc from 0x03b21d to 0x03d594 (0x2378 bytes) 000756 1786989130.693407 read 0x03a238 thru 0x03d594 (0x335d bytes) 000758 1786989130.699621 trunc from 0x03d595 to 0x038e19 (0x477b bytes) 000759 1786989130.726039 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x38e1a): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38e1a): Mirror 3: 0x1b81532a (stale) Mirror 5: 0x1b81532a (stale) Mirror 6: 0x1b81532a (stale) Mirror 8: 0xa56d47a0 (stale) CRC-32 checksum value for chunk [0, 0x38e1a): Mirror 1: 0xe449a6f9 Mirror 9: 0xe449a6f9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38e1a: skipped 000760 1786989131.494775 mapread 0x00f702 thru 0x01adb4 (0xb6b3 bytes) 000762 1786989131.521520 write 0x0357b1 thru 0x03ffff (0xa84f bytes) 000763 1786989131.627116 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcea2c166 (stale) Mirror 6: 0xcea2c166 (stale) Mirror 8: 0xe3f2c086 (stale) Mirror 9: 0xf87c66ab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcea2c166 (stale) Mirror 6: 0xcea2c166 (stale) Mirror 8: 0xe3f2c086 (stale) Mirror 9: 0xf87c66ab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000764 1786989132.086594 mapread 0x014c56 thru 0x01e7f6 (0x9ba1 bytes) 000765 1786989132.120444 mapwrite 0x0248e7 thru 0x02d75f (0x8e79 bytes) 000767 1786989132.215087 mapwrite 0x0175e7 thru 0x01a8c4 (0x32de bytes) 000768 1786989132.274804 read 0x028b9b thru 0x02cf18 (0x437e bytes) 000769 1786989132.281797 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcea2c166 (stale) Mirror 6: 0xcea2c166 (stale) Mirror 8: 0xe3f2c086 (stale) Mirror 9: 0xf87c66ab (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x28b22e66 Mirror 10: 0x28b22e66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000771 1786989133.440632 trunc from 0x040000 to 0x00263a (0x3d9c5 bytes) 000773 1786989133.577143 mapwrite 0x038795 thru 0x03ffff (0x786b bytes) 000775 1786989133.664454 mapread 0x00ecc3 thru 0x013c84 (0x4fc2 bytes) 000776 1786989133.675072 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcea2c166 (stale) Mirror 8: 0xe3f2c086 (stale) Mirror 9: 0xf87c66ab (stale) Mirror 10: 0x28b22e66 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcea2c166 (stale) Mirror 8: 0xe3f2c086 (stale) Mirror 9: 0xf87c66ab (stale) Mirror 10: 0x28b22e66 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000777 1786989134.004647 read 0x03d310 thru 0x03e3c6 (0x10b7 bytes) 000778 1786989134.014228 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcea2c166 (stale) Mirror 8: 0xe3f2c086 (stale) Mirror 9: 0xf87c66ab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcea2c166 (stale) Mirror 8: 0xe3f2c086 (stale) Mirror 9: 0xf87c66ab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000779 1786989134.389678 trunc from 0x040000 to 0x03ed29 (0x12d6 bytes) 000782 1786989134.413459 read 0x018376 thru 0x01eb74 (0x67ff bytes) 000783 1786989134.431614 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ed2a): Mirror 8: 0x68d2584b (stale) Mirror 9: 0x4f62823d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ed2a): Mirror 8: 0x68d2584b (stale) Mirror 9: 0x4f62823d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ed2a: skipped 000788 1786989134.887027 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ed2a): Mirror 9: 0x4f62823d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ed2a): Mirror 9: 0x4f62823d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ed2a: skipped 000789 1786989135.261968 mapread 0x0142e5 thru 0x022619 (0xe335 bytes) 000790 1786989135.305920 trunc from 0x03ed2a to 0x01eba3 (0x20186 bytes) 000792 1786989135.337369 mapwrite 0x02e4d7 thru 0x0312d3 (0x2dfd bytes) 000793 1786989135.557100 write 0x0210c2 thru 0x02f996 (0xe8d5 bytes) 000795 1786989135.564458 read 0x02efe6 thru 0x030993 (0x19ae bytes) 000797 1786989135.566529 mapread 0x01f938 thru 0x02524a (0x5913 bytes) 000798 1786989135.572451 mapread 0x01a3e6 thru 0x01e27c (0x3e97 bytes) 000801 1786989135.577866 mapwrite 0x02987c thru 0x02cd51 (0x34d6 bytes) 000803 1786989135.681278 read 0x030024 thru 0x0312d3 (0x12b0 bytes) 000810 1786989135.696356 read 0x02aca1 thru 0x02bb61 (0xec1 bytes) 000811 1786989135.698510 trunc from 0x0312d4 to 0x00e52f (0x22da4 bytes) 000812 1786989135.737336 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) 000813 1786989135.988577 trunc from 0x00e530 to 0x0272b6 (0x18d87 bytes) 000815 1786989136.028825 mapwrite 0x03cbf9 thru 0x03ffff (0x3407 bytes) 000816 1786989136.204092 mapread 0x01e2f3 thru 0x02a738 (0xc446 bytes) 000817 1786989136.230473 trunc from 0x040000 to 0x010a8f (0x2f570 bytes) 000820 1786989136.260756 mapwrite 0x019a5d thru 0x01ae8d (0x1431 bytes) 000825 1786989136.362839 mapread 0x006a84 thru 0x013822 (0xcd9f bytes) 000827 1786989136.381773 read 0x0191f3 thru 0x019a19 (0x827 bytes) 000829 1786989136.385105 mapwrite 0x01e401 thru 0x02b3b9 (0xcfb9 bytes) 000831 1786989136.501875 mapwrite 0x0254f1 thru 0x02b756 (0x6266 bytes) 000833 1786989136.628709 write 0x02cee7 thru 0x02d2e3 (0x3fd bytes) 000834 1786989136.634534 read 0x028141 thru 0x02d2e3 (0x51a3 bytes) 000835 1786989136.637243 read 0x0155c0 thru 0x01b299 (0x5cda bytes) 000837 1786989136.640421 read 0x001935 thru 0x007fa4 (0x6670 bytes) 000838 1786989136.659382 MIRROR_EXTEND to 2 mirrors 000841 1786989138.342063 mapread 0x00da50 thru 0x017dc8 (0xa379 bytes) 000843 1786989138.376445 mapwrite 0x02d9ae thru 0x03a363 (0xc9b6 bytes) 000844 1786989138.912974 write 0x02b965 thru 0x02d8a8 (0x1f44 bytes) 000845 1786989138.914225 mapwrite 0x039bdb thru 0x03ffff (0x6425 bytes) 000846 1786989139.166712 read 0x0352c6 thru 0x03fc5f (0xa99a bytes) 000847 1786989139.173127 write 0x016dde thru 0x02551f (0xe742 bytes) 000848 1786989139.217433 MIRROR_RESYNC 2 mirrors 000851 1786989139.908403 trunc from 0x040000 to 0x0209aa (0x1f655 bytes) 000852 1786989140.028165 mapread 0x01baf9 thru 0x01d332 (0x183a bytes) 000853 1786989140.054675 trunc from 0x0209ab to 0x013caa (0xcd00 bytes) 000855 1786989140.086420 trunc from 0x013cab to 0x029260 (0x155b6 bytes) 000856 1786989140.108107 write 0x00d135 thru 0x00d373 (0x23f bytes) 000857 1786989140.128252 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) 000858 1786989140.301699 mapwrite 0x01fe5c thru 0x02d3e1 (0xd586 bytes) 000859 1786989140.455945 mapwrite 0x01e555 thru 0x0254c1 (0x6f6d bytes) 000860 1786989140.521951 MIRROR_EXTEND to 2 mirrors 000861 1786989141.161607 read 0x01d937 thru 0x02cd05 (0xf3cf bytes) 000862 1786989141.188087 MIRROR_RESYNC 2 mirrors 000863 1786989141.705416 mapwrite 0x002d63 thru 0x00eb41 (0xbddf bytes) 000864 1786989142.003777 mapread 0x01271e thru 0x01fcdd (0xd5c0 bytes) 000866 1786989142.035747 trunc from 0x02d3e2 to 0x031c49 (0x4868 bytes) 000867 1786989142.089705 mapread 0x01a643 thru 0x01a65f (0x1d bytes) 000872 1786989142.104433 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x31c4a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31c4a): Mirror 2: 0x44505a91 (stale) CRC-32 checksum value for chunk [0, 0x31c4a): Mirror 1: 0xb6acbb51 Mirror 3: 0xb6acbb51 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31c4a: skipped 000875 1786989143.485539 mapread 0x030fc3 thru 0x031c49 (0xc87 bytes) 000876 1786989143.504214 write 0x01d4ed thru 0x01e091 (0xba5 bytes) 000877 1786989143.605705 mapwrite 0x00b676 thru 0x019fe2 (0xe96d bytes) 000879 1786989143.709831 write 0x003f2d thru 0x00e73a (0xa80e bytes) 000882 1786989143.726804 trunc from 0x031c4a to 0x009eae (0x27d9b bytes) 000883 1786989143.795689 trunc from 0x009eaf to 0x032899 (0x289eb bytes) 000886 1786989143.823239 mapread 0x019135 thru 0x023855 (0xa721 bytes) 000887 1786989143.844738 mapwrite 0x0156e2 thru 0x01f2f3 (0x9c12 bytes) 000889 1786989143.917122 mapwrite 0x025d5e thru 0x02fad0 (0x9d73 bytes) 000890 1786989144.057550 mapwrite 0x03340f thru 0x03e75d (0xb34f bytes) 000891 1786989144.270751 write 0x0242e4 thru 0x028925 (0x4642 bytes) 000892 1786989144.284009 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e75e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e75e): Mirror 2: 0xeebbb85f (stale) Mirror 3: 0x2baf3cc1 (stale) CRC-32 checksum value for chunk [0, 0x3e75e): Mirror 1: 0xd25de39 Mirror 4: 0xd25de39 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e75e: skipped 000893 1786989145.549646 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e75e): Mirror 2: 0xeebbb85f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e75e): Mirror 2: 0xeebbb85f (stale) CRC-32 checksum value for chunk [0, 0x3e75e): Mirror 1: 0xd25de39 Mirror 4: 0xd25de39 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e75e: skipped 000896 1786989145.987191 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e75e): Mirror 2: 0xeebbb85f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e75e): Mirror 2: 0xeebbb85f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e75e: skipped 000897 1786989146.380241 mapread 0x0135a7 thru 0x01ba19 (0x8473 bytes) 000898 1786989146.419173 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e75e): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e75e): Mirror 2: 0xeebbb85f (stale) CRC-32 checksum value for chunk [0, 0x3e75e): Mirror 1: 0xd25de39 Mirror 3: 0xd25de39 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e75e: skipped 000899 1786989147.265477 mapread 0x036c0b thru 0x03e75d (0x7b53 bytes) 000900 1786989147.289279 write 0x017dde thru 0x01d755 (0x5978 bytes) 000901 1786989147.385729 write 0x011aa0 thru 0x01765e (0x5bbf bytes) 000902 1786989147.392559 trunc from 0x03e75e to 0x03d041 (0x171c bytes) 000905 1786989147.417242 trunc from 0x03d042 to 0x02b169 (0x11ed8 bytes) 000906 1786989147.436238 mapwrite 0x0000d2 thru 0x00a7f4 (0xa723 bytes) 000907 1786989147.514365 write 0x00100e thru 0x0030ff (0x20f2 bytes) 000908 1786989147.520722 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b16a): Mirror 2: 0x3a623ff2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b16a): Mirror 2: 0x3a623ff2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b16a: skipped 000910 1786989147.806208 read 0x02acfc thru 0x02b064 (0x369 bytes) 000911 1786989147.811492 mapread 0x02618d thru 0x02b169 (0x4fdd bytes) 000913 1786989147.835346 trunc from 0x02b16a to 0x02164a (0x9b1f bytes) 000915 1786989147.860243 read 0x01a709 thru 0x01d722 (0x301a bytes) 000916 1786989147.871316 mapwrite 0x00255a thru 0x007f6b (0x5a12 bytes) 000921 1786989147.924734 mapread 0x01f4d5 thru 0x02164a (0x2176 bytes) 000922 1786989147.925804 read 0x017850 thru 0x021328 (0x9ad9 bytes) 000923 1786989147.927222 mapwrite 0x027342 thru 0x02ee1f (0x7ade bytes) 000924 1786989148.020395 mapread 0x01d1e3 thru 0x01ef75 (0x1d93 bytes) 000926 1786989148.023534 read 0x001b0a thru 0x008855 (0x6d4c bytes) 000927 1786989148.024676 mapwrite 0x01abb9 thru 0x029873 (0xecbb bytes) 000928 1786989148.083300 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) 000930 1786989148.221772 mapread 0x0110c7 thru 0x012785 (0x16bf bytes) 000931 1786989148.235287 trunc from 0x02ee20 to 0x027af6 (0x7329 bytes) 000932 1786989148.251107 mapread 0x0045a9 thru 0x010efb (0xc953 bytes) 000933 1786989148.262756 mapwrite 0x03d48c thru 0x03ffff (0x2b74 bytes) 000941 1786989148.348705 read 0x03aaba thru 0x03ffff (0x5546 bytes) 000942 1786989148.349495 trunc from 0x040000 to 0x01fb48 (0x204b7 bytes) 000944 1786989148.372621 MIRROR_EXTEND to 2 mirrors 000945 1786989149.097222 MIRROR_EXTEND to 3 mirrors 000946 1786989149.691779 mapwrite 0x024ba2 thru 0x02e5db (0x9a3a bytes) 000948 1786989149.896226 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2e5dc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e5dc): Mirror 2: 0xa1c2f11 (stale) Mirror 3: 0xa1c2f11 (stale) CRC-32 checksum value for chunk [0, 0x2e5dc): Mirror 1: 0x396125c9 Mirror 4: 0x396125c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e5dc: skipped 000949 1786989151.054253 write 0x001a06 thru 0x00941e (0x7a19 bytes) 000950 1786989151.146727 write 0x001c3d thru 0x01092d (0xecf1 bytes) 000952 1786989151.155209 write 0x035d12 thru 0x03ffff (0xa2ee bytes) 000953 1786989151.157472 mapwrite 0x01ef1d thru 0x023410 (0x44f4 bytes) 000954 1786989151.349231 mapread 0x00a370 thru 0x013d8c (0x9a1d bytes) 000955 1786989151.365244 trunc from 0x040000 to 0x02b5ba (0x14a45 bytes) 000958 1786989151.426822 MIRROR_RESYNC 4 mirrors 000961 1786989152.893191 trunc from 0x02b5bb to 0x038790 (0xd1d6 bytes) 000964 1786989153.063116 mapwrite 0x02a3ab thru 0x02e3c5 (0x401b bytes) 000965 1786989153.147847 mapread 0x00cb51 thru 0x01a064 (0xd514 bytes) 000972 1786989153.182843 write 0x029522 thru 0x033be5 (0xa6c4 bytes) 000973 1786989153.185273 read 0x010b8a thru 0x01f63b (0xeab2 bytes) 000974 1786989153.194573 trunc from 0x038791 to 0x0370ed (0x16a3 bytes) 000976 1786989153.223094 trunc from 0x0370ee to 0x0202ff (0x16dee bytes) 000977 1786989153.240460 read 0x01e770 thru 0x0202ff (0x1b90 bytes) 000981 1786989153.251330 read 0x012736 thru 0x0202ff (0xdbca bytes) 000983 1786989153.252654 read 0x01f5c0 thru 0x0202ff (0xd40 bytes) 000984 1786989153.254050 trunc from 0x020300 to 0x0058a7 (0x1aa58 bytes) 000987 1786989153.277258 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x210:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x58a8): Mirror 3: 0xdcbab2e7 (stale) Mirror 4: 0xdcbab2e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x58a8): Mirror 3: 0xdcbab2e7 (stale) Mirror 4: 0xdcbab2e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x58a8: skipped 000988 1786989153.713427 MIRROR_RESYNC 3 mirrors 000990 1786989155.084248 write 0x01aef6 thru 0x01ce1a (0x1f25 bytes) 000991 1786989155.152837 mapwrite 0x011565 thru 0x01e398 (0xce34 bytes) 000992 1786989155.255286 MIRROR_RESYNC 3 mirrors 000993 1786989156.407636 read 0x00280d thru 0x00c947 (0xa13b bytes) 000996 1786989156.417470 read 0x013292 thru 0x01bb29 (0x8898 bytes) 000997 1786989156.429779 MIRROR_EXTEND to 4 mirrors 000998 1786989157.270417 mapwrite 0x01b218 thru 0x022cbc (0x7aa5 bytes) 001000 1786989157.601516 trunc from 0x022cbd to 0x039bf8 (0x16f3c bytes) All operations completed A-OK!