== sanity-flr test 70a: flr mode fsx test ================ 14:09:24 (1783966164) Seed set to 6167 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x30111 000001 1783966167.506252 trunc from 00000000 to 0x030110 (0x30111 bytes) 000004 1783966167.527023 mapread 0x0173e5 thru 0x02687c (0xf498 bytes) 000005 1783966167.557077 mapwrite 0x01352d thru 0x0189f3 (0x54c7 bytes) truncating to largest ever: 0x3ddb4 000008 1783966167.654409 trunc from 0x030111 to 0x03ddb3 (0xdca3 bytes) 000009 1783966167.671655 trunc from 0x03ddb4 to 0x007cda (0x360d9 bytes) 000017 1783966167.706618 mapwrite 0x03328f thru 0x03b410 (0x8182 bytes) 000020 1783966167.929942 write 0x007e4c thru 0x00fbd4 (0x7d89 bytes) 000021 1783966167.967903 MIRROR_EXTEND to 2 mirrors 000023 1783966169.630348 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) 000024 1783966169.946042 read 0x004dad thru 0x00e32e (0x9582 bytes) 000026 1783966169.979278 mapread 0x020ec6 thru 0x0298e5 (0x8a20 bytes) 000027 1783966170.030352 MIRROR_EXTEND to 2 mirrors 000028 1783966171.118427 trunc from 0x03b411 to 0x03be38 (0xa28 bytes) 000029 1783966171.206673 mapread 0x0302f5 thru 0x03a991 (0xa69d bytes) 000030 1783966171.231191 mapwrite 0x0018bc thru 0x00fcf2 (0xe437 bytes) 000032 1783966171.386769 MIRROR_RESYNC 2 mirrors 000033 1783966172.201001 read 0x0327fc thru 0x0368b9 (0x40be bytes) 000035 1783966172.217600 write 0x03411b thru 0x03ffff (0xbee5 bytes) 000036 1783966172.327442 write 0x02f7ee thru 0x037767 (0x7f7a bytes) 000037 1783966172.338307 MIRROR_RESYNC 2 mirrors 000038 1783966173.084224 trunc from 0x040000 to 0x018ab4 (0x2754b bytes) 000039 1783966173.173394 mapwrite 0x03977d thru 0x03ffff (0x6883 bytes) 000040 1783966173.255351 mapread 0x03b965 thru 0x03ffff (0x469b bytes) 000041 1783966173.257538 write 0x03b9e0 thru 0x03ffff (0x4620 bytes) 000042 1783966173.269823 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xdb8865e4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x613aa57b Mirror 3: 0x613aa57b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000043 1783966174.109414 trunc from 0x040000 to 0x02a6aa (0x15955 bytes) 000046 1783966174.276778 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a6ab): Mirror 2: 0xaa3be855 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a6ab): Mirror 2: 0xaa3be855 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a6ab: skipped 000047 1783966174.780961 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) 000048 1783966175.014114 mapread 0x00c9ff thru 0x01a111 (0xd713 bytes) 000049 1783966175.060878 mapread 0x00effa thru 0x01cdfc (0xde03 bytes) 000051 1783966175.077157 trunc from 0x02a6ab to 0x02a364 (0x346 bytes) 000053 1783966175.130346 mapwrite 0x03bd86 thru 0x03ffff (0x427a bytes) 000054 1783966175.284031 write 0x0377ad thru 0x03a217 (0x2a6b bytes) 000058 1783966175.292076 mapread 0x01561c thru 0x0227d4 (0xd1b9 bytes) 000061 1783966175.322610 read 0x02083c thru 0x02cbf1 (0xc3b6 bytes) 000064 1783966175.341184 trunc from 0x040000 to 0x00960e (0x369f1 bytes) 000067 1783966175.412285 trunc from 0x00960f to 0x03410a (0x2aafc bytes) 000068 1783966175.447889 mapwrite 0x036e95 thru 0x03a711 (0x387d bytes) 000069 1783966175.585952 trunc from 0x03a712 to 0x00958d (0x31184 bytes) 000072 1783966175.616910 read 0x002ef2 thru 0x005b74 (0x2c83 bytes) 000073 1783966175.623923 mapread 0x005615 thru 0x00958d (0x3f79 bytes) 000074 1783966175.625299 write 0x0318dd thru 0x03f395 (0xdab9 bytes) 000075 1783966175.631053 MIRROR_EXTEND to 2 mirrors 000076 1783966176.127187 read 0x010d12 thru 0x015b54 (0x4e43 bytes) 000079 1783966176.172234 read 0x00870d thru 0x014158 (0xba4c bytes) 000080 1783966176.199083 mapread 0x00ba88 thru 0x012e78 (0x73f1 bytes) 000082 1783966176.238235 mapread 0x0114b9 thru 0x01f2fb (0xde43 bytes) 000084 1783966176.272113 mapwrite 0x01e03f thru 0x02220e (0x41d0 bytes) 000085 1783966176.616407 mapread 0x017dca thru 0x0195c2 (0x17f9 bytes) 000087 1783966176.647945 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3f396): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f396): Mirror 2: 0xc755a68a (stale) CRC-32 checksum value for chunk [0, 0x3f396): Mirror 1: 0x85d21e57 Mirror 3: 0x85d21e57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f396: skipped 000089 1783966178.218723 read 0x02eb4e thru 0x03a4aa (0xb95d bytes) 000090 1783966178.253966 mapwrite 0x039af9 thru 0x03ffff (0x6507 bytes) 000091 1783966178.560430 mapwrite 0x03c28d thru 0x03ffff (0x3d73 bytes) 000092 1783966178.663210 trunc from 0x040000 to 0x0088aa (0x37755 bytes) 000093 1783966178.709369 MIRROR_RESYNC 3 mirrors 000094 1783966179.986718 read 0x007403 thru 0x0088aa (0x14a8 bytes) 000095 1783966179.999353 write 0x00f027 thru 0x019790 (0xa76a bytes) 000097 1783966180.084681 mapread 0x019012 thru 0x019790 (0x77f bytes) 000098 1783966180.095355 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19791): Mirror 2: 0x602fd445 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19791): Mirror 2: 0x602fd445 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19791: skipped 000100 1783966180.618394 read 0x00d615 thru 0x012047 (0x4a33 bytes) 000103 1783966180.629416 trunc from 0x019791 to 0x020512 (0x6d82 bytes) 000105 1783966180.662233 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) 000106 1783966180.902937 read 0x01c108 thru 0x01dae0 (0x19d9 bytes) 000107 1783966180.916629 mapread 0x016789 thru 0x020512 (0x9d8a bytes) 000108 1783966180.955774 mapwrite 0x017916 thru 0x01d6b1 (0x5d9c bytes) 000110 1783966181.039110 write 0x016dc9 thru 0x02109f (0xa2d7 bytes) 000112 1783966181.049300 read 0x0081cf thru 0x016520 (0xe352 bytes) 000114 1783966181.074330 mapread 0x016569 thru 0x0201ba (0x9c52 bytes) 000116 1783966181.078076 trunc from 0x0210a0 to 0x0171bc (0x9ee3 bytes) 000117 1783966181.118757 trunc from 0x0171bd to 0x016481 (0xd3b bytes) 000120 1783966181.162280 read 0x0119b1 thru 0x016481 (0x4ad1 bytes) 000121 1783966181.163864 mapread 0x0013d9 thru 0x005d61 (0x4989 bytes) 000122 1783966181.166047 write 0x03e77f thru 0x03ffff (0x1881 bytes) 000128 1783966181.177189 MIRROR_EXTEND to 2 mirrors 000129 1783966182.262588 trunc from 0x040000 to 0x013c6e (0x2c391 bytes) 000130 1783966182.457812 mapread 0x01327e thru 0x013c6e (0x9f1 bytes) 000138 1783966182.491199 MIRROR_RESYNC 2 mirrors 000139 1783966183.401658 mapread 0x011e18 thru 0x013c6e (0x1e57 bytes) 000142 1783966183.437316 write 0x02af84 thru 0x02e0ab (0x3128 bytes) 000143 1783966183.523232 mapwrite 0x00942d thru 0x0174e5 (0xe0b9 bytes) 000144 1783966183.618529 read 0x02a27a thru 0x02e0ab (0x3e32 bytes) 000146 1783966183.622183 read 0x0183af thru 0x01a0d0 (0x1d22 bytes) 000147 1783966183.623966 mapread 0x0201d1 thru 0x02d7d6 (0xd606 bytes) 000148 1783966183.639965 trunc from 0x02e0ac to 0x00b746 (0x22965 bytes) 000150 1783966183.701921 trunc from 0x00b747 to 0x03b36d (0x2fc27 bytes) 000151 1783966183.732758 mapread 0x02a536 thru 0x033687 (0x9152 bytes) truncating to largest ever: 0x3e28d 000155 1783966183.795356 trunc from 0x03b36e to 0x03e28c (0x2f1f bytes) 000158 1783966183.820405 mapread 0x0170d6 thru 0x01a84f (0x377a bytes) 000159 1783966183.858461 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) 000162 1783966184.242974 mapread 0x01b20c thru 0x0200d3 (0x4ec8 bytes) 000163 1783966184.329425 trunc from 0x03e28d to 0x00bf1c (0x32370 bytes) 000165 1783966184.401133 read 0x00a1d8 thru 0x00bf1c (0x1d45 bytes) 000166 1783966184.410179 mapwrite 0x028419 thru 0x02f0d7 (0x6cbf bytes) 000167 1783966184.563258 trunc from 0x02f0d8 to 0x039cd8 (0xac01 bytes) 000168 1783966184.590501 mapwrite 0x025743 thru 0x02e69e (0x8f5c bytes) 000169 1783966184.749381 write 0x02edc5 thru 0x036730 (0x796c bytes) 000170 1783966184.774850 trunc from 0x039cd9 to 0x0081b1 (0x31b27 bytes) 000173 1783966184.856198 mapwrite 0x022030 thru 0x029a11 (0x79e2 bytes) 000174 1783966185.105654 mapread 0x004cbc thru 0x00b841 (0x6b86 bytes) 000175 1783966185.140089 mapread 0x025a2b thru 0x027ab0 (0x2086 bytes) 000176 1783966185.141333 trunc from 0x029a12 to 0x028f3c (0xad5 bytes) 000178 1783966185.177316 read 0x014467 thru 0x023218 (0xedb2 bytes) 000179 1783966185.210116 mapwrite 0x003116 thru 0x0031ed (0xd8 bytes) 000181 1783966185.336603 mapread 0x011295 thru 0x011598 (0x304 bytes) 000182 1783966185.340430 mapread 0x004b87 thru 0x009ca7 (0x5121 bytes) 000183 1783966185.348361 mapwrite 0x03ac1e thru 0x03f85d (0x4c40 bytes) 000185 1783966185.710328 MIRROR_EXTEND to 2 mirrors 000188 1783966186.950932 mapwrite 0x000d39 thru 0x002c45 (0x1f0d bytes) 000192 1783966187.443161 mapwrite 0x03bbce thru 0x03e2ab (0x26de bytes) 000193 1783966187.684546 read 0x01ae22 thru 0x020c0d (0x5dec bytes) 000194 1783966187.712275 mapwrite 0x01e441 thru 0x0282c7 (0x9e87 bytes) 000195 1783966187.861046 trunc from 0x03f85e to 0x03abab (0x4cb2 bytes) 000196 1783966187.924337 mapread 0x009149 thru 0x012b1c (0x99d4 bytes) 000198 1783966187.964173 trunc from 0x03abac to 0x00090c (0x3a29f bytes) 000202 1783966187.997185 mapwrite 0x002a2e thru 0x00ef94 (0xc567 bytes) 000204 1783966188.161173 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xef95): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xef95): Mirror 2: 0x8b5a961a (stale) CRC-32 checksum value for chunk [0, 0xef95): Mirror 1: 0xc3436d79 Mirror 3: 0xc3436d79 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xef95: skipped 000205 1783966189.727745 trunc from 0x00ef95 to 0x03dac1 (0x2eb2d bytes) 000206 1783966190.003599 read 0x000849 thru 0x007006 (0x67be bytes) 000207 1783966190.021666 trunc from 0x03dac2 to 0x0109fd (0x2d0c4 bytes) 000208 1783966190.081409 trunc from 0x0109fe to 0x02c7bf (0x1bdc2 bytes) 000210 1783966190.131580 mapwrite 0x00dcda thru 0x016adf (0x8e06 bytes) 000211 1783966190.300226 read 0x017e12 thru 0x018652 (0x841 bytes) 000214 1783966190.319659 mapread 0x013af6 thru 0x017505 (0x3a10 bytes) 000216 1783966190.331181 trunc from 0x02c7c0 to 0x034788 (0x7fc9 bytes) 000218 1783966190.382122 read 0x00ed60 thru 0x00f558 (0x7f9 bytes) 000219 1783966190.395202 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x34789): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34789): Mirror 2: 0x6818e238 (stale) Mirror 3: 0x4a5c4a1 (stale) CRC-32 checksum value for chunk [0, 0x34789): Mirror 1: 0x1f04d355 Mirror 4: 0x1f04d355 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34789: skipped 000223 1783966191.898532 read 0x00b576 thru 0x010c13 (0x569e bytes) 000227 1783966191.988733 write 0x03eb76 thru 0x03ffff (0x148a bytes) 000229 1783966192.121462 mapread 0x035a8a thru 0x03ffff (0xa576 bytes) 000230 1783966192.213440 mapread 0x019d6f thru 0x01a6d1 (0x963 bytes) 000236 1783966192.252061 write 0x025829 thru 0x028a40 (0x3218 bytes) 000237 1783966192.289642 write 0x027cfa thru 0x03054c (0x8853 bytes) 000239 1783966192.306603 write 0x00225f thru 0x006586 (0x4328 bytes) 000240 1783966192.340408 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x434f4551 (stale) Mirror 4: 0x8cd8854b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x434f4551 (stale) Mirror 4: 0x8cd8854b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000241 1783966193.000387 write 0x00a646 thru 0x018a2c (0xe3e7 bytes) 000242 1783966193.031108 write 0x032c3e thru 0x03ffff (0xd3c2 bytes) 000243 1783966193.049965 trunc from 0x040000 to 0x01429e (0x2bd61 bytes) 000255 1783966193.111806 trunc from 0x01429f to 0x029523 (0x15285 bytes) 000256 1783966193.166075 mapread 0x019f96 thru 0x022f54 (0x8fbf bytes) 000258 1783966193.203970 write 0x01f491 thru 0x02b102 (0xbc72 bytes) 000259 1783966193.211444 mapread 0x00a992 thru 0x016b2a (0xc199 bytes) 000260 1783966193.227653 MIRROR_RESYNC 3 mirrors 000262 1783966194.790638 read 0x00324b thru 0x0068b0 (0x3666 bytes) 000265 1783966194.799858 mapread 0x016068 thru 0x01a0b9 (0x4052 bytes) 000268 1783966194.840983 read 0x01898e thru 0x01efb2 (0x6625 bytes) 000269 1783966194.841629 read 0x005002 thru 0x00ea7c (0x9a7b bytes) 000270 1783966194.867026 write 0x02424e thru 0x027b08 (0x38bb bytes) 000272 1783966194.990821 mapread 0x017f22 thru 0x026fb5 (0xf094 bytes) 000273 1783966195.065337 mapwrite 0x0393a8 thru 0x03ffff (0x6c58 bytes) 000275 1783966195.212702 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xcb9d8970 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xcb9d8970 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000276 1783966195.592833 mapwrite 0x0259b1 thru 0x031d72 (0xc3c2 bytes) 000281 1783966195.725972 mapwrite 0x020cbf thru 0x02bb77 (0xaeb9 bytes) 000282 1783966195.814054 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) 000284 1783966196.008795 MIRROR_EXTEND to 2 mirrors 000285 1783966196.813192 write 0x00f094 thru 0x016ed6 (0x7e43 bytes) 000286 1783966196.905992 mapwrite 0x0112f9 thru 0x011366 (0x6e bytes) 000287 1783966196.957913 read 0x00d268 thru 0x00fc58 (0x29f1 bytes) 000290 1783966196.966040 mapwrite 0x030641 thru 0x0352ff (0x4cbf bytes) 000291 1783966197.061985 mapwrite 0x035675 thru 0x03944d (0x3dd9 bytes) 000293 1783966197.234581 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) 000294 1783966197.382560 trunc from 0x040000 to 0x02b69c (0x14963 bytes) 000297 1783966197.426386 read 0x00d42d thru 0x00f0cd (0x1ca1 bytes) 000301 1783966197.448108 MIRROR_EXTEND to 2 mirrors 000302 1783966198.156617 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) 000304 1783966198.318878 MIRROR_EXTEND to 2 mirrors 000305 1783966199.344096 read 0x0065e7 thru 0x011beb (0xb605 bytes) 000306 1783966199.363358 trunc from 0x02b69d to 0x01db85 (0xdb17 bytes) 000308 1783966199.477449 mapwrite 0x02604a thru 0x035001 (0xefb8 bytes) 000310 1783966199.663076 trunc from 0x035002 to 0x001ed9 (0x33128 bytes) 000311 1783966199.717295 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1eda): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1eda): Mirror 2: 0x3b07a679 (stale) CRC-32 checksum value for chunk [0, 0x1eda): Mirror 1: 0x3b07a679 Mirror 3: 0x3b07a679 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1eda: skipped 000312 1783966201.164517 write 0x025aac thru 0x0348ec (0xee41 bytes) 000315 1783966201.305114 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x348ed): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x348ed): Mirror 2: 0x3e2591a7 (stale) Mirror 3: 0x98a55be3 (stale) CRC-32 checksum value for chunk [0, 0x348ed): Mirror 1: 0x46a2b1c7 Mirror 4: 0x46a2b1c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x348ed: skipped 000317 1783966202.639660 read 0x03483a thru 0x0348ec (0xb3 bytes) 000318 1783966202.653813 trunc from 0x0348ed to 0x02cbd9 (0x7d13 bytes) 000320 1783966202.764927 read 0x015360 thru 0x01b855 (0x64f6 bytes) 000321 1783966202.780812 write 0x02f918 thru 0x03a82b (0xaf14 bytes) 000322 1783966202.787801 MIRROR_RESYNC 4 mirrors 000324 1783966203.745774 trunc from 0x03a82c to 0x003310 (0x3751b bytes) 000325 1783966203.827205 trunc from 0x003311 to 0x024f95 (0x21c85 bytes) 000326 1783966203.857459 mapread 0x001ce5 thru 0x005caf (0x3fcb bytes) 000328 1783966203.893346 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24f96): Mirror 2: 0x2b0fa25a (stale) Mirror 4: 0x2b0fa25a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24f96): Mirror 2: 0x2b0fa25a (stale) Mirror 4: 0x2b0fa25a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24f96: skipped 000329 1783966204.265853 read 0x002c53 thru 0x005690 (0x2a3e bytes) 000331 1783966204.274438 write 0x035c25 thru 0x038ac4 (0x2ea0 bytes) 000332 1783966204.276667 read 0x01ea34 thru 0x029e6e (0xb43b bytes) 000334 1783966204.290793 mapread 0x01ffaa thru 0x02e38c (0xe3e3 bytes) 000337 1783966204.295615 trunc from 0x038ac5 to 0x00048d (0x38637 bytes) 000338 1783966204.317010 mapwrite 0x0145e5 thru 0x016004 (0x1a20 bytes) 000339 1783966204.400564 read 0x006bb9 thru 0x00a565 (0x39ad bytes) 000341 1783966204.411861 mapread 0x015da6 thru 0x016004 (0x25f bytes) 000346 1783966204.417444 write 0x0029fc thru 0x009b36 (0x713b bytes) 000347 1783966204.419122 write 0x031dfd thru 0x032c69 (0xe6d bytes) 000348 1783966204.425917 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x32c6a): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32c6a): Mirror 2: 0xf30ca821 (stale) Mirror 4: 0xf30ca821 (stale) CRC-32 checksum value for chunk [0, 0x32c6a): Mirror 1: 0xf9178b66 Mirror 5: 0xf9178b66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32c6a: skipped 000350 1783966205.216994 mapwrite 0x03c1c7 thru 0x03df14 (0x1d4e bytes) 000351 1783966205.445117 trunc from 0x03df15 to 0x012696 (0x2b87e bytes) 000355 1783966205.480611 mapread 0x00fb4c thru 0x00ff81 (0x436 bytes) 000356 1783966205.493733 write 0x00fbe9 thru 0x015052 (0x546a bytes) 000358 1783966205.496286 trunc from 0x015053 to 0x01f51a (0xa4c8 bytes) 000359 1783966205.520747 mapwrite 0x01916a thru 0x023bbf (0xaa56 bytes) 000360 1783966205.598746 read 0x0096a7 thru 0x00e19d (0x4af7 bytes) 000361 1783966205.600612 mapread 0x00349a thru 0x00ba27 (0x858e bytes) 000362 1783966205.617768 mapread 0x00e6e0 thru 0x0111ee (0x2b0f bytes) 000363 1783966205.621735 trunc from 0x023bc0 to 0x01722e (0xc991 bytes) 000366 1783966205.656728 write 0x001ff4 thru 0x00e701 (0xc70e bytes) 000367 1783966205.663967 trunc from 0x01722f to 0x02d93c (0x1670e bytes) 000368 1783966205.695601 mapwrite 0x02cf51 thru 0x03a085 (0xd135 bytes) 000370 1783966205.895877 trunc from 0x03a086 to 0x015110 (0x24f75 bytes) 000372 1783966205.952243 mapread 0x00c97c thru 0x013c3e (0x72c3 bytes) 000375 1783966205.969327 read 0x00962d thru 0x011f5e (0x8932 bytes) 000376 1783966205.990016 MIRROR_RESYNC 4 mirrors 000377 1783966207.686461 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) 000378 1783966208.340095 mapread 0x004791 thru 0x014485 (0xfcf5 bytes) 000379 1783966208.425752 mapwrite 0x039b1a thru 0x03ffff (0x64e6 bytes) 000382 1783966208.582055 trunc from 0x040000 to 0x0310af (0xef50 bytes) 000383 1783966208.611974 read 0x0102c7 thru 0x015a01 (0x573b bytes) 000384 1783966208.622107 read 0x00dff2 thru 0x014648 (0x6657 bytes) 000385 1783966208.637844 mapread 0x011a68 thru 0x01ac00 (0x9199 bytes) 000387 1783966208.641097 mapwrite 0x03c2b5 thru 0x03ffff (0x3d4b bytes) 000389 1783966208.722447 read 0x01d300 thru 0x01f24f (0x1f50 bytes) 000390 1783966208.726368 read 0x0271be thru 0x02c4fc (0x533f bytes) 000391 1783966208.727694 write 0x026e3d thru 0x02d88b (0x6a4f bytes) 000392 1783966208.730702 read 0x02f257 thru 0x030b4e (0x18f8 bytes) 000393 1783966208.732421 mapwrite 0x0347a6 thru 0x03ffff (0xb85a bytes) 000394 1783966208.834441 trunc from 0x040000 to 0x01af0e (0x250f1 bytes) 000395 1783966208.869753 MIRROR_RESYNC 3 mirrors 000396 1783966210.302187 read 0x015424 thru 0x01af0e (0x5aeb bytes) 000397 1783966210.324781 mapread 0x01821e thru 0x01af0e (0x2cf1 bytes) 000398 1783966210.325662 mapwrite 0x02ed02 thru 0x03d169 (0xe468 bytes) 000399 1783966210.659371 mapread 0x0076b5 thru 0x00abff (0x354b bytes) 000401 1783966210.695925 mapread 0x02bb2a thru 0x038c38 (0xd10f bytes) 000402 1783966210.697914 trunc from 0x03d16a to 0x038475 (0x4cf4 bytes) 000404 1783966210.755024 write 0x024c39 thru 0x031052 (0xc41a bytes) 000406 1783966210.769018 read 0x031873 thru 0x032dd9 (0x1567 bytes) 000407 1783966210.770269 mapwrite 0x023f30 thru 0x02c449 (0x851a bytes) 000408 1783966210.838315 write 0x02fd32 thru 0x035f93 (0x6262 bytes) 000410 1783966210.842165 mapwrite 0x0001c1 thru 0x00b0c4 (0xaf04 bytes) 000411 1783966210.897458 mapwrite 0x0136df thru 0x01cc37 (0x9559 bytes) 000413 1783966210.947927 trunc from 0x038476 to 0x029f46 (0xe52f bytes) 000414 1783966210.966692 trunc from 0x029f47 to 0x030ce9 (0x6da3 bytes) 000415 1783966210.992165 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x30cea): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30cea): Mirror 2: 0x27ceb7dd (stale) Mirror 4: 0x27ceb7dd (stale) CRC-32 checksum value for chunk [0, 0x30cea): Mirror 1: 0x37fb4f2d Mirror 5: 0x37fb4f2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30cea: skipped 000416 1783966212.004983 mapread 0x003521 thru 0x00907f (0x5b5f bytes) 000417 1783966212.046753 write 0x01ecd0 thru 0x027cbb (0x8fec bytes) 000418 1783966212.146762 trunc from 0x030cea to 0x0364f3 (0x580a bytes) 000424 1783966212.175680 read 0x02a628 thru 0x0364f3 (0xbecc bytes) 000425 1783966212.185646 trunc from 0x0364f4 to 0x012e6f (0x23684 bytes) 000426 1783966212.223462 MIRROR_RESYNC 4 mirrors 000427 1783966213.014117 mapread 0x0006b8 thru 0x00f641 (0xef8a bytes) 000432 1783966213.043708 mapwrite 0x001173 thru 0x00f496 (0xe324 bytes) 000434 1783966213.242133 read 0x0103e4 thru 0x012dee (0x2a0b bytes) 000435 1783966213.258727 mapread 0x0102b1 thru 0x012b3c (0x288c bytes) 000438 1783966213.265226 mapwrite 0x023f28 thru 0x0244dd (0x5b6 bytes) 000439 1783966213.429923 mapread 0x0015f0 thru 0x00e4aa (0xcebb bytes) 000440 1783966213.437744 mapwrite 0x028178 thru 0x035087 (0xcf10 bytes) 000441 1783966213.578552 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x35088): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35088): Mirror 2: 0x9fcdb3d0 (stale) Mirror 4: 0x9fcdb3d0 (stale) Mirror 5: 0x9fcdb3d0 (stale) CRC-32 checksum value for chunk [0, 0x35088): Mirror 1: 0x47e6740c Mirror 6: 0x47e6740c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35088: skipped 000442 1783966214.663104 write 0x02fe54 thru 0x03b1d6 (0xb383 bytes) 000445 1783966214.794721 trunc from 0x03b1d7 to 0x01ce45 (0x1e391 bytes) 000447 1783966214.912802 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1ce46): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ce46): Mirror 2: 0xbe9123c7 (stale) Mirror 4: 0xbe9123c7 (stale) Mirror 5: 0xbe9123c7 (stale) Mirror 6: 0x3ab86622 (stale) CRC-32 checksum value for chunk [0, 0x1ce46): Mirror 1: 0x3ab86622 Mirror 7: 0x3ab86622 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ce46: skipped 000451 1783966216.808297 trunc from 0x01ce46 to 0x0345a9 (0x17764 bytes) 000452 1783966217.023625 read 0x021170 thru 0x02b0b2 (0x9f43 bytes) 000454 1783966217.036598 write 0x017367 thru 0x0177ea (0x484 bytes) 000457 1783966217.046786 mapread 0x029a16 thru 0x02f818 (0x5e03 bytes) 000459 1783966217.081105 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x345aa): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x345aa): Mirror 2: 0x4522bbac (stale) Mirror 4: 0x4522bbac (stale) Mirror 5: 0x4522bbac (stale) Mirror 6: 0xd7a4ff4 (stale) Mirror 7: 0x82b2c408 (stale) CRC-32 checksum value for chunk [0, 0x345aa): Mirror 1: 0x3c17a06 Mirror 8: 0x3c17a06 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x345aa: skipped 000460 1783966218.291320 trunc from 0x0345aa to 0x01107c (0x2352d bytes) 000463 1783966218.413568 mapwrite 0x0062e0 thru 0x00a9e3 (0x4704 bytes) 000465 1783966218.487673 mapread 0x000401 thru 0x0050e8 (0x4ce8 bytes) 000466 1783966218.497700 mapwrite 0x01f918 thru 0x0218b8 (0x1fa1 bytes) 000470 1783966218.591277 mapwrite 0x011e76 thru 0x013f21 (0x20ac bytes) 000471 1783966218.699383 write 0x003dad thru 0x006aa9 (0x2cfd bytes) 000472 1783966218.701151 write 0x011017 thru 0x0123bf (0x13a9 bytes) 000473 1783966218.702979 mapread 0x020206 thru 0x0218b8 (0x16b3 bytes) 000474 1783966218.705333 mapwrite 0x007bbc thru 0x00f5e5 (0x7a2a bytes) 000476 1783966218.810696 MIRROR_RESYNC 7 mirrors 000477 1783966220.394409 mapwrite 0x01a991 thru 0x02a2cb (0xf93b bytes) 000479 1783966220.719638 mapread 0x00cb20 thru 0x00d6f5 (0xbd6 bytes) 000481 1783966220.750002 MIRROR_RESYNC 7 mirrors 000482 1783966222.593846 write 0x0388e7 thru 0x03ffff (0x7719 bytes) 000483 1783966222.709995 mapread 0x0336db thru 0x0360af (0x29d5 bytes) 000486 1783966222.735270 mapwrite 0x007e42 thru 0x0087c9 (0x988 bytes) 000487 1783966222.847607 trunc from 0x040000 to 0x0399d8 (0x6627 bytes) 000489 1783966222.889405 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x399d9): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x399d9): Mirror 2: 0xa7ea51b1 (stale) Mirror 4: 0xa7ea51b1 (stale) Mirror 5: 0xa7ea51b1 (stale) Mirror 6: 0xa7ea51b1 (stale) Mirror 7: 0xa7ea51b1 (stale) Mirror 8: 0xa7ea51b1 (stale) CRC-32 checksum value for chunk [0, 0x399d9): Mirror 1: 0xee572213 Mirror 9: 0xee572213 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x399d9: skipped 000490 1783966224.428007 mapwrite 0x00efd4 thru 0x011b68 (0x2b95 bytes) 000491 1783966224.844823 read 0x015eff thru 0x01a381 (0x4483 bytes) 000493 1783966224.855398 mapread 0x00201c thru 0x002fb7 (0xf9c bytes) 000495 1783966224.867601 mapread 0x004e79 thru 0x00678c (0x1914 bytes) 000496 1783966224.869330 write 0x01dc08 thru 0x022499 (0x4892 bytes) 000497 1783966224.900675 trunc from 0x0399d9 to 0x022865 (0x17173 bytes) 000500 1783966224.938249 mapwrite 0x037bd7 thru 0x03ffff (0x8429 bytes) 000502 1783966225.079070 mapwrite 0x023798 thru 0x0295bf (0x5e28 bytes) 000504 1783966225.195447 read 0x032a49 thru 0x03692c (0x3ee4 bytes) 000509 1783966225.209308 mapread 0x00b8d1 thru 0x011e1d (0x654d bytes) 000510 1783966225.213725 mapwrite 0x0217a8 thru 0x027045 (0x589e bytes) 000511 1783966225.315677 MIRROR_RESYNC 8 mirrors 000512 1783966226.839693 write 0x030168 thru 0x03038d (0x226 bytes) 000513 1783966226.939881 mapwrite 0x01c3ab thru 0x023366 (0x6fbc bytes) 000514 1783966227.100874 read 0x026c4e thru 0x0340a7 (0xd45a bytes) 000515 1783966227.111840 read 0x01eb1c thru 0x028efd (0xa3e2 bytes) 000516 1783966227.113395 mapread 0x019a69 thru 0x01cd73 (0x330b bytes) 000517 1783966227.115004 write 0x03da1f thru 0x03dc88 (0x26a bytes) 000518 1783966227.126814 mapwrite 0x037259 thru 0x03ec11 (0x79b9 bytes) 000519 1783966227.170123 mapwrite 0x02cf75 thru 0x02e5ae (0x163a bytes) 000520 1783966227.209157 MIRROR_RESYNC 8 mirrors 000522 1783966228.947534 read 0x02945b thru 0x03045d (0x7003 bytes) 000523 1783966228.959145 trunc from 0x040000 to 0x017cb9 (0x28346 bytes) 000524 1783966229.057198 mapread 0x00c4b7 thru 0x012e8e (0x69d8 bytes) 000525 1783966229.079207 trunc from 0x017cba to 0x036ba5 (0x1eeec bytes) 000526 1783966229.110315 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x36ba6): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36ba6): Mirror 2: 0x1b5ce13b (stale) Mirror 4: 0x1b5ce13b (stale) Mirror 5: 0x1b5ce13b (stale) Mirror 6: 0x1b5ce13b (stale) Mirror 7: 0x1b5ce13b (stale) Mirror 8: 0x1b5ce13b (stale) Mirror 9: 0x1b5ce13b (stale) CRC-32 checksum value for chunk [0, 0x36ba6): Mirror 1: 0xc2b2aa5c Mirror 10: 0xc2b2aa5c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36ba6: skipped 000528 1783966230.438674 mapwrite 0x011ca4 thru 0x017a0f (0x5d6c bytes) 000531 1783966230.644098 mapread 0x02d2ec thru 0x036ba5 (0x98ba bytes) 000532 1783966230.668010 mapread 0x02c4b2 thru 0x032200 (0x5d4f bytes) 000534 1783966230.674266 write 0x0208c2 thru 0x029c7e (0x93bd bytes) 000535 1783966230.684001 write 0x02ee32 thru 0x03c05b (0xd22a bytes) 000537 1783966230.692831 mapread 0x000108 thru 0x0064aa (0x63a3 bytes) 000539 1783966230.707197 trunc from 0x03c05c to 0x00903a (0x33021 bytes) 000540 1783966230.738030 read 0x006af1 thru 0x00903a (0x254a bytes) 000541 1783966230.739340 mapread 0x0067d1 thru 0x00903a (0x286a bytes) 000543 1783966230.742091 mapwrite 0x03ceb1 thru 0x03ffff (0x314f bytes) 000545 1783966230.833086 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x218b232e (stale) Mirror 4: 0x218b232e (stale) Mirror 6: 0x218b232e (stale) Mirror 7: 0x218b232e (stale) Mirror 8: 0x218b232e (stale) Mirror 9: 0x218b232e (stale) Mirror 10: 0x3c64ef82 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x218b232e (stale) Mirror 4: 0x218b232e (stale) Mirror 6: 0x218b232e (stale) Mirror 7: 0x218b232e (stale) Mirror 8: 0x218b232e (stale) Mirror 9: 0x218b232e (stale) Mirror 10: 0x3c64ef82 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000546 1783966231.436072 mapread 0x039c4d thru 0x03be3b (0x21ef bytes) 000547 1783966231.462637 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x218b232e (stale) Mirror 4: 0x218b232e (stale) Mirror 6: 0x218b232e (stale) Mirror 7: 0x218b232e (stale) Mirror 8: 0x218b232e (stale) Mirror 9: 0x218b232e (stale) Mirror 10: 0x3c64ef82 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x616bda06 Mirror 11: 0x616bda06 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000548 1783966232.824574 MIRROR_RESYNC 9 mirrors 000553 1783966234.616455 mapread 0x03df4a thru 0x03ffff (0x20b6 bytes) 000554 1783966234.652202 MIRROR_EXTEND to 10 mirrors 000555 1783966235.750437 MIRROR_RESYNC 10 mirrors 000556 1783966236.497616 read 0x008c16 thru 0x01405f (0xb44a bytes) 000558 1783966236.510172 read 0x002a38 thru 0x008a8f (0x6058 bytes) 000559 1783966236.531748 read 0x00c148 thru 0x01410a (0x7fc3 bytes) 000561 1783966236.532634 write 0x03e359 thru 0x03ffff (0x1ca7 bytes) 000562 1783966236.632532 mapwrite 0x00096c thru 0x002569 (0x1bfe bytes) 000564 1783966236.679452 read 0x002480 thru 0x008d41 (0x68c2 bytes) 000565 1783966236.680346 mapwrite 0x008cf1 thru 0x010f64 (0x8274 bytes) 000566 1783966236.736840 write 0x02069a thru 0x02248e (0x1df5 bytes) 000568 1783966236.738597 trunc from 0x040000 to 0x012dc4 (0x2d23b bytes) 000569 1783966236.777241 mapread 0x00d257 thru 0x012dc4 (0x5b6e bytes) 000570 1783966236.780428 trunc from 0x012dc5 to 0x038b66 (0x25da2 bytes) 000572 1783966236.809077 read 0x025e8f thru 0x02b771 (0x58e3 bytes) 000573 1783966236.822341 read 0x030c2a thru 0x03334f (0x2726 bytes) 000575 1783966236.825312 trunc from 0x038b67 to 0x02b1ab (0xd9bb bytes) 000576 1783966236.846701 trunc from 0x02b1ac to 0x00a371 (0x20e3a bytes) 000577 1783966236.870971 mapread 0x001494 thru 0x008c46 (0x77b3 bytes) 000578 1783966236.884656 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa372): Mirror 2: 0x7e9f876b (stale) Mirror 4: 0x7e9f876b (stale) Mirror 6: 0x7e9f876b (stale) Mirror 7: 0x7e9f876b (stale) Mirror 8: 0x7e9f876b (stale) Mirror 10: 0x7e9f876b (stale) Mirror 11: 0x7e9f876b (stale) Mirror 12: 0x7e9f876b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa372): Mirror 2: 0x7e9f876b (stale) Mirror 4: 0x7e9f876b (stale) Mirror 6: 0x7e9f876b (stale) Mirror 7: 0x7e9f876b (stale) Mirror 8: 0x7e9f876b (stale) Mirror 10: 0x7e9f876b (stale) Mirror 11: 0x7e9f876b (stale) Mirror 12: 0x7e9f876b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa372: skipped 000579 1783966237.395177 mapread 0x0006fd thru 0x004cb7 (0x45bb bytes) 000581 1783966237.423352 mapwrite 0x00bfe9 thru 0x016020 (0xa038 bytes) 000582 1783966237.516601 mapread 0x007e5c thru 0x011daa (0x9f4f bytes) 000583 1783966237.525099 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16021): Mirror 2: 0xa7449f7c (stale) Mirror 4: 0xa7449f7c (stale) Mirror 6: 0xa7449f7c (stale) Mirror 7: 0xa7449f7c (stale) Mirror 8: 0xa7449f7c (stale) Mirror 11: 0xa7449f7c (stale) Mirror 12: 0xa7449f7c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16021): Mirror 2: 0xa7449f7c (stale) Mirror 4: 0xa7449f7c (stale) Mirror 6: 0xa7449f7c (stale) Mirror 7: 0xa7449f7c (stale) Mirror 8: 0xa7449f7c (stale) Mirror 11: 0xa7449f7c (stale) Mirror 12: 0xa7449f7c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16021: skipped 000584 1783966238.021859 write 0x014f57 thru 0x022859 (0xd903 bytes) 000586 1783966238.039940 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2285a): Mirror 2: 0xb4ecaeec (stale) Mirror 4: 0xb4ecaeec (stale) Mirror 6: 0xb4ecaeec (stale) Mirror 8: 0xb4ecaeec (stale) Mirror 11: 0xb4ecaeec (stale) Mirror 12: 0xb4ecaeec (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2285a): Mirror 2: 0xb4ecaeec (stale) Mirror 4: 0xb4ecaeec (stale) Mirror 6: 0xb4ecaeec (stale) Mirror 8: 0xb4ecaeec (stale) Mirror 11: 0xb4ecaeec (stale) Mirror 12: 0xb4ecaeec (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2285a: skipped 000587 1783966238.520444 mapread 0x021634 thru 0x022859 (0x1226 bytes) 000588 1783966238.539987 MIRROR_RESYNC 7 mirrors 000589 1783966239.951026 mapwrite 0x03c9a7 thru 0x03ffff (0x3659 bytes) 000590 1783966240.134409 mapread 0x017203 thru 0x021aaf (0xa8ad bytes) 000593 1783966240.171404 mapread 0x02affe thru 0x02ba3a (0xa3d bytes) 000596 1783966240.185415 write 0x014ffe thru 0x015bc1 (0xbc4 bytes) 000599 1783966240.200269 MIRROR_RESYNC 7 mirrors 000600 1783966241.679375 MIRROR_EXTEND to 8 mirrors 000601 1783966242.926758 mapread 0x025edd thru 0x02b70f (0x5833 bytes) 000602 1783966242.983832 MIRROR_RESYNC 8 mirrors 000603 1783966243.728964 MIRROR_EXTEND to 9 mirrors 000608 1783966245.160120 mapwrite 0x01e7db thru 0x022ff3 (0x4819 bytes) 000609 1783966245.469769 mapwrite 0x017466 thru 0x01899c (0x1537 bytes) 000610 1783966245.560259 mapread 0x019833 thru 0x022a32 (0x9200 bytes) 000611 1783966245.561715 mapwrite 0x01e503 thru 0x0280ed (0x9beb bytes) 000613 1783966245.651556 trunc from 0x040000 to 0x001cdd (0x3e322 bytes) 000616 1783966245.680740 read 0x001c13 thru 0x001cdd (0xcb bytes) 000617 1783966245.688706 write 0x01dd17 thru 0x028cb8 (0xafa2 bytes) 000619 1783966245.692920 write 0x022b21 thru 0x025d70 (0x3250 bytes) 000620 1783966245.694550 read 0x0231eb thru 0x028cb8 (0x5ace bytes) 000624 1783966245.698316 write 0x01aadb thru 0x02a374 (0xf89a bytes) 000625 1783966245.727284 trunc from 0x02a375 to 0x0226c8 (0x7cac bytes) 000626 1783966245.761307 write 0x00aab5 thru 0x019608 (0xeb54 bytes) 000627 1783966245.767693 mapread 0x011444 thru 0x01782b (0x63e8 bytes) 000629 1783966245.779234 mapwrite 0x00740a thru 0x014b6d (0xd764 bytes) 000630 1783966245.992213 mapwrite 0x019e71 thru 0x027dbb (0xdf4b bytes) 000633 1783966246.182705 read 0x01df00 thru 0x025e34 (0x7f35 bytes) 000634 1783966246.183916 mapwrite 0x0399b1 thru 0x03ffff (0x664f bytes) 000635 1783966246.376198 read 0x0389fb thru 0x03ffff (0x7605 bytes) 000636 1783966246.388139 read 0x005a0c thru 0x00e7f8 (0x8ded bytes) 000639 1783966246.390646 write 0x01fa4b thru 0x027307 (0x78bd bytes) 000641 1783966246.399563 read 0x0188c2 thru 0x01b56f (0x2cae bytes) 000642 1783966246.407718 MIRROR_RESYNC 9 mirrors 000643 1783966248.119060 write 0x0027bf thru 0x006adf (0x4321 bytes) 000644 1783966248.233007 write 0x00181e thru 0x008331 (0x6b14 bytes) 000645 1783966248.256034 mapread 0x03d5ce thru 0x03ffff (0x2a32 bytes) 000648 1783966248.288912 write 0x02ee57 thru 0x0385a6 (0x9750 bytes) 000650 1783966248.301298 read 0x037545 thru 0x03c854 (0x5310 bytes) 000653 1783966248.327712 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x78f84435 (stale) Mirror 4: 0x78f84435 (stale) Mirror 6: 0x78f84435 (stale) Mirror 8: 0x78f84435 (stale) Mirror 11: 0x78f84435 (stale) Mirror 12: 0x78f84435 (stale) Mirror 13: 0x78f84435 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x78f84435 (stale) Mirror 4: 0x78f84435 (stale) Mirror 6: 0x78f84435 (stale) Mirror 8: 0x78f84435 (stale) Mirror 11: 0x78f84435 (stale) Mirror 12: 0x78f84435 (stale) Mirror 13: 0x78f84435 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000654 1783966249.395393 mapread 0x006279 thru 0x00bfb9 (0x5d41 bytes) 000655 1783966249.433695 trunc from 0x040000 to 0x023b72 (0x1c48d bytes) 000656 1783966249.482215 write 0x026d2c thru 0x0291b0 (0x2485 bytes) 000657 1783966249.499379 mapread 0x01d081 thru 0x02555b (0x84db bytes) 000659 1783966249.522159 write 0x006bbf thru 0x013ff5 (0xd437 bytes) 000660 1783966249.534460 write 0x000671 thru 0x002222 (0x1bb2 bytes) 000661 1783966249.553320 mapread 0x0104ce thru 0x0166a0 (0x61d3 bytes) 000664 1783966249.571107 trunc from 0x0291b1 to 0x030e81 (0x7cd1 bytes) 000665 1783966249.600092 trunc from 0x030e82 to 0x01c880 (0x14601 bytes) 000666 1783966249.672063 write 0x008a96 thru 0x00ec03 (0x616e bytes) 000672 1783966249.689588 write 0x01557d thru 0x01e8a8 (0x932c bytes) 000677 1783966249.694185 read 0x01429c thru 0x01e639 (0xa39e bytes) 000678 1783966249.695088 write 0x00d916 thru 0x01b1a8 (0xd893 bytes) 000680 1783966249.697782 write 0x02ecce thru 0x03bb5b (0xce8e bytes) 000681 1783966249.700016 read 0x03579a thru 0x03bb5b (0x63c2 bytes) 000682 1783966249.701247 mapread 0x01a7d1 thru 0x025727 (0xaf57 bytes) 000684 1783966249.715234 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3bb5c): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bb5c): Mirror 2: 0x9dc8bd95 (stale) Mirror 4: 0x9dc8bd95 (stale) Mirror 6: 0x9dc8bd95 (stale) Mirror 8: 0x9dc8bd95 (stale) Mirror 11: 0x9dc8bd95 (stale) Mirror 12: 0x9dc8bd95 (stale) Mirror 13: 0x9dc8bd95 (stale) CRC-32 checksum value for chunk [0, 0x3bb5c): Mirror 1: 0x36f9aa1f Mirror 14: 0x36f9aa1f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bb5c: skipped 000685 1783966250.691127 mapread 0x02782a thru 0x0369fd (0xf1d4 bytes) 000686 1783966250.758231 mapwrite 0x030c02 thru 0x03a7c5 (0x9bc4 bytes) 000688 1783966251.051796 read 0x03680a thru 0x03bb5b (0x5352 bytes) 000691 1783966251.056926 mapwrite 0x036aa7 thru 0x03ffff (0x9559 bytes) 000692 1783966251.179705 trunc from 0x040000 to 0x010575 (0x2fa8a bytes) 000694 1783966251.220780 MIRROR_RESYNC 9 mirrors 000696 1783966252.878579 write 0x02b101 thru 0x0352a3 (0xa1a3 bytes) 000698 1783966252.944052 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x352a4): Mirror 2: 0xccb6eac2 (stale) Mirror 4: 0xccb6eac2 (stale) Mirror 6: 0xccb6eac2 (stale) Mirror 8: 0xccb6eac2 (stale) Mirror 11: 0xccb6eac2 (stale) Mirror 12: 0xccb6eac2 (stale) Mirror 13: 0xccb6eac2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x352a4): Mirror 2: 0xccb6eac2 (stale) Mirror 4: 0xccb6eac2 (stale) Mirror 6: 0xccb6eac2 (stale) Mirror 8: 0xccb6eac2 (stale) Mirror 11: 0xccb6eac2 (stale) Mirror 12: 0xccb6eac2 (stale) Mirror 13: 0xccb6eac2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x352a4: skipped 000700 1783966253.481672 mapread 0x0160b6 thru 0x01e7f5 (0x8740 bytes) 000701 1783966253.521180 read 0x02920c thru 0x029b21 (0x916 bytes) 000703 1783966253.547745 mapwrite 0x0155a4 thru 0x016817 (0x1274 bytes) 000704 1783966253.654343 trunc from 0x0352a4 to 0x0144fb (0x20da8 bytes) 000705 1783966253.689417 write 0x02a96c thru 0x02f330 (0x49c5 bytes) 000706 1783966253.693810 mapwrite 0x02006a thru 0x029f51 (0x9ee8 bytes) 000708 1783966253.887259 write 0x0037b9 thru 0x0039d0 (0x218 bytes) 000709 1783966253.929819 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2f331): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f331): Mirror 2: 0x52fa9314 (stale) Mirror 4: 0x52fa9314 (stale) Mirror 6: 0x52fa9314 (stale) Mirror 8: 0x52fa9314 (stale) Mirror 11: 0x52fa9314 (stale) Mirror 12: 0x52fa9314 (stale) Mirror 13: 0x52fa9314 (stale) CRC-32 checksum value for chunk [0, 0x2f331): Mirror 1: 0x738de9b Mirror 14: 0x738de9b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f331: skipped 000710 1783966255.981994 write 0x01604a thru 0x020f76 (0xaf2d bytes) 000711 1783966256.174024 mapread 0x0062d2 thru 0x015b7c (0xf8ab bytes) 000712 1783966256.222811 mapread 0x0127bf thru 0x01eb65 (0xc3a7 bytes) 000715 1783966256.232984 mapwrite 0x031bc6 thru 0x03f26d (0xd6a8 bytes) 000716 1783966256.390826 read 0x01c973 thru 0x022985 (0x6013 bytes) 000718 1783966256.400077 mapread 0x01687f thru 0x0250af (0xe831 bytes) 000721 1783966256.411533 mapwrite 0x02289f thru 0x02bdb7 (0x9519 bytes) 000724 1783966256.477439 write 0x03775d thru 0x03daa1 (0x6345 bytes) 000725 1783966256.484167 write 0x01b21b thru 0x01bfe6 (0xdcc bytes) 000726 1783966256.490918 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f26e): Mirror 2: 0x7ee3103e (stale) Mirror 4: 0x7ee3103e (stale) Mirror 6: 0x7ee3103e (stale) Mirror 11: 0x7ee3103e (stale) Mirror 12: 0x7ee3103e (stale) Mirror 13: 0x7ee3103e (stale) Mirror 14: 0xdf0cd5bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f26e): Mirror 2: 0x7ee3103e (stale) Mirror 4: 0x7ee3103e (stale) Mirror 6: 0x7ee3103e (stale) Mirror 11: 0x7ee3103e (stale) Mirror 12: 0x7ee3103e (stale) Mirror 13: 0x7ee3103e (stale) Mirror 14: 0xdf0cd5bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f26e: skipped 000727 1783966257.200263 mapwrite 0x024b4a thru 0x02f48d (0xa944 bytes) 000728 1783966257.318918 read 0x00a7e3 thru 0x011f69 (0x7787 bytes) 000729 1783966257.332713 mapwrite 0x02e18e thru 0x038677 (0xa4ea bytes) 000730 1783966257.494195 read 0x02f5a1 thru 0x03e693 (0xf0f3 bytes) 000731 1783966257.507209 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f26e): Mirror 2: 0x7ee3103e (stale) Mirror 4: 0x7ee3103e (stale) Mirror 6: 0x7ee3103e (stale) Mirror 11: 0x7ee3103e (stale) Mirror 13: 0x7ee3103e (stale) Mirror 14: 0xdf0cd5bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f26e): Mirror 2: 0x7ee3103e (stale) Mirror 4: 0x7ee3103e (stale) Mirror 6: 0x7ee3103e (stale) Mirror 11: 0x7ee3103e (stale) Mirror 13: 0x7ee3103e (stale) Mirror 14: 0xdf0cd5bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f26e: skipped 000733 1783966258.350325 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f26e): Mirror 2: 0x7ee3103e (stale) Mirror 4: 0x7ee3103e (stale) Mirror 6: 0x7ee3103e (stale) Mirror 11: 0x7ee3103e (stale) Mirror 14: 0xdf0cd5bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f26e): Mirror 2: 0x7ee3103e (stale) Mirror 4: 0x7ee3103e (stale) Mirror 6: 0x7ee3103e (stale) Mirror 11: 0x7ee3103e (stale) Mirror 14: 0xdf0cd5bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f26e: skipped 000735 1783966258.917882 write 0x015a90 thru 0x0237e1 (0xdd52 bytes) 000736 1783966258.934264 write 0x01f369 thru 0x023479 (0x4111 bytes) 000737 1783966258.941310 trunc from 0x03f26e to 0x02dca5 (0x115c8 bytes) 000738 1783966258.978314 read 0x01e8dd thru 0x02dca5 (0xf3c9 bytes) 000740 1783966258.993860 trunc from 0x02dca6 to 0x01a842 (0x13463 bytes) 000741 1783966259.038089 MIRROR_RESYNC 6 mirrors 000742 1783966261.383835 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) 000743 1783966262.263653 mapread 0x01382b thru 0x01a842 (0x7018 bytes) 000744 1783966262.349889 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) 000745 1783966262.961657 mapwrite 0x00d431 thru 0x01cc70 (0xf840 bytes) 000746 1783966263.158163 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1cc71): Mirror 11: 0x4e7f0741 (stale) Mirror 14: 0x4e7f0741 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cc71): Mirror 11: 0x4e7f0741 (stale) Mirror 14: 0x4e7f0741 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cc71: skipped 000748 1783966263.493677 mapread 0x010add thru 0x019186 (0x86aa bytes) 000751 1783966263.527637 read 0x011f05 thru 0x01cc70 (0xad6c bytes) 000752 1783966263.534653 mapread 0x01a04a thru 0x01cc70 (0x2c27 bytes) 000753 1783966263.535946 read 0x013699 thru 0x01734d (0x3cb5 bytes) 000755 1783966263.543126 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1cc71): Mirror 11: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cc71): Mirror 11: 0x4e7f0741 (stale) Mirror 14: 0x4e7f0741 (stale) CRC-32 checksum value for chunk [0, 0x1cc71): Mirror 1: 0xa8e1c6cf Mirror 15: 0xa8e1c6cf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cc71: skipped 000756 1783966264.520421 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1cc71): Mirror 14: 0x4e7f0741 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cc71): Mirror 14: 0x4e7f0741 (stale) CRC-32 checksum value for chunk [0, 0x1cc71): Mirror 1: 0xa8e1c6cf Mirror 15: 0xa8e1c6cf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cc71: skipped 000758 1783966265.093448 mapwrite 0x03c677 thru 0x03ffff (0x3989 bytes) 000760 1783966265.498860 mapread 0x03bb66 thru 0x03ffff (0x449a bytes) 000761 1783966265.500036 write 0x01cf2f thru 0x01d613 (0x6e5 bytes) 000762 1783966265.521815 write 0x03f62b thru 0x03ffff (0x9d5 bytes) 000763 1783966265.522930 mapread 0x00300c thru 0x00ba38 (0x8a2d bytes) 000765 1783966265.540810 write 0x0036e2 thru 0x007cfc (0x461b bytes) 000766 1783966265.542184 mapwrite 0x002742 thru 0x008f7d (0x683c bytes) 000767 1783966265.644717 mapread 0x00115f thru 0x00e586 (0xd428 bytes) 000770 1783966265.670571 MIRROR_RESYNC 3 mirrors 000775 1783966266.817124 mapwrite 0x002200 thru 0x0090b4 (0x6eb5 bytes) 000776 1783966266.952056 mapwrite 0x03500b thru 0x03ffff (0xaff5 bytes) 000777 1783966267.009845 read 0x037b29 thru 0x03c2c7 (0x479f bytes) 000780 1783966267.014205 mapread 0x00e8ef thru 0x01e6a5 (0xfdb7 bytes) 000781 1783966267.028766 read 0x00c0c8 thru 0x0100bb (0x3ff4 bytes) 000782 1783966267.029453 read 0x01465c thru 0x01811d (0x3ac2 bytes) 000783 1783966267.030108 write 0x023562 thru 0x025629 (0x20c8 bytes) 000785 1783966267.040190 mapread 0x00d84a thru 0x01b988 (0xe13f bytes) 000787 1783966267.047052 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x40d2bc34 (stale) Mirror 15: 0x40d2bc34 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x15f62508 Mirror 16: 0x15f62508 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000788 1783966268.261613 read 0x0182ee thru 0x025b44 (0xd857 bytes) 000791 1783966268.330651 trunc from 0x040000 to 0x00b53b (0x34ac4 bytes) 000794 1783966268.546417 read 0x00598e thru 0x00636e (0x9e1 bytes) 000795 1783966268.583935 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xb53c): Mirror 15: 0xc9c9cdd3 (stale) Mirror 16: 0x15684d3c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb53c): Mirror 15: 0xc9c9cdd3 (stale) Mirror 16: 0x15684d3c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb53c: skipped 000796 1783966269.343558 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xb53c): Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb53c): Mirror 15: 0xc9c9cdd3 (stale) Mirror 16: 0x15684d3c (stale) CRC-32 checksum value for chunk [0, 0xb53c): Mirror 1: 0x15684d3c Mirror 17: 0x15684d3c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb53c: skipped 000797 1783966271.270402 mapread 0x003ce6 thru 0x00b53b (0x7856 bytes) 000798 1783966271.345741 read 0x004b4a thru 0x006e25 (0x22dc bytes) 000801 1783966271.405729 trunc from 0x00b53c to 0x02168f (0x16154 bytes) 000802 1783966271.565716 mapwrite 0x01e1e9 thru 0x02db1d (0xf935 bytes) 000803 1783966271.707661 read 0x01d48f thru 0x02c249 (0xedbb bytes) 000804 1783966271.708660 read 0x002fee thru 0x003ee7 (0xefa bytes) 000805 1783966271.737367 write 0x01d88f thru 0x0286fb (0xae6d bytes) 000806 1783966271.739178 mapwrite 0x017a98 thru 0x020812 (0x8d7b bytes) 000809 1783966271.906574 trunc from 0x02db1e to 0x03dc40 (0x10123 bytes) 000810 1783966271.968851 write 0x00e180 thru 0x01ab10 (0xc991 bytes) 000811 1783966271.978406 mapread 0x0238f7 thru 0x02621e (0x2928 bytes) 000812 1783966271.980319 trunc from 0x03dc41 to 0x019649 (0x245f7 bytes) 000813 1783966272.025741 trunc from 0x01964a to 0x02f1a6 (0x15b5d bytes) 000814 1783966272.075105 trunc from 0x02f1a7 to 0x0232d5 (0xbed1 bytes) 000815 1783966272.142509 mapread 0x00f19b thru 0x016129 (0x6f8f bytes) 000816 1783966272.148617 trunc from 0x0232d6 to 0x003c19 (0x1f6bc bytes) 000817 1783966272.210947 read 0x000675 thru 0x003c19 (0x35a5 bytes) truncating to largest ever: 0x3e8bc 000818 1783966272.218200 trunc from 0x003c1a to 0x03e8bb (0x3aca2 bytes) 000819 1783966272.296132 MIRROR_RESYNC 4 mirrors 000820 1783966274.250212 mapwrite 0x00b76b thru 0x00e779 (0x300f bytes) 000822 1783966274.524071 read 0x0339ea thru 0x03e8bb (0xaed2 bytes) 000823 1783966274.534337 read 0x038444 thru 0x03e8bb (0x6478 bytes) 000825 1783966274.535431 mapwrite 0x037c88 thru 0x03ffff (0x8378 bytes) 000828 1783966274.633000 mapread 0x018283 thru 0x019e75 (0x1bf3 bytes) 000829 1783966274.634440 mapread 0x00ec6e thru 0x01e707 (0xfa9a bytes) 000831 1783966274.636313 read 0x0379cd thru 0x03ffff (0x8633 bytes) 000832 1783966274.637377 write 0x024c3c thru 0x027ee3 (0x32a8 bytes) 000833 1783966274.639413 read 0x03a247 thru 0x03a602 (0x3bc bytes) 000834 1783966274.640391 mapread 0x023c71 thru 0x025f23 (0x22b3 bytes) 000836 1783966274.642767 trunc from 0x040000 to 0x01ecf6 (0x21309 bytes) 000837 1783966274.676759 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1ecf7): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ecf7): Mirror 15: 0xe4c7cfd3 (stale) Mirror 16: 0xe4c7cfd3 (stale) Mirror 17: 0xe4c7cfd3 (stale) CRC-32 checksum value for chunk [0, 0x1ecf7): Mirror 1: 0x3074e361 Mirror 18: 0x3074e361 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ecf7: skipped 000839 1783966276.182971 mapread 0x004c6b thru 0x006540 (0x18d6 bytes) 000840 1783966276.293786 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1ecf7): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ecf7): Mirror 15: 0xe4c7cfd3 (stale) Mirror 16: 0xe4c7cfd3 (stale) Mirror 17: 0xe4c7cfd3 (stale) CRC-32 checksum value for chunk [0, 0x1ecf7): Mirror 1: 0x3074e361 Mirror 18: 0x3074e361 Mirror 19: 0x3074e361 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ecf7: skipped 000841 1783966278.350945 write 0x02537e thru 0x0333df (0xe062 bytes) 000842 1783966278.580956 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x333e0): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x333e0): Mirror 15: 0x87598254 (stale) Mirror 16: 0x87598254 (stale) Mirror 17: 0x87598254 (stale) Mirror 18: 0x2ba7e653 (stale) Mirror 19: 0x2ba7e653 (stale) CRC-32 checksum value for chunk [0, 0x333e0): Mirror 1: 0x926d869b Mirror 20: 0x926d869b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x333e0: skipped 000844 1783966280.430182 mapread 0x01dbd9 thru 0x024f62 (0x738a bytes) 000847 1783966280.516025 trunc from 0x0333e0 to 0x020a94 (0x1294b bytes) 000848 1783966280.674675 trunc from 0x020a95 to 0x0384c2 (0x17a2e bytes) 000849 1783966280.727811 mapread 0x017feb thru 0x01cb20 (0x4b36 bytes) 000851 1783966280.752900 write 0x02fc1b thru 0x03294b (0x2d31 bytes) 000852 1783966280.790848 mapread 0x015ba0 thru 0x01ebd3 (0x9034 bytes) 000858 1783966280.799949 mapread 0x027049 thru 0x033519 (0xc4d1 bytes) 000859 1783966280.861598 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x384c3): Mirror 15: 0xa6b00857 (stale) Mirror 16: 0xa6b00857 (stale) Mirror 17: 0xa6b00857 (stale) Mirror 18: 0x32642213 (stale) Mirror 20: 0xe14aa6cf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x384c3): Mirror 15: 0xa6b00857 (stale) Mirror 16: 0xa6b00857 (stale) Mirror 17: 0xa6b00857 (stale) Mirror 18: 0x32642213 (stale) Mirror 20: 0xe14aa6cf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x384c3: skipped 000860 1783966281.624713 trunc from 0x0384c3 to 0x016519 (0x21fa9 bytes) 000861 1783966281.675217 mapread 0x00788d thru 0x00bfd7 (0x474b bytes) 000862 1783966281.717393 MIRROR_RESYNC 6 mirrors 000863 1783966283.429095 trunc from 0x01651a to 0x014241 (0x22d8 bytes) 000864 1783966283.504429 MIRROR_RESYNC 6 mirrors 000865 1783966285.549198 mapread 0x009356 thru 0x014241 (0xaeec bytes) 000866 1783966285.614572 mapread 0x00412d thru 0x00fe43 (0xbd17 bytes) 000870 1783966285.621212 mapread 0x00ac5d thru 0x014241 (0x95e5 bytes) 000871 1783966285.627040 MIRROR_RESYNC 6 mirrors 000874 1783966286.185896 mapread 0x00dacd thru 0x014241 (0x6775 bytes) 000875 1783966286.188060 write 0x001ec9 thru 0x00bfe4 (0xa11c bytes) 000877 1783966286.418378 MIRROR_RESYNC 6 mirrors 000878 1783966288.295347 write 0x00f9ee thru 0x0165ca (0x6bdd bytes) 000879 1783966288.472309 mapwrite 0x0107ed thru 0x011470 (0xc84 bytes) 000881 1783966288.565458 mapwrite 0x0317e2 thru 0x034ee6 (0x3705 bytes) 000882 1783966288.707286 mapread 0x0293fb thru 0x034ee6 (0xbaec bytes) 000883 1783966288.724180 write 0x01e800 thru 0x0293ab (0xabac bytes) 000884 1783966288.732204 write 0x031528 thru 0x03a47f (0x8f58 bytes) 000885 1783966288.745286 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3a480): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a480): Mirror 15: 0xe4ec6a1c (stale) Mirror 16: 0xe4ec6a1c (stale) Mirror 17: 0xe4ec6a1c (stale) Mirror 18: 0xe4ec6a1c (stale) Mirror 20: 0xe4ec6a1c (stale) CRC-32 checksum value for chunk [0, 0x3a480): Mirror 1: 0xb266b6b6 Mirror 21: 0xb266b6b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a480: skipped 000886 1783966290.265605 mapread 0x014274 thru 0x023689 (0xf416 bytes) 000887 1783966290.355940 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3a480): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a480): Mirror 15: 0xe4ec6a1c (stale) Mirror 16: 0xe4ec6a1c (stale) Mirror 17: 0xe4ec6a1c (stale) Mirror 18: 0xe4ec6a1c (stale) Mirror 20: 0xe4ec6a1c (stale) CRC-32 checksum value for chunk [0, 0x3a480): Mirror 1: 0xb266b6b6 Mirror 21: 0xb266b6b6 Mirror 22: 0xb266b6b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a480: skipped 000888 1783966291.171239 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3a480): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a480): Mirror 15: 0xe4ec6a1c (stale) Mirror 16: 0xe4ec6a1c (stale) Mirror 17: 0xe4ec6a1c (stale) Mirror 18: 0xe4ec6a1c (stale) Mirror 20: 0xe4ec6a1c (stale) CRC-32 checksum value for chunk [0, 0x3a480): Mirror 1: 0xb266b6b6 Mirror 21: 0xb266b6b6 Mirror 22: 0xb266b6b6 Mirror 23: 0xb266b6b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a480: skipped 000889 1783966292.965659 read 0x017ac4 thru 0x01844d (0x98a bytes) 000893 1783966292.974992 write 0x0118f7 thru 0x02146e (0xfb78 bytes) 000894 1783966293.172009 write 0x014c9d thru 0x02037b (0xb6df bytes) 000897 1783966293.177436 trunc from 0x03a480 to 0x03b3cd (0xf4e bytes) 000898 1783966293.211300 mapwrite 0x038f80 thru 0x03f80c (0x688d bytes) 000899 1783966293.353136 write 0x00fac5 thru 0x01693e (0x6e7a bytes) 000901 1783966293.362156 read 0x035db9 thru 0x03eac5 (0x8d0d bytes) 000902 1783966293.363678 mapread 0x03648d thru 0x03f80c (0x9380 bytes) 000904 1783966293.368444 mapwrite 0x00ac29 thru 0x016d9e (0xc176 bytes) 000905 1783966293.478770 read 0x01f18a thru 0x01f63d (0x4b4 bytes) 000909 1783966293.480711 read 0x03490f thru 0x03b54a (0x6c3c bytes) 000911 1783966293.496382 MIRROR_RESYNC 9 mirrors 000913 1783966295.354958 mapread 0x010cb2 thru 0x020968 (0xfcb7 bytes) 000914 1783966295.405872 mapread 0x034f97 thru 0x03879f (0x3809 bytes) 000915 1783966295.425291 mapwrite 0x029e9c thru 0x03090b (0x6a70 bytes) 000916 1783966295.742933 mapwrite 0x023ad1 thru 0x0337fe (0xfd2e bytes) 000917 1783966295.912805 trunc from 0x03f80d to 0x03928c (0x6580 bytes) 000918 1783966295.968889 mapread 0x00a5b9 thru 0x00e086 (0x3ace bytes) 000919 1783966296.001388 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3928d): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3928d): Mirror 15: 0xd9e27cb5 (stale) Mirror 16: 0xd9e27cb5 (stale) Mirror 17: 0xd9e27cb5 (stale) Mirror 18: 0xd9e27cb5 (stale) Mirror 20: 0xd9e27cb5 (stale) Mirror 21: 0xd9e27cb5 (stale) Mirror 22: 0xd9e27cb5 (stale) Mirror 23: 0xd9e27cb5 (stale) CRC-32 checksum value for chunk [0, 0x3928d): Mirror 1: 0x7971f08b Mirror 24: 0x7971f08b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3928d: skipped 000920 1783966298.150366 read 0x0198ef thru 0x0263fa (0xcb0c bytes) 000921 1783966298.215999 MIRROR_RESYNC 10 mirrors 000922 1783966300.518001 MIRROR_EXTEND to 11 mirrors 000924 1783966302.049147 mapread 0x019296 thru 0x01c8a0 (0x360b bytes) 000926 1783966302.097782 read 0x009b36 thru 0x014514 (0xa9df bytes) 000929 1783966302.118248 trunc from 0x03928d to 0x031ef1 (0x739b bytes) 000930 1783966302.292565 write 0x021009 thru 0x0286e1 (0x76d9 bytes) 000931 1783966302.319144 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31ef2): Mirror 16: 0xfaf4f5be (stale) Mirror 17: 0xfaf4f5be (stale) Mirror 18: 0xfaf4f5be (stale) Mirror 20: 0xfaf4f5be (stale) Mirror 21: 0xfaf4f5be (stale) Mirror 22: 0xfaf4f5be (stale) Mirror 23: 0xfaf4f5be (stale) Mirror 24: 0xfaf4f5be (stale) Mirror 25: 0xfaf4f5be (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31ef2): Mirror 16: 0xfaf4f5be (stale) Mirror 17: 0xfaf4f5be (stale) Mirror 18: 0xfaf4f5be (stale) Mirror 20: 0xfaf4f5be (stale) Mirror 21: 0xfaf4f5be (stale) Mirror 22: 0xfaf4f5be (stale) Mirror 23: 0xfaf4f5be (stale) Mirror 24: 0xfaf4f5be (stale) Mirror 25: 0xfaf4f5be (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31ef2: skipped 000932 1783966303.536988 read 0x02409f thru 0x031ef1 (0xde53 bytes) 000933 1783966303.557148 mapwrite 0x02c27e thru 0x02c5fb (0x37e bytes) 000938 1783966303.634267 trunc from 0x031ef2 to 0x000474 (0x31a7d bytes) 000939 1783966303.660527 write 0x02c9c9 thru 0x03054a (0x3b82 bytes) 000940 1783966303.664289 read 0x02028c thru 0x0266c7 (0x643c bytes) 000941 1783966303.678265 read 0x020c43 thru 0x02a585 (0x9943 bytes) 000946 1783966303.686351 mapwrite 0x006ba7 thru 0x00c93f (0x5d99 bytes) 000948 1783966303.846951 write 0x039c45 thru 0x03f2ce (0x568a bytes) 000949 1783966303.863244 read 0x011716 thru 0x012ef5 (0x17e0 bytes) 000950 1783966303.882439 trunc from 0x03f2cf to 0x01ffe9 (0x1f2e5 bytes) 000953 1783966303.936356 mapwrite 0x03fad3 thru 0x03ffff (0x52d bytes) 000954 1783966304.087202 write 0x03c4dc thru 0x03e34b (0x1e70 bytes) 000955 1783966304.096957 mapwrite 0x01bd0d thru 0x0279a0 (0xbc94 bytes) 000957 1783966304.239233 read 0x0212d2 thru 0x02f6a4 (0xe3d3 bytes) 000958 1783966304.252863 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0xf4531c05 (stale) Mirror 18: 0xf4531c05 (stale) Mirror 20: 0xf4531c05 (stale) Mirror 21: 0xf4531c05 (stale) Mirror 22: 0xf4531c05 (stale) Mirror 23: 0xf4531c05 (stale) Mirror 24: 0xf4531c05 (stale) Mirror 25: 0xf4531c05 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0xf4531c05 (stale) Mirror 18: 0xf4531c05 (stale) Mirror 20: 0xf4531c05 (stale) Mirror 21: 0xf4531c05 (stale) Mirror 22: 0xf4531c05 (stale) Mirror 23: 0xf4531c05 (stale) Mirror 24: 0xf4531c05 (stale) Mirror 25: 0xf4531c05 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000959 1783966305.267872 mapread 0x007eb5 thru 0x008123 (0x26f bytes) 000960 1783966305.283964 mapread 0x039325 thru 0x03c62d (0x3309 bytes) 000961 1783966305.300459 mapwrite 0x0176b3 thru 0x018f82 (0x18d0 bytes) 000963 1783966305.381584 read 0x01bd4b thru 0x02b0bd (0xf373 bytes) 000965 1783966305.413023 write 0x01573a thru 0x024992 (0xf259 bytes) 000966 1783966305.418755 mapwrite 0x033783 thru 0x03cf63 (0x97e1 bytes) 000967 1783966305.529854 mapread 0x0397e9 thru 0x03ffff (0x6817 bytes) 000969 1783966305.533099 mapread 0x026511 thru 0x02d883 (0x7373 bytes) 000970 1783966305.543786 read 0x0170ba thru 0x024532 (0xd479 bytes) 000971 1783966305.544893 mapwrite 0x00a4fb thru 0x00a704 (0x20a bytes) 000972 1783966305.622735 read 0x01a262 thru 0x01e93e (0x46dd bytes) 000973 1783966305.625109 write 0x024029 thru 0x0277e2 (0x37ba bytes) 000974 1783966305.629326 write 0x00ea16 thru 0x011c48 (0x3233 bytes) 000975 1783966305.632883 mapwrite 0x01a044 thru 0x01c595 (0x2552 bytes) 000976 1783966305.748744 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0xf4531c05 (stale) Mirror 18: 0xf4531c05 (stale) Mirror 20: 0xf4531c05 (stale) Mirror 21: 0xf4531c05 (stale) Mirror 22: 0xf4531c05 (stale) Mirror 23: 0xf4531c05 (stale) Mirror 24: 0xf4531c05 (stale) Mirror 25: 0xf4531c05 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xac2689e5 Mirror 26: 0xac2689e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000978 1783966307.472292 mapread 0x02e262 thru 0x02f7d2 (0x1571 bytes) 000979 1783966307.524923 mapread 0x031538 thru 0x03c057 (0xab20 bytes) 000981 1783966307.649004 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0xf4531c05 (stale) Mirror 20: 0xf4531c05 (stale) Mirror 21: 0xf4531c05 (stale) Mirror 22: 0xf4531c05 (stale) Mirror 23: 0xf4531c05 (stale) Mirror 24: 0xf4531c05 (stale) Mirror 25: 0xf4531c05 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0xf4531c05 (stale) Mirror 20: 0xf4531c05 (stale) Mirror 21: 0xf4531c05 (stale) Mirror 22: 0xf4531c05 (stale) Mirror 23: 0xf4531c05 (stale) Mirror 24: 0xf4531c05 (stale) Mirror 25: 0xf4531c05 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xac2689e5 Mirror 26: 0xac2689e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000982 1783966309.178762 write 0x037308 thru 0x03b74b (0x4444 bytes) 000987 1783966309.399904 trunc from 0x040000 to 0x01bc28 (0x243d7 bytes) 000988 1783966309.440951 write 0x003d01 thru 0x013939 (0xfc39 bytes) 000989 1783966309.463668 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1bc29): Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bc29): Mirror 17: 0xfdcb4eda (stale) Mirror 20: 0xfdcb4eda (stale) Mirror 21: 0xfdcb4eda (stale) Mirror 22: 0xfdcb4eda (stale) Mirror 23: 0xfdcb4eda (stale) Mirror 24: 0xfdcb4eda (stale) Mirror 25: 0xfdcb4eda (stale) Mirror 26: 0xb1670e9c (stale) CRC-32 checksum value for chunk [0, 0x1bc29): Mirror 1: 0x6d01e0d8 Mirror 27: 0x6d01e0d8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bc29: skipped 000992 1783966310.699414 write 0x001091 thru 0x003df4 (0x2d64 bytes) 000994 1783966310.878962 MIRROR_RESYNC 10 mirrors 000995 1783966312.708828 trunc from 0x01bc29 to 0x0012a5 (0x1a983 bytes) 000996 1783966312.784585 read 0x000cc0 thru 0x0012a5 (0x5e6 bytes) 000997 1783966312.791858 read 0x000a58 thru 0x0012a5 (0x84e bytes) All operations completed A-OK!