== sanity-flr test 70a: flr mode fsx test ================ 21:31:41 (1788917501) Seed set to 7502 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x6cf5 000002 1788917502.379561 trunc from 00000000 to 0x006cf4 (0x6cf5 bytes) truncating to largest ever: 0x3d97b 000007 1788917502.387934 trunc from 0x006cf5 to 0x03d97a (0x36c86 bytes) 000008 1788917502.394781 mapread 0x00da15 thru 0x01bce9 (0xe2d5 bytes) 000010 1788917502.409776 trunc from 0x03d97b to 0x00bfde (0x3199c bytes) 000011 1788917502.417488 trunc from 0x00bfdf to 0x00a3f3 (0x1beb bytes) 000013 1788917502.425030 mapread 0x003514 thru 0x006ac7 (0x35b4 bytes) 000015 1788917502.432133 trunc from 0x00a3f4 to 0x00c0e0 (0x1ced bytes) 000017 1788917502.443355 write 0x027c7a thru 0x028a28 (0xdaf bytes) 000021 1788917502.446646 mapread 0x018c23 thru 0x0198af (0xc8d bytes) 000024 1788917502.455417 mapread 0x0063bf thru 0x00da34 (0x7676 bytes) 000025 1788917502.459692 trunc from 0x028a29 to 0x0237ed (0x523b bytes) 000027 1788917502.468888 write 0x02768e thru 0x02c2b5 (0x4c28 bytes) 000028 1788917502.469921 write 0x00a7e5 thru 0x00da3c (0x3258 bytes) 000029 1788917502.476757 read 0x0085e8 thru 0x00db45 (0x555e bytes) 000030 1788917502.477365 write 0x0395fa thru 0x03ffff (0x6a06 bytes) 000031 1788917502.478579 trunc from 0x040000 to 0x012f09 (0x2d0f6 bytes) 000033 1788917502.489303 write 0x0236b2 thru 0x0278a6 (0x41f5 bytes) 000039 1788917502.493323 mapread 0x01d296 thru 0x01d54f (0x2ba bytes) 000041 1788917502.498805 read 0x01e8ad thru 0x020660 (0x1db4 bytes) 000042 1788917502.499431 read 0x022e5e thru 0x025474 (0x2617 bytes) 000044 1788917502.500428 mapread 0x0169ee thru 0x017c27 (0x123a bytes) 000045 1788917502.501188 trunc from 0x0278a7 to 0x01e890 (0x9016 bytes) 000047 1788917502.510420 trunc from 0x01e891 to 0x0047ad (0x1a0e3 bytes) 000049 1788917502.517483 write 0x03801c thru 0x03ffff (0x7fe4 bytes) 000051 1788917502.520785 MIRROR_EXTEND to 2 mirrors 000052 1788917502.831119 mapread 0x027c0b thru 0x02e45b (0x6851 bytes) 000054 1788917502.845031 write 0x008407 thru 0x00e73b (0x6335 bytes) 000056 1788917502.870132 trunc from 0x040000 to 0x0137ce (0x2c831 bytes) 000057 1788917502.884054 mapread 0x012462 thru 0x0137ce (0x136d bytes) 000058 1788917502.888301 write 0x0324c3 thru 0x03ffff (0xdb3d bytes) 000059 1788917502.889509 trunc from 0x040000 to 0x01eec0 (0x2113f bytes) 000060 1788917502.896268 mapread 0x00ff34 thru 0x010807 (0x8d4 bytes) 000061 1788917502.896957 read 0x01db06 thru 0x01eec0 (0x13bb bytes) 000062 1788917502.899379 mapread 0x00d3e5 thru 0x0191b7 (0xbdd3 bytes) 000063 1788917502.902996 mapwrite 0x00e2d0 thru 0x00f073 (0xda4 bytes) 000064 1788917502.920730 trunc from 0x01eec1 to 0x00bcda (0x131e6 bytes) 000065 1788917502.928105 mapread 0x00b5ae thru 0x00bcda (0x72d bytes) 000067 1788917502.932452 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) 000070 1788917503.011890 MIRROR_EXTEND to 2 mirrors 000071 1788917503.315442 write 0x0053cd thru 0x00894b (0x357f bytes) 000073 1788917503.350091 write 0x03ccf9 thru 0x03ffff (0x3307 bytes) 000075 1788917503.351791 mapwrite 0x000b9e thru 0x003c85 (0x30e8 bytes) 000076 1788917503.387071 mapread 0x013896 thru 0x01b93e (0x80a9 bytes) 000077 1788917503.394516 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x77c2625 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd719d373 Mirror 3: 0xd719d373 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000078 1788917503.725998 read 0x03858e thru 0x03d183 (0x4bf6 bytes) 000079 1788917503.733243 trunc from 0x040000 to 0x0170db (0x28f24 bytes) 000083 1788917503.778399 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x170dc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x170dc): Mirror 2: 0x33e630d4 (stale) Mirror 3: 0x6a35141c (stale) CRC-32 checksum value for chunk [0, 0x170dc): Mirror 1: 0x6a35141c Mirror 4: 0x6a35141c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x170dc: skipped 000085 1788917504.156675 MIRROR_RESYNC 4 mirrors 000086 1788917504.489205 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) 000088 1788917504.637768 write 0x0248c0 thru 0x024b20 (0x261 bytes) 000089 1788917504.668638 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24b21): Mirror 3: 0x408996fd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24b21): Mirror 3: 0x408996fd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24b21: skipped 000090 1788917504.810542 write 0x011b31 thru 0x014662 (0x2b32 bytes) 000092 1788917504.815699 read 0x01874c thru 0x018e28 (0x6dd bytes) 000094 1788917504.822804 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) 000097 1788917504.896041 mapwrite 0x01c4dc thru 0x027d8d (0xb8b2 bytes) 000101 1788917504.955415 mapread 0x0191ee thru 0x01f151 (0x5f64 bytes) 000103 1788917504.956937 mapread 0x012967 thru 0x0218cb (0xef65 bytes) 000105 1788917504.962758 trunc from 0x027d8e to 0x0158d9 (0x124b4 bytes) 000106 1788917504.970433 read 0x0030be thru 0x006bbe (0x3b01 bytes) 000109 1788917504.975557 write 0x03e8f9 thru 0x03ffff (0x1707 bytes) 000110 1788917504.976877 trunc from 0x040000 to 0x00023c (0x3fdc3 bytes) 000111 1788917504.982688 mapread 0x0001fc thru 0x00023c (0x41 bytes) 000114 1788917504.985825 mapread 0x0001f9 thru 0x00023c (0x44 bytes) 000117 1788917504.987426 mapread 0x00002d thru 0x00023c (0x210 bytes) 000120 1788917504.988888 write 0x013396 thru 0x02198d (0xe5f8 bytes) 000121 1788917504.990216 mapwrite 0x028550 thru 0x028f63 (0xa14 bytes) 000122 1788917505.015003 read 0x00d879 thru 0x00de52 (0x5da bytes) 000123 1788917505.019923 read 0x026d3a thru 0x028f63 (0x222a bytes) 000128 1788917505.022883 write 0x02f772 thru 0x031e83 (0x2712 bytes) 000129 1788917505.024170 mapwrite 0x03890c thru 0x03ffff (0x76f4 bytes) 000130 1788917505.066624 mapwrite 0x00a153 thru 0x012493 (0x8341 bytes) 000131 1788917505.092402 trunc from 0x040000 to 0x0211a3 (0x1ee5c bytes) 000132 1788917505.100059 mapwrite 0x0359ae thru 0x03ffff (0xa652 bytes) 000135 1788917505.158890 trunc from 0x040000 to 0x01bbbb (0x24444 bytes) 000137 1788917505.169976 read 0x009635 thru 0x017ab1 (0xe47d bytes) 000140 1788917505.171443 trunc from 0x01bbbc to 0x0178d3 (0x42e8 bytes) 000141 1788917505.183043 mapread 0x0027a2 thru 0x005bd7 (0x3436 bytes) 000143 1788917505.184705 write 0x037afb thru 0x03b9ba (0x3ec0 bytes) 000144 1788917505.186106 mapread 0x020077 thru 0x0262cc (0x6256 bytes) 000146 1788917505.191381 trunc from 0x03b9bb to 0x015e6b (0x25b4f bytes) 000147 1788917505.202172 read 0x009d03 thru 0x00f3e1 (0x56df bytes) 000149 1788917505.203333 trunc from 0x015e6c to 0x0223fd (0xc592 bytes) 000150 1788917505.210392 mapread 0x00e1a0 thru 0x016ad9 (0x893a bytes) 000154 1788917505.219699 mapread 0x01477f thru 0x0223fd (0xdc7f bytes) 000155 1788917505.221199 mapread 0x00fe1c thru 0x01aff0 (0xb1d5 bytes) 000158 1788917505.223385 mapwrite 0x01ce51 thru 0x02c9a1 (0xfb51 bytes) 000159 1788917505.270296 trunc from 0x02c9a2 to 0x00def7 (0x1eaaa bytes) 000160 1788917505.280675 mapwrite 0x00d0b5 thru 0x01cac1 (0xfa0d bytes) 000161 1788917505.359886 read 0x017a3c thru 0x019d0f (0x22d4 bytes) 000162 1788917505.360577 mapwrite 0x02f2ca thru 0x038810 (0x9547 bytes) 000163 1788917505.396724 mapwrite 0x019c37 thru 0x025180 (0xb54a bytes) 000164 1788917505.421193 write 0x00071a thru 0x008db5 (0x869c bytes) 000166 1788917505.423003 write 0x001f2a thru 0x00f5b6 (0xd68d bytes) 000168 1788917505.424989 write 0x02e2b5 thru 0x0368fb (0x8647 bytes) 000169 1788917505.426182 write 0x0361e1 thru 0x038f5a (0x2d7a bytes) 000170 1788917505.427275 mapread 0x0167cc thru 0x01fafc (0x9331 bytes) 000172 1788917505.428510 write 0x02c9be thru 0x037df4 (0xb437 bytes) 000175 1788917505.430706 write 0x00ab47 thru 0x00e12f (0x35e9 bytes) 000177 1788917505.432213 read 0x00f22c thru 0x0148a2 (0x5677 bytes) 000178 1788917505.432935 mapwrite 0x03cc4f thru 0x03ffff (0x33b1 bytes) 000179 1788917505.473125 trunc from 0x040000 to 0x0293f1 (0x16c0e bytes) 000180 1788917505.482637 write 0x0163b5 thru 0x01f016 (0x8c62 bytes) 000181 1788917505.483852 trunc from 0x0293f2 to 0x029939 (0x548 bytes) 000182 1788917505.490292 write 0x016578 thru 0x018989 (0x2412 bytes) 000183 1788917505.491322 trunc from 0x02993a to 0x0205f5 (0x9344 bytes) 000184 1788917505.498936 mapread 0x014ce6 thru 0x0205f5 (0xb910 bytes) 000185 1788917505.501859 MIRROR_EXTEND to 2 mirrors 000188 1788917505.748678 MIRROR_RESYNC 2 mirrors 000189 1788917505.906562 mapwrite 0x002331 thru 0x00ab8e (0x885e bytes) 000193 1788917506.001232 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x205f6): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x205f6): Mirror 2: 0xaf47c72c (stale) CRC-32 checksum value for chunk [0, 0x205f6): Mirror 1: 0x7ab082b3 Mirror 3: 0x7ab082b3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x205f6: skipped 000194 1788917506.383244 mapread 0x001d8b thru 0x00db1d (0xbd93 bytes) 000197 1788917506.409164 MIRROR_RESYNC 3 mirrors 000198 1788917506.737193 trunc from 0x0205f6 to 0x012dfe (0xd7f7 bytes) 000206 1788917506.793777 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12dff): Mirror 3: 0x17888fca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12dff): Mirror 3: 0x17888fca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12dff: skipped 000209 1788917506.944153 mapread 0x00b05f thru 0x012dfe (0x7da0 bytes) 000215 1788917506.959744 trunc from 0x012dff to 0x024e90 (0x12092 bytes) 000218 1788917506.972139 write 0x012a5e thru 0x015b64 (0x3107 bytes) 000219 1788917506.977036 read 0x007466 thru 0x00e183 (0x6d1e bytes) 000220 1788917506.977563 mapread 0x00b4a0 thru 0x015f7e (0xaadf bytes) 000221 1788917506.978342 write 0x021af1 thru 0x022e4d (0x135d bytes) 000222 1788917506.986156 read 0x01fa4f thru 0x024e90 (0x5442 bytes) 000223 1788917506.991344 mapwrite 0x014e64 thru 0x023cb4 (0xee51 bytes) 000225 1788917507.020801 write 0x004cb2 thru 0x011102 (0xc451 bytes) 000227 1788917507.022783 mapread 0x0061d8 thru 0x014b98 (0xe9c1 bytes) 000228 1788917507.023914 mapread 0x0011f5 thru 0x011131 (0xff3d bytes) 000230 1788917507.025712 mapread 0x01d4d7 thru 0x024e90 (0x79ba bytes) 000238 1788917507.030209 mapwrite 0x03af24 thru 0x03ffff (0x50dc bytes) 000239 1788917507.072458 mapwrite 0x03c66d thru 0x03ffff (0x3993 bytes) 000240 1788917507.095855 write 0x022664 thru 0x02a020 (0x79bd bytes) 000241 1788917507.096966 mapread 0x023301 thru 0x02acae (0x79ae bytes) 000242 1788917507.097819 mapread 0x0141d2 thru 0x016ceb (0x2b1a bytes) 000243 1788917507.098705 trunc from 0x040000 to 0x017af8 (0x28507 bytes) 000245 1788917507.116446 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x17af9): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17af9): Mirror 3: 0x731d7ad9 (stale) CRC-32 checksum value for chunk [0, 0x17af9): Mirror 1: 0xc7a9bc20 Mirror 4: 0xc7a9bc20 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17af9: skipped 000248 1788917507.550887 mapread 0x0146de thru 0x017af8 (0x341b bytes) 000249 1788917507.570726 write 0x02c7f1 thru 0x03a122 (0xd932 bytes) 000250 1788917507.601177 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a123): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a123): Mirror 3: 0x515851c9 (stale) Mirror 4: 0xe51bfec0 (stale) CRC-32 checksum value for chunk [0, 0x3a123): Mirror 1: 0x7420cb87 Mirror 5: 0x7420cb87 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a123: skipped 000251 1788917508.081963 mapread 0x0274fe thru 0x02d014 (0x5b17 bytes) 000252 1788917508.099331 read 0x009f8b thru 0x017887 (0xd8fd bytes) 000253 1788917508.111533 read 0x02e329 thru 0x03a122 (0xbdfa bytes) 000255 1788917508.127544 mapwrite 0x02893c thru 0x02a849 (0x1f0e bytes) 000257 1788917508.223869 trunc from 0x03a123 to 0x030d0c (0x9416 bytes) 000259 1788917508.236956 trunc from 0x030d0d to 0x0287ac (0x8560 bytes) 000262 1788917508.246123 mapread 0x016d59 thru 0x022552 (0xb7fa bytes) 000263 1788917508.280356 write 0x03013e thru 0x03a093 (0x9f56 bytes) 000265 1788917508.287516 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3a094): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a094): Mirror 3: 0x2b95bbfb (stale) Mirror 4: 0x6af5aaab (stale) Mirror 5: 0x7451a4b3 (stale) CRC-32 checksum value for chunk [0, 0x3a094): Mirror 1: 0x78f78199 Mirror 6: 0x78f78199 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a094: skipped 000266 1788917508.710814 mapread 0x002e12 thru 0x003c1a (0xe09 bytes) 000267 1788917508.716162 mapwrite 0x02183a thru 0x025a64 (0x422b bytes) 000268 1788917508.781340 mapread 0x03167a thru 0x0356b2 (0x4039 bytes) 000269 1788917508.787316 MIRROR_RESYNC 5 mirrors 000271 1788917509.322540 mapwrite 0x02bfb7 thru 0x02c3bd (0x407 bytes) 000272 1788917509.383515 trunc from 0x03a094 to 0x021585 (0x18b0e bytes) 000273 1788917509.391887 mapwrite 0x014f6b thru 0x022490 (0xd526 bytes) 000276 1788917509.429063 read 0x01aeb8 thru 0x022490 (0x75d9 bytes) 000277 1788917509.429641 mapread 0x01c9b5 thru 0x022490 (0x5adc bytes) 000278 1788917509.430312 write 0x0249ba thru 0x0283ff (0x3a46 bytes) 000280 1788917509.433882 MIRROR_RESYNC 5 mirrors 000281 1788917509.742265 mapwrite 0x03e0d1 thru 0x03ffff (0x1f2f bytes) 000285 1788917509.865176 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x320c0361 (stale) Mirror 5: 0x320c0361 (stale) Mirror 6: 0x320c0361 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x320c0361 (stale) Mirror 5: 0x320c0361 (stale) Mirror 6: 0x320c0361 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000287 1788917510.037467 read 0x014fc4 thru 0x01bf1d (0x6f5a bytes) 000292 1788917510.046958 write 0x02accc thru 0x033205 (0x853a bytes) 000293 1788917510.057164 write 0x013276 thru 0x021df8 (0xeb83 bytes) 000294 1788917510.066487 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x320c0361 (stale) Mirror 5: 0x320c0361 (stale) Mirror 6: 0x320c0361 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x627d282f Mirror 7: 0x627d282f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000295 1788917510.438716 trunc from 0x040000 to 0x027edc (0x18123 bytes) 000296 1788917510.492552 mapwrite 0x03c2ed thru 0x03ffff (0x3d13 bytes) 000297 1788917510.539568 trunc from 0x040000 to 0x03a91e (0x56e1 bytes) 000298 1788917510.547030 mapwrite 0x01c1f4 thru 0x024118 (0x7f25 bytes) 000300 1788917510.575665 write 0x03c186 thru 0x03edea (0x2c65 bytes) 000301 1788917510.576501 read 0x004ef1 thru 0x00aa45 (0x5b55 bytes) 000302 1788917510.579914 mapread 0x02e2c9 thru 0x03959a (0xb2d2 bytes) 000304 1788917510.587741 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3edeb): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3edeb): Mirror 3: 0x11c1080e (stale) Mirror 5: 0x11c1080e (stale) Mirror 6: 0x11c1080e (stale) Mirror 7: 0x372c04eb (stale) CRC-32 checksum value for chunk [0, 0x3edeb): Mirror 1: 0x7c251761 Mirror 8: 0x7c251761 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3edeb: skipped 000305 1788917511.001925 trunc from 0x03edeb to 0x00c570 (0x3287a bytes) 000306 1788917511.044313 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0xc571): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc571): Mirror 3: 0x40610b2d (stale) Mirror 5: 0x40610b2d (stale) Mirror 6: 0x40610b2d (stale) Mirror 7: 0x40610b2d (stale) Mirror 8: 0x40610b2d (stale) CRC-32 checksum value for chunk [0, 0xc571): Mirror 1: 0x40610b2d Mirror 9: 0x40610b2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc571: skipped 000307 1788917511.419512 trunc from 0x00c571 to 0x02fc66 (0x236f6 bytes) 000309 1788917511.457234 write 0x0264ac thru 0x02effd (0x8b52 bytes) 000311 1788917511.469833 MIRROR_RESYNC 7 mirrors 000312 1788917512.205413 MIRROR_RESYNC 7 mirrors 000314 1788917512.403999 mapread 0x000e8b thru 0x003103 (0x2279 bytes) 000315 1788917512.421490 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) 000316 1788917512.613631 mapread 0x005401 thru 0x00d744 (0x8344 bytes) 000319 1788917512.626477 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) 000320 1788917512.810214 mapread 0x015d2f thru 0x01baa3 (0x5d75 bytes) 000322 1788917512.819766 mapread 0x00e0d5 thru 0x0172b5 (0x91e1 bytes) 000323 1788917512.824247 read 0x01373d thru 0x01fe06 (0xc6ca bytes) 000325 1788917512.825261 mapwrite 0x01a5c6 thru 0x02476e (0xa1a9 bytes) 000326 1788917512.908432 write 0x03b9d5 thru 0x03ffff (0x462b bytes) 000328 1788917512.910353 mapwrite 0x018fed thru 0x01d5b9 (0x45cd bytes) 000331 1788917512.942694 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xc4e055c6 (stale) Mirror 7: 0xc4e055c6 (stale) Mirror 8: 0xc4e055c6 (stale) Mirror 9: 0xc4e055c6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5e4ffe02 Mirror 10: 0x5e4ffe02 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000332 1788917513.463194 write 0x0398ad thru 0x03ffff (0x6753 bytes) 000334 1788917513.528826 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xc4e055c6 (stale) Mirror 7: 0xc4e055c6 (stale) Mirror 8: 0xc4e055c6 (stale) Mirror 9: 0xc4e055c6 (stale) Mirror 10: 0x5e4ffe02 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb3e5b02f Mirror 11: 0xb3e5b02f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000335 1788917514.016489 read 0x03a3f8 thru 0x03d189 (0x2d92 bytes) 000336 1788917514.024177 read 0x007fef thru 0x0111ba (0x91cc bytes) 000338 1788917514.037747 trunc from 0x040000 to 0x020582 (0x1fa7d bytes) 000339 1788917514.074878 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x20583): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20583): Mirror 6: 0x78eb2535 (stale) Mirror 7: 0x78eb2535 (stale) Mirror 8: 0x78eb2535 (stale) Mirror 9: 0x78eb2535 (stale) Mirror 10: 0x85d8058 (stale) Mirror 11: 0x85d8058 (stale) CRC-32 checksum value for chunk [0, 0x20583): Mirror 1: 0x85d8058 Mirror 12: 0x85d8058 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20583: skipped 000340 1788917514.488248 trunc from 0x020583 to 0x00413c (0x1c446 bytes) 000343 1788917514.527087 write 0x02cd0c thru 0x031571 (0x4866 bytes) 000346 1788917514.529429 mapwrite 0x03a46b thru 0x03ffff (0x5b95 bytes) 000348 1788917514.566897 write 0x005dd0 thru 0x012b64 (0xcd95 bytes) 000349 1788917514.572029 mapread 0x00dc68 thru 0x0100bf (0x2458 bytes) 000352 1788917514.574092 mapread 0x01a734 thru 0x01fa41 (0x530e bytes) 000356 1788917514.580518 write 0x004276 thru 0x004ea2 (0xc2d bytes) 000357 1788917514.585299 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xc4e055c6 (stale) Mirror 7: 0xc4e055c6 (stale) Mirror 8: 0xc4e055c6 (stale) Mirror 9: 0xc4e055c6 (stale) Mirror 10: 0x5e4ffe02 (stale) Mirror 11: 0xb3e5b02f (stale) Mirror 12: 0x1ddcc38 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf3862ab6 Mirror 13: 0xf3862ab6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000358 1788917515.056005 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xc4e055c6 (stale) Mirror 7: 0xc4e055c6 (stale) Mirror 9: 0xc4e055c6 (stale) Mirror 10: 0x5e4ffe02 (stale) Mirror 11: 0xb3e5b02f (stale) Mirror 12: 0x1ddcc38 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xc4e055c6 (stale) Mirror 7: 0xc4e055c6 (stale) Mirror 9: 0xc4e055c6 (stale) Mirror 10: 0x5e4ffe02 (stale) Mirror 11: 0xb3e5b02f (stale) Mirror 12: 0x1ddcc38 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf3862ab6 Mirror 13: 0xf3862ab6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000363 1788917515.502442 read 0x00aac7 thru 0x010282 (0x57bc bytes) 000364 1788917515.514891 mapwrite 0x013067 thru 0x01fbec (0xcb86 bytes) 000365 1788917515.608737 mapwrite 0x0013dd thru 0x00edcc (0xd9f0 bytes) 000366 1788917515.638833 mapwrite 0x000d4a thru 0x00ec1c (0xded3 bytes) 000369 1788917515.664786 mapwrite 0x035675 thru 0x03f253 (0x9bdf bytes) 000370 1788917515.695870 read 0x025493 thru 0x02bf24 (0x6a92 bytes) 000371 1788917515.700481 mapread 0x004068 thru 0x0053af (0x1348 bytes) 000373 1788917515.701916 trunc from 0x040000 to 0x033345 (0xccba bytes) 000374 1788917515.722064 mapwrite 0x02c06d thru 0x036c02 (0xab96 bytes) 000377 1788917515.771893 trunc from 0x036c03 to 0x02b3e6 (0xb81c bytes) 000379 1788917515.787001 mapwrite 0x0189aa thru 0x01b5c4 (0x2c1b bytes) 000380 1788917515.818381 mapread 0x026b5b thru 0x02777d (0xc23 bytes) 000381 1788917515.819314 mapread 0x00cd14 thru 0x01c576 (0xf863 bytes) 000382 1788917515.820480 trunc from 0x02b3e7 to 0x0286dd (0x2d09 bytes) 000383 1788917515.831157 trunc from 0x0286de to 0x006a4d (0x21c90 bytes) 000384 1788917515.843374 mapwrite 0x01b59a thru 0x021dfb (0x6862 bytes) 000385 1788917515.915075 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x21dfc): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21dfc): Mirror 6: 0x2edc622c (stale) Mirror 7: 0x2edc622c (stale) Mirror 9: 0x2edc622c (stale) Mirror 10: 0x949c6774 (stale) Mirror 11: 0x949c6774 (stale) Mirror 12: 0xfe949b41 (stale) Mirror 13: 0x721d724d (stale) CRC-32 checksum value for chunk [0, 0x21dfc): Mirror 1: 0x6fbab722 Mirror 14: 0x6fbab722 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21dfc: skipped 000386 1788917516.408254 read 0x01f92f thru 0x021dfb (0x24cd bytes) 000387 1788917516.422448 read 0x008210 thru 0x015e13 (0xdc04 bytes) 000389 1788917516.456219 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21dfc): Mirror 6: 0x2edc622c (stale) Mirror 7: 0x2edc622c (stale) Mirror 9: 0x2edc622c (stale) Mirror 10: 0x949c6774 (stale) Mirror 11: 0x949c6774 (stale) Mirror 12: 0xfe949b41 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21dfc): Mirror 6: 0x2edc622c (stale) Mirror 7: 0x2edc622c (stale) Mirror 9: 0x2edc622c (stale) Mirror 10: 0x949c6774 (stale) Mirror 11: 0x949c6774 (stale) Mirror 12: 0xfe949b41 (stale) CRC-32 checksum value for chunk [0, 0x21dfc): Mirror 1: 0x6fbab722 Mirror 14: 0x6fbab722 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21dfc: skipped 000390 1788917516.867898 mapwrite 0x03357d thru 0x03def4 (0xa978 bytes) 000391 1788917516.949992 trunc from 0x03def5 to 0x02e242 (0xfcb2 bytes) 000394 1788917516.959380 write 0x03e0f4 thru 0x03ffff (0x1f0c bytes) 000396 1788917516.963654 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xc4e055c6 (stale) Mirror 9: 0xc4e055c6 (stale) Mirror 10: 0x5e4ffe02 (stale) Mirror 11: 0xb3e5b02f (stale) Mirror 12: 0x1ddcc38 (stale) Mirror 14: 0xe93ad1b6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xc4e055c6 (stale) Mirror 9: 0xc4e055c6 (stale) Mirror 10: 0x5e4ffe02 (stale) Mirror 11: 0xb3e5b02f (stale) Mirror 12: 0x1ddcc38 (stale) Mirror 14: 0xe93ad1b6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000397 1788917517.153952 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xc4e055c6 (stale) Mirror 9: 0xc4e055c6 (stale) Mirror 10: 0x5e4ffe02 (stale) Mirror 11: 0xb3e5b02f (stale) Mirror 12: 0x1ddcc38 (stale) Mirror 14: 0xe93ad1b6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x875dd361 Mirror 15: 0x875dd361 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000398 1788917517.668185 trunc from 0x040000 to 0x01a06f (0x25f90 bytes) 000399 1788917517.713368 MIRROR_RESYNC 8 mirrors 000400 1788917518.640079 write 0x01b899 thru 0x02b1b4 (0xf91c bytes) 000401 1788917518.676930 write 0x03ab30 thru 0x03b155 (0x626 bytes) 000402 1788917518.677913 trunc from 0x03b156 to 0x00e17e (0x2cfd7 bytes) 000403 1788917518.690017 mapread 0x000348 thru 0x004523 (0x41dc bytes) 000404 1788917518.701146 trunc from 0x00e17f to 0x02f205 (0x21087 bytes) 000405 1788917518.708056 read 0x01731e thru 0x022cce (0xb9b1 bytes) 000408 1788917518.714197 read 0x007233 thru 0x007251 (0x1f bytes) 000410 1788917518.715541 write 0x0216a5 thru 0x02a70b (0x9067 bytes) 000411 1788917518.723825 mapwrite 0x0043d1 thru 0x012802 (0xe432 bytes) 000413 1788917518.761299 trunc from 0x02f206 to 0x02a5ba (0x4c4b bytes) 000414 1788917518.772587 mapwrite 0x00c438 thru 0x01ad52 (0xe91b bytes) 000415 1788917518.813461 mapwrite 0x01f825 thru 0x02d088 (0xd864 bytes) 000416 1788917518.852990 read 0x0047f8 thru 0x00a6d0 (0x5ed9 bytes) 000417 1788917518.853751 mapwrite 0x00fb06 thru 0x014e6f (0x536a bytes) 000418 1788917518.880179 write 0x020371 thru 0x023958 (0x35e8 bytes) 000424 1788917518.884418 trunc from 0x02d089 to 0x001070 (0x2c018 bytes) 000425 1788917518.902544 mapread 0x000f71 thru 0x001070 (0x100 bytes) 000427 1788917518.904008 read 0x0006cf thru 0x001070 (0x9a2 bytes) 000429 1788917518.905210 mapwrite 0x010784 thru 0x013926 (0x31a3 bytes) 000430 1788917518.961298 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x13927): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13927): Mirror 7: 0x1aeb60cc (stale) Mirror 9: 0x1aeb60cc (stale) Mirror 10: 0x1aeb60cc (stale) Mirror 11: 0x1aeb60cc (stale) Mirror 12: 0x1aeb60cc (stale) Mirror 14: 0x1aeb60cc (stale) Mirror 15: 0x1aeb60cc (stale) CRC-32 checksum value for chunk [0, 0x13927): Mirror 1: 0x38401473 Mirror 16: 0x38401473 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13927: skipped 000432 1788917519.498071 MIRROR_RESYNC 9 mirrors 000435 1788917520.368348 mapwrite 0x025cba thru 0x02a560 (0x48a7 bytes) 000437 1788917520.440949 mapread 0x01b8aa thru 0x0226d9 (0x6e30 bytes) 000438 1788917520.445869 read 0x017750 thru 0x01d40a (0x5cbb bytes) 000439 1788917520.448736 MIRROR_RESYNC 9 mirrors 000440 1788917521.438631 mapread 0x006f33 thru 0x00e242 (0x7310 bytes) 000441 1788917521.449887 trunc from 0x02a561 to 0x0393a5 (0xee45 bytes) 000442 1788917521.482048 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x393a6): Mirror 9: 0x4c08b02e (stale) Mirror 10: 0x4c08b02e (stale) Mirror 11: 0x4c08b02e (stale) Mirror 12: 0x4c08b02e (stale) Mirror 14: 0x4c08b02e (stale) Mirror 15: 0x4c08b02e (stale) Mirror 16: 0x4c08b02e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x393a6): Mirror 9: 0x4c08b02e (stale) Mirror 10: 0x4c08b02e (stale) Mirror 11: 0x4c08b02e (stale) Mirror 12: 0x4c08b02e (stale) Mirror 14: 0x4c08b02e (stale) Mirror 15: 0x4c08b02e (stale) Mirror 16: 0x4c08b02e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x393a6: skipped 000444 1788917521.682427 trunc from 0x0393a6 to 0x033d63 (0x5642 bytes) 000448 1788917521.692462 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33d64): Mirror 9: 0xaee10908 (stale) Mirror 10: 0xaee10908 (stale) Mirror 11: 0xaee10908 (stale) Mirror 12: 0xaee10908 (stale) Mirror 14: 0xaee10908 (stale) Mirror 16: 0xaee10908 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33d64): Mirror 9: 0xaee10908 (stale) Mirror 10: 0xaee10908 (stale) Mirror 11: 0xaee10908 (stale) Mirror 12: 0xaee10908 (stale) Mirror 14: 0xaee10908 (stale) Mirror 16: 0xaee10908 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33d64: skipped 000452 1788917521.874147 mapread 0x00da50 thru 0x01847c (0xaa2d bytes) 000453 1788917521.892635 read 0x00a652 thru 0x00e92c (0x42db bytes) 000454 1788917521.893345 write 0x017157 thru 0x01af01 (0x3dab bytes) 000455 1788917521.894351 read 0x016bc9 thru 0x01a09f (0x34d7 bytes) 000456 1788917521.895368 mapwrite 0x0275d6 thru 0x02c489 (0x4eb4 bytes) 000457 1788917521.923879 mapwrite 0x0233ac thru 0x02b0ee (0x7d43 bytes) 000460 1788917521.942557 mapwrite 0x039c89 thru 0x03ffff (0x6377 bytes) 000462 1788917521.974952 trunc from 0x040000 to 0x00543c (0x3abc3 bytes) 000464 1788917521.983976 mapread 0x001eda thru 0x00543c (0x3563 bytes) 000465 1788917521.985048 read 0x000b02 thru 0x00543c (0x493b bytes) 000468 1788917521.986748 mapread 0x003f18 thru 0x00543c (0x1525 bytes) 000470 1788917521.988070 write 0x018a51 thru 0x0268ba (0xde6a bytes) 000472 1788917521.990128 write 0x00351e thru 0x010fe3 (0xdac6 bytes) 000473 1788917521.994437 read 0x00d6fa thru 0x0184c2 (0xadc9 bytes) 000475 1788917521.999190 mapread 0x0055a9 thru 0x00d664 (0x80bc bytes) 000478 1788917522.001153 trunc from 0x0268bb to 0x032224 (0xb96a bytes) 000480 1788917522.008838 write 0x02d328 thru 0x033922 (0x65fb bytes) 000481 1788917522.014792 read 0x012548 thru 0x013d7a (0x1833 bytes) 000484 1788917522.016389 mapread 0x01db92 thru 0x025d0a (0x8179 bytes) 000485 1788917522.017529 mapwrite 0x005c7f thru 0x015aa5 (0xfe27 bytes) 000488 1788917522.047103 trunc from 0x033923 to 0x01a9ee (0x18f34 bytes) 000489 1788917522.055857 mapread 0x019f6e thru 0x01a9ee (0xa81 bytes) 000495 1788917522.059482 write 0x0271e9 thru 0x02f66f (0x8487 bytes) 000497 1788917522.061258 mapread 0x024aeb thru 0x02b3d6 (0x68ec bytes) 000498 1788917522.068776 write 0x03dc45 thru 0x03fb7d (0x1f39 bytes) 000502 1788917522.071472 trunc from 0x03fb7e to 0x029c8b (0x15ef2 bytes) 000503 1788917522.079968 trunc from 0x029c8c to 0x009024 (0x20c67 bytes) 000504 1788917522.090379 mapread 0x008495 thru 0x008d1d (0x889 bytes) 000505 1788917522.091354 mapwrite 0x023227 thru 0x024b79 (0x1953 bytes) 000507 1788917522.121995 mapread 0x00bcbc thru 0x00efdb (0x3320 bytes) 000508 1788917522.132485 trunc from 0x024b7a to 0x018677 (0xc502 bytes) 000509 1788917522.140058 read 0x001267 thru 0x00bdcd (0xab67 bytes) 000510 1788917522.145327 read 0x006886 thru 0x0071cf (0x94a bytes) 000513 1788917522.147110 trunc from 0x018678 to 0x014815 (0x3e62 bytes) 000514 1788917522.157587 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14816): Mirror 9: 0x32792ee3 (stale) Mirror 10: 0x32792ee3 (stale) Mirror 11: 0x32792ee3 (stale) Mirror 12: 0x32792ee3 (stale) Mirror 16: 0x32792ee3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14816): Mirror 9: 0x32792ee3 (stale) Mirror 10: 0x32792ee3 (stale) Mirror 11: 0x32792ee3 (stale) Mirror 12: 0x32792ee3 (stale) Mirror 16: 0x32792ee3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14816: skipped 000516 1788917522.331055 mapread 0x007161 thru 0x01163a (0xa4da bytes) 000517 1788917522.341526 mapread 0x00d577 thru 0x014815 (0x729f bytes) 000519 1788917522.347297 mapwrite 0x03b8ac thru 0x03ffff (0x4754 bytes) 000521 1788917522.391147 mapread 0x014c07 thru 0x0249f3 (0xfded bytes) 000522 1788917522.400864 trunc from 0x040000 to 0x035295 (0xad6a bytes) 000523 1788917522.411062 write 0x001059 thru 0x006bf6 (0x5b9e bytes) 000524 1788917522.414287 write 0x01203d thru 0x012065 (0x29 bytes) 000526 1788917522.415364 write 0x023925 thru 0x032bf1 (0xf2cd bytes) truncating to largest ever: 0x3f76d 000527 1788917522.418725 trunc from 0x035296 to 0x03f76c (0xa4d7 bytes) 000528 1788917522.428752 MIRROR_RESYNC 6 mirrors 000530 1788917523.062851 mapread 0x013350 thru 0x014746 (0x13f7 bytes) 000532 1788917523.068211 mapwrite 0x01cc5e thru 0x022531 (0x58d4 bytes) 000533 1788917523.150563 mapread 0x013201 thru 0x019db5 (0x6bb5 bytes) 000534 1788917523.156675 write 0x02a320 thru 0x031a3c (0x771d bytes) 000535 1788917523.162254 mapread 0x0017a4 thru 0x002c1b (0x1478 bytes) 000538 1788917523.169594 write 0x0284ca thru 0x02a52c (0x2063 bytes) 000540 1788917523.176512 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f76d): Mirror 9: 0x24f33be1 (stale) Mirror 11: 0x24f33be1 (stale) Mirror 12: 0x24f33be1 (stale) Mirror 16: 0x24f33be1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f76d): Mirror 9: 0x24f33be1 (stale) Mirror 11: 0x24f33be1 (stale) Mirror 12: 0x24f33be1 (stale) Mirror 16: 0x24f33be1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f76d: skipped 000541 1788917523.344577 read 0x01f231 thru 0x0240fb (0x4ecb bytes) 000544 1788917523.352769 write 0x02972b thru 0x02b946 (0x221c bytes) 000545 1788917523.362127 trunc from 0x03f76d to 0x01a521 (0x2524b bytes) 000546 1788917523.381049 mapread 0x011ad6 thru 0x0163ce (0x48f9 bytes) 000547 1788917523.393714 mapread 0x003e15 thru 0x0128fa (0xeae6 bytes) 000551 1788917523.402369 mapread 0x00ef1e thru 0x0124fd (0x35e0 bytes) 000553 1788917523.403655 trunc from 0x01a522 to 0x00c016 (0xe50b bytes) 000554 1788917523.413412 MIRROR_RESYNC 5 mirrors 000555 1788917523.787678 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) 000556 1788917523.921301 mapwrite 0x026413 thru 0x02f2e7 (0x8ed5 bytes) 000558 1788917524.000654 mapwrite 0x00dc3c thru 0x01333d (0x5702 bytes) 000559 1788917524.026444 mapwrite 0x02eabd thru 0x03cb36 (0xe07a bytes) 000561 1788917524.071827 trunc from 0x03cb37 to 0x01fd44 (0x1cdf2 bytes) 000562 1788917524.080803 trunc from 0x01fd45 to 0x014185 (0xbbbf bytes) 000563 1788917524.087581 write 0x000201 thru 0x00e405 (0xe205 bytes) 000564 1788917524.091070 write 0x00dc58 thru 0x0121c8 (0x4571 bytes) 000565 1788917524.092268 write 0x005337 thru 0x014846 (0xf510 bytes) 000566 1788917524.093714 read 0x0111d0 thru 0x014846 (0x3677 bytes) 000570 1788917524.095776 mapread 0x0125a5 thru 0x014846 (0x22a2 bytes) 000571 1788917524.099338 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x14847): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14847): Mirror 11: 0xfb99f469 (stale) Mirror 12: 0xfb99f469 (stale) Mirror 16: 0xfb99f469 (stale) CRC-32 checksum value for chunk [0, 0x14847): Mirror 1: 0x3444a026 Mirror 17: 0x3444a026 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14847: skipped 000572 1788917524.411181 mapread 0x00ace6 thru 0x014846 (0x9b61 bytes) 000573 1788917524.424350 MIRROR_RESYNC 5 mirrors 000574 1788917524.708849 mapwrite 0x003ec5 thru 0x00dd29 (0x9e65 bytes) 000575 1788917524.780403 trunc from 0x014847 to 0x01b3bc (0x6b76 bytes) 000576 1788917524.796880 trunc from 0x01b3bd to 0x03583b (0x1a47f bytes) 000578 1788917524.804089 write 0x001304 thru 0x010186 (0xee83 bytes) 000581 1788917524.806238 mapread 0x028a78 thru 0x03583b (0xcdc4 bytes) 000582 1788917524.814340 mapread 0x006f02 thru 0x008ded (0x1eec bytes) 000586 1788917524.816903 read 0x02a678 thru 0x02e028 (0x39b1 bytes) 000587 1788917524.817496 mapread 0x0339dd thru 0x03583b (0x1e5f bytes) 000589 1788917524.818934 read 0x02c140 thru 0x02e39f (0x2260 bytes) 000590 1788917524.819487 write 0x0167af thru 0x01ad6f (0x45c1 bytes) 000593 1788917524.827434 read 0x00332e thru 0x00f3f1 (0xc0c4 bytes) 000594 1788917524.830424 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3583c): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3583c): Mirror 11: 0x7e0c2c1b (stale) Mirror 12: 0x7e0c2c1b (stale) Mirror 16: 0x7e0c2c1b (stale) Mirror 17: 0x7e0c2c1b (stale) CRC-32 checksum value for chunk [0, 0x3583c): Mirror 1: 0xac26ca9e Mirror 18: 0xac26ca9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3583c: skipped 000595 1788917525.357429 mapread 0x029ed3 thru 0x02faea (0x5c18 bytes) 000596 1788917525.373840 trunc from 0x03583c to 0x034c48 (0xbf3 bytes) 000599 1788917525.414784 MIRROR_RESYNC 6 mirrors 000600 1788917526.046735 mapread 0x01e7f9 thru 0x02bcc8 (0xd4d0 bytes) 000601 1788917526.062176 mapwrite 0x01d20a thru 0x02829b (0xb092 bytes) 000604 1788917526.152061 trunc from 0x034c49 to 0x0004a3 (0x347a5 bytes) 000606 1788917526.172759 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x4a4): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4a4): Mirror 11: 0xf93f1af5 (stale) Mirror 12: 0xf93f1af5 (stale) Mirror 16: 0xf93f1af5 (stale) Mirror 17: 0xf93f1af5 (stale) Mirror 18: 0xf93f1af5 (stale) CRC-32 checksum value for chunk [0, 0x4a4): Mirror 1: 0xf93f1af5 Mirror 19: 0xf93f1af5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4a4: skipped 000607 1788917526.580041 mapread 0x000060 thru 0x0004a3 (0x444 bytes) 000609 1788917526.600031 write 0x0155f8 thru 0x01fbb0 (0xa5b9 bytes) 000610 1788917526.640423 read 0x0098c2 thru 0x0152e4 (0xba23 bytes) 000611 1788917526.646999 MIRROR_RESYNC 7 mirrors 000612 1788917527.443760 mapread 0x0085b1 thru 0x008ad3 (0x523 bytes) 000613 1788917527.451064 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) 000614 1788917527.634022 read 0x0078d1 thru 0x0164be (0xebee bytes) 000615 1788917527.640002 read 0x01f2e1 thru 0x01fbb0 (0x8d0 bytes) 000619 1788917527.647844 read 0x011f23 thru 0x01d3b8 (0xb496 bytes) 000620 1788917527.648391 write 0x00295d thru 0x010416 (0xdaba bytes) 000621 1788917527.687551 trunc from 0x01fbb1 to 0x001302 (0x1e8ae bytes) 000622 1788917527.700480 MIRROR_RESYNC 6 mirrors 000626 1788917528.121084 mapwrite 0x00b4e9 thru 0x01a7b3 (0xf2cb bytes) 000627 1788917528.207121 MIRROR_RESYNC 6 mirrors 000628 1788917528.671975 write 0x020b0e thru 0x02667e (0x5b71 bytes) 000634 1788917528.720314 read 0x004548 thru 0x006373 (0x1e2c bytes) 000635 1788917528.725588 write 0x01a28a thru 0x0226f4 (0x846b bytes) 000637 1788917528.731102 write 0x024fea thru 0x030354 (0xb36b bytes) 000638 1788917528.733320 read 0x01cb90 thru 0x021094 (0x4505 bytes) 000639 1788917528.733900 mapread 0x017b23 thru 0x01e493 (0x6971 bytes) 000640 1788917528.742352 mapread 0x0209fd thru 0x026f87 (0x658b bytes) 000641 1788917528.743555 mapwrite 0x0264a5 thru 0x030f70 (0xaacc bytes) 000642 1788917528.782263 mapwrite 0x020a6b thru 0x02309f (0x2635 bytes) 000645 1788917528.801858 read 0x00d0f4 thru 0x014408 (0x7315 bytes) 000648 1788917528.803409 write 0x00fc93 thru 0x01c9e4 (0xcd52 bytes) 000649 1788917528.807219 MIRROR_RESYNC 6 mirrors 000652 1788917529.250294 trunc from 0x030f71 to 0x021835 (0xf73b bytes) 000653 1788917529.281567 read 0x006248 thru 0x00acce (0x4a87 bytes) 000654 1788917529.285948 trunc from 0x021836 to 0x00a1fa (0x1763b bytes) 000655 1788917529.295244 mapwrite 0x012e35 thru 0x01fc94 (0xce60 bytes) 000657 1788917529.340951 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1fc95): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fc95): Mirror 11: 0xb33efcd7 (stale) Mirror 12: 0xb33efcd7 (stale) Mirror 16: 0xb33efcd7 (stale) Mirror 17: 0xb33efcd7 (stale) Mirror 19: 0xb33efcd7 (stale) CRC-32 checksum value for chunk [0, 0x1fc95): Mirror 1: 0xd6be8394 Mirror 20: 0xd6be8394 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fc95: skipped 000659 1788917529.671253 mapread 0x019d1e thru 0x01dade (0x3dc1 bytes) 000662 1788917529.687238 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1fc95): Mirror 11: 0xb33efcd7 (stale) Mirror 12: 0xb33efcd7 (stale) Mirror 17: 0xb33efcd7 (stale) Mirror 19: 0xb33efcd7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fc95): Mirror 11: 0xb33efcd7 (stale) Mirror 12: 0xb33efcd7 (stale) Mirror 17: 0xb33efcd7 (stale) Mirror 19: 0xb33efcd7 (stale) CRC-32 checksum value for chunk [0, 0x1fc95): Mirror 1: 0xd6be8394 Mirror 20: 0xd6be8394 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fc95: skipped 000663 1788917530.027951 mapread 0x01625c thru 0x01909e (0x2e43 bytes) 000664 1788917530.049950 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1fc95): Mirror 11: 0xb33efcd7 (stale) Mirror 17: 0xb33efcd7 (stale) Mirror 19: 0xb33efcd7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fc95): Mirror 11: 0xb33efcd7 (stale) Mirror 17: 0xb33efcd7 (stale) Mirror 19: 0xb33efcd7 (stale) CRC-32 checksum value for chunk [0, 0x1fc95): Mirror 1: 0xd6be8394 Mirror 20: 0xd6be8394 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fc95: skipped 000665 1788917530.340263 read 0x003f4b thru 0x008525 (0x45db bytes) 000667 1788917530.346097 mapread 0x0052fc thru 0x0121d8 (0xcedd bytes) 000668 1788917530.356732 trunc from 0x01fc95 to 0x002392 (0x1d902 bytes) 000669 1788917530.402942 trunc from 0x002393 to 0x00de79 (0xbae7 bytes) 000672 1788917530.414889 mapwrite 0x02b46f thru 0x035bdc (0xa76e bytes) 000673 1788917530.451439 mapwrite 0x00d374 thru 0x010096 (0x2d23 bytes) 000674 1788917530.488461 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35bdd): Mirror 17: 0xaa2ab6ef (stale) Mirror 19: 0xaa2ab6ef (stale) Mirror 20: 0xd8884b92 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35bdd): Mirror 17: 0xaa2ab6ef (stale) Mirror 19: 0xaa2ab6ef (stale) Mirror 20: 0xd8884b92 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35bdd: skipped 000677 1788917530.645878 mapwrite 0x011f44 thru 0x01b9b2 (0x9a6f bytes) 000679 1788917530.679374 read 0x0029fa thru 0x00efe2 (0xc5e9 bytes) 000680 1788917530.685374 mapread 0x01fc0a thru 0x026b13 (0x6f0a bytes) 000681 1788917530.694907 write 0x0102ee thru 0x01d9a4 (0xd6b7 bytes) 000682 1788917530.699209 MIRROR_RESYNC 4 mirrors 000683 1788917531.111898 mapwrite 0x031ee8 thru 0x032f4b (0x1064 bytes) 000684 1788917531.174887 mapwrite 0x035809 thru 0x03ffff (0xa7f7 bytes) 000686 1788917531.214163 mapwrite 0x0326d1 thru 0x036669 (0x3f99 bytes) 000687 1788917531.228013 mapread 0x00a634 thru 0x00eb72 (0x453f bytes) 000688 1788917531.235084 MIRROR_RESYNC 4 mirrors 000689 1788917531.593557 read 0x03cc6a thru 0x03ffff (0x3396 bytes) 000691 1788917531.596587 mapread 0x02946f thru 0x038928 (0xf4ba bytes) 000693 1788917531.610779 mapread 0x0236f9 thru 0x029fa3 (0x68ab bytes) 000695 1788917531.615214 mapwrite 0x0042e4 thru 0x006324 (0x2041 bytes) 000696 1788917531.679572 mapread 0x0045f5 thru 0x00932d (0x4d39 bytes) 000697 1788917531.680824 write 0x0350cf thru 0x039cf9 (0x4c2b bytes) 000698 1788917531.685428 mapread 0x03a0a4 thru 0x03ffff (0x5f5c bytes) 000699 1788917531.691695 trunc from 0x040000 to 0x02007b (0x1ff84 bytes) 000700 1788917531.712001 mapread 0x01d893 thru 0x02007b (0x27e9 bytes) 000701 1788917531.720567 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2007c): Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2007c): Mirror 17: 0xdc6e9b8 (stale) Mirror 19: 0xdc6e9b8 (stale) Mirror 20: 0xdc6e9b8 (stale) CRC-32 checksum value for chunk [0, 0x2007c): Mirror 1: 0x6d5a3e85 Mirror 21: 0x6d5a3e85 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2007c: skipped 000702 1788917532.079752 mapread 0x016572 thru 0x019172 (0x2c01 bytes) 000703 1788917532.089041 write 0x016dcd thru 0x025159 (0xe38d bytes) 000704 1788917532.125479 mapwrite 0x005bf0 thru 0x00847b (0x288c bytes) 000705 1788917532.165393 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2515a): Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2515a): Mirror 17: 0xe97faba1 (stale) Mirror 19: 0xe97faba1 (stale) Mirror 20: 0xe97faba1 (stale) Mirror 21: 0x4290bb66 (stale) CRC-32 checksum value for chunk [0, 0x2515a): Mirror 1: 0xb78df64b Mirror 22: 0xb78df64b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2515a: skipped 000707 1788917532.512544 trunc from 0x02515a to 0x032627 (0xd4ce bytes) 000708 1788917532.551286 mapwrite 0x03e359 thru 0x03ffff (0x1ca7 bytes) 000710 1788917532.586832 trunc from 0x040000 to 0x015d09 (0x2a2f6 bytes) 000711 1788917532.594767 write 0x02954b thru 0x02bac2 (0x2578 bytes) 000712 1788917532.601536 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bac3): Mirror 19: 0xa3bb8b88 (stale) Mirror 20: 0xa3bb8b88 (stale) Mirror 21: 0x38f2d649 (stale) Mirror 22: 0xe74ee305 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bac3): Mirror 19: 0xa3bb8b88 (stale) Mirror 20: 0xa3bb8b88 (stale) Mirror 21: 0x38f2d649 (stale) Mirror 22: 0xe74ee305 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bac3: skipped 000713 1788917532.746285 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2bac3): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bac3): Mirror 19: 0xa3bb8b88 (stale) Mirror 20: 0xa3bb8b88 (stale) Mirror 21: 0x38f2d649 (stale) Mirror 22: 0xe74ee305 (stale) CRC-32 checksum value for chunk [0, 0x2bac3): Mirror 1: 0xc5af7f20 Mirror 23: 0xc5af7f20 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bac3: skipped 000714 1788917533.176142 read 0x01a9f1 thru 0x021521 (0x6b31 bytes) 000715 1788917533.186950 write 0x009c3a thru 0x015feb (0xc3b2 bytes) 000716 1788917533.228994 mapread 0x0109f2 thru 0x013f2f (0x353e bytes) 000717 1788917533.230048 trunc from 0x02bac3 to 0x034253 (0x8791 bytes) 000719 1788917533.249565 write 0x007a88 thru 0x00af22 (0x349b bytes) 000720 1788917533.252959 mapwrite 0x00b69d thru 0x011e2a (0x678e bytes) 000721 1788917533.275531 read 0x023084 thru 0x030c7a (0xdbf7 bytes) 000722 1788917533.279566 trunc from 0x034254 to 0x020044 (0x1420f bytes) 000723 1788917533.286551 MIRROR_RESYNC 6 mirrors 000724 1788917533.786167 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) 000725 1788917533.935707 mapread 0x000ec9 thru 0x0038f3 (0x2a2b bytes) 000727 1788917533.949738 mapread 0x0009fd thru 0x008df6 (0x83fa bytes) 000728 1788917533.950814 mapwrite 0x022a67 thru 0x031238 (0xe7d2 bytes) 000729 1788917534.028759 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x31239): Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31239): Mirror 19: 0x26bce629 (stale) Mirror 21: 0x26bce629 (stale) Mirror 22: 0x26bce629 (stale) Mirror 23: 0x26bce629 (stale) CRC-32 checksum value for chunk [0, 0x31239): Mirror 1: 0x17f97ec7 Mirror 24: 0x17f97ec7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31239: skipped 000730 1788917534.459561 mapwrite 0x039d96 thru 0x03ffff (0x626a bytes) 000731 1788917534.519849 read 0x02c00c thru 0x037614 (0xb609 bytes) 000733 1788917534.525639 trunc from 0x040000 to 0x01634c (0x29cb3 bytes) 000734 1788917534.534367 write 0x01ec91 thru 0x01f4b7 (0x827 bytes) 000735 1788917534.535269 trunc from 0x01f4b8 to 0x02ce04 (0xd94d bytes) 000736 1788917534.542379 write 0x009788 thru 0x01699a (0xd213 bytes) 000737 1788917534.548433 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2ce05): Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ce05): Mirror 19: 0x2af8dfdd (stale) Mirror 21: 0x2af8dfdd (stale) Mirror 22: 0x2af8dfdd (stale) Mirror 23: 0x2af8dfdd (stale) Mirror 24: 0xc78d463f (stale) CRC-32 checksum value for chunk [0, 0x2ce05): Mirror 1: 0xee19b4 Mirror 25: 0xee19b4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ce05: skipped 000740 1788917534.956130 MIRROR_RESYNC 7 mirrors 000743 1788917535.467445 trunc from 0x02ce05 to 0x00acd3 (0x22131 bytes) 000747 1788917535.503807 read 0x001559 thru 0x0062b5 (0x4d5d bytes) 000749 1788917535.508947 trunc from 0x00acd4 to 0x008866 (0x246d bytes) 000750 1788917535.521323 mapwrite 0x03a13a thru 0x03cb60 (0x2a27 bytes) 000753 1788917535.581515 read 0x0043a6 thru 0x013db3 (0xfa0e bytes) 000754 1788917535.588883 mapread 0x01385d thru 0x01ed07 (0xb4ab bytes) 000755 1788917535.590151 read 0x028963 thru 0x02fdc0 (0x745e bytes) 000756 1788917535.590843 mapwrite 0x0259b9 thru 0x02db4b (0x8193 bytes) 000759 1788917535.630659 read 0x012a4d thru 0x016c2c (0x41e0 bytes) 000760 1788917535.633967 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3cb61): Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cb61): Mirror 19: 0x96b50bc0 (stale) Mirror 21: 0x96b50bc0 (stale) Mirror 22: 0x96b50bc0 (stale) Mirror 23: 0x96b50bc0 (stale) Mirror 24: 0x96b50bc0 (stale) Mirror 25: 0x96b50bc0 (stale) CRC-32 checksum value for chunk [0, 0x3cb61): Mirror 1: 0xc5545489 Mirror 26: 0xc5545489 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cb61: skipped 000761 1788917536.111290 mapwrite 0x01657e thru 0x01efbc (0x8a3f bytes) 000763 1788917536.215999 read 0x026864 thru 0x029cae (0x344b bytes) 000764 1788917536.220860 mapread 0x006784 thru 0x015ccd (0xf54a bytes) 000765 1788917536.225510 mapread 0x02da06 thru 0x032c70 (0x526b bytes) 000766 1788917536.230331 mapread 0x02ecfd thru 0x03bd60 (0xd064 bytes) 000769 1788917536.236662 trunc from 0x03cb61 to 0x00b284 (0x318dc bytes) 000772 1788917536.262676 trunc from 0x00b285 to 0x013179 (0x7ef5 bytes) 000774 1788917536.273962 mapread 0x00850f thru 0x00b987 (0x3479 bytes) 000775 1788917536.275266 mapwrite 0x00a145 thru 0x00d086 (0x2f42 bytes) 000776 1788917536.306279 MIRROR_RESYNC 8 mirrors 000778 1788917536.865311 read 0x004caa thru 0x010797 (0xbaee bytes) 000779 1788917536.869725 mapwrite 0x0057c9 thru 0x01344c (0xdc84 bytes) 000780 1788917536.938901 mapwrite 0x00600a thru 0x0095ea (0x35e1 bytes) 000781 1788917536.955574 write 0x0381e1 thru 0x03ffff (0x7e1f bytes) 000784 1788917536.960799 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x61b9d334 (stale) Mirror 22: 0x61b9d334 (stale) Mirror 23: 0x61b9d334 (stale) Mirror 24: 0x61b9d334 (stale) Mirror 25: 0x61b9d334 (stale) Mirror 26: 0x61b9d334 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x61b9d334 (stale) Mirror 22: 0x61b9d334 (stale) Mirror 23: 0x61b9d334 (stale) Mirror 24: 0x61b9d334 (stale) Mirror 25: 0x61b9d334 (stale) Mirror 26: 0x61b9d334 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000786 1788917537.155976 read 0x032ff3 thru 0x03b350 (0x835e bytes) 000787 1788917537.161113 trunc from 0x040000 to 0x017d24 (0x282db bytes) 000788 1788917537.173122 MIRROR_RESYNC 7 mirrors 000789 1788917537.583070 trunc from 0x017d25 to 0x032914 (0x1abf0 bytes) 000791 1788917537.623500 mapwrite 0x00bac9 thru 0x015b46 (0xa07e bytes) 000793 1788917537.662340 mapread 0x0192c6 thru 0x01e70f (0x544a bytes) 000794 1788917537.670570 mapread 0x01e1f1 thru 0x025226 (0x7036 bytes) 000797 1788917537.682421 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32915): Mirror 19: 0x19c886dc (stale) Mirror 22: 0x19c886dc (stale) Mirror 23: 0x19c886dc (stale) Mirror 25: 0x19c886dc (stale) Mirror 26: 0x19c886dc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32915): Mirror 19: 0x19c886dc (stale) Mirror 22: 0x19c886dc (stale) Mirror 23: 0x19c886dc (stale) Mirror 25: 0x19c886dc (stale) Mirror 26: 0x19c886dc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32915: skipped 000799 1788917537.880245 write 0x038d07 thru 0x03ffff (0x72f9 bytes) 000800 1788917537.881513 write 0x027aec thru 0x02b415 (0x392a bytes) 000801 1788917537.888000 read 0x039aa5 thru 0x03ffff (0x655b bytes) 000803 1788917537.889160 mapwrite 0x00867d thru 0x014451 (0xbdd5 bytes) 000806 1788917537.928456 mapread 0x02b7a8 thru 0x02fdee (0x4647 bytes) 000807 1788917537.933056 trunc from 0x040000 to 0x024e60 (0x1b19f bytes) 000808 1788917537.938691 mapread 0x023ee3 thru 0x024e60 (0xf7e bytes) 000810 1788917537.942940 write 0x01b37d thru 0x020a1e (0x56a2 bytes) 000813 1788917537.947768 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x24e61): Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24e61): Mirror 19: 0x8c75f325 (stale) Mirror 22: 0x8c75f325 (stale) Mirror 23: 0x8c75f325 (stale) Mirror 25: 0x8c75f325 (stale) Mirror 26: 0x8c75f325 (stale) CRC-32 checksum value for chunk [0, 0x24e61): Mirror 1: 0x82a2aee9 Mirror 27: 0x82a2aee9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24e61: skipped 000818 1788917538.339936 mapwrite 0x010075 thru 0x014e70 (0x4dfc bytes) 000820 1788917538.403884 write 0x000cf7 thru 0x00255f (0x1869 bytes) 000824 1788917538.409893 write 0x034966 thru 0x0397f1 (0x4e8c bytes) 000825 1788917538.410930 write 0x0393fe thru 0x03ffff (0x6c02 bytes) 000826 1788917538.413976 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xae1eb57e (stale) Mirror 22: 0xae1eb57e (stale) Mirror 23: 0xae1eb57e (stale) Mirror 25: 0xae1eb57e (stale) Mirror 26: 0xae1eb57e (stale) Mirror 27: 0xf884d322 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3dedf434 Mirror 28: 0x3dedf434 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000827 1788917538.904367 write 0x023128 thru 0x02c6b5 (0x958e bytes) 000828 1788917538.959319 mapread 0x015f70 thru 0x01fbd7 (0x9c68 bytes) 000829 1788917538.973187 MIRROR_RESYNC 8 mirrors 000830 1788917539.535841 MIRROR_EXTEND to 9 mirrors 000832 1788917539.910097 read 0x005c2a thru 0x005e7f (0x256 bytes) truncating to largest ever: 0x3fb82 000833 1788917539.913439 trunc from 0x040000 to 0x03fb81 (0x47e bytes) 000836 1788917539.955362 trunc from 0x03fb82 to 0x0266dc (0x194a5 bytes) 000837 1788917539.965454 mapwrite 0x00b652 thru 0x00f38f (0x3d3e bytes) 000838 1788917539.993927 read 0x019e88 thru 0x02497d (0xaaf6 bytes) 000839 1788917539.999945 mapread 0x025b79 thru 0x0266dc (0xb64 bytes) 000842 1788917540.004536 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x266dd): Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x266dd): Mirror 19: 0xb6ae6683 (stale) Mirror 22: 0xb6ae6683 (stale) Mirror 23: 0xb6ae6683 (stale) Mirror 25: 0xb6ae6683 (stale) Mirror 26: 0xb6ae6683 (stale) Mirror 27: 0xb6ae6683 (stale) Mirror 28: 0xb6ae6683 (stale) Mirror 29: 0xb6ae6683 (stale) CRC-32 checksum value for chunk [0, 0x266dd): Mirror 1: 0xd7aa31e0 Mirror 30: 0xd7aa31e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x266dd: skipped 000845 1788917540.424059 read 0x005568 thru 0x00d362 (0x7dfb bytes) 000847 1788917540.428874 read 0x016645 thru 0x020741 (0xa0fd bytes) 000850 1788917540.437550 MIRROR_RESYNC 10 mirrors 000852 1788917540.995321 mapread 0x0022ad thru 0x004a01 (0x2755 bytes) 000857 1788917541.005881 mapwrite 0x029ba0 thru 0x03762f (0xda90 bytes) 000859 1788917541.083119 write 0x0025dd thru 0x004e23 (0x2847 bytes) 000866 1788917541.091141 mapread 0x032068 thru 0x03762f (0x55c8 bytes) 000868 1788917541.093053 write 0x02ba0a thru 0x02e30c (0x2903 bytes) 000869 1788917541.094113 trunc from 0x037630 to 0x034cb4 (0x297b bytes) 000870 1788917541.105509 read 0x003105 thru 0x010fac (0xdea8 bytes) 000875 1788917541.112534 mapwrite 0x00d9c1 thru 0x014b08 (0x7148 bytes) 000878 1788917541.138938 trunc from 0x034cb5 to 0x02843b (0xc879 bytes) 000879 1788917541.145513 write 0x03ef50 thru 0x03ffff (0x10b0 bytes) 000880 1788917541.146646 mapwrite 0x012bca thru 0x01cad4 (0x9f0b bytes) 000881 1788917541.173240 mapwrite 0x0312fc thru 0x03ffff (0xed04 bytes) 000882 1788917541.204101 write 0x01c806 thru 0x027780 (0xaf7b bytes) 000883 1788917541.208048 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x754e364 (stale) Mirror 22: 0x754e364 (stale) Mirror 23: 0x754e364 (stale) Mirror 25: 0x754e364 (stale) Mirror 26: 0x754e364 (stale) Mirror 27: 0x754e364 (stale) Mirror 28: 0x754e364 (stale) Mirror 29: 0x754e364 (stale) Mirror 30: 0x754e364 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb4066625 Mirror 31: 0xb4066625 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000889 1788917541.633718 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x754e364 (stale) Mirror 22: 0x754e364 (stale) Mirror 25: 0x754e364 (stale) Mirror 26: 0x754e364 (stale) Mirror 27: 0x754e364 (stale) Mirror 28: 0x754e364 (stale) Mirror 29: 0x754e364 (stale) Mirror 30: 0x754e364 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x754e364 (stale) Mirror 22: 0x754e364 (stale) Mirror 25: 0x754e364 (stale) Mirror 26: 0x754e364 (stale) Mirror 27: 0x754e364 (stale) Mirror 28: 0x754e364 (stale) Mirror 29: 0x754e364 (stale) Mirror 30: 0x754e364 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb4066625 Mirror 31: 0xb4066625 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000890 1788917541.993809 trunc from 0x040000 to 0x031ad4 (0xe52b bytes) 000891 1788917542.050137 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x31ad5): Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31ad5): Mirror 19: 0x6fc4c444 (stale) Mirror 22: 0x6fc4c444 (stale) Mirror 25: 0x6fc4c444 (stale) Mirror 26: 0x6fc4c444 (stale) Mirror 27: 0x6fc4c444 (stale) Mirror 28: 0x6fc4c444 (stale) Mirror 29: 0x6fc4c444 (stale) Mirror 30: 0x6fc4c444 (stale) Mirror 31: 0xa3ff7cdc (stale) CRC-32 checksum value for chunk [0, 0x31ad5): Mirror 1: 0xa3ff7cdc Mirror 32: 0xa3ff7cdc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31ad5: skipped 000894 1788917542.598863 read 0x00750e thru 0x00a8fa (0x33ed bytes) 000895 1788917542.608080 write 0x036b10 thru 0x03ffa3 (0x9494 bytes) 000896 1788917542.678524 mapread 0x0133d6 thru 0x01cc7f (0x98aa bytes) 000897 1788917542.692028 mapwrite 0x0241d4 thru 0x027f21 (0x3d4e bytes) 000898 1788917542.731561 mapread 0x00f39c thru 0x01ca58 (0xd6bd bytes) 000899 1788917542.732754 trunc from 0x03ffa4 to 0x02a4b4 (0x15aef bytes) 000900 1788917542.745276 trunc from 0x02a4b5 to 0x02ad66 (0x8b2 bytes) 000902 1788917542.755010 mapread 0x00d0db thru 0x01afb0 (0xded6 bytes) 000903 1788917542.761992 mapread 0x01a7e2 thru 0x01e73d (0x3f5c bytes) 000904 1788917542.763047 mapwrite 0x011382 thru 0x016957 (0x55d6 bytes) 000905 1788917542.789246 write 0x0213a6 thru 0x0220ab (0xd06 bytes) 000906 1788917542.794189 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2ad67): Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ad67): Mirror 19: 0x1da924c4 (stale) Mirror 22: 0x1da924c4 (stale) Mirror 25: 0x1da924c4 (stale) Mirror 26: 0x1da924c4 (stale) Mirror 27: 0x1da924c4 (stale) Mirror 28: 0x1da924c4 (stale) Mirror 29: 0x1da924c4 (stale) Mirror 30: 0x1da924c4 (stale) Mirror 31: 0xee6b0592 (stale) Mirror 32: 0xee6b0592 (stale) CRC-32 checksum value for chunk [0, 0x2ad67): Mirror 1: 0x5df6ee3a Mirror 33: 0x5df6ee3a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ad67: skipped 000907 1788917543.260648 write 0x00340c thru 0x00cf06 (0x9afb bytes) 000909 1788917543.307052 read 0x016918 thru 0x017ef6 (0x15df bytes) 000910 1788917543.310835 mapread 0x01823a thru 0x022cfa (0xaac1 bytes) 000911 1788917543.321592 mapwrite 0x020cb8 thru 0x02dfbd (0xd306 bytes) 000913 1788917543.384031 mapread 0x01ae09 thru 0x0253bb (0xa5b3 bytes) 000914 1788917543.387738 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2dfbe): Mirror 19: 0xbaaff761 (stale) Mirror 22: 0xbaaff761 (stale) Mirror 25: 0xbaaff761 (stale) Mirror 27: 0xbaaff761 (stale) Mirror 28: 0xbaaff761 (stale) Mirror 29: 0xbaaff761 (stale) Mirror 30: 0xbaaff761 (stale) Mirror 31: 0x41273e86 (stale) Mirror 32: 0x41273e86 (stale) Mirror 33: 0x472f3c5e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dfbe): Mirror 19: 0xbaaff761 (stale) Mirror 22: 0xbaaff761 (stale) Mirror 25: 0xbaaff761 (stale) Mirror 27: 0xbaaff761 (stale) Mirror 28: 0xbaaff761 (stale) Mirror 29: 0xbaaff761 (stale) Mirror 30: 0xbaaff761 (stale) Mirror 31: 0x41273e86 (stale) Mirror 32: 0x41273e86 (stale) Mirror 33: 0x472f3c5e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dfbe: skipped 000915 1788917543.659436 mapread 0x01f316 thru 0x029838 (0xa523 bytes) 000918 1788917543.670406 write 0x028fc6 thru 0x02e508 (0x5543 bytes) 000919 1788917543.671755 read 0x0120bc thru 0x021bc8 (0xfb0d bytes) 000920 1788917543.676052 mapwrite 0x00de17 thru 0x010f3e (0x3128 bytes) 000921 1788917543.704203 mapread 0x01867f thru 0x027c61 (0xf5e3 bytes) 000923 1788917543.708491 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e509): Mirror 19: 0xb12c5980 (stale) Mirror 22: 0xb12c5980 (stale) Mirror 25: 0xb12c5980 (stale) Mirror 27: 0xb12c5980 (stale) Mirror 28: 0xb12c5980 (stale) Mirror 29: 0xb12c5980 (stale) Mirror 31: 0xd4ff216f (stale) Mirror 32: 0xd4ff216f (stale) Mirror 33: 0x11644652 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e509): Mirror 19: 0xb12c5980 (stale) Mirror 22: 0xb12c5980 (stale) Mirror 25: 0xb12c5980 (stale) Mirror 27: 0xb12c5980 (stale) Mirror 28: 0xb12c5980 (stale) Mirror 29: 0xb12c5980 (stale) Mirror 31: 0xd4ff216f (stale) Mirror 32: 0xd4ff216f (stale) Mirror 33: 0x11644652 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e509: skipped 000924 1788917544.010166 mapread 0x0010b1 thru 0x00c83c (0xb78c bytes) 000926 1788917544.024715 write 0x01783d thru 0x021b5e (0xa322 bytes) 000927 1788917544.035884 mapwrite 0x03244f thru 0x034dec (0x299e bytes) 000928 1788917544.097658 write 0x03a812 thru 0x03ffff (0x57ee bytes) 000929 1788917544.099071 mapread 0x0186ec thru 0x020ef2 (0x8807 bytes) 000930 1788917544.100247 read 0x0176cf thru 0x01a377 (0x2ca9 bytes) 000937 1788917544.104237 write 0x02ea37 thru 0x0345e0 (0x5baa bytes) 000938 1788917544.105755 mapwrite 0x00f94d thru 0x016190 (0x6844 bytes) 000939 1788917544.142331 mapwrite 0x002b01 thru 0x012087 (0xf587 bytes) 000940 1788917544.170258 mapwrite 0x019fca thru 0x01ede9 (0x4e20 bytes) 000942 1788917544.198237 trunc from 0x040000 to 0x023dbd (0x1c242 bytes) 000943 1788917544.207838 write 0x01eac2 thru 0x02ba6e (0xcfad bytes) 000944 1788917544.212041 MIRROR_RESYNC 10 mirrors 000945 1788917544.996119 mapread 0x029057 thru 0x02ba6e (0x2a18 bytes) 000946 1788917545.008352 read 0x028f1b thru 0x02ba6e (0x2b54 bytes) 000950 1788917545.009672 mapwrite 0x01ef44 thru 0x022947 (0x3a04 bytes) 000951 1788917545.094826 mapread 0x018f83 thru 0x026411 (0xd48f bytes) 000955 1788917545.097853 read 0x018e33 thru 0x01a587 (0x1755 bytes) 000956 1788917545.098440 trunc from 0x02ba6f to 0x00d469 (0x1e605 bytes) 000957 1788917545.112346 write 0x00088d thru 0x006eb3 (0x6627 bytes) 000959 1788917545.121781 trunc from 0x00d46a to 0x02a3bd (0x1cf54 bytes) 000963 1788917545.136439 mapwrite 0x03a00f thru 0x03ac3a (0xc2c bytes) 000965 1788917545.193532 trunc from 0x03ac3b to 0x0182f8 (0x22942 bytes) 000967 1788917545.207950 write 0x00ae37 thru 0x00ebc0 (0x3d8a bytes) 000968 1788917545.211586 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x182f9): Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x182f9): Mirror 19: 0xc7c6c7a5 (stale) Mirror 22: 0xc7c6c7a5 (stale) Mirror 25: 0xc7c6c7a5 (stale) Mirror 27: 0xc7c6c7a5 (stale) Mirror 28: 0xc7c6c7a5 (stale) Mirror 29: 0xc7c6c7a5 (stale) Mirror 31: 0xc7c6c7a5 (stale) Mirror 32: 0xc7c6c7a5 (stale) Mirror 33: 0xc7c6c7a5 (stale) CRC-32 checksum value for chunk [0, 0x182f9): Mirror 1: 0x8705d783 Mirror 34: 0x8705d783 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x182f9: skipped 000969 1788917545.802044 trunc from 0x0182f9 to 0x037d3c (0x1fa44 bytes) 000970 1788917545.859108 read 0x0255a9 thru 0x028a29 (0x3481 bytes) 000971 1788917545.864415 trunc from 0x037d3d to 0x03b0da (0x339e bytes) 000972 1788917545.876669 trunc from 0x03b0db to 0x028baf (0x1252b bytes) 000974 1788917545.887472 MIRROR_RESYNC 11 mirrors 000975 1788917546.772990 mapwrite 0x01872f thru 0x022ab9 (0xa38b bytes) 000976 1788917546.877981 mapread 0x00b77d thru 0x011b88 (0x640c bytes) 000978 1788917546.887594 read 0x01384b thru 0x01d459 (0x9c0f bytes) 000979 1788917546.888450 mapread 0x0269bc thru 0x02739d (0x9e2 bytes) 000980 1788917546.893918 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x492:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28bb0): Mirror 19: 0xcdb8b36c (stale) Mirror 22: 0xcdb8b36c (stale) Mirror 25: 0xcdb8b36c (stale) Mirror 27: 0xcdb8b36c (stale) Mirror 28: 0xcdb8b36c (stale) Mirror 31: 0xcdb8b36c (stale) Mirror 32: 0xcdb8b36c (stale) Mirror 33: 0xcdb8b36c (stale) Mirror 34: 0xcdb8b36c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28bb0): Mirror 19: 0xcdb8b36c (stale) Mirror 22: 0xcdb8b36c (stale) Mirror 25: 0xcdb8b36c (stale) Mirror 27: 0xcdb8b36c (stale) Mirror 28: 0xcdb8b36c (stale) Mirror 31: 0xcdb8b36c (stale) Mirror 32: 0xcdb8b36c (stale) Mirror 33: 0xcdb8b36c (stale) Mirror 34: 0xcdb8b36c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28bb0: skipped 000983 1788917547.131546 mapread 0x00815c thru 0x0134ae (0xb353 bytes) 000984 1788917547.142707 mapwrite 0x03f78a thru 0x03ffff (0x876 bytes) 000985 1788917547.167631 write 0x002053 thru 0x00b470 (0x941e bytes) 000986 1788917547.171300 mapwrite 0x014f47 thru 0x0245a0 (0xf65a bytes) 000988 1788917547.198702 trunc from 0x040000 to 0x02abfd (0x15402 bytes) 000990 1788917547.207860 trunc from 0x02abfe to 0x017047 (0x13bb6 bytes) 000992 1788917547.219987 mapread 0x002043 thru 0x004690 (0x264e bytes) 000993 1788917547.221094 mapwrite 0x00d41d thru 0x0140d1 (0x6cb5 bytes) 000996 1788917547.254383 mapwrite 0x009fb7 thru 0x01560b (0xb655 bytes) 000997 1788917547.286643 MIRROR_RESYNC 10 mirrors 000998 1788917547.807664 trunc from 0x017048 to 0x03593e (0x1e8f7 bytes) 000999 1788917547.851561 trunc from 0x03593f to 0x007396 (0x2e5a8 bytes) 001000 1788917547.863634 mapwrite 0x016a9a thru 0x0211b9 (0xa720 bytes) All operations completed A-OK!