== sanity-flr test 70a: flr mode fsx test ================ 20:24:13 (1784939053) Seed set to 9055 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1784939055.294135 write 0x01fd60 thru 0x02797d (0x7c1e bytes) truncating to largest ever: 0x36569 000003 1784939055.307165 trunc from 0x02797e to 0x036568 (0xebeb bytes) 000004 1784939055.329096 write 0x03d4ea thru 0x03ffff (0x2b16 bytes) 000006 1784939088.154040 trunc from 0x040000 to 0x0203b5 (0x1fc4a bytes) 000007 1784939088.182674 read 0x01ea6d thru 0x0203b5 (0x1949 bytes) 000008 1784939088.197874 mapwrite 0x002b28 thru 0x00e2ff (0xb7d8 bytes) 000009 1784939088.464975 MIRROR_EXTEND to 2 mirrors 000010 1784939089.319248 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) 000011 1784939089.527256 trunc from 0x0203b6 to 0x006003 (0x1a3b2 bytes) 000014 1784939089.601920 MIRROR_EXTEND to 2 mirrors 000015 1784939090.801072 trunc from 0x006004 to 0x010969 (0xa966 bytes) 000016 1784939090.940470 write 0x008f02 thru 0x00a951 (0x1a50 bytes) 000017 1784939090.981250 MIRROR_RESYNC 2 mirrors 000018 1784939092.553654 trunc from 0x01096a to 0x01484b (0x3ee2 bytes) 000023 1784939092.625968 trunc from 0x01484c to 0x032dcd (0x1e582 bytes) 000025 1784939092.647066 write 0x03eb3e thru 0x03ffff (0x14c2 bytes) 000026 1784939092.649317 mapread 0x00ecdb thru 0x01ba48 (0xcd6e bytes) 000027 1784939092.685706 mapwrite 0x039fff thru 0x03ffff (0x6001 bytes) 000029 1784939092.767982 mapread 0x02a7a0 thru 0x033db7 (0x9618 bytes) 000030 1784939092.781176 read 0x039404 thru 0x03ffff (0x6bfc bytes) 000032 1784939092.782513 read 0x00f89e thru 0x01cb8d (0xd2f0 bytes) 000035 1784939092.786963 write 0x01df4d thru 0x02adf6 (0xceaa bytes) 000037 1784939092.790777 trunc from 0x040000 to 0x017474 (0x28b8b bytes) 000038 1784939092.814757 trunc from 0x017475 to 0x0112c1 (0x61b3 bytes) 000039 1784939092.848923 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) 000041 1784939093.030195 write 0x0110ff thru 0x019586 (0x8488 bytes) 000042 1784939093.044896 mapread 0x00d649 thru 0x01017b (0x2b33 bytes) 000043 1784939093.063427 mapread 0x001d7f thru 0x003ecc (0x214e bytes) 000045 1784939093.077682 write 0x02cbdd thru 0x033324 (0x6748 bytes) truncating to largest ever: 0x3fb9e 000049 1784939093.083035 trunc from 0x033325 to 0x03fb9d (0xc879 bytes) 000050 1784939093.106744 write 0x03a978 thru 0x03ffff (0x5688 bytes) 000051 1784939093.115883 write 0x0060d5 thru 0x014d64 (0xec90 bytes) 000052 1784939093.118425 write 0x016608 thru 0x01fb6f (0x9568 bytes) 000056 1784939093.131771 read 0x030387 thru 0x03cdae (0xca28 bytes) 000058 1784939093.145182 trunc from 0x040000 to 0x019e2e (0x261d1 bytes) 000060 1784939093.172992 read 0x0058aa thru 0x00fcff (0xa456 bytes) 000061 1784939093.173712 trunc from 0x019e2f to 0x03059b (0x1676d bytes) 000062 1784939093.202848 MIRROR_EXTEND to 2 mirrors 000063 1784939094.683088 mapread 0x018110 thru 0x025165 (0xd056 bytes) 000066 1784939094.741605 read 0x021e8a thru 0x02e2f1 (0xc468 bytes) 000068 1784939094.753205 mapread 0x02df22 thru 0x03059b (0x267a bytes) 000069 1784939094.760633 write 0x0393b9 thru 0x03a5a7 (0x11ef bytes) 000070 1784939094.825419 trunc from 0x03a5a8 to 0x003a60 (0x36b47 bytes) 000071 1784939094.847894 write 0x00e506 thru 0x01e286 (0xfd81 bytes) 000072 1784939094.849819 read 0x001d1c thru 0x00b62f (0x9914 bytes) 000075 1784939094.864255 mapread 0x00aa7f thru 0x0162f8 (0xb87a bytes) 000076 1784939094.866396 mapread 0x00a623 thru 0x016c22 (0xc600 bytes) 000077 1784939094.868729 mapwrite 0x0240af thru 0x030298 (0xc1ea bytes) 000079 1784939095.011929 read 0x0234d8 thru 0x02acff (0x7828 bytes) 000081 1784939095.014129 write 0x0227d3 thru 0x025aba (0x32e8 bytes) 000083 1784939095.017006 trunc from 0x030299 to 0x010c7f (0x1f619 bytes) 000084 1784939095.034002 mapread 0x006627 thru 0x010ba3 (0xa57d bytes) 000085 1784939095.035491 write 0x0142d4 thru 0x02095d (0xc68a bytes) 000086 1784939095.037670 mapwrite 0x005490 thru 0x00dadd (0x864e bytes) 000087 1784939095.092909 write 0x0335be thru 0x03e9c2 (0xb405 bytes) 000090 1784939095.104558 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e9c3): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e9c3): Mirror 2: 0x9c82dae6 (stale) CRC-32 checksum value for chunk [0, 0x3e9c3): Mirror 1: 0xf5936ac1 Mirror 3: 0xf5936ac1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e9c3: skipped 000091 1784939096.580689 read 0x01d06d thru 0x01e126 (0x10ba bytes) 000094 1784939096.617287 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e9c3): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e9c3): Mirror 2: 0x9c82dae6 (stale) CRC-32 checksum value for chunk [0, 0x3e9c3): Mirror 1: 0xf5936ac1 Mirror 3: 0xf5936ac1 Mirror 4: 0xf5936ac1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e9c3: skipped 000096 1784939097.980533 read 0x03717f thru 0x03e9c2 (0x7844 bytes) 000099 1784939098.005302 read 0x03aab5 thru 0x03e9c2 (0x3f0e bytes) 000100 1784939098.009530 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e9c3): Mirror 2: 0x9c82dae6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e9c3): Mirror 2: 0x9c82dae6 (stale) CRC-32 checksum value for chunk [0, 0x3e9c3): Mirror 1: 0xf5936ac1 Mirror 3: 0xf5936ac1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e9c3: skipped 000102 1784939098.868417 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e9c3): Mirror 2: 0x9c82dae6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e9c3): Mirror 2: 0x9c82dae6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e9c3: skipped 000103 1784939099.185795 mapread 0x02276a thru 0x022e5f (0x6f6 bytes) 000105 1784939099.197955 mapwrite 0x01a4a1 thru 0x01d345 (0x2ea5 bytes) 000112 1784939099.320483 read 0x001637 thru 0x008810 (0x71da bytes) 000113 1784939099.332737 write 0x00b71c thru 0x0150cc (0x99b1 bytes) 000116 1784939099.346206 read 0x02a095 thru 0x03197c (0x78e8 bytes) 000118 1784939099.385553 mapwrite 0x006a1f thru 0x0071ee (0x7d0 bytes) 000120 1784939099.451954 mapwrite 0x028591 thru 0x02f6da (0x714a bytes) 000122 1784939099.508434 trunc from 0x03e9c3 to 0x00e945 (0x3007d bytes) 000123 1784939099.562495 MIRROR_RESYNC 2 mirrors 000125 1784939100.465935 read 0x00ae6d thru 0x00e945 (0x3ad9 bytes) 000130 1784939100.492689 mapread 0x00c8ee thru 0x00e945 (0x2058 bytes) 000131 1784939100.498454 MIRROR_EXTEND to 3 mirrors 000133 1784939101.920594 read 0x00d558 thru 0x00e945 (0x13ee bytes) 000136 1784939101.973942 mapread 0x000b8d thru 0x0070f5 (0x6569 bytes) 000137 1784939102.086176 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) 000139 1784939102.730358 read 0x000041 thru 0x00ad82 (0xad42 bytes) 000141 1784939102.756295 mapwrite 0x0302a3 thru 0x03cf24 (0xcc82 bytes) 000143 1784939102.985953 trunc from 0x03cf25 to 0x033c4e (0x92d6 bytes) 000145 1784939103.023444 trunc from 0x033c4f to 0x0149f7 (0x1f257 bytes) 000147 1784939103.044357 mapread 0x004882 thru 0x011929 (0xd0a8 bytes) 000148 1784939103.068526 mapread 0x00a474 thru 0x00cc62 (0x27ef bytes) 000150 1784939103.075421 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x149f8): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x149f8): Mirror 2: 0x3954af0d (stale) CRC-32 checksum value for chunk [0, 0x149f8): Mirror 1: 0x3954af0d Mirror 3: 0x3954af0d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x149f8: skipped 000152 1784939104.214042 mapread 0x007ba8 thru 0x014299 (0xc6f2 bytes) 000153 1784939104.289280 trunc from 0x0149f8 to 0x009a00 (0xaff7 bytes) 000154 1784939104.520201 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x9a01): Mirror 2: 0x9e379452 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9a01): Mirror 2: 0x9e379452 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9a01: skipped 000159 1784939104.874100 write 0x03d693 thru 0x03ffff (0x296d bytes) 000160 1784939104.882277 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x66fa44b9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7ef478b Mirror 3: 0x7ef478b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000161 1784939106.022822 trunc from 0x040000 to 0x01748b (0x28b74 bytes) 000166 1784939106.204835 read 0x00a108 thru 0x00fd08 (0x5c01 bytes) 000168 1784939106.235672 trunc from 0x01748c to 0x037396 (0x1ff0b bytes) 000171 1784939106.267336 read 0x00a4e5 thru 0x015269 (0xad85 bytes) 000172 1784939106.280481 trunc from 0x037397 to 0x0232e4 (0x140b2 bytes) 000173 1784939106.301933 write 0x016444 thru 0x01e2e9 (0x7ea6 bytes) 000174 1784939106.308633 MIRROR_RESYNC 3 mirrors 000176 1784939107.184281 trunc from 0x0232e5 to 0x028c11 (0x592d bytes) 000177 1784939107.279527 trunc from 0x028c12 to 0x0087d9 (0x20438 bytes) 000178 1784939107.305164 trunc from 0x0087da to 0x03b876 (0x3309d bytes) 000179 1784939107.346464 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b877): Mirror 3: 0x511c8185 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b877): Mirror 3: 0x511c8185 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b877: skipped 000180 1784939107.733736 trunc from 0x03b877 to 0x0380a5 (0x37d1 bytes) 000181 1784939107.759087 write 0x00711b thru 0x00c578 (0x545e bytes) 000183 1784939107.776535 write 0x0147ee thru 0x015f4e (0x1761 bytes) 000184 1784939107.796127 write 0x010873 thru 0x01cc7e (0xc40c bytes) 000185 1784939107.821503 MIRROR_RESYNC 2 mirrors 000186 1784939108.665804 write 0x02b95f thru 0x03a667 (0xed09 bytes) 000187 1784939108.780175 mapwrite 0x022360 thru 0x0314c3 (0xf164 bytes) 000191 1784939108.910136 read 0x026be5 thru 0x02bf22 (0x533e bytes) 000192 1784939108.915884 read 0x012e95 thru 0x015c00 (0x2d6c bytes) 000193 1784939108.951266 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) 000195 1784939109.192942 write 0x008565 thru 0x00a6a2 (0x213e bytes) 000197 1784939109.218250 trunc from 0x03a668 to 0x023ae1 (0x16b86 bytes) 000198 1784939109.259293 mapwrite 0x03e664 thru 0x03ffff (0x199c bytes) 000199 1784939109.386833 mapread 0x0327d9 thru 0x03dff3 (0xb81b bytes) 000200 1784939109.415186 write 0x035e35 thru 0x03ffff (0xa1cb bytes) 000202 1784939109.429309 read 0x03ceb2 thru 0x03ffff (0x314e bytes) 000204 1784939109.436804 mapwrite 0x035446 thru 0x036e08 (0x19c3 bytes) 000205 1784939109.569469 trunc from 0x040000 to 0x029fdc (0x16023 bytes) 000208 1784939109.599375 mapwrite 0x029ce8 thru 0x03662a (0xc943 bytes) 000212 1784939109.701502 write 0x0031c7 thru 0x00973a (0x6574 bytes) 000213 1784939109.710118 trunc from 0x03662b to 0x02f8d2 (0x6d58 bytes) 000214 1784939109.740326 read 0x000cb3 thru 0x00777b (0x6ac9 bytes) 000216 1784939109.750103 read 0x02e5c0 thru 0x02f8d2 (0x1313 bytes) 000217 1784939109.750895 mapwrite 0x008003 thru 0x0085c5 (0x5c3 bytes) 000218 1784939109.833097 trunc from 0x02f8d3 to 0x009f83 (0x2594f bytes) 000220 1784939109.879483 read 0x0032f2 thru 0x009f83 (0x6c92 bytes) 000221 1784939109.883183 read 0x009666 thru 0x009f83 (0x91e bytes) 000222 1784939109.885606 read 0x0010d8 thru 0x009f83 (0x8eac bytes) 000225 1784939109.891145 trunc from 0x009f84 to 0x033aef (0x29b6c bytes) 000226 1784939109.929068 trunc from 0x033af0 to 0x0219f4 (0x120fb bytes) 000233 1784939109.969469 write 0x00cc0d thru 0x0148b9 (0x7cad bytes) 000234 1784939109.982244 read 0x01dfc6 thru 0x01e95f (0x99a bytes) 000235 1784939109.983235 read 0x009d60 thru 0x00e989 (0x4c2a bytes) 000236 1784939109.988464 read 0x000f0b thru 0x009490 (0x8586 bytes) 000237 1784939109.989369 mapwrite 0x0181a4 thru 0x02519d (0xcffa bytes) 000240 1784939110.076960 read 0x0228db thru 0x02519d (0x28c3 bytes) 000241 1784939110.077806 mapwrite 0x00cb21 thru 0x0198a2 (0xcd82 bytes) 000242 1784939110.145505 mapread 0x00cbee thru 0x00e2ea (0x16fd bytes) 000246 1784939110.153600 mapread 0x004036 thru 0x00c931 (0x88fc bytes) 000247 1784939110.155958 mapwrite 0x021589 thru 0x0216af (0x127 bytes) 000248 1784939110.229648 mapread 0x0190f8 thru 0x020096 (0x6f9f bytes) 000250 1784939110.232432 read 0x018e1b thru 0x02519d (0xc383 bytes) 000252 1784939110.233726 trunc from 0x02519e to 0x02a343 (0x51a6 bytes) 000253 1784939110.253264 mapread 0x021bd8 thru 0x02a343 (0x876c bytes) 000254 1784939110.268522 trunc from 0x02a344 to 0x030b7d (0x683a bytes) 000255 1784939110.306091 read 0x0104dd thru 0x0140cb (0x3bef bytes) 000258 1784939110.312457 mapread 0x027506 thru 0x02d048 (0x5b43 bytes) 000260 1784939110.328241 mapwrite 0x014114 thru 0x02209d (0xdf8a bytes) 000261 1784939110.398957 mapwrite 0x036364 thru 0x039c2d (0x38ca bytes) 000262 1784939110.465894 mapread 0x028f2e thru 0x0326da (0x97ad bytes) 000264 1784939110.469399 mapread 0x00e6b0 thru 0x00f680 (0xfd1 bytes) 000266 1784939110.471155 mapread 0x02c9f5 thru 0x03963d (0xcc49 bytes) 000268 1784939110.474812 mapread 0x00e7b2 thru 0x016d17 (0x8566 bytes) 000270 1784939110.477686 trunc from 0x039c2e to 0x021484 (0x187a9 bytes) 000274 1784939110.516838 mapread 0x0210b7 thru 0x021484 (0x3ce bytes) 000276 1784939110.525680 read 0x015030 thru 0x021484 (0xc455 bytes) 000278 1784939110.532151 trunc from 0x021485 to 0x0025c6 (0x1eebe bytes) 000281 1784939110.569155 MIRROR_EXTEND to 2 mirrors 000283 1784939111.540973 trunc from 0x0025c7 to 0x003dc9 (0x1803 bytes) 000285 1784939111.644835 mapread 0x0033ac thru 0x003dc9 (0xa1e bytes) 000286 1784939111.652446 write 0x016629 thru 0x01cc45 (0x661d bytes) 000287 1784939111.655970 trunc from 0x01cc46 to 0x0056f6 (0x1754f bytes) 000289 1784939111.692936 write 0x0377fc thru 0x03f697 (0x7e9c bytes) 000290 1784939111.695087 write 0x012f42 thru 0x021f05 (0xefc4 bytes) 000291 1784939111.711122 write 0x02cbb1 thru 0x038dba (0xc20a bytes) 000293 1784939111.728973 MIRROR_RESYNC 2 mirrors 000294 1784939112.659193 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) 000295 1784939112.949090 mapwrite 0x002480 thru 0x002cea (0x86b bytes) 000296 1784939113.042828 trunc from 0x03f698 to 0x02dd99 (0x118fe bytes) 000297 1784939113.107962 MIRROR_EXTEND to 2 mirrors 000298 1784939114.147192 read 0x0212a6 thru 0x02dd99 (0xcaf4 bytes) 000299 1784939114.167470 mapread 0x0229b9 thru 0x024ea6 (0x24ee bytes) 000300 1784939114.168811 read 0x0160d9 thru 0x016df7 (0xd1f bytes) 000301 1784939114.181975 read 0x01ba90 thru 0x027021 (0xb592 bytes) 000302 1784939114.182526 mapread 0x02ce36 thru 0x02dd99 (0xf64 bytes) 000303 1784939114.183271 mapread 0x018f30 thru 0x027f56 (0xf027 bytes) 000304 1784939114.184262 write 0x00b354 thru 0x015001 (0x9cae bytes) 000305 1784939114.351341 write 0x00b92c thru 0x01ab50 (0xf225 bytes) 000306 1784939114.353888 read 0x015952 thru 0x01d3cd (0x7a7c bytes) 000307 1784939114.359480 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) 000309 1784939114.554485 mapread 0x0242b2 thru 0x024c72 (0x9c1 bytes) 000310 1784939114.568786 trunc from 0x02dd9a to 0x02475e (0x963b bytes) 000312 1784939114.615909 mapread 0x01cb7d thru 0x02181a (0x4c9e bytes) 000313 1784939114.647966 mapwrite 0x031980 thru 0x033db6 (0x2437 bytes) 000316 1784939114.773391 mapread 0x00c5f5 thru 0x017e53 (0xb85f bytes) 000317 1784939114.841954 trunc from 0x033db7 to 0x03d775 (0x99bf bytes) 000318 1784939114.866466 mapwrite 0x02daee thru 0x0330ef (0x5602 bytes) 000320 1784939114.940270 mapread 0x010377 thru 0x014016 (0x3ca0 bytes) 000323 1784939114.943383 mapwrite 0x033fb3 thru 0x03ffff (0xc04d bytes) 000328 1784939115.072253 trunc from 0x040000 to 0x0039b2 (0x3c64d bytes) 000330 1784939115.109679 read 0x0004a2 thru 0x002186 (0x1ce5 bytes) 000331 1784939115.132292 write 0x02eb03 thru 0x0352e2 (0x67e0 bytes) 000333 1784939115.143413 MIRROR_EXTEND to 2 mirrors 000334 1784939116.502518 mapwrite 0x002921 thru 0x010e2e (0xe50e bytes) 000336 1784939116.788889 mapread 0x001234 thru 0x003da6 (0x2b73 bytes) 000337 1784939116.796610 mapread 0x030618 thru 0x03204c (0x1a35 bytes) 000338 1784939116.807712 read 0x00623e thru 0x015900 (0xf6c3 bytes) 000339 1784939116.819819 read 0x01c1e1 thru 0x02a5d8 (0xe3f8 bytes) 000340 1784939116.852810 write 0x0053f5 thru 0x00c986 (0x7592 bytes) 000343 1784939116.861923 trunc from 0x0352e3 to 0x0306c7 (0x4c1b bytes) 000346 1784939116.907079 read 0x0166af thru 0x024405 (0xdd57 bytes) 000347 1784939116.908510 read 0x00cf5c thru 0x01b777 (0xe81c bytes) 000350 1784939116.930368 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x306c8): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x306c8): Mirror 2: 0x92c610e1 (stale) CRC-32 checksum value for chunk [0, 0x306c8): Mirror 1: 0x697234be Mirror 3: 0x697234be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x306c8: skipped 000351 1784939118.186050 write 0x03b294 thru 0x03e73b (0x34a8 bytes) 000352 1784939118.279126 write 0x004462 thru 0x005367 (0xf06 bytes) 000353 1784939118.293388 read 0x01a828 thru 0x01eaf1 (0x42ca bytes) 000354 1784939118.301918 mapwrite 0x03d1cf thru 0x03ffff (0x2e31 bytes) 000355 1784939118.378771 mapread 0x03370d thru 0x033f4d (0x841 bytes) 000356 1784939118.387928 mapwrite 0x00e165 thru 0x01dae5 (0xf981 bytes) 000357 1784939118.474853 mapwrite 0x019342 thru 0x019f6a (0xc29 bytes) 000358 1784939118.521868 mapwrite 0x03455d thru 0x03ffff (0xbaa3 bytes) 000359 1784939118.611815 MIRROR_RESYNC 3 mirrors 000360 1784939119.557347 trunc from 0x040000 to 0x01801e (0x27fe1 bytes) 000361 1784939119.664107 mapwrite 0x01f968 thru 0x022846 (0x2edf bytes) 000362 1784939119.806094 write 0x00de65 thru 0x016bcb (0x8d67 bytes) 000363 1784939119.832829 read 0x00b09c thru 0x014113 (0x9078 bytes) 000366 1784939119.846778 trunc from 0x022847 to 0x027b80 (0x533a bytes) 000369 1784939119.871848 read 0x0020bd thru 0x003ca9 (0x1bed bytes) 000370 1784939119.900345 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x27b81): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27b81): Mirror 2: 0x4570e754 (stale) Mirror 3: 0x4570e754 (stale) CRC-32 checksum value for chunk [0, 0x27b81): Mirror 1: 0xf4685159 Mirror 4: 0xf4685159 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27b81: skipped 000371 1784939121.112793 read 0x016c2d thru 0x02533d (0xe711 bytes) 000372 1784939121.179625 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x27b81): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27b81): Mirror 2: 0x4570e754 (stale) Mirror 3: 0x4570e754 (stale) CRC-32 checksum value for chunk [0, 0x27b81): Mirror 1: 0xf4685159 Mirror 4: 0xf4685159 Mirror 5: 0xf4685159 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27b81: skipped 000373 1784939122.302426 read 0x02643a thru 0x027b80 (0x1747 bytes) 000374 1784939122.316908 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x27b81): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27b81): Mirror 2: 0x4570e754 (stale) Mirror 3: 0x4570e754 (stale) CRC-32 checksum value for chunk [0, 0x27b81): Mirror 1: 0xf4685159 Mirror 4: 0xf4685159 Mirror 5: 0xf4685159 Mirror 6: 0xf4685159 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27b81: skipped 000375 1784939123.312854 mapwrite 0x0092b2 thru 0x012527 (0x9276 bytes) 000377 1784939123.510990 write 0x0323d8 thru 0x03c126 (0x9d4f bytes) 000378 1784939123.514233 trunc from 0x03c127 to 0x001a08 (0x3a71e bytes) 000381 1784939123.558923 trunc from 0x001a09 to 0x026827 (0x24e1f bytes) 000382 1784939123.593764 MIRROR_RESYNC 6 mirrors 000384 1784939125.178784 mapwrite 0x02c847 thru 0x032a17 (0x61d1 bytes) 000386 1784939125.377885 mapwrite 0x03e809 thru 0x03ffff (0x17f7 bytes) 000389 1784939125.504071 read 0x01e35d thru 0x0210f2 (0x2d96 bytes) 000390 1784939125.514545 mapwrite 0x000821 thru 0x00703d (0x681d bytes) 000392 1784939125.591285 read 0x03ef28 thru 0x03ffff (0x10d8 bytes) 000393 1784939125.592299 mapwrite 0x039338 thru 0x03ffff (0x6cc8 bytes) 000394 1784939125.657670 mapwrite 0x0329da thru 0x033f68 (0x158f bytes) 000395 1784939125.721494 mapwrite 0x018d3f thru 0x01c015 (0x32d7 bytes) 000397 1784939125.805495 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 5: 0xe20eea22 (stale) Mirror 6: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 5: 0xe20eea22 (stale) Mirror 6: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000398 1784939126.235718 mapread 0x0289d7 thru 0x034890 (0xbeba bytes) 000400 1784939126.277743 mapwrite 0x02e2b9 thru 0x036bcd (0x8915 bytes) 000403 1784939126.367227 mapwrite 0x000e5d thru 0x00327d (0x2421 bytes) 000404 1784939126.424877 mapread 0x03a74f thru 0x03f7fe (0x50b0 bytes) 000405 1784939126.437193 MIRROR_RESYNC 5 mirrors 000406 1784939127.572155 mapwrite 0x02925c thru 0x038cf1 (0xfa96 bytes) 000407 1784939127.805174 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x367a13eb (stale) Mirror 5: 0x367a13eb (stale) Mirror 6: 0x367a13eb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x367a13eb (stale) Mirror 5: 0x367a13eb (stale) Mirror 6: 0x367a13eb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000408 1784939128.235463 write 0x038317 thru 0x03d8d6 (0x55c0 bytes) 000409 1784939128.272975 trunc from 0x040000 to 0x00651c (0x39ae3 bytes) 000410 1784939128.298751 trunc from 0x00651d to 0x03cf29 (0x36a0d bytes) 000412 1784939128.321065 mapread 0x02ecf8 thru 0x03cf29 (0xe232 bytes) 000413 1784939128.360848 MIRROR_RESYNC 4 mirrors 000415 1784939129.442268 mapread 0x00e16f thru 0x00eec0 (0xd52 bytes) 000416 1784939129.457523 read 0x018dde thru 0x01cb9d (0x3dc0 bytes) 000417 1784939129.480449 trunc from 0x03cf2a to 0x00e4e8 (0x2ea41 bytes) 000419 1784939129.637194 mapread 0x00d176 thru 0x00e4e8 (0x1373 bytes) 000421 1784939129.677239 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe4e9): Mirror 5: 0xec5cbe91 (stale) Mirror 6: 0xec5cbe91 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe4e9): Mirror 5: 0xec5cbe91 (stale) Mirror 6: 0xec5cbe91 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe4e9: skipped 000422 1784939130.110748 mapwrite 0x006f81 thru 0x0118b1 (0xa931 bytes) 000423 1784939130.282996 write 0x00fb30 thru 0x018c30 (0x9101 bytes) 000425 1784939130.287621 write 0x03bd59 thru 0x03ffff (0x42a7 bytes) 000427 1784939130.290297 mapwrite 0x021517 thru 0x028553 (0x703d bytes) 000428 1784939130.384381 mapread 0x033e30 thru 0x03f3b4 (0xb585 bytes) 000436 1784939130.407157 mapread 0x002e5c thru 0x007c93 (0x4e38 bytes) 000437 1784939130.408639 trunc from 0x040000 to 0x021c57 (0x1e3a8 bytes) 000438 1784939130.431698 write 0x024f4b thru 0x02cc1c (0x7cd2 bytes) 000439 1784939130.433532 mapread 0x029426 thru 0x02cc1c (0x37f7 bytes) 000440 1784939130.434895 mapread 0x001c63 thru 0x005d9a (0x4138 bytes) 000441 1784939130.441323 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2cc1d): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cc1d): Mirror 5: 0xb83b7eb2 (stale) Mirror 6: 0xb83b7eb2 (stale) CRC-32 checksum value for chunk [0, 0x2cc1d): Mirror 1: 0x4e42dc4c Mirror 7: 0x4e42dc4c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cc1d: skipped 000442 1784939131.351871 write 0x0040ba thru 0x009588 (0x54cf bytes) 000443 1784939131.440055 write 0x0391f4 thru 0x03ffff (0x6e0c bytes) 000445 1784939131.443952 trunc from 0x040000 to 0x0253f5 (0x1ac0a bytes) 000447 1784939131.500991 mapwrite 0x029d5e thru 0x0369c2 (0xcc65 bytes) 000448 1784939131.663054 mapread 0x0195f6 thru 0x02295d (0x9368 bytes) 000449 1784939131.680919 trunc from 0x0369c3 to 0x0250ee (0x118d4 bytes) 000452 1784939131.717408 trunc from 0x0250ef to 0x02e21f (0x9131 bytes) 000454 1784939131.750909 mapread 0x0152b6 thru 0x022022 (0xcd6d bytes) 000455 1784939131.753120 trunc from 0x02e220 to 0x010ceb (0x1d534 bytes) 000456 1784939131.773845 trunc from 0x010cec to 0x0087a1 (0x854a bytes) 000457 1784939131.796822 mapwrite 0x032e4c thru 0x03a0ca (0x727f bytes) 000458 1784939131.955404 mapread 0x016ccc thru 0x017927 (0xc5c bytes) 000460 1784939131.977592 mapwrite 0x014c1b thru 0x01e5bd (0x99a3 bytes) 000461 1784939132.064814 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3a0cb): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a0cb): Mirror 5: 0xf6c4ddd2 (stale) Mirror 6: 0xf6c4ddd2 (stale) Mirror 7: 0xf8171b6c (stale) CRC-32 checksum value for chunk [0, 0x3a0cb): Mirror 1: 0xa2e40fec Mirror 8: 0xa2e40fec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a0cb: skipped 000462 1784939133.244215 write 0x00c725 thru 0x01af5e (0xe83a bytes) 000467 1784939133.381374 read 0x0185e0 thru 0x0220bc (0x9add bytes) 000468 1784939133.404432 read 0x00efc6 thru 0x01b364 (0xc39f bytes) 000469 1784939133.405503 read 0x002b3b thru 0x00a7dd (0x7ca3 bytes) 000470 1784939133.420491 trunc from 0x03a0cb to 0x01d5cf (0x1cafb bytes) 000471 1784939133.485158 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1d5d0): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d5d0): Mirror 5: 0x3ee3239f (stale) Mirror 6: 0x3ee3239f (stale) Mirror 7: 0xcf3ad97e (stale) Mirror 8: 0x624b27a4 (stale) CRC-32 checksum value for chunk [0, 0x1d5d0): Mirror 1: 0x4bd4b169 Mirror 9: 0x4bd4b169 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d5d0: skipped 000474 1784939134.603113 mapwrite 0x006c73 thru 0x01064d (0x99db bytes) 000476 1784939134.804173 mapread 0x0093ee thru 0x011a1f (0x8632 bytes) 000479 1784939134.816534 trunc from 0x01d5d0 to 0x026ebb (0x98ec bytes) 000482 1784939134.845084 write 0x001fa0 thru 0x0090d0 (0x7131 bytes) 000483 1784939134.847389 trunc from 0x026ebc to 0x0073dc (0x1fadf bytes) 000484 1784939134.867424 mapwrite 0x010908 thru 0x01ab2e (0xa227 bytes) 000485 1784939135.000213 trunc from 0x01ab2f to 0x016cc1 (0x3e6d bytes) 000489 1784939135.020092 mapwrite 0x01acdf thru 0x0249c2 (0x9ce4 bytes) 000490 1784939135.176919 MIRROR_RESYNC 6 mirrors 000494 1784939136.768962 mapread 0x01cebb thru 0x0249c2 (0x7b08 bytes) 000495 1784939136.796184 write 0x0386a3 thru 0x03e7ea (0x6148 bytes) 000497 1784939136.938370 MIRROR_RESYNC 6 mirrors 000498 1784939138.548034 mapread 0x01602b thru 0x01d0a9 (0x707f bytes) 000499 1784939138.604979 read 0x020b53 thru 0x03032c (0xf7da bytes) 000500 1784939138.616474 mapread 0x01a51c thru 0x021c01 (0x76e6 bytes) 000503 1784939138.621414 write 0x016174 thru 0x023324 (0xd1b1 bytes) 000505 1784939138.765144 read 0x00453a thru 0x00d705 (0x91cc bytes) 000507 1784939138.788636 trunc from 0x03e7eb to 0x03c564 (0x2286 bytes) 000508 1784939138.836729 trunc from 0x03c565 to 0x01ab77 (0x219ed bytes) 000510 1784939138.863430 write 0x0359ce thru 0x035e65 (0x498 bytes) 000511 1784939138.865087 trunc from 0x035e66 to 0x016cd8 (0x1f18d bytes) 000514 1784939138.892349 mapwrite 0x010ba4 thru 0x01dc37 (0xd094 bytes) 000515 1784939139.094894 mapread 0x0189b0 thru 0x01aac7 (0x2118 bytes) 000516 1784939139.097541 trunc from 0x01dc38 to 0x00a562 (0x136d5 bytes) 000518 1784939139.129976 mapwrite 0x02a1b2 thru 0x031038 (0x6e87 bytes) 000519 1784939139.331077 read 0x01aa5e thru 0x029a13 (0xefb6 bytes) 000520 1784939139.360609 write 0x008bab thru 0x011eb5 (0x930b bytes) 000521 1784939139.385391 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x31039): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31039): Mirror 5: 0xb735ad74 (stale) Mirror 6: 0xb735ad74 (stale) Mirror 7: 0xb735ad74 (stale) Mirror 8: 0xb735ad74 (stale) Mirror 9: 0xb735ad74 (stale) CRC-32 checksum value for chunk [0, 0x31039): Mirror 1: 0x67ebaf1a Mirror 10: 0x67ebaf1a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31039: skipped 000522 1784939140.722137 mapread 0x02dcad thru 0x031038 (0x338c bytes) 000523 1784939140.757144 write 0x002adb thru 0x004632 (0x1b58 bytes) 000525 1784939140.853247 trunc from 0x031039 to 0x01d364 (0x13cd4 bytes) 000526 1784939140.931157 trunc from 0x01d365 to 0x03cf01 (0x1fb9d bytes) 000528 1784939140.950606 mapread 0x012326 thru 0x0176ea (0x53c5 bytes) 000529 1784939140.964139 MIRROR_RESYNC 7 mirrors 000530 1784939142.781233 MIRROR_EXTEND to 8 mirrors 000532 1784939144.092485 write 0x0185db thru 0x01c6cd (0x40f3 bytes) 000534 1784939144.196875 mapread 0x031cc8 thru 0x03cf01 (0xb23a bytes) 000535 1784939144.228559 mapwrite 0x0380ef thru 0x03822d (0x13f bytes) 000536 1784939144.285702 read 0x037d4c thru 0x03cf01 (0x51b6 bytes) 000539 1784939144.287507 read 0x008e4a thru 0x00b007 (0x21be bytes) 000540 1784939144.314648 read 0x03721f thru 0x03cf01 (0x5ce3 bytes) 000541 1784939144.316279 read 0x0187b7 thru 0x027d9d (0xf5e7 bytes) 000542 1784939144.317741 mapread 0x02b7fd thru 0x031cbc (0x64c0 bytes) 000544 1784939144.330748 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3cf02): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cf02): Mirror 5: 0x589f8873 (stale) Mirror 6: 0x589f8873 (stale) Mirror 7: 0x589f8873 (stale) Mirror 8: 0x589f8873 (stale) Mirror 9: 0x589f8873 (stale) Mirror 10: 0x589f8873 (stale) Mirror 11: 0x589f8873 (stale) CRC-32 checksum value for chunk [0, 0x3cf02): Mirror 1: 0x8d2c9967 Mirror 12: 0x8d2c9967 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cf02: skipped 000546 1784939145.933739 write 0x02073a thru 0x027374 (0x6c3b bytes) 000547 1784939146.081891 trunc from 0x03cf02 to 0x01df8c (0x1ef75 bytes) 000553 1784939146.133203 trunc from 0x01df8d to 0x02aaaa (0xcb1e bytes) 000555 1784939146.171526 mapread 0x029f8b thru 0x02aaaa (0xb20 bytes) 000557 1784939146.197224 trunc from 0x02aaab to 0x019f5e (0x10b4c bytes) 000559 1784939146.225605 mapread 0x01236d thru 0x015d10 (0x39a4 bytes) 000560 1784939146.240096 mapwrite 0x0027c4 thru 0x00cc1d (0xa45a bytes) 000561 1784939146.365421 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x19f5f): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19f5f): Mirror 5: 0x33389ec5 (stale) Mirror 6: 0x33389ec5 (stale) Mirror 7: 0x33389ec5 (stale) Mirror 8: 0x33389ec5 (stale) Mirror 9: 0x33389ec5 (stale) Mirror 10: 0x33389ec5 (stale) Mirror 11: 0x33389ec5 (stale) Mirror 12: 0x1e78d2df (stale) CRC-32 checksum value for chunk [0, 0x19f5f): Mirror 1: 0x1edaf2d5 Mirror 13: 0x1edaf2d5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19f5f: skipped 000563 1784939147.456686 mapread 0x017cdf thru 0x019f5e (0x2280 bytes) 000564 1784939147.489726 trunc from 0x019f5f to 0x01c01e (0x20c0 bytes) 000565 1784939147.621272 write 0x002e90 thru 0x004a37 (0x1ba8 bytes) 000567 1784939147.632317 trunc from 0x01c01f to 0x02dce7 (0x11cc9 bytes) 000570 1784939147.663489 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2dce8): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dce8): Mirror 5: 0xcc505025 (stale) Mirror 6: 0xcc505025 (stale) Mirror 7: 0xcc505025 (stale) Mirror 8: 0xcc505025 (stale) Mirror 9: 0xcc505025 (stale) Mirror 10: 0xcc505025 (stale) Mirror 11: 0xcc505025 (stale) Mirror 12: 0xd7071104 (stale) Mirror 13: 0x8297f76f (stale) CRC-32 checksum value for chunk [0, 0x2dce8): Mirror 1: 0xa6c2e984 Mirror 14: 0xa6c2e984 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dce8: skipped 000572 1784939149.365493 trunc from 0x02dce8 to 0x008ba5 (0x25142 bytes) 000574 1784939149.493173 read 0x002ce3 thru 0x008ba5 (0x5ec3 bytes) 000576 1784939149.520981 mapread 0x005da0 thru 0x008ba5 (0x2e06 bytes) 000580 1784939149.529122 write 0x019466 thru 0x0207ab (0x7346 bytes) 000581 1784939149.533856 mapwrite 0x000013 thru 0x004f9f (0x4f8d bytes) 000585 1784939149.652962 read 0x00be1e thru 0x019198 (0xd37b bytes) 000586 1784939149.673270 mapwrite 0x000a86 thru 0x008419 (0x7994 bytes) 000588 1784939149.755916 read 0x00901f thru 0x00f22f (0x6211 bytes) 000589 1784939149.757038 read 0x008e4e thru 0x013bf3 (0xada6 bytes) 000590 1784939149.761960 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x207ac): Mirror 5: 0x63f98044 (stale) Mirror 6: 0x63f98044 (stale) Mirror 7: 0x63f98044 (stale) Mirror 8: 0x63f98044 (stale) Mirror 9: 0x63f98044 (stale) Mirror 10: 0x63f98044 (stale) Mirror 12: 0xfbc30c98 (stale) Mirror 13: 0xfc63c33b (stale) Mirror 14: 0xfc8fda78 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x207ac): Mirror 5: 0x63f98044 (stale) Mirror 6: 0x63f98044 (stale) Mirror 7: 0x63f98044 (stale) Mirror 8: 0x63f98044 (stale) Mirror 9: 0x63f98044 (stale) Mirror 10: 0x63f98044 (stale) Mirror 12: 0xfbc30c98 (stale) Mirror 13: 0xfc63c33b (stale) Mirror 14: 0xfc8fda78 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x207ac: skipped 000591 1784939150.441045 write 0x00a753 thru 0x012e66 (0x8714 bytes) 000592 1784939150.451787 read 0x01cad9 thru 0x0207ab (0x3cd3 bytes) 000593 1784939150.461906 mapwrite 0x010e11 thru 0x02093d (0xfb2d bytes) 000595 1784939150.593639 read 0x002354 thru 0x00c8ad (0xa55a bytes) 000598 1784939150.613146 read 0x00038a thru 0x001cad (0x1924 bytes) 000600 1784939150.615368 mapread 0x01cbb9 thru 0x02093d (0x3d85 bytes) 000601 1784939150.616520 read 0x01330e thru 0x01f80a (0xc4fd bytes) 000606 1784939150.622837 read 0x00152f thru 0x01141c (0xfeee bytes) 000608 1784939150.625179 write 0x025315 thru 0x02f983 (0xa66f bytes) 000609 1784939150.626797 write 0x036dad thru 0x03ffff (0x9253 bytes) 000611 1784939150.630557 trunc from 0x040000 to 0x022817 (0x1d7e8 bytes) 000612 1784939150.651807 mapread 0x00243b thru 0x0061ba (0x3d80 bytes) 000613 1784939150.653177 mapwrite 0x03760f thru 0x03ffff (0x89f1 bytes) 000614 1784939150.743689 mapread 0x00f5e8 thru 0x01e134 (0xeb4d bytes) 000615 1784939150.747153 mapwrite 0x01eb0d thru 0x029ea1 (0xb395 bytes) 000616 1784939150.792396 read 0x01e8d2 thru 0x02a86d (0xbf9c bytes) 000619 1784939150.799098 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4bbdc935 (stale) Mirror 6: 0x4bbdc935 (stale) Mirror 7: 0x4bbdc935 (stale) Mirror 8: 0x4bbdc935 (stale) Mirror 9: 0x4bbdc935 (stale) Mirror 10: 0x4bbdc935 (stale) Mirror 12: 0xfcda268 (stale) Mirror 13: 0x5f48dcfd (stale) Mirror 14: 0x58afa365 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4f126684 Mirror 15: 0x4f126684 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000622 1784939152.349467 MIRROR_RESYNC 11 mirrors 000623 1784939154.710026 trunc from 0x040000 to 0x023ded (0x1c212 bytes) 000624 1784939154.846911 mapwrite 0x03dc7f thru 0x03ffff (0x2381 bytes) 000625 1784939154.984116 trunc from 0x040000 to 0x00f54d (0x30ab2 bytes) 000626 1784939155.003140 trunc from 0x00f54e to 0x017ce4 (0x8797 bytes) 000627 1784939155.031901 mapread 0x012a5f thru 0x017ce4 (0x5286 bytes) 000631 1784939155.058760 mapwrite 0x01b771 thru 0x021e41 (0x66d1 bytes) 000632 1784939155.197462 read 0x00d2c9 thru 0x01913d (0xbe75 bytes) 000633 1784939155.222244 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21e42): Mirror 5: 0x68454d53 (stale) Mirror 7: 0x68454d53 (stale) Mirror 8: 0x68454d53 (stale) Mirror 9: 0x68454d53 (stale) Mirror 10: 0x68454d53 (stale) Mirror 12: 0x68454d53 (stale) Mirror 13: 0x68454d53 (stale) Mirror 14: 0x68454d53 (stale) Mirror 15: 0x68454d53 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21e42): Mirror 5: 0x68454d53 (stale) Mirror 7: 0x68454d53 (stale) Mirror 8: 0x68454d53 (stale) Mirror 9: 0x68454d53 (stale) Mirror 10: 0x68454d53 (stale) Mirror 12: 0x68454d53 (stale) Mirror 13: 0x68454d53 (stale) Mirror 14: 0x68454d53 (stale) Mirror 15: 0x68454d53 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21e42: skipped 000635 1784939155.895112 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x21e42): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21e42): Mirror 5: 0x68454d53 (stale) Mirror 7: 0x68454d53 (stale) Mirror 8: 0x68454d53 (stale) Mirror 9: 0x68454d53 (stale) Mirror 10: 0x68454d53 (stale) Mirror 12: 0x68454d53 (stale) Mirror 13: 0x68454d53 (stale) Mirror 14: 0x68454d53 (stale) Mirror 15: 0x68454d53 (stale) CRC-32 checksum value for chunk [0, 0x21e42): Mirror 1: 0x6ed872bf Mirror 16: 0x6ed872bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21e42: skipped 000637 1784939157.379372 read 0x00c9c0 thru 0x013f61 (0x75a2 bytes) 000639 1784939157.412408 read 0x012ef8 thru 0x019d3b (0x6e44 bytes) 000640 1784939157.439461 trunc from 0x021e42 to 0x03271d (0x108dc bytes) 000641 1784939157.625136 read 0x0212d0 thru 0x025a8d (0x47be bytes) 000643 1784939157.639380 write 0x038484 thru 0x0388a2 (0x41f bytes) 000646 1784939157.644021 write 0x030cf6 thru 0x03eff2 (0xe2fd bytes) 000649 1784939157.651986 read 0x038ab6 thru 0x03d34a (0x4895 bytes) 000650 1784939157.657704 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3eff3): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eff3): Mirror 5: 0x5aa3bc7a (stale) Mirror 7: 0x5aa3bc7a (stale) Mirror 8: 0x5aa3bc7a (stale) Mirror 9: 0x5aa3bc7a (stale) Mirror 10: 0x5aa3bc7a (stale) Mirror 12: 0x5aa3bc7a (stale) Mirror 13: 0x5aa3bc7a (stale) Mirror 14: 0x5aa3bc7a (stale) Mirror 15: 0x5aa3bc7a (stale) Mirror 16: 0xd5fd2ef8 (stale) CRC-32 checksum value for chunk [0, 0x3eff3): Mirror 1: 0x7016e9c0 Mirror 17: 0x7016e9c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eff3: skipped 000651 1784939159.228304 trunc from 0x03eff3 to 0x0135cc (0x2ba26 bytes) 000652 1784939159.351051 mapwrite 0x00443c thru 0x011a85 (0xd64a bytes) 000653 1784939159.505859 mapwrite 0x01e5ac thru 0x01e86d (0x2c2 bytes) 000654 1784939159.574234 mapread 0x0104a6 thru 0x014bcc (0x4727 bytes) 000658 1784939159.585643 mapwrite 0x034695 thru 0x039a7a (0x53e6 bytes) 000660 1784939159.731494 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39a7b): Mirror 5: 0x9fc5f71d (stale) Mirror 8: 0x9fc5f71d (stale) Mirror 9: 0x9fc5f71d (stale) Mirror 10: 0x9fc5f71d (stale) Mirror 12: 0x9fc5f71d (stale) Mirror 13: 0x9fc5f71d (stale) Mirror 14: 0x9fc5f71d (stale) Mirror 15: 0x9fc5f71d (stale) Mirror 16: 0xf51599f (stale) Mirror 17: 0x97f99168 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a7b): Mirror 5: 0x9fc5f71d (stale) Mirror 8: 0x9fc5f71d (stale) Mirror 9: 0x9fc5f71d (stale) Mirror 10: 0x9fc5f71d (stale) Mirror 12: 0x9fc5f71d (stale) Mirror 13: 0x9fc5f71d (stale) Mirror 14: 0x9fc5f71d (stale) Mirror 15: 0x9fc5f71d (stale) Mirror 16: 0xf51599f (stale) Mirror 17: 0x97f99168 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a7b: skipped 000661 1784939160.833070 read 0x005c04 thru 0x00c9f1 (0x6dee bytes) 000662 1784939160.859612 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x39a7b): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a7b): Mirror 5: 0x9fc5f71d (stale) Mirror 8: 0x9fc5f71d (stale) Mirror 9: 0x9fc5f71d (stale) Mirror 10: 0x9fc5f71d (stale) Mirror 12: 0x9fc5f71d (stale) Mirror 13: 0x9fc5f71d (stale) Mirror 14: 0x9fc5f71d (stale) Mirror 15: 0x9fc5f71d (stale) Mirror 16: 0xf51599f (stale) Mirror 17: 0x97f99168 (stale) CRC-32 checksum value for chunk [0, 0x39a7b): Mirror 1: 0xc16cbc15 Mirror 18: 0xc16cbc15 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a7b: skipped 000663 1784939162.409552 mapread 0x0338f1 thru 0x039a7a (0x618a bytes) 000665 1784939162.479420 mapwrite 0x00fbeb thru 0x01b7a0 (0xbbb6 bytes) 000668 1784939162.808179 write 0x029d1c thru 0x03846a (0xe74f bytes) 000669 1784939162.833481 mapwrite 0x00fae0 thru 0x01e2e9 (0xe80a bytes) 000670 1784939162.917225 write 0x0193e6 thru 0x0211ef (0x7e0a bytes) 000672 1784939162.929078 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x39a7b): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a7b): Mirror 5: 0x9fc5f71d (stale) Mirror 8: 0x9fc5f71d (stale) Mirror 9: 0x9fc5f71d (stale) Mirror 10: 0x9fc5f71d (stale) Mirror 12: 0x9fc5f71d (stale) Mirror 13: 0x9fc5f71d (stale) Mirror 14: 0x9fc5f71d (stale) Mirror 15: 0x9fc5f71d (stale) Mirror 16: 0xf51599f (stale) Mirror 17: 0x97f99168 (stale) Mirror 18: 0xc16cbc15 (stale) CRC-32 checksum value for chunk [0, 0x39a7b): Mirror 1: 0xa279f88a Mirror 19: 0xa279f88a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a7b: skipped 000673 1784939164.204288 mapwrite 0x02b2db thru 0x0310e8 (0x5e0e bytes) 000674 1784939164.475073 mapread 0x03106d thru 0x039a7a (0x8a0e bytes) 000675 1784939164.510077 mapread 0x00aac1 thru 0x0114e4 (0x6a24 bytes) 000677 1784939164.532992 MIRROR_RESYNC 13 mirrors 000678 1784939167.092165 write 0x01a911 thru 0x01f43c (0x4b2c bytes) 000679 1784939167.189769 mapwrite 0x00282c thru 0x01253e (0xfd13 bytes) 000680 1784939167.345783 MIRROR_RESYNC 13 mirrors 000681 1784939169.504561 mapread 0x0341f1 thru 0x039a7a (0x588a bytes) 000683 1784939169.545430 write 0x00d7b9 thru 0x01d2df (0xfb27 bytes) 000686 1784939169.683292 mapread 0x02a15f thru 0x034840 (0xa6e2 bytes) 000687 1784939169.720397 trunc from 0x039a7b to 0x01dc77 (0x1be03 bytes) 000689 1784939169.767875 mapread 0x00a7a1 thru 0x00ce51 (0x26b1 bytes) 000691 1784939169.778989 read 0x00e66a thru 0x013445 (0x4ddc bytes) 000694 1784939169.783475 mapwrite 0x0308e0 thru 0x034f34 (0x4655 bytes) 000695 1784939169.905795 write 0x019d69 thru 0x029768 (0xfa00 bytes) 000696 1784939169.913296 mapread 0x028cbc thru 0x034f34 (0xc279 bytes) 000699 1784939169.919315 read 0x01a057 thru 0x01c9f6 (0x29a0 bytes) 000700 1784939169.920241 trunc from 0x034f35 to 0x013f04 (0x21030 bytes) 000701 1784939169.952162 mapwrite 0x03d0cc thru 0x03eb62 (0x1a97 bytes) 000702 1784939170.123209 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3eb63): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb63): Mirror 5: 0xcfaac153 (stale) Mirror 8: 0xcfaac153 (stale) Mirror 9: 0xcfaac153 (stale) Mirror 10: 0xcfaac153 (stale) Mirror 12: 0xcfaac153 (stale) Mirror 13: 0xcfaac153 (stale) Mirror 14: 0xcfaac153 (stale) Mirror 15: 0xcfaac153 (stale) Mirror 16: 0xcfaac153 (stale) Mirror 17: 0xcfaac153 (stale) Mirror 18: 0xcfaac153 (stale) Mirror 19: 0xcfaac153 (stale) CRC-32 checksum value for chunk [0, 0x3eb63): Mirror 1: 0xcdcd1110 Mirror 20: 0xcdcd1110 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb63: skipped 000703 1784939171.950600 trunc from 0x03eb63 to 0x00e90b (0x30257 bytes) 000706 1784939172.085125 mapwrite 0x029077 thru 0x02fb3e (0x6ac8 bytes) 000708 1784939172.227176 mapwrite 0x0186e2 thru 0x01e3f2 (0x5d11 bytes) 000709 1784939172.362288 mapread 0x0014a2 thru 0x0020aa (0xc09 bytes) 000710 1784939172.384160 MIRROR_SPLIT mirror 6 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fb3f): Mirror 5: 0x9287a0ed (stale) Mirror 8: 0x9287a0ed (stale) Mirror 9: 0x9287a0ed (stale) Mirror 10: 0x9287a0ed (stale) Mirror 12: 0x9287a0ed (stale) Mirror 14: 0x9287a0ed (stale) Mirror 15: 0x9287a0ed (stale) Mirror 16: 0x9287a0ed (stale) Mirror 17: 0x9287a0ed (stale) Mirror 18: 0x9287a0ed (stale) Mirror 19: 0x9287a0ed (stale) Mirror 20: 0xe36368af (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fb3f): Mirror 5: 0x9287a0ed (stale) Mirror 8: 0x9287a0ed (stale) Mirror 9: 0x9287a0ed (stale) Mirror 10: 0x9287a0ed (stale) Mirror 12: 0x9287a0ed (stale) Mirror 14: 0x9287a0ed (stale) Mirror 15: 0x9287a0ed (stale) Mirror 16: 0x9287a0ed (stale) Mirror 17: 0x9287a0ed (stale) Mirror 18: 0x9287a0ed (stale) Mirror 19: 0x9287a0ed (stale) Mirror 20: 0xe36368af (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fb3f: skipped 000712 1784939173.284891 mapread 0x0109ff thru 0x01bd0f (0xb311 bytes) 000713 1784939173.328148 mapwrite 0x01e756 thru 0x02961f (0xaeca bytes) 000714 1784939173.412119 write 0x013426 thru 0x01cd9e (0x9979 bytes) 000715 1784939173.413688 mapread 0x025162 thru 0x028882 (0x3721 bytes) 000717 1784939173.434091 MIRROR_SPLIT mirror 12 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fb3f): Mirror 5: 0x9287a0ed (stale) Mirror 8: 0x9287a0ed (stale) Mirror 9: 0x9287a0ed (stale) Mirror 10: 0x9287a0ed (stale) Mirror 12: 0x9287a0ed (stale) Mirror 14: 0x9287a0ed (stale) Mirror 15: 0x9287a0ed (stale) Mirror 16: 0x9287a0ed (stale) Mirror 17: 0x9287a0ed (stale) Mirror 18: 0x9287a0ed (stale) Mirror 19: 0x9287a0ed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fb3f): Mirror 5: 0x9287a0ed (stale) Mirror 8: 0x9287a0ed (stale) Mirror 9: 0x9287a0ed (stale) Mirror 10: 0x9287a0ed (stale) Mirror 12: 0x9287a0ed (stale) Mirror 14: 0x9287a0ed (stale) Mirror 15: 0x9287a0ed (stale) Mirror 16: 0x9287a0ed (stale) Mirror 17: 0x9287a0ed (stale) Mirror 18: 0x9287a0ed (stale) Mirror 19: 0x9287a0ed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fb3f: skipped 000718 1784939174.160734 mapwrite 0x0010d8 thru 0x009549 (0x8472 bytes) 000719 1784939174.246005 write 0x0060b3 thru 0x00c01e (0x5f6c bytes) 000720 1784939174.250948 read 0x00e5d4 thru 0x015fc9 (0x79f6 bytes) 000721 1784939174.264157 read 0x0116fd thru 0x01af37 (0x983b bytes) 000722 1784939174.279015 trunc from 0x02fb3f to 0x00b1d5 (0x24969 bytes) 000725 1784939174.304527 mapread 0x009c55 thru 0x00b1d5 (0x1581 bytes) 000726 1784939174.307063 mapwrite 0x00b464 thru 0x00dbfc (0x2799 bytes) 000727 1784939174.398158 trunc from 0x00dbfd to 0x01256c (0x4970 bytes) 000728 1784939174.419049 write 0x00661b thru 0x0127a3 (0xc189 bytes) 000730 1784939174.429330 trunc from 0x0127a4 to 0x02add5 (0x18632 bytes) 000733 1784939174.451740 read 0x01c616 thru 0x01c6a9 (0x94 bytes) 000734 1784939174.462944 trunc from 0x02add6 to 0x0272b2 (0x3b23 bytes) 000736 1784939174.480801 mapread 0x017486 thru 0x01b603 (0x417e bytes) 000739 1784939174.485919 trunc from 0x0272b3 to 0x0268af (0xa03 bytes) 000740 1784939174.508103 write 0x015273 thru 0x01c294 (0x7022 bytes) 000741 1784939174.510606 write 0x031a13 thru 0x033882 (0x1e70 bytes) 000742 1784939174.513138 read 0x001fdd thru 0x00d366 (0xb38a bytes) 000743 1784939174.514094 mapread 0x01a667 thru 0x022937 (0x82d1 bytes) 000744 1784939174.516493 mapwrite 0x013860 thru 0x01eb07 (0xb2a8 bytes) 000745 1784939174.567609 mapwrite 0x00ca7b thru 0x01b1f1 (0xe777 bytes) 000747 1784939174.623150 read 0x02a1b2 thru 0x02ed46 (0x4b95 bytes) 000748 1784939174.638077 trunc from 0x033883 to 0x01f7f0 (0x14092 bytes) 000750 1784939174.663128 read 0x01cea3 thru 0x01eb95 (0x1cf3 bytes) 000751 1784939174.669181 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f7f1): Mirror 8: 0x8f5ee5fa (stale) Mirror 9: 0x8f5ee5fa (stale) Mirror 10: 0x8f5ee5fa (stale) Mirror 12: 0x8f5ee5fa (stale) Mirror 14: 0x8f5ee5fa (stale) Mirror 15: 0x8f5ee5fa (stale) Mirror 16: 0x8f5ee5fa (stale) Mirror 17: 0x8f5ee5fa (stale) Mirror 18: 0x8f5ee5fa (stale) Mirror 19: 0x8f5ee5fa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f7f1): Mirror 8: 0x8f5ee5fa (stale) Mirror 9: 0x8f5ee5fa (stale) Mirror 10: 0x8f5ee5fa (stale) Mirror 12: 0x8f5ee5fa (stale) Mirror 14: 0x8f5ee5fa (stale) Mirror 15: 0x8f5ee5fa (stale) Mirror 16: 0x8f5ee5fa (stale) Mirror 17: 0x8f5ee5fa (stale) Mirror 18: 0x8f5ee5fa (stale) Mirror 19: 0x8f5ee5fa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f7f1: skipped 000752 1784939175.420105 write 0x011760 thru 0x0212d6 (0xfb77 bytes) 000753 1784939175.434469 trunc from 0x0212d7 to 0x000bb7 (0x2071f bytes) 000754 1784939175.464985 mapwrite 0x01d111 thru 0x02943a (0xc32a bytes) 000756 1784939175.670823 mapread 0x001d5d thru 0x003085 (0x1329 bytes) 000759 1784939175.685310 mapwrite 0x01b8d8 thru 0x0261b2 (0xa8db bytes) 000763 1784939175.778232 write 0x01e08e thru 0x01e09e (0x11 bytes) 000767 1784939175.790037 mapwrite 0x017d0b thru 0x0273f5 (0xf6eb bytes) 000768 1784939175.867485 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2943b): Mirror 8: 0x504004d6 (stale) Mirror 9: 0x504004d6 (stale) Mirror 10: 0x504004d6 (stale) Mirror 12: 0x504004d6 (stale) Mirror 14: 0x504004d6 (stale) Mirror 15: 0x504004d6 (stale) Mirror 17: 0x504004d6 (stale) Mirror 18: 0x504004d6 (stale) Mirror 19: 0x504004d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2943b): Mirror 8: 0x504004d6 (stale) Mirror 9: 0x504004d6 (stale) Mirror 10: 0x504004d6 (stale) Mirror 12: 0x504004d6 (stale) Mirror 14: 0x504004d6 (stale) Mirror 15: 0x504004d6 (stale) Mirror 17: 0x504004d6 (stale) Mirror 18: 0x504004d6 (stale) Mirror 19: 0x504004d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2943b: skipped 000769 1784939176.664196 write 0x030dfb thru 0x036392 (0x5598 bytes) 000770 1784939176.684485 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36393): Mirror 8: 0x89060446 (stale) Mirror 9: 0x89060446 (stale) Mirror 10: 0x89060446 (stale) Mirror 12: 0x89060446 (stale) Mirror 14: 0x89060446 (stale) Mirror 15: 0x89060446 (stale) Mirror 18: 0x89060446 (stale) Mirror 19: 0x89060446 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36393): Mirror 8: 0x89060446 (stale) Mirror 9: 0x89060446 (stale) Mirror 10: 0x89060446 (stale) Mirror 12: 0x89060446 (stale) Mirror 14: 0x89060446 (stale) Mirror 15: 0x89060446 (stale) Mirror 18: 0x89060446 (stale) Mirror 19: 0x89060446 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36393: skipped 000771 1784939177.531692 write 0x01b5e8 thru 0x026d05 (0xb71e bytes) 000772 1784939177.548625 mapread 0x02ad23 thru 0x036392 (0xb670 bytes) 000775 1784939177.589699 trunc from 0x036393 to 0x003afc (0x32896 bytes) 000778 1784939177.614151 mapwrite 0x0217d8 thru 0x02874c (0x6f75 bytes) 000780 1784939177.764823 trunc from 0x02874d to 0x01e617 (0xa135 bytes) 000782 1784939177.804360 MIRROR_RESYNC 9 mirrors 000783 1784939180.212044 read 0x01aeec thru 0x01b8f2 (0xa07 bytes) 000784 1784939180.223417 write 0x003dff thru 0x00ec86 (0xae88 bytes) 000785 1784939180.382043 mapwrite 0x00baa3 thru 0x00e406 (0x2964 bytes) 000787 1784939180.523982 mapread 0x019a62 thru 0x01e617 (0x4bb6 bytes) 000789 1784939180.608880 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1e618): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e618): Mirror 8: 0xa0c55c (stale) Mirror 9: 0xa0c55c (stale) Mirror 10: 0xa0c55c (stale) Mirror 12: 0xa0c55c (stale) Mirror 14: 0xa0c55c (stale) Mirror 15: 0xa0c55c (stale) Mirror 18: 0xa0c55c (stale) Mirror 19: 0xa0c55c (stale) CRC-32 checksum value for chunk [0, 0x1e618): Mirror 1: 0xe7f183a5 Mirror 20: 0xe7f183a5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e618: skipped 000790 1784939182.824687 trunc from 0x01e618 to 0x0076e2 (0x16f35 bytes) 000794 1784939182.972623 mapwrite 0x01dddf thru 0x02671a (0x893c bytes) 000795 1784939183.094687 mapread 0x001b7a thru 0x004ea3 (0x332a bytes) 000796 1784939183.113475 read 0x025d2e thru 0x02671a (0x9ed bytes) 000801 1784939183.122885 trunc from 0x02671b to 0x0138db (0x12e3f bytes) 000802 1784939183.168514 write 0x009f42 thru 0x015f94 (0xc053 bytes) 000803 1784939183.173076 read 0x000814 thru 0x00a6d1 (0x9ebe bytes) 000805 1784939183.184415 mapread 0x005a77 thru 0x00970a (0x3c94 bytes) 000807 1784939183.204090 read 0x01216d thru 0x015f94 (0x3e28 bytes) 000808 1784939183.213975 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15f95): Mirror 8: 0xd4846758 (stale) Mirror 9: 0xd4846758 (stale) Mirror 12: 0xd4846758 (stale) Mirror 14: 0xd4846758 (stale) Mirror 15: 0xd4846758 (stale) Mirror 18: 0xd4846758 (stale) Mirror 19: 0xd4846758 (stale) Mirror 20: 0x56fb5031 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15f95): Mirror 8: 0xd4846758 (stale) Mirror 9: 0xd4846758 (stale) Mirror 12: 0xd4846758 (stale) Mirror 14: 0xd4846758 (stale) Mirror 15: 0xd4846758 (stale) Mirror 18: 0xd4846758 (stale) Mirror 19: 0xd4846758 (stale) Mirror 20: 0x56fb5031 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15f95: skipped 000809 1784939184.033980 write 0x016939 thru 0x021be1 (0xb2a9 bytes) 000810 1784939184.045163 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21be2): Mirror 8: 0x5b7b5c89 (stale) Mirror 9: 0x5b7b5c89 (stale) Mirror 12: 0x5b7b5c89 (stale) Mirror 14: 0x5b7b5c89 (stale) Mirror 18: 0x5b7b5c89 (stale) Mirror 19: 0x5b7b5c89 (stale) Mirror 20: 0x113f2193 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21be2): Mirror 8: 0x5b7b5c89 (stale) Mirror 9: 0x5b7b5c89 (stale) Mirror 12: 0x5b7b5c89 (stale) Mirror 14: 0x5b7b5c89 (stale) Mirror 18: 0x5b7b5c89 (stale) Mirror 19: 0x5b7b5c89 (stale) Mirror 20: 0x113f2193 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21be2: skipped 000812 1784939184.705061 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21be2): Mirror 8: 0x5b7b5c89 (stale) Mirror 9: 0x5b7b5c89 (stale) Mirror 12: 0x5b7b5c89 (stale) Mirror 14: 0x5b7b5c89 (stale) Mirror 19: 0x5b7b5c89 (stale) Mirror 20: 0x113f2193 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21be2): Mirror 8: 0x5b7b5c89 (stale) Mirror 9: 0x5b7b5c89 (stale) Mirror 12: 0x5b7b5c89 (stale) Mirror 14: 0x5b7b5c89 (stale) Mirror 19: 0x5b7b5c89 (stale) Mirror 20: 0x113f2193 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21be2: skipped 000817 1784939185.276139 mapwrite 0x016751 thru 0x01e299 (0x7b49 bytes) 000818 1784939185.397302 write 0x0386ff thru 0x038731 (0x33 bytes) 000822 1784939185.403819 trunc from 0x038732 to 0x007bf6 (0x30b3b bytes) 000823 1784939185.440209 write 0x030a2e thru 0x03eb4f (0xe122 bytes) 000824 1784939185.443296 mapwrite 0x01cea2 thru 0x02c0ab (0xf20a bytes) 000825 1784939185.580001 trunc from 0x03eb50 to 0x0238f6 (0x1b259 bytes) 000826 1784939185.609747 mapwrite 0x022784 thru 0x025359 (0x2bd6 bytes) 000827 1784939185.705484 trunc from 0x02535a to 0x023830 (0x1b29 bytes) 000829 1784939185.750709 mapwrite 0x0221ef thru 0x02ff12 (0xdd24 bytes) 000830 1784939185.959244 mapwrite 0x00a32e thru 0x00f7e7 (0x54ba bytes) 000831 1784939186.010867 read 0x008455 thru 0x015101 (0xccad bytes) 000832 1784939186.019062 write 0x00a835 thru 0x00e8c7 (0x4093 bytes) 000833 1784939186.026767 MIRROR_RESYNC 7 mirrors 000837 1784939187.611393 mapread 0x002d9c thru 0x008460 (0x56c5 bytes) 000838 1784939187.673071 trunc from 0x02ff13 to 0x007780 (0x28792 bytes) 000839 1784939187.758658 mapwrite 0x01ad95 thru 0x0227ee (0x7a5a bytes) 000841 1784939187.866606 read 0x01ef92 thru 0x021c1c (0x2c8b bytes) 000842 1784939187.875180 write 0x00047b thru 0x00fdb9 (0xf93f bytes) 000843 1784939187.900171 trunc from 0x0227ef to 0x009652 (0x1919c bytes) 000845 1784939187.937201 mapwrite 0x01120e thru 0x01befe (0xacf1 bytes) 000846 1784939188.099842 write 0x02c693 thru 0x03699a (0xa308 bytes) 000848 1784939188.105888 mapwrite 0x033a07 thru 0x03991b (0x5f15 bytes) 000850 1784939188.234446 read 0x018243 thru 0x01fdd0 (0x7b8e bytes) 000852 1784939188.253703 read 0x0220da thru 0x029b4e (0x7a75 bytes) 000854 1784939188.257974 read 0x0327ae thru 0x03991b (0x716e bytes) 000855 1784939188.258977 read 0x019cfe thru 0x01bc05 (0x1f08 bytes) 000856 1784939188.260218 trunc from 0x03991c to 0x0016b8 (0x38263 bytes) 000857 1784939188.288784 write 0x01e743 thru 0x023530 (0x4dee bytes) 000859 1784939188.294767 read 0x0094a8 thru 0x010962 (0x74bb bytes) 000861 1784939188.317435 MIRROR_RESYNC 7 mirrors 000862 1784939189.832214 trunc from 0x023531 to 0x01a425 (0x910b bytes) 000863 1784939189.933183 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a426): Mirror 8: 0x92ab713a (stale) Mirror 9: 0x92ab713a (stale) Mirror 12: 0x92ab713a (stale) Mirror 19: 0x92ab713a (stale) Mirror 20: 0x92ab713a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a426): Mirror 8: 0x92ab713a (stale) Mirror 9: 0x92ab713a (stale) Mirror 12: 0x92ab713a (stale) Mirror 19: 0x92ab713a (stale) Mirror 20: 0x92ab713a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a426: skipped 000864 1784939190.531200 mapwrite 0x034e8e thru 0x0361fa (0x136d bytes) 000865 1784939190.602315 mapread 0x01fb29 thru 0x024018 (0x44f0 bytes) 000866 1784939190.615038 mapread 0x01fe59 thru 0x022435 (0x25dd bytes) 000869 1784939190.619283 write 0x029648 thru 0x02e581 (0x4f3a bytes) 000870 1784939190.629345 read 0x02699c thru 0x02b71b (0x4d80 bytes) 000871 1784939190.635252 mapread 0x013d7e thru 0x017970 (0x3bf3 bytes) 000872 1784939190.651821 MIRROR_RESYNC 6 mirrors 000877 1784939192.055670 read 0x00fab4 thru 0x013ab5 (0x4002 bytes) 000879 1784939192.069407 write 0x0313ec thru 0x03a864 (0x9479 bytes) 000885 1784939192.159990 write 0x039ca8 thru 0x03ffff (0x6358 bytes) 000886 1784939192.162151 trunc from 0x040000 to 0x0223f8 (0x1dc07 bytes) 000887 1784939192.181136 trunc from 0x0223f9 to 0x012075 (0x10383 bytes) 000888 1784939192.201158 mapwrite 0x0321a4 thru 0x03ffff (0xde5c bytes) 000889 1784939192.353861 trunc from 0x040000 to 0x025f06 (0x1a0f9 bytes) 000890 1784939192.373801 read 0x002d6f thru 0x00d412 (0xa6a4 bytes) 000891 1784939192.397067 trunc from 0x025f07 to 0x01f65d (0x68a9 bytes) 000892 1784939192.426118 write 0x01a256 thru 0x01eec1 (0x4c6c bytes) 000893 1784939192.438720 MIRROR_RESYNC 6 mirrors 000894 1784939193.482699 trunc from 0x01f65e to 0x005b85 (0x19ad8 bytes) 000895 1784939193.572366 write 0x03671f thru 0x03ffff (0x98e1 bytes) 000896 1784939193.575212 mapread 0x022f6d thru 0x02a979 (0x7a0d bytes) 000898 1784939193.597672 trunc from 0x040000 to 0x02816e (0x17e91 bytes) 000899 1784939193.622845 mapread 0x017ca5 thru 0x022198 (0xa4f4 bytes) 000900 1784939193.638073 write 0x03217c thru 0x033476 (0x12fb bytes) 000901 1784939193.640600 trunc from 0x033477 to 0x03ae70 (0x79fa bytes) 000902 1784939193.660144 trunc from 0x03ae71 to 0x00a9e2 (0x3048e bytes) 000906 1784939193.696193 mapread 0x006095 thru 0x00a9e2 (0x494e bytes) 000907 1784939193.707380 mapwrite 0x03bf52 thru 0x03ffff (0x40ae bytes) 000908 1784939193.811416 write 0x025e2a thru 0x02eec3 (0x909a bytes) 000909 1784939193.823759 mapread 0x022046 thru 0x02a811 (0x87cc bytes) 000911 1784939193.842286 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xa4cc8c0c (stale) Mirror 12: 0xa4cc8c0c (stale) Mirror 19: 0xa4cc8c0c (stale) Mirror 20: 0xa4cc8c0c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xa4cc8c0c (stale) Mirror 12: 0xa4cc8c0c (stale) Mirror 19: 0xa4cc8c0c (stale) Mirror 20: 0xa4cc8c0c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000912 1784939194.300450 trunc from 0x040000 to 0x015d21 (0x2a2de bytes) 000915 1784939194.333231 read 0x011d39 thru 0x015d21 (0x3fe9 bytes) 000917 1784939194.349743 trunc from 0x015d22 to 0x015bcc (0x155 bytes) 000918 1784939194.379152 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x15bcd): Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15bcd): Mirror 9: 0xc4c34a00 (stale) Mirror 12: 0xc4c34a00 (stale) Mirror 19: 0xc4c34a00 (stale) Mirror 20: 0xc4c34a00 (stale) CRC-32 checksum value for chunk [0, 0x15bcd): Mirror 1: 0xc4c34a00 Mirror 21: 0xc4c34a00 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15bcd: skipped 000919 1784939195.749416 read 0x00f12d thru 0x015bcc (0x6aa0 bytes) 000921 1784939195.782924 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15bcd): Mirror 9: 0xc4c34a00 (stale) Mirror 12: 0xc4c34a00 (stale) Mirror 19: 0xc4c34a00 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15bcd): Mirror 9: 0xc4c34a00 (stale) Mirror 12: 0xc4c34a00 (stale) Mirror 19: 0xc4c34a00 (stale) CRC-32 checksum value for chunk [0, 0x15bcd): Mirror 1: 0xc4c34a00 Mirror 21: 0xc4c34a00 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15bcd: skipped 000922 1784939196.676455 read 0x00ac94 thru 0x012a1c (0x7d89 bytes) 000924 1784939196.774819 mapread 0x001629 thru 0x006811 (0x51e9 bytes) 000925 1784939196.849185 write 0x02eab6 thru 0x0383c3 (0x990e bytes) 000928 1784939196.958359 write 0x023d73 thru 0x02bd14 (0x7fa2 bytes) 000930 1784939196.970978 trunc from 0x0383c4 to 0x028ead (0xf516 bytes) 000933 1784939196.998300 MIRROR_RESYNC 5 mirrors 000934 1784939198.791755 mapread 0x004a89 thru 0x007ffd (0x3575 bytes) 000937 1784939198.841799 MIRROR_RESYNC 5 mirrors 000938 1784939199.589603 trunc from 0x028eae to 0x02eaac (0x5bff bytes) 000940 1784939199.685460 trunc from 0x02eaad to 0x0228a2 (0xc20a bytes) 000941 1784939199.726038 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x228a3): Mirror 12: 0xb76402ae (stale) Mirror 19: 0xb76402ae (stale) Mirror 21: 0xb76402ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x228a3): Mirror 12: 0xb76402ae (stale) Mirror 19: 0xb76402ae (stale) Mirror 21: 0xb76402ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x228a3: skipped 000942 1784939200.215689 read 0x01425d thru 0x01662e (0x23d2 bytes) 000943 1784939200.224824 read 0x00ed2d thru 0x01c32f (0xd603 bytes) 000944 1784939200.247448 mapread 0x01cd9d thru 0x01dbb6 (0xe1a bytes) 000945 1784939200.252798 write 0x0037ba thru 0x00d97f (0xa1c6 bytes) 000946 1784939200.254669 read 0x00e840 thru 0x010b93 (0x2354 bytes) 000948 1784939200.260440 write 0x009ade thru 0x00cd62 (0x3285 bytes) 000949 1784939200.269766 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x228a3): Mirror 19: 0xb76402ae (stale) Mirror 21: 0xb76402ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x228a3): Mirror 19: 0xb76402ae (stale) Mirror 21: 0xb76402ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x228a3: skipped 000950 1784939200.733733 trunc from 0x0228a3 to 0x029b3c (0x729a bytes) 000951 1784939200.755908 mapread 0x027273 thru 0x029b3c (0x28ca bytes) 000954 1784939200.816348 mapread 0x010d85 thru 0x010e53 (0xcf bytes) 000955 1784939200.833890 mapwrite 0x01c6a6 thru 0x01c855 (0x1b0 bytes) 000958 1784939200.948064 write 0x0067cb thru 0x016080 (0xf8b6 bytes) 000959 1784939200.960313 mapread 0x01ad73 thru 0x01c13b (0x13c9 bytes) 000960 1784939200.961563 trunc from 0x029b3d to 0x03896e (0xee32 bytes) 000961 1784939201.006198 mapread 0x021cd1 thru 0x029205 (0x7535 bytes) 000962 1784939201.016888 read 0x034df4 thru 0x03896e (0x3b7b bytes) 000964 1784939201.047869 write 0x03aacf thru 0x03b5f5 (0xb27 bytes) 000965 1784939201.049936 mapwrite 0x02b028 thru 0x02b136 (0x10f bytes) 000966 1784939201.202327 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3b5f6): Mirror 19: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b5f6): Mirror 19: 0x4071cca7 (stale) Mirror 21: 0x4071cca7 (stale) CRC-32 checksum value for chunk [0, 0x3b5f6): Mirror 1: 0x5f268a4c Mirror 22: 0x5f268a4c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b5f6: skipped 000967 1784939202.353129 trunc from 0x03b5f6 to 0x02b91b (0xfcda bytes) 000973 1784939202.517431 mapwrite 0x01ffb0 thru 0x02de8c (0xdedd bytes) 000974 1784939202.735851 trunc from 0x02de8d to 0x01ceb3 (0x10fd9 bytes) 000976 1784939202.768365 read 0x00d087 thru 0x0189e1 (0xb95b bytes) 000977 1784939202.786301 trunc from 0x01ceb4 to 0x013f1b (0x8f98 bytes) 000978 1784939202.823896 read 0x004d3f thru 0x012e09 (0xe0cb bytes) 000980 1784939202.859976 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x13f1c): Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13f1c): Mirror 19: 0x78053272 (stale) Mirror 21: 0x78053272 (stale) Mirror 22: 0x1a7daedc (stale) CRC-32 checksum value for chunk [0, 0x13f1c): Mirror 1: 0x1a7daedc Mirror 23: 0x1a7daedc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13f1c: skipped 000981 1784939204.269273 read 0x00a0c2 thru 0x013f1b (0x9e5a bytes) 000982 1784939204.295343 trunc from 0x013f1c to 0x013891 (0x68a bytes) 000983 1784939204.404032 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x13892): Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13892): Mirror 19: 0x6f949398 (stale) Mirror 21: 0x6f949398 (stale) Mirror 22: 0x2fa036a3 (stale) Mirror 23: 0x2fa036a3 (stale) CRC-32 checksum value for chunk [0, 0x13892): Mirror 1: 0x2fa036a3 Mirror 24: 0x2fa036a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13892: skipped 000984 1784939205.667799 mapwrite 0x0165f7 thru 0x01e65d (0x8067 bytes) 000988 1784939205.909797 trunc from 0x01e65e to 0x00e8f4 (0xfd69 bytes) 000993 1784939205.962343 trunc from 0x00e8f5 to 0x0150c4 (0x67d0 bytes) 000994 1784939205.987910 read 0x01320f thru 0x0150c4 (0x1eb6 bytes) 000997 1784939205.999335 trunc from 0x0150c5 to 0x022c15 (0xdb51 bytes) 001000 1784939206.023338 write 0x0200d5 thru 0x0281f1 (0x811d bytes) All operations completed A-OK!