== sanity-flr test 70a: flr mode fsx test ================ 17:03:30 (1779311010) Seed set to 1011 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1a94b 000003 1779311011.843059 trunc from 00000000 to 0x01a94a (0x1a94b bytes) 000004 1779311011.858752 read 0x01224e thru 0x0135ed (0x13a0 bytes) 000005 1779311011.864255 write 0x000946 thru 0x00f22e (0xe8e9 bytes) 000007 1779311011.874367 read 0x019a18 thru 0x019f40 (0x529 bytes) 000012 1779311011.884868 mapwrite 0x0295d2 thru 0x036201 (0xcc30 bytes) 000013 1779311011.991949 trunc from 0x036202 to 0x01328d (0x22f74 bytes) truncating to largest ever: 0x26ca1 000014 1779311012.012387 trunc from 0x01328e to 0x026ca0 (0x13a13 bytes) 000015 1779311012.040898 mapwrite 0x028ed3 thru 0x02d21e (0x434c bytes) 000016 1779311012.140994 mapread 0x003599 thru 0x00cd73 (0x97db bytes) 000018 1779311012.142306 read 0x00c399 thru 0x018bde (0xc846 bytes) 000020 1779311012.148916 read 0x00244c thru 0x00a462 (0x8017 bytes) 000022 1779311012.149952 mapread 0x0147f9 thru 0x01917e (0x4986 bytes) 000023 1779311012.154345 MIRROR_EXTEND to 2 mirrors 000024 1779311012.603930 write 0x00666b thru 0x00c1f5 (0x5b8b bytes) 000025 1779311012.663198 read 0x0127bc thru 0x01e3d7 (0xbc1c bytes) 000026 1779311012.670803 mapwrite 0x013ff3 thru 0x016ec7 (0x2ed5 bytes) 000030 1779311012.704536 mapwrite 0x03dc32 thru 0x03ffff (0x23ce bytes) 000031 1779311012.792963 read 0x019dd0 thru 0x01d362 (0x3593 bytes) 000032 1779311012.794027 write 0x033ee8 thru 0x033fe7 (0x100 bytes) 000034 1779311012.809945 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) 000035 1779311012.935098 read 0x0348a1 thru 0x03f202 (0xa962 bytes) 000036 1779311012.944050 trunc from 0x040000 to 0x008c33 (0x373cc bytes) 000038 1779311012.957689 trunc from 0x008c34 to 0x008174 (0xabf bytes) 000039 1779311012.972870 mapwrite 0x0372ad thru 0x03ba0f (0x4763 bytes) 000040 1779311013.051481 read 0x022b00 thru 0x025e5d (0x335e bytes) 000041 1779311013.059119 mapread 0x0062ce thru 0x00e311 (0x8044 bytes) 000042 1779311013.060325 mapwrite 0x018aeb thru 0x01a8f9 (0x1e0f bytes) 000043 1779311013.111829 read 0x03a2f1 thru 0x03ba0f (0x171f bytes) 000044 1779311013.112590 mapread 0x024cd4 thru 0x032ec6 (0xe1f3 bytes) 000045 1779311013.115239 mapwrite 0x0378e5 thru 0x03ffff (0x871b bytes) 000046 1779311013.164603 write 0x018357 thru 0x01d32f (0x4fd9 bytes) 000048 1779311013.166732 write 0x00449a thru 0x006489 (0x1ff0 bytes) 000049 1779311013.167909 mapwrite 0x00d3fc thru 0x0110da (0x3cdf bytes) 000051 1779311013.205323 mapread 0x03b994 thru 0x03ffff (0x466c bytes) 000055 1779311013.211844 mapwrite 0x034e01 thru 0x03ffff (0xb1ff bytes) truncating to largest ever: 0x30008 000057 1779311013.277398 trunc from 0x040000 to 0x030007 (0xfff8 bytes) 000060 1779311013.298004 mapwrite 0x016a61 thru 0x024c2e (0xe1ce bytes) 000062 1779311013.355295 mapread 0x01d7b8 thru 0x026f6b (0x97b4 bytes) 000064 1779311013.358697 mapwrite 0x02bd94 thru 0x03a4c0 (0xe72d bytes) 000065 1779311013.467074 read 0x0381ed thru 0x03a4c0 (0x22d4 bytes) 000066 1779311013.467768 write 0x030142 thru 0x03d6af (0xd56e bytes) 000067 1779311013.469073 mapwrite 0x022abc thru 0x02d868 (0xadad bytes) 000068 1779311013.511298 mapwrite 0x027010 thru 0x02d2f6 (0x62e7 bytes) 000070 1779311013.555911 read 0x0015ef thru 0x001baf (0x5c1 bytes) 000071 1779311013.556627 mapwrite 0x02c00d thru 0x034f80 (0x8f74 bytes) 000074 1779311013.594568 write 0x006bbb thru 0x00ba47 (0x4e8d bytes) 000076 1779311013.596142 mapwrite 0x0083cd thru 0x00bc30 (0x3864 bytes) 000078 1779311013.639609 trunc from 0x03d6b0 to 0x00717f (0x36530 bytes) 000079 1779311013.661464 read 0x001176 thru 0x00717f (0x600a bytes) 000082 1779311013.667495 write 0x001b53 thru 0x0115a9 (0xfa57 bytes) truncating to largest ever: 0x389a8 000083 1779311013.669109 trunc from 0x0115aa to 0x0389a7 (0x273fe bytes) 000088 1779311013.694306 mapread 0x033b5b thru 0x0389a7 (0x4e4d bytes) 000090 1779311013.711442 read 0x010e71 thru 0x020269 (0xf3f9 bytes) 000091 1779311013.712445 mapread 0x00db96 thru 0x013e65 (0x62d0 bytes) 000092 1779311013.713463 mapwrite 0x016c4e thru 0x01a4d3 (0x3886 bytes) 000093 1779311013.761351 read 0x031067 thru 0x036a7e (0x5a18 bytes) 000095 1779311013.763010 trunc from 0x0389a8 to 0x01533a (0x2366d bytes) 000096 1779311013.777118 trunc from 0x01533b to 0x01bde9 (0x6aaf bytes) 000100 1779311013.795908 write 0x0373d5 thru 0x03ffff (0x8c2b bytes) 000101 1779311013.802402 MIRROR_EXTEND to 2 mirrors 000102 1779311014.376256 mapread 0x01c8bf thru 0x02c378 (0xfaba bytes) 000103 1779311014.422041 mapwrite 0x023278 thru 0x02f966 (0xc6ef bytes) 000104 1779311014.562307 read 0x02e4e5 thru 0x034370 (0x5e8c bytes) 000105 1779311014.569581 MIRROR_RESYNC 2 mirrors 000106 1779311014.929429 write 0x009aac thru 0x0144cc (0xaa21 bytes) 000110 1779311014.993844 trunc from 0x040000 to 0x0070db (0x38f24 bytes) 000111 1779311015.039870 mapwrite 0x01d55d thru 0x01d6e9 (0x18d bytes) 000113 1779311015.100976 mapread 0x012839 thru 0x01d6e9 (0xaeb1 bytes) 000114 1779311015.109353 read 0x003296 thru 0x00a1eb (0x6f56 bytes) 000115 1779311015.116131 trunc from 0x01d6ea to 0x00247b (0x1b26e bytes) 000117 1779311015.131664 mapwrite 0x015329 thru 0x017543 (0x221b bytes) 000118 1779311015.185505 MIRROR_RESYNC 2 mirrors 000119 1779311015.546945 mapwrite 0x026474 thru 0x03362f (0xd1bc bytes) 000120 1779311015.698055 write 0x0301ea thru 0x03ac8a (0xaaa1 bytes) 000121 1779311015.699562 mapread 0x025d4a thru 0x033e57 (0xe10e bytes) 000123 1779311015.711321 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3ac8b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ac8b): Mirror 2: 0x1dc66675 (stale) CRC-32 checksum value for chunk [0, 0x3ac8b): Mirror 1: 0xb131d301 Mirror 3: 0xb131d301 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ac8b: skipped 000124 1779311016.219019 read 0x02ade4 thru 0x02be29 (0x1046 bytes) 000125 1779311016.226835 trunc from 0x03ac8b to 0x037689 (0x3601 bytes) 000126 1779311016.288433 trunc from 0x03768a to 0x014df6 (0x22893 bytes) 000131 1779311016.306393 read 0x002ea3 thru 0x005be4 (0x2d42 bytes) 000133 1779311016.314849 mapread 0x00afbd thru 0x0141af (0x91f3 bytes) 000134 1779311016.316098 write 0x02e9e7 thru 0x03bac9 (0xd0e3 bytes) 000136 1779311016.319271 read 0x0017d2 thru 0x002884 (0x10b3 bytes) 000137 1779311016.320055 mapread 0x022b65 thru 0x0326e9 (0xfb85 bytes) 000138 1779311016.331259 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3baca): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3baca): Mirror 2: 0x8adf4da1 (stale) Mirror 3: 0x59e08f71 (stale) CRC-32 checksum value for chunk [0, 0x3baca): Mirror 1: 0xc656cca9 Mirror 4: 0xc656cca9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3baca: skipped 000139 1779311016.772739 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3baca): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3baca): Mirror 2: 0x8adf4da1 (stale) Mirror 3: 0x59e08f71 (stale) CRC-32 checksum value for chunk [0, 0x3baca): Mirror 1: 0xc656cca9 Mirror 4: 0xc656cca9 Mirror 5: 0xc656cca9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3baca: skipped 000140 1779311017.249970 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3baca): Mirror 3: 0x59e08f71 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3baca): Mirror 3: 0x59e08f71 (stale) CRC-32 checksum value for chunk [0, 0x3baca): Mirror 1: 0xc656cca9 Mirror 4: 0xc656cca9 Mirror 5: 0xc656cca9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3baca: skipped 000142 1779311017.629891 read 0x03a31d thru 0x03bac9 (0x17ad bytes) 000143 1779311017.639052 read 0x00551c thru 0x005ef6 (0x9db bytes) 000146 1779311017.677066 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3baca): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3baca): Mirror 3: 0x59e08f71 (stale) CRC-32 checksum value for chunk [0, 0x3baca): Mirror 1: 0xc656cca9 Mirror 4: 0xc656cca9 Mirror 5: 0xc656cca9 Mirror 6: 0xc656cca9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3baca: skipped 000149 1779311018.266962 MIRROR_RESYNC 5 mirrors 000151 1779311018.677820 trunc from 0x03baca to 0x01dbee (0x1dedb bytes) 000152 1779311018.749125 mapread 0x009736 thru 0x01502c (0xb8f7 bytes) 000157 1779311018.777941 mapread 0x00bc06 thru 0x019172 (0xd56d bytes) truncating to largest ever: 0x3d92d 000158 1779311018.779922 trunc from 0x01dbef to 0x03d92c (0x1fd3e bytes) 000160 1779311018.794143 mapwrite 0x004b2e thru 0x012c43 (0xe116 bytes) 000161 1779311018.826050 mapwrite 0x0036b2 thru 0x00a9e5 (0x7334 bytes) 000162 1779311018.858850 read 0x025242 thru 0x02c08d (0x6e4c bytes) 000163 1779311018.865812 trunc from 0x03d92d to 0x00d96e (0x2ffbe bytes) 000164 1779311018.876958 write 0x02a065 thru 0x02f330 (0x52cc bytes) 000166 1779311018.882964 MIRROR_RESYNC 5 mirrors 000167 1779311019.373841 write 0x012c18 thru 0x013745 (0xb2e bytes) 000168 1779311019.425834 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2f331): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f331): Mirror 3: 0x2e41e0de (stale) Mirror 4: 0x2e41e0de (stale) Mirror 5: 0x2e41e0de (stale) Mirror 6: 0x2e41e0de (stale) CRC-32 checksum value for chunk [0, 0x2f331): Mirror 1: 0xad637387 Mirror 7: 0xad637387 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f331: skipped 000169 1779311019.907965 trunc from 0x02f331 to 0x039e42 (0xab12 bytes) 000172 1779311019.961971 mapread 0x01ce0d thru 0x01fd1d (0x2f11 bytes) 000173 1779311019.977277 mapread 0x02d502 thru 0x039e42 (0xc941 bytes) 000176 1779311019.995914 read 0x02295b thru 0x02b7a3 (0x8e49 bytes) 000177 1779311019.996588 write 0x010261 thru 0x01275d (0x24fd bytes) 000178 1779311020.005547 MIRROR_RESYNC 6 mirrors 000179 1779311020.608919 mapread 0x01cefc thru 0x020551 (0x3656 bytes) 000180 1779311020.624687 mapwrite 0x00e881 thru 0x01af83 (0xc703 bytes) 000181 1779311020.745560 trunc from 0x039e43 to 0x0333ab (0x6a97 bytes) 000183 1779311020.756473 mapread 0x01eab5 thru 0x01fb43 (0x108f bytes) 000188 1779311020.758831 trunc from 0x0333ac to 0x03bec2 (0x8b17 bytes) 000189 1779311020.767358 mapread 0x02f31f thru 0x0367b9 (0x749b bytes) 000190 1779311020.773693 mapread 0x007962 thru 0x00c6f4 (0x4d93 bytes) 000191 1779311020.774589 mapread 0x007bf7 thru 0x009fb6 (0x23c0 bytes) 000197 1779311020.777747 mapwrite 0x018980 thru 0x023a93 (0xb114 bytes) 000200 1779311020.824230 trunc from 0x03bec3 to 0x02850b (0x139b7 bytes) 000201 1779311020.835069 mapread 0x014b54 thru 0x017510 (0x29bd bytes) 000204 1779311020.838050 mapread 0x024286 thru 0x025469 (0x11e4 bytes) 000206 1779311020.840118 write 0x02e502 thru 0x03463d (0x613c bytes) 000209 1779311020.846985 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3463e): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3463e): Mirror 3: 0x28d490bf (stale) Mirror 4: 0x28d490bf (stale) Mirror 5: 0x28d490bf (stale) Mirror 6: 0x28d490bf (stale) Mirror 7: 0x28d490bf (stale) CRC-32 checksum value for chunk [0, 0x3463e): Mirror 1: 0xe321c01 Mirror 8: 0xe321c01 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3463e: skipped 000210 1779311021.432860 write 0x00b4ef thru 0x01936d (0xde7f bytes) 000211 1779311021.504010 trunc from 0x03463e to 0x03c710 (0x80d3 bytes) 000215 1779311021.521694 mapread 0x01f3e7 thru 0x0222fb (0x2f15 bytes) 000216 1779311021.534943 mapread 0x02ba8a thru 0x02e66a (0x2be1 bytes) 000217 1779311021.556667 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3c711): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c711): Mirror 3: 0x5ab388d6 (stale) Mirror 4: 0x5ab388d6 (stale) Mirror 5: 0x5ab388d6 (stale) Mirror 6: 0x5ab388d6 (stale) Mirror 7: 0x5ab388d6 (stale) Mirror 8: 0x7c2e7145 (stale) CRC-32 checksum value for chunk [0, 0x3c711): Mirror 1: 0x9b202b80 Mirror 9: 0x9b202b80 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c711: skipped 000219 1779311022.146339 write 0x03f363 thru 0x03ffff (0xc9d bytes) 000224 1779311022.199423 mapwrite 0x022cd9 thru 0x022fbb (0x2e3 bytes) 000225 1779311022.240565 mapwrite 0x00cf73 thru 0x01cbcf (0xfc5d bytes) 000228 1779311022.294853 write 0x03834c thru 0x03d100 (0x4db5 bytes) 000229 1779311022.301299 trunc from 0x040000 to 0x009c51 (0x363ae bytes) 000231 1779311022.329705 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x9c52): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9c52): Mirror 3: 0xad839d9e (stale) Mirror 4: 0xad839d9e (stale) Mirror 5: 0xad839d9e (stale) Mirror 6: 0xad839d9e (stale) Mirror 7: 0xad839d9e (stale) Mirror 8: 0xad839d9e (stale) Mirror 9: 0xad839d9e (stale) CRC-32 checksum value for chunk [0, 0x9c52): Mirror 1: 0xad839d9e Mirror 10: 0xad839d9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9c52: skipped 000235 1779311022.901973 read 0x0046b6 thru 0x009c51 (0x559c bytes) 000236 1779311022.914220 mapwrite 0x037512 thru 0x03d7d9 (0x62c8 bytes) 000238 1779311023.037755 mapwrite 0x02ad00 thru 0x036d87 (0xc088 bytes) 000239 1779311023.086516 trunc from 0x03d7da to 0x027eb7 (0x15922 bytes) 000241 1779311023.113083 mapread 0x00ff6f thru 0x01b0f3 (0xb185 bytes) 000242 1779311023.135789 write 0x025880 thru 0x02e30a (0x8a8b bytes) 000243 1779311023.137336 write 0x033800 thru 0x036ec1 (0x36c2 bytes) 000244 1779311023.140083 mapwrite 0x032912 thru 0x033870 (0xf5f bytes) 000245 1779311023.191360 write 0x001098 thru 0x006b1b (0x5a84 bytes) 000246 1779311023.203219 read 0x032da3 thru 0x036ec1 (0x411f bytes) 000247 1779311023.206080 mapwrite 0x029dd4 thru 0x038d91 (0xefbe bytes) 000248 1779311023.257968 mapwrite 0x034021 thru 0x03e540 (0xa520 bytes) 000250 1779311023.321012 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e541): Mirror 4: 0x2b2377da (stale) Mirror 5: 0x2b2377da (stale) Mirror 6: 0x2b2377da (stale) Mirror 7: 0x2b2377da (stale) Mirror 8: 0x89eb6e8a (stale) Mirror 9: 0x17c85c69 (stale) Mirror 10: 0xf830edce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e541): Mirror 4: 0x2b2377da (stale) Mirror 5: 0x2b2377da (stale) Mirror 6: 0x2b2377da (stale) Mirror 7: 0x2b2377da (stale) Mirror 8: 0x89eb6e8a (stale) Mirror 9: 0x17c85c69 (stale) Mirror 10: 0xf830edce (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e541: skipped 000252 1779311023.698892 MIRROR_RESYNC 8 mirrors 000253 1779311024.749231 mapwrite 0x02c72f thru 0x031cba (0x558c bytes) 000255 1779311024.900965 trunc from 0x03e541 to 0x02e17f (0x103c1 bytes) 000256 1779311024.948083 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2e180): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e180): Mirror 4: 0x512b1185 (stale) Mirror 5: 0x512b1185 (stale) Mirror 6: 0x512b1185 (stale) Mirror 7: 0x512b1185 (stale) Mirror 8: 0x512b1185 (stale) Mirror 9: 0x512b1185 (stale) Mirror 10: 0x512b1185 (stale) CRC-32 checksum value for chunk [0, 0x2e180): Mirror 1: 0x4e5dc87f Mirror 11: 0x4e5dc87f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e180: skipped 000258 1779311025.768463 write 0x037d08 thru 0x03ffff (0x82f8 bytes) 000259 1779311025.834086 mapread 0x037689 thru 0x03e4d4 (0x6e4c bytes) 000260 1779311025.836026 write 0x00d7c1 thru 0x0193ce (0xbc0e bytes) 000263 1779311025.849187 mapread 0x03aef0 thru 0x03ffff (0x5110 bytes) 000264 1779311025.850880 mapread 0x038667 thru 0x03ded6 (0x5870 bytes) 000265 1779311025.851947 read 0x0134ca thru 0x01ac05 (0x773c bytes) 000266 1779311025.857243 read 0x03baa9 thru 0x03ffff (0x4557 bytes) 000267 1779311025.858018 mapwrite 0x032671 thru 0x0388dc (0x626c bytes) 000268 1779311025.924496 trunc from 0x040000 to 0x01b1a7 (0x24e58 bytes) 000269 1779311025.955887 mapread 0x018303 thru 0x01b1a7 (0x2ea5 bytes) 000270 1779311025.964496 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b1a8): Mirror 4: 0x561e74e1 (stale) Mirror 6: 0x561e74e1 (stale) Mirror 7: 0x561e74e1 (stale) Mirror 8: 0x561e74e1 (stale) Mirror 9: 0x561e74e1 (stale) Mirror 10: 0x561e74e1 (stale) Mirror 11: 0x561e74e1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b1a8): Mirror 4: 0x561e74e1 (stale) Mirror 6: 0x561e74e1 (stale) Mirror 7: 0x561e74e1 (stale) Mirror 8: 0x561e74e1 (stale) Mirror 9: 0x561e74e1 (stale) Mirror 10: 0x561e74e1 (stale) Mirror 11: 0x561e74e1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b1a8: skipped 000272 1779311026.364850 mapread 0x014140 thru 0x01b1a7 (0x7068 bytes) 000278 1779311026.387886 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1b1a8): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b1a8): Mirror 4: 0x561e74e1 (stale) Mirror 6: 0x561e74e1 (stale) Mirror 7: 0x561e74e1 (stale) Mirror 8: 0x561e74e1 (stale) Mirror 9: 0x561e74e1 (stale) Mirror 10: 0x561e74e1 (stale) Mirror 11: 0x561e74e1 (stale) CRC-32 checksum value for chunk [0, 0x1b1a8): Mirror 1: 0x12a22f7a Mirror 12: 0x12a22f7a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b1a8: skipped 000281 1779311027.114154 trunc from 0x01b1a8 to 0x009b3f (0x11668 bytes) 000284 1779311027.182413 mapread 0x008be0 thru 0x009b3f (0xf60 bytes) 000285 1779311027.190886 read 0x001b6e thru 0x009b3f (0x7fd2 bytes) 000287 1779311027.200585 read 0x006344 thru 0x009b3f (0x37fc bytes) 000288 1779311027.201337 read 0x00980d thru 0x009b3f (0x333 bytes) 000290 1779311027.203339 read 0x004473 thru 0x009b3f (0x56cd bytes) 000292 1779311027.209130 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x9b40): Mirror 6: 0xf690d7df (stale) Mirror 7: 0xf690d7df (stale) Mirror 8: 0xf690d7df (stale) Mirror 9: 0xf690d7df (stale) Mirror 10: 0xf690d7df (stale) Mirror 11: 0xf690d7df (stale) Mirror 12: 0xf690d7df (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9b40): Mirror 6: 0xf690d7df (stale) Mirror 7: 0xf690d7df (stale) Mirror 8: 0xf690d7df (stale) Mirror 9: 0xf690d7df (stale) Mirror 10: 0xf690d7df (stale) Mirror 11: 0xf690d7df (stale) Mirror 12: 0xf690d7df (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9b40: skipped 000293 1779311027.627231 read 0x004e0b thru 0x009b3f (0x4d35 bytes) 000295 1779311027.636853 mapwrite 0x02ce62 thru 0x035233 (0x83d2 bytes) 000299 1779311027.716733 trunc from 0x035234 to 0x03b786 (0x6553 bytes) 000300 1779311027.737768 mapwrite 0x0180e9 thru 0x01b0ab (0x2fc3 bytes) 000301 1779311027.795459 mapread 0x02517e thru 0x0254ad (0x330 bytes) 000302 1779311027.804416 read 0x0104f5 thru 0x019cfc (0x9808 bytes) 000303 1779311027.813926 read 0x010731 thru 0x016023 (0x58f3 bytes) 000304 1779311027.819446 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3b787): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b787): Mirror 6: 0x5c548783 (stale) Mirror 7: 0x5c548783 (stale) Mirror 8: 0x5c548783 (stale) Mirror 9: 0x5c548783 (stale) Mirror 10: 0x5c548783 (stale) Mirror 11: 0xd580cbbe (stale) Mirror 12: 0x93e50f4d (stale) CRC-32 checksum value for chunk [0, 0x3b787): Mirror 1: 0xd9f196b1 Mirror 13: 0xd9f196b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b787: skipped 000306 1779311028.592918 read 0x0363a7 thru 0x036a96 (0x6f0 bytes) 000307 1779311028.602222 read 0x001253 thru 0x00989e (0x864c bytes) 000309 1779311028.623145 trunc from 0x03b787 to 0x006c23 (0x34b63 bytes) 000312 1779311028.706609 mapread 0x00519b thru 0x006c23 (0x1a89 bytes) 000314 1779311028.724992 trunc from 0x006c24 to 0x0096f0 (0x2acd bytes) 000315 1779311028.744920 write 0x0202b4 thru 0x020494 (0x1e1 bytes) 000319 1779311028.754102 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20495): Mirror 6: 0x996ba87 (stale) Mirror 7: 0x996ba87 (stale) Mirror 8: 0x996ba87 (stale) Mirror 9: 0x996ba87 (stale) Mirror 11: 0x996ba87 (stale) Mirror 12: 0x2a7fd134 (stale) Mirror 13: 0x144b62bf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20495): Mirror 6: 0x996ba87 (stale) Mirror 7: 0x996ba87 (stale) Mirror 8: 0x996ba87 (stale) Mirror 9: 0x996ba87 (stale) Mirror 11: 0x996ba87 (stale) Mirror 12: 0x2a7fd134 (stale) Mirror 13: 0x144b62bf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20495: skipped 000320 1779311029.129262 trunc from 0x020495 to 0x01a7e7 (0x5cad bytes) 000321 1779311029.149810 mapread 0x00aecb thru 0x018d4c (0xde82 bytes) 000322 1779311029.173990 read 0x0040a7 thru 0x0114ef (0xd449 bytes) 000323 1779311029.181834 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1a7e8): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a7e8): Mirror 6: 0x27b73445 (stale) Mirror 7: 0x27b73445 (stale) Mirror 8: 0x27b73445 (stale) Mirror 9: 0x27b73445 (stale) Mirror 11: 0x27b73445 (stale) Mirror 12: 0x8a0d532c (stale) Mirror 13: 0xb976b42e (stale) CRC-32 checksum value for chunk [0, 0x1a7e8): Mirror 1: 0x3f8991a7 Mirror 14: 0x3f8991a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a7e8: skipped 000324 1779311029.779748 write 0x02df0c thru 0x02f9a3 (0x1a98 bytes) 000326 1779311029.849101 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2f9a4): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f9a4): Mirror 6: 0xcd97a0e9 (stale) Mirror 7: 0xcd97a0e9 (stale) Mirror 8: 0xcd97a0e9 (stale) Mirror 9: 0xcd97a0e9 (stale) Mirror 11: 0xbfccd017 (stale) Mirror 12: 0x8d454638 (stale) Mirror 13: 0xd3f336e8 (stale) Mirror 14: 0xa6659ae9 (stale) CRC-32 checksum value for chunk [0, 0x2f9a4): Mirror 1: 0x31c3d5b0 Mirror 15: 0x31c3d5b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f9a4: skipped 000327 1779311030.662342 mapread 0x02253c thru 0x024f94 (0x2a59 bytes) 000330 1779311030.731608 read 0x01a87e thru 0x025c19 (0xb39c bytes) 000332 1779311030.755752 read 0x0173ac thru 0x023011 (0xbc66 bytes) 000333 1779311030.774076 write 0x009e61 thru 0x01312f (0x92cf bytes) 000335 1779311030.842329 trunc from 0x02f9a4 to 0x034b1e (0x517b bytes) 000338 1779311030.857745 mapread 0x016a6b thru 0x01b3ed (0x4983 bytes) 000339 1779311030.885671 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x34b1f): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34b1f): Mirror 6: 0x159c5c86 (stale) Mirror 7: 0x159c5c86 (stale) Mirror 8: 0x159c5c86 (stale) Mirror 9: 0x159c5c86 (stale) Mirror 11: 0x6ccdfb05 (stale) Mirror 12: 0x408c1c4b (stale) Mirror 13: 0x187eb703 (stale) Mirror 14: 0xae701059 (stale) Mirror 15: 0x13da47be (stale) CRC-32 checksum value for chunk [0, 0x34b1f): Mirror 1: 0x679ff112 Mirror 16: 0x679ff112 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34b1f: skipped 000340 1779311031.689315 trunc from 0x034b1f to 0x0173c1 (0x1d75d bytes) 000341 1779311031.774308 read 0x014654 thru 0x0173c1 (0x2d6e bytes) 000342 1779311031.780280 write 0x010f2a thru 0x015666 (0x473d bytes) 000344 1779311031.786413 mapread 0x0112b8 thru 0x0173c1 (0x610a bytes) 000346 1779311031.788942 read 0x00b89b thru 0x013c74 (0x83da bytes) 000347 1779311031.807439 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x173c2): Mirror 6: 0xc38f870a (stale) Mirror 8: 0xc38f870a (stale) Mirror 9: 0xc38f870a (stale) Mirror 11: 0xc38f870a (stale) Mirror 12: 0xe06733e7 (stale) Mirror 13: 0xd6bbe273 (stale) Mirror 14: 0xff82f547 (stale) Mirror 15: 0xff82f547 (stale) Mirror 16: 0x3b1bb33 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x173c2): Mirror 6: 0xc38f870a (stale) Mirror 8: 0xc38f870a (stale) Mirror 9: 0xc38f870a (stale) Mirror 11: 0xc38f870a (stale) Mirror 12: 0xe06733e7 (stale) Mirror 13: 0xd6bbe273 (stale) Mirror 14: 0xff82f547 (stale) Mirror 15: 0xff82f547 (stale) Mirror 16: 0x3b1bb33 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x173c2: skipped 000348 1779311032.278001 mapread 0x006b1c thru 0x00d91b (0x6e00 bytes) 000349 1779311032.297596 mapwrite 0x01ef0e thru 0x020aac (0x1b9f bytes) 000350 1779311032.369497 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x20aad): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20aad): Mirror 6: 0xd7ba5af6 (stale) Mirror 8: 0xd7ba5af6 (stale) Mirror 9: 0xd7ba5af6 (stale) Mirror 11: 0xd7ba5af6 (stale) Mirror 12: 0xc0c1f641 (stale) Mirror 13: 0xd0d24034 (stale) Mirror 14: 0xf14ef778 (stale) Mirror 15: 0xf14ef778 (stale) Mirror 16: 0x2605b29f (stale) CRC-32 checksum value for chunk [0, 0x20aad): Mirror 1: 0x96f55501 Mirror 17: 0x96f55501 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20aad: skipped 000355 1779311033.120841 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x20aad): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20aad): Mirror 6: 0xd7ba5af6 (stale) Mirror 8: 0xd7ba5af6 (stale) Mirror 9: 0xd7ba5af6 (stale) Mirror 11: 0xd7ba5af6 (stale) Mirror 12: 0xc0c1f641 (stale) Mirror 13: 0xd0d24034 (stale) Mirror 14: 0xf14ef778 (stale) Mirror 15: 0xf14ef778 (stale) Mirror 16: 0x2605b29f (stale) CRC-32 checksum value for chunk [0, 0x20aad): Mirror 1: 0x96f55501 Mirror 17: 0x96f55501 Mirror 18: 0x96f55501 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20aad: skipped 000358 1779311033.951502 trunc from 0x020aad to 0x00a548 (0x16564 bytes) 000359 1779311034.057864 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0xa549): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa549): Mirror 6: 0x17f19dea (stale) Mirror 8: 0x17f19dea (stale) Mirror 9: 0x17f19dea (stale) Mirror 11: 0x17f19dea (stale) Mirror 12: 0x17f19dea (stale) Mirror 13: 0xbf5c8ab5 (stale) Mirror 14: 0xf0c493ae (stale) Mirror 15: 0xf0c493ae (stale) Mirror 16: 0xc590c7c (stale) Mirror 17: 0xc590c7c (stale) Mirror 18: 0xc590c7c (stale) CRC-32 checksum value for chunk [0, 0xa549): Mirror 1: 0xc590c7c Mirror 19: 0xc590c7c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa549: skipped 000360 1779311034.834306 mapread 0x0071a4 thru 0x00a548 (0x33a5 bytes) 000361 1779311034.856608 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0xa549): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa549): Mirror 6: 0x17f19dea (stale) Mirror 8: 0x17f19dea (stale) Mirror 9: 0x17f19dea (stale) Mirror 11: 0x17f19dea (stale) Mirror 12: 0x17f19dea (stale) Mirror 13: 0xbf5c8ab5 (stale) Mirror 14: 0xf0c493ae (stale) Mirror 15: 0xf0c493ae (stale) Mirror 16: 0xc590c7c (stale) Mirror 17: 0xc590c7c (stale) Mirror 18: 0xc590c7c (stale) CRC-32 checksum value for chunk [0, 0xa549): Mirror 1: 0xc590c7c Mirror 19: 0xc590c7c Mirror 20: 0xc590c7c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa549: skipped 000362 1779311035.552257 mapwrite 0x020316 thru 0x02fa88 (0xf773 bytes) 000363 1779311035.695342 write 0x0119a2 thru 0x0133bc (0x1a1b bytes) 000366 1779311035.722577 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x2fa89): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fa89): Mirror 6: 0x7b96bd9d (stale) Mirror 8: 0x7b96bd9d (stale) Mirror 9: 0x7b96bd9d (stale) Mirror 11: 0x6c11e2f3 (stale) Mirror 12: 0xed8d1ff (stale) Mirror 13: 0x8cf3ffa4 (stale) Mirror 14: 0xdd1f41c9 (stale) Mirror 15: 0x340c0c22 (stale) Mirror 16: 0xdf21e841 (stale) Mirror 17: 0xe492e8a3 (stale) Mirror 18: 0xe492e8a3 (stale) Mirror 19: 0xdb64621d (stale) Mirror 20: 0xdb64621d (stale) CRC-32 checksum value for chunk [0, 0x2fa89): Mirror 1: 0x4681f318 Mirror 21: 0x4681f318 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fa89: skipped 000368 1779311036.417606 mapwrite 0x03fbad thru 0x03ffff (0x453 bytes) 000372 1779311036.549124 write 0x003de0 thru 0x00796b (0x3b8c bytes) 000373 1779311036.565583 mapwrite 0x0208a8 thru 0x02e694 (0xdded bytes) 000374 1779311036.626775 MIRROR_RESYNC 15 mirrors 000378 1779311038.046710 trunc from 0x040000 to 0x037fa1 (0x805e bytes) 000379 1779311038.108925 mapread 0x004615 thru 0x0126ee (0xe0da bytes) 000380 1779311038.132772 trunc from 0x037fa2 to 0x0344f2 (0x3aaf bytes) 000381 1779311038.147665 read 0x028362 thru 0x02e8fc (0x659b bytes) 000383 1779311038.162897 MIRROR_RESYNC 15 mirrors 000384 1779311039.450989 MIRROR_SPLIT mirror 7 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) 000385 1779311039.835493 trunc from 0x0344f3 to 0x03422c (0x2c6 bytes) 000387 1779311039.902724 mapwrite 0x004706 thru 0x01291d (0xe218 bytes) 000388 1779311039.968763 mapread 0x015de9 thru 0x021cd6 (0xbeee bytes) 000389 1779311039.979810 write 0x00adc2 thru 0x018e3f (0xe07e bytes) 000391 1779311039.981866 mapread 0x02dfb9 thru 0x030cff (0x2d47 bytes) 000392 1779311039.991848 MIRROR_RESYNC 14 mirrors 000394 1779311041.351928 mapread 0x016fa1 thru 0x018ba3 (0x1c03 bytes) 000395 1779311041.377060 trunc from 0x03422d to 0x02f9f1 (0x483b bytes) 000398 1779311041.455255 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x2f9f2): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f9f2): Mirror 6: 0xa7ff91df (stale) Mirror 8: 0xa7ff91df (stale) Mirror 9: 0xa7ff91df (stale) Mirror 11: 0xa7ff91df (stale) Mirror 12: 0xa7ff91df (stale) Mirror 13: 0xa7ff91df (stale) Mirror 15: 0xa7ff91df (stale) Mirror 16: 0xa7ff91df (stale) Mirror 17: 0xa7ff91df (stale) Mirror 18: 0xa7ff91df (stale) Mirror 19: 0xa7ff91df (stale) Mirror 20: 0xa7ff91df (stale) Mirror 21: 0xa7ff91df (stale) CRC-32 checksum value for chunk [0, 0x2f9f2): Mirror 1: 0xa7ff91df Mirror 22: 0xa7ff91df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f9f2: skipped 000399 1779311042.143922 mapread 0x02c8d0 thru 0x02f9f1 (0x3122 bytes) 000400 1779311042.165381 trunc from 0x02f9f2 to 0x03b2ae (0xb8bd bytes) 000402 1779311042.232233 write 0x0291e5 thru 0x037608 (0xe424 bytes) 000403 1779311042.244278 read 0x01f767 thru 0x02c504 (0xcd9e bytes) 000404 1779311042.251381 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x3b2af): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b2af): Mirror 6: 0x8e164ca5 (stale) Mirror 8: 0x8e164ca5 (stale) Mirror 9: 0x8e164ca5 (stale) Mirror 11: 0x8e164ca5 (stale) Mirror 12: 0x8e164ca5 (stale) Mirror 13: 0x8e164ca5 (stale) Mirror 15: 0x8e164ca5 (stale) Mirror 16: 0x8e164ca5 (stale) Mirror 17: 0x8e164ca5 (stale) Mirror 18: 0x8e164ca5 (stale) Mirror 19: 0x8e164ca5 (stale) Mirror 20: 0x8e164ca5 (stale) Mirror 21: 0x8e164ca5 (stale) Mirror 22: 0x1d3ff5de (stale) CRC-32 checksum value for chunk [0, 0x3b2af): Mirror 1: 0xc91d4351 Mirror 23: 0xc91d4351 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b2af: skipped 000412 1779311042.929875 mapread 0x01eb8d thru 0x0246b9 (0x5b2d bytes) 000414 1779311042.959917 trunc from 0x03b2af to 0x035ade (0x57d0 bytes) 000416 1779311043.037870 mapwrite 0x02844e thru 0x02d041 (0x4bf4 bytes) 000417 1779311043.086834 read 0x035a25 thru 0x035ade (0xba bytes) 000419 1779311043.090778 trunc from 0x035adf to 0x022637 (0x134a7 bytes) 000420 1779311043.103858 mapwrite 0x0255f0 thru 0x02fa61 (0xa472 bytes) 000421 1779311043.176457 MIRROR_RESYNC 16 mirrors 000422 1779311044.491814 trunc from 0x02fa62 to 0x01906e (0x169f3 bytes) 000423 1779311044.554621 MIRROR_SPLIT mirror 15 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1906f): Mirror 6: 0xa15550e9 (stale) Mirror 8: 0xa15550e9 (stale) Mirror 9: 0xa15550e9 (stale) Mirror 11: 0xa15550e9 (stale) Mirror 12: 0xa15550e9 (stale) Mirror 13: 0xa15550e9 (stale) Mirror 15: 0xa15550e9 (stale) Mirror 16: 0xa15550e9 (stale) Mirror 17: 0xa15550e9 (stale) Mirror 18: 0xa15550e9 (stale) Mirror 19: 0xa15550e9 (stale) Mirror 20: 0xa15550e9 (stale) Mirror 21: 0xa15550e9 (stale) Mirror 22: 0xa15550e9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1906f): Mirror 6: 0xa15550e9 (stale) Mirror 8: 0xa15550e9 (stale) Mirror 9: 0xa15550e9 (stale) Mirror 11: 0xa15550e9 (stale) Mirror 12: 0xa15550e9 (stale) Mirror 13: 0xa15550e9 (stale) Mirror 15: 0xa15550e9 (stale) Mirror 16: 0xa15550e9 (stale) Mirror 17: 0xa15550e9 (stale) Mirror 18: 0xa15550e9 (stale) Mirror 19: 0xa15550e9 (stale) Mirror 20: 0xa15550e9 (stale) Mirror 21: 0xa15550e9 (stale) Mirror 22: 0xa15550e9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1906f: skipped 000424 1779311045.000808 write 0x03eb33 thru 0x03ffff (0x14cd bytes) 000428 1779311045.003910 mapwrite 0x03a9cd thru 0x03ffff (0x5633 bytes) 000429 1779311045.051655 write 0x011edc thru 0x01b192 (0x92b7 bytes) 000430 1779311045.072580 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb6238d9f (stale) Mirror 8: 0xb6238d9f (stale) Mirror 9: 0xb6238d9f (stale) Mirror 11: 0xb6238d9f (stale) Mirror 12: 0xb6238d9f (stale) Mirror 13: 0xb6238d9f (stale) Mirror 15: 0xb6238d9f (stale) Mirror 16: 0xb6238d9f (stale) Mirror 17: 0xb6238d9f (stale) Mirror 18: 0xb6238d9f (stale) Mirror 19: 0xb6238d9f (stale) Mirror 20: 0xb6238d9f (stale) Mirror 21: 0xb6238d9f (stale) Mirror 22: 0xb6238d9f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3ae25c44 Mirror 23: 0x3ae25c44 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000431 1779311045.793062 read 0x000e23 thru 0x007940 (0x6b1e bytes) 000434 1779311045.812910 write 0x0262c7 thru 0x031d47 (0xba81 bytes) 000435 1779311045.874154 mapwrite 0x00c373 thru 0x012b35 (0x67c3 bytes) 000436 1779311045.920277 trunc from 0x040000 to 0x00dffc (0x32003 bytes) 000437 1779311045.952924 trunc from 0x00dffd to 0x02a67c (0x1c680 bytes) 000439 1779311045.973414 mapread 0x012103 thru 0x01dbae (0xbaac bytes) 000440 1779311045.993023 trunc from 0x02a67d to 0x01005a (0x1a622 bytes) 000441 1779311046.005819 write 0x01dc5a thru 0x02001b (0x23c2 bytes) 000443 1779311046.007716 write 0x01ae68 thru 0x021c5d (0x6df6 bytes) 000444 1779311046.016634 mapwrite 0x0259c8 thru 0x025d87 (0x3c0 bytes) 000447 1779311046.069032 write 0x03d727 thru 0x03ffff (0x28d9 bytes) 000449 1779311046.070883 trunc from 0x040000 to 0x00daf1 (0x3250e bytes) 000451 1779311046.082709 mapwrite 0x009d8d thru 0x0188e1 (0xeb55 bytes) 000452 1779311046.171172 trunc from 0x0188e2 to 0x0284af (0xfbce bytes) 000453 1779311046.194114 mapwrite 0x035f54 thru 0x036964 (0xa11 bytes) 000456 1779311046.254191 mapread 0x021344 thru 0x029d08 (0x89c5 bytes) 000460 1779311046.270005 trunc from 0x036965 to 0x001716 (0x3524e bytes) 000461 1779311046.303181 trunc from 0x001717 to 0x010c54 (0xf53e bytes) 000463 1779311046.318717 write 0x01b647 thru 0x02704c (0xba06 bytes) 000464 1779311046.321769 write 0x008c76 thru 0x01109d (0x8428 bytes) 000465 1779311046.334640 mapread 0x00b04b thru 0x00d0c2 (0x2078 bytes) 000467 1779311046.336997 write 0x031800 thru 0x03e2f8 (0xcaf9 bytes) 000468 1779311046.338766 write 0x002696 thru 0x0080be (0x5a29 bytes) 000470 1779311046.340782 write 0x01ef03 thru 0x023323 (0x4421 bytes) 000472 1779311046.343103 mapwrite 0x039afc thru 0x03ffff (0x6504 bytes) 000473 1779311046.404359 trunc from 0x040000 to 0x037493 (0x8b6c bytes) 000474 1779311046.419792 write 0x01a53a thru 0x01b458 (0xf1f bytes) 000476 1779311046.434747 mapwrite 0x01d68d thru 0x0245a8 (0x6f1c bytes) 000479 1779311046.479308 mapread 0x018637 thru 0x01e2a6 (0x5c70 bytes) 000480 1779311046.481629 mapread 0x007807 thru 0x017531 (0xfd2b bytes) 000481 1779311046.493651 mapread 0x027f43 thru 0x02d6d6 (0x5794 bytes) 000483 1779311046.505974 mapwrite 0x03b58a thru 0x03ffff (0x4a76 bytes) 000485 1779311046.571110 write 0x018549 thru 0x019679 (0x1131 bytes) 000487 1779311046.582293 MIRROR_RESYNC 16 mirrors 000488 1779311047.998447 mapread 0x029c08 thru 0x03421e (0xa617 bytes) 000489 1779311048.027704 mapwrite 0x00df96 thru 0x00f967 (0x19d2 bytes) 000490 1779311048.162562 MIRROR_RESYNC 16 mirrors 000491 1779311049.352000 read 0x03873d thru 0x03ffff (0x78c3 bytes) 000493 1779311049.359765 trunc from 0x040000 to 0x009812 (0x367ed bytes) 000495 1779311049.412221 mapread 0x007077 thru 0x00859d (0x1527 bytes) 000497 1779311049.421105 MIRROR_SPLIT mirror 10 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x9813): Mirror 6: 0xb9267d88 (stale) Mirror 8: 0xb9267d88 (stale) Mirror 9: 0xb9267d88 (stale) Mirror 11: 0xb9267d88 (stale) Mirror 12: 0xb9267d88 (stale) Mirror 13: 0xb9267d88 (stale) Mirror 15: 0xb9267d88 (stale) Mirror 16: 0xb9267d88 (stale) Mirror 17: 0xb9267d88 (stale) Mirror 19: 0xb9267d88 (stale) Mirror 20: 0xb9267d88 (stale) Mirror 21: 0xb9267d88 (stale) Mirror 22: 0xb9267d88 (stale) Mirror 23: 0xb9267d88 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9813): Mirror 6: 0xb9267d88 (stale) Mirror 8: 0xb9267d88 (stale) Mirror 9: 0xb9267d88 (stale) Mirror 11: 0xb9267d88 (stale) Mirror 12: 0xb9267d88 (stale) Mirror 13: 0xb9267d88 (stale) Mirror 15: 0xb9267d88 (stale) Mirror 16: 0xb9267d88 (stale) Mirror 17: 0xb9267d88 (stale) Mirror 19: 0xb9267d88 (stale) Mirror 20: 0xb9267d88 (stale) Mirror 21: 0xb9267d88 (stale) Mirror 22: 0xb9267d88 (stale) Mirror 23: 0xb9267d88 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9813: skipped 000500 1779311049.814267 mapread 0x002ce4 thru 0x009812 (0x6b2f bytes) 000504 1779311049.830734 read 0x007f32 thru 0x009812 (0x18e1 bytes) 000507 1779311049.832291 read 0x008813 thru 0x009812 (0x1000 bytes) 000508 1779311049.832871 read 0x0030a5 thru 0x004a14 (0x1970 bytes) 000509 1779311049.833445 write 0x03bef6 thru 0x03ffff (0x410a bytes) 000510 1779311049.834624 trunc from 0x040000 to 0x008ee1 (0x3711e bytes) 000511 1779311049.850666 read 0x0035cb thru 0x003c2f (0x665 bytes) 000512 1779311049.851305 trunc from 0x008ee2 to 0x02d764 (0x24883 bytes) 000513 1779311049.861422 mapread 0x020738 thru 0x02d764 (0xd02d bytes) 000514 1779311049.874327 MIRROR_RESYNC 15 mirrors 000515 1779311051.006220 trunc from 0x02d765 to 0x0389c7 (0xb263 bytes) 000516 1779311051.088013 mapwrite 0x00bc58 thru 0x01b753 (0xfafc bytes) 000519 1779311051.136649 mapwrite 0x01ab4f thru 0x023be6 (0x9098 bytes) 000521 1779311051.180176 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x389c8): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x389c8): Mirror 6: 0x83d819d5 (stale) Mirror 8: 0x83d819d5 (stale) Mirror 9: 0x83d819d5 (stale) Mirror 11: 0x83d819d5 (stale) Mirror 12: 0x83d819d5 (stale) Mirror 13: 0x83d819d5 (stale) Mirror 15: 0x83d819d5 (stale) Mirror 16: 0x83d819d5 (stale) Mirror 17: 0x83d819d5 (stale) Mirror 19: 0x83d819d5 (stale) Mirror 20: 0x83d819d5 (stale) Mirror 21: 0x83d819d5 (stale) Mirror 22: 0x83d819d5 (stale) Mirror 23: 0x83d819d5 (stale) CRC-32 checksum value for chunk [0, 0x389c8): Mirror 1: 0x40c9f2f7 Mirror 24: 0x40c9f2f7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x389c8: skipped 000522 1779311051.865234 mapwrite 0x02b644 thru 0x031bc6 (0x6583 bytes) 000523 1779311052.018286 MIRROR_RESYNC 16 mirrors 000526 1779311053.331750 read 0x011fad thru 0x01591a (0x396e bytes) 000527 1779311053.342853 mapread 0x02ab27 thru 0x03732a (0xc804 bytes) 000528 1779311053.365598 mapread 0x032429 thru 0x0389c7 (0x659f bytes) 000529 1779311053.366247 mapread 0x0184d2 thru 0x01f713 (0x7242 bytes) 000533 1779311053.375934 trunc from 0x0389c8 to 0x003100 (0x358c7 bytes) 000535 1779311053.437163 trunc from 0x003101 to 0x00122b (0x1ed5 bytes) 000539 1779311053.453029 write 0x00483a thru 0x01425d (0xfa24 bytes) 000540 1779311053.454801 trunc from 0x01425e to 0x02b095 (0x16e38 bytes) 000541 1779311053.466677 write 0x034653 thru 0x03c5f2 (0x7fa0 bytes) 000543 1779311053.468426 write 0x035905 thru 0x036730 (0xe2c bytes) 000545 1779311053.471259 read 0x0107c1 thru 0x016c4c (0x648c bytes) 000547 1779311053.480139 write 0x002e76 thru 0x00f36b (0xc4f6 bytes) 000549 1779311053.482207 mapread 0x015938 thru 0x015c0c (0x2d5 bytes) 000551 1779311053.483899 mapread 0x00976f thru 0x00baf7 (0x2389 bytes) 000552 1779311053.484943 write 0x0145ae thru 0x0164de (0x1f31 bytes) 000554 1779311053.486859 write 0x03f57b thru 0x03ffff (0xa85 bytes) 000558 1779311053.489817 write 0x00744b thru 0x00c1ad (0x4d63 bytes) 000559 1779311053.490882 read 0x038775 thru 0x03e0ac (0x5938 bytes) 000561 1779311053.496909 read 0x01445a thru 0x021549 (0xd0f0 bytes) 000562 1779311053.497608 write 0x011158 thru 0x0133c3 (0x226c bytes) 000563 1779311053.502701 MIRROR_RESYNC 16 mirrors 000564 1779311054.899857 read 0x000e31 thru 0x00f31f (0xe4ef bytes) 000565 1779311054.904713 mapwrite 0x01e111 thru 0x02742f (0x931f bytes) 000566 1779311055.027515 MIRROR_SPLIT mirror 3 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x7e5165bf (stale) Mirror 8: 0x7e5165bf (stale) Mirror 11: 0x7e5165bf (stale) Mirror 12: 0x7e5165bf (stale) Mirror 13: 0x7e5165bf (stale) Mirror 15: 0x7e5165bf (stale) Mirror 16: 0x7e5165bf (stale) Mirror 17: 0x7e5165bf (stale) Mirror 19: 0x7e5165bf (stale) Mirror 20: 0x7e5165bf (stale) Mirror 21: 0x7e5165bf (stale) Mirror 22: 0x7e5165bf (stale) Mirror 23: 0x7e5165bf (stale) Mirror 24: 0x7e5165bf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x7e5165bf (stale) Mirror 8: 0x7e5165bf (stale) Mirror 11: 0x7e5165bf (stale) Mirror 12: 0x7e5165bf (stale) Mirror 13: 0x7e5165bf (stale) Mirror 15: 0x7e5165bf (stale) Mirror 16: 0x7e5165bf (stale) Mirror 17: 0x7e5165bf (stale) Mirror 19: 0x7e5165bf (stale) Mirror 20: 0x7e5165bf (stale) Mirror 21: 0x7e5165bf (stale) Mirror 22: 0x7e5165bf (stale) Mirror 23: 0x7e5165bf (stale) Mirror 24: 0x7e5165bf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000568 1779311055.509131 read 0x02eb20 thru 0x030022 (0x1503 bytes) 000570 1779311055.515967 mapread 0x036f59 thru 0x03b4f2 (0x459a bytes) 000572 1779311055.540411 read 0x019e95 thru 0x01c3e0 (0x254c bytes) 000573 1779311055.547905 trunc from 0x040000 to 0x03cfd3 (0x302c bytes) 000574 1779311055.564452 mapread 0x02cd63 thru 0x02eb54 (0x1df2 bytes) 000576 1779311055.570808 MIRROR_RESYNC 15 mirrors 000577 1779311056.669111 mapwrite 0x020412 thru 0x0278d0 (0x74bf bytes) 000578 1779311056.811473 mapwrite 0x031933 thru 0x03aff0 (0x96be bytes) 000580 1779311056.872171 MIRROR_SPLIT mirror 2 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cfd4): Mirror 6: 0xdf86e388 (stale) Mirror 11: 0xdf86e388 (stale) Mirror 12: 0xdf86e388 (stale) Mirror 13: 0xdf86e388 (stale) Mirror 15: 0xdf86e388 (stale) Mirror 16: 0xdf86e388 (stale) Mirror 17: 0xdf86e388 (stale) Mirror 19: 0xdf86e388 (stale) Mirror 20: 0xdf86e388 (stale) Mirror 21: 0xdf86e388 (stale) Mirror 22: 0xdf86e388 (stale) Mirror 23: 0xdf86e388 (stale) Mirror 24: 0xdf86e388 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cfd4): Mirror 6: 0xdf86e388 (stale) Mirror 11: 0xdf86e388 (stale) Mirror 12: 0xdf86e388 (stale) Mirror 13: 0xdf86e388 (stale) Mirror 15: 0xdf86e388 (stale) Mirror 16: 0xdf86e388 (stale) Mirror 17: 0xdf86e388 (stale) Mirror 19: 0xdf86e388 (stale) Mirror 20: 0xdf86e388 (stale) Mirror 21: 0xdf86e388 (stale) Mirror 22: 0xdf86e388 (stale) Mirror 23: 0xdf86e388 (stale) Mirror 24: 0xdf86e388 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cfd4: skipped 000582 1779311057.441653 read 0x006918 thru 0x010a34 (0xa11d bytes) 000587 1779311057.453909 write 0x03ebac thru 0x03ffff (0x1454 bytes) 000588 1779311057.458099 mapwrite 0x033828 thru 0x03ffff (0xc7d8 bytes) 000590 1779311057.528724 trunc from 0x040000 to 0x01b843 (0x247bc bytes) 000591 1779311057.546459 trunc from 0x01b844 to 0x035402 (0x19bbf bytes) 000592 1779311057.559908 MIRROR_RESYNC 14 mirrors 000594 1779311058.850105 write 0x03dbe9 thru 0x03ffff (0x2417 bytes) 000597 1779311058.896265 MIRROR_RESYNC 14 mirrors 000598 1779311060.178924 mapread 0x0294cf thru 0x036ded (0xd91f bytes) 000599 1779311060.210778 write 0x024aff thru 0x02f630 (0xab32 bytes) 000601 1779311060.284740 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xf7ed80cb (stale) Mirror 11: 0xf7ed80cb (stale) Mirror 12: 0xf7ed80cb (stale) Mirror 13: 0xf7ed80cb (stale) Mirror 15: 0xf7ed80cb (stale) Mirror 16: 0xf7ed80cb (stale) Mirror 17: 0xf7ed80cb (stale) Mirror 19: 0xf7ed80cb (stale) Mirror 20: 0xf7ed80cb (stale) Mirror 21: 0xf7ed80cb (stale) Mirror 22: 0xf7ed80cb (stale) Mirror 23: 0xf7ed80cb (stale) Mirror 24: 0xf7ed80cb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2aca0bc Mirror 25: 0x2aca0bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000603 1779311061.137086 mapwrite 0x032c65 thru 0x0395cf (0x696b bytes) 000604 1779311061.284734 MIRROR_RESYNC 15 mirrors 000605 1779311062.686909 mapread 0x01808b thru 0x0220e5 (0xa05b bytes) 000606 1779311062.708183 MIRROR_EXTEND to 16 mirrors 000608 1779311063.294379 read 0x0358b9 thru 0x03ffff (0xa747 bytes) 000609 1779311063.306433 MIRROR_SPLIT mirror 11 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) 000610 1779311063.652515 MIRROR_RESYNC 15 mirrors 000614 1779311064.121372 trunc from 0x040000 to 0x033b76 (0xc489 bytes) 000615 1779311064.185746 MIRROR_RESYNC 15 mirrors 000617 1779311065.221761 MIRROR_SPLIT mirror 4 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) 000618 1779311065.496034 write 0x008ef8 thru 0x014d70 (0xbe79 bytes) 000619 1779311065.543120 mapwrite 0x00daeb thru 0x00f0f0 (0x1606 bytes) 000620 1779311065.588810 MIRROR_RESYNC 14 mirrors 000621 1779311066.488613 mapread 0x00f6a3 thru 0x01903e (0x999c bytes) 000623 1779311066.503378 MIRROR_SPLIT mirror 2 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) 000624 1779311066.772850 read 0x01299e thru 0x018a3d (0x60a0 bytes) 000625 1779311066.779108 write 0x01c6c5 thru 0x028775 (0xc0b1 bytes) 000630 1779311066.837225 write 0x017823 thru 0x026c6e (0xf44c bytes) 000631 1779311066.844726 mapwrite 0x02fe29 thru 0x03fc9d (0xfe75 bytes) 000632 1779311066.913052 trunc from 0x03fc9e to 0x02ed9d (0x10f00 bytes) 000633 1779311066.928455 write 0x01338a thru 0x01a598 (0x720f bytes) 000634 1779311066.929673 mapread 0x015c17 thru 0x020727 (0xab11 bytes) 000635 1779311066.930810 read 0x028550 thru 0x029489 (0xf3a bytes) 000636 1779311066.931415 read 0x0008da thru 0x00632b (0x5a52 bytes) 000638 1779311066.938920 write 0x03d4c6 thru 0x03ffff (0x2b3a bytes) 000639 1779311066.939882 mapwrite 0x018fe1 thru 0x0254db (0xc4fb bytes) 000641 1779311066.972607 trunc from 0x040000 to 0x00b6c0 (0x3493f bytes) 000643 1779311066.983543 mapread 0x009cf2 thru 0x00b6c0 (0x19cf bytes) 000644 1779311066.984590 write 0x014840 thru 0x01912d (0x48ee bytes) 000646 1779311066.986683 mapread 0x00fe73 thru 0x0109ef (0xb7d bytes) 000648 1779311066.997489 MIRROR_RESYNC 13 mirrors 000649 1779311067.931741 read 0x018e4c thru 0x01912d (0x2e2 bytes) 000650 1779311067.935077 read 0x018c17 thru 0x01912d (0x517 bytes) 000652 1779311067.938157 MIRROR_RESYNC 13 mirrors 000655 1779311068.322083 read 0x00194a thru 0x004e3d (0x34f4 bytes) 000657 1779311068.330289 write 0x027d8d thru 0x031919 (0x9b8d bytes) 000658 1779311068.374325 read 0x01aaa5 thru 0x023b61 (0x90bd bytes) 000660 1779311068.383369 mapwrite 0x017367 thru 0x0246d1 (0xd36b bytes) 000661 1779311068.438221 mapwrite 0x01f5ee thru 0x02bd9e (0xc7b1 bytes) 000663 1779311068.482177 trunc from 0x03191a to 0x02513c (0xc7dd bytes) 000667 1779311068.506207 trunc from 0x02513d to 0x02a2c8 (0x518c bytes) 000670 1779311068.523247 trunc from 0x02a2c9 to 0x012917 (0x179b1 bytes) 000671 1779311068.540094 mapwrite 0x021fe2 thru 0x026432 (0x4451 bytes) 000672 1779311068.639985 mapread 0x008005 thru 0x01421f (0xc21b bytes) 000673 1779311068.646598 read 0x00df18 thru 0x01a215 (0xc2fe bytes) 000674 1779311068.651682 trunc from 0x026433 to 0x01d1b0 (0x9282 bytes) 000675 1779311068.659620 write 0x03cc08 thru 0x03ffff (0x33f8 bytes) 000676 1779311068.662838 MIRROR_RESYNC 13 mirrors 000679 1779311069.807005 read 0x000986 thru 0x002065 (0x16e0 bytes) 000680 1779311069.815640 mapread 0x0002cd thru 0x00f45e (0xf192 bytes) 000681 1779311069.841823 read 0x00d567 thru 0x01c8a3 (0xf33d bytes) 000682 1779311069.850107 mapwrite 0x032e7b thru 0x03a16b (0x72f1 bytes) 000683 1779311070.000573 mapread 0x031b10 thru 0x03664f (0x4b40 bytes) 000684 1779311070.005158 read 0x0283ba thru 0x03030b (0x7f52 bytes) 000688 1779311070.017906 write 0x00dbf5 thru 0x019c49 (0xc055 bytes) 000689 1779311070.019709 read 0x011ca9 thru 0x014c30 (0x2f88 bytes) 000690 1779311070.020694 mapwrite 0x00a8e4 thru 0x00fb1f (0x523c bytes) 000691 1779311070.064046 trunc from 0x040000 to 0x00d603 (0x329fc bytes) 000692 1779311070.082420 read 0x0028c2 thru 0x00d603 (0xad42 bytes) 000694 1779311070.083685 mapread 0x0070c2 thru 0x00d603 (0x6542 bytes) 000695 1779311070.084893 mapwrite 0x030077 thru 0x03642f (0x63b9 bytes) 000699 1779311070.157198 write 0x03181e thru 0x03fa18 (0xe1fb bytes) 000702 1779311070.165610 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fa19): Mirror 12: 0x4a5fb8f3 (stale) Mirror 15: 0x4a5fb8f3 (stale) Mirror 16: 0x4a5fb8f3 (stale) Mirror 17: 0x4a5fb8f3 (stale) Mirror 19: 0x4a5fb8f3 (stale) Mirror 20: 0x4a5fb8f3 (stale) Mirror 21: 0x4a5fb8f3 (stale) Mirror 23: 0x4a5fb8f3 (stale) Mirror 24: 0x4a5fb8f3 (stale) Mirror 25: 0x4a5fb8f3 (stale) Mirror 26: 0x4a5fb8f3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa19): Mirror 12: 0x4a5fb8f3 (stale) Mirror 15: 0x4a5fb8f3 (stale) Mirror 16: 0x4a5fb8f3 (stale) Mirror 17: 0x4a5fb8f3 (stale) Mirror 19: 0x4a5fb8f3 (stale) Mirror 20: 0x4a5fb8f3 (stale) Mirror 21: 0x4a5fb8f3 (stale) Mirror 23: 0x4a5fb8f3 (stale) Mirror 24: 0x4a5fb8f3 (stale) Mirror 25: 0x4a5fb8f3 (stale) Mirror 26: 0x4a5fb8f3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa19: skipped 000703 1779311070.647801 trunc from 0x03fa19 to 0x02037c (0x1f69c bytes) 000704 1779311070.660907 read 0x012fcd thru 0x02037c (0xd3b0 bytes) 000707 1779311070.673768 read 0x0082a1 thru 0x01107c (0x8ddc bytes) 000708 1779311070.689150 MIRROR_RESYNC 12 mirrors 000709 1779311071.780132 read 0x0183b3 thru 0x01eaa5 (0x66f3 bytes) 000710 1779311071.791699 MIRROR_EXTEND to 13 mirrors 000711 1779311072.363503 MIRROR_RESYNC 13 mirrors 000712 1779311072.761141 MIRROR_EXTEND to 14 mirrors 000716 1779311073.320666 MIRROR_EXTEND to 15 mirrors 000717 1779311073.837737 MIRROR_SPLIT mirror 2 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) 000719 1779311074.195356 mapread 0x0015f9 thru 0x0102ac (0xecb4 bytes) 000721 1779311074.225718 mapread 0x019f36 thru 0x02037c (0x6447 bytes) 000724 1779311074.237023 trunc from 0x02037d to 0x02c15a (0xbdde bytes) 000727 1779311074.310424 trunc from 0x02c15b to 0x010b7d (0x1b5dd bytes) 000730 1779311074.328632 mapwrite 0x00f6ec thru 0x015c48 (0x655d bytes) 000731 1779311074.419121 MIRROR_SPLIT mirror 4 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15c49): Mirror 12: 0x586d38ac (stale) Mirror 16: 0x586d38ac (stale) Mirror 17: 0x586d38ac (stale) Mirror 20: 0x586d38ac (stale) Mirror 21: 0x586d38ac (stale) Mirror 23: 0x586d38ac (stale) Mirror 24: 0x586d38ac (stale) Mirror 25: 0x586d38ac (stale) Mirror 26: 0x586d38ac (stale) Mirror 27: 0x586d38ac (stale) Mirror 28: 0x586d38ac (stale) Mirror 29: 0x586d38ac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15c49): Mirror 12: 0x586d38ac (stale) Mirror 16: 0x586d38ac (stale) Mirror 17: 0x586d38ac (stale) Mirror 20: 0x586d38ac (stale) Mirror 21: 0x586d38ac (stale) Mirror 23: 0x586d38ac (stale) Mirror 24: 0x586d38ac (stale) Mirror 25: 0x586d38ac (stale) Mirror 26: 0x586d38ac (stale) Mirror 27: 0x586d38ac (stale) Mirror 28: 0x586d38ac (stale) Mirror 29: 0x586d38ac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15c49: skipped 000734 1779311074.822708 mapread 0x00a0fc thru 0x00d46a (0x336f bytes) 000735 1779311074.837894 write 0x02cce7 thru 0x03ab62 (0xde7c bytes) 000736 1779311074.841509 trunc from 0x03ab63 to 0x0300d8 (0xaa8a bytes) 000737 1779311074.855847 mapwrite 0x034934 thru 0x03f06d (0xa73a bytes) 000738 1779311074.937637 mapread 0x0057cd thru 0x009711 (0x3f45 bytes) 000740 1779311074.939097 write 0x029ffe thru 0x030e42 (0x6e45 bytes) 000742 1779311074.946113 trunc from 0x03f06e to 0x0145d7 (0x2aa96 bytes) 000743 1779311074.957120 mapread 0x00e3e0 thru 0x010746 (0x2367 bytes) 000745 1779311074.959111 read 0x00a1bb thru 0x00d556 (0x339c bytes) 000746 1779311074.959919 mapwrite 0x026d68 thru 0x029e38 (0x30d1 bytes) 000747 1779311075.022728 write 0x018e01 thru 0x025bc5 (0xcdc5 bytes) 000749 1779311075.031256 mapwrite 0x0363f5 thru 0x03ffff (0x9c0b bytes) 000752 1779311075.113621 read 0x03afa1 thru 0x03cd71 (0x1dd1 bytes) 000755 1779311075.118695 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x1656e1bc (stale) Mirror 16: 0x1656e1bc (stale) Mirror 17: 0x1656e1bc (stale) Mirror 20: 0x1656e1bc (stale) Mirror 21: 0x1656e1bc (stale) Mirror 23: 0x1656e1bc (stale) Mirror 24: 0x1656e1bc (stale) Mirror 25: 0x1656e1bc (stale) Mirror 26: 0x1656e1bc (stale) Mirror 27: 0x1656e1bc (stale) Mirror 28: 0x1656e1bc (stale) Mirror 29: 0x1656e1bc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x808f34dc Mirror 30: 0x808f34dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000756 1779311075.755443 mapwrite 0x032831 thru 0x03a8b5 (0x8085 bytes) 000757 1779311075.891553 write 0x03641c thru 0x03ac7e (0x4863 bytes) 000760 1779311075.896852 mapread 0x01596c thru 0x0212ca (0xb95f bytes) 000762 1779311075.926826 mapwrite 0x00166f thru 0x001fbb (0x94d bytes) 000763 1779311075.972637 mapread 0x02ba3e thru 0x02fc49 (0x420c bytes) 000764 1779311075.987829 trunc from 0x040000 to 0x032740 (0xd8bf bytes) 000765 1779311076.020889 mapwrite 0x03f40d thru 0x03f775 (0x369 bytes) 000769 1779311076.076116 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3f776): Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f776): Mirror 12: 0x157970e9 (stale) Mirror 16: 0x157970e9 (stale) Mirror 17: 0x157970e9 (stale) Mirror 20: 0x157970e9 (stale) Mirror 21: 0x157970e9 (stale) Mirror 23: 0x157970e9 (stale) Mirror 24: 0x157970e9 (stale) Mirror 25: 0x157970e9 (stale) Mirror 26: 0x157970e9 (stale) Mirror 27: 0x157970e9 (stale) Mirror 28: 0x157970e9 (stale) Mirror 29: 0x157970e9 (stale) Mirror 30: 0xa5b6ef4c (stale) CRC-32 checksum value for chunk [0, 0x3f776): Mirror 1: 0xefcd5fe Mirror 31: 0xefcd5fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f776: skipped 000770 1779311076.823118 mapread 0x00bb61 thru 0x018c97 (0xd137 bytes) 000776 1779311076.867507 read 0x032bf3 thru 0x0368ba (0x3cc8 bytes) 000777 1779311076.877792 mapread 0x03b3f2 thru 0x03f775 (0x4384 bytes) 000778 1779311076.889755 write 0x026170 thru 0x030cb8 (0xab49 bytes) 000780 1779311076.957782 mapwrite 0x01e404 thru 0x021990 (0x358d bytes) 000781 1779311077.006259 mapread 0x0358fd thru 0x037c84 (0x2388 bytes) 000782 1779311077.020892 MIRROR_SPLIT mirror 4 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f776): Mirror 12: 0x157970e9 (stale) Mirror 16: 0x157970e9 (stale) Mirror 17: 0x157970e9 (stale) Mirror 21: 0x157970e9 (stale) Mirror 23: 0x157970e9 (stale) Mirror 24: 0x157970e9 (stale) Mirror 25: 0x157970e9 (stale) Mirror 26: 0x157970e9 (stale) Mirror 27: 0x157970e9 (stale) Mirror 28: 0x157970e9 (stale) Mirror 29: 0x157970e9 (stale) Mirror 30: 0xa5b6ef4c (stale) Mirror 31: 0xefcd5fe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f776): Mirror 12: 0x157970e9 (stale) Mirror 16: 0x157970e9 (stale) Mirror 17: 0x157970e9 (stale) Mirror 21: 0x157970e9 (stale) Mirror 23: 0x157970e9 (stale) Mirror 24: 0x157970e9 (stale) Mirror 25: 0x157970e9 (stale) Mirror 26: 0x157970e9 (stale) Mirror 27: 0x157970e9 (stale) Mirror 28: 0x157970e9 (stale) Mirror 29: 0x157970e9 (stale) Mirror 30: 0xa5b6ef4c (stale) Mirror 31: 0xefcd5fe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f776: skipped 000785 1779311077.457495 mapwrite 0x025ba7 thru 0x027318 (0x1772 bytes) 000789 1779311077.499834 read 0x03af57 thru 0x03f775 (0x481f bytes) 000790 1779311077.507965 mapread 0x001f06 thru 0x00be9e (0x9f99 bytes) 000793 1779311077.516434 mapwrite 0x00826c thru 0x00d94b (0x56e0 bytes) 000795 1779311077.560775 mapread 0x017dac thru 0x019e75 (0x20ca bytes) 000796 1779311077.572605 trunc from 0x03f776 to 0x02486f (0x1af06 bytes) 000797 1779311077.608899 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x24870): Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24870): Mirror 12: 0x86034753 (stale) Mirror 16: 0x86034753 (stale) Mirror 17: 0x86034753 (stale) Mirror 21: 0x86034753 (stale) Mirror 23: 0x86034753 (stale) Mirror 24: 0x86034753 (stale) Mirror 25: 0x86034753 (stale) Mirror 26: 0x86034753 (stale) Mirror 27: 0x86034753 (stale) Mirror 28: 0x86034753 (stale) Mirror 29: 0x86034753 (stale) Mirror 30: 0x2d13841e (stale) Mirror 31: 0x6dcb2d9a (stale) CRC-32 checksum value for chunk [0, 0x24870): Mirror 1: 0xe7268bbc Mirror 32: 0xe7268bbc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24870: skipped 000798 1779311078.178513 MIRROR_SPLIT mirror 2 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24870): Mirror 12: 0x86034753 (stale) Mirror 17: 0x86034753 (stale) Mirror 21: 0x86034753 (stale) Mirror 23: 0x86034753 (stale) Mirror 24: 0x86034753 (stale) Mirror 25: 0x86034753 (stale) Mirror 26: 0x86034753 (stale) Mirror 27: 0x86034753 (stale) Mirror 28: 0x86034753 (stale) Mirror 29: 0x86034753 (stale) Mirror 30: 0x2d13841e (stale) Mirror 31: 0x6dcb2d9a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24870): Mirror 12: 0x86034753 (stale) Mirror 17: 0x86034753 (stale) Mirror 21: 0x86034753 (stale) Mirror 23: 0x86034753 (stale) Mirror 24: 0x86034753 (stale) Mirror 25: 0x86034753 (stale) Mirror 26: 0x86034753 (stale) Mirror 27: 0x86034753 (stale) Mirror 28: 0x86034753 (stale) Mirror 29: 0x86034753 (stale) Mirror 30: 0x2d13841e (stale) Mirror 31: 0x6dcb2d9a (stale) CRC-32 checksum value for chunk [0, 0x24870): Mirror 1: 0xe7268bbc Mirror 32: 0xe7268bbc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24870: skipped 000799 1779311078.860006 mapread 0x01fe78 thru 0x02486f (0x49f8 bytes) 000800 1779311078.894728 trunc from 0x024870 to 0x002bb6 (0x21cb9 bytes) 000801 1779311078.991749 trunc from 0x002bb7 to 0x00edc8 (0xc212 bytes) 000802 1779311079.004801 read 0x00798c thru 0x00edc8 (0x743d bytes) 000804 1779311079.013515 read 0x00e6e2 thru 0x00edc8 (0x6e7 bytes) 000806 1779311079.015127 mapwrite 0x03ce9a thru 0x03ffff (0x3166 bytes) 000808 1779311079.083396 MIRROR_RESYNC 14 mirrors 000810 1779311080.479700 read 0x01be09 thru 0x0259b8 (0x9bb0 bytes) 000811 1779311080.488559 write 0x00fd18 thru 0x01ec15 (0xeefe bytes) 000812 1779311080.553500 MIRROR_RESYNC 14 mirrors 000813 1779311081.739707 write 0x012de5 thru 0x014143 (0x135f bytes) 000816 1779311081.814317 mapwrite 0x02f29e thru 0x0366d2 (0x7435 bytes) 000818 1779311081.858114 write 0x008b48 thru 0x00aae2 (0x1f9b bytes) 000819 1779311081.868086 mapwrite 0x00eece thru 0x00f88a (0x9bd bytes) 000820 1779311081.903690 trunc from 0x040000 to 0x00c57c (0x33a83 bytes) 000821 1779311081.914761 write 0x00e6e9 thru 0x0187e1 (0xa0f9 bytes) 000823 1779311081.917454 write 0x035d77 thru 0x03b0af (0x5339 bytes) 000826 1779311081.920497 write 0x0293d9 thru 0x03697d (0xd5a5 bytes) 000827 1779311081.929274 mapwrite 0x038b40 thru 0x03ab3b (0x1ffc bytes) 000828 1779311081.974118 write 0x018672 thru 0x01e416 (0x5da5 bytes) 000830 1779311081.980069 mapwrite 0x035ff2 thru 0x03626f (0x27e bytes) 000831 1779311082.020204 trunc from 0x03b0b0 to 0x03a8a9 (0x806 bytes) 000833 1779311082.040116 read 0x038755 thru 0x03a8a9 (0x2155 bytes) 000837 1779311082.046010 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3a8aa): Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a8aa): Mirror 12: 0xb7b7b338 (stale) Mirror 17: 0xb7b7b338 (stale) Mirror 21: 0xb7b7b338 (stale) Mirror 23: 0xb7b7b338 (stale) Mirror 24: 0xb7b7b338 (stale) Mirror 25: 0xb7b7b338 (stale) Mirror 26: 0xb7b7b338 (stale) Mirror 27: 0xb7b7b338 (stale) Mirror 28: 0xb7b7b338 (stale) Mirror 29: 0xb7b7b338 (stale) Mirror 30: 0xb7b7b338 (stale) Mirror 31: 0xb7b7b338 (stale) Mirror 32: 0xb7b7b338 (stale) CRC-32 checksum value for chunk [0, 0x3a8aa): Mirror 1: 0x421aee49 Mirror 33: 0x421aee49 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a8aa: skipped 000839 1779311082.750485 mapread 0x00bce0 thru 0x010fe7 (0x5308 bytes) 000840 1779311082.770782 trunc from 0x03a8aa to 0x024730 (0x16179 bytes) 000841 1779311082.834138 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x24731): Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24731): Mirror 12: 0x3d5948c9 (stale) Mirror 17: 0x3d5948c9 (stale) Mirror 21: 0x3d5948c9 (stale) Mirror 23: 0x3d5948c9 (stale) Mirror 24: 0x3d5948c9 (stale) Mirror 25: 0x3d5948c9 (stale) Mirror 26: 0x3d5948c9 (stale) Mirror 27: 0x3d5948c9 (stale) Mirror 28: 0x3d5948c9 (stale) Mirror 29: 0x3d5948c9 (stale) Mirror 30: 0x3d5948c9 (stale) Mirror 31: 0x3d5948c9 (stale) Mirror 32: 0x3d5948c9 (stale) Mirror 33: 0xa80cb109 (stale) CRC-32 checksum value for chunk [0, 0x24731): Mirror 1: 0xa80cb109 Mirror 34: 0xa80cb109 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24731: skipped 000845 1779311083.491600 MIRROR_RESYNC 16 mirrors 000848 1779311084.778702 read 0x020981 thru 0x02435c (0x39dc bytes) 000849 1779311084.786840 read 0x01ee13 thru 0x024730 (0x591e bytes) 000852 1779311084.795891 write 0x03285b thru 0x03b320 (0x8ac6 bytes) 000853 1779311084.846927 mapwrite 0x016d3e thru 0x0258dd (0xeba0 bytes) 000854 1779311084.968138 mapwrite 0x0147e8 thru 0x021058 (0xc871 bytes) 000855 1779311085.020118 read 0x00508b thru 0x00783b (0x27b1 bytes) 000856 1779311085.031654 trunc from 0x03b321 to 0x00f964 (0x2b9bc bytes) 000857 1779311085.051676 write 0x02a4b4 thru 0x03519c (0xace9 bytes) 000858 1779311085.055418 mapread 0x02f02d thru 0x03519c (0x6170 bytes) 000859 1779311085.057044 trunc from 0x03519d to 0x01ad8e (0x1a40e bytes) 000860 1779311085.083992 mapwrite 0x0099ec thru 0x01838a (0xe99f bytes) 000864 1779311085.174547 mapread 0x00ff90 thru 0x01ad8e (0xadff bytes) 000866 1779311085.193415 mapwrite 0x0019dd thru 0x011018 (0xf63c bytes) 000867 1779311085.247279 mapwrite 0x03c992 thru 0x03cbc5 (0x234 bytes) 000869 1779311085.305509 MIRROR_SPLIT mirror 7 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cbc6): Mirror 12: 0xd5c39fc4 (stale) Mirror 17: 0xd5c39fc4 (stale) Mirror 21: 0xd5c39fc4 (stale) Mirror 23: 0xd5c39fc4 (stale) Mirror 24: 0xd5c39fc4 (stale) Mirror 25: 0xd5c39fc4 (stale) Mirror 27: 0xd5c39fc4 (stale) Mirror 28: 0xd5c39fc4 (stale) Mirror 29: 0xd5c39fc4 (stale) Mirror 30: 0xd5c39fc4 (stale) Mirror 31: 0xd5c39fc4 (stale) Mirror 32: 0xd5c39fc4 (stale) Mirror 33: 0xd5c39fc4 (stale) Mirror 34: 0xd5c39fc4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cbc6): Mirror 12: 0xd5c39fc4 (stale) Mirror 17: 0xd5c39fc4 (stale) Mirror 21: 0xd5c39fc4 (stale) Mirror 23: 0xd5c39fc4 (stale) Mirror 24: 0xd5c39fc4 (stale) Mirror 25: 0xd5c39fc4 (stale) Mirror 27: 0xd5c39fc4 (stale) Mirror 28: 0xd5c39fc4 (stale) Mirror 29: 0xd5c39fc4 (stale) Mirror 30: 0xd5c39fc4 (stale) Mirror 31: 0xd5c39fc4 (stale) Mirror 32: 0xd5c39fc4 (stale) Mirror 33: 0xd5c39fc4 (stale) Mirror 34: 0xd5c39fc4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cbc6: skipped 000870 1779311085.888086 trunc from 0x03cbc6 to 0x028b38 (0x1408d bytes) 000872 1779311085.911280 MIRROR_SPLIT mirror 2 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28b39): Mirror 12: 0x3af1fa18 (stale) Mirror 21: 0x3af1fa18 (stale) Mirror 23: 0x3af1fa18 (stale) Mirror 24: 0x3af1fa18 (stale) Mirror 25: 0x3af1fa18 (stale) Mirror 27: 0x3af1fa18 (stale) Mirror 28: 0x3af1fa18 (stale) Mirror 29: 0x3af1fa18 (stale) Mirror 30: 0x3af1fa18 (stale) Mirror 31: 0x3af1fa18 (stale) Mirror 32: 0x3af1fa18 (stale) Mirror 33: 0x3af1fa18 (stale) Mirror 34: 0x3af1fa18 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28b39): Mirror 12: 0x3af1fa18 (stale) Mirror 21: 0x3af1fa18 (stale) Mirror 23: 0x3af1fa18 (stale) Mirror 24: 0x3af1fa18 (stale) Mirror 25: 0x3af1fa18 (stale) Mirror 27: 0x3af1fa18 (stale) Mirror 28: 0x3af1fa18 (stale) Mirror 29: 0x3af1fa18 (stale) Mirror 30: 0x3af1fa18 (stale) Mirror 31: 0x3af1fa18 (stale) Mirror 32: 0x3af1fa18 (stale) Mirror 33: 0x3af1fa18 (stale) Mirror 34: 0x3af1fa18 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28b39: skipped 000873 1779311086.420928 trunc from 0x028b39 to 0x00d66d (0x1b4cb bytes) 000875 1779311086.433662 mapwrite 0x003734 thru 0x00f08d (0xb95a bytes) 000876 1779311086.522549 mapwrite 0x03948f thru 0x03ffff (0x6b71 bytes) 000877 1779311086.588385 write 0x02dbb6 thru 0x02e7e5 (0xc30 bytes) 000879 1779311086.597504 mapwrite 0x020291 thru 0x0256c4 (0x5434 bytes) 000880 1779311086.652477 mapwrite 0x020a9f thru 0x02ddb1 (0xd313 bytes) 000883 1779311086.709368 mapread 0x03cb65 thru 0x03ffff (0x349b bytes) 000885 1779311086.716136 trunc from 0x040000 to 0x0050d5 (0x3af2a bytes) 000886 1779311086.734642 MIRROR_SPLIT mirror 13 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x50d6): Mirror 12: 0x398c0cad (stale) Mirror 21: 0x398c0cad (stale) Mirror 23: 0x398c0cad (stale) Mirror 24: 0x398c0cad (stale) Mirror 25: 0x398c0cad (stale) Mirror 27: 0x398c0cad (stale) Mirror 28: 0x398c0cad (stale) Mirror 29: 0x398c0cad (stale) Mirror 30: 0x398c0cad (stale) Mirror 31: 0x398c0cad (stale) Mirror 32: 0x398c0cad (stale) Mirror 33: 0x398c0cad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x50d6): Mirror 12: 0x398c0cad (stale) Mirror 21: 0x398c0cad (stale) Mirror 23: 0x398c0cad (stale) Mirror 24: 0x398c0cad (stale) Mirror 25: 0x398c0cad (stale) Mirror 27: 0x398c0cad (stale) Mirror 28: 0x398c0cad (stale) Mirror 29: 0x398c0cad (stale) Mirror 30: 0x398c0cad (stale) Mirror 31: 0x398c0cad (stale) Mirror 32: 0x398c0cad (stale) Mirror 33: 0x398c0cad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x50d6: skipped 000888 1779311087.137903 mapread 0x00420b thru 0x0050d5 (0xecb bytes) 000889 1779311087.151028 mapread 0x00079c thru 0x004bb4 (0x4419 bytes) 000891 1779311087.156996 read 0x000966 thru 0x000e56 (0x4f1 bytes) 000893 1779311087.158094 mapread 0x000032 thru 0x004cdc (0x4cab bytes) 000895 1779311087.163964 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x50d6): Mirror 12: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x50d6): Mirror 12: 0x398c0cad (stale) Mirror 21: 0x398c0cad (stale) Mirror 23: 0x398c0cad (stale) Mirror 24: 0x398c0cad (stale) Mirror 25: 0x398c0cad (stale) Mirror 27: 0x398c0cad (stale) Mirror 28: 0x398c0cad (stale) Mirror 29: 0x398c0cad (stale) Mirror 30: 0x398c0cad (stale) Mirror 31: 0x398c0cad (stale) Mirror 32: 0x398c0cad (stale) Mirror 33: 0x398c0cad (stale) CRC-32 checksum value for chunk [0, 0x50d6): Mirror 1: 0xf47d326b Mirror 34: 0xf47d326b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x50d6: skipped 000896 1779311087.851242 mapread 0x003f36 thru 0x0050d5 (0x11a0 bytes) 000898 1779311087.906760 write 0x03145e thru 0x03a01a (0x8bbd bytes) 000900 1779311087.988643 mapwrite 0x02244d thru 0x02935b (0x6f0f bytes) 000901 1779311088.058634 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3a01b): Mirror 12: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a01b): Mirror 12: 0xcd4eb162 (stale) Mirror 21: 0xcd4eb162 (stale) Mirror 23: 0xcd4eb162 (stale) Mirror 24: 0xcd4eb162 (stale) Mirror 25: 0xcd4eb162 (stale) Mirror 27: 0xcd4eb162 (stale) Mirror 28: 0xcd4eb162 (stale) Mirror 29: 0xcd4eb162 (stale) Mirror 30: 0xcd4eb162 (stale) Mirror 31: 0xcd4eb162 (stale) Mirror 32: 0xcd4eb162 (stale) Mirror 33: 0xcd4eb162 (stale) Mirror 34: 0x5a0dcea6 (stale) CRC-32 checksum value for chunk [0, 0x3a01b): Mirror 1: 0xe06ebb80 Mirror 35: 0xe06ebb80 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a01b: skipped 000902 1779311088.830649 read 0x035fc0 thru 0x03a01a (0x405b bytes) 000903 1779311088.844080 mapwrite 0x01fe2d thru 0x02982e (0x9a02 bytes) 000904 1779311088.980308 read 0x017eb4 thru 0x01afd7 (0x3124 bytes) 000905 1779311088.994548 trunc from 0x03a01b to 0x012171 (0x27ea9 bytes) 000908 1779311089.013028 mapread 0x005f83 thru 0x00de84 (0x7f02 bytes) 000910 1779311089.016231 write 0x026559 thru 0x02c16c (0x5c14 bytes) 000911 1779311089.017536 write 0x021757 thru 0x02f36a (0xdc14 bytes) 000913 1779311089.028186 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x2f36b): Mirror 12: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f36b): Mirror 12: 0xa228aa46 (stale) Mirror 21: 0xa228aa46 (stale) Mirror 23: 0xa228aa46 (stale) Mirror 24: 0xa228aa46 (stale) Mirror 25: 0xa228aa46 (stale) Mirror 27: 0xa228aa46 (stale) Mirror 28: 0xa228aa46 (stale) Mirror 29: 0xa228aa46 (stale) Mirror 30: 0xa228aa46 (stale) Mirror 31: 0xa228aa46 (stale) Mirror 32: 0xa228aa46 (stale) Mirror 33: 0xa228aa46 (stale) Mirror 34: 0xe1a2c5cc (stale) Mirror 35: 0xbd4e0f0d (stale) CRC-32 checksum value for chunk [0, 0x2f36b): Mirror 1: 0xf2375351 Mirror 36: 0xf2375351 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f36b: skipped 000914 1779311089.662981 mapread 0x018bb4 thru 0x019d6a (0x11b7 bytes) 000918 1779311089.683344 mapread 0x020043 thru 0x0240ce (0x408c bytes) 000919 1779311089.695657 MIRROR_SPLIT mirror 5 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f36b): Mirror 12: 0xa228aa46 (stale) Mirror 21: 0xa228aa46 (stale) Mirror 23: 0xa228aa46 (stale) Mirror 24: 0xa228aa46 (stale) Mirror 27: 0xa228aa46 (stale) Mirror 28: 0xa228aa46 (stale) Mirror 29: 0xa228aa46 (stale) Mirror 30: 0xa228aa46 (stale) Mirror 31: 0xa228aa46 (stale) Mirror 32: 0xa228aa46 (stale) Mirror 33: 0xa228aa46 (stale) Mirror 34: 0xe1a2c5cc (stale) Mirror 35: 0xbd4e0f0d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f36b): Mirror 12: 0xa228aa46 (stale) Mirror 21: 0xa228aa46 (stale) Mirror 23: 0xa228aa46 (stale) Mirror 24: 0xa228aa46 (stale) Mirror 27: 0xa228aa46 (stale) Mirror 28: 0xa228aa46 (stale) Mirror 29: 0xa228aa46 (stale) Mirror 30: 0xa228aa46 (stale) Mirror 31: 0xa228aa46 (stale) Mirror 32: 0xa228aa46 (stale) Mirror 33: 0xa228aa46 (stale) Mirror 34: 0xe1a2c5cc (stale) Mirror 35: 0xbd4e0f0d (stale) CRC-32 checksum value for chunk [0, 0x2f36b): Mirror 1: 0xf2375351 Mirror 36: 0xf2375351 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f36b: skipped 000921 1779311090.415191 mapwrite 0x0001d7 thru 0x001e5d (0x1c87 bytes) 000922 1779311090.609936 mapread 0x000712 thru 0x0029db (0x22ca bytes) 000923 1779311090.616016 mapread 0x01e520 thru 0x021097 (0x2b78 bytes) 000924 1779311090.625268 mapwrite 0x002baf thru 0x005c9c (0x30ee bytes) 000926 1779311090.660873 mapread 0x018578 thru 0x01dba2 (0x562b bytes) 000927 1779311090.661977 mapwrite 0x024c9b thru 0x033f61 (0xf2c7 bytes) 000931 1779311090.743785 mapread 0x00f4c0 thru 0x01b52e (0xc06f bytes) 000935 1779311090.758051 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33f62): Mirror 21: 0xf3da7c42 (stale) Mirror 23: 0xf3da7c42 (stale) Mirror 24: 0xf3da7c42 (stale) Mirror 27: 0xf3da7c42 (stale) Mirror 28: 0xf3da7c42 (stale) Mirror 29: 0xf3da7c42 (stale) Mirror 30: 0xf3da7c42 (stale) Mirror 31: 0xf3da7c42 (stale) Mirror 32: 0xf3da7c42 (stale) Mirror 33: 0xf3da7c42 (stale) Mirror 34: 0xa1ab4067 (stale) Mirror 35: 0x3aed0191 (stale) Mirror 36: 0xb1577721 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33f62): Mirror 21: 0xf3da7c42 (stale) Mirror 23: 0xf3da7c42 (stale) Mirror 24: 0xf3da7c42 (stale) Mirror 27: 0xf3da7c42 (stale) Mirror 28: 0xf3da7c42 (stale) Mirror 29: 0xf3da7c42 (stale) Mirror 30: 0xf3da7c42 (stale) Mirror 31: 0xf3da7c42 (stale) Mirror 32: 0xf3da7c42 (stale) Mirror 33: 0xf3da7c42 (stale) Mirror 34: 0xa1ab4067 (stale) Mirror 35: 0x3aed0191 (stale) Mirror 36: 0xb1577721 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33f62: skipped 000936 1779311091.255921 read 0x01dfe6 thru 0x02d8d9 (0xf8f4 bytes) 000937 1779311091.266471 read 0x01eee5 thru 0x0235f2 (0x470e bytes) 000938 1779311091.267075 write 0x01ca36 thru 0x02aa5d (0xe028 bytes) 000939 1779311091.272857 write 0x031ea8 thru 0x038483 (0x65dc bytes) 000940 1779311091.273720 read 0x02e8fa thru 0x02f611 (0xd18 bytes) 000941 1779311091.274279 mapread 0x01da73 thru 0x02cf73 (0xf501 bytes) 000942 1779311091.275668 mapread 0x017c74 thru 0x026d93 (0xf120 bytes) 000943 1779311091.276850 read 0x033882 thru 0x038483 (0x4c02 bytes) 000944 1779311091.277595 mapwrite 0x00f972 thru 0x01a55a (0xabe9 bytes) 000947 1779311091.323935 write 0x01f7e2 thru 0x022ceb (0x350a bytes) 000948 1779311091.327192 mapwrite 0x02d7c8 thru 0x035123 (0x795c bytes) 000950 1779311091.363468 trunc from 0x038484 to 0x0153f9 (0x2308a bytes) 000956 1779311091.381331 mapwrite 0x02236d thru 0x02b8c2 (0x9556 bytes) 000957 1779311091.438573 read 0x02242e thru 0x0235c1 (0x1194 bytes) 000959 1779311091.445390 MIRROR_SPLIT mirror 5 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b8c3): Mirror 21: 0xc7478cf1 (stale) Mirror 23: 0xc7478cf1 (stale) Mirror 24: 0xc7478cf1 (stale) Mirror 27: 0xc7478cf1 (stale) Mirror 29: 0xc7478cf1 (stale) Mirror 30: 0xc7478cf1 (stale) Mirror 31: 0xc7478cf1 (stale) Mirror 32: 0xc7478cf1 (stale) Mirror 33: 0xc7478cf1 (stale) Mirror 34: 0x7b882d99 (stale) Mirror 35: 0x8f599d3d (stale) Mirror 36: 0x53e235e2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b8c3): Mirror 21: 0xc7478cf1 (stale) Mirror 23: 0xc7478cf1 (stale) Mirror 24: 0xc7478cf1 (stale) Mirror 27: 0xc7478cf1 (stale) Mirror 29: 0xc7478cf1 (stale) Mirror 30: 0xc7478cf1 (stale) Mirror 31: 0xc7478cf1 (stale) Mirror 32: 0xc7478cf1 (stale) Mirror 33: 0xc7478cf1 (stale) Mirror 34: 0x7b882d99 (stale) Mirror 35: 0x8f599d3d (stale) Mirror 36: 0x53e235e2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b8c3: skipped 000962 1779311091.824159 read 0x02983a thru 0x02b8c2 (0x2089 bytes) 000963 1779311091.828133 read 0x0158b1 thru 0x0212e7 (0xba37 bytes) 000969 1779311091.839485 mapread 0x0005a1 thru 0x0040e0 (0x3b40 bytes) 000971 1779311091.841252 write 0x0303d3 thru 0x0317e4 (0x1412 bytes) 000972 1779311091.843023 trunc from 0x0317e5 to 0x01b4a3 (0x16341 bytes) 000974 1779311091.856720 write 0x01cc79 thru 0x02a373 (0xd6fb bytes) 000976 1779311091.861825 MIRROR_RESYNC 13 mirrors 000978 1779311092.989253 mapwrite 0x00e00e thru 0x01bb22 (0xdb15 bytes) 000979 1779311093.109071 mapwrite 0x00d428 thru 0x01271a (0x52f3 bytes) 000980 1779311093.144967 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2a374): Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a374): Mirror 21: 0x27134801 (stale) Mirror 23: 0x27134801 (stale) Mirror 24: 0x27134801 (stale) Mirror 27: 0x27134801 (stale) Mirror 29: 0x27134801 (stale) Mirror 30: 0x27134801 (stale) Mirror 31: 0x27134801 (stale) Mirror 32: 0x27134801 (stale) Mirror 33: 0x27134801 (stale) Mirror 34: 0x27134801 (stale) Mirror 35: 0x27134801 (stale) Mirror 36: 0x27134801 (stale) CRC-32 checksum value for chunk [0, 0x2a374): Mirror 1: 0x4d4793db Mirror 37: 0x4d4793db lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a374: skipped 000981 1779311093.798052 trunc from 0x02a374 to 0x00ee1b (0x1b558 bytes) 000982 1779311093.884633 mapread 0x0004f8 thru 0x00df0e (0xda17 bytes) 000983 1779311093.904427 read 0x005fb4 thru 0x0093e5 (0x3432 bytes) 000987 1779311093.908432 mapwrite 0x019387 thru 0x022f4a (0x9bc4 bytes) 000988 1779311093.996257 mapread 0x01b6f2 thru 0x022f4a (0x7859 bytes) 000992 1779311093.999313 trunc from 0x022f4b to 0x029bad (0x6c63 bytes) 000994 1779311094.018455 mapwrite 0x02d347 thru 0x03c097 (0xed51 bytes) 000995 1779311094.089448 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3c098): Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c098): Mirror 21: 0xcc2e1bad (stale) Mirror 23: 0xcc2e1bad (stale) Mirror 24: 0xcc2e1bad (stale) Mirror 27: 0xcc2e1bad (stale) Mirror 29: 0xcc2e1bad (stale) Mirror 30: 0xcc2e1bad (stale) Mirror 31: 0xcc2e1bad (stale) Mirror 32: 0xcc2e1bad (stale) Mirror 33: 0xcc2e1bad (stale) Mirror 34: 0xcc2e1bad (stale) Mirror 35: 0xcc2e1bad (stale) Mirror 36: 0xcc2e1bad (stale) Mirror 37: 0x6b67494c (stale) CRC-32 checksum value for chunk [0, 0x3c098): Mirror 1: 0x32989b23 Mirror 38: 0x32989b23 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c098: skipped 000996 1779311094.669701 write 0x030b23 thru 0x039ef7 (0x93d5 bytes) 000997 1779311094.734627 write 0x01e582 thru 0x026668 (0x80e7 bytes) 000998 1779311094.743389 mapwrite 0x024fe2 thru 0x02c22b (0x724a bytes) 001000 1779311094.797544 write 0x00a788 thru 0x014b56 (0xa3cf bytes) All operations completed A-OK!