== sanity-flr test 70a: flr mode fsx test ================ 16:07:00 (1787602020) Seed set to 2023 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read 000004 1787602023.447664 mapwrite 0x01e996 thru 0x0231af (0x481a bytes) truncating to largest ever: 0x1d1ef 000005 1787602023.708764 trunc from 0x0231b0 to 0x01d1ee (0x5fc1 bytes) 000010 1787602023.760626 write 0x015da2 thru 0x01e4a7 (0x8706 bytes) 000011 1787602023.797386 read 0x0153e8 thru 0x0160a7 (0xcc0 bytes) 000014 1787602023.799001 read 0x01ddbf thru 0x01e4a7 (0x6e9 bytes) 000015 1787602023.799497 mapwrite 0x03bf93 thru 0x03ceda (0xf48 bytes) 000016 1787602023.937441 trunc from 0x03cedb to 0x006470 (0x36a6a bytes) 000017 1787602023.979497 MIRROR_EXTEND to 2 mirrors 000018 1787602024.965984 mapread 0x00027f thru 0x003d3f (0x3ac1 bytes) 000019 1787602024.993067 write 0x00c4bf thru 0x014537 (0x8079 bytes) truncating to largest ever: 0x2fbcd 000021 1787602025.045461 trunc from 0x014538 to 0x02fbcc (0x1b695 bytes) 000031 1787602025.109202 MIRROR_RESYNC 2 mirrors 000032 1787602025.845499 trunc from 0x02fbcd to 0x0225e2 (0xd5ea bytes) 000034 1787602025.917365 mapread 0x007a5a thru 0x00e18f (0x6736 bytes) 000035 1787602025.940985 trunc from 0x0225e3 to 0x0100ed (0x124f5 bytes) 000036 1787602025.969914 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x100ee): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x100ee): Mirror 2: 0x6dbc730d (stale) CRC-32 checksum value for chunk [0, 0x100ee): Mirror 1: 0x6dbc730d Mirror 3: 0x6dbc730d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x100ee: skipped 000040 1787602027.036438 read 0x009e0c thru 0x00ad9f (0xf94 bytes) 000042 1787602027.042190 read 0x003281 thru 0x005d6a (0x2aea bytes) 000044 1787602027.052453 write 0x01ebf2 thru 0x024f0c (0x631b bytes) 000047 1787602027.188806 write 0x00ed68 thru 0x01d1af (0xe448 bytes) 000048 1787602027.200384 write 0x01a116 thru 0x01af32 (0xe1d bytes) 000049 1787602027.201024 read 0x01cba1 thru 0x024f0c (0x836c bytes) 000050 1787602027.201582 trunc from 0x024f0d to 0x01db9a (0x7372 bytes) 000052 1787602027.253073 read 0x00053d thru 0x006cf6 (0x67ba bytes) 000054 1787602027.265398 mapwrite 0x03b352 thru 0x03ffff (0x4cae bytes) 000055 1787602027.381275 trunc from 0x040000 to 0x01616c (0x29e93 bytes) 000056 1787602027.413496 mapread 0x015338 thru 0x01616c (0xe35 bytes) 000058 1787602027.418300 trunc from 0x01616d to 0x00ec26 (0x7546 bytes) 000059 1787602027.445296 write 0x012fa2 thru 0x01956b (0x65ca bytes) 000062 1787602027.447471 mapwrite 0x03047c thru 0x035b52 (0x56d7 bytes) 000063 1787602027.650495 read 0x01d43f thru 0x01d7c1 (0x383 bytes) 000064 1787602027.675368 write 0x03418f thru 0x03ac79 (0x6aeb bytes) 000065 1787602027.684299 MIRROR_RESYNC 3 mirrors 000067 1787602028.690322 mapwrite 0x039527 thru 0x03ffff (0x6ad9 bytes) 000071 1787602028.817915 write 0x015627 thru 0x01c5ae (0x6f88 bytes) 000072 1787602028.828042 mapread 0x001d82 thru 0x010301 (0xe580 bytes) 000075 1787602028.842295 write 0x03b7e0 thru 0x03ffff (0x4820 bytes) 000078 1787602028.844519 mapread 0x01ba72 thru 0x028272 (0xc801 bytes) 000080 1787602028.875552 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1087d55e (stale) Mirror 3: 0x1087d55e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9f2f88ed Mirror 4: 0x9f2f88ed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000082 1787602029.927399 read 0x03b047 thru 0x03ffff (0x4fb9 bytes) 000084 1787602029.933493 mapread 0x019433 thru 0x0255b5 (0xc183 bytes) 000087 1787602029.959360 mapwrite 0x037186 thru 0x03ffff (0x8e7a bytes) 000088 1787602030.119027 mapwrite 0x01a991 thru 0x024332 (0x99a2 bytes) truncating to largest ever: 0x364db 000089 1787602030.189899 trunc from 0x040000 to 0x0364da (0x9b25 bytes) 000091 1787602030.208055 read 0x027d26 thru 0x02c53e (0x4819 bytes) 000095 1787602030.222314 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x364db): Mirror 3: 0x80d9fd0f (stale) Mirror 4: 0x9ff6c951 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x364db): Mirror 3: 0x80d9fd0f (stale) Mirror 4: 0x9ff6c951 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x364db: skipped 000096 1787602030.512242 mapread 0x00dc73 thru 0x00fd74 (0x2102 bytes) 000098 1787602030.533699 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x364db): Mirror 4: 0x9ff6c951 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x364db): Mirror 4: 0x9ff6c951 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x364db: skipped 000099 1787602030.777469 write 0x039668 thru 0x03ffff (0x6998 bytes) 000100 1787602030.778654 mapwrite 0x008594 thru 0x015a3f (0xd4ac bytes) 000101 1787602030.844771 mapread 0x014404 thru 0x01c872 (0x846f bytes) 000104 1787602030.855917 write 0x01a779 thru 0x0266b4 (0xbf3c bytes) 000107 1787602030.867877 read 0x016469 thru 0x022125 (0xbcbd bytes) 000109 1787602030.869098 trunc from 0x040000 to 0x00e2c2 (0x31d3d bytes) 000110 1787602030.890596 trunc from 0x00e2c3 to 0x01ecfd (0x10a3b bytes) 000114 1787602030.916387 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) 000116 1787602031.034506 mapread 0x00a45f thru 0x018630 (0xe1d2 bytes) 000117 1787602031.069647 mapwrite 0x01f5f8 thru 0x0278b8 (0x82c1 bytes) 000121 1787602031.139784 write 0x01ea8d thru 0x029efb (0xb46f bytes) 000122 1787602031.142019 mapread 0x025425 thru 0x029efb (0x4ad7 bytes) 000124 1787602031.143936 mapread 0x00f9ee thru 0x0130c0 (0x36d3 bytes) 000125 1787602031.145067 mapwrite 0x00dcb0 thru 0x018b5a (0xaeab bytes) 000126 1787602031.189288 trunc from 0x029efc to 0x01bcbe (0xe23d bytes) 000132 1787602031.207151 read 0x002cd3 thru 0x007db3 (0x50e1 bytes) 000134 1787602031.213898 read 0x007691 thru 0x014ee5 (0xd855 bytes) 000138 1787602031.216394 mapwrite 0x02a107 thru 0x030696 (0x6590 bytes) 000140 1787602031.282297 write 0x00f1e7 thru 0x01beb9 (0xccd3 bytes) 000146 1787602031.288089 write 0x03dbd6 thru 0x03ebf9 (0x1024 bytes) 000147 1787602031.289359 write 0x0191b5 thru 0x0265b3 (0xd3ff bytes) 000148 1787602031.291352 write 0x015e8e thru 0x019f4b (0x40be bytes) 000151 1787602031.293649 trunc from 0x03ebfa to 0x0034b3 (0x3b746 bytes) 000152 1787602031.308030 mapread 0x0000b2 thru 0x0034b3 (0x3402 bytes) 000153 1787602031.308913 mapread 0x0018f2 thru 0x0034b3 (0x1bc2 bytes) 000154 1787602031.309593 write 0x00c8b5 thru 0x0115a4 (0x4cf0 bytes) 000158 1787602031.317277 trunc from 0x0115a5 to 0x008442 (0x9162 bytes) 000160 1787602031.333380 trunc from 0x008443 to 0x02a02e (0x21bec bytes) 000161 1787602031.354968 read 0x01decc thru 0x025d13 (0x7e48 bytes) 000164 1787602031.368389 mapread 0x003e9a thru 0x00d0c1 (0x9228 bytes) 000167 1787602031.371699 read 0x027715 thru 0x02a02e (0x291a bytes) 000169 1787602031.373077 mapwrite 0x00e0b4 thru 0x013045 (0x4f92 bytes) 000170 1787602031.415610 read 0x018856 thru 0x01d7e0 (0x4f8b bytes) 000172 1787602031.417374 read 0x028c9e thru 0x02a02e (0x1391 bytes) 000174 1787602031.418905 read 0x01edb9 thru 0x02a02e (0xb276 bytes) 000176 1787602031.422362 read 0x0157d2 thru 0x025250 (0xfa7f bytes) 000177 1787602031.423445 mapwrite 0x009f69 thru 0x00a65d (0x6f5 bytes) 000180 1787602031.458259 write 0x01d1dc thru 0x01efd4 (0x1df9 bytes) 000188 1787602031.464173 mapwrite 0x008ba9 thru 0x010bab (0x8003 bytes) 000189 1787602031.507555 mapwrite 0x0118d0 thru 0x01b952 (0xa083 bytes) 000190 1787602031.555433 mapwrite 0x005de2 thru 0x00b3dd (0x55fc bytes) 000191 1787602031.595442 read 0x023273 thru 0x02a02e (0x6dbc bytes) 000194 1787602031.597570 trunc from 0x02a02f to 0x003630 (0x269fe bytes) 000195 1787602031.614637 mapread 0x00080e thru 0x003630 (0x2e23 bytes) 000197 1787602031.619113 write 0x021124 thru 0x028cf2 (0x7bcf bytes) 000200 1787602031.621757 trunc from 0x028cf3 to 0x022b08 (0x61ea bytes) 000201 1787602031.638766 mapread 0x018c8f thru 0x021e39 (0x91ab bytes) 000202 1787602031.649674 write 0x01a51f thru 0x024fe1 (0xaac3 bytes) 000203 1787602031.651933 mapwrite 0x00c718 thru 0x01c398 (0xfc81 bytes) 000204 1787602031.697314 write 0x037015 thru 0x03e8b6 (0x78a2 bytes) 000205 1787602031.699464 write 0x02cd48 thru 0x0372bf (0xa578 bytes) 000209 1787602031.710966 mapwrite 0x01da25 thru 0x029bc2 (0xc19e bytes) 000210 1787602031.756334 mapwrite 0x03b08f thru 0x03d725 (0x2697 bytes) 000211 1787602031.791422 write 0x032a2d thru 0x03bb19 (0x90ed bytes) 000215 1787602031.794824 mapwrite 0x020aa5 thru 0x026042 (0x559e bytes) 000216 1787602031.829726 mapread 0x035ff7 thru 0x03e3a5 (0x83af bytes) 000220 1787602031.831989 mapread 0x037885 thru 0x03e8b6 (0x7032 bytes) 000221 1787602031.833693 mapread 0x0096a3 thru 0x012066 (0x89c4 bytes) 000222 1787602031.835052 write 0x03f3a0 thru 0x03ffff (0xc60 bytes) 000225 1787602031.846192 write 0x02306b thru 0x02f758 (0xc6ee bytes) 000226 1787602031.850009 mapread 0x0095e7 thru 0x00d4d4 (0x3eee bytes) 000227 1787602031.851216 mapwrite 0x030990 thru 0x0356b0 (0x4d21 bytes) 000230 1787602031.893891 trunc from 0x040000 to 0x024cb1 (0x1b34e bytes) 000234 1787602031.914246 mapread 0x01575b thru 0x023d3f (0xe5e5 bytes) 000235 1787602031.915285 read 0x0017d7 thru 0x00388f (0x20b9 bytes) 000237 1787602031.917111 trunc from 0x024cb2 to 0x01d284 (0x7a2d bytes) 000238 1787602031.931559 mapread 0x0099e7 thru 0x00efd6 (0x55f0 bytes) 000239 1787602031.933245 read 0x00c03b thru 0x012333 (0x62f9 bytes) 000240 1787602031.934520 read 0x00249d thru 0x009496 (0x6ffa bytes) truncating to largest ever: 0x3da50 000241 1787602031.935647 trunc from 0x01d285 to 0x03da4f (0x207cb bytes) 000242 1787602031.951958 write 0x017efd thru 0x024b1c (0xcc20 bytes) 000246 1787602031.960491 mapwrite 0x02b231 thru 0x033b20 (0x88f0 bytes) 000247 1787602032.012508 mapread 0x02a93f thru 0x030f0c (0x65ce bytes) 000248 1787602032.013659 trunc from 0x03da50 to 0x03a58a (0x34c5 bytes) 000250 1787602032.030950 write 0x016067 thru 0x02364f (0xd5e9 bytes) 000252 1787602032.033680 trunc from 0x03a58b to 0x0093f3 (0x31197 bytes) 000253 1787602032.051208 MIRROR_EXTEND to 2 mirrors 000257 1787602032.556257 write 0x00d11b thru 0x013441 (0x6327 bytes) 000258 1787602032.642479 read 0x006d1c thru 0x013160 (0xc445 bytes) 000259 1787602032.655118 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x13442): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13442): Mirror 2: 0x4d3097a2 (stale) CRC-32 checksum value for chunk [0, 0x13442): Mirror 1: 0x6f4aeb88 Mirror 3: 0x6f4aeb88 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13442: skipped 000261 1787602033.586259 trunc from 0x013442 to 0x0106a8 (0x2d99 bytes) 000263 1787602033.656073 mapwrite 0x02e656 thru 0x0380f4 (0x9a9f bytes) 000264 1787602033.740729 trunc from 0x0380f5 to 0x031019 (0x70db bytes) 000265 1787602033.759711 mapread 0x01c77e thru 0x029ece (0xd751 bytes) 000266 1787602033.774439 trunc from 0x03101a to 0x02389e (0xd77b bytes) 000267 1787602033.792381 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2389f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2389f): Mirror 2: 0xb74773c0 (stale) Mirror 3: 0x180c1fdf (stale) CRC-32 checksum value for chunk [0, 0x2389f): Mirror 1: 0x5e698266 Mirror 4: 0x5e698266 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2389f: skipped 000269 1787602034.773622 mapwrite 0x03bcfc thru 0x03db71 (0x1e76 bytes) 000271 1787602034.973391 trunc from 0x03db72 to 0x02a61f (0x13552 bytes) 000272 1787602035.008002 mapread 0x022755 thru 0x02a61f (0x7ecb bytes) 000274 1787602035.017153 mapread 0x00b2c6 thru 0x01061b (0x5356 bytes) 000275 1787602035.028419 mapwrite 0x01ac33 thru 0x0283b6 (0xd784 bytes) 000276 1787602035.116106 write 0x03e4b9 thru 0x03ffff (0x1b47 bytes) 000277 1787602035.123588 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 3: 0x9367346d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 3: 0x9367346d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000279 1787602035.464831 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 3: 0x9367346d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6a29a829 Mirror 4: 0x6a29a829 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000281 1787602036.866180 read 0x000c57 thru 0x007dd0 (0x717a bytes) 000283 1787602036.884457 write 0x023356 thru 0x031242 (0xdeed bytes) 000285 1787602037.010982 mapwrite 0x02ef38 thru 0x035c05 (0x6cce bytes) 000287 1787602037.101089 mapread 0x00c79c thru 0x017240 (0xaaa5 bytes) 000288 1787602037.117979 mapread 0x020ada thru 0x0244b1 (0x39d8 bytes) 000293 1787602037.131631 trunc from 0x040000 to 0x03d7e9 (0x2816 bytes) 000296 1787602037.198084 mapread 0x003f1b thru 0x007ee1 (0x3fc7 bytes) 000298 1787602037.215583 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d7ea): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d7ea): Mirror 2: 0x10f91011 (stale) Mirror 3: 0xf4da16b7 (stale) Mirror 4: 0x44b104ee (stale) CRC-32 checksum value for chunk [0, 0x3d7ea): Mirror 1: 0x29398f80 Mirror 5: 0x29398f80 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d7ea: skipped 000300 1787602038.221480 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3d7ea): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d7ea): Mirror 2: 0x10f91011 (stale) Mirror 3: 0xf4da16b7 (stale) Mirror 4: 0x44b104ee (stale) CRC-32 checksum value for chunk [0, 0x3d7ea): Mirror 1: 0x29398f80 Mirror 5: 0x29398f80 Mirror 6: 0x29398f80 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d7ea: skipped 000302 1787602039.076766 read 0x020b23 thru 0x027526 (0x6a04 bytes) 000305 1787602039.085357 read 0x035d0a thru 0x03d7e9 (0x7ae0 bytes) 000310 1787602039.101073 MIRROR_RESYNC 6 mirrors 000311 1787602040.207084 trunc from 0x03d7ea to 0x031be6 (0xbc03 bytes) 000312 1787602040.343009 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31be7): Mirror 2: 0xe2f70e32 (stale) Mirror 3: 0xe2f70e32 (stale) Mirror 5: 0xe2f70e32 (stale) Mirror 6: 0xe2f70e32 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31be7): Mirror 2: 0xe2f70e32 (stale) Mirror 3: 0xe2f70e32 (stale) Mirror 5: 0xe2f70e32 (stale) Mirror 6: 0xe2f70e32 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31be7: skipped 000313 1787602040.774294 MIRROR_RESYNC 5 mirrors 000317 1787602041.889057 write 0x027921 thru 0x02ac90 (0x3370 bytes) 000319 1787602042.056776 MIRROR_RESYNC 5 mirrors truncating to largest ever: 0x3f7a6 000320 1787602043.747099 trunc from 0x031be7 to 0x03f7a5 (0xdbbf bytes) 000321 1787602043.953343 mapread 0x037075 thru 0x039520 (0x24ac bytes) 000323 1787602043.976472 trunc from 0x03f7a6 to 0x00c75c (0x33049 bytes) 000324 1787602044.006398 mapread 0x00b67d thru 0x00c75c (0x10e0 bytes) 000325 1787602044.019666 trunc from 0x00c75d to 0x0209d1 (0x14275 bytes) 000327 1787602044.046817 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x209d2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x209d2): Mirror 2: 0x17c041e7 (stale) Mirror 3: 0x17c041e7 (stale) Mirror 5: 0x17c041e7 (stale) Mirror 6: 0x17c041e7 (stale) CRC-32 checksum value for chunk [0, 0x209d2): Mirror 1: 0xb67af693 Mirror 7: 0xb67af693 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x209d2: skipped 000330 1787602045.254425 write 0x01c060 thru 0x01d0c6 (0x1067 bytes) 000332 1787602045.418443 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x209d2): Mirror 3: 0x17c041e7 (stale) Mirror 5: 0x17c041e7 (stale) Mirror 6: 0x17c041e7 (stale) Mirror 7: 0xb67af693 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x209d2): Mirror 3: 0x17c041e7 (stale) Mirror 5: 0x17c041e7 (stale) Mirror 6: 0x17c041e7 (stale) Mirror 7: 0xb67af693 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x209d2: skipped 000333 1787602045.893213 mapwrite 0x0033c2 thru 0x004237 (0xe76 bytes) 000334 1787602045.967173 trunc from 0x0209d2 to 0x00748b (0x19546 bytes) 000336 1787602045.999244 mapread 0x000cde thru 0x00748b (0x67ae bytes) 000338 1787602046.051148 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x748c): Mirror 5: 0x104d4cc6 (stale) Mirror 6: 0x104d4cc6 (stale) Mirror 7: 0x104d4cc6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x748c): Mirror 5: 0x104d4cc6 (stale) Mirror 6: 0x104d4cc6 (stale) Mirror 7: 0x104d4cc6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x748c: skipped 000339 1787602046.559444 mapread 0x00375a thru 0x0060dc (0x2983 bytes) 000340 1787602046.621958 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x748c): Mirror 5: 0x104d4cc6 (stale) Mirror 6: 0x104d4cc6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x748c): Mirror 5: 0x104d4cc6 (stale) Mirror 6: 0x104d4cc6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x748c: skipped 000342 1787602046.913712 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x748c): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x748c): Mirror 5: 0x104d4cc6 (stale) Mirror 6: 0x104d4cc6 (stale) CRC-32 checksum value for chunk [0, 0x748c): Mirror 1: 0xbb246a05 Mirror 7: 0xbb246a05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x748c: skipped 000344 1787602047.800385 read 0x003876 thru 0x00748b (0x3c16 bytes) 000345 1787602047.808472 read 0x00081d thru 0x00748b (0x6c6f bytes) 000346 1787602047.822539 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x748c): Mirror 5: 0x104d4cc6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x748c): Mirror 5: 0x104d4cc6 (stale) CRC-32 checksum value for chunk [0, 0x748c): Mirror 1: 0xbb246a05 Mirror 7: 0xbb246a05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x748c: skipped 000347 1787602048.209636 read 0x007298 thru 0x00748b (0x1f4 bytes) 000349 1787602048.217127 read 0x00280e thru 0x0060fd (0x38f0 bytes) 000353 1787602048.231228 write 0x01888d thru 0x01cc4b (0x43bf bytes) 000357 1787602048.310622 trunc from 0x01cc4c to 0x00dbbe (0xf08d bytes) 000359 1787602048.345225 read 0x006766 thru 0x00dbbe (0x7459 bytes) 000360 1787602048.355439 write 0x030391 thru 0x03c98b (0xc5fb bytes) 000361 1787602048.356902 write 0x00823a thru 0x00a0d3 (0x1e9a bytes) 000362 1787602048.363034 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3c98c): Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c98c): Mirror 5: 0xadcd6048 (stale) Mirror 7: 0xcd937fac (stale) CRC-32 checksum value for chunk [0, 0x3c98c): Mirror 1: 0x8ab9651c Mirror 8: 0x8ab9651c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c98c: skipped 000363 1787602049.105677 mapread 0x029ce7 thru 0x02b1c2 (0x14dc bytes) 000366 1787602049.125048 trunc from 0x03c98c to 0x034186 (0x8805 bytes) 000368 1787602049.221458 write 0x03f7f1 thru 0x03ffff (0x80f bytes) 000369 1787602049.226024 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xef63959d (stale) Mirror 7: 0x9894ce86 (stale) Mirror 8: 0x28d3ad42 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf5160a09 Mirror 9: 0xf5160a09 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000370 1787602050.188252 mapwrite 0x00ef9a thru 0x013cc2 (0x4d29 bytes) 000371 1787602050.393134 MIRROR_RESYNC 5 mirrors 000376 1787602051.480669 read 0x00e61b thru 0x01e560 (0xff46 bytes) 000377 1787602051.492010 MIRROR_RESYNC 5 mirrors 000379 1787602051.879428 mapread 0x00001f thru 0x00ad50 (0xad32 bytes) 000380 1787602051.903988 mapread 0x03895f thru 0x03ffff (0x76a1 bytes) 000381 1787602051.913276 mapread 0x03ebdd thru 0x03ffff (0x1423 bytes) 000383 1787602051.914187 mapwrite 0x0315ce thru 0x03ef68 (0xd99b bytes) 000385 1787602052.060019 mapwrite 0x02926a thru 0x0346bd (0xb454 bytes) 000387 1787602052.111599 mapread 0x029203 thru 0x02dc2b (0x4a29 bytes) 000389 1787602052.112961 trunc from 0x040000 to 0x02c1c1 (0x13e3e bytes) 000392 1787602052.139723 mapwrite 0x038e41 thru 0x03ffff (0x71bf bytes) 000397 1787602052.210103 MIRROR_RESYNC 5 mirrors 000399 1787602053.759693 write 0x039483 thru 0x03bcb1 (0x282f bytes) 000400 1787602053.840476 mapwrite 0x00b6d9 thru 0x00e138 (0x2a60 bytes) 000402 1787602053.915986 MIRROR_RESYNC 5 mirrors 000403 1787602055.385261 MIRROR_EXTEND to 6 mirrors 000404 1787602055.952129 write 0x00f203 thru 0x019bcf (0xa9cd bytes) 000407 1787602056.036132 write 0x032e1e thru 0x038e4d (0x6030 bytes) 000408 1787602056.045089 read 0x030da1 thru 0x03d4d4 (0xc734 bytes) 000412 1787602056.055993 mapwrite 0x02d504 thru 0x0325b8 (0x50b5 bytes) 000413 1787602056.112166 write 0x0115a1 thru 0x01ea58 (0xd4b8 bytes) 000414 1787602056.122241 MIRROR_RESYNC 6 mirrors 000416 1787602057.421016 read 0x00f457 thru 0x01e9e7 (0xf591 bytes) 000417 1787602057.435606 MIRROR_RESYNC 6 mirrors 000418 1787602057.926627 mapwrite 0x0227b0 thru 0x025121 (0x2972 bytes) 000419 1787602058.125115 read 0x026ade thru 0x0315b2 (0xaad5 bytes) 000420 1787602058.137383 read 0x01fa42 thru 0x02f2df (0xf89e bytes) 000422 1787602058.138465 write 0x02d8f9 thru 0x038f78 (0xb680 bytes) 000424 1787602058.156058 read 0x006433 thru 0x00947c (0x304a bytes) 000425 1787602058.157139 mapread 0x01c7b7 thru 0x01ffce (0x3818 bytes) 000426 1787602058.165034 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x3af2c1a4 (stale) Mirror 8: 0x3af2c1a4 (stale) Mirror 9: 0x3af2c1a4 (stale) Mirror 10: 0x3af2c1a4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x3af2c1a4 (stale) Mirror 8: 0x3af2c1a4 (stale) Mirror 9: 0x3af2c1a4 (stale) Mirror 10: 0x3af2c1a4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000428 1787602058.610615 read 0x03ad22 thru 0x03f2c7 (0x45a6 bytes) 000430 1787602058.625373 trunc from 0x040000 to 0x03bbe2 (0x441d bytes) 000431 1787602058.642395 mapwrite 0x00b4c0 thru 0x0133a9 (0x7eea bytes) truncating to largest ever: 0x3faae 000434 1787602058.709288 trunc from 0x03bbe3 to 0x03faad (0x3ecb bytes) 000435 1787602058.721176 mapread 0x01b504 thru 0x0260ab (0xaba8 bytes) 000437 1787602058.745014 write 0x014183 thru 0x01bfe6 (0x7e64 bytes) 000438 1787602058.747767 trunc from 0x03faae to 0x036e02 (0x8cab bytes) 000440 1787602058.771967 write 0x028c6a thru 0x02f942 (0x6cd9 bytes) 000441 1787602058.781689 write 0x037a06 thru 0x03ffff (0x85fa bytes) 000442 1787602058.789038 trunc from 0x040000 to 0x01c236 (0x23dc9 bytes) 000443 1787602058.806878 mapwrite 0x032333 thru 0x0395e4 (0x72b2 bytes) 000444 1787602058.888727 trunc from 0x0395e5 to 0x012858 (0x26d8c bytes) 000445 1787602058.912786 read 0x0116b1 thru 0x012858 (0x11a8 bytes) 000448 1787602058.915012 trunc from 0x012859 to 0x01ad21 (0x84c9 bytes) 000449 1787602058.931189 write 0x0086fb thru 0x011045 (0x894b bytes) 000450 1787602058.934055 trunc from 0x01ad22 to 0x024f1b (0xa1fa bytes) 000453 1787602058.946228 mapwrite 0x0079f4 thru 0x010c2f (0x923c bytes) 000454 1787602058.990026 read 0x002a85 thru 0x00341f (0x99b bytes) 000455 1787602059.058605 MIRROR_RESYNC 5 mirrors 000456 1787602060.086215 mapread 0x00fcbb thru 0x0137b9 (0x3aff bytes) 000459 1787602060.105137 write 0x032614 thru 0x037590 (0x4f7d bytes) 000460 1787602060.159339 write 0x02669f thru 0x030486 (0x9de8 bytes) 000463 1787602060.175814 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37591): Mirror 8: 0x6c36357 (stale) Mirror 9: 0x6c36357 (stale) Mirror 10: 0x6c36357 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37591): Mirror 8: 0x6c36357 (stale) Mirror 9: 0x6c36357 (stale) Mirror 10: 0x6c36357 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37591: skipped 000467 1787602060.488826 trunc from 0x037591 to 0x03ee9f (0x790f bytes) 000468 1787602060.503390 mapwrite 0x017650 thru 0x023d7d (0xc72e bytes) 000469 1787602060.566927 mapread 0x00383c thru 0x00b079 (0x783e bytes) 000472 1787602060.577968 write 0x00d6ea thru 0x017cb4 (0xa5cb bytes) 000474 1787602060.580391 write 0x03a72b thru 0x03ffff (0x58d5 bytes) 000478 1787602060.589433 mapwrite 0x01ff5e thru 0x023cbe (0x3d61 bytes) 000480 1787602060.639289 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe00e18c3 (stale) Mirror 10: 0xe00e18c3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe00e18c3 (stale) Mirror 10: 0xe00e18c3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000481 1787602060.910168 mapread 0x00ff5b thru 0x013d20 (0x3dc6 bytes) 000482 1787602060.927745 trunc from 0x040000 to 0x012f42 (0x2d0bd bytes) 000484 1787602060.943664 write 0x009992 thru 0x00d010 (0x367f bytes) 000488 1787602060.949722 mapread 0x0023f3 thru 0x0037bd (0x13cb bytes) 000489 1787602060.957968 mapread 0x009d30 thru 0x012f42 (0x9213 bytes) 000492 1787602060.960152 trunc from 0x012f43 to 0x0040c9 (0xee79 bytes) 000497 1787602060.984046 read 0x003f12 thru 0x0040c9 (0x1b8 bytes) 000500 1787602060.991598 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40ca): Mirror 8: 0x74069999 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40ca): Mirror 8: 0x74069999 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40ca: skipped 000501 1787602061.214917 mapwrite 0x01bf05 thru 0x025ef5 (0x9ff1 bytes) 000503 1787602061.294122 read 0x01a3fa thru 0x01e145 (0x3d4c bytes) 000504 1787602061.295744 mapwrite 0x00abbb thru 0x00e5bf (0x3a05 bytes) 000505 1787602061.347697 mapwrite 0x019b06 thru 0x022cb9 (0x91b4 bytes) 000507 1787602061.382099 mapwrite 0x013d3e thru 0x01ca9c (0x8d5f bytes) 000511 1787602061.428041 mapread 0x024265 thru 0x025cbc (0x1a58 bytes) 000513 1787602061.429016 write 0x01f3af thru 0x029e69 (0xaabb bytes) 000514 1787602061.431368 write 0x00e9a8 thru 0x01979e (0xadf7 bytes) 000516 1787602061.433149 read 0x007b62 thru 0x00bbaa (0x4049 bytes) 000520 1787602061.436869 mapread 0x004152 thru 0x0071e0 (0x308f bytes) 000521 1787602061.438148 trunc from 0x029e6a to 0x008d5b (0x2110e bytes) 000523 1787602061.451522 trunc from 0x008d5c to 0x03dd07 (0x34fac bytes) 000524 1787602061.472171 mapwrite 0x037a90 thru 0x03ffff (0x8570 bytes) 000525 1787602061.545602 read 0x00ec2b thru 0x0118a5 (0x2c7b bytes) 000526 1787602061.546202 mapread 0x02ff1a thru 0x03a768 (0xa84f bytes) 000527 1787602061.548407 trunc from 0x040000 to 0x0328c5 (0xd73a bytes) 000528 1787602061.565645 write 0x009a54 thru 0x012426 (0x89d3 bytes) 000529 1787602061.571538 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x328c6): Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x328c6): Mirror 8: 0x69ce8e49 (stale) CRC-32 checksum value for chunk [0, 0x328c6): Mirror 1: 0x38072da9 Mirror 9: 0x38072da9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x328c6: skipped 000531 1787602062.654171 read 0x006afb thru 0x008f49 (0x244f bytes) 000532 1787602062.663301 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x328c6): Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x328c6): Mirror 8: 0x69ce8e49 (stale) CRC-32 checksum value for chunk [0, 0x328c6): Mirror 1: 0x38072da9 Mirror 9: 0x38072da9 Mirror 10: 0x38072da9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x328c6: skipped 000533 1787602063.774880 trunc from 0x0328c6 to 0x0349d5 (0x2110 bytes) 000534 1787602063.856075 read 0x01bdc5 thru 0x022759 (0x6995 bytes) 000537 1787602063.864706 read 0x00902c thru 0x009bee (0xbc3 bytes) 000538 1787602063.883310 write 0x0183c4 thru 0x01af07 (0x2b44 bytes) 000540 1787602063.884741 write 0x00e48f thru 0x00f30e (0xe80 bytes) 000541 1787602063.889534 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x349d6): Mirror 9: 0xdb7b7407 (stale) Mirror 10: 0xdb7b7407 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x349d6): Mirror 9: 0xdb7b7407 (stale) Mirror 10: 0xdb7b7407 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x349d6: skipped 000544 1787602064.179493 mapwrite 0x017f6a thru 0x0212d6 (0x936d bytes) 000545 1787602064.244386 trunc from 0x0349d6 to 0x01a3d0 (0x1a605 bytes) 000546 1787602064.267875 MIRROR_RESYNC 3 mirrors 000547 1787602064.984023 MIRROR_EXTEND to 4 mirrors 000549 1787602065.569094 write 0x002902 thru 0x00bb51 (0x9250 bytes) 000551 1787602065.640085 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a3d1): Mirror 10: 0x3554809b (stale) Mirror 11: 0x3554809b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a3d1): Mirror 10: 0x3554809b (stale) Mirror 11: 0x3554809b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a3d1: skipped 000552 1787602065.830265 mapread 0x015868 thru 0x01a3d0 (0x4b69 bytes) 000553 1787602065.845820 write 0x030d9b thru 0x0339a6 (0x2c0c bytes) 000554 1787602065.848680 trunc from 0x0339a7 to 0x02bbe9 (0x7dbd bytes) 000555 1787602065.865596 trunc from 0x02bbea to 0x02418e (0x7a5b bytes) 000556 1787602065.891722 MIRROR_RESYNC 3 mirrors 000558 1787602066.732598 mapwrite 0x03c288 thru 0x03ffff (0x3d78 bytes) 000559 1787602066.949764 write 0x01fc38 thru 0x024aed (0x4eb6 bytes) 000560 1787602066.965277 trunc from 0x040000 to 0x0011a6 (0x3ee59 bytes) 000561 1787602066.988360 mapread 0x0001eb thru 0x0011a6 (0xfbc bytes) 000563 1787602066.995746 mapwrite 0x006ff2 thru 0x00d6c2 (0x66d1 bytes) 000564 1787602067.083015 mapwrite 0x033160 thru 0x039539 (0x63da bytes) 000566 1787602067.218216 write 0x034e00 thru 0x03e326 (0x9527 bytes) 000568 1787602067.224276 mapwrite 0x0035c4 thru 0x011423 (0xde60 bytes) 000569 1787602067.292802 mapread 0x011c6e thru 0x018f08 (0x729b bytes) 000570 1787602067.301714 mapwrite 0x0364cf thru 0x038325 (0x1e57 bytes) 000571 1787602067.340806 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e327): Mirror 10: 0x1ae02e95 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e327): Mirror 10: 0x1ae02e95 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e327: skipped 000573 1787602067.608074 trunc from 0x03e327 to 0x03520b (0x911b bytes) 000577 1787602067.627224 write 0x01e38d thru 0x01fc50 (0x18c4 bytes) 000578 1787602067.635207 mapwrite 0x01b882 thru 0x022305 (0x6a84 bytes) 000582 1787602067.689609 read 0x02b0c3 thru 0x03520b (0xa149 bytes) 000583 1787602067.702037 mapread 0x00caa6 thru 0x00f6af (0x2c0a bytes) 000585 1787602067.715563 trunc from 0x03520c to 0x00a855 (0x2a9b6 bytes) 000587 1787602067.735729 trunc from 0x00a856 to 0x009e77 (0x9de bytes) 000588 1787602067.755268 trunc from 0x009e78 to 0x005021 (0x4e56 bytes) 000589 1787602067.777380 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) 000590 1787602067.966496 MIRROR_EXTEND to 2 mirrors 000591 1787602068.633722 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) 000593 1787602068.774249 read 0x000355 thru 0x005021 (0x4ccd bytes) 000599 1787602068.789157 read 0x0015de thru 0x005021 (0x3a44 bytes) 000600 1787602068.789594 trunc from 0x005022 to 0x02b14c (0x2612b bytes) 000601 1787602068.808064 trunc from 0x02b14d to 0x03e137 (0x12feb bytes) 000602 1787602068.823680 mapwrite 0x00cbbf thru 0x014b08 (0x7f4a bytes) 000603 1787602068.883894 write 0x023b4c thru 0x02df28 (0xa3dd bytes) 000605 1787602068.886599 mapread 0x038f43 thru 0x03e137 (0x51f5 bytes) 000606 1787602068.887728 mapread 0x0042b8 thru 0x008d1e (0x4a67 bytes) 000608 1787602068.889939 trunc from 0x03e138 to 0x010ea0 (0x2d297 bytes) 000611 1787602068.906448 read 0x002464 thru 0x0037dc (0x1379 bytes) 000615 1787602068.908957 mapread 0x0054d6 thru 0x006aff (0x162a bytes) 000617 1787602068.911160 write 0x03b738 thru 0x03e64e (0x2f17 bytes) 000619 1787602068.913006 mapread 0x0110e1 thru 0x01b52f (0xa44f bytes) 000620 1787602068.919968 write 0x0268e4 thru 0x02ab35 (0x4252 bytes) 000621 1787602068.920950 write 0x026d57 thru 0x036008 (0xf2b2 bytes) 000622 1787602068.922225 trunc from 0x03e64f to 0x03df57 (0x6f7 bytes) 000624 1787602068.942973 mapread 0x008a13 thru 0x013a16 (0xb004 bytes) 000626 1787602068.945509 write 0x021ece thru 0x027558 (0x568b bytes) 000630 1787602068.948897 read 0x016c3d thru 0x01c155 (0x5519 bytes) 000631 1787602068.949971 mapread 0x026712 thru 0x0361bb (0xfaaa bytes) 000632 1787602068.950973 read 0x02d594 thru 0x0334d8 (0x5f45 bytes) 000636 1787602068.954331 mapread 0x002a98 thru 0x010ee1 (0xe44a bytes) 000637 1787602068.959138 MIRROR_EXTEND to 2 mirrors 000638 1787602069.588774 write 0x0328fd thru 0x0335c8 (0xccc bytes) 000642 1787602069.654968 mapwrite 0x0389a1 thru 0x03ffff (0x765f bytes) 000643 1787602069.735980 read 0x010121 thru 0x01f3d4 (0xf2b4 bytes) 000645 1787602069.745310 mapwrite 0x039a14 thru 0x03bba2 (0x218f bytes) 000646 1787602069.775261 write 0x00d31e thru 0x0127c6 (0x54a9 bytes) 000648 1787602069.780319 trunc from 0x040000 to 0x01b1d3 (0x24e2c bytes) 000649 1787602069.799724 MIRROR_RESYNC 2 mirrors 000650 1787602070.352492 mapread 0x017c0d thru 0x01b1d3 (0x35c7 bytes) 000653 1787602070.373875 write 0x00dd0f thru 0x00ee63 (0x1155 bytes) 000654 1787602070.444017 trunc from 0x01b1d4 to 0x00ad17 (0x104bc bytes) 000656 1787602070.466175 mapread 0x000ebb thru 0x00ad17 (0x9e5d bytes) 000657 1787602070.475701 trunc from 0x00ad18 to 0x01f821 (0x14b0a bytes) 000658 1787602070.492585 mapwrite 0x017970 thru 0x027424 (0xfab5 bytes) 000659 1787602070.578346 trunc from 0x027425 to 0x0007db (0x26c49 bytes) 000662 1787602070.598594 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x7dc): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7dc): Mirror 2: 0xdbf653e3 (stale) CRC-32 checksum value for chunk [0, 0x7dc): Mirror 1: 0xdbf653e3 Mirror 3: 0xdbf653e3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7dc: skipped 000663 1787602071.198678 trunc from 0x0007dc to 0x00ced3 (0xc6f8 bytes) 000665 1787602071.286057 write 0x03a79f thru 0x03ffff (0x5861 bytes) 000668 1787602071.288191 write 0x0341a5 thru 0x03ffff (0xbe5b bytes) 000669 1787602071.296620 mapwrite 0x02aecb thru 0x02f0b8 (0x41ee bytes) 000675 1787602071.362156 mapread 0x00e77a thru 0x018027 (0x98ae bytes) 000676 1787602071.384011 MIRROR_RESYNC 3 mirrors 000677 1787602072.106739 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) 000678 1787602072.319257 MIRROR_EXTEND to 3 mirrors 000680 1787602073.036509 read 0x03c049 thru 0x03ffff (0x3fb7 bytes) 000681 1787602073.044576 mapread 0x007f56 thru 0x008f9e (0x1049 bytes) 000683 1787602073.054039 mapwrite 0x023b64 thru 0x028db6 (0x5253 bytes) 000688 1787602073.227442 mapread 0x024fa0 thru 0x02f23b (0xa29c bytes) 000692 1787602073.240182 trunc from 0x040000 to 0x014fe6 (0x2b019 bytes) 000694 1787602073.261657 write 0x0135bd thru 0x013c82 (0x6c6 bytes) 000695 1787602073.268259 read 0x003749 thru 0x0085ba (0x4e72 bytes) 000697 1787602073.286600 MIRROR_RESYNC 3 mirrors 000699 1787602074.037795 mapwrite 0x004705 thru 0x00e4ec (0x9de8 bytes) 000700 1787602074.161012 MIRROR_RESYNC 3 mirrors 000701 1787602074.745208 read 0x0014fc thru 0x00dd19 (0xc81e bytes) 000702 1787602074.757913 mapread 0x008aa8 thru 0x00cbe7 (0x4140 bytes) 000708 1787602074.760876 read 0x00fe7a thru 0x014fe6 (0x516d bytes) 000709 1787602074.773460 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) 000712 1787602075.031542 write 0x03bb08 thru 0x03e864 (0x2d5d bytes) 000713 1787602075.119213 mapwrite 0x039137 thru 0x03ffff (0x6ec9 bytes) 000715 1787602075.259478 trunc from 0x040000 to 0x0199eb (0x26614 bytes) 000716 1787602075.284440 mapread 0x00d392 thru 0x0135ca (0x6239 bytes) 000717 1787602075.300550 read 0x012172 thru 0x018917 (0x67a6 bytes) 000718 1787602075.307051 mapread 0x00fb3c thru 0x015f28 (0x63ed bytes) 000721 1787602075.317766 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) 000722 1787602075.474290 trunc from 0x0199ec to 0x033b3e (0x1a153 bytes) 000724 1787602075.489284 read 0x022ca4 thru 0x02374c (0xaa9 bytes) 000725 1787602075.495452 write 0x00d470 thru 0x0166c7 (0x9258 bytes) 000726 1787602075.504272 write 0x03e18f thru 0x03ffff (0x1e71 bytes) 000729 1787602075.507577 mapread 0x0383b4 thru 0x03cffe (0x4c4b bytes) 000733 1787602075.524967 read 0x02e0e4 thru 0x02f935 (0x1852 bytes) 000735 1787602075.545593 write 0x03f6b6 thru 0x03ffff (0x94a bytes) 000736 1787602075.546425 trunc from 0x040000 to 0x0350c2 (0xaf3d bytes) 000737 1787602075.561473 trunc from 0x0350c3 to 0x024c99 (0x10429 bytes) 000739 1787602075.582599 mapread 0x0219ba thru 0x024c99 (0x32e0 bytes) 000740 1787602075.583638 mapwrite 0x01ed79 thru 0x02008a (0x1312 bytes) 000743 1787602075.655437 read 0x014da4 thru 0x01c42e (0x768b bytes) 000746 1787602075.658196 mapread 0x00e1c7 thru 0x0164dd (0x8317 bytes) 000747 1787602075.660112 read 0x01cfba thru 0x01d0ed (0x134 bytes) 000749 1787602075.662108 mapread 0x01bf15 thru 0x024c99 (0x8d85 bytes) 000753 1787602075.669765 MIRROR_EXTEND to 2 mirrors 000754 1787602076.083969 mapread 0x00c2f5 thru 0x01a18e (0xde9a bytes) 000755 1787602076.106124 MIRROR_EXTEND to 3 mirrors 000758 1787602076.573100 read 0x013f88 thru 0x0140c3 (0x13c bytes) 000759 1787602076.578415 mapwrite 0x030beb thru 0x035a72 (0x4e88 bytes) 000760 1787602076.710979 mapwrite 0x000510 thru 0x0100f6 (0xfbe7 bytes) 000761 1787602076.775057 mapwrite 0x0005fa thru 0x008134 (0x7b3b bytes) 000763 1787602076.806966 write 0x00fd6f thru 0x01c304 (0xc596 bytes) 000764 1787602076.811219 trunc from 0x035a73 to 0x026a00 (0xf072 bytes) 000766 1787602076.834802 trunc from 0x026a01 to 0x028438 (0x1a38 bytes) 000767 1787602076.849944 read 0x027b08 thru 0x028438 (0x931 bytes) 000768 1787602076.859445 mapread 0x011181 thru 0x0175ed (0x646d bytes) 000770 1787602076.861550 trunc from 0x028439 to 0x000299 (0x2819f bytes) 000773 1787602076.881702 mapwrite 0x027a6d thru 0x02c82a (0x4dbe bytes) 000774 1787602076.958235 MIRROR_RESYNC 3 mirrors 000775 1787602077.750391 mapread 0x014a5e thru 0x01d9d6 (0x8f79 bytes) 000776 1787602077.768895 write 0x01cdba thru 0x0240b4 (0x72fb bytes) 000777 1787602077.836233 trunc from 0x02c82b to 0x01c0ca (0x10760 bytes) 000778 1787602077.856619 trunc from 0x01c0cb to 0x03de0b (0x21d41 bytes) 000779 1787602077.877885 mapread 0x026ea8 thru 0x02ad28 (0x3e81 bytes) 000784 1787602077.896486 trunc from 0x03de0c to 0x014150 (0x29cbb bytes) 000787 1787602077.920685 mapwrite 0x016391 thru 0x0240da (0xdd4a bytes) 000789 1787602078.003764 mapread 0x0182a5 thru 0x0240da (0xbe36 bytes) 000792 1787602078.005551 read 0x015681 thru 0x01fd10 (0xa690 bytes) 000793 1787602078.006131 read 0x00f59d thru 0x01ed99 (0xf7fd bytes) 000794 1787602078.008537 write 0x006ef0 thru 0x009475 (0x2586 bytes) 000798 1787602078.024486 mapwrite 0x00f503 thru 0x01eea2 (0xf9a0 bytes) 000799 1787602078.071169 read 0x01a9cf thru 0x0240da (0x970c bytes) 000801 1787602078.072743 write 0x02605a thru 0x034058 (0xdfff bytes) 000804 1787602078.075926 read 0x0123ed thru 0x01b043 (0x8c57 bytes) 000805 1787602078.077037 mapread 0x01f601 thru 0x02eb2a (0xf52a bytes) 000806 1787602078.086177 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x34059): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34059): Mirror 2: 0x781994cb (stale) Mirror 3: 0x781994cb (stale) CRC-32 checksum value for chunk [0, 0x34059): Mirror 1: 0x2d4b1e4e Mirror 4: 0x2d4b1e4e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34059: skipped 000807 1787602078.761351 trunc from 0x034059 to 0x01748b (0x1cbcd bytes) 000810 1787602078.895966 mapwrite 0x026f4c thru 0x02dfcf (0x7084 bytes) 000814 1787602078.994205 mapread 0x010ef9 thru 0x017af5 (0x6bfd bytes) 000816 1787602079.019886 MIRROR_RESYNC 4 mirrors 000819 1787602080.110396 MIRROR_RESYNC 4 mirrors 000820 1787602080.433544 trunc from 0x02dfd0 to 0x01b95f (0x12670 bytes) 000821 1787602080.530584 mapwrite 0x027312 thru 0x02cd19 (0x5a08 bytes) 000823 1787602080.606597 read 0x0001a8 thru 0x007916 (0x776f bytes) 000825 1787602080.622187 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2cd1a): Mirror 3: 0x41e08431 (stale) Mirror 4: 0x41e08431 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cd1a): Mirror 3: 0x41e08431 (stale) Mirror 4: 0x41e08431 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cd1a: skipped 000828 1787602080.922389 read 0x002c8c thru 0x008da1 (0x6116 bytes) 000830 1787602080.938987 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2cd1a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cd1a): Mirror 3: 0x41e08431 (stale) Mirror 4: 0x41e08431 (stale) CRC-32 checksum value for chunk [0, 0x2cd1a): Mirror 1: 0xf7b1d6bd Mirror 5: 0xf7b1d6bd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cd1a: skipped 000833 1787602081.748527 read 0x0292bf thru 0x02cd19 (0x3a5b bytes) 000834 1787602081.761969 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2cd1a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cd1a): Mirror 3: 0x41e08431 (stale) Mirror 4: 0x41e08431 (stale) CRC-32 checksum value for chunk [0, 0x2cd1a): Mirror 1: 0xf7b1d6bd Mirror 5: 0xf7b1d6bd Mirror 6: 0xf7b1d6bd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cd1a: skipped 000835 1787602082.621549 write 0x02b805 thru 0x032226 (0x6a22 bytes) 000836 1787602082.682752 trunc from 0x032227 to 0x003c9a (0x2e58c bytes) 000837 1787602082.703671 read 0x00332b thru 0x003c9a (0x970 bytes) 000840 1787602082.711452 mapread 0x000c73 thru 0x003c9a (0x3028 bytes) 000842 1787602082.724600 mapread 0x00240d thru 0x003c9a (0x188e bytes) 000844 1787602082.726104 write 0x02442e thru 0x031e63 (0xda36 bytes) 000847 1787602082.733501 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31e64): Mirror 4: 0x8920d5d3 (stale) Mirror 5: 0xb5359294 (stale) Mirror 6: 0xb5359294 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31e64): Mirror 4: 0x8920d5d3 (stale) Mirror 5: 0xb5359294 (stale) Mirror 6: 0xb5359294 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31e64: skipped 000850 1787602083.044525 trunc from 0x031e64 to 0x004eef (0x2cf74 bytes) 000852 1787602083.066251 read 0x0031e0 thru 0x004512 (0x1333 bytes) 000853 1787602083.072501 trunc from 0x004ef0 to 0x029722 (0x24833 bytes) 000855 1787602083.087833 mapread 0x005e1a thru 0x00b0e1 (0x52c8 bytes) 000857 1787602083.105922 mapread 0x016af4 thru 0x01ca6a (0x5f77 bytes) 000860 1787602083.116521 write 0x0317e6 thru 0x03ffff (0xe81a bytes) 000863 1787602083.121644 read 0x0336e3 thru 0x034a0f (0x132d bytes) 000865 1787602083.123248 read 0x0143e4 thru 0x022c51 (0xe86e bytes) 000870 1787602083.139616 mapwrite 0x022da7 thru 0x0308d4 (0xdb2e bytes) 000871 1787602083.200536 trunc from 0x040000 to 0x0276e8 (0x18917 bytes) 000873 1787602083.218039 write 0x02292d thru 0x031493 (0xeb67 bytes) 000874 1787602083.220509 read 0x019db9 thru 0x01cff9 (0x3241 bytes) 000877 1787602083.222371 write 0x03eaa6 thru 0x03ffff (0x155a bytes) 000878 1787602083.223806 mapwrite 0x01cb02 thru 0x020eee (0x43ed bytes) 000879 1787602083.266771 read 0x0124a1 thru 0x0159f6 (0x3556 bytes) 000880 1787602083.267413 mapread 0x02eff6 thru 0x0328d9 (0x38e4 bytes) 000883 1787602083.289210 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x981e4c85 (stale) Mirror 5: 0xa404a285 (stale) Mirror 6: 0xa404a285 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9965561b Mirror 7: 0x9965561b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000884 1787602084.116439 mapwrite 0x02e190 thru 0x0389fa (0xa86b bytes) 000889 1787602084.284449 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x981e4c85 (stale) Mirror 5: 0xa404a285 (stale) Mirror 6: 0xa404a285 (stale) Mirror 7: 0x9965561b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9ecfa4b0 Mirror 8: 0x9ecfa4b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000891 1787602085.115738 mapread 0x03dcc7 thru 0x03ffff (0x2339 bytes) 000892 1787602085.136382 mapread 0x0242ea thru 0x02677e (0x2495 bytes) 000893 1787602085.150401 write 0x00680a thru 0x00f892 (0x9089 bytes) 000895 1787602085.235438 mapread 0x0212e9 thru 0x0234a3 (0x21bb bytes) 000897 1787602085.245440 trunc from 0x040000 to 0x02e9f4 (0x1160b bytes) 000902 1787602085.264939 mapwrite 0x038372 thru 0x03ffff (0x7c8e bytes) 000905 1787602085.399938 MIRROR_RESYNC 6 mirrors 000907 1787602087.037295 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) 000908 1787602087.323517 read 0x029ab9 thru 0x030cce (0x7216 bytes) 000909 1787602087.341133 MIRROR_RESYNC 5 mirrors 000911 1787602087.807415 trunc from 0x040000 to 0x00da09 (0x325f6 bytes) 000913 1787602087.938415 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xda0a): Mirror 5: 0x9ce4a2dd (stale) Mirror 6: 0x9ce4a2dd (stale) Mirror 7: 0x9ce4a2dd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xda0a): Mirror 5: 0x9ce4a2dd (stale) Mirror 6: 0x9ce4a2dd (stale) Mirror 7: 0x9ce4a2dd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xda0a: skipped 000915 1787602088.350129 write 0x01092f thru 0x017afb (0x71cd bytes) 000916 1787602088.355422 read 0x002957 thru 0x00573e (0x2de8 bytes) 000919 1787602088.382764 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1cd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17afc): Mirror 5: 0xde01afff (stale) Mirror 7: 0xde01afff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17afc): Mirror 5: 0xde01afff (stale) Mirror 7: 0xde01afff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17afc: skipped 000920 1787602088.729951 mapwrite 0x03c945 thru 0x03ffff (0x36bb bytes) 000922 1787602088.827967 write 0x028b06 thru 0x02f9ea (0x6ee5 bytes) 000926 1787602088.844269 trunc from 0x040000 to 0x02bc64 (0x1439b bytes) 000932 1787602088.869356 read 0x022d97 thru 0x0266ad (0x3917 bytes) 000936 1787602088.880135 read 0x01d281 thru 0x028161 (0xaee1 bytes) 000938 1787602088.909105 write 0x01c77e thru 0x0273bb (0xac3e bytes) 000939 1787602088.910341 trunc from 0x02bc65 to 0x01c640 (0xf624 bytes) 000940 1787602088.931913 trunc from 0x01c641 to 0x03b3ba (0x1ed7a bytes) 000941 1787602088.961165 mapread 0x00aecb thru 0x01378e (0x88c4 bytes) 000942 1787602088.962501 mapread 0x01030f thru 0x015097 (0x4d89 bytes) 000943 1787602088.964634 read 0x028681 thru 0x037ef7 (0xf877 bytes) 000946 1787602088.983231 write 0x03d205 thru 0x03ffff (0x2dfb bytes) 000947 1787602088.984382 write 0x02c0fc thru 0x035127 (0x902c bytes) 000948 1787602088.985458 mapread 0x00c9c0 thru 0x014988 (0x7fc9 bytes) 000949 1787602088.986582 read 0x00e866 thru 0x0138fd (0x5098 bytes) 000951 1787602088.988948 read 0x03157c thru 0x03dc4e (0xc6d3 bytes) 000953 1787602088.998384 mapread 0x03ca43 thru 0x03ffff (0x35bd bytes) 000957 1787602089.002914 mapread 0x02a761 thru 0x03884e (0xe0ee bytes) 000958 1787602089.009411 mapwrite 0x019622 thru 0x028e8b (0xf86a bytes) 000959 1787602089.104544 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xfdcb2f90 (stale) Mirror 7: 0xfdcb2f90 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2467dcee Mirror 8: 0x2467dcee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000964 1787602089.831694 trunc from 0x040000 to 0x00b2ee (0x34d11 bytes) 000967 1787602089.936979 trunc from 0x00b2ef to 0x037592 (0x2c2a4 bytes) 000969 1787602089.962991 mapwrite 0x02b84b thru 0x036d2f (0xb4e5 bytes) 000972 1787602090.054538 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x37593): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37593): Mirror 5: 0x1d8fd234 (stale) Mirror 7: 0x1d8fd234 (stale) Mirror 8: 0xca673a2f (stale) CRC-32 checksum value for chunk [0, 0x37593): Mirror 1: 0x7ae5ed18 Mirror 9: 0x7ae5ed18 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37593: skipped 000973 1787602090.878074 MIRROR_RESYNC 5 mirrors 000975 1787602091.936418 MIRROR_EXTEND to 6 mirrors 000976 1787602092.681923 mapwrite 0x006852 thru 0x00fd15 (0x94c4 bytes) 000978 1787602093.020793 MIRROR_RESYNC 6 mirrors 000979 1787602094.402280 write 0x00a3e5 thru 0x0197b0 (0xf3cc bytes) 000982 1787602094.480629 read 0x008b76 thru 0x016db7 (0xe242 bytes) 000983 1787602094.486319 write 0x00e86a thru 0x014e38 (0x65cf bytes) 000984 1787602094.487460 trunc from 0x037593 to 0x018ee9 (0x1e6a9 bytes) 000986 1787602094.512362 mapread 0x00326c thru 0x004294 (0x1029 bytes) 000987 1787602094.520499 read 0x00b1cb thru 0x018ee9 (0xdd1f bytes) 000988 1787602094.521345 read 0x018e43 thru 0x018ee9 (0xa7 bytes) 000992 1787602094.524465 mapwrite 0x03bc8a thru 0x03ffff (0x4376 bytes) 000993 1787602094.590793 mapread 0x034462 thru 0x035284 (0xe23 bytes) 000996 1787602094.592628 mapwrite 0x00973c thru 0x012141 (0x8a06 bytes) 000997 1787602094.633689 trunc from 0x040000 to 0x0257d4 (0x1a82b bytes) 000998 1787602094.651730 mapread 0x016d88 thru 0x018033 (0x12ac bytes) All operations completed A-OK!