== sanity-flr test 70a: flr mode fsx test ================ 18:37:01 (1786833421) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 3423 000001 1786833424.076106 write 0x032000 thru 0x03ffff (0xe000 bytes) 000003 1786833424.111577 mapread 0x031e86 thru 0x03a136 (0x82b1 bytes) zero_range to largest ever: 0xcc5a 000005 1786833424.125223 trunc from 0x0033d6 to 0x00cc59 (0x9884 bytes) 000007 1786833424.132803 punch from 0x00991b to 0x0183c6 (0xeaac bytes) 000008 1786833424.148729 trunc from 0x019a8f to 0x022957 (0x8ec9 bytes) 000009 1786833424.159718 write 0x00bbf4 thru 0x015c2f (0xa03c bytes) 000010 1786833424.183095 punch from 0x0198d8 to 0x01a9f9 (0x1122 bytes) 000012 1786833424.194118 write 0x03dfce thru 0x03e524 (0x557 bytes) 000013 1786833424.198607 read 0x00e341 thru 0x013b1a (0x57da bytes) 000015 1786833424.204943 write 0x01da73 thru 0x02169f (0x3c2d bytes) 000016 1786833424.253742 mapwrite 0x00a848 thru 0x016120 (0xb8d9 bytes) 000017 1786833424.413233 trunc from 0x03dd63 to 0x03ffff (0x229d bytes) 000018 1786833424.441137 MIRROR_EXTEND to 2 mirrors fallocating to largest ever: 0x23406 000019 1786833425.526316 fallocate 0x020755 thru 0x023405 (0x2cb1 bytes) 000021 1786833425.572068 punch from 0x01725d to 0x01f1bb (0x7f5f bytes) 000022 1786833425.592772 trunc from 0x00b3e5 to 0x012d49 (0x7965 bytes) 000023 1786833425.611163 mapwrite 0x01482f thru 0x01b401 (0x6bd3 bytes) 000024 1786833425.716209 punch from 0x027378 to 0x029cf0 (0x2979 bytes) 000025 1786833425.725450 trunc from 0x0032c2 to 0x012bac (0xf8eb bytes) zero_range to largest ever: 0x40000 000026 1786833425.736195 trunc from 0x03911e to 0x03ffff (0x6ee2 bytes) 000027 1786833425.754218 fallocate 0x003368 thru 0x005e8e (0x2b27 bytes) 000028 1786833425.764154 trunc from 0x040000 to 0x001c5b (0x3e3a4 bytes) 000029 1786833425.815490 MIRROR_RESYNC 2 mirrors 000030 1786833426.467021 fallocate 0x02c535 thru 0x0395b2 (0xd07e bytes) 000031 1786833426.500664 read 0x021f82 thru 0x02d1ad (0xb22c bytes) 000032 1786833426.524193 write 0x034f24 thru 0x038abc (0x3b99 bytes) 000033 1786833426.547756 trunc from 0x01bc36 to 0x020468 (0x4833 bytes) 000034 1786833426.552465 mapwrite 0x00e1ac thru 0x016f26 (0x8d7b bytes) 000035 1786833426.616353 write 0x011348 thru 0x0160cf (0x4d88 bytes) 000036 1786833426.617638 mapwrite 0x030d43 thru 0x03446c (0x372a bytes) 000037 1786833426.678134 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x395b3): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x395b3): Mirror 2: 0x3ea82dd0 (stale) CRC-32 checksum value for chunk [0, 0x395b3): Mirror 1: 0xf91db2a2 Mirror 3: 0xf91db2a2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x395b3: skipped 000039 1786833427.955697 trunc from 0x0395b3 to 0x006ae9 (0x32ac9 bytes) 000041 1786833428.063933 trunc from 0x006aea to 0x0248c7 (0x1ddde bytes) 000042 1786833428.105958 punch from 0x00a64d to 0x00f6b0 (0x5064 bytes) 000043 1786833428.112467 mapwrite 0x01d7dd thru 0x023ba0 (0x63c4 bytes) 000044 1786833428.200721 write 0x03610d thru 0x03ffff (0x9ef3 bytes) 000045 1786833428.217655 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 3: 0xba6434f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9f4e953a Mirror 4: 0x9f4e953a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000046 1786833429.317284 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9f4e953a Mirror 4: 0x9f4e953a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000047 1786833430.162947 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) 000048 1786833430.725951 write 0x016ba5 thru 0x0200f8 (0x9554 bytes) 000049 1786833430.834431 read 0x016979 thru 0x018f17 (0x259f bytes) 000050 1786833430.844771 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) 000052 1786833431.191420 trunc from 0x012ba8 to 0x013ef9 (0x1352 bytes) 000053 1786833431.216519 write 0x003df9 thru 0x00bf7b (0x8183 bytes) 000054 1786833431.247572 trunc from 0x02229b to 0x027619 (0x537f bytes) 000055 1786833431.259989 trunc from 0x004e70 to 0x00e822 (0x99b3 bytes) 000056 1786833431.308826 read 0x01f981 thru 0x023bb2 (0x4232 bytes) 000057 1786833431.325815 read 0x007478 thru 0x015d67 (0xe8f0 bytes) 000058 1786833431.349718 MIRROR_EXTEND to 2 mirrors 000059 1786833432.096196 mapread 0x03648a thru 0x03e0c4 (0x7c3b bytes) 000060 1786833432.172290 punch from 0x001807 to 0x00d981 (0xc17b bytes) 000061 1786833432.247995 punch from 0x0020f0 to 0x007f83 (0x5e94 bytes) 000062 1786833432.264076 punch from 0x00ff21 to 0x01a244 (0xa324 bytes) 000063 1786833432.280734 mapread 0x0077e3 thru 0x011466 (0x9c84 bytes) 000064 1786833432.351975 trunc from 0x0236c1 to 0x02df50 (0xa890 bytes) 000066 1786833432.382453 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) 000067 1786833432.580202 trunc from 0x025211 to 0x02f4a3 (0xa293 bytes) 000069 1786833432.589417 mapwrite 0x020092 thru 0x0218ad (0x181c bytes) 000070 1786833432.615683 read 0x0139a5 thru 0x013a6b (0xc7 bytes) 000071 1786833432.621532 trunc from 0x013918 to 0x0188d2 (0x4fbb bytes) 000072 1786833432.628103 fallocate 0x019578 thru 0x020a10 (0x7499 bytes) 000073 1786833432.641360 read 0x00d1ed thru 0x01751d (0xa331 bytes) 000074 1786833432.657563 mapwrite 0x024fa0 thru 0x02c899 (0x78fa bytes) 000076 1786833432.685016 trunc from 0x040000 to 0x02505a (0x1afa5 bytes) 000077 1786833432.741642 write 0x0340eb thru 0x03c42c (0x8342 bytes) 000078 1786833432.744950 trunc from 0x02a3bd to 0x033f93 (0x9bd7 bytes) 000079 1786833432.749729 mapwrite 0x03bf62 thru 0x03ffff (0x409e bytes) 000080 1786833432.798983 mapwrite 0x03c607 thru 0x03ffff (0x39f9 bytes) 000081 1786833432.814758 read 0x031dfc thru 0x0366cb (0x48d0 bytes) 000082 1786833432.828298 mapwrite 0x024a78 thru 0x027f21 (0x34aa bytes) 000083 1786833432.843423 mapwrite 0x032512 thru 0x032a16 (0x505 bytes) 000084 1786833432.856217 trunc from 0x040000 to 0x02d6e7 (0x12918 bytes) 000085 1786833432.872500 punch from 0x00991e to 0x00e000 (0x46e3 bytes) 000086 1786833432.881672 MIRROR_EXTEND to 2 mirrors 000087 1786833433.836376 write 0x02157a thru 0x02e62a (0xd0b1 bytes) 000088 1786833433.894325 read 0x007bbd thru 0x015158 (0xd59c bytes) 000089 1786833433.915440 read 0x0202e1 thru 0x02d2b5 (0xcfd5 bytes) 000090 1786833433.927803 punch from 0x0184d1 to 0x022d6c (0xa89c bytes) 000091 1786833433.951246 read 0x006a04 thru 0x00e79c (0x7d99 bytes) 000092 1786833433.952326 trunc from 0x0091dd to 0x00ac91 (0x1ab5 bytes) 000095 1786833433.959794 punch from 0x017930 to 0x0219a8 (0xa079 bytes) 000096 1786833433.965648 mapread 0x0027ab thru 0x00bf09 (0x975f bytes) 000097 1786833433.982222 fallocate 0x028bff thru 0x02accf (0x20d1 bytes) 000098 1786833433.988636 fallocate 0x0348cb thru 0x03655b (0x1c91 bytes) 000099 1786833434.004061 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2e62b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e62b): Mirror 2: 0x5abf7d8b (stale) CRC-32 checksum value for chunk [0, 0x2e62b): Mirror 1: 0x49a28b92 Mirror 3: 0x49a28b92 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e62b: skipped 000100 1786833435.149092 mapread 0x0051f2 thru 0x00d109 (0x7f18 bytes) 000101 1786833435.199055 mapwrite 0x02af4f thru 0x03ae5d (0xff0f bytes) 000102 1786833435.323013 mapwrite 0x02936d thru 0x03715c (0xddf0 bytes) 000103 1786833435.393530 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ae5e): Mirror 3: 0xa3cadff0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae5e): Mirror 3: 0xa3cadff0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae5e: skipped 000104 1786833435.778713 fallocate 0x03c8d7 thru 0x03e0f8 (0x1822 bytes) 000105 1786833435.790313 mapread 0x002963 thru 0x0048d3 (0x1f71 bytes) 000106 1786833435.844815 mapwrite 0x015377 thru 0x020a20 (0xb6aa bytes) 000107 1786833435.907965 punch from 0x00b68b to 0x0101f2 (0x4b68 bytes) 000109 1786833435.917842 trunc from 0x02b613 to 0x02c874 (0x1262 bytes) 000110 1786833435.922399 write 0x0129ce thru 0x014486 (0x1ab9 bytes) 000111 1786833435.928301 fallocate 0x038564 thru 0x03ffff (0x7a9c bytes) 000112 1786833435.936233 trunc from 0x040000 to 0x03427b (0xbd84 bytes) 000113 1786833435.955550 punch from 0x009517 to 0x009606 (0xf0 bytes) 000114 1786833435.964925 mapread 0x031502 thru 0x03427b (0x2d7a bytes) 000115 1786833435.980497 trunc from 0x03427c to 0x0006db (0x33ba0 bytes) 000117 1786833436.007225 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x6dc): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6dc): Mirror 3: 0xc3c89924 (stale) CRC-32 checksum value for chunk [0, 0x6dc): Mirror 1: 0xc3c89924 Mirror 4: 0xc3c89924 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6dc: skipped 000118 1786833436.966803 trunc from 0x0006dc to 0x030efe (0x30823 bytes) 000119 1786833437.041273 read 0x01ff29 thru 0x0205ca (0x6a2 bytes) 000120 1786833437.057120 punch from 0x02aed8 to 0x02c89b (0x19c4 bytes) 000121 1786833437.063791 trunc from 0x030eff to 0x00fb15 (0x213e9 bytes) 000122 1786833437.103121 fallocate 0x012e5a thru 0x01c95e (0x9b05 bytes) 000123 1786833437.128455 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xfb16): Mirror 4: 0x8c85d340 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfb16): Mirror 4: 0x8c85d340 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfb16: skipped 000124 1786833437.464442 mapread 0x002ebb thru 0x004fcf (0x2115 bytes) 000126 1786833437.504920 trunc from 0x00fb16 to 0x01fd34 (0x1021f bytes) 000127 1786833437.533944 trunc from 0x01e037 to 0x01fd34 (0x1cfe bytes) 000129 1786833437.542420 write 0x021c40 thru 0x022723 (0xae4 bytes) 000130 1786833437.545414 fallocate 0x020675 thru 0x02dbd1 (0xd55d bytes) 000131 1786833437.554081 trunc from 0x022724 to 0x00fc2a (0x12af9 bytes) 000132 1786833437.579448 mapread 0x003b7c thru 0x00b5f2 (0x7a77 bytes) 000133 1786833437.583093 trunc from 0x00fc2b to 0x013749 (0x3b1f bytes) 000134 1786833437.611139 MIRROR_RESYNC 2 mirrors 000135 1786833438.159796 write 0x031b7a thru 0x03ab3f (0x8fc6 bytes) 000136 1786833438.200777 punch from 0x006666 to 0x00e5cb (0x7f66 bytes) 000137 1786833438.206135 mapread 0x010752 thru 0x0177d7 (0x7086 bytes) 000138 1786833438.232384 mapread 0x02e29d thru 0x039683 (0xb3e7 bytes) 000139 1786833438.242895 fallocate 0x03e344 thru 0x03ffff (0x1cbc bytes) 000140 1786833438.250385 trunc from 0x022a3a to 0x024dc1 (0x2388 bytes) 000141 1786833438.264278 trunc from 0x03ab40 to 0x03013a (0xaa05 bytes) 000142 1786833438.335889 trunc from 0x00d5c7 to 0x01ca7a (0xf4b4 bytes) 000143 1786833438.342133 mapwrite 0x01449e thru 0x01e624 (0xa187 bytes) 000144 1786833438.397030 trunc from 0x03013b to 0x012a72 (0x1d6c8 bytes) 000145 1786833438.422986 read 0x007fa9 thru 0x00b339 (0x3391 bytes) 000146 1786833438.435455 mapwrite 0x0228aa thru 0x02dac1 (0xb218 bytes) 000147 1786833438.502971 trunc from 0x02dac2 to 0x003e35 (0x29c8c bytes) 000148 1786833438.526846 trunc from 0x0001fc to 0x003e35 (0x3c3a bytes) 000149 1786833438.534348 trunc from 0x000b37 to 0x003e35 (0x32ff bytes) 000150 1786833438.546739 mapread 0x002059 thru 0x003e35 (0x1ddd bytes) 000151 1786833438.560467 mapwrite 0x028a50 thru 0x02d666 (0x4c17 bytes) 000152 1786833438.637278 write 0x00ab74 thru 0x0187af (0xdc3c bytes) 000153 1786833438.657375 read 0x023e8c thru 0x02d666 (0x97db bytes) 000154 1786833438.693201 MIRROR_RESYNC 2 mirrors 000155 1786833439.611977 mapread 0x02b75c thru 0x02d666 (0x1f0b bytes) 000156 1786833439.651775 write 0x009932 thru 0x00ff29 (0x65f8 bytes) 000157 1786833439.705210 MIRROR_RESYNC 2 mirrors 000158 1786833440.505758 write 0x007977 thru 0x012b3a (0xb1c4 bytes) 000159 1786833440.573480 trunc from 0x02d667 to 0x016fe2 (0x16684 bytes) 000160 1786833440.604692 read 0x002f8c thru 0x00aad1 (0x7b46 bytes) 000161 1786833440.620306 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x16fe3): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16fe3): Mirror 4: 0x6df04430 (stale) CRC-32 checksum value for chunk [0, 0x16fe3): Mirror 1: 0x7f90735f Mirror 5: 0x7f90735f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16fe3: skipped 000163 1786833441.500570 mapwrite 0x024715 thru 0x02f34b (0xac37 bytes) 000164 1786833441.662087 mapread 0x007e6f thru 0x00e010 (0x61a2 bytes) 000165 1786833441.694543 mapread 0x009151 thru 0x01137a (0x822a bytes) 000166 1786833441.744498 trunc from 0x02f34c to 0x00f408 (0x1ff43 bytes) 000167 1786833441.806045 fallocate 0x033535 thru 0x03ce5c (0x9928 bytes) 000168 1786833441.815380 punch from 0x0057e3 to 0x00c000 (0x681e bytes) 000169 1786833441.827034 punch from 0x00c509 to 0x00f408 (0x2f00 bytes) 000170 1786833441.832747 mapread 0x001a50 thru 0x0073ef (0x59a0 bytes) 000171 1786833441.851348 punch from 0x006093 to 0x009037 (0x2fa5 bytes) 000172 1786833441.856624 mapread 0x00e85f thru 0x00f408 (0xbaa bytes) 000173 1786833441.858862 trunc from 0x00e72a to 0x00f408 (0xcdf bytes) 000174 1786833441.866107 read 0x007c5e thru 0x00dfd2 (0x6375 bytes) 000175 1786833441.877027 write 0x035ccd thru 0x03ffff (0xa333 bytes) 000176 1786833441.880385 fallocate 0x027e5d thru 0x03708c (0xf230 bytes) 000177 1786833441.889177 mapwrite 0x0043c9 thru 0x00dc49 (0x9881 bytes) 000178 1786833441.940547 read 0x0212f0 thru 0x02ae50 (0x9b61 bytes) 000179 1786833441.957974 mapread 0x00e54c thru 0x00f9ce (0x1483 bytes) 000180 1786833441.959633 trunc from 0x030fcc to 0x03df13 (0xcf48 bytes) 000181 1786833441.969451 mapwrite 0x03a8ef thru 0x03ffff (0x5711 bytes) 000182 1786833442.039732 mapwrite 0x0002c9 thru 0x0005d4 (0x30c bytes) 000183 1786833442.054689 mapwrite 0x01bbb7 thru 0x023a98 (0x7ee2 bytes) 000185 1786833442.075034 mapwrite 0x01eb75 thru 0x02d4cd (0xe959 bytes) 000186 1786833442.101898 fallocate 0x000002 thru 0x002b39 (0x2b38 bytes) 000187 1786833442.113150 MIRROR_RESYNC 3 mirrors 000189 1786833443.334990 mapwrite 0x00a341 thru 0x00ad7a (0xa3a bytes) 000190 1786833443.457211 mapwrite 0x0311b7 thru 0x03dc2a (0xca74 bytes) 000191 1786833443.563104 write 0x01545f thru 0x01e69e (0x9240 bytes) 000192 1786833443.585114 trunc from 0x0307ce to 0x0371fb (0x6a2e bytes) 000193 1786833443.598659 trunc from 0x02c6c5 to 0x0315ad (0x4ee9 bytes) 000194 1786833443.608218 trunc from 0x0167b8 to 0x01d268 (0x6ab1 bytes) 000195 1786833443.638360 write 0x02e778 thru 0x03105e (0x28e7 bytes) 000196 1786833443.652761 read 0x024f27 thru 0x024fcb (0xa5 bytes) 000197 1786833443.664545 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb6b86269 (stale) Mirror 5: 0xb6b86269 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfdcf1ecb Mirror 6: 0xfdcf1ecb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000198 1786833445.065087 mapread 0x009a02 thru 0x00fb74 (0x6173 bytes) 000199 1786833445.119327 MIRROR_RESYNC 4 mirrors 000200 1786833446.359512 fallocate 0x03647f thru 0x03ffff (0x9b81 bytes) 000201 1786833446.407182 MIRROR_RESYNC 4 mirrors 000202 1786833447.840344 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) 000203 1786833448.240499 mapwrite 0x038661 thru 0x03f43c (0x6ddc bytes) 000204 1786833448.338416 trunc from 0x03bee9 to 0x03ffff (0x4117 bytes) 000205 1786833448.348363 fallocate 0x00bafb thru 0x01b0de (0xf5e4 bytes) 000206 1786833448.358074 write 0x010ca8 thru 0x01456b (0x38c4 bytes) 000207 1786833448.383757 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xfdcf1ecb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xfdcf1ecb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000208 1786833448.764587 fallocate 0x0040fc thru 0x00d9d0 (0x98d5 bytes) 000209 1786833448.775739 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xfdcf1ecb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xffc2d70f Mirror 5: 0xffc2d70f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000210 1786833450.205646 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xfdcf1ecb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xffc2d70f Mirror 5: 0xffc2d70f Mirror 6: 0xffc2d70f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000211 1786833451.689997 trunc from 0x0046f7 to 0x010aa5 (0xc3af bytes) 000212 1786833451.751860 read 0x0067f3 thru 0x00ac52 (0x4460 bytes) 000213 1786833451.783673 punch from 0x011017 to 0x01bc89 (0xac73 bytes) 000214 1786833451.800169 fallocate 0x03b821 thru 0x03d667 (0x1e47 bytes) 000216 1786833451.828479 MIRROR_RESYNC 4 mirrors 000217 1786833453.656038 write 0x0378b1 thru 0x03ffff (0x874f bytes) 000218 1786833453.696974 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xcf4ec540 (stale) Mirror 5: 0xcf4ec540 (stale) Mirror 6: 0xcf4ec540 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf05cc495 Mirror 7: 0xf05cc495 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000220 1786833455.055253 read 0x03e789 thru 0x03ffff (0x1877 bytes) 000221 1786833455.065285 punch from 0x02fc59 to 0x035254 (0x55fc bytes) 000222 1786833455.131179 trunc from 0x021a28 to 0x02988e (0x7e67 bytes) 000223 1786833455.151333 punch from 0x032f34 to 0x038dca (0x5e97 bytes) 000224 1786833455.178671 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xcf4ec540 (stale) Mirror 6: 0xcf4ec540 (stale) Mirror 7: 0xf05cc495 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xcf4ec540 (stale) Mirror 6: 0xcf4ec540 (stale) Mirror 7: 0xf05cc495 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000225 1786833455.889930 read 0x0359b0 thru 0x03de7d (0x84ce bytes) 000226 1786833455.909430 mapwrite 0x02081b thru 0x02fc38 (0xf41e bytes) 000227 1786833456.021075 fallocate 0x00079a thru 0x00c661 (0xbec8 bytes) 000229 1786833456.030928 trunc from 0x02a686 to 0x036e35 (0xc7b0 bytes) 000230 1786833456.046291 mapread 0x0299a9 thru 0x038dfe (0xf456 bytes) 000231 1786833456.069350 mapread 0x00cd52 thru 0x012e7a (0x6129 bytes) 000232 1786833456.086087 fallocate 0x032d28 thru 0x03acba (0x7f93 bytes) 000234 1786833456.091875 read 0x024450 thru 0x032f00 (0xeab1 bytes) 000235 1786833456.092557 write 0x017fea thru 0x01f2d6 (0x72ed bytes) 000236 1786833456.113937 read 0x0233db thru 0x028030 (0x4c56 bytes) 000237 1786833456.114795 mapread 0x006029 thru 0x015035 (0xf00d bytes) 000238 1786833456.116837 mapread 0x013578 thru 0x01991a (0x63a3 bytes) 000239 1786833456.119967 write 0x03d97a thru 0x03ffff (0x2686 bytes) 000240 1786833456.121739 mapwrite 0x01380c thru 0x02163f (0xde34 bytes) 000241 1786833456.157679 mapread 0x00d7f4 thru 0x016e2e (0x963b bytes) 000242 1786833456.160159 mapwrite 0x01196d thru 0x0206c6 (0xed5a bytes) 000243 1786833456.187952 punch from 0x02dd4f to 0x031754 (0x3a06 bytes) 000244 1786833456.194928 read 0x034a04 thru 0x03b2d5 (0x68d2 bytes) 000245 1786833456.196062 mapwrite 0x032853 thru 0x03ff40 (0xd6ee bytes) 000247 1786833456.227198 trunc from 0x03fecd to 0x03ffff (0x133 bytes) 000248 1786833456.244656 write 0x02e175 thru 0x033d1c (0x5ba8 bytes) 000250 1786833456.262489 write 0x032678 thru 0x03a5e7 (0x7f70 bytes) 000251 1786833456.264697 trunc from 0x027a73 to 0x02a4a5 (0x2a33 bytes) 000252 1786833456.281747 fallocate 0x034e46 thru 0x03ffff (0xb1ba bytes) 000253 1786833456.304793 MIRROR_RESYNC 4 mirrors 000254 1786833458.182900 MIRROR_EXTEND to 5 mirrors 000255 1786833459.268957 MIRROR_EXTEND to 6 mirrors 000256 1786833460.314756 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) 000257 1786833460.633959 mapwrite 0x0270b2 thru 0x028c1f (0x1b6e bytes) 000258 1786833460.752383 write 0x03cd44 thru 0x03ffff (0x32bc bytes) 000259 1786833460.769778 read 0x03b66c thru 0x03ffff (0x4994 bytes) 000260 1786833460.775488 read 0x039edd thru 0x03ffff (0x6123 bytes) 000261 1786833460.790500 punch from 0x020d91 to 0x02e368 (0xd5d8 bytes) 000262 1786833460.796861 read 0x033020 thru 0x039e1e (0x6dff bytes) 000263 1786833460.798743 read 0x01e05d thru 0x02b591 (0xd535 bytes) 000264 1786833460.814129 fallocate 0x030c67 thru 0x03e130 (0xd4ca bytes) 000265 1786833460.820022 write 0x002e5a thru 0x007824 (0x49cb bytes) 000266 1786833460.822258 trunc from 0x040000 to 0x026729 (0x198d6 bytes) 000268 1786833460.843070 write 0x004d07 thru 0x00f551 (0xa84b bytes) 000269 1786833460.851726 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2672a): Mirror 4: 0x3b9e2b18 (stale) Mirror 6: 0x3b9e2b18 (stale) Mirror 7: 0x3b9e2b18 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2672a): Mirror 4: 0x3b9e2b18 (stale) Mirror 6: 0x3b9e2b18 (stale) Mirror 7: 0x3b9e2b18 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2672a: skipped 000270 1786833461.457780 mapread 0x024b03 thru 0x026729 (0x1c27 bytes) 000271 1786833461.510228 trunc from 0x00e3cd to 0x013604 (0x5238 bytes) 000272 1786833461.532192 write 0x03542d thru 0x03ffff (0xabd3 bytes) 000273 1786833461.545741 mapread 0x0030ed thru 0x00a20e (0x7122 bytes) 000274 1786833461.562164 mapwrite 0x010712 thru 0x01d7cb (0xd0ba bytes) 000275 1786833461.639318 write 0x0240cc thru 0x03013a (0xc06f bytes) 000276 1786833461.661959 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2c1e69c2 (stale) Mirror 6: 0x2c1e69c2 (stale) Mirror 7: 0x2c1e69c2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8c88e01c Mirror 8: 0x8c88e01c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000278 1786833462.827450 read 0x034c0a thru 0x03bb08 (0x6eff bytes) 000279 1786833462.836805 write 0x03c17a thru 0x03ffff (0x3e86 bytes) 000282 1786833462.925444 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2c1e69c2 (stale) Mirror 6: 0x2c1e69c2 (stale) Mirror 7: 0x2c1e69c2 (stale) Mirror 8: 0x8c88e01c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8bc29b89 Mirror 9: 0x8bc29b89 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000283 1786833464.249580 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2c1e69c2 (stale) Mirror 6: 0x2c1e69c2 (stale) Mirror 7: 0x2c1e69c2 (stale) Mirror 8: 0x8c88e01c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8bc29b89 Mirror 9: 0x8bc29b89 Mirror 10: 0x8bc29b89 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000284 1786833465.335275 punch from 0x028efd to 0x02e649 (0x574d bytes) 000286 1786833465.381939 MIRROR_RESYNC 7 mirrors 000287 1786833468.137655 read 0x02c680 thru 0x032d53 (0x66d4 bytes) 000288 1786833468.153368 write 0x036fdc thru 0x039004 (0x2029 bytes) 000289 1786833468.194490 punch from 0x002348 to 0x002e56 (0xb0f bytes) 000291 1786833468.203065 punch from 0x03a96b to 0x03d710 (0x2da6 bytes) 000292 1786833468.212882 punch from 0x004543 to 0x007cc8 (0x3786 bytes) 000293 1786833468.219948 trunc from 0x02fbe8 to 0x03a3b3 (0xa7cc bytes) 000294 1786833468.254378 mapread 0x03d977 thru 0x03ffff (0x2689 bytes) 000295 1786833468.282528 punch from 0x021ec0 to 0x02838a (0x64cb bytes) 000296 1786833468.288211 mapwrite 0x03c43a thru 0x03ffff (0x3bc6 bytes) 000297 1786833468.315235 fallocate 0x01c34d thru 0x020806 (0x44ba bytes) 000298 1786833468.324836 mapread 0x00a1fd thru 0x00eeff (0x4d03 bytes) 000299 1786833468.343348 mapwrite 0x0257ef thru 0x02ebeb (0x93fd bytes) 000300 1786833468.436182 fallocate 0x020f3d thru 0x02ed8e (0xde52 bytes) 000301 1786833468.454075 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe5ec6243 (stale) Mirror 7: 0xe5ec6243 (stale) Mirror 8: 0xe5ec6243 (stale) Mirror 9: 0xe5ec6243 (stale) Mirror 10: 0xe5ec6243 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe5ec6243 (stale) Mirror 7: 0xe5ec6243 (stale) Mirror 8: 0xe5ec6243 (stale) Mirror 9: 0xe5ec6243 (stale) Mirror 10: 0xe5ec6243 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000302 1786833469.043158 mapread 0x00b93f thru 0x0151b3 (0x9875 bytes) 000303 1786833469.074856 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe5ec6243 (stale) Mirror 7: 0xe5ec6243 (stale) Mirror 8: 0xe5ec6243 (stale) Mirror 9: 0xe5ec6243 (stale) Mirror 10: 0xe5ec6243 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1461f0cb Mirror 11: 0x1461f0cb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000304 1786833470.243508 mapwrite 0x00eb1a thru 0x00eb93 (0x7a bytes) 000305 1786833470.376009 mapread 0x02ccb4 thru 0x039f8a (0xd2d7 bytes) 000306 1786833470.424832 write 0x02b8dd thru 0x02dfc6 (0x26ea bytes) 000308 1786833470.435174 write 0x02e3e5 thru 0x03444d (0x6069 bytes) 000309 1786833470.438314 write 0x0021ec thru 0x00aa96 (0x88ab bytes) 000311 1786833470.456305 mapread 0x001b8d thru 0x007170 (0x55e4 bytes) 000312 1786833470.466884 trunc from 0x040000 to 0x0303fe (0xfc01 bytes) 000313 1786833470.519340 fallocate 0x012222 thru 0x0214d8 (0xf2b7 bytes) 000314 1786833470.530232 punch from 0x00e6f9 to 0x013e9e (0x57a6 bytes) 000315 1786833470.535336 fallocate 0x00f5a6 thru 0x01aac7 (0xb522 bytes) 000316 1786833470.540283 punch from 0x009f35 to 0x00ad68 (0xe34 bytes) 000317 1786833470.589185 trunc from 0x00bd69 to 0x00e89b (0x2b33 bytes) 000318 1786833470.602361 punch from 0x02af34 to 0x0303fe (0x54cb bytes) 000319 1786833470.612680 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x303ff): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x303ff): Mirror 4: 0x543d9022 (stale) Mirror 7: 0x543d9022 (stale) Mirror 8: 0x543d9022 (stale) Mirror 9: 0x543d9022 (stale) Mirror 10: 0x543d9022 (stale) Mirror 11: 0x5760b4c (stale) CRC-32 checksum value for chunk [0, 0x303ff): Mirror 1: 0xf68e0474 Mirror 12: 0xf68e0474 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x303ff: skipped 000320 1786833472.036480 read 0x00734c thru 0x016250 (0xef05 bytes) 000321 1786833472.059707 punch from 0x013957 to 0x01b3ba (0x7a64 bytes) 000322 1786833472.134416 trunc from 0x0303ff to 0x01f401 (0x10ffd bytes) 000323 1786833472.191532 punch from 0x01c6e0 to 0x01f401 (0x2d22 bytes) 000324 1786833472.214778 write 0x02a3f5 thru 0x034f3e (0xab4a bytes) 000325 1786833472.221479 read 0x028826 thru 0x030fc1 (0x879c bytes) 000326 1786833472.263475 mapread 0x0041b8 thru 0x013075 (0xeebe bytes) 000327 1786833472.275449 mapread 0x0227ae thru 0x031be5 (0xf438 bytes) 000328 1786833472.284444 mapread 0x01e961 thru 0x0213d3 (0x2a73 bytes) 000329 1786833472.285791 trunc from 0x034f3f to 0x019eae (0x1b090 bytes) 000330 1786833472.337586 punch from 0x016c0e to 0x019eae (0x32a1 bytes) 000331 1786833472.354732 fallocate 0x036c71 thru 0x03ffff (0x938f bytes) 000332 1786833472.372898 mapread 0x0017a4 thru 0x001985 (0x1e2 bytes) 000334 1786833472.381756 trunc from 0x030519 to 0x031dd4 (0x18bc bytes) 000335 1786833472.390470 trunc from 0x040000 to 0x0170a8 (0x28f57 bytes) 000336 1786833472.421365 punch from 0x00f58b to 0x0145a5 (0x501b bytes) 000337 1786833472.430423 trunc from 0x0170a9 to 0x039a16 (0x2296e bytes) 000339 1786833472.464387 punch from 0x01efbc to 0x0263d1 (0x7416 bytes) 000341 1786833472.470835 trunc from 0x039a17 to 0x031446 (0x85d0 bytes) 000342 1786833472.503699 MIRROR_RESYNC 8 mirrors 000343 1786833475.048964 trunc from 0x00aeb7 to 0x00cd68 (0x1eb2 bytes) 000344 1786833475.119256 trunc from 0x00c4d8 to 0x00fff1 (0x3b1a bytes) 000345 1786833475.135476 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31447): Mirror 7: 0xf15099d (stale) Mirror 8: 0xf15099d (stale) Mirror 9: 0xf15099d (stale) Mirror 10: 0xf15099d (stale) Mirror 11: 0xf15099d (stale) Mirror 12: 0xf15099d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31447): Mirror 7: 0xf15099d (stale) Mirror 8: 0xf15099d (stale) Mirror 9: 0xf15099d (stale) Mirror 10: 0xf15099d (stale) Mirror 11: 0xf15099d (stale) Mirror 12: 0xf15099d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31447: skipped 000347 1786833475.904567 trunc from 0x001ed9 to 0x00260a (0x732 bytes) 000348 1786833475.925353 write 0x028fc3 thru 0x037fa9 (0xefe7 bytes) 000349 1786833475.948162 read 0x00b81c thru 0x014422 (0x8c07 bytes) 000350 1786833475.970170 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37faa): Mirror 8: 0xe0ef0b16 (stale) Mirror 9: 0xe0ef0b16 (stale) Mirror 10: 0xe0ef0b16 (stale) Mirror 11: 0xe0ef0b16 (stale) Mirror 12: 0xe0ef0b16 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37faa): Mirror 8: 0xe0ef0b16 (stale) Mirror 9: 0xe0ef0b16 (stale) Mirror 10: 0xe0ef0b16 (stale) Mirror 11: 0xe0ef0b16 (stale) Mirror 12: 0xe0ef0b16 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37faa: skipped 000351 1786833476.653374 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37faa): Mirror 8: 0xe0ef0b16 (stale) Mirror 9: 0xe0ef0b16 (stale) Mirror 10: 0xe0ef0b16 (stale) Mirror 12: 0xe0ef0b16 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37faa): Mirror 8: 0xe0ef0b16 (stale) Mirror 9: 0xe0ef0b16 (stale) Mirror 10: 0xe0ef0b16 (stale) Mirror 12: 0xe0ef0b16 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37faa: skipped 000352 1786833477.085777 punch from 0x019863 to 0x02025d (0x69fb bytes) 000353 1786833477.091884 mapread 0x0356f0 thru 0x0362d6 (0xbe7 bytes) 000355 1786833477.107560 mapread 0x00ba9d thru 0x0174ab (0xba0f bytes) 000357 1786833477.129402 punch from 0x0160b7 to 0x01e396 (0x82e0 bytes) 000358 1786833477.135488 fallocate 0x02343e thru 0x028214 (0x4dd7 bytes) 000359 1786833477.141198 mapread 0x01c429 thru 0x023073 (0x6c4b bytes) 000360 1786833477.152141 punch from 0x01fe81 to 0x023313 (0x3493 bytes) 000361 1786833477.157372 trunc from 0x037faa to 0x0094c7 (0x2eae2 bytes) 000362 1786833477.178842 mapread 0x0075a0 thru 0x0094c7 (0x1f28 bytes) 000363 1786833477.180738 punch from 0x0093f8 to 0x0094c7 (0xd0 bytes) 000364 1786833477.191955 punch from 0x004ecd to 0x0094c7 (0x45fb bytes) 000365 1786833477.200246 trunc from 0x0094c8 to 0x00575a (0x3d6d bytes) 000367 1786833477.222796 mapread 0x001df9 thru 0x00575a (0x3962 bytes) 000368 1786833477.237513 fallocate 0x00c43a thru 0x014999 (0x8560 bytes) 000369 1786833477.245807 trunc from 0x012fb3 to 0x014999 (0x19e7 bytes) 000370 1786833477.256362 mapread 0x00d8c3 thru 0x014999 (0x70d7 bytes) 000371 1786833477.273679 mapwrite 0x02017f thru 0x02af6b (0xaded bytes) 000372 1786833477.353494 mapwrite 0x0011c9 thru 0x0022c6 (0x10fe bytes) 000373 1786833477.368467 fallocate 0x03dfd2 thru 0x03ffff (0x202e bytes) 000374 1786833477.373854 mapread 0x00d44f thru 0x017444 (0x9ff6 bytes) 000375 1786833477.387351 MIRROR_RESYNC 5 mirrors 000376 1786833478.835347 mapwrite 0x01cd42 thru 0x029908 (0xcbc7 bytes) 000377 1786833478.975814 punch from 0x012a01 to 0x01fa64 (0xd064 bytes) 000378 1786833478.982712 mapread 0x00f531 thru 0x019128 (0x9bf8 bytes) 000379 1786833479.001029 write 0x036180 thru 0x03fb38 (0x99b9 bytes) 000380 1786833479.012133 fallocate 0x02ce46 thru 0x033cc6 (0x6e81 bytes) 000381 1786833479.016984 mapread 0x031358 thru 0x032f80 (0x1c29 bytes) 000382 1786833479.027916 trunc from 0x021164 to 0x023392 (0x222f bytes) 000383 1786833479.035998 mapwrite 0x029bbc thru 0x032d43 (0x9188 bytes) 000384 1786833479.065467 write 0x03ed8c thru 0x03ffff (0x1274 bytes) 000385 1786833479.069405 read 0x025efe thru 0x03022a (0xa32d bytes) 000386 1786833479.070373 mapread 0x016956 thru 0x020d3a (0xa3e5 bytes) 000387 1786833479.072484 mapwrite 0x018e47 thru 0x01ce88 (0x4042 bytes) 000388 1786833479.096048 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x352a028b (stale) Mirror 10: 0x352a028b (stale) Mirror 12: 0x352a028b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x352a028b (stale) Mirror 10: 0x352a028b (stale) Mirror 12: 0x352a028b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000389 1786833479.468017 trunc from 0x040000 to 0x02df38 (0x120c7 bytes) 000390 1786833479.513147 write 0x0300ff thru 0x035ba2 (0x5aa4 bytes) 000391 1786833479.515547 read 0x011c5d thru 0x01fa15 (0xddb9 bytes) 000392 1786833479.561879 mapwrite 0x00d2a8 thru 0x0142fb (0x7054 bytes) 000393 1786833479.635668 mapread 0x02d3f5 thru 0x035ba2 (0x87ae bytes) 000394 1786833479.649439 read 0x005248 thru 0x0149ed (0xf7a6 bytes) 000395 1786833479.688626 punch from 0x012cec to 0x0179c8 (0x4cdd bytes) 000396 1786833479.700184 punch from 0x002050 to 0x006083 (0x4034 bytes) 000397 1786833479.713402 MIRROR_RESYNC 4 mirrors 000398 1786833481.633243 mapwrite 0x00f20b thru 0x0130e1 (0x3ed7 bytes) 000399 1786833481.763541 trunc from 0x035ba3 to 0x034950 (0x1252 bytes) 000400 1786833481.828800 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x34951): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34951): Mirror 9: 0xaf2a7388 (stale) Mirror 10: 0xaf2a7388 (stale) Mirror 12: 0xaf2a7388 (stale) CRC-32 checksum value for chunk [0, 0x34951): Mirror 1: 0x719a4a95 Mirror 13: 0x719a4a95 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34951: skipped 000401 1786833483.091805 fallocate 0x03a12b thru 0x03ffff (0x5ed5 bytes) 000402 1786833483.134940 punch from 0x03ef35 to 0x03ffff (0x10cb bytes) 000404 1786833483.146488 trunc from 0x040000 to 0x01db47 (0x224b8 bytes) 000405 1786833483.202284 punch from 0x01c11f to 0x01db47 (0x1a29 bytes) 000406 1786833483.214296 mapwrite 0x0379cb thru 0x03ffff (0x8635 bytes) 000408 1786833483.298393 trunc from 0x040000 to 0x010341 (0x2fcbe bytes) 000409 1786833483.325934 trunc from 0x00d82a to 0x010341 (0x2b18 bytes) 000410 1786833483.332218 trunc from 0x010342 to 0x012877 (0x2536 bytes) 000411 1786833483.355815 trunc from 0x012878 to 0x00726b (0xb60c bytes) 000413 1786833483.398157 MIRROR_RESYNC 5 mirrors 000414 1786833484.341440 read 0x004ce6 thru 0x00726b (0x2586 bytes) 000415 1786833484.355419 fallocate 0x0079c2 thru 0x00b7b4 (0x3df3 bytes) 000417 1786833484.434898 trunc from 0x003dd2 to 0x00726b (0x349a bytes) 000418 1786833484.452002 mapread 0x002a76 thru 0x00726b (0x47f6 bytes) 000419 1786833484.487398 trunc from 0x00726c to 0x038c8d (0x31a22 bytes) 000420 1786833484.546995 punch from 0x0096f3 to 0x0100ed (0x69fb bytes) 000421 1786833484.553349 read 0x00ffbe thru 0x01dca6 (0xdce9 bytes) 000422 1786833484.568978 trunc from 0x033091 to 0x038c8d (0x5bfd bytes) 000423 1786833484.574840 trunc from 0x038c8e to 0x017c1e (0x2106f bytes) 000424 1786833484.596877 trunc from 0x017c1f to 0x0368db (0x1ecbd bytes) 000425 1786833484.622800 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x368dc): Mirror 10: 0xf62766a8 (stale) Mirror 12: 0xf62766a8 (stale) Mirror 13: 0xf62766a8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x368dc): Mirror 10: 0xf62766a8 (stale) Mirror 12: 0xf62766a8 (stale) Mirror 13: 0xf62766a8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x368dc: skipped 000426 1786833485.070814 fallocate 0x002045 thru 0x007ae7 (0x5aa3 bytes) 000427 1786833485.090759 punch from 0x015c81 to 0x01b64a (0x59ca bytes) 000428 1786833485.098566 read 0x02c6fb thru 0x035303 (0x8c09 bytes) 000429 1786833485.140086 MIRROR_RESYNC 4 mirrors 000430 1786833486.064069 mapwrite 0x0070d8 thru 0x00a188 (0x30b1 bytes) 000431 1786833486.218150 mapwrite 0x02e58c thru 0x03cf80 (0xe9f5 bytes) 000432 1786833486.298082 trunc from 0x03cf81 to 0x012550 (0x2aa30 bytes) 000433 1786833486.336405 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x12551): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12551): Mirror 10: 0xce1f5442 (stale) Mirror 12: 0xce1f5442 (stale) Mirror 13: 0xce1f5442 (stale) CRC-32 checksum value for chunk [0, 0x12551): Mirror 1: 0x5d7f8a61 Mirror 14: 0x5d7f8a61 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12551: skipped 000434 1786833487.293848 trunc from 0x012551 to 0x00b6de (0x6e72 bytes) 000435 1786833487.350162 trunc from 0x007535 to 0x007e5c (0x928 bytes) 000436 1786833487.354484 write 0x028560 thru 0x02ded8 (0x5979 bytes) 000438 1786833487.358914 MIRROR_RESYNC 5 mirrors 000439 1786833488.692744 trunc from 0x02ded9 to 0x00a124 (0x23db4 bytes) 000440 1786833488.755084 MIRROR_RESYNC 5 mirrors 000441 1786833490.089229 write 0x029d41 thru 0x0390e8 (0xf3a8 bytes) 000442 1786833490.139191 fallocate 0x024394 thru 0x02bfa7 (0x7c14 bytes) 000443 1786833490.147536 write 0x02b54d thru 0x0361e7 (0xac9b bytes) 000445 1786833490.150813 trunc from 0x0390e9 to 0x0304d9 (0x8c0f bytes) 000446 1786833490.191693 mapwrite 0x0089ef thru 0x011b57 (0x9169 bytes) 000447 1786833490.242079 trunc from 0x02e466 to 0x0304d9 (0x2074 bytes) 000448 1786833490.253363 mapread 0x010595 thru 0x018484 (0x7ef0 bytes) 000449 1786833490.272888 mapwrite 0x02a2fb thru 0x039ffc (0xfd02 bytes) 000450 1786833490.366257 mapread 0x018fad thru 0x01fa1e (0x6a72 bytes) 000451 1786833490.389380 trunc from 0x023a9c to 0x024ea2 (0x1407 bytes) 000452 1786833490.409981 write 0x023c29 thru 0x02602e (0x2406 bytes) 000453 1786833490.437114 punch from 0x037fc7 to 0x039ffc (0x2036 bytes) 000454 1786833490.449653 trunc from 0x039ffd to 0x01b8b3 (0x1e749 bytes) 000455 1786833490.510765 trunc from 0x01b8b4 to 0x028731 (0xce7e bytes) 000456 1786833490.584158 read 0x00781b thru 0x00df55 (0x673b bytes) 000457 1786833490.586760 read 0x01f0ff thru 0x0234b6 (0x43b8 bytes) 000458 1786833490.617150 read 0x01d098 thru 0x01e890 (0x17f9 bytes) 000459 1786833490.619255 trunc from 0x028732 to 0x038de1 (0x106b0 bytes) 000460 1786833490.663687 fallocate 0x003cc4 thru 0x00ecd3 (0xb010 bytes) 000461 1786833490.688525 mapread 0x0285e1 thru 0x02b814 (0x3234 bytes) 000462 1786833490.747717 punch from 0x01776f to 0x02563c (0xdece bytes) 000463 1786833490.755384 mapwrite 0x018f41 thru 0x02252c (0x95ec bytes) 000464 1786833490.919264 write 0x001ce2 thru 0x00c36f (0xa68e bytes) 000465 1786833490.921870 write 0x0258d4 thru 0x032a06 (0xd133 bytes) 000466 1786833490.936482 fallocate 0x024823 thru 0x02e76a (0x9f48 bytes) 000468 1786833490.943765 read 0x003d15 thru 0x00603c (0x2328 bytes) 000469 1786833490.953091 write 0x03b310 thru 0x03c609 (0x12fa bytes) 000470 1786833490.954148 trunc from 0x02fc70 to 0x0380f3 (0x8484 bytes) 000471 1786833490.982823 trunc from 0x03c60a to 0x01e34d (0x1e2bc bytes) 000472 1786833491.005880 mapread 0x017aba thru 0x01e34d (0x6894 bytes) 000473 1786833491.016498 fallocate 0x039095 thru 0x03a958 (0x18c4 bytes) 000474 1786833491.023496 fallocate 0x010a15 thru 0x016bc1 (0x61ad bytes) 000475 1786833491.034642 fallocate 0x004e61 thru 0x013314 (0xe4b4 bytes) 000476 1786833491.067392 fallocate 0x0006d6 thru 0x00df3e (0xd869 bytes) 000477 1786833491.093519 mapwrite 0x0270c5 thru 0x02afa8 (0x3ee4 bytes) 000478 1786833491.191301 trunc from 0x02afa9 to 0x0235e4 (0x79c4 bytes) 000479 1786833491.229871 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x235e5): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x235e5): Mirror 10: 0x8423f3e (stale) Mirror 12: 0x8423f3e (stale) Mirror 13: 0x8423f3e (stale) Mirror 14: 0x8423f3e (stale) CRC-32 checksum value for chunk [0, 0x235e5): Mirror 1: 0xd0ad39e Mirror 15: 0xd0ad39e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x235e5: skipped 000481 1786833493.025131 mapwrite 0x03325d thru 0x0370a5 (0x3e49 bytes) 000482 1786833493.227243 fallocate 0x003218 thru 0x0044e4 (0x12cd bytes) 000483 1786833493.237120 punch from 0x0284f3 to 0x0330a8 (0xabb6 bytes) 000484 1786833493.245281 mapread 0x02148a thru 0x022c07 (0x177e bytes) 000485 1786833493.268893 mapread 0x033be8 thru 0x03412a (0x543 bytes) 000486 1786833493.288891 fallocate 0x023bdf thru 0x027cb7 (0x40d9 bytes) 000487 1786833493.297190 punch from 0x017a4f to 0x01a607 (0x2bb9 bytes) 000488 1786833493.306066 fallocate 0x02c0fb thru 0x02d5fb (0x1501 bytes) 000491 1786833493.315244 trunc from 0x02c434 to 0x0337af (0x737c bytes) 000492 1786833493.322044 trunc from 0x01eb72 to 0x023340 (0x47cf bytes) 000493 1786833493.330350 read 0x00c4d9 thru 0x016384 (0x9eac bytes) 000494 1786833493.344379 write 0x02c88c thru 0x035db3 (0x9528 bytes) 000495 1786833493.355468 read 0x0292ec thru 0x0356ab (0xc3c0 bytes) 000496 1786833493.369850 write 0x00c2ab thru 0x0125d4 (0x632a bytes) 000497 1786833493.378133 MIRROR_RESYNC 6 mirrors 000500 1786833495.467710 read 0x02815f thru 0x0370a5 (0xef47 bytes) 000501 1786833495.482421 trunc from 0x030b47 to 0x0370a5 (0x655f bytes) 000502 1786833495.543007 read 0x032df3 thru 0x0370a5 (0x42b3 bytes) 000503 1786833495.567941 trunc from 0x0370a6 to 0x029143 (0xdf62 bytes) 000504 1786833495.599043 write 0x008266 thru 0x00b1f1 (0x2f8c bytes) 000505 1786833495.605107 fallocate 0x007f69 thru 0x00a761 (0x27f9 bytes) 000506 1786833495.612491 mapwrite 0x03877d thru 0x038f37 (0x7bb bytes) 000507 1786833495.666533 fallocate 0x03aff3 thru 0x03ffff (0x500d bytes) 000508 1786833495.673559 punch from 0x038c02 to 0x03ffff (0x73fe bytes) 000510 1786833495.688051 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x9966da99 (stale) Mirror 12: 0x9966da99 (stale) Mirror 13: 0x9966da99 (stale) Mirror 15: 0x9966da99 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x9966da99 (stale) Mirror 12: 0x9966da99 (stale) Mirror 13: 0x9966da99 (stale) Mirror 15: 0x9966da99 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000511 1786833496.389315 punch from 0x03c3ff to 0x03f8b9 (0x34bb bytes) 000512 1786833496.396880 trunc from 0x040000 to 0x02a9af (0x15650 bytes) 000513 1786833496.425573 mapread 0x023a55 thru 0x02a9af (0x6f5b bytes) 000514 1786833496.462936 mapread 0x010309 thru 0x019ca8 (0x99a0 bytes) 000515 1786833496.506537 fallocate 0x03d014 thru 0x03ffff (0x2fec bytes) 000517 1786833496.527724 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a9b0): Mirror 12: 0xcfb8c259 (stale) Mirror 13: 0xcfb8c259 (stale) Mirror 15: 0xcfb8c259 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a9b0): Mirror 12: 0xcfb8c259 (stale) Mirror 13: 0xcfb8c259 (stale) Mirror 15: 0xcfb8c259 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a9b0: skipped 000518 1786833497.059518 write 0x00ea39 thru 0x01a012 (0xb5da bytes) 000519 1786833497.076369 trunc from 0x02a9b0 to 0x024aa7 (0x5f08 bytes) 000520 1786833497.089157 mapread 0x0133f4 thru 0x01866b (0x5278 bytes) 000521 1786833497.090645 trunc from 0x024aa8 to 0x001a34 (0x23073 bytes) 000522 1786833497.114491 punch from 0x00147f to 0x001a34 (0x5b6 bytes) 000524 1786833497.122330 trunc from 0x0008e7 to 0x001a34 (0x114e bytes) 000525 1786833497.128293 mapread 0x000743 thru 0x001a34 (0x12f2 bytes) 000526 1786833497.146255 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1a35): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a35): Mirror 12: 0x9953433c (stale) Mirror 13: 0x9953433c (stale) Mirror 15: 0x9953433c (stale) CRC-32 checksum value for chunk [0, 0x1a35): Mirror 1: 0xa1d880e4 Mirror 16: 0xa1d880e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a35: skipped 000527 1786833497.847274 write 0x02a074 thru 0x02eb6b (0x4af8 bytes) 000529 1786833497.931140 mapread 0x01f177 thru 0x0260bd (0x6f47 bytes) 000530 1786833497.981351 mapwrite 0x02fe8f thru 0x039ea1 (0xa013 bytes) 000531 1786833498.081342 trunc from 0x026c1b to 0x031e9f (0xb285 bytes) 000532 1786833498.088039 fallocate 0x030718 thru 0x03c20d (0xbaf6 bytes) 000533 1786833498.100818 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3c20e): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c20e): Mirror 12: 0x5ef61a08 (stale) Mirror 13: 0x5ef61a08 (stale) Mirror 15: 0x5ef61a08 (stale) Mirror 16: 0x46fbfffe (stale) CRC-32 checksum value for chunk [0, 0x3c20e): Mirror 1: 0xe69d38c8 Mirror 17: 0xe69d38c8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c20e: skipped 000534 1786833499.086361 fallocate 0x029ea2 thru 0x030a72 (0x6bd1 bytes) 000535 1786833499.136737 write 0x01b8f1 thru 0x027ed5 (0xc5e5 bytes) 000536 1786833499.160094 write 0x02f134 thru 0x03c611 (0xd4de bytes) 000538 1786833499.170894 mapread 0x035598 thru 0x03c611 (0x707a bytes) 000539 1786833499.173177 punch from 0x0168d4 to 0x019a99 (0x31c6 bytes) 000540 1786833499.179931 trunc from 0x03c612 to 0x02e30b (0xe306 bytes) 000541 1786833499.235052 read 0x016b05 thru 0x01b25c (0x4758 bytes) 000542 1786833499.243837 punch from 0x0227ac to 0x025cdb (0x3530 bytes) 000543 1786833499.256813 trunc from 0x0086c0 to 0x008e42 (0x783 bytes) 000544 1786833499.261356 write 0x02435d thru 0x02a298 (0x5f3c bytes) 000545 1786833499.277754 punch from 0x02c9de to 0x02e30b (0x192e bytes) 000546 1786833499.282308 write 0x02437a thru 0x031dd9 (0xda60 bytes) 000547 1786833499.286004 trunc from 0x031dda to 0x001dad (0x3002c bytes) 000548 1786833499.308783 write 0x037523 thru 0x03ffff (0x8add bytes) 000549 1786833499.313494 fallocate 0x013745 thru 0x02245b (0xed17 bytes) 000551 1786833499.323271 punch from 0x02c3a4 to 0x036045 (0x9ca2 bytes) 000552 1786833499.332127 read 0x01eef6 thru 0x02b563 (0xc66e bytes) 000553 1786833499.348652 trunc from 0x040000 to 0x00c30a (0x33cf5 bytes) 000554 1786833499.367810 fallocate 0x011416 thru 0x01a66a (0x9255 bytes) 000555 1786833499.374015 trunc from 0x00c30b to 0x00c49f (0x195 bytes) 000556 1786833499.399755 read 0x009c62 thru 0x00a12b (0x4ca bytes) 000557 1786833499.407714 MIRROR_RESYNC 6 mirrors 000558 1786833500.693131 MIRROR_RESYNC 6 mirrors 000559 1786833501.376170 mapwrite 0x0078b6 thru 0x01764f (0xfd9a bytes) 000560 1786833501.533535 mapwrite 0x005409 thru 0x00eb4d (0x9745 bytes) 000561 1786833501.570490 read 0x016efa thru 0x01764f (0x756 bytes) 000562 1786833501.577979 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x17650): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17650): Mirror 12: 0x76604664 (stale) Mirror 13: 0x76604664 (stale) Mirror 15: 0x76604664 (stale) Mirror 16: 0x76604664 (stale) Mirror 17: 0x76604664 (stale) CRC-32 checksum value for chunk [0, 0x17650): Mirror 1: 0x967417ec Mirror 18: 0x967417ec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17650: skipped 000563 1786833502.916731 write 0x024027 thru 0x030449 (0xc423 bytes) 000565 1786833502.972921 write 0x03d5f8 thru 0x03ffff (0x2a08 bytes) 000566 1786833502.974866 trunc from 0x031b64 to 0x03f9f2 (0xde8f bytes) 000567 1786833503.006295 mapwrite 0x0015dd thru 0x00e79a (0xd1be bytes) 000568 1786833503.148006 read 0x00c3dd thru 0x01929f (0xcec3 bytes) 000570 1786833503.179196 fallocate 0x005dac thru 0x00bdfa (0x604f bytes) 000571 1786833503.213023 MIRROR_RESYNC 7 mirrors 000572 1786833504.948791 trunc from 0x026b72 to 0x02c112 (0x55a1 bytes) 000573 1786833504.995266 punch from 0x023bbc to 0x02f92d (0xbd72 bytes) 000574 1786833505.000911 read 0x02cb10 thru 0x03af87 (0xe478 bytes) 000575 1786833505.017467 trunc from 0x00e7a2 to 0x01b296 (0xcaf5 bytes) 000576 1786833505.022501 mapread 0x0038c1 thru 0x007063 (0x37a3 bytes) 000577 1786833505.039346 trunc from 0x018e9a to 0x02793a (0xeaa1 bytes) 000578 1786833505.047562 read 0x02757e thru 0x03662e (0xf0b1 bytes) 000579 1786833505.062383 write 0x007916 thru 0x00ccdc (0x53c7 bytes) 000580 1786833505.064245 trunc from 0x019ac1 to 0x01b26b (0x17ab bytes) 000581 1786833505.072495 trunc from 0x03eb7e to 0x03ffff (0x1482 bytes) 000582 1786833505.081115 mapread 0x01e85e thru 0x02e809 (0xffac bytes) 000583 1786833505.090868 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xfce2cecb (stale) Mirror 13: 0xfce2cecb (stale) Mirror 15: 0xfce2cecb (stale) Mirror 16: 0xfce2cecb (stale) Mirror 17: 0xfce2cecb (stale) Mirror 18: 0xfce2cecb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x29068149 Mirror 19: 0x29068149 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000584 1786833506.324360 mapread 0x02981e thru 0x02b8cf (0x20b2 bytes) 000585 1786833506.405200 read 0x03da7c thru 0x03ffff (0x2584 bytes) 000586 1786833506.428317 write 0x008c0d thru 0x0167c2 (0xdbb6 bytes) 000587 1786833506.517398 mapwrite 0x0310a0 thru 0x03fc96 (0xebf7 bytes) 000588 1786833506.599206 mapread 0x01c1fa thru 0x02838e (0xc195 bytes) 000589 1786833506.646533 read 0x03a7b0 thru 0x03ffff (0x5850 bytes) 000590 1786833506.659117 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xfce2cecb (stale) Mirror 13: 0xfce2cecb (stale) Mirror 15: 0xfce2cecb (stale) Mirror 16: 0xfce2cecb (stale) Mirror 17: 0xfce2cecb (stale) Mirror 18: 0xfce2cecb (stale) Mirror 19: 0x29068149 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd5cfef62 Mirror 20: 0xd5cfef62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000591 1786833508.233573 trunc from 0x040000 to 0x03b778 (0x4887 bytes) 000592 1786833508.298718 read 0x036a69 thru 0x03b778 (0x4d10 bytes) 000593 1786833508.332874 mapread 0x021327 thru 0x023bc9 (0x28a3 bytes) 000595 1786833508.356564 trunc from 0x03b779 to 0x01f28a (0x1c4ee bytes) 000596 1786833508.378995 fallocate 0x00977a thru 0x017db8 (0xe63f bytes) 000597 1786833508.386395 write 0x01f076 thru 0x029157 (0xa0e2 bytes) 000599 1786833508.390434 fallocate 0x01f182 thru 0x0210a6 (0x1f25 bytes) 000600 1786833508.400574 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x29158): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29158): Mirror 12: 0x188a6cea (stale) Mirror 13: 0x188a6cea (stale) Mirror 15: 0x188a6cea (stale) Mirror 16: 0x188a6cea (stale) Mirror 17: 0x188a6cea (stale) Mirror 18: 0x188a6cea (stale) Mirror 19: 0xbbb1a414 (stale) Mirror 20: 0x554fbb2f (stale) CRC-32 checksum value for chunk [0, 0x29158): Mirror 1: 0x558e09d5 Mirror 21: 0x558e09d5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29158: skipped 000601 1786833509.454704 read 0x000324 thru 0x00b489 (0xb166 bytes) 000602 1786833509.477157 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29158): Mirror 12: 0x188a6cea (stale) Mirror 15: 0x188a6cea (stale) Mirror 16: 0x188a6cea (stale) Mirror 17: 0x188a6cea (stale) Mirror 18: 0x188a6cea (stale) Mirror 19: 0xbbb1a414 (stale) Mirror 20: 0x554fbb2f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29158): Mirror 12: 0x188a6cea (stale) Mirror 15: 0x188a6cea (stale) Mirror 16: 0x188a6cea (stale) Mirror 17: 0x188a6cea (stale) Mirror 18: 0x188a6cea (stale) Mirror 19: 0xbbb1a414 (stale) Mirror 20: 0x554fbb2f (stale) CRC-32 checksum value for chunk [0, 0x29158): Mirror 1: 0x558e09d5 Mirror 21: 0x558e09d5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29158: skipped 000603 1786833510.666753 punch from 0x00c6d2 to 0x01c1c7 (0xfaf6 bytes) 000604 1786833510.727704 fallocate 0x0250f2 thru 0x02c70a (0x7619 bytes) 000605 1786833510.738048 trunc from 0x00f371 to 0x01c718 (0xd3a8 bytes) 000606 1786833510.746940 trunc from 0x029158 to 0x00942b (0x1fd2c bytes) 000607 1786833510.848374 read 0x000dc1 thru 0x0048c0 (0x3b00 bytes) 000608 1786833510.860045 mapread 0x00087f thru 0x00942b (0x8bad bytes) 000609 1786833510.887384 mapread 0x004d77 thru 0x008995 (0x3c1f bytes) 000610 1786833510.889456 mapwrite 0x00836c thru 0x00da03 (0x5698 bytes) 000611 1786833510.954473 punch from 0x002bfb to 0x00da03 (0xae09 bytes) 000613 1786833510.964379 trunc from 0x00da04 to 0x00c875 (0x118e bytes) 000614 1786833510.988012 mapwrite 0x00e115 thru 0x017063 (0x8f4f bytes) 000616 1786833511.092167 MIRROR_RESYNC 9 mirrors 000618 1786833512.768353 write 0x020a96 thru 0x028bf1 (0x815c bytes) 000619 1786833512.816441 read 0x002a2e thru 0x00fe0f (0xd3e2 bytes) 000620 1786833512.842855 mapwrite 0x03f461 thru 0x03f670 (0x210 bytes) 000621 1786833512.956079 mapread 0x02314c thru 0x02d26d (0xa122 bytes) 000622 1786833512.973635 read 0x02df49 thru 0x033803 (0x58bb bytes) 000623 1786833512.987227 fallocate 0x020420 thru 0x02384e (0x342f bytes) 000624 1786833512.993384 read 0x0301fd thru 0x036207 (0x600b bytes) 000625 1786833512.995584 mapread 0x0199f3 thru 0x023763 (0x9d71 bytes) 000626 1786833512.997501 fallocate 0x009d0e thru 0x00b856 (0x1b49 bytes) 000627 1786833513.003148 punch from 0x03d811 to 0x03f670 (0x1e60 bytes) 000628 1786833513.009387 mapread 0x0019aa thru 0x006a27 (0x507e bytes) 000629 1786833513.021363 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3f671): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f671): Mirror 12: 0xac6386b (stale) Mirror 15: 0xac6386b (stale) Mirror 16: 0xac6386b (stale) Mirror 17: 0xac6386b (stale) Mirror 18: 0xac6386b (stale) Mirror 19: 0xac6386b (stale) Mirror 20: 0xac6386b (stale) Mirror 21: 0xac6386b (stale) CRC-32 checksum value for chunk [0, 0x3f671): Mirror 1: 0xaf0b6d94 Mirror 22: 0xaf0b6d94 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f671: skipped 000630 1786833514.218200 punch from 0x01ba66 to 0x01f865 (0x3e00 bytes) 000632 1786833514.288514 fallocate 0x01a1ef thru 0x026813 (0xc625 bytes) 000633 1786833514.299199 mapread 0x02178a thru 0x0260ee (0x4965 bytes) 000634 1786833514.327853 mapwrite 0x01a170 thru 0x0281ae (0xe03f bytes) 000635 1786833514.359800 write 0x01eb5f thru 0x01f399 (0x83b bytes) 000636 1786833514.367287 mapwrite 0x03a205 thru 0x03fd3a (0x5b36 bytes) 000637 1786833514.457477 punch from 0x011e53 to 0x016a51 (0x4bff bytes) 000638 1786833514.464619 punch from 0x000d7f to 0x00ff4d (0xf1cf bytes) 000639 1786833514.470451 punch from 0x0358cc to 0x03c5e7 (0x6d1c bytes) 000640 1786833514.485410 mapread 0x02993c thru 0x029ae1 (0x1a6 bytes) 000641 1786833514.490526 punch from 0x02a84f to 0x034f7e (0xa730 bytes) 000642 1786833514.499534 mapread 0x0010f4 thru 0x00d567 (0xc474 bytes) 000644 1786833514.524142 trunc from 0x00da44 to 0x017de7 (0xa3a4 bytes) 000645 1786833514.537264 write 0x03f19c thru 0x03ffff (0xe64 bytes) 000646 1786833514.538523 write 0x017076 thru 0x0197bf (0x274a bytes) 000647 1786833514.545470 read 0x030a57 thru 0x03b9d2 (0xaf7c bytes) 000648 1786833514.586544 write 0x006393 thru 0x00ebc3 (0x8831 bytes) 000649 1786833514.603831 MIRROR_RESYNC 10 mirrors 000650 1786833517.827373 trunc from 0x034ce5 to 0x03a156 (0x5472 bytes) 000651 1786833517.909802 MIRROR_RESYNC 10 mirrors 000652 1786833520.498890 fallocate 0x038785 thru 0x03ffff (0x787b bytes) 000654 1786833520.571387 fallocate 0x0274e4 thru 0x02a8be (0x33db bytes) 000655 1786833520.596853 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xbde95f70 (stale) Mirror 15: 0xbde95f70 (stale) Mirror 16: 0xbde95f70 (stale) Mirror 17: 0xbde95f70 (stale) Mirror 18: 0xbde95f70 (stale) Mirror 19: 0xbde95f70 (stale) Mirror 20: 0xbde95f70 (stale) Mirror 21: 0xbde95f70 (stale) Mirror 22: 0xbde95f70 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbde95f70 Mirror 23: 0xbde95f70 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000656 1786833522.397572 mapread 0x005fe4 thru 0x010daf (0xadcc bytes) 000657 1786833522.447440 mapread 0x014eb4 thru 0x0174e4 (0x2631 bytes) 000658 1786833522.485748 trunc from 0x040000 to 0x031636 (0xe9c9 bytes) 000659 1786833522.572805 trunc from 0x031637 to 0x027f0e (0x9728 bytes) 000660 1786833522.621780 mapwrite 0x010e95 thru 0x01c60d (0xb779 bytes) 000661 1786833522.716853 write 0x03c97e thru 0x03e5bb (0x1c3e bytes) 000662 1786833522.722332 fallocate 0x0188c1 thru 0x02577d (0xcebd bytes) 000663 1786833522.733740 fallocate 0x02ee33 thru 0x035375 (0x6543 bytes) 000665 1786833522.745562 mapwrite 0x02cadc thru 0x03c7d2 (0xfcf7 bytes) 000666 1786833522.790803 trunc from 0x01d48a to 0x028103 (0xac7a bytes) 000668 1786833522.808697 fallocate 0x028439 thru 0x02dd57 (0x591f bytes) 000669 1786833522.817966 write 0x00cb9e thru 0x0156fc (0x8b5f bytes) 000670 1786833522.819303 write 0x013e7a thru 0x0238a6 (0xfa2d bytes) 000671 1786833522.832180 fallocate 0x0038ef thru 0x00dfc8 (0xa6da bytes) 000672 1786833522.841996 mapwrite 0x01d2a1 thru 0x01ff67 (0x2cc7 bytes) 000673 1786833522.875445 write 0x02f182 thru 0x032c60 (0x3adf bytes) 000674 1786833522.884888 read 0x035386 thru 0x03e5bb (0x9236 bytes) 000675 1786833522.886243 mapwrite 0x001242 thru 0x00ef96 (0xdd55 bytes) 000676 1786833522.944451 fallocate 0x02a75a thru 0x034b21 (0xa3c8 bytes) 000677 1786833522.962774 punch from 0x003cad to 0x00c64f (0x89a3 bytes) 000678 1786833522.981882 write 0x0172f8 thru 0x01fe5b (0x8b64 bytes) 000679 1786833522.988615 trunc from 0x03e5bc to 0x035f88 (0x8633 bytes) 000680 1786833523.022503 mapwrite 0x029cfd thru 0x034e1a (0xb11e bytes) 000681 1786833523.078746 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35f89): Mirror 15: 0x2b79dca5 (stale) Mirror 16: 0x2b79dca5 (stale) Mirror 17: 0x2b79dca5 (stale) Mirror 18: 0x2b79dca5 (stale) Mirror 19: 0x2b79dca5 (stale) Mirror 20: 0x2b79dca5 (stale) Mirror 21: 0x2b79dca5 (stale) Mirror 22: 0x2b79dca5 (stale) Mirror 23: 0x2b79dca5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35f89): Mirror 15: 0x2b79dca5 (stale) Mirror 16: 0x2b79dca5 (stale) Mirror 17: 0x2b79dca5 (stale) Mirror 18: 0x2b79dca5 (stale) Mirror 19: 0x2b79dca5 (stale) Mirror 20: 0x2b79dca5 (stale) Mirror 21: 0x2b79dca5 (stale) Mirror 22: 0x2b79dca5 (stale) Mirror 23: 0x2b79dca5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35f89: skipped 000683 1786833523.983777 punch from 0x00c3fe to 0x012f3a (0x6b3d bytes) 000684 1786833523.992285 trunc from 0x035f89 to 0x02c6d6 (0x98b2 bytes) 000685 1786833524.028508 mapwrite 0x001428 thru 0x0085a1 (0x717a bytes) 000686 1786833524.098584 mapwrite 0x0337f9 thru 0x03ffff (0xc807 bytes) 000687 1786833524.257194 mapwrite 0x003f50 thru 0x00e422 (0xa4d3 bytes) 000688 1786833524.292762 mapread 0x034120 thru 0x03fb4b (0xba2c bytes) 000689 1786833524.294037 trunc from 0x020e89 to 0x0307bc (0xf934 bytes) 000691 1786833524.310421 trunc from 0x040000 to 0x0361d8 (0x9e27 bytes) 000692 1786833524.332864 trunc from 0x014788 to 0x01cb80 (0x83f9 bytes) 000694 1786833524.343752 write 0x0270d4 thru 0x0318ce (0xa7fb bytes) 000695 1786833524.353771 read 0x009a39 thru 0x01414b (0xa713 bytes) 000696 1786833524.364149 read 0x0290b2 thru 0x032213 (0x9162 bytes) 000697 1786833524.364904 mapwrite 0x013e3c thru 0x0209cf (0xcb94 bytes) 000698 1786833524.408377 read 0x000658 thru 0x00eb03 (0xe4ac bytes) 000699 1786833524.409563 mapwrite 0x0324f8 thru 0x0331bd (0xcc6 bytes) 000700 1786833524.428019 trunc from 0x0361d9 to 0x021bac (0x1462c bytes) 000701 1786833524.446894 read 0x0138ab thru 0x01d387 (0x9add bytes) 000702 1786833524.450271 fallocate 0x00dbff thru 0x015830 (0x7c32 bytes) 000703 1786833524.458433 trunc from 0x021bad to 0x01e6fd (0x34af bytes) 000704 1786833524.480777 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e6fe): Mirror 15: 0x5695fbca (stale) Mirror 16: 0x5695fbca (stale) Mirror 17: 0x5695fbca (stale) Mirror 18: 0x5695fbca (stale) Mirror 20: 0x5695fbca (stale) Mirror 21: 0x5695fbca (stale) Mirror 22: 0x5695fbca (stale) Mirror 23: 0x5695fbca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e6fe): Mirror 15: 0x5695fbca (stale) Mirror 16: 0x5695fbca (stale) Mirror 17: 0x5695fbca (stale) Mirror 18: 0x5695fbca (stale) Mirror 20: 0x5695fbca (stale) Mirror 21: 0x5695fbca (stale) Mirror 22: 0x5695fbca (stale) Mirror 23: 0x5695fbca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e6fe: skipped 000705 1786833525.216250 write 0x03ed20 thru 0x03ffff (0x12e0 bytes) 000706 1786833525.227678 read 0x01b644 thru 0x026708 (0xb0c5 bytes) 000707 1786833525.241811 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xbde95f70 (stale) Mirror 16: 0xbde95f70 (stale) Mirror 17: 0xbde95f70 (stale) Mirror 20: 0xbde95f70 (stale) Mirror 21: 0xbde95f70 (stale) Mirror 22: 0xbde95f70 (stale) Mirror 23: 0xbde95f70 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xbde95f70 (stale) Mirror 16: 0xbde95f70 (stale) Mirror 17: 0xbde95f70 (stale) Mirror 20: 0xbde95f70 (stale) Mirror 21: 0xbde95f70 (stale) Mirror 22: 0xbde95f70 (stale) Mirror 23: 0xbde95f70 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000708 1786833525.964975 write 0x015290 thru 0x01ca3f (0x77b0 bytes) 000709 1786833526.006491 trunc from 0x0059e0 to 0x012cf1 (0xd312 bytes) 000710 1786833526.014323 read 0x019cf6 thru 0x01a526 (0x831 bytes) 000711 1786833526.015272 mapwrite 0x00b4f5 thru 0x0124f6 (0x7002 bytes) 000712 1786833526.076186 mapwrite 0x009e4c thru 0x014505 (0xa6ba bytes) 000713 1786833526.100976 trunc from 0x0347bb to 0x038c25 (0x446b bytes) 000714 1786833526.108041 mapwrite 0x02df1a thru 0x0338d6 (0x59bd bytes) 000715 1786833526.149436 mapwrite 0x0142c9 thru 0x015894 (0x15cc bytes) 000718 1786833526.173515 trunc from 0x004080 to 0x00e7dd (0xa75e bytes) 000719 1786833526.185586 mapwrite 0x03533f thru 0x03619e (0xe60 bytes) 000720 1786833526.235481 mapwrite 0x01ea82 thru 0x0229cf (0x3f4e bytes) 000721 1786833526.283221 fallocate 0x03aaf5 thru 0x03ffff (0x550b bytes) 000722 1786833526.291019 mapread 0x01db9c thru 0x01fe5c (0x22c1 bytes) 000723 1786833526.292333 mapwrite 0x03d4d7 thru 0x03ffff (0x2b29 bytes) 000724 1786833526.322960 punch from 0x012935 to 0x017575 (0x4c41 bytes) 000725 1786833526.334028 punch from 0x024cac to 0x033b9a (0xeeef bytes) 000726 1786833526.346044 fallocate 0x003520 thru 0x005868 (0x2349 bytes) 000727 1786833526.355036 punch from 0x038a01 to 0x03ffff (0x75ff bytes) 000728 1786833526.367741 punch from 0x0158a3 to 0x01b8e8 (0x6046 bytes) 000729 1786833526.377452 trunc from 0x040000 to 0x021728 (0x1e8d7 bytes) 000730 1786833526.407410 write 0x039787 thru 0x03c3fa (0x2c74 bytes) 000731 1786833526.408749 trunc from 0x037cdc to 0x03c3fa (0x471f bytes) 000732 1786833526.427448 trunc from 0x03c3fb to 0x01cf22 (0x1f4d8 bytes) 000733 1786833526.463752 read 0x0007a2 thru 0x002435 (0x1c94 bytes) 000734 1786833526.486468 mapwrite 0x0183c6 thru 0x020ca6 (0x88e1 bytes) 000735 1786833526.570879 read 0x01374d thru 0x01d3a8 (0x9c5c bytes) 000736 1786833526.571895 trunc from 0x01e71a to 0x020ca6 (0x258d bytes) 000737 1786833526.582185 read 0x001f25 thru 0x010ad9 (0xebb5 bytes) 000738 1786833526.583093 read 0x015aab thru 0x020ca6 (0xb1fc bytes) 000739 1786833526.608727 punch from 0x0124cf to 0x0165e5 (0x4117 bytes) 000740 1786833526.634933 fallocate 0x01b25a thru 0x025721 (0xa4c8 bytes) 000741 1786833526.644939 trunc from 0x01dc38 to 0x020ca6 (0x306f bytes) 000742 1786833526.662790 mapwrite 0x0183aa thru 0x01eb02 (0x6759 bytes) 000743 1786833526.750835 trunc from 0x020ca7 to 0x0021ad (0x1eaf9 bytes) 000744 1786833526.780794 punch from 0x001079 to 0x0021ad (0x1135 bytes) 000745 1786833526.803423 fallocate 0x016c83 thru 0x022eb2 (0xc230 bytes) 000746 1786833526.821665 write 0x02e7bf thru 0x030b10 (0x2352 bytes) 000747 1786833526.830480 MIRROR_RESYNC 8 mirrors 000748 1786833528.081298 fallocate 0x027a08 thru 0x031ed9 (0xa4d2 bytes) 000749 1786833528.132186 mapwrite 0x00bcc6 thru 0x012080 (0x63bb bytes) 000750 1786833528.192351 mapwrite 0x00459c thru 0x00c62a (0x808f bytes) 000752 1786833528.230438 mapread 0x00e3dc thru 0x014673 (0x6298 bytes) 000753 1786833528.232422 trunc from 0x003eba to 0x01082f (0xc976 bytes) 000754 1786833528.239191 fallocate 0x0398ae thru 0x03ffff (0x6752 bytes) 000755 1786833528.244513 write 0x0152fc thru 0x01cc9a (0x799f bytes) 000756 1786833528.250488 trunc from 0x031eda to 0x012224 (0x1fcb5 bytes) 000757 1786833528.284141 MIRROR_RESYNC 8 mirrors 000758 1786833529.553229 read 0x011b27 thru 0x012224 (0x6fe bytes) 000759 1786833529.560737 trunc from 0x012225 to 0x01f5c9 (0xd3a5 bytes) 000760 1786833529.616312 mapread 0x013dda thru 0x01f5c9 (0xb7f0 bytes) 000761 1786833529.667855 fallocate 0x01edb9 thru 0x023774 (0x49bc bytes) 000762 1786833529.685103 read 0x021450 thru 0x023774 (0x2325 bytes) 000763 1786833529.719984 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x23775): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23775): Mirror 15: 0xed33481f (stale) Mirror 16: 0xed33481f (stale) Mirror 17: 0xed33481f (stale) Mirror 20: 0xed33481f (stale) Mirror 21: 0xed33481f (stale) Mirror 22: 0xed33481f (stale) Mirror 23: 0xed33481f (stale) CRC-32 checksum value for chunk [0, 0x23775): Mirror 1: 0xed33481f Mirror 24: 0xed33481f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23775: skipped 000764 1786833531.031466 read 0x01f3f6 thru 0x023774 (0x437f bytes) 000765 1786833531.068372 mapwrite 0x018795 thru 0x023275 (0xaae1 bytes) 000766 1786833531.304250 mapread 0x02299d thru 0x023774 (0xdd8 bytes) 000767 1786833531.310341 write 0x02bbfd thru 0x03b506 (0xf90a bytes) 000768 1786833531.321340 read 0x01f25b thru 0x023d4d (0x4af3 bytes) 000769 1786833531.322210 mapread 0x016715 thru 0x01f81c (0x9108 bytes) 000770 1786833531.327558 write 0x0354af thru 0x03bd01 (0x6853 bytes) 000771 1786833531.331503 fallocate 0x015f7a thru 0x01b9ca (0x5a51 bytes) 000772 1786833531.354562 read 0x034e79 thru 0x03a2ab (0x5433 bytes) 000773 1786833531.362516 trunc from 0x02a827 to 0x036a46 (0xc220 bytes) 000775 1786833531.392189 trunc from 0x017c4f to 0x021a64 (0x9e16 bytes) 000776 1786833531.428649 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3bd02): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd02): Mirror 15: 0x63d1344b (stale) Mirror 16: 0x63d1344b (stale) Mirror 17: 0x63d1344b (stale) Mirror 20: 0x63d1344b (stale) Mirror 21: 0x63d1344b (stale) Mirror 22: 0x63d1344b (stale) Mirror 23: 0x63d1344b (stale) Mirror 24: 0x63d1344b (stale) CRC-32 checksum value for chunk [0, 0x3bd02): Mirror 1: 0x82575fbb Mirror 25: 0x82575fbb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd02: skipped 000777 1786833532.836202 trunc from 0x00cb41 to 0x0172f2 (0xa7b2 bytes) 000778 1786833532.874099 fallocate 0x037d94 thru 0x03ffff (0x826c bytes) 000779 1786833532.880533 read 0x037c0d thru 0x037c5e (0x52 bytes) 000780 1786833532.887815 trunc from 0x040000 to 0x025f90 (0x1a06f bytes) 000781 1786833532.939335 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x25f91): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25f91): Mirror 15: 0x335f5b26 (stale) Mirror 16: 0x335f5b26 (stale) Mirror 17: 0x335f5b26 (stale) Mirror 20: 0x335f5b26 (stale) Mirror 21: 0x335f5b26 (stale) Mirror 22: 0x335f5b26 (stale) Mirror 23: 0x335f5b26 (stale) Mirror 24: 0x335f5b26 (stale) Mirror 25: 0xafd72fa0 (stale) CRC-32 checksum value for chunk [0, 0x25f91): Mirror 1: 0xbc73e2d5 Mirror 26: 0xbc73e2d5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25f91: skipped 000782 1786833534.395310 mapread 0x0035da thru 0x012918 (0xf33f bytes) 000784 1786833534.451413 read 0x00c70a thru 0x00f1a6 (0x2a9d bytes) 000786 1786833534.470169 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x25f91): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25f91): Mirror 15: 0x335f5b26 (stale) Mirror 16: 0x335f5b26 (stale) Mirror 17: 0x335f5b26 (stale) Mirror 20: 0x335f5b26 (stale) Mirror 21: 0x335f5b26 (stale) Mirror 22: 0x335f5b26 (stale) Mirror 23: 0x335f5b26 (stale) Mirror 24: 0x335f5b26 (stale) Mirror 25: 0xafd72fa0 (stale) CRC-32 checksum value for chunk [0, 0x25f91): Mirror 1: 0xbc73e2d5 Mirror 26: 0xbc73e2d5 Mirror 27: 0xbc73e2d5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25f91: skipped 000787 1786833535.634447 fallocate 0x03488e thru 0x03ffff (0xb772 bytes) 000788 1786833535.693751 fallocate 0x01969e thru 0x01b5df (0x1f42 bytes) 000789 1786833535.703815 trunc from 0x040000 to 0x030d6c (0xf293 bytes) 000790 1786833535.738026 read 0x024e63 thru 0x02656b (0x1709 bytes) 000791 1786833535.745017 write 0x012c8c thru 0x01f524 (0xc899 bytes) 000792 1786833535.755074 fallocate 0x02e332 thru 0x030d0d (0x29dc bytes) 000793 1786833535.760070 trunc from 0x030d6d to 0x01aeae (0x15ebe bytes) 000794 1786833535.777033 read 0x0145ac thru 0x0164f3 (0x1f48 bytes) 000797 1786833535.781170 punch from 0x00c5c4 to 0x00db88 (0x15c5 bytes) 000798 1786833535.786521 trunc from 0x01add6 to 0x01aeae (0xd9 bytes) 000800 1786833535.801332 trunc from 0x01aeaf to 0x0229a5 (0x7af7 bytes) 000801 1786833535.819148 fallocate 0x0105e3 thru 0x016a75 (0x6493 bytes) 000802 1786833535.824315 trunc from 0x0229a6 to 0x01863e (0xa367 bytes) 000803 1786833535.848936 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x1863f): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1863f): Mirror 15: 0xc4fd3848 (stale) Mirror 16: 0xc4fd3848 (stale) Mirror 17: 0xc4fd3848 (stale) Mirror 20: 0xc4fd3848 (stale) Mirror 21: 0xc4fd3848 (stale) Mirror 22: 0xc4fd3848 (stale) Mirror 23: 0xc4fd3848 (stale) Mirror 24: 0xc4fd3848 (stale) Mirror 25: 0xc4fd3848 (stale) Mirror 26: 0xc219e894 (stale) Mirror 27: 0xc219e894 (stale) CRC-32 checksum value for chunk [0, 0x1863f): Mirror 1: 0x8ab6cacd Mirror 28: 0x8ab6cacd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1863f: skipped 000804 1786833537.175157 read 0x002a00 thru 0x00ed25 (0xc326 bytes) 000805 1786833537.224464 trunc from 0x018452 to 0x01863e (0x1ed bytes) 000806 1786833537.330965 read 0x004e3f thru 0x005104 (0x2c6 bytes) 000807 1786833537.343758 fallocate 0x00099b thru 0x00fb17 (0xf17d bytes) 000808 1786833537.350291 punch from 0x000095 to 0x0039c1 (0x392d bytes) 000809 1786833537.356628 fallocate 0x03ea17 thru 0x03ffff (0x15e9 bytes) 000810 1786833537.362256 punch from 0x008d91 to 0x0147a1 (0xba11 bytes) 000811 1786833537.375477 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1863f): Mirror 15: 0xc4fd3848 (stale) Mirror 16: 0xc4fd3848 (stale) Mirror 17: 0xc4fd3848 (stale) Mirror 21: 0xc4fd3848 (stale) Mirror 22: 0xc4fd3848 (stale) Mirror 23: 0xc4fd3848 (stale) Mirror 24: 0xc4fd3848 (stale) Mirror 25: 0xc4fd3848 (stale) Mirror 26: 0xc219e894 (stale) Mirror 27: 0xc219e894 (stale) Mirror 28: 0x8ab6cacd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1863f): Mirror 15: 0xc4fd3848 (stale) Mirror 16: 0xc4fd3848 (stale) Mirror 17: 0xc4fd3848 (stale) Mirror 21: 0xc4fd3848 (stale) Mirror 22: 0xc4fd3848 (stale) Mirror 23: 0xc4fd3848 (stale) Mirror 24: 0xc4fd3848 (stale) Mirror 25: 0xc4fd3848 (stale) Mirror 26: 0xc219e894 (stale) Mirror 27: 0xc219e894 (stale) Mirror 28: 0x8ab6cacd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1863f: skipped 000812 1786833538.125253 punch from 0x0045cb to 0x0140bb (0xfaf1 bytes) 000814 1786833538.133436 mapread 0x00887f thru 0x00a502 (0x1c84 bytes) 000815 1786833538.153977 trunc from 0x00831a to 0x0139ba (0xb6a1 bytes) 000817 1786833538.161233 trunc from 0x01863f to 0x0188c0 (0x282 bytes) 000818 1786833538.186324 mapwrite 0x013c27 thru 0x01c1ef (0x85c9 bytes) 000819 1786833538.247453 mapwrite 0x004a71 thru 0x00f354 (0xa8e4 bytes) 000820 1786833538.290357 MIRROR_RESYNC 12 mirrors 000821 1786833541.180733 trunc from 0x017b62 to 0x01c1ef (0x468e bytes) 000822 1786833541.230502 MIRROR_RESYNC 12 mirrors 000823 1786833544.734704 punch from 0x001e6a to 0x00ee51 (0xcfe8 bytes) 000824 1786833544.796322 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c1f0): Mirror 16: 0xa8248c72 (stale) Mirror 17: 0xa8248c72 (stale) Mirror 21: 0xa8248c72 (stale) Mirror 22: 0xa8248c72 (stale) Mirror 23: 0xa8248c72 (stale) Mirror 24: 0xa8248c72 (stale) Mirror 25: 0xa8248c72 (stale) Mirror 26: 0xa8248c72 (stale) Mirror 27: 0xa8248c72 (stale) Mirror 28: 0xa8248c72 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c1f0): Mirror 16: 0xa8248c72 (stale) Mirror 17: 0xa8248c72 (stale) Mirror 21: 0xa8248c72 (stale) Mirror 22: 0xa8248c72 (stale) Mirror 23: 0xa8248c72 (stale) Mirror 24: 0xa8248c72 (stale) Mirror 25: 0xa8248c72 (stale) Mirror 26: 0xa8248c72 (stale) Mirror 27: 0xa8248c72 (stale) Mirror 28: 0xa8248c72 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c1f0: skipped 000825 1786833545.639426 punch from 0x01212c to 0x01c1ef (0xa0c4 bytes) 000826 1786833545.646336 punch from 0x011d5e to 0x01c1ef (0xa492 bytes) 000827 1786833545.658756 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x1c1f0): Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c1f0): Mirror 16: 0xa8248c72 (stale) Mirror 17: 0xa8248c72 (stale) Mirror 21: 0xa8248c72 (stale) Mirror 22: 0xa8248c72 (stale) Mirror 23: 0xa8248c72 (stale) Mirror 24: 0xa8248c72 (stale) Mirror 25: 0xa8248c72 (stale) Mirror 26: 0xa8248c72 (stale) Mirror 27: 0xa8248c72 (stale) Mirror 28: 0xa8248c72 (stale) CRC-32 checksum value for chunk [0, 0x1c1f0): Mirror 1: 0xda5f6fbd Mirror 29: 0xda5f6fbd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c1f0: skipped 000828 1786833546.834796 write 0x00b238 thru 0x01ad98 (0xfb61 bytes) 000829 1786833546.895950 mapwrite 0x030fe4 thru 0x038044 (0x7061 bytes) 000830 1786833546.972335 trunc from 0x0064cd to 0x010413 (0x9f47 bytes) 000832 1786833546.981478 trunc from 0x038045 to 0x01119a (0x26eaa bytes) 000833 1786833546.997972 trunc from 0x01119b to 0x03703e (0x25ea4 bytes) 000834 1786833547.021668 trunc from 0x01d5b4 to 0x020705 (0x3152 bytes) 000835 1786833547.027484 mapwrite 0x0139e0 thru 0x018524 (0x4b45 bytes) 000836 1786833547.060097 write 0x035797 thru 0x036251 (0xabb bytes) 000838 1786833547.072227 write 0x002831 thru 0x01271b (0xfeeb bytes) 000839 1786833547.078182 punch from 0x02cb1c to 0x03703e (0xa523 bytes) 000840 1786833547.101254 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3703f): Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3703f): Mirror 16: 0x1e8c2cfd (stale) Mirror 17: 0x1e8c2cfd (stale) Mirror 21: 0x1e8c2cfd (stale) Mirror 22: 0x1e8c2cfd (stale) Mirror 23: 0x1e8c2cfd (stale) Mirror 24: 0x1e8c2cfd (stale) Mirror 25: 0x1e8c2cfd (stale) Mirror 26: 0x1e8c2cfd (stale) Mirror 27: 0x1e8c2cfd (stale) Mirror 28: 0x1e8c2cfd (stale) Mirror 29: 0x545594db (stale) CRC-32 checksum value for chunk [0, 0x3703f): Mirror 1: 0x294590e7 Mirror 30: 0x294590e7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3703f: skipped 000841 1786833548.274955 punch from 0x021b79 to 0x030cd7 (0xf15f bytes) 000842 1786833548.346410 MIRROR_SPLIT mirror 3 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3703f): Mirror 16: 0x1e8c2cfd (stale) Mirror 17: 0x1e8c2cfd (stale) Mirror 22: 0x1e8c2cfd (stale) Mirror 23: 0x1e8c2cfd (stale) Mirror 24: 0x1e8c2cfd (stale) Mirror 25: 0x1e8c2cfd (stale) Mirror 26: 0x1e8c2cfd (stale) Mirror 27: 0x1e8c2cfd (stale) Mirror 28: 0x1e8c2cfd (stale) Mirror 29: 0x545594db (stale) Mirror 30: 0x294590e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3703f): Mirror 16: 0x1e8c2cfd (stale) Mirror 17: 0x1e8c2cfd (stale) Mirror 22: 0x1e8c2cfd (stale) Mirror 23: 0x1e8c2cfd (stale) Mirror 24: 0x1e8c2cfd (stale) Mirror 25: 0x1e8c2cfd (stale) Mirror 26: 0x1e8c2cfd (stale) Mirror 27: 0x1e8c2cfd (stale) Mirror 28: 0x1e8c2cfd (stale) Mirror 29: 0x545594db (stale) Mirror 30: 0x294590e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3703f: skipped 000843 1786833549.042454 fallocate 0x014ad7 thru 0x019707 (0x4c31 bytes) 000844 1786833549.050828 write 0x020713 thru 0x0297d8 (0x90c6 bytes) 000845 1786833549.079668 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3703f): Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3703f): Mirror 16: 0x1e8c2cfd (stale) Mirror 17: 0x1e8c2cfd (stale) Mirror 22: 0x1e8c2cfd (stale) Mirror 23: 0x1e8c2cfd (stale) Mirror 24: 0x1e8c2cfd (stale) Mirror 25: 0x1e8c2cfd (stale) Mirror 26: 0x1e8c2cfd (stale) Mirror 27: 0x1e8c2cfd (stale) Mirror 28: 0x1e8c2cfd (stale) Mirror 29: 0x545594db (stale) Mirror 30: 0x294590e7 (stale) CRC-32 checksum value for chunk [0, 0x3703f): Mirror 1: 0xc1e1ded9 Mirror 31: 0xc1e1ded9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3703f: skipped 000846 1786833550.753118 trunc from 0x018834 to 0x019a4e (0x121b bytes) 000847 1786833550.834499 MIRROR_SPLIT mirror 8 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3703f): Mirror 16: 0x1e8c2cfd (stale) Mirror 17: 0x1e8c2cfd (stale) Mirror 22: 0x1e8c2cfd (stale) Mirror 23: 0x1e8c2cfd (stale) Mirror 24: 0x1e8c2cfd (stale) Mirror 25: 0x1e8c2cfd (stale) Mirror 26: 0x1e8c2cfd (stale) Mirror 28: 0x1e8c2cfd (stale) Mirror 29: 0x545594db (stale) Mirror 30: 0x294590e7 (stale) Mirror 31: 0xc1e1ded9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3703f): Mirror 16: 0x1e8c2cfd (stale) Mirror 17: 0x1e8c2cfd (stale) Mirror 22: 0x1e8c2cfd (stale) Mirror 23: 0x1e8c2cfd (stale) Mirror 24: 0x1e8c2cfd (stale) Mirror 25: 0x1e8c2cfd (stale) Mirror 26: 0x1e8c2cfd (stale) Mirror 28: 0x1e8c2cfd (stale) Mirror 29: 0x545594db (stale) Mirror 30: 0x294590e7 (stale) Mirror 31: 0xc1e1ded9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3703f: skipped 000848 1786833551.611516 trunc from 0x03703f to 0x03c202 (0x51c4 bytes) 000849 1786833551.633682 mapwrite 0x0135a5 thru 0x019935 (0x6391 bytes) 000851 1786833551.680128 punch from 0x0210c1 to 0x02931c (0x825c bytes) 000852 1786833551.687223 mapwrite 0x033a57 thru 0x03ffff (0xc5a9 bytes) 000853 1786833551.763817 punch from 0x021927 to 0x023dd0 (0x24aa bytes) 000854 1786833551.776554 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x2e75c4b (stale) Mirror 17: 0x2e75c4b (stale) Mirror 22: 0x2e75c4b (stale) Mirror 23: 0x2e75c4b (stale) Mirror 24: 0x2e75c4b (stale) Mirror 26: 0x2e75c4b (stale) Mirror 28: 0x2e75c4b (stale) Mirror 29: 0xe23eb6cf (stale) Mirror 30: 0x4a069678 (stale) Mirror 31: 0x1ac77c06 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x2e75c4b (stale) Mirror 17: 0x2e75c4b (stale) Mirror 22: 0x2e75c4b (stale) Mirror 23: 0x2e75c4b (stale) Mirror 24: 0x2e75c4b (stale) Mirror 26: 0x2e75c4b (stale) Mirror 28: 0x2e75c4b (stale) Mirror 29: 0xe23eb6cf (stale) Mirror 30: 0x4a069678 (stale) Mirror 31: 0x1ac77c06 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000855 1786833552.417338 mapread 0x03b035 thru 0x03ffff (0x4fcb bytes) 000856 1786833552.450616 punch from 0x02dd70 to 0x02e081 (0x312 bytes) 000857 1786833552.458038 write 0x01dfd2 thru 0x02bef4 (0xdf23 bytes) 000859 1786833552.482764 fallocate 0x01e0d4 thru 0x0278c8 (0x97f5 bytes) 000860 1786833552.490715 trunc from 0x02af19 to 0x0329ef (0x7ad7 bytes) 000861 1786833552.517079 write 0x02e171 thru 0x03804a (0x9eda bytes) 000862 1786833552.528405 trunc from 0x040000 to 0x006fc3 (0x3903c bytes) 000863 1786833552.556647 write 0x03b528 thru 0x03e378 (0x2e51 bytes) 000864 1786833552.558764 trunc from 0x03e379 to 0x0219a8 (0x1c9d0 bytes) 000865 1786833552.583146 mapwrite 0x027c59 thru 0x02b961 (0x3d09 bytes) 000866 1786833552.656126 fallocate 0x02e706 thru 0x0374e8 (0x8de3 bytes) 000868 1786833552.671518 mapread 0x005aa7 thru 0x011db5 (0xc30f bytes) 000869 1786833552.725901 mapwrite 0x02f90b thru 0x033186 (0x387c bytes) 000870 1786833552.838793 trunc from 0x01ddef to 0x023924 (0x5b36 bytes) 000871 1786833552.853420 fallocate 0x02bfb4 thru 0x03954e (0xd59b bytes) 000872 1786833552.868702 trunc from 0x008a5f to 0x012cb3 (0xa255 bytes) 000873 1786833552.898496 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x33187): Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33187): Mirror 16: 0x47dd2d72 (stale) Mirror 17: 0x47dd2d72 (stale) Mirror 22: 0x47dd2d72 (stale) Mirror 23: 0x47dd2d72 (stale) Mirror 24: 0x47dd2d72 (stale) Mirror 26: 0x47dd2d72 (stale) Mirror 28: 0x47dd2d72 (stale) Mirror 29: 0x4c7490cb (stale) Mirror 30: 0x282282e9 (stale) Mirror 31: 0xec5d8748 (stale) CRC-32 checksum value for chunk [0, 0x33187): Mirror 1: 0x336db5e9 Mirror 32: 0x336db5e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33187: skipped 000874 1786833554.244121 mapread 0x017d13 thru 0x024147 (0xc435 bytes) 000875 1786833554.309171 read 0x000cef thru 0x0050e8 (0x43fa bytes) 000877 1786833554.344861 read 0x008997 thru 0x009637 (0xca1 bytes) 000878 1786833554.373870 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x33187): Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33187): Mirror 16: 0x47dd2d72 (stale) Mirror 17: 0x47dd2d72 (stale) Mirror 22: 0x47dd2d72 (stale) Mirror 23: 0x47dd2d72 (stale) Mirror 24: 0x47dd2d72 (stale) Mirror 26: 0x47dd2d72 (stale) Mirror 28: 0x47dd2d72 (stale) Mirror 29: 0x4c7490cb (stale) Mirror 30: 0x282282e9 (stale) Mirror 31: 0xec5d8748 (stale) CRC-32 checksum value for chunk [0, 0x33187): Mirror 1: 0x336db5e9 Mirror 32: 0x336db5e9 Mirror 33: 0x336db5e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33187: skipped 000880 1786833555.568267 trunc from 0x033187 to 0x03760f (0x4489 bytes) 000881 1786833555.641755 read 0x0080e1 thru 0x014197 (0xc0b7 bytes) 000882 1786833555.660902 write 0x00da67 thru 0x010478 (0x2a12 bytes) 000883 1786833555.662849 trunc from 0x037610 to 0x0058db (0x31d34 bytes) 000884 1786833555.691790 punch from 0x004d67 to 0x0058db (0xb75 bytes) 000885 1786833555.696577 mapread 0x000113 thru 0x0058db (0x57c9 bytes) 000886 1786833555.723488 write 0x0002fd thru 0x001bb5 (0x18b9 bytes) 000887 1786833555.725253 mapread 0x004da1 thru 0x0058db (0xb3b bytes) 000888 1786833555.727197 mapread 0x0045cd thru 0x0058db (0x130f bytes) 000889 1786833555.728812 mapread 0x00190f thru 0x0058db (0x3fcd bytes) 000890 1786833555.731568 fallocate 0x008457 thru 0x00869f (0x249 bytes) 000891 1786833555.736684 read 0x001db4 thru 0x0058db (0x3b28 bytes) 000892 1786833555.737449 mapwrite 0x03d0bc thru 0x03d32f (0x274 bytes) 000893 1786833555.802203 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d330): Mirror 17: 0xfc2ba45d (stale) Mirror 22: 0xfc2ba45d (stale) Mirror 23: 0xfc2ba45d (stale) Mirror 24: 0xfc2ba45d (stale) Mirror 26: 0xfc2ba45d (stale) Mirror 28: 0xfc2ba45d (stale) Mirror 29: 0x154b6d35 (stale) Mirror 30: 0x2695abc9 (stale) Mirror 31: 0xd940dc16 (stale) Mirror 32: 0xc8bac72c (stale) Mirror 33: 0xc8bac72c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d330): Mirror 17: 0xfc2ba45d (stale) Mirror 22: 0xfc2ba45d (stale) Mirror 23: 0xfc2ba45d (stale) Mirror 24: 0xfc2ba45d (stale) Mirror 26: 0xfc2ba45d (stale) Mirror 28: 0xfc2ba45d (stale) Mirror 29: 0x154b6d35 (stale) Mirror 30: 0x2695abc9 (stale) Mirror 31: 0xd940dc16 (stale) Mirror 32: 0xc8bac72c (stale) Mirror 33: 0xc8bac72c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d330: skipped 000894 1786833556.654021 fallocate 0x002ce4 thru 0x00b9cd (0x8cea bytes) 000895 1786833556.661267 mapwrite 0x0398d8 thru 0x03ffff (0x6728 bytes) 000896 1786833556.756185 punch from 0x026cdf to 0x033818 (0xcb3a bytes) 000897 1786833556.765301 mapread 0x020700 thru 0x0255a1 (0x4ea2 bytes) 000898 1786833556.784874 trunc from 0x040000 to 0x0282d3 (0x17d2c bytes) 000899 1786833556.807144 mapread 0x026ec9 thru 0x0282d3 (0x140b bytes) 000900 1786833556.810223 fallocate 0x01cdb7 thru 0x023506 (0x6750 bytes) 000901 1786833556.817383 fallocate 0x0180a7 thru 0x02674c (0xe6a6 bytes) 000902 1786833556.828655 MIRROR_RESYNC 12 mirrors 000903 1786833558.978367 read 0x00d76e thru 0x018381 (0xac14 bytes) 000904 1786833559.004214 read 0x013ecf thru 0x0236a9 (0xf7db bytes) 000905 1786833559.027677 read 0x0002cb thru 0x0035c4 (0x32fa bytes) 000906 1786833559.028077 mapwrite 0x0101e1 thru 0x01a87d (0xa69d bytes) 000907 1786833559.129827 write 0x01979c thru 0x01f456 (0x5cbb bytes) 000908 1786833559.132374 write 0x027264 thru 0x0353e4 (0xe181 bytes) 000909 1786833559.134281 mapwrite 0x00ef82 thru 0x01727a (0x82f9 bytes) 000910 1786833559.181142 trunc from 0x03534c to 0x0353e4 (0x99 bytes) 000911 1786833559.191844 mapread 0x034a8b thru 0x0353e4 (0x95a bytes) 000912 1786833559.204573 punch from 0x022fd6 to 0x02690c (0x3937 bytes) 000913 1786833559.214286 trunc from 0x0353e5 to 0x025212 (0x101d2 bytes) 000914 1786833559.239419 mapwrite 0x028f4f thru 0x03520e (0xc2c0 bytes) 000915 1786833559.365072 fallocate 0x032b5a thru 0x035861 (0x2d08 bytes) 000916 1786833559.370799 fallocate 0x030a6d thru 0x03d37f (0xc913 bytes) 000917 1786833559.380058 write 0x03d119 thru 0x03ffff (0x2ee7 bytes) 000918 1786833559.381803 punch from 0x008661 to 0x013052 (0xa9f2 bytes) 000920 1786833559.398587 mapread 0x004cfa thru 0x009ae8 (0x4def bytes) 000922 1786833559.413787 read 0x0133e2 thru 0x01ab74 (0x7793 bytes) 000923 1786833559.424282 read 0x033d29 thru 0x03ed09 (0xafe1 bytes) 000924 1786833559.425147 fallocate 0x009d42 thru 0x00a812 (0xad1 bytes) 000926 1786833559.434399 trunc from 0x040000 to 0x015554 (0x2aaab bytes) 000927 1786833559.450368 read 0x008acc thru 0x008c7d (0x1b2 bytes) 000929 1786833559.452807 trunc from 0x0030a6 to 0x004519 (0x1474 bytes) 000930 1786833559.458232 fallocate 0x00cb0a thru 0x00f899 (0x2d90 bytes) 000931 1786833559.462543 fallocate 0x000b7c thru 0x0064cd (0x5952 bytes) 000932 1786833559.468571 fallocate 0x00a320 thru 0x00c747 (0x2428 bytes) 000933 1786833559.489015 MIRROR_RESYNC 12 mirrors 000934 1786833561.227686 mapwrite 0x00e1ca thru 0x019d62 (0xbb99 bytes) 000935 1786833561.312268 write 0x02133e thru 0x025b21 (0x47e4 bytes) 000936 1786833561.314514 mapread 0x00f5c8 thru 0x01e301 (0xed3a bytes) 000938 1786833561.323025 mapread 0x0027b7 thru 0x007be8 (0x5432 bytes) 000939 1786833561.333285 write 0x015e8b thru 0x021552 (0xb6c8 bytes) 000940 1786833561.335869 read 0x01a741 thru 0x025b21 (0xb3e1 bytes) 000941 1786833561.336766 fallocate 0x02db9a thru 0x03747c (0x98e3 bytes) 000943 1786833561.342343 mapwrite 0x03e07b thru 0x03ffff (0x1f85 bytes) 000944 1786833561.387260 fallocate 0x01f249 thru 0x02c74f (0xd507 bytes) 000945 1786833561.392723 fallocate 0x01de29 thru 0x0253cc (0x75a4 bytes) 000946 1786833561.403988 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0x959e83ca (stale) Mirror 22: 0x959e83ca (stale) Mirror 23: 0x959e83ca (stale) Mirror 24: 0x959e83ca (stale) Mirror 26: 0x959e83ca (stale) Mirror 28: 0x959e83ca (stale) Mirror 29: 0x959e83ca (stale) Mirror 30: 0x959e83ca (stale) Mirror 31: 0x959e83ca (stale) Mirror 32: 0x959e83ca (stale) Mirror 33: 0x959e83ca (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9f9a3a96 Mirror 34: 0x9f9a3a96 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000947 1786833562.453549 trunc from 0x040000 to 0x02f335 (0x10cca bytes) 000948 1786833562.551013 mapwrite 0x00c526 thru 0x019a83 (0xd55e bytes) 000950 1786833562.617407 read 0x01f991 thru 0x0298ba (0x9f2a bytes) 000952 1786833562.633994 read 0x0171c3 thru 0x022cff (0xbb3d bytes) 000954 1786833562.638918 read 0x0096c7 thru 0x00bd82 (0x26bc bytes) 000955 1786833562.640024 fallocate 0x030c7c thru 0x03c48d (0xb812 bytes) 000956 1786833562.649805 trunc from 0x03c48e to 0x03bb9b (0x8f2 bytes) 000957 1786833562.677883 write 0x00162d thru 0x01084d (0xf221 bytes) 000959 1786833562.695836 MIRROR_SPLIT mirror 3 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bb9c): Mirror 17: 0x4fe07411 (stale) Mirror 22: 0x4fe07411 (stale) Mirror 24: 0x4fe07411 (stale) Mirror 26: 0x4fe07411 (stale) Mirror 28: 0x4fe07411 (stale) Mirror 29: 0x4fe07411 (stale) Mirror 30: 0x4fe07411 (stale) Mirror 31: 0x4fe07411 (stale) Mirror 32: 0x4fe07411 (stale) Mirror 33: 0x4fe07411 (stale) Mirror 34: 0xe0c3c528 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bb9c): Mirror 17: 0x4fe07411 (stale) Mirror 22: 0x4fe07411 (stale) Mirror 24: 0x4fe07411 (stale) Mirror 26: 0x4fe07411 (stale) Mirror 28: 0x4fe07411 (stale) Mirror 29: 0x4fe07411 (stale) Mirror 30: 0x4fe07411 (stale) Mirror 31: 0x4fe07411 (stale) Mirror 32: 0x4fe07411 (stale) Mirror 33: 0x4fe07411 (stale) Mirror 34: 0xe0c3c528 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bb9c: skipped 000960 1786833563.463357 read 0x0088f6 thru 0x00eb1f (0x622a bytes) 000961 1786833563.478443 fallocate 0x021852 thru 0x02caa9 (0xb258 bytes) 000962 1786833563.487746 punch from 0x0189f7 to 0x01c688 (0x3c92 bytes) 000963 1786833563.495451 punch from 0x01f2ac to 0x0275a9 (0x82fe bytes) 000964 1786833563.506274 punch from 0x033f5a to 0x03bb9b (0x7c42 bytes) 000965 1786833563.523363 mapread 0x01f5d3 thru 0x02e742 (0xf170 bytes) 000966 1786833563.563544 mapread 0x037506 thru 0x03bb9b (0x4696 bytes) 000967 1786833563.584116 fallocate 0x012532 thru 0x020a5c (0xe52b bytes) 000968 1786833563.603343 read 0x038d4d thru 0x03bb9b (0x2e4f bytes) 000969 1786833563.625251 MIRROR_RESYNC 12 mirrors 000970 1786833566.160749 mapread 0x02a56d thru 0x032d43 (0x87d7 bytes) 000971 1786833566.181021 read 0x00b0d6 thru 0x01176a (0x6695 bytes) 000973 1786833566.189646 read 0x03abfc thru 0x03bb9b (0xfa0 bytes) 000974 1786833566.200769 trunc from 0x01e5bf to 0x02818e (0x9bd0 bytes) 000975 1786833566.234756 mapread 0x02fcc8 thru 0x031ea6 (0x21df bytes) 000976 1786833566.255712 trunc from 0x03bb9c to 0x005de1 (0x35dba bytes) 000977 1786833566.291764 trunc from 0x000d17 to 0x005de1 (0x50cb bytes) 000978 1786833566.297875 mapread 0x003089 thru 0x005de1 (0x2d59 bytes) 000979 1786833566.315882 trunc from 0x004d93 to 0x005de1 (0x104f bytes) 000980 1786833566.322283 mapwrite 0x0141c0 thru 0x0205db (0xc41c bytes) 000982 1786833566.431506 fallocate 0x01cc0f thru 0x0250a1 (0x8493 bytes) 000983 1786833566.442095 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x250a2): Mirror 22: 0xc6e25d42 (stale) Mirror 24: 0xc6e25d42 (stale) Mirror 26: 0xc6e25d42 (stale) Mirror 28: 0xc6e25d42 (stale) Mirror 29: 0xc6e25d42 (stale) Mirror 30: 0xc6e25d42 (stale) Mirror 31: 0xc6e25d42 (stale) Mirror 32: 0xc6e25d42 (stale) Mirror 33: 0xc6e25d42 (stale) Mirror 34: 0xc6e25d42 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x250a2): Mirror 22: 0xc6e25d42 (stale) Mirror 24: 0xc6e25d42 (stale) Mirror 26: 0xc6e25d42 (stale) Mirror 28: 0xc6e25d42 (stale) Mirror 29: 0xc6e25d42 (stale) Mirror 30: 0xc6e25d42 (stale) Mirror 31: 0xc6e25d42 (stale) Mirror 32: 0xc6e25d42 (stale) Mirror 33: 0xc6e25d42 (stale) Mirror 34: 0xc6e25d42 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x250a2: skipped 000984 1786833567.061018 read 0x010383 thru 0x010da9 (0xa27 bytes) 000985 1786833567.074985 write 0x038159 thru 0x03cfc9 (0x4e71 bytes) 000986 1786833567.085100 mapwrite 0x03bca7 thru 0x03ffff (0x4359 bytes) 000988 1786833567.161799 write 0x02d8e7 thru 0x03ad40 (0xd45a bytes) 000989 1786833567.176282 write 0x033064 thru 0x037d52 (0x4cef bytes) 000990 1786833567.180928 read 0x02a7fb thru 0x032e23 (0x8629 bytes) 000991 1786833567.211307 mapread 0x0381b9 thru 0x03ffff (0x7e47 bytes) 000992 1786833567.213439 mapwrite 0x004a88 thru 0x00e4d0 (0x9a49 bytes) 000993 1786833567.240770 trunc from 0x02eb9b to 0x03474b (0x5bb1 bytes) 000994 1786833567.251396 punch from 0x00b57d to 0x00ff8b (0x4a0f bytes) 000995 1786833567.259545 trunc from 0x01cc59 to 0x02a716 (0xdabe bytes) 000996 1786833567.267207 read 0x017961 thru 0x0204ac (0x8b4c bytes) 000997 1786833567.279346 mapwrite 0x014a67 thru 0x01ab2f (0x60c9 bytes) 000999 1786833567.303660 trunc from 0x00a56e to 0x015a8a (0xb51d bytes) 001000 1786833567.309755 punch from 0x011e7f to 0x01511d (0x329f bytes) All operations completed A-OK!