== sanity-flr test 70a: flr mode fsx test ================ 23:25:54 (1769055954) Seed set to 5956 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x4f7b 000002 1769055957.024293 trunc from 00000000 to 0x004f7a (0x4f7b bytes) 000003 1769055957.040929 write 0x00321d thru 0x009ad8 (0x68bc bytes) 000006 1769055957.051995 mapwrite 0x039877 thru 0x03d248 (0x39d2 bytes) 000007 1769055957.146551 read 0x00ece2 thru 0x016901 (0x7c20 bytes) 000008 1769055957.158700 write 0x00ae7b thru 0x0159cd (0xab53 bytes) 000009 1769055957.166212 write 0x03891c thru 0x03eccb (0x63b0 bytes) 000010 1769055957.168119 mapread 0x01a864 thru 0x01ef98 (0x4735 bytes) 000011 1769055957.179260 mapwrite 0x03185e thru 0x0366ea (0x4e8d bytes) 000015 1769055957.283222 write 0x02a048 thru 0x039f57 (0xff10 bytes) 000016 1769055957.285280 read 0x03e494 thru 0x03eccb (0x838 bytes) 000017 1769055957.286775 read 0x02a8b3 thru 0x039893 (0xefe1 bytes) 000020 1769055957.288819 mapread 0x0128d2 thru 0x01e12f (0xb85e bytes) 000021 1769055957.290357 read 0x013d67 thru 0x022585 (0xe81f bytes) 000023 1769055957.292375 read 0x039fef thru 0x03eccb (0x4cdd bytes) 000024 1769055957.293369 mapread 0x001447 thru 0x007c42 (0x67fc bytes) truncating to largest ever: 0x10ee3 000025 1769055957.305208 trunc from 0x03eccc to 0x010ee2 (0x2dde9 bytes) 000029 1769055957.337979 mapread 0x002309 thru 0x00bd9c (0x9a94 bytes) 000030 1769055957.340068 mapwrite 0x03b839 thru 0x03eda1 (0x3569 bytes) truncating to largest ever: 0x27675 000032 1769055957.492875 trunc from 0x03eda2 to 0x027674 (0x1772d bytes) 000034 1769055957.534458 read 0x0064c4 thru 0x008be2 (0x271f bytes) 000036 1769055957.535468 mapwrite 0x00ba43 thru 0x01738d (0xb94b bytes) 000037 1769055957.664526 read 0x019352 thru 0x01aebc (0x1b6b bytes) 000038 1769055957.666121 read 0x00751e thru 0x00a84a (0x332d bytes) 000039 1769055957.670282 mapwrite 0x029032 thru 0x037886 (0xe855 bytes) 000040 1769055957.890584 mapread 0x016aed thru 0x022ec0 (0xc3d4 bytes) 000041 1769055957.891559 write 0x02b3c4 thru 0x02e3dc (0x3019 bytes) 000042 1769055957.892487 trunc from 0x037887 to 0x00dfeb (0x2989b bytes) 000044 1769055957.924578 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x3ba73 000046 1769055958.849996 trunc from 0x00dfec to 0x03ba72 (0x2da87 bytes) 000051 1769055958.989470 mapread 0x0040cc thru 0x006299 (0x21ce bytes) 000053 1769055959.015304 read 0x03a893 thru 0x03ba72 (0x11e0 bytes) 000055 1769055959.023919 write 0x00d4ea thru 0x018d5f (0xb876 bytes) 000058 1769055959.035004 write 0x014d02 thru 0x01585b (0xb5a bytes) 000059 1769055959.044518 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3ba73): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ba73): Mirror 2: 0xc8606a64 (stale) CRC-32 checksum value for chunk [0, 0x3ba73): Mirror 1: 0x7dad41e9 Mirror 3: 0x7dad41e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ba73: skipped 000060 1769055960.066225 read 0x003df5 thru 0x00c3bd (0x85c9 bytes) 000061 1769055960.098316 mapwrite 0x01fa3c thru 0x021ba3 (0x2168 bytes) 000062 1769055960.405031 trunc from 0x03ba73 to 0x0117ad (0x2a2c5 bytes) 000063 1769055960.455420 mapread 0x0067c9 thru 0x0117ad (0xafe5 bytes) 000064 1769055960.475273 mapread 0x003e72 thru 0x00d0fa (0x9289 bytes) 000065 1769055960.498046 MIRROR_RESYNC 3 mirrors 000066 1769055961.429202 read 0x00c585 thru 0x0117ad (0x5229 bytes) 000068 1769055961.436519 write 0x037bd6 thru 0x03ffff (0x842a bytes) 000069 1769055961.473559 trunc from 0x040000 to 0x006784 (0x3987b bytes) 000071 1769055961.489651 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6785): Mirror 3: 0x9e61da5d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6785): Mirror 3: 0x9e61da5d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6785: skipped 000072 1769055961.717856 mapwrite 0x003870 thru 0x0117de (0xdf6f bytes) 000073 1769055961.808973 trunc from 0x0117df to 0x03361e (0x21e40 bytes) 000076 1769055961.829427 trunc from 0x03361f to 0x038db2 (0x5794 bytes) 000078 1769055961.838867 mapwrite 0x020f25 thru 0x02d0c1 (0xc19d bytes) 000084 1769055961.883873 mapread 0x007531 thru 0x0116ee (0xa1be bytes) 000085 1769055961.886002 mapwrite 0x006471 thru 0x0115b4 (0xb144 bytes) 000086 1769055961.937664 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x38db3): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38db3): Mirror 3: 0x42af7369 (stale) CRC-32 checksum value for chunk [0, 0x38db3): Mirror 1: 0x6cd558b Mirror 4: 0x6cd558b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38db3: skipped 000087 1769055962.862425 mapread 0x01001e thru 0x01973e (0x9721 bytes) 000088 1769055962.879052 mapwrite 0x01bc7a thru 0x02bae6 (0xfe6d bytes) 000089 1769055963.040124 trunc from 0x038db3 to 0x0343a2 (0x4a10 bytes) 000090 1769055963.066034 read 0x0032cb thru 0x012602 (0xf338 bytes) 000091 1769055963.078004 read 0x00d935 thru 0x01b9b1 (0xe07d bytes) 000092 1769055963.086208 mapwrite 0x0051b7 thru 0x00d11c (0x7f66 bytes) 000093 1769055963.130460 mapwrite 0x02a6e7 thru 0x033a87 (0x93a1 bytes) 000094 1769055963.175218 write 0x03cd33 thru 0x03e058 (0x1326 bytes) 000095 1769055963.176181 mapwrite 0x03e7b4 thru 0x03ffff (0x184c bytes) 000098 1769055963.230838 mapwrite 0x02b1ac thru 0x032904 (0x7759 bytes) 000099 1769055963.287023 mapwrite 0x02334f thru 0x02a22b (0x6edd bytes) 000101 1769055963.347048 trunc from 0x040000 to 0x01b729 (0x248d6 bytes) 000102 1769055963.371820 mapwrite 0x03e138 thru 0x03ffff (0x1ec8 bytes) 000103 1769055963.462879 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xa678d425 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xa678d425 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000104 1769055963.734038 write 0x002421 thru 0x0089c6 (0x65a6 bytes) 000106 1769055963.751512 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000108 1769055963.894451 MIRROR_EXTEND to 2 mirrors 000109 1769055964.638033 read 0x01b20b thru 0x0297cb (0xe5c1 bytes) 000110 1769055964.654997 write 0x0387e1 thru 0x03e7c6 (0x5fe6 bytes) 000113 1769055964.760087 write 0x01a4a0 thru 0x021339 (0x6e9a bytes) 000114 1769055964.769715 mapwrite 0x011b13 thru 0x01ea9c (0xcf8a bytes) 000115 1769055964.908873 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000116 1769055965.053066 mapread 0x015add thru 0x0207b6 (0xacda bytes) 000118 1769055965.070690 trunc from 0x040000 to 0x036fb4 (0x904b bytes) 000120 1769055965.082912 mapread 0x01928b thru 0x028b22 (0xf898 bytes) 000121 1769055965.083994 trunc from 0x036fb5 to 0x03a68f (0x36db bytes) 000124 1769055965.102513 trunc from 0x03a690 to 0x02a26c (0x10423 bytes) 000125 1769055965.115780 mapwrite 0x032787 thru 0x0380a5 (0x591f bytes) truncating to largest ever: 0x3e6a5 000126 1769055965.188809 trunc from 0x0380a6 to 0x03e6a4 (0x65ff bytes) 000127 1769055965.211198 read 0x01d693 thru 0x026913 (0x9281 bytes) 000128 1769055965.211973 read 0x0067de thru 0x014156 (0xd979 bytes) 000130 1769055965.224088 read 0x0062ef thru 0x00ffc2 (0x9cd4 bytes) 000131 1769055965.224701 mapread 0x020e91 thru 0x022056 (0x11c6 bytes) 000132 1769055965.226714 mapwrite 0x039ba4 thru 0x03a591 (0x9ee bytes) 000133 1769055965.265754 mapwrite 0x02a3b8 thru 0x0335b2 (0x91fb bytes) 000137 1769055965.310948 write 0x004354 thru 0x0135d0 (0xf27d bytes) 000138 1769055965.312331 mapread 0x013344 thru 0x01eaf5 (0xb7b2 bytes) 000139 1769055965.313290 write 0x02e84c thru 0x02ed73 (0x528 bytes) 000141 1769055965.314834 write 0x037dba thru 0x03ffff (0x8246 bytes) 000144 1769055965.316296 read 0x0104ae thru 0x0186bb (0x820e bytes) 000148 1769055965.317941 trunc from 0x040000 to 0x02c4f5 (0x13b0a bytes) 000151 1769055965.331505 read 0x00ee96 thru 0x01e539 (0xf6a4 bytes) 000152 1769055965.331992 write 0x0089c7 thru 0x016d66 (0xe3a0 bytes) 000153 1769055965.332897 mapwrite 0x020356 thru 0x029b7b (0x9826 bytes) 000154 1769055965.382864 read 0x01e5a5 thru 0x020263 (0x1cbf bytes) 000155 1769055965.383772 mapwrite 0x02ef86 thru 0x0362e9 (0x7364 bytes) 000156 1769055965.478986 trunc from 0x0362ea to 0x002634 (0x33cb5 bytes) 000157 1769055965.501700 mapread 0x00233a thru 0x002634 (0x2fb bytes) 000158 1769055965.502570 mapwrite 0x03d4d7 thru 0x03ffff (0x2b29 bytes) 000159 1769055965.571444 trunc from 0x040000 to 0x00b32d (0x34cd2 bytes) 000160 1769055965.592226 MIRROR_EXTEND to 2 mirrors 000162 1769055966.114186 write 0x02d6de thru 0x02dcfc (0x61f bytes) 000165 1769055966.202525 mapwrite 0x02af6b thru 0x02ff56 (0x4fec bytes) 000167 1769055966.301742 read 0x025c3c thru 0x02f953 (0x9d18 bytes) 000168 1769055966.302189 trunc from 0x02ff57 to 0x024cd1 (0xb285 bytes) 000169 1769055966.328579 trunc from 0x024cd2 to 0x015f9f (0xed32 bytes) 000171 1769055966.374454 mapwrite 0x024036 thru 0x02e3ac (0xa377 bytes) 000172 1769055966.498206 trunc from 0x02e3ad to 0x02147c (0xcf30 bytes) 000173 1769055966.532928 MIRROR_RESYNC 2 mirrors 000175 1769055967.561476 MIRROR_RESYNC 2 mirrors 000177 1769055968.246382 MIRROR_RESYNC 2 mirrors 000178 1769055968.691298 trunc from 0x02147d to 0x01363a (0xde42 bytes) 000179 1769055968.794525 trunc from 0x01363b to 0x0131e2 (0x458 bytes) 000181 1769055968.838004 trunc from 0x0131e3 to 0x0331f6 (0x20014 bytes) 000183 1769055968.864006 write 0x0259ae thru 0x032dc9 (0xd41c bytes) 000184 1769055968.881309 mapread 0x01ab3b thru 0x029bbc (0xf082 bytes) 000186 1769055968.930215 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000187 1769055969.145977 read 0x01a308 thru 0x026a1b (0xc714 bytes) 000189 1769055969.156696 MIRROR_EXTEND to 2 mirrors 000190 1769055969.523238 write 0x00b395 thru 0x012e8c (0x7af8 bytes) 000193 1769055969.570442 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x331f7): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x331f7): Mirror 2: 0xcd9131c8 (stale) CRC-32 checksum value for chunk [0, 0x331f7): Mirror 1: 0xc9ea7726 Mirror 3: 0xc9ea7726 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x331f7: skipped 000194 1769055970.197495 write 0x011e94 thru 0x01bb43 (0x9cb0 bytes) 000195 1769055970.314597 write 0x021080 thru 0x02255a (0x14db bytes) 000197 1769055970.340197 MIRROR_RESYNC 3 mirrors 000198 1769055971.433657 read 0x022c60 thru 0x02de6d (0xb20e bytes) 000199 1769055971.442842 write 0x01a7a8 thru 0x023435 (0x8c8e bytes) 000200 1769055971.509134 trunc from 0x0331f7 to 0x031dd9 (0x141d bytes) 000201 1769055971.530067 read 0x01e66d thru 0x021bbb (0x354f bytes) 000203 1769055971.532136 mapwrite 0x027a4d thru 0x02a324 (0x28d8 bytes) 000204 1769055971.587768 mapwrite 0x0354ea thru 0x03ffff (0xab16 bytes) 000205 1769055971.672447 read 0x0034be thru 0x01334f (0xfe92 bytes) 000206 1769055971.675069 mapread 0x00278f thru 0x0031b8 (0xa2a bytes) 000210 1769055971.677359 mapread 0x0328c5 thru 0x03de97 (0xb5d3 bytes) 000213 1769055971.680164 read 0x0141a7 thru 0x01927e (0x50d8 bytes) 000214 1769055971.680842 mapwrite 0x02e163 thru 0x03bc2e (0xdacc bytes) 000216 1769055971.736364 mapread 0x00ab9d thru 0x00b886 (0xcea bytes) 000217 1769055971.737262 write 0x03bed6 thru 0x03ffff (0x412a bytes) 000219 1769055971.743820 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa6bf9de6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa6bf9de6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000220 1769055972.113325 mapwrite 0x03e8c7 thru 0x03ffff (0x1739 bytes) 000221 1769055972.189762 MIRROR_RESYNC 2 mirrors 000223 1769055972.755147 mapwrite 0x01dfd5 thru 0x01f7df (0x180b bytes) 000224 1769055972.906962 read 0x026daa thru 0x027e34 (0x108b bytes) 000225 1769055972.912682 write 0x027dd7 thru 0x02ac28 (0x2e52 bytes) 000226 1769055972.917940 mapread 0x00bb86 thru 0x017e99 (0xc314 bytes) 000227 1769055972.932121 trunc from 0x040000 to 0x037020 (0x8fdf bytes) 000228 1769055972.972978 write 0x00151c thru 0x004c65 (0x374a bytes) 000229 1769055972.984244 MIRROR_RESYNC 2 mirrors 000231 1769055973.703582 write 0x01986b thru 0x0198c6 (0x5c bytes) 000232 1769055973.858985 mapread 0x030a69 thru 0x037020 (0x65b8 bytes) 000233 1769055973.894814 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x37021): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37021): Mirror 3: 0x17d91442 (stale) CRC-32 checksum value for chunk [0, 0x37021): Mirror 1: 0xdb4b59a6 Mirror 4: 0xdb4b59a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37021: skipped 000235 1769055975.363223 mapwrite 0x00fee3 thru 0x01148a (0x15a8 bytes) 000240 1769055975.791897 read 0x025bef thru 0x02f00c (0x941e bytes) 000241 1769055975.813370 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x37021): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37021): Mirror 3: 0x17d91442 (stale) Mirror 4: 0xdb4b59a6 (stale) CRC-32 checksum value for chunk [0, 0x37021): Mirror 1: 0xec69ef0e Mirror 5: 0xec69ef0e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37021: skipped 000243 1769055976.729306 mapwrite 0x0082a0 thru 0x01062c (0x838d bytes) 000246 1769055976.937278 trunc from 0x037021 to 0x02f354 (0x7ccc bytes) 000247 1769055976.970077 read 0x01b129 thru 0x01ff4b (0x4e23 bytes) 000249 1769055976.979926 read 0x00874d thru 0x015ff0 (0xd8a4 bytes) 000251 1769055976.992104 write 0x032a6c thru 0x033454 (0x9e9 bytes) 000256 1769055976.996659 mapwrite 0x022c94 thru 0x0267b2 (0x3b1f bytes) 000257 1769055977.051667 mapwrite 0x00ed3d thru 0x012444 (0x3708 bytes) 000258 1769055977.101221 read 0x0038b9 thru 0x00c9b0 (0x90f8 bytes) 000259 1769055977.101949 trunc from 0x033455 to 0x02b9c3 (0x7a91 bytes) 000261 1769055977.126020 write 0x027b6b thru 0x028c2b (0x10c1 bytes) 000264 1769055977.135975 read 0x00146e thru 0x00889b (0x742e bytes) 000265 1769055977.136819 write 0x01d01a thru 0x0256ee (0x86d5 bytes) 000266 1769055977.154044 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2b9c4): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b9c4): Mirror 3: 0x8062df17 (stale) Mirror 4: 0x6d3710d2 (stale) Mirror 5: 0xe4719c58 (stale) CRC-32 checksum value for chunk [0, 0x2b9c4): Mirror 1: 0xb1d473ce Mirror 6: 0xb1d473ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b9c4: skipped 000268 1769055978.396157 mapread 0x012ac7 thru 0x018463 (0x599d bytes) 000269 1769055978.481125 read 0x0268ba thru 0x02b9c3 (0x510a bytes) 000272 1769055978.546392 trunc from 0x02b9c4 to 0x0130b0 (0x18913 bytes) 000273 1769055978.777898 read 0x005fed thru 0x010856 (0xa86a bytes) 000275 1769055978.792638 mapwrite 0x01a3e9 thru 0x01dcf1 (0x3909 bytes) 000276 1769055978.952796 read 0x014071 thru 0x01dcf1 (0x9c81 bytes) 000277 1769055978.953527 mapread 0x018189 thru 0x01c022 (0x3e9a bytes) 000279 1769055978.955221 read 0x00a9e1 thru 0x01a539 (0xfb59 bytes) 000284 1769055978.957972 trunc from 0x01dcf2 to 0x013936 (0xa3bb bytes) 000288 1769055978.988274 mapwrite 0x01d53f thru 0x01ee3f (0x1901 bytes) 000290 1769055979.175304 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1ee40): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ee40): Mirror 3: 0xa24023ca (stale) Mirror 4: 0xafa0b34d (stale) Mirror 5: 0xa10d58d4 (stale) Mirror 6: 0x294dfd61 (stale) CRC-32 checksum value for chunk [0, 0x1ee40): Mirror 1: 0x8eccf21b Mirror 7: 0x8eccf21b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ee40: skipped 000291 1769055980.275332 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1ee40): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ee40): Mirror 3: 0xa24023ca (stale) Mirror 4: 0xafa0b34d (stale) Mirror 5: 0xa10d58d4 (stale) Mirror 6: 0x294dfd61 (stale) CRC-32 checksum value for chunk [0, 0x1ee40): Mirror 1: 0x8eccf21b Mirror 7: 0x8eccf21b Mirror 8: 0x8eccf21b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ee40: skipped 000293 1769055981.768802 read 0x00d26f thru 0x00f469 (0x21fb bytes) 000294 1769055981.778813 read 0x017992 thru 0x0192cc (0x193b bytes) 000295 1769055981.800201 mapwrite 0x02babe thru 0x039dbe (0xe301 bytes) 000297 1769055982.383545 mapwrite 0x01949e thru 0x027119 (0xdc7c bytes) 000299 1769055982.651964 MIRROR_RESYNC 7 mirrors 000300 1769055984.791909 mapread 0x01e1b9 thru 0x02094f (0x2797 bytes) 000301 1769055984.819235 MIRROR_RESYNC 7 mirrors 000303 1769055985.310865 write 0x00067e thru 0x003b21 (0x34a4 bytes) 000304 1769055985.493940 write 0x010228 thru 0x01a694 (0xa46d bytes) 000306 1769055985.507789 mapread 0x0355d4 thru 0x039dbe (0x47eb bytes) 000307 1769055985.518471 read 0x01ef53 thru 0x023619 (0x46c7 bytes) 000311 1769055985.531501 read 0x00830f thru 0x00da1d (0x570f bytes) 000312 1769055985.542528 write 0x02f1ae thru 0x03aabf (0xb912 bytes) 000314 1769055985.549944 MIRROR_RESYNC 7 mirrors 000316 1769055986.673682 mapread 0x01981d thru 0x026cd8 (0xd4bc bytes) 000317 1769055986.727248 mapread 0x019a84 thru 0x027fea (0xe567 bytes) 000319 1769055986.728136 mapread 0x02d537 thru 0x03aabf (0xd589 bytes) 000320 1769055986.777252 read 0x01eeee thru 0x02d233 (0xe346 bytes) 000321 1769055986.777732 trunc from 0x03aac0 to 0x02543b (0x15684 bytes) 000322 1769055986.977009 read 0x0218ff thru 0x02543b (0x3b3d bytes) 000324 1769055987.017980 trunc from 0x02543c to 0x0177fe (0xdc3d bytes) 000326 1769055987.068506 trunc from 0x0177ff to 0x01e748 (0x6f4a bytes) 000327 1769055987.106173 mapread 0x004f58 thru 0x00ee9f (0x9f48 bytes) 000329 1769055987.109313 mapread 0x01886c thru 0x01e748 (0x5edd bytes) 000331 1769055987.209295 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e749): Mirror 3: 0xcf409f73 (stale) Mirror 4: 0xcf409f73 (stale) Mirror 5: 0xcf409f73 (stale) Mirror 6: 0xcf409f73 (stale) Mirror 8: 0xcf409f73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e749): Mirror 3: 0xcf409f73 (stale) Mirror 4: 0xcf409f73 (stale) Mirror 5: 0xcf409f73 (stale) Mirror 6: 0xcf409f73 (stale) Mirror 8: 0xcf409f73 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e749: skipped 000333 1769055988.005136 mapwrite 0x00ee54 thru 0x0123e3 (0x3590 bytes) 000334 1769055988.148889 read 0x001b72 thru 0x00a046 (0x84d5 bytes) 000338 1769055988.162307 mapwrite 0x00c2ba thru 0x00d1f4 (0xf3b bytes) 000339 1769055988.245171 mapread 0x00ae0a thru 0x01670b (0xb902 bytes) 000340 1769055988.250908 mapwrite 0x0197c8 thru 0x01cb5e (0x3397 bytes) 000341 1769055988.349800 read 0x00d00d thru 0x012d73 (0x5d67 bytes) 000343 1769055988.350974 mapread 0x019dcc thru 0x01e748 (0x497d bytes) 000347 1769055988.355510 mapread 0x00afae thru 0x018861 (0xd8b4 bytes) 000348 1769055988.356453 read 0x003c00 thru 0x007ffe (0x43ff bytes) 000349 1769055988.357368 read 0x003d86 thru 0x012167 (0xe3e2 bytes) 000351 1769055988.364563 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e749): Mirror 3: 0xcf409f73 (stale) Mirror 5: 0xcf409f73 (stale) Mirror 6: 0xcf409f73 (stale) Mirror 8: 0xcf409f73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e749): Mirror 3: 0xcf409f73 (stale) Mirror 5: 0xcf409f73 (stale) Mirror 6: 0xcf409f73 (stale) Mirror 8: 0xcf409f73 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e749: skipped 000353 1769055988.861883 mapwrite 0x019078 thru 0x01aebd (0x1e46 bytes) 000358 1769055988.949838 write 0x00e871 thru 0x014c9a (0x642a bytes) 000359 1769055988.968974 trunc from 0x01e749 to 0x008bab (0x15b9d bytes) 000360 1769055989.000655 MIRROR_RESYNC 5 mirrors 000361 1769055990.063076 mapread 0x007229 thru 0x008bab (0x1983 bytes) 000362 1769055990.080065 MIRROR_RESYNC 5 mirrors 000366 1769055990.450965 read 0x001bcf thru 0x008bab (0x6fdd bytes) 000369 1769055990.462531 trunc from 0x008bac to 0x01a230 (0x11685 bytes) 000371 1769055990.569918 MIRROR_RESYNC 5 mirrors 000372 1769055991.729524 read 0x016eaa thru 0x01a230 (0x3387 bytes) 000373 1769055991.747874 mapwrite 0x00edc8 thru 0x0159e4 (0x6c1d bytes) 000374 1769055992.110438 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a231): Mirror 5: 0xfb02a829 (stale) Mirror 6: 0xfb02a829 (stale) Mirror 8: 0xfb02a829 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a231): Mirror 5: 0xfb02a829 (stale) Mirror 6: 0xfb02a829 (stale) Mirror 8: 0xfb02a829 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a231: skipped truncating to largest ever: 0x3f913 000375 1769055992.556543 trunc from 0x01a231 to 0x03f912 (0x256e2 bytes) 000376 1769055992.581020 trunc from 0x03f913 to 0x003e31 (0x3bae1 bytes) 000377 1769055992.602840 read 0x000af6 thru 0x003e31 (0x333c bytes) 000378 1769055992.610593 write 0x0220f9 thru 0x02297f (0x887 bytes) 000379 1769055992.611983 read 0x01ed1c thru 0x02297f (0x3c64 bytes) 000380 1769055992.621360 trunc from 0x022980 to 0x011830 (0x1114f bytes) 000381 1769055992.641092 read 0x0006fb thru 0x00507c (0x4982 bytes) 000382 1769055992.643097 read 0x010e9d thru 0x011830 (0x994 bytes) 000383 1769055992.651065 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x11831): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11831): Mirror 5: 0xe0c3ce1e (stale) Mirror 6: 0xe0c3ce1e (stale) Mirror 8: 0xe0c3ce1e (stale) CRC-32 checksum value for chunk [0, 0x11831): Mirror 1: 0xfd0d22ea Mirror 9: 0xfd0d22ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11831: skipped 000385 1769055993.782803 read 0x00aba1 thru 0x011830 (0x6c90 bytes) 000386 1769055993.800290 mapwrite 0x01a392 thru 0x01b311 (0xf80 bytes) 000387 1769055993.957122 read 0x0087f5 thru 0x00dff4 (0x5800 bytes) 000388 1769055993.970213 mapread 0x01aae9 thru 0x01b311 (0x829 bytes) 000390 1769055993.972891 trunc from 0x01b312 to 0x03563a (0x1a329 bytes) 000391 1769055994.001856 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3563b): Mirror 6: 0x9746bb04 (stale) Mirror 8: 0x9746bb04 (stale) Mirror 9: 0x24b316a4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3563b): Mirror 6: 0x9746bb04 (stale) Mirror 8: 0x9746bb04 (stale) Mirror 9: 0x24b316a4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3563b: skipped 000392 1769055994.494871 trunc from 0x03563b to 0x0259c2 (0xfc78 bytes) 000397 1769055994.555598 write 0x00ef92 thru 0x01e916 (0xf985 bytes) 000398 1769055994.608205 mapread 0x018bc8 thru 0x01b35b (0x2794 bytes) 000399 1769055994.625269 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x259c3): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x259c3): Mirror 6: 0x84cfeec5 (stale) Mirror 8: 0x84cfeec5 (stale) Mirror 9: 0xe7e415f6 (stale) CRC-32 checksum value for chunk [0, 0x259c3): Mirror 1: 0x7e5e904d Mirror 10: 0x7e5e904d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x259c3: skipped 000402 1769055995.672998 write 0x02fd59 thru 0x03af1a (0xb1c2 bytes) 000407 1769055995.758956 mapread 0x010492 thru 0x0188cc (0x843b bytes) 000408 1769055995.776833 mapwrite 0x039a40 thru 0x03ffff (0x65c0 bytes) 000409 1769055995.864922 mapread 0x033340 thru 0x03527b (0x1f3c bytes) 000410 1769055995.865913 trunc from 0x040000 to 0x0006a0 (0x3f95f bytes) 000411 1769055995.884402 read 0x0000d5 thru 0x0006a0 (0x5cc bytes) 000412 1769055995.892790 trunc from 0x0006a1 to 0x0000d0 (0x5d0 bytes) 000413 1769055995.913124 mapread 0x000088 thru 0x0000d0 (0x49 bytes) 000414 1769055995.917462 mapread 0x000024 thru 0x0000d0 (0xad bytes) 000415 1769055995.924783 MIRROR_RESYNC 5 mirrors 000416 1769055997.255733 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000417 1769055997.557352 MIRROR_RESYNC 4 mirrors 000419 1769055997.886813 mapread 0x000071 thru 0x0000d0 (0x60 bytes) 000422 1769055997.899868 read 0x000006 thru 0x0000d0 (0xcb bytes) 000423 1769055997.900798 read 0x000031 thru 0x0000d0 (0xa0 bytes) 000426 1769055997.902189 mapread 0x00002f thru 0x0000d0 (0xa2 bytes) 000427 1769055997.903507 write 0x03da77 thru 0x03ffff (0x2589 bytes) 000428 1769055997.964074 read 0x0191dc thru 0x0257b7 (0xc5dc bytes) 000429 1769055997.995273 trunc from 0x040000 to 0x000dad (0x3f252 bytes) 000431 1769055998.038457 mapread 0x000b3a thru 0x000dad (0x274 bytes) 000432 1769055998.041898 trunc from 0x000dae to 0x01104d (0x102a0 bytes) 000433 1769055998.069033 trunc from 0x01104e to 0x02fc4f (0x1ec02 bytes) 000434 1769055998.093140 trunc from 0x02fc50 to 0x00f7da (0x20475 bytes) 000435 1769055998.146407 mapread 0x008423 thru 0x00970f (0x12ed bytes) 000437 1769055998.179587 mapread 0x00a11d thru 0x00f7da (0x56be bytes) 000438 1769055998.242107 trunc from 0x00f7db to 0x0160d0 (0x68f6 bytes) 000440 1769055998.280215 trunc from 0x0160d1 to 0x0036ef (0x129e1 bytes) 000442 1769055998.316112 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36f0): Mirror 9: 0xd65c1647 (stale) Mirror 10: 0xd65c1647 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36f0): Mirror 9: 0xd65c1647 (stale) Mirror 10: 0xd65c1647 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36f0: skipped 000443 1769055998.800100 read 0x001769 thru 0x0036ef (0x1f87 bytes) 000444 1769055998.813580 mapwrite 0x006bf1 thru 0x00ef0d (0x831d bytes) 000445 1769055999.025388 mapwrite 0x03c69e thru 0x03ffff (0x3962 bytes) 000446 1769055999.246102 read 0x00d5a2 thru 0x00df82 (0x9e1 bytes) 000447 1769055999.249145 mapwrite 0x03da4f thru 0x03ffff (0x25b1 bytes) 000448 1769055999.337162 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9361a7fb Mirror 11: 0x9361a7fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000449 1769056000.593864 write 0x01b94f thru 0x01d1ba (0x186c bytes) 000450 1769056000.681711 read 0x0246b3 thru 0x02ca58 (0x83a6 bytes) 000451 1769056000.695425 mapread 0x02e4b1 thru 0x03996f (0xb4bf bytes) 000453 1769056000.731710 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xe20eea22 (stale) Mirror 11: 0x9361a7fb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xe20eea22 (stale) Mirror 11: 0x9361a7fb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000454 1769056001.183039 read 0x027023 thru 0x028b1d (0x1afb bytes) 000455 1769056001.191150 read 0x02997d thru 0x03198a (0x800e bytes) 000459 1769056001.249747 mapread 0x01b19b thru 0x021e66 (0x6ccc bytes) 000460 1769056001.250673 mapwrite 0x02ee34 thru 0x0395e8 (0xa7b5 bytes) 000461 1769056001.406129 mapread 0x00b57d thru 0x013dd1 (0x8855 bytes) 000462 1769056001.409187 mapwrite 0x02063a thru 0x028cbe (0x8685 bytes) 000463 1769056001.530230 mapread 0x02aa8a thru 0x033929 (0x8ea0 bytes) 000466 1769056001.544067 trunc from 0x040000 to 0x00c13a (0x33ec5 bytes) 000467 1769056001.626153 mapread 0x0043ca thru 0x009b62 (0x5799 bytes) 000468 1769056001.628369 mapread 0x00a316 thru 0x00c13a (0x1e25 bytes) 000469 1769056001.634342 write 0x02b5d6 thru 0x02d7e0 (0x220b bytes) 000470 1769056001.635250 read 0x0017c7 thru 0x00d564 (0xbd9e bytes) 000471 1769056001.673971 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d7e1): Mirror 10: 0x3787874b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d7e1): Mirror 10: 0x3787874b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d7e1: skipped 000472 1769056002.325404 mapwrite 0x00b663 thru 0x017154 (0xbaf2 bytes) 000473 1769056002.487852 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2d7e1): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d7e1): Mirror 10: 0x3787874b (stale) CRC-32 checksum value for chunk [0, 0x2d7e1): Mirror 1: 0x5a2c4d17 Mirror 11: 0x5a2c4d17 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d7e1: skipped 000474 1769056003.226596 mapread 0x016e1a thru 0x01c1de (0x53c5 bytes) 000475 1769056003.301635 mapwrite 0x025633 thru 0x02e860 (0x922e bytes) 000476 1769056003.696090 mapread 0x01cf4d thru 0x02bc16 (0xecca bytes) 000477 1769056003.706218 read 0x02bf72 thru 0x02e757 (0x27e6 bytes) 000479 1769056003.712169 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e861): Mirror 10: 0x8aafa621 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e861): Mirror 10: 0x8aafa621 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e861: skipped 000480 1769056004.132653 MIRROR_RESYNC 2 mirrors 000481 1769056004.961445 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000482 1769056005.152404 read 0x0101bc thru 0x011986 (0x17cb bytes) 000484 1769056005.163092 MIRROR_EXTEND to 2 mirrors 000485 1769056006.351087 write 0x02ecc3 thru 0x03d8c4 (0xec02 bytes) 000486 1769056006.497988 write 0x00fed1 thru 0x017802 (0x7932 bytes) 000487 1769056006.527391 read 0x03341a thru 0x03d8c4 (0xa4ab bytes) 000488 1769056006.528596 read 0x03a376 thru 0x03d8c4 (0x354f bytes) 000489 1769056006.529190 mapread 0x010def thru 0x01fa33 (0xec45 bytes) 000490 1769056006.554962 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000491 1769056006.737322 read 0x0011c0 thru 0x00e515 (0xd356 bytes) 000492 1769056006.750899 read 0x025227 thru 0x030eed (0xbcc7 bytes) 000493 1769056006.777207 read 0x02d837 thru 0x030c2d (0x33f7 bytes) 000494 1769056006.785591 MIRROR_EXTEND to 2 mirrors 000495 1769056007.866256 write 0x026c68 thru 0x0343e3 (0xd77c bytes) 000497 1769056008.016513 read 0x035d1d thru 0x03b202 (0x54e6 bytes) 000498 1769056008.039417 mapread 0x008fe0 thru 0x00ad34 (0x1d55 bytes) 000499 1769056008.066594 mapwrite 0x010f1e thru 0x01d394 (0xc477 bytes) 000500 1769056008.239106 mapwrite 0x021c35 thru 0x02923c (0x7608 bytes) 000501 1769056008.367927 trunc from 0x03d8c5 to 0x027e4b (0x15a79 bytes) 000503 1769056008.403583 mapread 0x01f8ce thru 0x0207bb (0xeee bytes) 000504 1769056008.416248 MIRROR_RESYNC 2 mirrors 000505 1769056009.241783 mapread 0x01f30d thru 0x0210bc (0x1db0 bytes) 000506 1769056009.265340 mapread 0x00650c thru 0x011184 (0xac79 bytes) 000509 1769056009.291089 mapread 0x0077d8 thru 0x0163d0 (0xebf9 bytes) 000510 1769056009.301846 MIRROR_RESYNC 2 mirrors 000512 1769056009.830850 mapwrite 0x036cfc thru 0x037ece (0x11d3 bytes) 000513 1769056010.212205 mapread 0x011e6f thru 0x014c96 (0x2e28 bytes) 000516 1769056010.246800 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000517 1769056010.400984 read 0x0063e9 thru 0x014eb0 (0xeac8 bytes) 000518 1769056010.411928 trunc from 0x037ecf to 0x00de5c (0x2a072 bytes) 000519 1769056010.433507 read 0x009fc1 thru 0x00b618 (0x1658 bytes) 000522 1769056010.437818 read 0x000e60 thru 0x008304 (0x74a5 bytes) 000525 1769056010.453064 MIRROR_EXTEND to 2 mirrors 000526 1769056011.061152 mapwrite 0x01bd4f thru 0x01fd72 (0x4024 bytes) 000527 1769056011.308925 mapread 0x01e3d2 thru 0x01fd72 (0x19a1 bytes) 000528 1769056011.311310 write 0x01692b thru 0x021ae7 (0xb1bd bytes) 000530 1769056011.315840 write 0x033e0a thru 0x03ffff (0xc1f6 bytes) 000531 1769056011.317228 mapread 0x022e96 thru 0x0261e5 (0x3350 bytes) 000532 1769056011.327531 write 0x01da03 thru 0x02d78c (0xfd8a bytes) 000534 1769056011.343589 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x49b77522 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4e896b6a Mirror 3: 0x4e896b6a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000536 1769056012.168441 read 0x00cef6 thru 0x012b11 (0x5c1c bytes) 000537 1769056012.186981 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x49b77522 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4e896b6a Mirror 3: 0x4e896b6a Mirror 4: 0x4e896b6a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000539 1769056013.090744 trunc from 0x040000 to 0x007b05 (0x384fa bytes) 000540 1769056013.164777 read 0x005759 thru 0x0071db (0x1a83 bytes) 000541 1769056013.170886 read 0x0064a8 thru 0x007b05 (0x165e bytes) 000542 1769056013.171559 trunc from 0x007b06 to 0x01a19c (0x12697 bytes) 000546 1769056013.220073 trunc from 0x01a19d to 0x01d8f7 (0x375b bytes) 000548 1769056013.246217 mapwrite 0x0015e8 thru 0x00be13 (0xa82c bytes) 000551 1769056013.333734 read 0x001965 thru 0x008c1d (0x72b9 bytes) 000552 1769056013.334322 read 0x00d8e9 thru 0x016eb4 (0x95cc bytes) 000553 1769056013.334911 write 0x01c1a6 thru 0x027f66 (0xbdc1 bytes) 000556 1769056013.339739 mapwrite 0x02edaf thru 0x034ee2 (0x6134 bytes) 000558 1769056013.421299 trunc from 0x034ee3 to 0x00508d (0x2fe55 bytes) 000560 1769056013.440453 mapread 0x000ae4 thru 0x00508d (0x45aa bytes) 000562 1769056013.441833 write 0x00ae59 thru 0x011972 (0x6b1a bytes) 000563 1769056013.448860 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11973): Mirror 2: 0xdc3edc1c (stale) Mirror 4: 0xdc3edc1c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11973): Mirror 2: 0xdc3edc1c (stale) Mirror 4: 0xdc3edc1c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11973: skipped 000564 1769056013.726511 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11973): Mirror 4: 0xdc3edc1c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11973): Mirror 4: 0xdc3edc1c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11973: skipped 000566 1769056013.964104 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000567 1769056014.100060 mapread 0x004474 thru 0x00bb08 (0x7695 bytes) 000568 1769056014.120539 mapwrite 0x021bfa thru 0x023128 (0x152f bytes) 000570 1769056014.197730 trunc from 0x023129 to 0x00fb42 (0x135e6 bytes) 000572 1769056014.212827 read 0x005050 thru 0x00cbc7 (0x7b78 bytes) 000574 1769056014.213922 trunc from 0x00fb43 to 0x01e74a (0xec08 bytes) 000579 1769056014.239103 read 0x01af63 thru 0x01d937 (0x29d5 bytes) 000581 1769056014.249818 trunc from 0x01e74b to 0x02ea03 (0x102b9 bytes) 000583 1769056014.265027 write 0x0097a6 thru 0x0165db (0xce36 bytes) 000585 1769056014.266788 mapwrite 0x03e361 thru 0x03ffff (0x1c9f bytes) 000586 1769056014.354983 write 0x021804 thru 0x0317e3 (0xffe0 bytes) 000587 1769056014.356360 write 0x03a72c thru 0x03ffff (0x58d4 bytes) 000590 1769056014.360443 write 0x0389e9 thru 0x03d2ad (0x48c5 bytes) 000591 1769056014.362690 trunc from 0x040000 to 0x03a6e0 (0x591f bytes) 000598 1769056014.390119 trunc from 0x03a6e1 to 0x02dbb7 (0xcb29 bytes) 000600 1769056014.414106 mapwrite 0x03fc88 thru 0x03ffff (0x378 bytes) 000601 1769056014.485494 mapread 0x003350 thru 0x00f083 (0xbd34 bytes) 000602 1769056014.486918 read 0x033c31 thru 0x03ffff (0xc3cf bytes) 000604 1769056014.497025 mapread 0x019438 thru 0x021bc2 (0x878b bytes) 000605 1769056014.499959 mapread 0x00bf23 thru 0x0192a7 (0xd385 bytes) 000606 1769056014.501113 mapwrite 0x031d19 thru 0x03ffff (0xe2e7 bytes) 000608 1769056014.553216 mapwrite 0x000572 thru 0x00c93f (0xc3ce bytes) 000609 1769056014.598876 write 0x01836a thru 0x01f311 (0x6fa8 bytes) 000610 1769056014.600677 read 0x00f1b7 thru 0x015178 (0x5fc2 bytes) 000612 1769056014.602630 read 0x012779 thru 0x01544b (0x2cd3 bytes) 000613 1769056014.603286 mapread 0x03d1cf thru 0x03ffff (0x2e31 bytes) 000616 1769056014.606563 trunc from 0x040000 to 0x01465c (0x2b9a3 bytes) 000617 1769056014.633592 read 0x00f322 thru 0x01465c (0x533b bytes) 000618 1769056014.635507 mapwrite 0x012a2f thru 0x022514 (0xfae6 bytes) 000619 1769056014.721860 read 0x01e246 thru 0x022514 (0x42cf bytes) 000622 1769056014.723927 mapwrite 0x036b3a thru 0x03cbea (0x60b1 bytes) 000625 1769056014.800090 mapwrite 0x018522 thru 0x01ece1 (0x67c0 bytes) 000626 1769056014.836695 read 0x0104cc thru 0x015509 (0x503e bytes) 000627 1769056014.837756 write 0x01f9b7 thru 0x0262d1 (0x691b bytes) 000629 1769056014.844680 MIRROR_EXTEND to 2 mirrors 000630 1769056015.515662 mapwrite 0x001d0e thru 0x00ec82 (0xcf75 bytes) 000635 1769056015.820736 mapwrite 0x000392 thru 0x0089b4 (0x8623 bytes) 000636 1769056015.904850 mapwrite 0x013591 thru 0x01a641 (0x70b1 bytes) 000638 1769056015.985940 write 0x02f68c thru 0x03a1cf (0xab44 bytes) 000644 1769056016.008385 trunc from 0x03cbeb to 0x030784 (0xc466 bytes) 000646 1769056016.050782 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000650 1769056016.177700 mapwrite 0x02de41 thru 0x034c07 (0x6dc7 bytes) 000654 1769056016.265914 mapwrite 0x00132e thru 0x00dff4 (0xccc7 bytes) 000657 1769056016.322793 trunc from 0x034c08 to 0x028d60 (0xbea7 bytes) 000658 1769056016.342626 trunc from 0x028d61 to 0x014619 (0x14747 bytes) 000659 1769056016.362732 trunc from 0x01461a to 0x02c370 (0x17d57 bytes) 000663 1769056016.387792 trunc from 0x02c371 to 0x01d523 (0xee4d bytes) 000665 1769056016.413933 trunc from 0x01d524 to 0x02b550 (0xe02d bytes) 000666 1769056016.428831 read 0x020af0 thru 0x026a55 (0x5f66 bytes) 000670 1769056016.439972 mapread 0x01d2a3 thru 0x02b550 (0xe2ae bytes) 000671 1769056016.455953 read 0x024d01 thru 0x02b550 (0x6850 bytes) 000672 1769056016.456744 mapwrite 0x03d073 thru 0x03ffff (0x2f8d bytes) 000674 1769056016.573352 read 0x011a84 thru 0x020097 (0xe614 bytes) 000677 1769056016.575924 write 0x010f6b thru 0x0204e2 (0xf578 bytes) 000679 1769056016.580096 read 0x0350bb thru 0x03ffff (0xaf45 bytes) 000683 1769056016.583113 trunc from 0x040000 to 0x01cfed (0x23012 bytes) 000685 1769056016.607438 read 0x01335a thru 0x0139a2 (0x649 bytes) 000687 1769056016.614569 MIRROR_EXTEND to 2 mirrors 000688 1769056017.412949 trunc from 0x01cfee to 0x00c02a (0x10fc3 bytes) 000691 1769056017.478651 write 0x02e5e5 thru 0x033ff5 (0x5a11 bytes) 000692 1769056017.479793 mapread 0x024f1f thru 0x02d2a5 (0x8387 bytes) 000694 1769056017.495554 write 0x001c48 thru 0x0050d3 (0x348c bytes) 000696 1769056017.504863 write 0x014c92 thru 0x01a55b (0x58ca bytes) 000698 1769056017.513927 mapread 0x01043e thru 0x016596 (0x6159 bytes) 000699 1769056017.522015 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) 000700 1769056017.672646 trunc from 0x033ff6 to 0x00b14f (0x28ea6 bytes) 000701 1769056017.691168 trunc from 0x00b150 to 0x010036 (0x4ee7 bytes) 000702 1769056017.716468 write 0x0083d6 thru 0x017388 (0xefb3 bytes) 000703 1769056017.722458 write 0x00a939 thru 0x014b53 (0xa21b bytes) 000706 1769056017.725937 read 0x00c570 thru 0x012793 (0x6224 bytes) 000707 1769056017.727095 write 0x039dd0 thru 0x03fc7f (0x5eb0 bytes) 000709 1769056017.729755 write 0x03c5f9 thru 0x03ffff (0x3a07 bytes) 000710 1769056017.730845 read 0x016f7c thru 0x01fb7f (0x8c04 bytes) 000711 1769056017.741529 mapread 0x02d655 thru 0x0368cc (0x9278 bytes) 000715 1769056017.745372 read 0x02e9ed thru 0x03296d (0x3f81 bytes) 000716 1769056017.746057 trunc from 0x040000 to 0x00265a (0x3d9a5 bytes) 000719 1769056017.768040 write 0x0131e2 thru 0x01966e (0x648d bytes) 000720 1769056017.769482 read 0x008881 thru 0x017bf3 (0xf373 bytes) 000722 1769056017.778048 read 0x002111 thru 0x00ba07 (0x98f7 bytes) 000725 1769056017.780440 mapread 0x008f70 thru 0x0186d2 (0xf763 bytes) 000726 1769056017.782027 write 0x03f0db thru 0x03ffff (0xf25 bytes) 000727 1769056017.783329 mapread 0x03bb22 thru 0x03e338 (0x2817 bytes) 000729 1769056017.792931 mapwrite 0x005abf thru 0x010443 (0xa985 bytes) 000730 1769056017.838287 read 0x02ab52 thru 0x036f34 (0xc3e3 bytes) 000733 1769056017.839668 read 0x03484a thru 0x03befe (0x76b5 bytes) 000738 1769056017.846862 MIRROR_EXTEND to 2 mirrors 000739 1769056018.563900 trunc from 0x040000 to 0x014d3a (0x2b2c5 bytes) 000740 1769056018.759316 mapread 0x00e6a4 thru 0x014d3a (0x6697 bytes) 000743 1769056018.803460 trunc from 0x014d3b to 0x02a787 (0x15a4d bytes) 000744 1769056018.831493 read 0x01b1ec thru 0x021867 (0x667c bytes) 000748 1769056018.841960 mapwrite 0x02cce7 thru 0x03b4ce (0xe7e8 bytes) 000750 1769056018.946362 read 0x013663 thru 0x0192f3 (0x5c91 bytes) 000753 1769056018.956010 read 0x00bca7 thru 0x00c0ad (0x407 bytes) 000754 1769056018.957004 write 0x03a438 thru 0x03d4bd (0x3086 bytes) 000755 1769056018.958076 mapread 0x00aaa4 thru 0x016ea0 (0xc3fd bytes) 000756 1769056018.962766 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d4be): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d4be): Mirror 2: 0xb3cd948e (stale) CRC-32 checksum value for chunk [0, 0x3d4be): Mirror 1: 0xe676c241 Mirror 3: 0xe676c241 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d4be: skipped 000759 1769056019.846332 read 0x006495 thru 0x00dec6 (0x7a32 bytes) 000760 1769056019.858524 mapwrite 0x03e458 thru 0x03ffff (0x1ba8 bytes) 000761 1769056020.131444 trunc from 0x040000 to 0x00506b (0x3af94 bytes) 000765 1769056020.201577 read 0x001a63 thru 0x00506b (0x3609 bytes) 000766 1769056020.219488 mapread 0x003430 thru 0x00506b (0x1c3c bytes) 000767 1769056020.220236 write 0x0211c0 thru 0x026820 (0x5661 bytes) 000769 1769056020.223660 trunc from 0x026821 to 0x01ba7c (0xada4 bytes) 000770 1769056020.276586 MIRROR_RESYNC 3 mirrors 000771 1769056020.873580 write 0x02f959 thru 0x0320ea (0x2792 bytes) 000772 1769056020.939669 mapwrite 0x016cd2 thru 0x025a73 (0xeda2 bytes) 000773 1769056021.001349 write 0x02c92c thru 0x032a14 (0x60e9 bytes) 000774 1769056021.009930 write 0x017c09 thru 0x01a23a (0x2632 bytes) 000775 1769056021.014672 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x32a15): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32a15): Mirror 2: 0xa0ce76c1 (stale) Mirror 3: 0xa0ce76c1 (stale) CRC-32 checksum value for chunk [0, 0x32a15): Mirror 1: 0x43d77006 Mirror 4: 0x43d77006 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32a15: skipped 000777 1769056021.693027 mapread 0x027799 thru 0x032133 (0xa99b bytes) 000778 1769056021.734813 mapread 0x009054 thru 0x015d31 (0xccde bytes) 000779 1769056021.761547 trunc from 0x032a15 to 0x01e44a (0x145ca bytes) 000780 1769056021.845970 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1e44b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e44b): Mirror 2: 0x8c04f739 (stale) Mirror 3: 0x8c04f739 (stale) Mirror 4: 0x4ee952aa (stale) CRC-32 checksum value for chunk [0, 0x1e44b): Mirror 1: 0x4ee952aa Mirror 5: 0x4ee952aa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e44b: skipped 000781 1769056022.496125 mapread 0x00b589 thru 0x017cbc (0xc734 bytes) 000782 1769056022.529656 write 0x020eb0 thru 0x0227a5 (0x18f6 bytes) 000784 1769056022.616482 write 0x00368c thru 0x008db7 (0x572c bytes) 000787 1769056022.626777 read 0x0074e1 thru 0x01629e (0xedbe bytes) 000789 1769056022.636538 trunc from 0x0227a6 to 0x01e81c (0x3f89 bytes) 000790 1769056022.654660 write 0x0331e8 thru 0x03e05a (0xae73 bytes) 000792 1769056022.661409 MIRROR_RESYNC 5 mirrors 000796 1769056023.447726 read 0x017dff thru 0x01fe7f (0x8081 bytes) 000797 1769056023.455753 write 0x030233 thru 0x030a94 (0x862 bytes) 000798 1769056023.516016 trunc from 0x03e05b to 0x00b830 (0x3282a bytes) 000799 1769056023.535579 read 0x0087ef thru 0x00b830 (0x3042 bytes) 000800 1769056023.543874 read 0x006b7c thru 0x00735e (0x7e3 bytes) 000803 1769056023.548937 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xb831): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb831): Mirror 2: 0xe8c2770b (stale) Mirror 3: 0xe8c2770b (stale) Mirror 4: 0xe8c2770b (stale) Mirror 5: 0xe8c2770b (stale) CRC-32 checksum value for chunk [0, 0xb831): Mirror 1: 0xe8c2770b Mirror 6: 0xe8c2770b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb831: skipped 000804 1769056024.144480 mapread 0x005741 thru 0x00b830 (0x60f0 bytes) 000805 1769056024.167688 read 0x00b45b thru 0x00b830 (0x3d6 bytes) 000806 1769056024.171309 mapwrite 0x0107f6 thru 0x01940a (0x8c15 bytes) 000808 1769056024.342325 mapwrite 0x033028 thru 0x039a91 (0x6a6a bytes) 000809 1769056024.416684 mapread 0x005dd6 thru 0x00ca56 (0x6c81 bytes) 000813 1769056024.426698 write 0x02fd10 thru 0x03e571 (0xe862 bytes) 000815 1769056024.429891 trunc from 0x03e572 to 0x027fca (0x165a7 bytes) 000816 1769056024.448872 MIRROR_RESYNC 6 mirrors 000819 1769056025.389717 trunc from 0x027fcb to 0x01ca62 (0xb568 bytes) 000820 1769056025.467821 MIRROR_RESYNC 6 mirrors 000821 1769056026.286780 read 0x0093ae thru 0x0158fd (0xc550 bytes) 000823 1769056026.296040 read 0x00339f thru 0x0126ee (0xf350 bytes) 000825 1769056026.304257 mapread 0x00e2f8 thru 0x014c5c (0x6965 bytes) 000828 1769056026.305287 trunc from 0x01ca63 to 0x0215fa (0x4b98 bytes) 000829 1769056026.363762 read 0x005401 thru 0x0080bc (0x2cbc bytes) 000831 1769056026.376634 read 0x0199fc thru 0x0215fa (0x7bff bytes) 000832 1769056026.377227 read 0x000bbf thru 0x010851 (0xfc93 bytes) 000834 1769056026.378262 mapwrite 0x01b165 thru 0x028474 (0xd310 bytes) 000836 1769056026.448640 mapwrite 0x007d1e thru 0x016a3a (0xed1d bytes) 000837 1769056026.498784 mapread 0x025544 thru 0x027c5a (0x2717 bytes) 000838 1769056026.507259 MIRROR_RESYNC 6 mirrors 000839 1769056027.217514 MIRROR_EXTEND to 7 mirrors 000840 1769056027.735567 mapwrite 0x01beb7 thru 0x01dd2a (0x1e74 bytes) 000841 1769056027.881424 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x28475): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28475): Mirror 2: 0x5002163c (stale) Mirror 3: 0x5002163c (stale) Mirror 4: 0x5002163c (stale) Mirror 5: 0x5002163c (stale) Mirror 6: 0x5002163c (stale) Mirror 7: 0x5002163c (stale) CRC-32 checksum value for chunk [0, 0x28475): Mirror 1: 0xcb2c860b Mirror 8: 0xcb2c860b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28475: skipped 000842 1769056028.794027 mapread 0x0108a7 thru 0x01ed8b (0xe4e5 bytes) 000845 1769056028.849513 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x28475): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28475): Mirror 2: 0x5002163c (stale) Mirror 3: 0x5002163c (stale) Mirror 4: 0x5002163c (stale) Mirror 5: 0x5002163c (stale) Mirror 6: 0x5002163c (stale) Mirror 7: 0x5002163c (stale) CRC-32 checksum value for chunk [0, 0x28475): Mirror 1: 0xcb2c860b Mirror 8: 0xcb2c860b Mirror 9: 0xcb2c860b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28475: skipped 000847 1769056029.586220 read 0x011b3b thru 0x017054 (0x551a bytes) 000848 1769056029.601049 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28475): Mirror 3: 0x5002163c (stale) Mirror 4: 0x5002163c (stale) Mirror 5: 0x5002163c (stale) Mirror 6: 0x5002163c (stale) Mirror 7: 0x5002163c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28475): Mirror 3: 0x5002163c (stale) Mirror 4: 0x5002163c (stale) Mirror 5: 0x5002163c (stale) Mirror 6: 0x5002163c (stale) Mirror 7: 0x5002163c (stale) CRC-32 checksum value for chunk [0, 0x28475): Mirror 1: 0xcb2c860b Mirror 8: 0xcb2c860b Mirror 9: 0xcb2c860b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28475: skipped 000849 1769056030.128919 read 0x006862 thru 0x01508a (0xe829 bytes) 000851 1769056030.141921 mapread 0x001a2b thru 0x003dda (0x23b0 bytes) 000852 1769056030.156758 read 0x012e2c thru 0x019a04 (0x6bd9 bytes) 000853 1769056030.168955 trunc from 0x028475 to 0x035287 (0xce13 bytes) 000854 1769056030.267266 mapwrite 0x02648d thru 0x02a4c4 (0x4038 bytes) 000856 1769056030.355317 mapread 0x028a35 thru 0x029fab (0x1577 bytes) 000857 1769056030.356133 trunc from 0x035288 to 0x00241c (0x32e6b bytes) 000858 1769056030.390843 mapwrite 0x03c4e4 thru 0x03ffff (0x3b1c bytes) 000860 1769056030.493417 read 0x0280f2 thru 0x02be8d (0x3d9c bytes) 000861 1769056030.511807 trunc from 0x040000 to 0x00f6c9 (0x30936 bytes) 000862 1769056030.536890 trunc from 0x00f6ca to 0x00c823 (0x2ea6 bytes) 000864 1769056030.577537 mapread 0x002427 thru 0x003af5 (0x16cf bytes) 000866 1769056030.580406 trunc from 0x00c824 to 0x01ec41 (0x1241e bytes) 000868 1769056030.626273 write 0x02ae2b thru 0x03332b (0x8501 bytes) 000871 1769056030.633807 mapwrite 0x01d921 thru 0x023e49 (0x6529 bytes) 000872 1769056030.773302 mapread 0x020e50 thru 0x02ba31 (0xabe2 bytes) 000873 1769056030.831063 mapread 0x00acf6 thru 0x01a657 (0xf962 bytes) 000874 1769056030.948456 trunc from 0x03332c to 0x03194c (0x19df bytes) 000875 1769056030.995484 read 0x00d169 thru 0x01648b (0x9323 bytes) 000878 1769056031.004343 MIRROR_RESYNC 8 mirrors 000880 1769056032.056983 mapread 0x0194e5 thru 0x024740 (0xb25c bytes) 000882 1769056032.080958 mapwrite 0x0065c1 thru 0x007c45 (0x1685 bytes) 000885 1769056032.253109 mapread 0x024f9b thru 0x02587a (0x8e0 bytes) 000888 1769056032.268569 mapwrite 0x0066ca thru 0x0151d9 (0xeb10 bytes) 000889 1769056032.348267 mapread 0x010224 thru 0x013534 (0x3311 bytes) 000890 1769056032.359018 MIRROR_RESYNC 8 mirrors 000891 1769056033.579655 write 0x018b5d thru 0x021625 (0x8ac9 bytes) 000892 1769056033.643932 mapwrite 0x03998b thru 0x03ffff (0x6675 bytes) 000893 1769056033.725746 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3aee24b3 (stale) Mirror 5: 0x3aee24b3 (stale) Mirror 6: 0x3aee24b3 (stale) Mirror 7: 0x3aee24b3 (stale) Mirror 8: 0x3aee24b3 (stale) Mirror 9: 0x3aee24b3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3aee24b3 (stale) Mirror 5: 0x3aee24b3 (stale) Mirror 6: 0x3aee24b3 (stale) Mirror 7: 0x3aee24b3 (stale) Mirror 8: 0x3aee24b3 (stale) Mirror 9: 0x3aee24b3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000894 1769056034.115831 read 0x03ed45 thru 0x03ffff (0x12bb bytes) 000895 1769056034.126945 MIRROR_RESYNC 7 mirrors 000897 1769056035.350013 mapread 0x03202d thru 0x0374bc (0x5490 bytes) 000898 1769056035.419918 MIRROR_RESYNC 7 mirrors 000901 1769056036.239466 write 0x010d6f thru 0x011615 (0x8a7 bytes) 000903 1769056036.391464 write 0x021079 thru 0x02b600 (0xa588 bytes) 000904 1769056036.404418 mapwrite 0x019383 thru 0x01bec2 (0x2b40 bytes) 000909 1769056036.512200 mapwrite 0x02d326 thru 0x030171 (0x2e4c bytes) 000910 1769056036.645892 mapread 0x011252 thru 0x01aadf (0x988e bytes) 000911 1769056036.656732 write 0x005531 thru 0x0079ef (0x24bf bytes) 000913 1769056036.693545 write 0x00427f thru 0x00e179 (0x9efb bytes) 000915 1769056036.722831 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x89d54b64 (stale) Mirror 5: 0x89d54b64 (stale) Mirror 6: 0x89d54b64 (stale) Mirror 7: 0x89d54b64 (stale) Mirror 8: 0x89d54b64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x89d54b64 (stale) Mirror 5: 0x89d54b64 (stale) Mirror 6: 0x89d54b64 (stale) Mirror 7: 0x89d54b64 (stale) Mirror 8: 0x89d54b64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000918 1769056037.575986 mapread 0x01ae7d thru 0x02624e (0xb3d2 bytes) 000922 1769056037.645294 mapwrite 0x031a9c thru 0x03a160 (0x86c5 bytes) 000924 1769056037.814819 read 0x015295 thru 0x01ed17 (0x9a83 bytes) 000925 1769056037.819132 write 0x00b9fa thru 0x00e501 (0x2b08 bytes) 000928 1769056037.838637 mapwrite 0x00f76a thru 0x015d77 (0x660e bytes) 000930 1769056037.986767 mapwrite 0x00c419 thru 0x01808a (0xbc72 bytes) 000933 1769056038.096478 write 0x03be50 thru 0x03ffff (0x41b0 bytes) 000934 1769056038.097726 mapwrite 0x005b38 thru 0x00dda1 (0x826a bytes) 000935 1769056038.176089 trunc from 0x040000 to 0x01481e (0x2b7e1 bytes) 000938 1769056038.203932 mapwrite 0x035152 thru 0x03c996 (0x7845 bytes) 000940 1769056038.311512 trunc from 0x03c997 to 0x009a34 (0x32f62 bytes) 000941 1769056038.337281 read 0x00336d thru 0x006f6b (0x3bff bytes) 000942 1769056038.346817 mapwrite 0x00cd1b thru 0x01378e (0x6a74 bytes) 000943 1769056038.419265 mapwrite 0x013b81 thru 0x01b39d (0x781d bytes) 000944 1769056038.538814 mapread 0x00bf38 thru 0x011ccd (0x5d96 bytes) 000946 1769056038.540371 read 0x009773 thru 0x00c0ff (0x298d bytes) 000950 1769056038.550139 mapwrite 0x03bfe6 thru 0x03ffff (0x401a bytes) 000954 1769056038.705780 write 0x02e53a thru 0x03c931 (0xe3f8 bytes) 000955 1769056038.709234 write 0x010717 thru 0x0130d1 (0x29bb bytes) 000956 1769056038.710955 mapwrite 0x033ab6 thru 0x037038 (0x3583 bytes) 000958 1769056038.816762 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x89d54b64 (stale) Mirror 6: 0x89d54b64 (stale) Mirror 7: 0x89d54b64 (stale) Mirror 8: 0x89d54b64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x89d54b64 (stale) Mirror 6: 0x89d54b64 (stale) Mirror 7: 0x89d54b64 (stale) Mirror 8: 0x89d54b64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000959 1769056039.534151 write 0x01a217 thru 0x01ec1b (0x4a05 bytes) 000960 1769056039.584094 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x89d54b64 (stale) Mirror 6: 0x89d54b64 (stale) Mirror 7: 0x89d54b64 (stale) Mirror 8: 0x89d54b64 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbb45fa53 Mirror 9: 0xbb45fa53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000963 1769056040.972513 mapwrite 0x03ebb8 thru 0x03ffff (0x1448 bytes) 000964 1769056041.187716 write 0x03cf95 thru 0x03d8ec (0x958 bytes) 000966 1769056041.188725 read 0x01dd77 thru 0x02ba62 (0xdcec bytes) 000967 1769056041.198262 mapwrite 0x029a48 thru 0x02ef89 (0x5542 bytes) 000968 1769056041.340064 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x89d54b64 (stale) Mirror 7: 0x89d54b64 (stale) Mirror 8: 0x89d54b64 (stale) Mirror 9: 0xbb45fa53 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x89d54b64 (stale) Mirror 7: 0x89d54b64 (stale) Mirror 8: 0x89d54b64 (stale) Mirror 9: 0xbb45fa53 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000969 1769056041.831788 read 0x014345 thru 0x0221fc (0xdeb8 bytes) 000970 1769056041.842933 write 0x03e196 thru 0x03ffff (0x1e6a bytes) 000971 1769056041.849683 trunc from 0x040000 to 0x00b65f (0x349a0 bytes) 000972 1769056041.871556 trunc from 0x00b660 to 0x005ec4 (0x579b bytes) 000973 1769056041.894313 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x5ec5): Mirror 5: 0x45ba3152 (stale) Mirror 7: 0x45ba3152 (stale) Mirror 9: 0xd789b910 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5ec5): Mirror 5: 0x45ba3152 (stale) Mirror 7: 0x45ba3152 (stale) Mirror 9: 0xd789b910 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5ec5: skipped 000974 1769056042.146670 mapwrite 0x03f05e thru 0x03ffff (0xfa2 bytes) 000977 1769056042.237977 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x186:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x89d54b64 (stale) Mirror 7: 0x89d54b64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x89d54b64 (stale) Mirror 7: 0x89d54b64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000979 1769056042.582709 mapread 0x010066 thru 0x0181aa (0x8145 bytes) 000980 1769056042.600161 trunc from 0x040000 to 0x00c534 (0x33acb bytes) 000983 1769056042.616915 trunc from 0x00c535 to 0x03ec49 (0x32715 bytes) 000984 1769056042.637903 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3ec4a): Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec4a): Mirror 5: 0x4480738b (stale) Mirror 7: 0x4480738b (stale) CRC-32 checksum value for chunk [0, 0x3ec4a): Mirror 1: 0x5aaf9eea Mirror 8: 0x5aaf9eea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec4a: skipped 000986 1769056043.519880 trunc from 0x03ec4a to 0x035063 (0x9be6 bytes) 000987 1769056043.645824 write 0x0196d5 thru 0x028e67 (0xf793 bytes) 000989 1769056043.663426 MIRROR_RESYNC 4 mirrors 000990 1769056044.463488 mapwrite 0x00f7fc thru 0x013a17 (0x421c bytes) 000991 1769056044.736474 write 0x031f33 thru 0x03613f (0x420d bytes) 000992 1769056044.747884 trunc from 0x036140 to 0x00918c (0x2cfb3 bytes) 000994 1769056044.779451 trunc from 0x00918d to 0x02a8e9 (0x2175d bytes) 000995 1769056044.796433 mapwrite 0x02fa1a thru 0x03b425 (0xba0c bytes) 000998 1769056044.949183 trunc from 0x03b426 to 0x034764 (0x6cc1 bytes) 000999 1769056044.966698 mapwrite 0x01ab88 thru 0x0265b4 (0xba2d bytes) 001000 1769056045.030650 mapread 0x00cd15 thru 0x01476e (0x7a5a bytes) All operations completed A-OK!