== sanity-flr test 70a: flr mode fsx test ================ 04:26:52 (1787819212) Seed set to 9215 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x3ae4d 000002 1787819215.432666 trunc from 00000000 to 0x03ae4c (0x3ae4d bytes) 000007 1787819215.458405 read 0x01c1ff thru 0x028d15 (0xcb17 bytes) 000010 1787819215.477447 mapwrite 0x02f459 thru 0x03a818 (0xb3c0 bytes) 000011 1787819215.791637 read 0x037554 thru 0x03ae4c (0x38f9 bytes) 000013 1787819215.792712 read 0x008c9e thru 0x00bbdb (0x2f3e bytes) 000017 1787819215.827135 trunc from 0x03ae4d to 0x0329eb (0x8461 bytes) 000022 1787819215.892095 mapread 0x00090f thru 0x00e13b (0xd82d bytes) 000026 1787819215.901734 trunc from 0x0329ec to 0x015f3d (0x1caae bytes) 000028 1787819215.963493 MIRROR_EXTEND to 2 mirrors 000029 1787819217.183295 MIRROR_EXTEND to 3 mirrors 000030 1787819218.451524 mapread 0x01381b thru 0x014e6c (0x1652 bytes) 000031 1787819218.488378 write 0x01a5a9 thru 0x023520 (0x8f78 bytes) 000032 1787819218.600955 mapwrite 0x01c2f8 thru 0x02b8e1 (0xf5ea bytes) 000033 1787819218.749442 trunc from 0x02b8e2 to 0x021dfb (0x9ae6 bytes) 000034 1787819218.792990 trunc from 0x021dfc to 0x00dab5 (0x14346 bytes) 000035 1787819218.826434 mapread 0x0094a9 thru 0x00dab5 (0x460d bytes) 000036 1787819218.838794 trunc from 0x00dab6 to 0x01a905 (0xce50 bytes) 000037 1787819218.879112 read 0x010fd5 thru 0x012fc7 (0x1ff3 bytes) 000039 1787819218.890980 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1a906): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a906): Mirror 2: 0xd139314c (stale) Mirror 3: 0xd139314c (stale) CRC-32 checksum value for chunk [0, 0x1a906): Mirror 1: 0xd139314c Mirror 4: 0xd139314c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a906: skipped 000041 1787819220.445707 mapread 0x017f74 thru 0x019efd (0x1f8a bytes) 000044 1787819220.534057 mapread 0x0161cc thru 0x01a1db (0x4010 bytes) 000046 1787819220.560789 trunc from 0x01a906 to 0x02e67b (0x13d76 bytes) 000047 1787819220.688108 mapread 0x0062cc thru 0x016014 (0xfd49 bytes) 000049 1787819220.750096 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e67c): Mirror 3: 0xd4b21dc9 (stale) Mirror 4: 0xd4b21dc9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e67c): Mirror 3: 0xd4b21dc9 (stale) Mirror 4: 0xd4b21dc9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e67c: skipped 000053 1787819221.344970 write 0x02be69 thru 0x02c3de (0x576 bytes) 000054 1787819221.358012 trunc from 0x02e67c to 0x01ffd9 (0xe6a2 bytes) 000055 1787819221.373163 read 0x003a66 thru 0x004933 (0xece bytes) 000057 1787819221.382210 read 0x0071e7 thru 0x008566 (0x1380 bytes) 000058 1787819221.393027 mapread 0x006765 thru 0x011167 (0xaa03 bytes) 000060 1787819221.395473 mapwrite 0x012dd8 thru 0x014ede (0x2107 bytes) 000061 1787819221.503233 trunc from 0x01ffda to 0x029084 (0x90ab bytes) 000062 1787819221.565133 mapwrite 0x03d8c1 thru 0x03ffff (0x273f bytes) 000063 1787819221.765324 read 0x037370 thru 0x03ffff (0x8c90 bytes) 000065 1787819221.774854 trunc from 0x040000 to 0x01100d (0x2eff2 bytes) 000066 1787819221.831860 trunc from 0x01100e to 0x02f7fb (0x1e7ee bytes) 000067 1787819221.862032 trunc from 0x02f7fc to 0x017841 (0x17fba bytes) 000068 1787819221.938242 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17842): Mirror 3: 0x8eaba844 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17842): Mirror 3: 0x8eaba844 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17842: skipped 000069 1787819222.587457 read 0x005e28 thru 0x011e87 (0xc060 bytes) 000071 1787819222.611158 mapwrite 0x00de8e thru 0x01188f (0x3a02 bytes) 000072 1787819222.739783 write 0x02c4b5 thru 0x038533 (0xc07f bytes) 000073 1787819222.743343 mapwrite 0x02aeb5 thru 0x033453 (0x859f bytes) 000074 1787819222.935408 read 0x020360 thru 0x02c861 (0xc502 bytes) 000077 1787819222.973682 write 0x023dc5 thru 0x02f1be (0xb3fa bytes) 000078 1787819222.979421 write 0x03edc6 thru 0x03ffff (0x123a bytes) 000080 1787819222.982346 trunc from 0x040000 to 0x011ace (0x2e531 bytes) 000081 1787819223.015129 read 0x00ffe0 thru 0x0119e4 (0x1a05 bytes) 000083 1787819223.019957 trunc from 0x011acf to 0x01f757 (0xdc89 bytes) 000084 1787819223.038682 mapread 0x0122f8 thru 0x01e660 (0xc369 bytes) 000085 1787819223.055192 trunc from 0x01f758 to 0x00613c (0x1961b bytes) 000088 1787819223.078060 write 0x00dd0b thru 0x00df4f (0x245 bytes) 000089 1787819223.084072 mapread 0x005d6e thru 0x00df4f (0x81e2 bytes) 000090 1787819223.120861 trunc from 0x00df50 to 0x03a74f (0x2c800 bytes) 000091 1787819223.140612 mapwrite 0x033fdb thru 0x03cf12 (0x8f38 bytes) 000092 1787819223.299958 mapwrite 0x0068b0 thru 0x00d0be (0x680f bytes) 000093 1787819223.436976 mapwrite 0x0144b4 thru 0x01a915 (0x6462 bytes) 000097 1787819223.655351 trunc from 0x03cf13 to 0x02256e (0x1a9a4 bytes) 000098 1787819223.697983 trunc from 0x02256f to 0x00f46b (0x13103 bytes) 000099 1787819223.742205 trunc from 0x00f46c to 0x005d85 (0x96e6 bytes) 000100 1787819223.797973 mapwrite 0x00eeec thru 0x016343 (0x7458 bytes) 000101 1787819224.008259 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000102 1787819224.174496 read 0x008dd5 thru 0x00d6aa (0x48d6 bytes) 000108 1787819224.198058 trunc from 0x016344 to 0x01fb2a (0x97e7 bytes) 000109 1787819224.213640 mapwrite 0x0396e3 thru 0x03b6d6 (0x1ff4 bytes) 000110 1787819224.313551 trunc from 0x03b6d7 to 0x033922 (0x7db4 bytes) 000111 1787819224.350596 trunc from 0x033923 to 0x03641c (0x2afa bytes) 000112 1787819224.387036 read 0x0281e5 thru 0x028242 (0x5e bytes) 000116 1787819224.421725 write 0x01dec6 thru 0x028bcc (0xad07 bytes) 000124 1787819224.428162 write 0x0032c5 thru 0x004b4e (0x188a bytes) 000126 1787819224.429982 read 0x035179 thru 0x03641c (0x12a4 bytes) 000130 1787819224.432750 write 0x032ac9 thru 0x03ffff (0xd537 bytes) 000131 1787819224.435576 write 0x038f05 thru 0x03d7d5 (0x48d1 bytes) 000135 1787819224.439878 mapread 0x03b9a9 thru 0x03ba29 (0x81 bytes) 000138 1787819224.442011 mapread 0x013f1e thru 0x022c2d (0xed10 bytes) 000139 1787819224.443480 mapwrite 0x00ebc4 thru 0x015553 (0x6990 bytes) 000146 1787819224.537981 read 0x00b413 thru 0x01a67e (0xf26c bytes) 000147 1787819224.551878 MIRROR_EXTEND to 2 mirrors 000148 1787819225.965832 write 0x02bf9d thru 0x034cb2 (0x8d16 bytes) 000152 1787819226.062805 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000153 1787819226.214007 trunc from 0x040000 to 0x013ec5 (0x2c13a bytes) 000157 1787819226.239486 read 0x0080d4 thru 0x00b29f (0x31cc bytes) 000163 1787819226.252707 write 0x019eed thru 0x01f821 (0x5935 bytes) 000165 1787819226.255477 mapread 0x00c27c thru 0x01acf6 (0xea7b bytes) 000170 1787819226.282618 trunc from 0x01f822 to 0x01c46d (0x33b4 bytes) 000171 1787819226.298840 mapread 0x006133 thru 0x014254 (0xe122 bytes) 000172 1787819226.310525 mapwrite 0x01a564 thru 0x0200f4 (0x5b91 bytes) 000173 1787819226.396232 trunc from 0x0200f5 to 0x02724e (0x715a bytes) 000176 1787819226.427780 mapwrite 0x022ff1 thru 0x0298ca (0x68da bytes) 000177 1787819226.511692 trunc from 0x0298cb to 0x00904c (0x2087e bytes) 000180 1787819226.541607 mapwrite 0x000ae3 thru 0x000b93 (0xb1 bytes) 000181 1787819226.600504 MIRROR_EXTEND to 2 mirrors 000182 1787819227.870777 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000184 1787819228.046793 read 0x008dc0 thru 0x00904c (0x28d bytes) 000187 1787819228.053841 write 0x0001b9 thru 0x004359 (0x41a1 bytes) 000188 1787819228.084593 trunc from 0x00904d to 0x02c5f6 (0x235aa bytes) 000189 1787819228.134806 mapwrite 0x00d404 thru 0x016e71 (0x9a6e bytes) 000190 1787819228.231804 mapread 0x00845f thru 0x011373 (0x8f15 bytes) 000191 1787819228.232810 write 0x02cb81 thru 0x031884 (0x4d04 bytes) 000195 1787819228.240900 read 0x009dc8 thru 0x0118ee (0x7b27 bytes) 000198 1787819228.243623 mapwrite 0x023a91 thru 0x031133 (0xd6a3 bytes) 000199 1787819228.306470 read 0x02a3a5 thru 0x031884 (0x74e0 bytes) 000200 1787819228.307825 read 0x013c14 thru 0x01ee89 (0xb276 bytes) 000202 1787819228.309540 mapwrite 0x02679a thru 0x033a79 (0xd2e0 bytes) 000203 1787819228.394226 write 0x0135bd thru 0x01d38d (0x9dd1 bytes) 000204 1787819228.396568 read 0x0284a8 thru 0x02c653 (0x41ac bytes) 000205 1787819228.401641 MIRROR_EXTEND to 2 mirrors 000206 1787819230.014698 mapwrite 0x024837 thru 0x02ae61 (0x662b bytes) 000207 1787819230.196212 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x33a7a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33a7a): Mirror 2: 0xcde849ec (stale) CRC-32 checksum value for chunk [0, 0x33a7a): Mirror 1: 0xec629c00 Mirror 3: 0xec629c00 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33a7a: skipped 000209 1787819231.617876 write 0x02e146 thru 0x03c663 (0xe51e bytes) 000210 1787819231.758486 mapread 0x029ccd thru 0x02e785 (0x4ab9 bytes) 000213 1787819231.829610 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c664): Mirror 3: 0x241936c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c664): Mirror 3: 0x241936c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c664: skipped truncating to largest ever: 0x3de2f 000214 1787819232.159671 trunc from 0x03c664 to 0x03de2e (0x17cb bytes) 000217 1787819232.169588 mapwrite 0x03dbf8 thru 0x03ffff (0x2408 bytes) 000218 1787819232.218372 MIRROR_RESYNC 2 mirrors 000220 1787819233.254690 mapwrite 0x03f5bd thru 0x03ffff (0xa43 bytes) 000221 1787819233.526539 trunc from 0x040000 to 0x03b10c (0x4ef3 bytes) 000222 1787819233.630645 trunc from 0x03b10d to 0x0255b7 (0x15b55 bytes) 000224 1787819233.699542 mapwrite 0x0163ab thru 0x020e10 (0xaa66 bytes) 000228 1787819233.865410 trunc from 0x0255b8 to 0x025a35 (0x47e bytes) 000230 1787819233.898669 read 0x018271 thru 0x01b91e (0x36ae bytes) 000231 1787819233.911808 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x25a36): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25a36): Mirror 3: 0x26be934d (stale) CRC-32 checksum value for chunk [0, 0x25a36): Mirror 1: 0xf222d9e2 Mirror 4: 0xf222d9e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25a36: skipped 000233 1787819235.364240 trunc from 0x025a36 to 0x01d06a (0x89cb bytes) 000235 1787819235.469086 mapwrite 0x02d42b thru 0x03a4b5 (0xd08b bytes) 000237 1787819235.582065 MIRROR_RESYNC 3 mirrors 000240 1787819236.939917 read 0x008e68 thru 0x0189c2 (0xfb5b bytes) 000242 1787819236.946495 trunc from 0x03a4b6 to 0x02ede0 (0xb6d5 bytes) 000243 1787819237.039089 read 0x0258b5 thru 0x026275 (0x9c1 bytes) 000244 1787819237.053413 mapread 0x01a259 thru 0x020b4d (0x68f5 bytes) 000246 1787819237.055001 mapread 0x02a2b3 thru 0x02bdd3 (0x1b21 bytes) truncating to largest ever: 0x3e628 000247 1787819237.055893 trunc from 0x02ede1 to 0x03e627 (0xf847 bytes) 000248 1787819237.088694 trunc from 0x03e628 to 0x01c1f6 (0x22431 bytes) 000251 1787819237.109753 mapwrite 0x01e1d3 thru 0x02bcba (0xdae8 bytes) 000253 1787819237.225208 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2bcbb): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bcbb): Mirror 3: 0x3844a095 (stale) Mirror 4: 0x3844a095 (stale) CRC-32 checksum value for chunk [0, 0x2bcbb): Mirror 1: 0x4510b8de Mirror 5: 0x4510b8de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bcbb: skipped 000254 1787819238.493384 mapwrite 0x019292 thru 0x01cbaf (0x391e bytes) 000256 1787819238.776835 read 0x01322e thru 0x016f21 (0x3cf4 bytes) 000257 1787819238.781537 write 0x01f677 thru 0x02d105 (0xda8f bytes) 000259 1787819238.795789 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2d106): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d106): Mirror 3: 0x17738741 (stale) Mirror 4: 0x17738741 (stale) Mirror 5: 0x6884af6c (stale) CRC-32 checksum value for chunk [0, 0x2d106): Mirror 1: 0xcd28f6e3 Mirror 6: 0xcd28f6e3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d106: skipped 000261 1787819240.604950 mapread 0x0009d0 thru 0x004008 (0x3639 bytes) 000264 1787819240.647721 trunc from 0x02d106 to 0x0230b3 (0xa052 bytes) 000265 1787819240.932599 mapread 0x020054 thru 0x0230b3 (0x3060 bytes) 000266 1787819240.976021 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x230b4): Mirror 3: 0x8b66ce22 (stale) Mirror 5: 0x580c49e6 (stale) Mirror 6: 0xd28c61e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x230b4): Mirror 3: 0x8b66ce22 (stale) Mirror 5: 0x580c49e6 (stale) Mirror 6: 0xd28c61e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x230b4: skipped 000271 1787819241.479480 MIRROR_RESYNC 4 mirrors 000272 1787819243.459062 read 0x009179 thru 0x009356 (0x1de bytes) 000273 1787819243.464173 trunc from 0x0230b4 to 0x01396b (0xf748 bytes) 000276 1787819243.541830 mapwrite 0x0136e8 thru 0x01e0cd (0xa9e6 bytes) 000277 1787819243.711015 write 0x00fc28 thru 0x01b6ae (0xba87 bytes) 000278 1787819243.714432 write 0x023be0 thru 0x0243af (0x7d0 bytes) 000279 1787819243.716693 read 0x0114d6 thru 0x011730 (0x25b bytes) 000281 1787819243.719906 trunc from 0x0243b0 to 0x020b47 (0x3868 bytes) 000282 1787819243.740777 read 0x01541d thru 0x01fe87 (0xaa6b bytes) 000284 1787819243.755420 mapread 0x01de4e thru 0x020b47 (0x2cfa bytes) 000285 1787819243.756748 write 0x0110f6 thru 0x01b57d (0xa488 bytes) 000286 1787819243.759100 write 0x016756 thru 0x022267 (0xbb12 bytes) 000289 1787819243.762425 trunc from 0x022268 to 0x020407 (0x1e60 bytes) 000290 1787819243.779543 mapwrite 0x005549 thru 0x00dfbe (0x8a76 bytes) 000291 1787819243.926283 write 0x005a8a thru 0x0084c2 (0x2a39 bytes) 000292 1787819243.928029 trunc from 0x020408 to 0x01f99d (0xa6a bytes) 000293 1787819243.954843 write 0x020c67 thru 0x0245f2 (0x398c bytes) 000294 1787819243.956180 mapwrite 0x0177e2 thru 0x02090c (0x912b bytes) 000296 1787819244.027511 mapread 0x01b60c thru 0x021c2b (0x6620 bytes) 000298 1787819244.048882 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x245f3): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x245f3): Mirror 3: 0xd393f844 (stale) Mirror 5: 0xd393f844 (stale) Mirror 6: 0xd393f844 (stale) CRC-32 checksum value for chunk [0, 0x245f3): Mirror 1: 0x48fe8f9f Mirror 7: 0x48fe8f9f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x245f3: skipped 000300 1787819245.715742 write 0x01a34f thru 0x01dde6 (0x3a98 bytes) 000302 1787819245.885968 write 0x015d16 thru 0x024fbd (0xf2a8 bytes) 000303 1787819245.905717 mapwrite 0x01aa0a thru 0x01d346 (0x293d bytes) 000304 1787819245.981668 read 0x00073c thru 0x000765 (0x2a bytes) 000307 1787819245.994534 mapread 0x006cb5 thru 0x010995 (0x9ce1 bytes) 000311 1787819246.030641 mapread 0x001160 thru 0x00d6c1 (0xc562 bytes) 000315 1787819246.034254 mapread 0x008914 thru 0x00d2c3 (0x49b0 bytes) 000318 1787819246.038619 trunc from 0x024fbe to 0x0391d0 (0x14213 bytes) 000319 1787819246.088484 read 0x034336 thru 0x038241 (0x3f0c bytes) 000320 1787819246.120754 trunc from 0x0391d1 to 0x00923a (0x2ff96 bytes) 000321 1787819246.163835 mapread 0x001374 thru 0x00923a (0x7ec7 bytes) 000322 1787819246.182555 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x923b): Mirror 3: 0xbfcfd811 (stale) Mirror 5: 0xbfcfd811 (stale) Mirror 6: 0xbfcfd811 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x923b): Mirror 3: 0xbfcfd811 (stale) Mirror 5: 0xbfcfd811 (stale) Mirror 6: 0xbfcfd811 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x923b: skipped 000323 1787819246.809533 read 0x001f1b thru 0x00923a (0x7320 bytes) 000327 1787819246.819594 mapread 0x00474b thru 0x00923a (0x4af0 bytes) 000329 1787819246.820878 write 0x021641 thru 0x028912 (0x72d2 bytes) truncating to largest ever: 0x3e871 000331 1787819246.841390 trunc from 0x028913 to 0x03e870 (0x15f5e bytes) 000332 1787819246.875825 trunc from 0x03e871 to 0x03e65a (0x216 bytes) 000334 1787819246.903098 mapread 0x033eb6 thru 0x035f2a (0x2075 bytes) 000336 1787819246.927485 mapread 0x03b107 thru 0x03e65a (0x3554 bytes) 000337 1787819246.934455 write 0x0219a1 thru 0x022f64 (0x15c4 bytes) 000338 1787819246.935974 mapwrite 0x024ed7 thru 0x02d8ea (0x8a14 bytes) 000339 1787819247.046703 mapread 0x02d7fe thru 0x02ebae (0x13b1 bytes) 000340 1787819247.059094 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e65b): Mirror 3: 0x9f151978 (stale) Mirror 5: 0x9f151978 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e65b): Mirror 3: 0x9f151978 (stale) Mirror 5: 0x9f151978 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e65b: skipped 000341 1787819247.410583 mapread 0x026d29 thru 0x02a62e (0x3906 bytes) 000342 1787819247.462856 read 0x02a9b0 thru 0x02e5be (0x3c0f bytes) 000343 1787819247.492160 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e65b): Mirror 5: 0x9f151978 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e65b): Mirror 5: 0x9f151978 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e65b: skipped 000346 1787819248.067785 write 0x02ddc4 thru 0x036050 (0x828d bytes) 000347 1787819248.100738 mapread 0x012087 thru 0x01b23e (0x91b8 bytes) 000349 1787819248.136021 write 0x0150fb thru 0x022ad6 (0xd9dc bytes) 000352 1787819248.165520 trunc from 0x03e65b to 0x01b4a0 (0x231ba bytes) 000356 1787819248.221804 trunc from 0x01b4a1 to 0x03d26f (0x21dcf bytes) 000358 1787819248.256131 mapread 0x01b83d thru 0x01f9bd (0x4181 bytes) 000359 1787819248.276189 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d270): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d270): Mirror 5: 0x3864f4f (stale) CRC-32 checksum value for chunk [0, 0x3d270): Mirror 1: 0x330d6862 Mirror 6: 0x330d6862 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d270: skipped 000363 1787819249.846893 read 0x019a8f thru 0x020e8b (0x73fd bytes) 000364 1787819249.857037 trunc from 0x03d270 to 0x00c0ca (0x311a5 bytes) 000365 1787819249.928094 read 0x0008a1 thru 0x003474 (0x2bd4 bytes) 000367 1787819249.943171 mapread 0x002af1 thru 0x00c0ca (0x95da bytes) 000368 1787819249.947162 mapread 0x007752 thru 0x00c0ca (0x4979 bytes) 000369 1787819249.948983 write 0x01cd57 thru 0x020efa (0x41a4 bytes) 000370 1787819249.950279 mapread 0x010831 thru 0x01a76b (0x9f3b bytes) 000373 1787819249.981863 mapwrite 0x03bc5c thru 0x03ffff (0x43a4 bytes) 000374 1787819250.095525 write 0x02d159 thru 0x02ed7f (0x1c27 bytes) 000375 1787819250.098441 write 0x024cf2 thru 0x02e8da (0x9be9 bytes) 000376 1787819250.105564 MIRROR_RESYNC 3 mirrors 000377 1787819251.620546 read 0x00c7b6 thru 0x0110e1 (0x492c bytes) 000378 1787819251.633668 trunc from 0x040000 to 0x02c53d (0x13ac2 bytes) 000379 1787819251.872668 mapwrite 0x03e437 thru 0x03ffff (0x1bc9 bytes) 000384 1787819252.041995 write 0x03b85b thru 0x03c837 (0xfdd bytes) 000385 1787819252.072945 trunc from 0x040000 to 0x019dbb (0x26244 bytes) 000387 1787819252.102373 read 0x008ba6 thru 0x0176f1 (0xeb4c bytes) 000388 1787819252.152873 MIRROR_RESYNC 3 mirrors 000389 1787819253.356674 read 0x010a36 thru 0x015637 (0x4c02 bytes) 000390 1787819253.370735 mapread 0x013808 thru 0x018a94 (0x528d bytes) 000392 1787819253.395695 read 0x013362 thru 0x019775 (0x6414 bytes) 000394 1787819253.398653 mapwrite 0x014874 thru 0x01eae5 (0xa272 bytes) 000395 1787819253.679389 trunc from 0x01eae6 to 0x026586 (0x7aa1 bytes) 000397 1787819253.713073 mapwrite 0x020471 thru 0x029125 (0x8cb5 bytes) 000398 1787819253.822271 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x29126): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29126): Mirror 5: 0xe65f0b2d (stale) Mirror 6: 0xe65f0b2d (stale) CRC-32 checksum value for chunk [0, 0x29126): Mirror 1: 0xfcf28aac Mirror 7: 0xfcf28aac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29126: skipped 000400 1787819255.114018 trunc from 0x029126 to 0x02cb9a (0x3a75 bytes) 000401 1787819255.222610 read 0x02b4e7 thru 0x02cb9a (0x16b4 bytes) 000402 1787819255.230912 mapwrite 0x024ede thru 0x034420 (0xf543 bytes) 000403 1787819255.373394 MIRROR_RESYNC 4 mirrors 000405 1787819256.771177 read 0x00a1e6 thru 0x013a9a (0x98b5 bytes) 000408 1787819256.789448 mapread 0x01490d thru 0x01b793 (0x6e87 bytes) 000410 1787819256.816639 mapread 0x029614 thru 0x034420 (0xae0d bytes) 000411 1787819256.860164 MIRROR_RESYNC 4 mirrors 000412 1787819257.420572 mapread 0x02f18b thru 0x034420 (0x5296 bytes) 000413 1787819257.421174 trunc from 0x034421 to 0x007dde (0x2c642 bytes) 000414 1787819257.512153 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x7ddf): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7ddf): Mirror 5: 0xbf0630c5 (stale) Mirror 6: 0xbf0630c5 (stale) Mirror 7: 0xbf0630c5 (stale) CRC-32 checksum value for chunk [0, 0x7ddf): Mirror 1: 0xbf0630c5 Mirror 8: 0xbf0630c5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7ddf: skipped 000415 1787819258.744854 mapread 0x0036a0 thru 0x005371 (0x1cd2 bytes) 000417 1787819258.780220 write 0x029946 thru 0x02bdc3 (0x247e bytes) 000420 1787819258.878741 read 0x0233fb thru 0x02a5bb (0x71c1 bytes) 000421 1787819258.889716 trunc from 0x02bdc4 to 0x027317 (0x4aac bytes) 000423 1787819258.921995 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27318): Mirror 6: 0x527d192e (stale) Mirror 7: 0x527d192e (stale) Mirror 8: 0x8dc5bb73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27318): Mirror 6: 0x527d192e (stale) Mirror 7: 0x527d192e (stale) Mirror 8: 0x8dc5bb73 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27318: skipped 000424 1787819259.300612 mapwrite 0x017708 thru 0x02762f (0xff28 bytes) 000425 1787819259.404640 write 0x02a880 thru 0x03a17b (0xf8fc bytes) 000426 1787819259.407732 mapread 0x02b561 thru 0x02ede3 (0x3883 bytes) 000427 1787819259.409455 read 0x00cee2 thru 0x016a61 (0x9b80 bytes) 000429 1787819259.419268 write 0x000b3a thru 0x00ea9e (0xdf65 bytes) 000432 1787819259.428679 write 0x032ddc thru 0x03ffff (0xd224 bytes) 000433 1787819259.430736 write 0x03468b thru 0x034a72 (0x3e8 bytes) 000436 1787819259.433600 mapread 0x01c184 thru 0x01d2ef (0x116c bytes) 000437 1787819259.439603 write 0x00c57e thru 0x018dc9 (0xc84c bytes) 000439 1787819259.442688 write 0x0326e6 thru 0x03ffff (0xd91a bytes) 000442 1787819259.446755 trunc from 0x040000 to 0x037563 (0x8a9c bytes) 000443 1787819259.467122 MIRROR_RESYNC 4 mirrors 000444 1787819260.918098 write 0x02a022 thru 0x0373e4 (0xd3c3 bytes) 000445 1787819261.107619 MIRROR_RESYNC 4 mirrors 000446 1787819262.107442 mapread 0x0060b1 thru 0x014458 (0xe3a8 bytes) 000447 1787819262.134478 mapread 0x03353c thru 0x037563 (0x4028 bytes) 000448 1787819262.146521 mapread 0x01ef5e thru 0x029f31 (0xafd4 bytes) 000451 1787819262.164833 read 0x0250e1 thru 0x026c49 (0x1b69 bytes) 000455 1787819262.166062 write 0x035dac thru 0x037bef (0x1e44 bytes) 000456 1787819262.230615 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x37bf0): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37bf0): Mirror 6: 0x165742ca (stale) Mirror 7: 0x165742ca (stale) Mirror 8: 0x165742ca (stale) CRC-32 checksum value for chunk [0, 0x37bf0): Mirror 1: 0xeadb2fe0 Mirror 9: 0xeadb2fe0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37bf0: skipped 000457 1787819263.065919 mapwrite 0x00db1d thru 0x01c442 (0xe926 bytes) 000458 1787819263.253508 read 0x02ee0c thru 0x02f040 (0x235 bytes) 000459 1787819263.260724 write 0x01db9c thru 0x02642a (0x888f bytes) 000460 1787819263.270054 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x37bf0): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37bf0): Mirror 6: 0x165742ca (stale) Mirror 7: 0x165742ca (stale) Mirror 8: 0x165742ca (stale) Mirror 9: 0xeadb2fe0 (stale) CRC-32 checksum value for chunk [0, 0x37bf0): Mirror 1: 0x25980ded Mirror 10: 0x25980ded lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37bf0: skipped 000462 1787819264.311908 trunc from 0x037bf0 to 0x019ce7 (0x1df08 bytes) 000463 1787819264.432554 mapwrite 0x01515f thru 0x017474 (0x2316 bytes) 000467 1787819264.533814 trunc from 0x019ce8 to 0x02300d (0x9326 bytes) 000469 1787819264.570026 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2300e): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2300e): Mirror 6: 0x3c998f0b (stale) Mirror 7: 0x3c998f0b (stale) Mirror 8: 0x3c998f0b (stale) Mirror 9: 0x3c998f0b (stale) Mirror 10: 0x6942c8e0 (stale) CRC-32 checksum value for chunk [0, 0x2300e): Mirror 1: 0x955623c Mirror 11: 0x955623c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2300e: skipped 000471 1787819265.605248 trunc from 0x02300e to 0x00dea5 (0x15168 bytes) 000473 1787819265.682054 write 0x03a041 thru 0x03ffff (0x5fbf bytes) 000476 1787819265.690231 trunc from 0x040000 to 0x020a4f (0x1f5b0 bytes) 000477 1787819265.718867 mapread 0x0006b8 thru 0x00a1ad (0x9af6 bytes) 000480 1787819265.747529 mapwrite 0x03b9ab thru 0x03ffff (0x4655 bytes) 000481 1787819265.831490 write 0x01e742 thru 0x0263ca (0x7c89 bytes) 000483 1787819265.851678 MIRROR_RESYNC 7 mirrors 000485 1787819268.433220 mapread 0x008110 thru 0x014d47 (0xcc38 bytes) 000486 1787819268.476950 mapread 0x03f3a0 thru 0x03ffff (0xc60 bytes) 000490 1787819268.489912 trunc from 0x040000 to 0x01b9da (0x24625 bytes) 000491 1787819268.574674 mapread 0x0154d8 thru 0x01b9da (0x6503 bytes) 000492 1787819268.587147 write 0x000ab0 thru 0x00d8c3 (0xce14 bytes) 000494 1787819268.599581 mapwrite 0x00f306 thru 0x0157db (0x64d6 bytes) 000496 1787819268.665921 mapwrite 0x01c8b0 thru 0x02c5c8 (0xfd19 bytes) 000499 1787819268.792666 mapwrite 0x0356be thru 0x03ffff (0xa942 bytes) 000500 1787819268.894863 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x2fea631 (stale) Mirror 7: 0x2fea631 (stale) Mirror 8: 0x2fea631 (stale) Mirror 9: 0x2fea631 (stale) Mirror 10: 0x2fea631 (stale) Mirror 11: 0x2fea631 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa9a5d152 Mirror 12: 0xa9a5d152 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000501 1787819270.264535 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x2fea631 (stale) Mirror 7: 0x2fea631 (stale) Mirror 8: 0x2fea631 (stale) Mirror 9: 0x2fea631 (stale) Mirror 10: 0x2fea631 (stale) Mirror 11: 0x2fea631 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa9a5d152 Mirror 12: 0xa9a5d152 Mirror 13: 0xa9a5d152 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000503 1787819271.500089 read 0x017c3e thru 0x024c3a (0xcffd bytes) 000504 1787819271.521241 mapwrite 0x00f1fb thru 0x01d1f2 (0xdff8 bytes) 000505 1787819271.840829 read 0x002fd4 thru 0x012888 (0xf8b5 bytes) 000506 1787819271.850889 trunc from 0x040000 to 0x01fa68 (0x20597 bytes) 000507 1787819271.873951 write 0x02393a thru 0x0291bb (0x5882 bytes) 000508 1787819271.878215 read 0x006c16 thru 0x015533 (0xe91e bytes) 000509 1787819271.879327 read 0x00f382 thru 0x01b79a (0xc419 bytes) 000510 1787819271.883477 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x291bc): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x291bc): Mirror 6: 0x802d7c8a (stale) Mirror 7: 0x802d7c8a (stale) Mirror 8: 0x802d7c8a (stale) Mirror 9: 0x802d7c8a (stale) Mirror 10: 0x802d7c8a (stale) Mirror 11: 0x802d7c8a (stale) Mirror 12: 0xb5e36a44 (stale) Mirror 13: 0xb5e36a44 (stale) CRC-32 checksum value for chunk [0, 0x291bc): Mirror 1: 0x36c81b25 Mirror 14: 0x36c81b25 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x291bc: skipped 000511 1787819273.326281 read 0x00ec83 thru 0x01e0b1 (0xf42f bytes) 000512 1787819273.336233 mapwrite 0x01b327 thru 0x02b139 (0xfe13 bytes) 000514 1787819273.525952 trunc from 0x02b13a to 0x0097c4 (0x21975 bytes) 000515 1787819273.555157 trunc from 0x0097c5 to 0x02b6aa (0x21ee6 bytes) 000517 1787819273.577499 mapread 0x01a93e thru 0x028259 (0xd91c bytes) 000518 1787819273.608047 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2b6ab): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b6ab): Mirror 6: 0xeb4a7b8f (stale) Mirror 7: 0xeb4a7b8f (stale) Mirror 8: 0xeb4a7b8f (stale) Mirror 9: 0xeb4a7b8f (stale) Mirror 10: 0xeb4a7b8f (stale) Mirror 11: 0xeb4a7b8f (stale) Mirror 12: 0x6506d606 (stale) Mirror 13: 0x6506d606 (stale) Mirror 14: 0x1df4d1d5 (stale) CRC-32 checksum value for chunk [0, 0x2b6ab): Mirror 1: 0x108c6714 Mirror 15: 0x108c6714 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b6ab: skipped 000519 1787819274.925404 trunc from 0x02b6ab to 0x0247bb (0x6eef bytes) 000520 1787819275.081635 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x247bc): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x247bc): Mirror 6: 0xc13a26cc (stale) Mirror 7: 0xc13a26cc (stale) Mirror 8: 0xc13a26cc (stale) Mirror 9: 0xc13a26cc (stale) Mirror 10: 0xc13a26cc (stale) Mirror 11: 0xc13a26cc (stale) Mirror 12: 0x878b784c (stale) Mirror 13: 0x878b784c (stale) Mirror 14: 0x96508b1c (stale) Mirror 15: 0xd8ec155b (stale) CRC-32 checksum value for chunk [0, 0x247bc): Mirror 1: 0xd8ec155b Mirror 16: 0xd8ec155b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x247bc: skipped 000521 1787819276.585551 read 0x0098f1 thru 0x00b6c2 (0x1dd2 bytes) 000526 1787819276.623924 mapwrite 0x026b4f thru 0x034e41 (0xe2f3 bytes) 000529 1787819276.862506 write 0x010754 thru 0x01f623 (0xeed0 bytes) 000532 1787819276.893469 trunc from 0x034e42 to 0x031ac1 (0x3380 bytes) 000533 1787819276.933431 read 0x02cec7 thru 0x031ac1 (0x4bfb bytes) 000535 1787819276.941583 MIRROR_RESYNC 12 mirrors 000536 1787819280.660510 MIRROR_EXTEND to 13 mirrors 000538 1787819281.569964 write 0x01f3dc thru 0x022ce7 (0x390c bytes) 000540 1787819281.718748 read 0x01801b thru 0x01bc80 (0x3c66 bytes) 000542 1787819281.729886 mapread 0x00005b thru 0x00dc77 (0xdc1d bytes) 000543 1787819281.783953 trunc from 0x031ac2 to 0x021079 (0x10a48 bytes) 000546 1787819281.851006 mapread 0x0196fb thru 0x021079 (0x797f bytes) 000547 1787819281.880098 write 0x028947 thru 0x02f4c4 (0x6b7e bytes) 000548 1787819281.889364 read 0x01ebd3 thru 0x02dff5 (0xf423 bytes) 000551 1787819281.911813 mapread 0x024251 thru 0x02f4c4 (0xb274 bytes) 000552 1787819281.913567 trunc from 0x02f4c5 to 0x009e7b (0x25649 bytes) 000553 1787819281.955054 write 0x0296d5 thru 0x0343a3 (0xaccf bytes) 000555 1787819281.957406 trunc from 0x0343a4 to 0x00a2c9 (0x2a0da bytes) 000556 1787819281.990483 mapwrite 0x039df1 thru 0x03ffff (0x620f bytes) 000557 1787819282.118550 read 0x012e4d thru 0x01af52 (0x8106 bytes) 000558 1787819282.145434 read 0x00d74a thru 0x01aa0b (0xd2c2 bytes) 000561 1787819282.150590 mapwrite 0x026c04 thru 0x02f625 (0x8a22 bytes) 000564 1787819282.221647 MIRROR_RESYNC 13 mirrors 000565 1787819285.672605 read 0x030faf thru 0x03cd67 (0xbdb9 bytes) 000567 1787819285.692373 mapwrite 0x0025aa thru 0x005cca (0x3721 bytes) 000569 1787819285.828990 trunc from 0x040000 to 0x021508 (0x1eaf7 bytes) 000571 1787819285.855631 write 0x01f1a8 thru 0x02ed3e (0xfb97 bytes) 000574 1787819285.863929 mapread 0x01fbad thru 0x025858 (0x5cac bytes) 000575 1787819285.869231 MIRROR_SPLIT mirror 3 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ed3f): Mirror 6: 0x5ddaa7a0 (stale) Mirror 7: 0x5ddaa7a0 (stale) Mirror 9: 0x5ddaa7a0 (stale) Mirror 10: 0x5ddaa7a0 (stale) Mirror 11: 0x5ddaa7a0 (stale) Mirror 12: 0x5ddaa7a0 (stale) Mirror 13: 0x5ddaa7a0 (stale) Mirror 14: 0x5ddaa7a0 (stale) Mirror 15: 0x5ddaa7a0 (stale) Mirror 16: 0x5ddaa7a0 (stale) Mirror 17: 0x5ddaa7a0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ed3f): Mirror 6: 0x5ddaa7a0 (stale) Mirror 7: 0x5ddaa7a0 (stale) Mirror 9: 0x5ddaa7a0 (stale) Mirror 10: 0x5ddaa7a0 (stale) Mirror 11: 0x5ddaa7a0 (stale) Mirror 12: 0x5ddaa7a0 (stale) Mirror 13: 0x5ddaa7a0 (stale) Mirror 14: 0x5ddaa7a0 (stale) Mirror 15: 0x5ddaa7a0 (stale) Mirror 16: 0x5ddaa7a0 (stale) Mirror 17: 0x5ddaa7a0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ed3f: skipped 000576 1787819286.631847 write 0x00a563 thru 0x017307 (0xcda5 bytes) 000577 1787819286.643698 trunc from 0x02ed3f to 0x00bfc2 (0x22d7c bytes) 000578 1787819286.663070 write 0x0219ef thru 0x028e52 (0x7464 bytes) 000580 1787819286.665066 trunc from 0x028e53 to 0x0349a2 (0xbb50 bytes) 000582 1787819286.689747 read 0x000c2b thru 0x0075ec (0x69c2 bytes) 000583 1787819286.699919 trunc from 0x0349a3 to 0x0389da (0x4038 bytes) 000585 1787819286.715122 mapread 0x0275f0 thru 0x02a3cf (0x2de0 bytes) 000586 1787819286.727799 mapwrite 0x001544 thru 0x00bff0 (0xaaad bytes) 000587 1787819286.804358 read 0x011a19 thru 0x017812 (0x5dfa bytes) 000588 1787819286.816823 write 0x00bd7b thru 0x013c8c (0x7f12 bytes) 000590 1787819286.820720 mapread 0x00ea13 thru 0x013c06 (0x51f4 bytes) 000591 1787819286.822264 write 0x03e4b7 thru 0x03ffff (0x1b49 bytes) 000592 1787819286.824038 write 0x0102bf thru 0x01300e (0x2d50 bytes) 000593 1787819286.826255 mapwrite 0x001459 thru 0x001e72 (0xa1a bytes) 000594 1787819286.878099 write 0x01adfa thru 0x025843 (0xaa4a bytes) 000595 1787819286.880837 write 0x01e758 thru 0x0299fb (0xb2a4 bytes) 000596 1787819286.887758 write 0x009ebc thru 0x012bcc (0x8d11 bytes) 000597 1787819286.890678 read 0x01336b thru 0x01eb4a (0xb7e0 bytes) 000599 1787819286.892805 write 0x018ef8 thru 0x01e792 (0x589b bytes) 000604 1787819286.901197 mapwrite 0x02bc5a thru 0x02bc5c (0x3 bytes) 000605 1787819286.965693 mapread 0x009fbb thru 0x00cc1d (0x2c63 bytes) 000607 1787819286.967167 mapwrite 0x029815 thru 0x038ff8 (0xf7e4 bytes) 000608 1787819287.029458 trunc from 0x040000 to 0x011f53 (0x2e0ac bytes) 000609 1787819287.056706 MIRROR_RESYNC 12 mirrors 000610 1787819288.537636 MIRROR_SPLIT mirror 9 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000614 1787819288.960325 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000616 1787819289.345969 read 0x001cbc thru 0x00cd99 (0xb0de bytes) 000619 1787819289.360695 MIRROR_RESYNC 10 mirrors 000621 1787819289.970898 trunc from 0x011f54 to 0x015609 (0x36b6 bytes) 000622 1787819290.071124 trunc from 0x01560a to 0x03a073 (0x24a6a bytes) 000623 1787819290.093237 mapwrite 0x022b50 thru 0x02bf84 (0x9435 bytes) 000624 1787819290.175670 trunc from 0x03a074 to 0x034a2c (0x5647 bytes) 000628 1787819290.193415 read 0x007b9e thru 0x00b868 (0x3ccb bytes) 000629 1787819290.202578 trunc from 0x034a2d to 0x00baeb (0x28f41 bytes) 000630 1787819290.219235 trunc from 0x00baec to 0x011cf6 (0x620b bytes) 000631 1787819290.240644 read 0x00f923 thru 0x011cf6 (0x23d4 bytes) 000632 1787819290.248940 mapwrite 0x037812 thru 0x03c19c (0x498b bytes) 000633 1787819290.329860 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3c19d): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c19d): Mirror 6: 0x7ce77b95 (stale) Mirror 7: 0x7ce77b95 (stale) Mirror 10: 0x7ce77b95 (stale) Mirror 11: 0x7ce77b95 (stale) Mirror 12: 0x7ce77b95 (stale) Mirror 13: 0x7ce77b95 (stale) Mirror 14: 0x7ce77b95 (stale) Mirror 16: 0x7ce77b95 (stale) Mirror 17: 0x7ce77b95 (stale) CRC-32 checksum value for chunk [0, 0x3c19d): Mirror 1: 0xc7a4f34a Mirror 18: 0xc7a4f34a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c19d: skipped 000636 1787819291.923145 mapwrite 0x032ace thru 0x033710 (0xc43 bytes) 000637 1787819292.181992 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3c19d): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c19d): Mirror 6: 0x7ce77b95 (stale) Mirror 7: 0x7ce77b95 (stale) Mirror 10: 0x7ce77b95 (stale) Mirror 11: 0x7ce77b95 (stale) Mirror 12: 0x7ce77b95 (stale) Mirror 13: 0x7ce77b95 (stale) Mirror 14: 0x7ce77b95 (stale) Mirror 16: 0x7ce77b95 (stale) Mirror 17: 0x7ce77b95 (stale) Mirror 18: 0xc7a4f34a (stale) CRC-32 checksum value for chunk [0, 0x3c19d): Mirror 1: 0x49aaba34 Mirror 19: 0x49aaba34 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c19d: skipped 000638 1787819293.530016 MIRROR_RESYNC 12 mirrors 000639 1787819296.885818 read 0x019a66 thru 0x026ff8 (0xd593 bytes) 000640 1787819296.895773 trunc from 0x03c19d to 0x034693 (0x7b09 bytes) 000641 1787819297.033196 MIRROR_RESYNC 12 mirrors 000643 1787819299.884239 MIRROR_EXTEND to 13 mirrors 000644 1787819300.702943 mapwrite 0x028060 thru 0x0346a4 (0xc645 bytes) 000645 1787819300.878766 read 0x0290e9 thru 0x02bc5f (0x2b77 bytes) 000646 1787819300.884478 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x346a5): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x346a5): Mirror 6: 0x7951b8b6 (stale) Mirror 7: 0x7951b8b6 (stale) Mirror 10: 0x7951b8b6 (stale) Mirror 11: 0x7951b8b6 (stale) Mirror 12: 0x7951b8b6 (stale) Mirror 13: 0x7951b8b6 (stale) Mirror 14: 0x7951b8b6 (stale) Mirror 16: 0x7951b8b6 (stale) Mirror 17: 0x7951b8b6 (stale) Mirror 18: 0x7951b8b6 (stale) Mirror 19: 0x7951b8b6 (stale) Mirror 20: 0x7951b8b6 (stale) CRC-32 checksum value for chunk [0, 0x346a5): Mirror 1: 0xb2e3d2b0 Mirror 21: 0xb2e3d2b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x346a5: skipped 000648 1787819302.317215 mapwrite 0x02c5c4 thru 0x02e656 (0x2093 bytes) 000650 1787819302.539090 write 0x0303f6 thru 0x03247c (0x2087 bytes) 000652 1787819302.544688 read 0x00aa15 thru 0x00c33c (0x1928 bytes) 000653 1787819302.554014 read 0x00f36b thru 0x016b69 (0x77ff bytes) 000655 1787819302.572949 mapwrite 0x01c6d1 thru 0x0279db (0xb30b bytes) 000656 1787819302.635203 read 0x00526b thru 0x00ee82 (0x9c18 bytes) 000657 1787819302.641620 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x346a5): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x346a5): Mirror 6: 0x7951b8b6 (stale) Mirror 7: 0x7951b8b6 (stale) Mirror 10: 0x7951b8b6 (stale) Mirror 11: 0x7951b8b6 (stale) Mirror 12: 0x7951b8b6 (stale) Mirror 13: 0x7951b8b6 (stale) Mirror 14: 0x7951b8b6 (stale) Mirror 16: 0x7951b8b6 (stale) Mirror 17: 0x7951b8b6 (stale) Mirror 18: 0x7951b8b6 (stale) Mirror 19: 0x7951b8b6 (stale) Mirror 20: 0x7951b8b6 (stale) Mirror 21: 0xb2e3d2b0 (stale) CRC-32 checksum value for chunk [0, 0x346a5): Mirror 1: 0x8e6244d9 Mirror 22: 0x8e6244d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x346a5: skipped 000658 1787819304.079911 trunc from 0x0346a5 to 0x0214c3 (0x131e1 bytes) 000660 1787819304.207132 trunc from 0x0214c4 to 0x026510 (0x504d bytes) 000661 1787819304.270083 read 0x0258bb thru 0x026510 (0xc56 bytes) 000665 1787819304.283868 mapread 0x00095f thru 0x002c29 (0x22cb bytes) 000667 1787819304.324226 trunc from 0x026511 to 0x018386 (0xe18a bytes) 000668 1787819304.378993 MIRROR_RESYNC 15 mirrors 000669 1787819307.457294 write 0x00d147 thru 0x016944 (0x97fe bytes) 000671 1787819307.565146 MIRROR_RESYNC 15 mirrors 000672 1787819311.039005 read 0x004328 thru 0x011a8d (0xd766 bytes) 000673 1787819311.053031 trunc from 0x018387 to 0x038d42 (0x209bc bytes) 000676 1787819311.219624 mapread 0x026638 thru 0x03492e (0xe2f7 bytes) 000678 1787819311.266727 read 0x031e64 thru 0x0374ed (0x568a bytes) 000681 1787819311.276849 mapwrite 0x03f51f thru 0x03ffff (0xae1 bytes) 000683 1787819311.433814 read 0x010b98 thru 0x012743 (0x1bac bytes) 000686 1787819311.470477 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa8c8e631 (stale) Mirror 7: 0xa8c8e631 (stale) Mirror 10: 0xa8c8e631 (stale) Mirror 11: 0xa8c8e631 (stale) Mirror 12: 0xa8c8e631 (stale) Mirror 13: 0xa8c8e631 (stale) Mirror 14: 0xa8c8e631 (stale) Mirror 16: 0xa8c8e631 (stale) Mirror 17: 0xa8c8e631 (stale) Mirror 18: 0xa8c8e631 (stale) Mirror 19: 0xa8c8e631 (stale) Mirror 20: 0xa8c8e631 (stale) Mirror 21: 0xa8c8e631 (stale) Mirror 22: 0xa8c8e631 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd5fba235 Mirror 23: 0xd5fba235 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000688 1787819313.141562 trunc from 0x040000 to 0x012033 (0x2dfcc bytes) 000690 1787819313.313584 mapwrite 0x00cf66 thru 0x01c4d7 (0xf572 bytes) 000691 1787819313.524699 mapwrite 0x02f9e3 thru 0x034f0d (0x552b bytes) 000692 1787819313.688227 mapwrite 0x01779b thru 0x024b8c (0xd3f2 bytes) 000694 1787819313.746093 read 0x031294 thru 0x034bec (0x3959 bytes) 000697 1787819313.748141 write 0x000e23 thru 0x00756c (0x674a bytes) 000699 1787819313.756743 write 0x01ac61 thru 0x0252f6 (0xa696 bytes) 000701 1787819313.759146 read 0x009abf thru 0x00c25f (0x27a1 bytes) 000702 1787819313.761015 trunc from 0x034f0e to 0x031636 (0x38d7 bytes) 000704 1787819313.779826 write 0x0334f7 thru 0x03e7a5 (0xb2af bytes) 000705 1787819313.782732 mapwrite 0x02585a thru 0x02d75a (0x7f01 bytes) 000706 1787819313.865005 MIRROR_SPLIT mirror 8 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e7a6): Mirror 6: 0xdc0eb599 (stale) Mirror 7: 0xdc0eb599 (stale) Mirror 10: 0xdc0eb599 (stale) Mirror 11: 0xdc0eb599 (stale) Mirror 12: 0xdc0eb599 (stale) Mirror 13: 0xdc0eb599 (stale) Mirror 14: 0xdc0eb599 (stale) Mirror 17: 0xdc0eb599 (stale) Mirror 18: 0xdc0eb599 (stale) Mirror 19: 0xdc0eb599 (stale) Mirror 20: 0xdc0eb599 (stale) Mirror 21: 0xdc0eb599 (stale) Mirror 22: 0xdc0eb599 (stale) Mirror 23: 0xdc0eb599 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7a6): Mirror 6: 0xdc0eb599 (stale) Mirror 7: 0xdc0eb599 (stale) Mirror 10: 0xdc0eb599 (stale) Mirror 11: 0xdc0eb599 (stale) Mirror 12: 0xdc0eb599 (stale) Mirror 13: 0xdc0eb599 (stale) Mirror 14: 0xdc0eb599 (stale) Mirror 17: 0xdc0eb599 (stale) Mirror 18: 0xdc0eb599 (stale) Mirror 19: 0xdc0eb599 (stale) Mirror 20: 0xdc0eb599 (stale) Mirror 21: 0xdc0eb599 (stale) Mirror 22: 0xdc0eb599 (stale) Mirror 23: 0xdc0eb599 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7a6: skipped 000707 1787819314.697549 read 0x007e02 thru 0x00f7f3 (0x79f2 bytes) 000708 1787819314.709016 trunc from 0x03e7a6 to 0x036d11 (0x7a94 bytes) 000709 1787819314.738042 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x36d12): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36d12): Mirror 6: 0xa80e5bf2 (stale) Mirror 7: 0xa80e5bf2 (stale) Mirror 10: 0xa80e5bf2 (stale) Mirror 11: 0xa80e5bf2 (stale) Mirror 12: 0xa80e5bf2 (stale) Mirror 13: 0xa80e5bf2 (stale) Mirror 14: 0xa80e5bf2 (stale) Mirror 17: 0xa80e5bf2 (stale) Mirror 18: 0xa80e5bf2 (stale) Mirror 19: 0xa80e5bf2 (stale) Mirror 20: 0xa80e5bf2 (stale) Mirror 21: 0xa80e5bf2 (stale) Mirror 22: 0xa80e5bf2 (stale) Mirror 23: 0xa80e5bf2 (stale) CRC-32 checksum value for chunk [0, 0x36d12): Mirror 1: 0x1c2d126f Mirror 24: 0x1c2d126f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36d12: skipped 000711 1787819316.100579 write 0x035125 thru 0x039657 (0x4533 bytes) 000712 1787819316.203426 mapread 0x0268c5 thru 0x031b70 (0xb2ac bytes) 000713 1787819316.232135 trunc from 0x039658 to 0x02fd39 (0x991e bytes) 000714 1787819316.263018 mapwrite 0x008143 thru 0x009c00 (0x1abe bytes) 000716 1787819316.342164 trunc from 0x02fd3a to 0x02f295 (0xaa4 bytes) 000717 1787819316.368234 mapwrite 0x029f57 thru 0x02fb0c (0x5bb6 bytes) 000723 1787819316.472156 mapwrite 0x0183c2 thru 0x01c75c (0x439b bytes) 000728 1787819316.551257 MIRROR_SPLIT mirror 6 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fb0d): Mirror 6: 0x1ce0df00 (stale) Mirror 7: 0x1ce0df00 (stale) Mirror 10: 0x1ce0df00 (stale) Mirror 11: 0x1ce0df00 (stale) Mirror 12: 0x1ce0df00 (stale) Mirror 14: 0x1ce0df00 (stale) Mirror 17: 0x1ce0df00 (stale) Mirror 18: 0x1ce0df00 (stale) Mirror 19: 0x1ce0df00 (stale) Mirror 20: 0x1ce0df00 (stale) Mirror 21: 0x1ce0df00 (stale) Mirror 22: 0x1ce0df00 (stale) Mirror 23: 0x1ce0df00 (stale) Mirror 24: 0x76ae60e1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fb0d): Mirror 6: 0x1ce0df00 (stale) Mirror 7: 0x1ce0df00 (stale) Mirror 10: 0x1ce0df00 (stale) Mirror 11: 0x1ce0df00 (stale) Mirror 12: 0x1ce0df00 (stale) Mirror 14: 0x1ce0df00 (stale) Mirror 17: 0x1ce0df00 (stale) Mirror 18: 0x1ce0df00 (stale) Mirror 19: 0x1ce0df00 (stale) Mirror 20: 0x1ce0df00 (stale) Mirror 21: 0x1ce0df00 (stale) Mirror 22: 0x1ce0df00 (stale) Mirror 23: 0x1ce0df00 (stale) Mirror 24: 0x76ae60e1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fb0d: skipped 000729 1787819317.288976 write 0x02bd3a thru 0x02f8f9 (0x3bc0 bytes) 000730 1787819317.300542 mapread 0x014672 thru 0x020979 (0xc308 bytes) 000732 1787819317.339079 trunc from 0x02fb0d to 0x004db9 (0x2ad53 bytes) 000734 1787819317.355195 mapwrite 0x01ed0f thru 0x02d897 (0xeb89 bytes) 000735 1787819317.487675 read 0x020746 thru 0x025b6d (0x5428 bytes) 000736 1787819317.488893 mapread 0x01d5ed thru 0x02442d (0x6e41 bytes) 000737 1787819317.491168 read 0x0020ff thru 0x00a07b (0x7f7d bytes) 000739 1787819317.505729 read 0x0069ea thru 0x0169b7 (0xffce bytes) 000740 1787819317.506597 write 0x015bf8 thru 0x024ac1 (0xeeca bytes) 000741 1787819317.508974 trunc from 0x02d898 to 0x01e7a9 (0xf0ee bytes) 000742 1787819317.528827 mapwrite 0x017d82 thru 0x021108 (0x9387 bytes) 000743 1787819317.609974 mapwrite 0x03366c thru 0x036576 (0x2f0b bytes) 000747 1787819317.688983 read 0x01ff93 thru 0x02bbd7 (0xbc45 bytes) 000748 1787819317.695003 MIRROR_SPLIT mirror 13 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36577): Mirror 6: 0x38add93e (stale) Mirror 7: 0x38add93e (stale) Mirror 10: 0x38add93e (stale) Mirror 11: 0x38add93e (stale) Mirror 12: 0x38add93e (stale) Mirror 14: 0x38add93e (stale) Mirror 17: 0x38add93e (stale) Mirror 18: 0x38add93e (stale) Mirror 19: 0x38add93e (stale) Mirror 20: 0x38add93e (stale) Mirror 21: 0x38add93e (stale) Mirror 22: 0x38add93e (stale) Mirror 24: 0x969980b6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36577): Mirror 6: 0x38add93e (stale) Mirror 7: 0x38add93e (stale) Mirror 10: 0x38add93e (stale) Mirror 11: 0x38add93e (stale) Mirror 12: 0x38add93e (stale) Mirror 14: 0x38add93e (stale) Mirror 17: 0x38add93e (stale) Mirror 18: 0x38add93e (stale) Mirror 19: 0x38add93e (stale) Mirror 20: 0x38add93e (stale) Mirror 21: 0x38add93e (stale) Mirror 22: 0x38add93e (stale) Mirror 24: 0x969980b6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36577: skipped 000749 1787819318.365676 mapwrite 0x0393bd thru 0x03e3d0 (0x5014 bytes) 000751 1787819318.458997 MIRROR_SPLIT mirror 8 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e3d1): Mirror 6: 0x35ed51c6 (stale) Mirror 7: 0x35ed51c6 (stale) Mirror 10: 0x35ed51c6 (stale) Mirror 11: 0x35ed51c6 (stale) Mirror 12: 0x35ed51c6 (stale) Mirror 14: 0x35ed51c6 (stale) Mirror 17: 0x35ed51c6 (stale) Mirror 19: 0x35ed51c6 (stale) Mirror 20: 0x35ed51c6 (stale) Mirror 21: 0x35ed51c6 (stale) Mirror 22: 0x35ed51c6 (stale) Mirror 24: 0x7cc4ab8e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e3d1): Mirror 6: 0x35ed51c6 (stale) Mirror 7: 0x35ed51c6 (stale) Mirror 10: 0x35ed51c6 (stale) Mirror 11: 0x35ed51c6 (stale) Mirror 12: 0x35ed51c6 (stale) Mirror 14: 0x35ed51c6 (stale) Mirror 17: 0x35ed51c6 (stale) Mirror 19: 0x35ed51c6 (stale) Mirror 20: 0x35ed51c6 (stale) Mirror 21: 0x35ed51c6 (stale) Mirror 22: 0x35ed51c6 (stale) Mirror 24: 0x7cc4ab8e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e3d1: skipped 000752 1787819319.291257 read 0x01acca thru 0x02a3a1 (0xf6d8 bytes) 000753 1787819319.326607 MIRROR_RESYNC 13 mirrors 000754 1787819325.680868 mapread 0x0250e9 thru 0x02f8b9 (0xa7d1 bytes) 000755 1787819325.705100 mapwrite 0x00f700 thru 0x01a884 (0xb185 bytes) 000756 1787819325.876088 mapwrite 0x032e34 thru 0x033b14 (0xce1 bytes) 000757 1787819325.923729 trunc from 0x03e3d1 to 0x01d63a (0x20d96 bytes) 000758 1787819325.951250 read 0x000889 thru 0x00590a (0x5082 bytes) 000759 1787819325.965020 mapwrite 0x012d13 thru 0x013341 (0x62f bytes) 000760 1787819326.012146 mapwrite 0x00ccd5 thru 0x013375 (0x66a1 bytes) 000763 1787819326.060087 mapread 0x0066cc thru 0x00dfcd (0x7902 bytes) 000764 1787819326.067863 mapwrite 0x023805 thru 0x028908 (0x5104 bytes) 000765 1787819326.169748 mapwrite 0x01aee5 thru 0x02a4fd (0xf619 bytes) 000767 1787819326.339405 write 0x0392ea thru 0x03ffff (0x6d16 bytes) 000768 1787819326.348853 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x64f9d32 (stale) Mirror 7: 0x64f9d32 (stale) Mirror 10: 0x64f9d32 (stale) Mirror 12: 0x64f9d32 (stale) Mirror 14: 0x64f9d32 (stale) Mirror 17: 0x64f9d32 (stale) Mirror 19: 0x64f9d32 (stale) Mirror 20: 0x64f9d32 (stale) Mirror 21: 0x64f9d32 (stale) Mirror 22: 0x64f9d32 (stale) Mirror 24: 0x64f9d32 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x64f9d32 (stale) Mirror 7: 0x64f9d32 (stale) Mirror 10: 0x64f9d32 (stale) Mirror 12: 0x64f9d32 (stale) Mirror 14: 0x64f9d32 (stale) Mirror 17: 0x64f9d32 (stale) Mirror 19: 0x64f9d32 (stale) Mirror 20: 0x64f9d32 (stale) Mirror 21: 0x64f9d32 (stale) Mirror 22: 0x64f9d32 (stale) Mirror 24: 0x64f9d32 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000769 1787819327.182009 read 0x006025 thru 0x00bce5 (0x5cc1 bytes) 000771 1787819327.189776 mapread 0x0016bb thru 0x005c10 (0x4556 bytes) 000772 1787819327.229592 read 0x011585 thru 0x016712 (0x518e bytes) 000773 1787819327.259844 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x64f9d32 (stale) Mirror 7: 0x64f9d32 (stale) Mirror 10: 0x64f9d32 (stale) Mirror 12: 0x64f9d32 (stale) Mirror 14: 0x64f9d32 (stale) Mirror 17: 0x64f9d32 (stale) Mirror 19: 0x64f9d32 (stale) Mirror 20: 0x64f9d32 (stale) Mirror 21: 0x64f9d32 (stale) Mirror 22: 0x64f9d32 (stale) Mirror 24: 0x64f9d32 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x27eed773 Mirror 25: 0x27eed773 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000775 1787819329.501484 read 0x020f57 thru 0x02268d (0x1737 bytes) 000776 1787819329.513412 read 0x00b0ad thru 0x0178cd (0xc821 bytes) 000777 1787819329.545956 mapwrite 0x02bb3b thru 0x02fcc8 (0x418e bytes) 000779 1787819329.923728 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x64f9d32 (stale) Mirror 7: 0x64f9d32 (stale) Mirror 10: 0x64f9d32 (stale) Mirror 12: 0x64f9d32 (stale) Mirror 14: 0x64f9d32 (stale) Mirror 17: 0x64f9d32 (stale) Mirror 19: 0x64f9d32 (stale) Mirror 20: 0x64f9d32 (stale) Mirror 21: 0x64f9d32 (stale) Mirror 22: 0x64f9d32 (stale) Mirror 24: 0x64f9d32 (stale) Mirror 25: 0x27eed773 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x621eb251 Mirror 26: 0x621eb251 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000783 1787819332.230083 MIRROR_RESYNC 14 mirrors 000787 1787819337.552176 write 0x001751 thru 0x0086b8 (0x6f68 bytes) 000789 1787819337.706622 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x621eb251 (stale) Mirror 7: 0x621eb251 (stale) Mirror 10: 0x621eb251 (stale) Mirror 12: 0x621eb251 (stale) Mirror 14: 0x621eb251 (stale) Mirror 17: 0x621eb251 (stale) Mirror 19: 0x621eb251 (stale) Mirror 20: 0x621eb251 (stale) Mirror 21: 0x621eb251 (stale) Mirror 22: 0x621eb251 (stale) Mirror 24: 0x621eb251 (stale) Mirror 25: 0x621eb251 (stale) Mirror 26: 0x621eb251 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3b20ed59 Mirror 27: 0x3b20ed59 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000790 1787819339.394607 trunc from 0x040000 to 0x021624 (0x1e9db bytes) 000791 1787819339.600003 write 0x027f95 thru 0x02ae87 (0x2ef3 bytes) 000792 1787819339.601423 mapwrite 0x002ca7 thru 0x0101b2 (0xd50c bytes) 000793 1787819339.721104 mapwrite 0x00af32 thru 0x0107f6 (0x58c5 bytes) 000795 1787819339.778823 read 0x00a532 thru 0x01203a (0x7b09 bytes) 000796 1787819339.787035 mapread 0x027b12 thru 0x02ab40 (0x302f bytes) 000797 1787819339.789801 mapwrite 0x00c099 thru 0x013c21 (0x7b89 bytes) 000798 1787819339.856939 trunc from 0x02ae88 to 0x0071a4 (0x23ce3 bytes) 000800 1787819339.889586 MIRROR_RESYNC 15 mirrors 000801 1787819342.113866 trunc from 0x0071a5 to 0x027f72 (0x20dce bytes) 000803 1787819342.244904 read 0x01f55f thru 0x02657a (0x701c bytes) 000804 1787819342.280910 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27f73): Mirror 7: 0x8e5d9967 (stale) Mirror 10: 0x8e5d9967 (stale) Mirror 12: 0x8e5d9967 (stale) Mirror 14: 0x8e5d9967 (stale) Mirror 17: 0x8e5d9967 (stale) Mirror 19: 0x8e5d9967 (stale) Mirror 20: 0x8e5d9967 (stale) Mirror 21: 0x8e5d9967 (stale) Mirror 22: 0x8e5d9967 (stale) Mirror 24: 0x8e5d9967 (stale) Mirror 25: 0x8e5d9967 (stale) Mirror 26: 0x8e5d9967 (stale) Mirror 27: 0x8e5d9967 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27f73): Mirror 7: 0x8e5d9967 (stale) Mirror 10: 0x8e5d9967 (stale) Mirror 12: 0x8e5d9967 (stale) Mirror 14: 0x8e5d9967 (stale) Mirror 17: 0x8e5d9967 (stale) Mirror 19: 0x8e5d9967 (stale) Mirror 20: 0x8e5d9967 (stale) Mirror 21: 0x8e5d9967 (stale) Mirror 22: 0x8e5d9967 (stale) Mirror 24: 0x8e5d9967 (stale) Mirror 25: 0x8e5d9967 (stale) Mirror 26: 0x8e5d9967 (stale) Mirror 27: 0x8e5d9967 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27f73: skipped 000808 1787819342.890534 trunc from 0x027f73 to 0x00b404 (0x1cb6e bytes) 000811 1787819342.912973 write 0x032a58 thru 0x03bbe4 (0x918d bytes) 000813 1787819342.916766 read 0x0382c0 thru 0x03bbe4 (0x3925 bytes) 000814 1787819342.917952 write 0x036197 thru 0x03ffff (0x9e69 bytes) 000817 1787819342.921215 read 0x033724 thru 0x03f38f (0xbc6c bytes) 000822 1787819342.926929 mapread 0x009ac0 thru 0x00b04e (0x158f bytes) 000823 1787819342.941966 MIRROR_RESYNC 14 mirrors 000825 1787819346.541676 write 0x029dea thru 0x0355e7 (0xb7fe bytes) 000826 1787819346.674146 mapwrite 0x035a16 thru 0x0387c7 (0x2db2 bytes) 000827 1787819346.938532 write 0x011f21 thru 0x0192a5 (0x7385 bytes) 000828 1787819346.980553 MIRROR_SPLIT mirror 9 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x1e41c780 (stale) Mirror 10: 0x1e41c780 (stale) Mirror 12: 0x1e41c780 (stale) Mirror 14: 0x1e41c780 (stale) Mirror 17: 0x1e41c780 (stale) Mirror 19: 0x1e41c780 (stale) Mirror 20: 0x1e41c780 (stale) Mirror 21: 0x1e41c780 (stale) Mirror 24: 0x1e41c780 (stale) Mirror 25: 0x1e41c780 (stale) Mirror 26: 0x1e41c780 (stale) Mirror 27: 0x1e41c780 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x1e41c780 (stale) Mirror 10: 0x1e41c780 (stale) Mirror 12: 0x1e41c780 (stale) Mirror 14: 0x1e41c780 (stale) Mirror 17: 0x1e41c780 (stale) Mirror 19: 0x1e41c780 (stale) Mirror 20: 0x1e41c780 (stale) Mirror 21: 0x1e41c780 (stale) Mirror 24: 0x1e41c780 (stale) Mirror 25: 0x1e41c780 (stale) Mirror 26: 0x1e41c780 (stale) Mirror 27: 0x1e41c780 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000830 1787819348.152597 trunc from 0x040000 to 0x03e09f (0x1f60 bytes) 000831 1787819348.187081 mapread 0x02dd16 thru 0x03118c (0x3477 bytes) 000834 1787819348.226620 MIRROR_SPLIT mirror 7 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e0a0): Mirror 7: 0xd411bb9f (stale) Mirror 10: 0xd411bb9f (stale) Mirror 12: 0xd411bb9f (stale) Mirror 14: 0xd411bb9f (stale) Mirror 17: 0xd411bb9f (stale) Mirror 19: 0xd411bb9f (stale) Mirror 21: 0xd411bb9f (stale) Mirror 24: 0xd411bb9f (stale) Mirror 25: 0xd411bb9f (stale) Mirror 26: 0xd411bb9f (stale) Mirror 27: 0xd411bb9f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e0a0): Mirror 7: 0xd411bb9f (stale) Mirror 10: 0xd411bb9f (stale) Mirror 12: 0xd411bb9f (stale) Mirror 14: 0xd411bb9f (stale) Mirror 17: 0xd411bb9f (stale) Mirror 19: 0xd411bb9f (stale) Mirror 21: 0xd411bb9f (stale) Mirror 24: 0xd411bb9f (stale) Mirror 25: 0xd411bb9f (stale) Mirror 26: 0xd411bb9f (stale) Mirror 27: 0xd411bb9f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e0a0: skipped 000835 1787819349.197546 read 0x03bd40 thru 0x03e09f (0x2360 bytes) 000836 1787819349.205898 trunc from 0x03e0a0 to 0x027450 (0x16c4f bytes) 000837 1787819349.240446 mapwrite 0x01b69c thru 0x01c888 (0x11ed bytes) 000839 1787819349.364613 read 0x001857 thru 0x0104d8 (0xec82 bytes) 000840 1787819349.377645 read 0x00ac3e thru 0x018c71 (0xe034 bytes) 000843 1787819349.380230 mapread 0x009dd4 thru 0x018e67 (0xf094 bytes) 000845 1787819349.383143 mapread 0x009d78 thru 0x013610 (0x9899 bytes) 000846 1787819349.384560 mapwrite 0x02596c thru 0x0322de (0xc973 bytes) 000848 1787819349.574683 mapread 0x00e76e thru 0x013b6d (0x5400 bytes) 000849 1787819349.577884 write 0x02f127 thru 0x036f11 (0x7deb bytes) 000850 1787819349.580480 write 0x035ab4 thru 0x037c48 (0x2195 bytes) 000853 1787819349.584105 mapread 0x022e5b thru 0x02e6c1 (0xb867 bytes) 000855 1787819349.593289 MIRROR_RESYNC 12 mirrors 000858 1787819354.443937 write 0x009191 thru 0x017a9b (0xe90b bytes) 000859 1787819354.618096 mapwrite 0x00f2f5 thru 0x0148e5 (0x55f1 bytes) 000860 1787819354.702597 read 0x001086 thru 0x00e6cb (0xd646 bytes) 000861 1787819354.713138 write 0x036f7d thru 0x03ffff (0x9083 bytes) 000863 1787819354.728074 MIRROR_RESYNC 12 mirrors 000864 1787819361.997669 mapwrite 0x03ee85 thru 0x03ffff (0x117b bytes) 000865 1787819362.308417 trunc from 0x040000 to 0x00c627 (0x339d8 bytes) 000866 1787819362.343793 MIRROR_RESYNC 12 mirrors 000867 1787819365.133939 write 0x00cc92 thru 0x019fd3 (0xd342 bytes) 000869 1787819365.233292 read 0x0060de thru 0x009318 (0x323b bytes) 000871 1787819365.244782 mapwrite 0x0047f5 thru 0x005b50 (0x135c bytes) 000873 1787819365.351953 MIRROR_RESYNC 12 mirrors 000876 1787819368.304047 mapread 0x000965 thru 0x0011ed (0x889 bytes) 000878 1787819368.314464 trunc from 0x019fd4 to 0x009cf2 (0x102e1 bytes) 000879 1787819368.395472 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x9cf3): Mirror 10: 0x1fcc247 (stale) Mirror 12: 0x1fcc247 (stale) Mirror 14: 0x1fcc247 (stale) Mirror 17: 0x1fcc247 (stale) Mirror 19: 0x1fcc247 (stale) Mirror 21: 0x1fcc247 (stale) Mirror 24: 0x1fcc247 (stale) Mirror 25: 0x1fcc247 (stale) Mirror 26: 0x1fcc247 (stale) Mirror 27: 0x1fcc247 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9cf3): Mirror 10: 0x1fcc247 (stale) Mirror 12: 0x1fcc247 (stale) Mirror 14: 0x1fcc247 (stale) Mirror 17: 0x1fcc247 (stale) Mirror 19: 0x1fcc247 (stale) Mirror 21: 0x1fcc247 (stale) Mirror 24: 0x1fcc247 (stale) Mirror 25: 0x1fcc247 (stale) Mirror 26: 0x1fcc247 (stale) Mirror 27: 0x1fcc247 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9cf3: skipped 000881 1787819369.061788 read 0x0052ae thru 0x006e5b (0x1bae bytes) 000882 1787819369.069471 mapwrite 0x02d2c8 thru 0x03b988 (0xe6c1 bytes) 000883 1787819369.213637 mapwrite 0x0349de thru 0x035d59 (0x137c bytes) 000884 1787819369.262067 MIRROR_RESYNC 11 mirrors 000885 1787819372.234847 trunc from 0x03b989 to 0x02db03 (0xde85 bytes) 000889 1787819372.314118 mapwrite 0x02da10 thru 0x03a1cd (0xc7be bytes) 000890 1787819372.422892 mapread 0x013daf thru 0x015c2f (0x1e81 bytes) 000891 1787819372.433474 read 0x001750 thru 0x00783f (0x60f0 bytes) 000894 1787819372.444373 trunc from 0x03a1ce to 0x0368e7 (0x38e6 bytes) 000895 1787819372.460722 trunc from 0x0368e8 to 0x01426c (0x2267b bytes) 000896 1787819372.480879 write 0x03a5f4 thru 0x03ffff (0x5a0c bytes) 000897 1787819372.482353 write 0x00864d thru 0x012f6c (0xa920 bytes) 000899 1787819372.490045 trunc from 0x040000 to 0x017ed1 (0x2812e bytes) 000900 1787819372.508416 mapwrite 0x00d5f9 thru 0x0114f5 (0x3efd bytes) 000901 1787819372.558696 mapwrite 0x00826e thru 0x01593d (0xd6d0 bytes) 000902 1787819372.619999 read 0x0107e3 thru 0x017ed1 (0x76ef bytes) 000903 1787819372.620707 trunc from 0x017ed2 to 0x03a083 (0x221b2 bytes) 000905 1787819372.639240 read 0x018002 thru 0x01ab55 (0x2b54 bytes) 000907 1787819372.653171 write 0x02d859 thru 0x038b67 (0xb30f bytes) 000912 1787819372.658441 write 0x02a162 thru 0x037560 (0xd3ff bytes) 000913 1787819372.660624 write 0x038c79 thru 0x03ffff (0x7387 bytes) 000914 1787819372.662665 read 0x002077 thru 0x008452 (0x63dc bytes) 000915 1787819372.668251 MIRROR_RESYNC 11 mirrors 000916 1787819375.714874 mapwrite 0x02c969 thru 0x031125 (0x47bd bytes) 000918 1787819375.913846 mapwrite 0x009313 thru 0x00cb6e (0x385c bytes) 000919 1787819376.032976 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xa63d9a58 (stale) Mirror 12: 0xa63d9a58 (stale) Mirror 14: 0xa63d9a58 (stale) Mirror 17: 0xa63d9a58 (stale) Mirror 19: 0xa63d9a58 (stale) Mirror 21: 0xa63d9a58 (stale) Mirror 24: 0xa63d9a58 (stale) Mirror 25: 0xa63d9a58 (stale) Mirror 26: 0xa63d9a58 (stale) Mirror 27: 0xa63d9a58 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x11589535 Mirror 28: 0x11589535 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000921 1787819377.823871 mapread 0x00a6fe thru 0x012b46 (0x8449 bytes) 000922 1787819377.857217 read 0x021b31 thru 0x02d3bf (0xb88f bytes) 000923 1787819377.875870 read 0x02db15 thru 0x031536 (0x3a22 bytes) 000924 1787819377.895231 read 0x0282cb thru 0x032665 (0xa39b bytes) 000925 1787819377.909194 MIRROR_RESYNC 12 mirrors 000926 1787819380.876458 trunc from 0x040000 to 0x00cbb1 (0x3344e bytes) 000927 1787819381.056399 MIRROR_RESYNC 12 mirrors 000929 1787819383.447750 trunc from 0x00cbb2 to 0x026a48 (0x19e97 bytes) 000930 1787819383.565199 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26a49): Mirror 10: 0x92559760 (stale) Mirror 12: 0x92559760 (stale) Mirror 14: 0x92559760 (stale) Mirror 19: 0x92559760 (stale) Mirror 21: 0x92559760 (stale) Mirror 24: 0x92559760 (stale) Mirror 25: 0x92559760 (stale) Mirror 26: 0x92559760 (stale) Mirror 27: 0x92559760 (stale) Mirror 28: 0x92559760 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26a49): Mirror 10: 0x92559760 (stale) Mirror 12: 0x92559760 (stale) Mirror 14: 0x92559760 (stale) Mirror 19: 0x92559760 (stale) Mirror 21: 0x92559760 (stale) Mirror 24: 0x92559760 (stale) Mirror 25: 0x92559760 (stale) Mirror 26: 0x92559760 (stale) Mirror 27: 0x92559760 (stale) Mirror 28: 0x92559760 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26a49: skipped 000936 1787819384.418804 mapread 0x023af1 thru 0x026a48 (0x2f58 bytes) 000937 1787819384.444780 MIRROR_RESYNC 11 mirrors 000938 1787819386.803649 mapwrite 0x01c695 thru 0x01df4f (0x18bb bytes) 000939 1787819387.295668 mapwrite 0x0069e0 thru 0x00cb13 (0x6134 bytes) 000940 1787819387.367233 trunc from 0x026a49 to 0x02aad8 (0x4090 bytes) 000942 1787819387.398123 MIRROR_RESYNC 11 mirrors 000944 1787819390.873859 trunc from 0x02aad9 to 0x020c96 (0x9e42 bytes) 000945 1787819390.956093 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20c97): Mirror 10: 0x25dd28cb (stale) Mirror 12: 0x25dd28cb (stale) Mirror 19: 0x25dd28cb (stale) Mirror 21: 0x25dd28cb (stale) Mirror 24: 0x25dd28cb (stale) Mirror 25: 0x25dd28cb (stale) Mirror 26: 0x25dd28cb (stale) Mirror 27: 0x25dd28cb (stale) Mirror 28: 0x25dd28cb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20c97): Mirror 10: 0x25dd28cb (stale) Mirror 12: 0x25dd28cb (stale) Mirror 19: 0x25dd28cb (stale) Mirror 21: 0x25dd28cb (stale) Mirror 24: 0x25dd28cb (stale) Mirror 25: 0x25dd28cb (stale) Mirror 26: 0x25dd28cb (stale) Mirror 27: 0x25dd28cb (stale) Mirror 28: 0x25dd28cb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20c97: skipped 000947 1787819391.494809 mapread 0x00847b thru 0x0159b3 (0xd539 bytes) 000949 1787819391.531366 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20c97): Mirror 10: 0x25dd28cb (stale) Mirror 12: 0x25dd28cb (stale) Mirror 21: 0x25dd28cb (stale) Mirror 24: 0x25dd28cb (stale) Mirror 25: 0x25dd28cb (stale) Mirror 26: 0x25dd28cb (stale) Mirror 27: 0x25dd28cb (stale) Mirror 28: 0x25dd28cb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20c97): Mirror 10: 0x25dd28cb (stale) Mirror 12: 0x25dd28cb (stale) Mirror 21: 0x25dd28cb (stale) Mirror 24: 0x25dd28cb (stale) Mirror 25: 0x25dd28cb (stale) Mirror 26: 0x25dd28cb (stale) Mirror 27: 0x25dd28cb (stale) Mirror 28: 0x25dd28cb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20c97: skipped 000951 1787819392.032488 mapwrite 0x02a02d thru 0x02d16d (0x3141 bytes) 000956 1787819392.135162 trunc from 0x02d16e to 0x0290d0 (0x409d bytes) 000959 1787819392.154286 write 0x02e5aa thru 0x038ad1 (0xa528 bytes) 000961 1787819392.157744 mapread 0x015e42 thru 0x0184a5 (0x2664 bytes) 000962 1787819392.174850 MIRROR_RESYNC 9 mirrors 000963 1787819395.505600 mapread 0x005ebc thru 0x009573 (0x36b8 bytes) 000964 1787819395.585375 trunc from 0x038ad2 to 0x03ce10 (0x433f bytes) 000966 1787819395.730902 mapwrite 0x01e9b9 thru 0x02c9dc (0xe024 bytes) 000967 1787819395.945459 MIRROR_RESYNC 9 mirrors 000969 1787819400.212731 read 0x03204e thru 0x03ce10 (0xadc3 bytes) 000970 1787819400.229190 MIRROR_EXTEND to 10 mirrors 000971 1787819401.321962 mapwrite 0x014613 thru 0x01b050 (0x6a3e bytes) 000972 1787819401.605627 trunc from 0x03ce11 to 0x01f9b7 (0x1d459 bytes) 000975 1787819401.642010 read 0x014ab4 thru 0x01628a (0x17d7 bytes) 000977 1787819401.646816 read 0x01ee9d thru 0x01f9b7 (0xb1b bytes) 000978 1787819401.657224 write 0x02af2e thru 0x034168 (0x923b bytes) 000980 1787819401.660784 trunc from 0x034169 to 0x003efc (0x3026c bytes) 000981 1787819401.708004 read 0x00333f thru 0x003c19 (0x8db bytes) 000982 1787819401.709396 mapread 0x000a6f thru 0x003efc (0x348e bytes) 000983 1787819401.718458 MIRROR_RESYNC 10 mirrors 000985 1787819403.479894 mapread 0x0007b4 thru 0x002ce4 (0x2531 bytes) 000986 1787819403.498644 read 0x0008a1 thru 0x003efc (0x365c bytes) 000987 1787819403.509773 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) 000988 1787819403.877865 read 0x0024a5 thru 0x003efc (0x1a58 bytes) 000989 1787819403.897533 read 0x0017d1 thru 0x003efc (0x272c bytes) 000991 1787819403.915231 write 0x030b43 thru 0x03ea23 (0xdee1 bytes) 000993 1787819404.085965 mapread 0x0361b8 thru 0x03ea23 (0x886c bytes) 000995 1787819404.088681 read 0x015b48 thru 0x01cf28 (0x73e1 bytes) 000996 1787819404.101331 read 0x006b33 thru 0x0149a9 (0xde77 bytes) 000997 1787819404.103277 read 0x031950 thru 0x03e462 (0xcb13 bytes) 000998 1787819404.104383 write 0x0316b7 thru 0x0325b1 (0xefb bytes) 000999 1787819404.106126 mapread 0x005de6 thru 0x00aefb (0x5116 bytes) 001000 1787819404.107487 mapwrite 0x024bd0 thru 0x026c72 (0x20a3 bytes) All operations completed A-OK!