== sanity-flr test 70a: flr mode fsx test ================ 04:29:42 (1779870582) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 583 skipping zero size read 000002 1779870583.842266 MIRROR_EXTEND to 2 mirrors skipping zero size read 000004 1779870584.156109 MIRROR_EXTEND to 3 mirrors skipping zero length zero range 000008 1779870584.474806 MIRROR_RESYNC 3 mirrors skipping zero length punch hole truncating to largest ever: 0x379b1 000010 1779870584.623708 trunc from 00000000 to 0x0379b0 (0x379b1 bytes) 000011 1779870584.663829 mapread 0x0374f1 thru 0x0379b0 (0x4c0 bytes) 000012 1779870584.672621 read 0x034392 thru 0x03572b (0x139a bytes) 000013 1779870584.678982 read 0x007b67 thru 0x00c9ad (0x4e47 bytes) 000014 1779870584.690562 punch from 0x0073c1 to 0x011017 (0x9c57 bytes) 000015 1779870584.696897 punch from 0x01a3af to 0x01c2c9 (0x1f1b bytes) 000016 1779870584.707346 read 0x0181ca thru 0x0195ad (0x13e4 bytes) 000017 1779870584.708140 trunc from 0x009df8 to 0x018b45 (0xed4e bytes) 000018 1779870584.713440 mapread 0x01d8c5 thru 0x025fbd (0x86f9 bytes) 000019 1779870584.719180 MIRROR_RESYNC 3 mirrors 000020 1779870585.263395 write 0x034ef4 thru 0x03ffff (0xb10c bytes) 000021 1779870585.302992 fallocate 0x031374 thru 0x03447d (0x310a bytes) zero_range to largest ever: 0x40000 000023 1779870585.311720 trunc from 0x0364e4 to 0x03ffff (0x9b1c bytes) 000026 1779870585.340948 mapwrite 0x0004de thru 0x005909 (0x542c bytes) 000027 1779870585.381955 mapwrite 0x03b8e3 thru 0x03ffff (0x471d bytes) 000028 1779870585.413790 trunc from 0x02a92f to 0x033236 (0x8908 bytes) 000029 1779870585.423143 fallocate 0x03a1f0 thru 0x03ffff (0x5e10 bytes) 000030 1779870585.435896 MIRROR_RESYNC 3 mirrors 000031 1779870586.112033 punch from 0x0104cd to 0x01cb49 (0xc67d bytes) 000032 1779870586.149422 mapwrite 0x03abf4 thru 0x03ffff (0x540c bytes) 000034 1779870586.174078 mapwrite 0x03f832 thru 0x03ffff (0x7ce bytes) 000035 1779870586.182910 trunc from 0x003e3e to 0x0048ba (0xa7d bytes) 000036 1779870586.186747 mapread 0x030543 thru 0x03be65 (0xb923 bytes) 000037 1779870586.194985 mapread 0x002813 thru 0x01099b (0xe189 bytes) 000038 1779870586.204719 punch from 0x009ca3 to 0x00b955 (0x1cb3 bytes) 000039 1779870586.211615 mapwrite 0x021ef4 thru 0x02d218 (0xb325 bytes) 000040 1779870586.255957 write 0x013a83 thru 0x01c72e (0x8cac bytes) 000041 1779870586.273214 mapwrite 0x03945b thru 0x03f022 (0x5bc8 bytes) 000042 1779870586.293782 fallocate 0x03df1f thru 0x03ffff (0x20e1 bytes) 000043 1779870586.299897 mapwrite 0x01302f thru 0x01c959 (0x992b bytes) 000044 1779870586.327943 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x832c0025 (stale) Mirror 3: 0x832c0025 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7e0ab2b Mirror 4: 0x7e0ab2b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000045 1779870587.148577 read 0x00cbfe thru 0x00f6af (0x2ab2 bytes) 000046 1779870587.162249 write 0x0004ba thru 0x006800 (0x6347 bytes) 000047 1779870587.206935 mapread 0x03d51b thru 0x03ffff (0x2ae5 bytes) 000048 1779870587.224537 punch from 0x030093 to 0x03508f (0x4ffd bytes) 000049 1779870587.242389 MIRROR_RESYNC 4 mirrors 000050 1779870588.195243 write 0x009396 thru 0x00a0cd (0xd38 bytes) 000051 1779870588.234196 mapwrite 0x0255b2 thru 0x027beb (0x263a bytes) 000052 1779870588.273959 trunc from 0x040000 to 0x00e485 (0x31b7a bytes) 000053 1779870588.304932 mapwrite 0x018418 thru 0x018b94 (0x77d bytes) 000054 1779870588.338939 trunc from 0x018b95 to 0x008d88 (0xfe0c bytes) 000055 1779870588.354032 read 0x00841d thru 0x008d88 (0x96c bytes) 000056 1779870588.359931 fallocate 0x027e8d thru 0x02f50a (0x767e bytes) 000057 1779870588.365682 punch from 0x0035e7 to 0x007ec3 (0x48dd bytes) 000058 1779870588.370149 read 0x003c8c thru 0x006e12 (0x3187 bytes) 000059 1779870588.377132 fallocate 0x00dcb6 thru 0x017867 (0x9bb2 bytes) 000060 1779870588.384824 trunc from 0x0064bf to 0x008d88 (0x28ca bytes) 000061 1779870588.391750 trunc from 0x0069a9 to 0x008d88 (0x23e0 bytes) 000062 1779870588.403888 trunc from 0x008d89 to 0x0375ed (0x2e865 bytes) 000063 1779870588.417904 trunc from 0x0375ee to 0x03dacc (0x64df bytes) 000064 1779870588.431288 trunc from 0x03dacd to 0x0027d7 (0x3b2f5 bytes) 000065 1779870588.450547 trunc from 0x0027d8 to 0x03cc93 (0x3a4bc bytes) 000066 1779870588.473955 fallocate 0x0206a8 thru 0x0210e9 (0xa42 bytes) 000067 1779870588.487972 MIRROR_RESYNC 4 mirrors 000068 1779870589.017558 read 0x002cd0 thru 0x010954 (0xdc85 bytes) 000069 1779870589.027395 fallocate 0x028026 thru 0x02b94c (0x3927 bytes) 000071 1779870589.052911 punch from 0x02a4f3 to 0x0375d1 (0xd0df bytes) 000072 1779870589.057199 trunc from 0x00790b to 0x0165c8 (0xecbe bytes) 000073 1779870589.061931 mapread 0x008657 thru 0x0130d9 (0xaa83 bytes) 000074 1779870589.086929 write 0x0337b3 thru 0x03bea8 (0x86f6 bytes) 000075 1779870589.097340 mapwrite 0x026679 thru 0x03368b (0xd013 bytes) 000076 1779870589.129323 read 0x0069c6 thru 0x012dc8 (0xc403 bytes) 000078 1779870589.130727 mapwrite 0x03c998 thru 0x03ffff (0x3668 bytes) 000079 1779870589.208907 punch from 0x018bb1 to 0x028240 (0xf690 bytes) 000080 1779870589.220635 mapwrite 0x03f45a thru 0x03ffff (0xba6 bytes) 000081 1779870589.240186 mapread 0x03bf36 thru 0x03ffff (0x40ca bytes) 000082 1779870589.241187 mapwrite 0x03c5be thru 0x03ffff (0x3a42 bytes) 000083 1779870589.259296 trunc from 0x03f28d to 0x03ffff (0xd73 bytes) 000084 1779870589.264825 read 0x009383 thru 0x018642 (0xf2c0 bytes) 000085 1779870589.275364 read 0x039b2f thru 0x03f0c9 (0x559b bytes) 000087 1779870589.276867 mapwrite 0x029afc thru 0x038dcd (0xf2d2 bytes) 000088 1779870589.297071 mapwrite 0x01225b thru 0x01cb6d (0xa913 bytes) 000089 1779870589.330034 mapread 0x007722 thru 0x0111d2 (0x9ab1 bytes) 000090 1779870589.335254 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5706c7ec (stale) Mirror 4: 0x5706c7ec (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5706c7ec (stale) Mirror 4: 0x5706c7ec (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000091 1779870589.611440 write 0x00b896 thru 0x017a73 (0xc1de bytes) 000092 1779870589.632621 mapread 0x0133e4 thru 0x019a11 (0x662e bytes) 000093 1779870589.644763 fallocate 0x03788c thru 0x03aafa (0x326f bytes) 000094 1779870589.651450 trunc from 0x028133 to 0x02e7bd (0x668b bytes) 000095 1779870589.657286 read 0x012b7a thru 0x01ea5c (0xbee3 bytes) 000096 1779870589.658018 write 0x008de1 thru 0x0100d8 (0x72f8 bytes) 000097 1779870589.669713 trunc from 0x040000 to 0x02bad4 (0x1452b bytes) 000098 1779870589.694360 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bad5): Mirror 3: 0xb6ab933 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bad5): Mirror 3: 0xb6ab933 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bad5: skipped 000099 1779870589.981345 punch from 0x001926 to 0x0041dd (0x28b8 bytes) 000100 1779870589.987589 trunc from 0x007aee to 0x0172f8 (0xf80b bytes) 000101 1779870589.995729 read 0x00c327 thru 0x00eae7 (0x27c1 bytes) 000102 1779870590.002900 mapwrite 0x00bdd7 thru 0x01b5f8 (0xf822 bytes) 000103 1779870590.069251 punch from 0x00e082 to 0x011453 (0x33d2 bytes) 000104 1779870590.084059 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2bad5): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bad5): Mirror 3: 0xb6ab933 (stale) CRC-32 checksum value for chunk [0, 0x2bad5): Mirror 1: 0x65cf9ae Mirror 4: 0x65cf9ae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bad5: skipped 000105 1779870590.809708 mapwrite 0x032cd5 thru 0x036a7b (0x3da7 bytes) 000106 1779870590.895425 fallocate 0x006164 thru 0x00aaee (0x498b bytes) 000107 1779870590.904402 write 0x028951 thru 0x02a745 (0x1df5 bytes) 000108 1779870590.922578 mapread 0x025184 thru 0x02d468 (0x82e5 bytes) 000109 1779870590.925407 trunc from 0x005700 to 0x007815 (0x2116 bytes) 000110 1779870590.930229 punch from 0x0197f0 to 0x021f58 (0x8769 bytes) 000111 1779870590.935546 read 0x01c00c thru 0x0255b8 (0x95ad bytes) 000113 1779870590.944939 mapread 0x0040be thru 0x0058ef (0x1832 bytes) 000114 1779870590.958894 read 0x00b039 thru 0x011417 (0x63df bytes) 000115 1779870590.974939 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36a7c): Mirror 4: 0x66bb0977 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36a7c): Mirror 4: 0x66bb0977 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36a7c: skipped 000117 1779870591.231999 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x36a7c): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36a7c): Mirror 4: 0x66bb0977 (stale) CRC-32 checksum value for chunk [0, 0x36a7c): Mirror 1: 0x1007908c Mirror 5: 0x1007908c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36a7c: skipped 000118 1779870591.997605 trunc from 0x036a7c to 0x01a1ae (0x1c8cd bytes) 000119 1779870592.057885 fallocate 0x01d936 thru 0x01f16a (0x1835 bytes) 000120 1779870592.068349 MIRROR_RESYNC 3 mirrors 000121 1779870592.841840 trunc from 0x01036e to 0x017866 (0x74f9 bytes) 000122 1779870592.883226 read 0x00abfa thru 0x00e486 (0x388d bytes) 000123 1779870592.892442 trunc from 0x01f16b to 0x00e119 (0x11051 bytes) 000124 1779870592.916210 read 0x00bd8d thru 0x00c2a4 (0x518 bytes) 000125 1779870592.925797 MIRROR_RESYNC 3 mirrors 000126 1779870593.442807 trunc from 0x00e11a to 0x0300ae (0x21f95 bytes) 000127 1779870593.471160 trunc from 0x017450 to 0x025a1a (0xe5cb bytes) 000128 1779870593.476898 read 0x02cd37 thru 0x0300ae (0x3378 bytes) 000129 1779870593.495141 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x300af): Mirror 5: 0x8eb801b4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x300af): Mirror 5: 0x8eb801b4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x300af: skipped 000130 1779870593.766183 mapwrite 0x01ad1f thru 0x01c7ca (0x1aac bytes) 000131 1779870593.805301 read 0x0086f4 thru 0x012cef (0xa5fc bytes) 000132 1779870593.815724 write 0x02e888 thru 0x03b299 (0xca12 bytes) 000134 1779870593.836514 trunc from 0x03b29a to 0x0345b7 (0x6ce2 bytes) 000135 1779870593.858222 punch from 0x01214c to 0x020e01 (0xecb6 bytes) 000137 1779870593.863727 punch from 0x01783c to 0x01ae58 (0x361d bytes) 000138 1779870593.869266 mapwrite 0x00716f thru 0x00999a (0x282c bytes) 000139 1779870593.895625 trunc from 0x0108fa to 0x01ec2f (0xe336 bytes) 000140 1779870593.901465 trunc from 0x0345b8 to 0x02f90a (0x4cad bytes) 000141 1779870593.920557 mapread 0x02bce8 thru 0x02f90a (0x3c23 bytes) 000143 1779870593.922914 mapwrite 0x00280a thru 0x00aec5 (0x86bc bytes) 000144 1779870593.940541 write 0x0377b2 thru 0x03c9c6 (0x5215 bytes) 000145 1779870593.942417 mapread 0x0132cd thru 0x01a770 (0x74a4 bytes) 000146 1779870593.951497 read 0x005977 thru 0x010513 (0xab9d bytes) 000147 1779870593.952561 trunc from 0x03c9c7 to 0x0083cc (0x345fa bytes) 000148 1779870593.974790 punch from 0x00652e to 0x00749b (0xf6e bytes) 000150 1779870593.980822 mapwrite 0x002d59 thru 0x00f563 (0xc80b bytes) 000152 1779870594.027644 write 0x0311c5 thru 0x03e139 (0xcf75 bytes) 000153 1779870594.030001 trunc from 0x03e13a to 0x01ee76 (0x1f2c3 bytes) 000154 1779870594.045560 mapwrite 0x03893c thru 0x03b93d (0x3002 bytes) 000155 1779870594.091697 trunc from 0x027b40 to 0x0297cd (0x1c8e bytes) 000156 1779870594.097091 punch from 0x001b46 to 0x00ecba (0xd175 bytes) 000157 1779870594.103255 mapwrite 0x007cce thru 0x015a93 (0xddc6 bytes) 000158 1779870594.178648 mapread 0x00a01e thru 0x0137ca (0x97ad bytes) 000159 1779870594.180880 read 0x005e3c thru 0x0107df (0xa9a4 bytes) 000160 1779870594.192054 trunc from 0x03b93e to 0x0237e1 (0x1815c bytes) 000163 1779870594.206883 read 0x022b29 thru 0x0237e1 (0xcb9 bytes) 000164 1779870594.207772 write 0x001cb7 thru 0x00aebe (0x9208 bytes) 000165 1779870594.214864 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x237e2): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x237e2): Mirror 5: 0x47c08d61 (stale) CRC-32 checksum value for chunk [0, 0x237e2): Mirror 1: 0x8aa8bb30 Mirror 6: 0x8aa8bb30 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x237e2: skipped 000166 1779870594.816983 fallocate 0x002ba9 thru 0x00a1d1 (0x7629 bytes) 000167 1779870594.862436 MIRROR_RESYNC 3 mirrors 000168 1779870595.373334 write 0x033eb5 thru 0x036331 (0x247d bytes) 000169 1779870595.399650 mapwrite 0x038672 thru 0x03f116 (0x6aa5 bytes) 000170 1779870595.478026 mapwrite 0x01dc01 thru 0x01e8ae (0xcae bytes) 000171 1779870595.506096 mapread 0x011547 thru 0x0134cb (0x1f85 bytes) 000173 1779870595.521651 mapwrite 0x00b0fd thru 0x00b45d (0x361 bytes) 000174 1779870595.540708 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f117): Mirror 6: 0xa074c081 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f117): Mirror 6: 0xa074c081 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f117: skipped 000175 1779870595.789254 trunc from 0x038369 to 0x03f116 (0x6dae bytes) 000176 1779870595.793611 trunc from 0x00f0c0 to 0x01ef69 (0xfeaa bytes) 000177 1779870595.807848 punch from 0x021041 to 0x026a25 (0x59e5 bytes) 000178 1779870595.815137 trunc from 0x03f117 to 0x032566 (0xcbb0 bytes) 000179 1779870595.839917 fallocate 0x0366ad thru 0x03ffff (0x9953 bytes) 000180 1779870595.843952 read 0x02c819 thru 0x036c7e (0xa466 bytes) 000181 1779870595.855404 mapread 0x028338 thru 0x030061 (0x7d2a bytes) 000183 1779870595.884778 mapwrite 0x0116d9 thru 0x01b5ed (0x9f15 bytes) 000184 1779870595.924582 trunc from 0x040000 to 0x00650a (0x39af5 bytes) 000185 1779870595.941064 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) 000186 1779870596.058520 trunc from 0x00290f to 0x00650a (0x3bfc bytes) 000187 1779870596.063044 write 0x008482 thru 0x01726b (0xedea bytes) 000188 1779870596.069805 write 0x03588a thru 0x03bc33 (0x63aa bytes) 000189 1779870596.072152 trunc from 0x013d09 to 0x0150e7 (0x13df bytes) 000190 1779870596.085980 trunc from 0x02b550 to 0x039d98 (0xe849 bytes) 000192 1779870596.094795 trunc from 0x03bc34 to 0x02cf33 (0xed00 bytes) 000193 1779870596.117198 punch from 0x016133 to 0x024187 (0xe055 bytes) 000194 1779870596.130848 read 0x006dbe thru 0x00b9b8 (0x4bfb bytes) 000195 1779870596.138832 mapwrite 0x00406b thru 0x00f913 (0xb8a9 bytes) 000196 1779870596.181929 read 0x005ab5 thru 0x00ef30 (0x947c bytes) 000197 1779870596.183069 trunc from 0x000ba2 to 0x00757a (0x69d9 bytes) 000198 1779870596.188356 write 0x004099 thru 0x01281c (0xe784 bytes) 000200 1779870596.212398 mapread 0x002d36 thru 0x00625b (0x3526 bytes) 000201 1779870596.214154 mapread 0x014aad thru 0x0195b7 (0x4b0b bytes) 000202 1779870596.215226 fallocate 0x00bab0 thru 0x01218e (0x66df bytes) 000203 1779870596.225422 MIRROR_EXTEND to 2 mirrors 000205 1779870596.830278 read 0x018a07 thru 0x021c51 (0x924b bytes) 000207 1779870596.841849 punch from 0x01a00a to 0x01bb4c (0x1b43 bytes) 000208 1779870596.880562 trunc from 0x02cf34 to 0x008861 (0x246d2 bytes) 000209 1779870596.922519 punch from 0x007d0e to 0x008313 (0x606 bytes) 000210 1779870596.930148 mapread 0x00439b thru 0x008861 (0x44c7 bytes) 000211 1779870596.951500 mapread 0x005d77 thru 0x008861 (0x2aeb bytes) 000212 1779870596.959364 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x8862): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8862): Mirror 2: 0xb0b11a88 (stale) CRC-32 checksum value for chunk [0, 0x8862): Mirror 1: 0xd4532de4 Mirror 3: 0xd4532de4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8862: skipped 000213 1779870597.700612 mapread 0x00432b thru 0x008861 (0x4537 bytes) 000214 1779870597.732161 mapread 0x001f5a thru 0x007249 (0x52f0 bytes) 000215 1779870597.747215 punch from 0x0026a3 to 0x0071da (0x4b38 bytes) 000217 1779870597.791481 read 0x003dd7 thru 0x008861 (0x4a8b bytes) 000218 1779870597.799617 write 0x01a67e thru 0x029efb (0xf87e bytes) 000219 1779870597.810034 write 0x0005e3 thru 0x0034be (0x2edc bytes) 000221 1779870597.835267 MIRROR_RESYNC 3 mirrors 000222 1779870598.600118 punch from 0x010a61 to 0x013b33 (0x30d3 bytes) 000224 1779870598.647701 write 0x0127ec thru 0x014a5b (0x2270 bytes) 000225 1779870598.667152 trunc from 0x029efc to 0x014e71 (0x1508a bytes) 000226 1779870598.696508 punch from 0x008dfe to 0x00ae07 (0x200a bytes) 000227 1779870598.701522 mapread 0x003a33 thru 0x004b89 (0x1157 bytes) 000229 1779870598.714276 trunc from 0x014e72 to 0x011d42 (0x312f bytes) 000230 1779870598.733775 read 0x0084eb thru 0x00ce61 (0x4977 bytes) 000231 1779870598.734614 mapwrite 0x01f25e thru 0x02cafc (0xd89f bytes) 000232 1779870598.799210 mapread 0x001ba5 thru 0x00a2cd (0x8729 bytes) 000233 1779870598.801610 mapread 0x0269b1 thru 0x02abf1 (0x4241 bytes) 000234 1779870598.803341 trunc from 0x00ee86 to 0x015982 (0x6afd bytes) 000235 1779870598.809360 fallocate 0x0060c0 thru 0x00fceb (0x9c2c bytes) 000236 1779870598.818086 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2cafd): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cafd): Mirror 2: 0x3259e185 (stale) Mirror 3: 0x3259e185 (stale) CRC-32 checksum value for chunk [0, 0x2cafd): Mirror 1: 0x3eaf1b02 Mirror 4: 0x3eaf1b02 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cafd: skipped 000237 1779870599.531107 trunc from 0x00ae3c to 0x017792 (0xc957 bytes) 000238 1779870599.565793 mapwrite 0x03060b thru 0x03ebb2 (0xe5a8 bytes) 000239 1779870599.636936 mapwrite 0x0396b3 thru 0x03ffff (0x694d bytes) 000240 1779870599.677063 trunc from 0x040000 to 0x00adca (0x35235 bytes) 000241 1779870599.693315 trunc from 0x00adcb to 0x007d01 (0x30c9 bytes) 000242 1779870599.714009 fallocate 0x01d832 thru 0x02b33d (0xdb0c bytes) 000243 1779870599.720451 trunc from 0x00168f to 0x007d01 (0x6673 bytes) 000244 1779870599.725571 fallocate 0x01b10b thru 0x02a85f (0xf755 bytes) 000245 1779870599.730705 mapread 0x0158e0 thru 0x019fa8 (0x46c9 bytes) 000247 1779870599.740563 fallocate 0x0138e8 thru 0x014f90 (0x16a9 bytes) 000248 1779870599.750907 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a860): Mirror 3: 0x75152d5 (stale) Mirror 4: 0x13da2305 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a860): Mirror 3: 0x75152d5 (stale) Mirror 4: 0x13da2305 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a860: skipped 000249 1779870599.980812 read 0x000fad thru 0x00d5f7 (0xc64b bytes) 000250 1779870599.988213 write 0x0155ca thru 0x02040f (0xae46 bytes) 000251 1779870600.000542 trunc from 0x01347a to 0x01e38d (0xaf14 bytes) 000252 1779870600.021135 punch from 0x0060b2 to 0x00d2f4 (0x7243 bytes) 000253 1779870600.026291 fallocate 0x000738 thru 0x00a2c3 (0x9b8c bytes) 000254 1779870600.031494 trunc from 0x02a285 to 0x02a85f (0x5db bytes) 000255 1779870600.036358 mapwrite 0x02ba83 thru 0x03600b (0xa589 bytes) 000256 1779870600.081112 mapread 0x0186db thru 0x019e51 (0x1777 bytes) 000257 1779870600.091511 trunc from 0x03600c to 0x026fd4 (0xf037 bytes) 000258 1779870600.114912 fallocate 0x00dfa9 thru 0x011bda (0x3c32 bytes) 000259 1779870600.122856 mapwrite 0x035c00 thru 0x0380ec (0x24ed bytes) 000260 1779870600.160625 mapwrite 0x0183ee thru 0x027410 (0xf023 bytes) 000262 1779870600.188934 trunc from 0x0380ed to 0x0236a3 (0x14a49 bytes) 000264 1779870600.206430 trunc from 0x011a2a to 0x012929 (0xf00 bytes) 000265 1779870600.213302 write 0x006bce thru 0x009b1c (0x2f4f bytes) 000267 1779870600.223729 mapread 0x01944e thru 0x0236a3 (0xa256 bytes) 000268 1779870600.225148 mapwrite 0x0182b0 thru 0x01d014 (0x4d65 bytes) 000269 1779870600.262103 MIRROR_RESYNC 3 mirrors 000270 1779870600.925078 fallocate 0x022c3a thru 0x02b655 (0x8a1c bytes) 000271 1779870600.948224 mapread 0x01145d thru 0x01947b (0x801f bytes) 000272 1779870600.964317 mapread 0x01ce6f thru 0x0236a3 (0x6835 bytes) 000274 1779870600.978445 trunc from 0x021bd4 to 0x0236a3 (0x1ad0 bytes) 000275 1779870600.984071 mapread 0x011e2e thru 0x01a5ca (0x879d bytes) 000276 1779870600.989567 MIRROR_RESYNC 3 mirrors 000277 1779870601.744360 read 0x00a65a thru 0x00d1e8 (0x2b8f bytes) 000278 1779870601.751551 write 0x007e38 thru 0x01206c (0xa235 bytes) 000279 1779870601.780048 write 0x036aa9 thru 0x03fa6d (0x8fc5 bytes) 000280 1779870601.781860 write 0x00b1d0 thru 0x00d962 (0x2793 bytes) 000281 1779870601.785336 punch from 0x0260fa to 0x02ba71 (0x5978 bytes) 000282 1779870601.789585 write 0x030b5f thru 0x034fec (0x448e bytes) 000283 1779870601.797208 mapwrite 0x01fba6 thru 0x021bcb (0x2026 bytes) 000284 1779870601.827407 punch from 0x01fbfe to 0x02475f (0x4b62 bytes) 000285 1779870601.833235 trunc from 0x03fa6e to 0x03897a (0x70f3 bytes) 000286 1779870601.856280 trunc from 0x010c6f to 0x012606 (0x1998 bytes) 000287 1779870601.861199 mapwrite 0x0334ee thru 0x03ffff (0xcb12 bytes) 000288 1779870601.912537 mapwrite 0x02e2a7 thru 0x0372e0 (0x903a bytes) 000289 1779870601.938938 mapread 0x03efd0 thru 0x03ffff (0x1030 bytes) 000290 1779870601.946015 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc4505b19 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc4505b19 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000291 1779870602.165116 punch from 0x023573 to 0x030829 (0xd2b7 bytes) 000292 1779870602.173102 read 0x01382f thru 0x0215be (0xdd90 bytes) 000293 1779870602.181972 mapread 0x0207ed thru 0x02d00d (0xc821 bytes) 000294 1779870602.204110 mapwrite 0x03ba0d thru 0x03ffff (0x45f3 bytes) 000295 1779870602.225825 trunc from 0x037e43 to 0x03c403 (0x45c1 bytes) 000296 1779870602.229810 mapwrite 0x01dcd7 thru 0x0250c0 (0x73ea bytes) 000297 1779870602.254044 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) 000298 1779870602.366017 mapread 0x000047 thru 0x000545 (0x4ff bytes) 000299 1779870602.370616 write 0x0071d5 thru 0x00a8aa (0x36d6 bytes) 000300 1779870602.384904 read 0x0358f1 thru 0x03ffff (0xa70f bytes) 000301 1779870602.399353 write 0x01e42f thru 0x023ac3 (0x5695 bytes) 000302 1779870602.405482 trunc from 0x040000 to 0x0058d8 (0x3a727 bytes) 000303 1779870602.425017 trunc from 0x000e4f to 0x0037d8 (0x298a bytes) 000304 1779870602.434570 read 0x004ea6 thru 0x0058d8 (0xa33 bytes) 000306 1779870602.446277 punch from 0x002a86 to 0x0058d8 (0x2e53 bytes) 000310 1779870602.461906 MIRROR_EXTEND to 2 mirrors 000311 1779870602.895277 MIRROR_EXTEND to 3 mirrors 000312 1779870603.405558 punch from 0x00071f to 0x0058d8 (0x51ba bytes) 000313 1779870603.429069 fallocate 0x0157de thru 0x01e941 (0x9164 bytes) 000314 1779870603.433398 mapwrite 0x03fbfb thru 0x03ffff (0x405 bytes) 000315 1779870603.479571 write 0x02552e thru 0x025d56 (0x829 bytes) 000316 1779870603.486406 trunc from 0x040000 to 0x02a713 (0x158ec bytes) 000317 1779870603.502810 trunc from 0x00bcef to 0x0115cc (0x58de bytes) 000318 1779870603.515250 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2a714): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a714): Mirror 2: 0x95b934fe (stale) Mirror 3: 0x95b934fe (stale) CRC-32 checksum value for chunk [0, 0x2a714): Mirror 1: 0xbb23b37d Mirror 4: 0xbb23b37d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a714: skipped 000319 1779870604.212189 write 0x03eaee thru 0x03ffff (0x1512 bytes) 000320 1779870604.248403 fallocate 0x030b1e thru 0x03264b (0x1b2e bytes) 000322 1779870604.255147 mapwrite 0x01d7bc thru 0x02734f (0x9b94 bytes) 000323 1779870604.322473 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4d694d91 (stale) Mirror 4: 0xd7bf1cc5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4d694d91 (stale) Mirror 4: 0xd7bf1cc5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000324 1779870604.567316 trunc from 0x02b40d to 0x03188b (0x647f bytes) 000325 1779870604.572352 fallocate 0x034376 thru 0x0391ed (0x4e78 bytes) 000326 1779870604.578849 trunc from 0x040000 to 0x01a268 (0x25d97 bytes) 000327 1779870604.600549 punch from 0x001382 to 0x010afa (0xf779 bytes) 000328 1779870604.607918 mapread 0x00e451 thru 0x00e6ca (0x27a bytes) 000329 1779870604.614818 punch from 0x019a5f to 0x01a268 (0x80a bytes) 000330 1779870604.620875 fallocate 0x034cc3 thru 0x03e79f (0x9add bytes) 000331 1779870604.625412 punch from 0x006de6 to 0x00f9f0 (0x8c0b bytes) 000333 1779870604.630774 mapread 0x00cbfa thru 0x01a268 (0xd66f bytes) 000334 1779870604.656584 write 0x00c36d thru 0x01b3d7 (0xf06b bytes) 000335 1779870604.659585 fallocate 0x0223c6 thru 0x0241e7 (0x1e22 bytes) 000336 1779870604.666355 mapread 0x0161d5 thru 0x01b3d7 (0x5203 bytes) 000337 1779870604.668164 fallocate 0x02adf0 thru 0x02f3bb (0x45cc bytes) 000338 1779870604.675109 write 0x0338a5 thru 0x0348a8 (0x1004 bytes) 000339 1779870604.679524 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x348a9): Mirror 4: 0x76a9685f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x348a9): Mirror 4: 0x76a9685f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x348a9: skipped 000340 1779870604.891731 punch from 0x01f1e3 to 0x026a3f (0x785d bytes) 000341 1779870604.902781 write 0x02c77a thru 0x03455d (0x7de4 bytes) 000342 1779870604.920387 trunc from 0x0348a9 to 0x032c5c (0x1c4c bytes) 000343 1779870604.935631 read 0x030e8a thru 0x032c5c (0x1dd3 bytes) 000344 1779870604.936513 punch from 0x02e99c to 0x02ee85 (0x4ea bytes) 000345 1779870604.948552 trunc from 0x031777 to 0x032c5c (0x14e6 bytes) 000346 1779870604.955819 trunc from 0x032c5d to 0x00f32d (0x2392f bytes) 000347 1779870604.968614 mapwrite 0x00c6e3 thru 0x01233f (0x5c5d bytes) 000349 1779870605.017055 read 0x007ab1 thru 0x010a9c (0x8fec bytes) 000350 1779870605.017908 fallocate 0x00218e thru 0x00f512 (0xd385 bytes) 000351 1779870605.027916 mapwrite 0x018b23 thru 0x025d3e (0xd21c bytes) 000352 1779870605.088961 read 0x01487d thru 0x020571 (0xbcf5 bytes) 000353 1779870605.090015 mapread 0x0147e2 thru 0x0239f1 (0xf210 bytes) 000354 1779870605.096192 punch from 0x015b91 to 0x023a3c (0xdeac bytes) 000355 1779870605.105857 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x25d3f): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25d3f): Mirror 4: 0x61742211 (stale) CRC-32 checksum value for chunk [0, 0x25d3f): Mirror 1: 0x5f951b28 Mirror 5: 0x5f951b28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25d3f: skipped 000356 1779870605.757406 trunc from 0x025d3f to 0x02f2fd (0x95bf bytes) 000357 1779870605.834003 mapread 0x02f034 thru 0x02f2fd (0x2ca bytes) 000358 1779870605.841205 write 0x01cf54 thru 0x02997a (0xca27 bytes) 000359 1779870605.855279 read 0x000147 thru 0x00e3a1 (0xe25b bytes) 000360 1779870605.865813 mapread 0x00c06a thru 0x01b11a (0xf0b1 bytes) 000362 1779870605.889212 fallocate 0x02c6e7 thru 0x034037 (0x7951 bytes) 000363 1779870605.898554 punch from 0x004b12 to 0x009572 (0x4a61 bytes) 000364 1779870605.905054 trunc from 0x00a873 to 0x015e32 (0xb5c0 bytes) 000365 1779870605.912100 mapread 0x020381 thru 0x02e5d6 (0xe256 bytes) 000366 1779870605.921895 mapread 0x01ffaf thru 0x020adb (0xb2d bytes) 000367 1779870605.923949 punch from 0x01eaaa to 0x021371 (0x28c8 bytes) 000368 1779870605.946055 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x34038): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34038): Mirror 4: 0xd1f2d7c7 (stale) Mirror 5: 0xa0a762dc (stale) CRC-32 checksum value for chunk [0, 0x34038): Mirror 1: 0x3bdd2326 Mirror 6: 0x3bdd2326 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34038: skipped 000369 1779870606.797246 mapread 0x00154c thru 0x00918f (0x7c44 bytes) 000370 1779870606.851740 trunc from 0x022c02 to 0x0303a0 (0xd79f bytes) 000371 1779870606.915220 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34038): Mirror 4: 0xd1f2d7c7 (stale) Mirror 6: 0x3bdd2326 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34038): Mirror 4: 0xd1f2d7c7 (stale) Mirror 6: 0x3bdd2326 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34038: skipped 000372 1779870607.244102 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x34038): Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34038): Mirror 4: 0xd1f2d7c7 (stale) Mirror 6: 0x3bdd2326 (stale) CRC-32 checksum value for chunk [0, 0x34038): Mirror 1: 0xd641328f Mirror 7: 0xd641328f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34038: skipped 000374 1779870608.119931 trunc from 0x01d878 to 0x02cf18 (0xf6a1 bytes) 000375 1779870608.158186 punch from 0x00eb23 to 0x01048d (0x196b bytes) 000376 1779870608.163476 trunc from 0x034038 to 0x020b94 (0x134a3 bytes) 000377 1779870608.187135 trunc from 0x020b95 to 0x0225ee (0x1a5a bytes) 000378 1779870608.214217 trunc from 0x013f12 to 0x015a86 (0x1b75 bytes) 000379 1779870608.222703 punch from 0x0129bb to 0x016640 (0x3c86 bytes) 000380 1779870608.227498 mapread 0x00e5c6 thru 0x016fcb (0x8a06 bytes) 000381 1779870608.248034 write 0x027a3f thru 0x033505 (0xbac7 bytes) 000382 1779870608.250463 mapread 0x02c267 thru 0x02c6fd (0x497 bytes) 000383 1779870608.252147 read 0x001405 thru 0x0103a8 (0xefa4 bytes) 000384 1779870608.261074 trunc from 0x033506 to 0x00a705 (0x28e00 bytes) 000385 1779870608.277489 trunc from 0x0035a5 to 0x008efa (0x5956 bytes) 000386 1779870608.284600 mapwrite 0x0293d0 thru 0x034513 (0xb144 bytes) 000387 1779870608.353583 trunc from 0x034514 to 0x01c1a8 (0x1836b bytes) 000388 1779870608.375138 punch from 0x011c50 to 0x019c16 (0x7fc7 bytes) 000389 1779870608.380129 write 0x01c0d2 thru 0x01e0e8 (0x2017 bytes) 000390 1779870608.399159 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1e0e9): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e0e9): Mirror 4: 0x5c9dd5b3 (stale) Mirror 6: 0x11275c78 (stale) Mirror 7: 0x11275c78 (stale) CRC-32 checksum value for chunk [0, 0x1e0e9): Mirror 1: 0x69098db2 Mirror 8: 0x69098db2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e0e9: skipped 000391 1779870609.045064 mapread 0x01b3c9 thru 0x01e0e8 (0x2d20 bytes) 000392 1779870609.081418 mapread 0x006da4 thru 0x00a31b (0x3578 bytes) 000393 1779870609.111631 mapread 0x00d2b3 thru 0x00dc85 (0x9d3 bytes) 000394 1779870609.127784 write 0x01f25c thru 0x028382 (0x9127 bytes) 000396 1779870609.169219 trunc from 0x000ad7 to 0x009a1b (0x8f45 bytes) 000397 1779870609.174528 fallocate 0x03c888 thru 0x03cfa4 (0x71d bytes) 000398 1779870609.180909 write 0x02d26a thru 0x0380df (0xae76 bytes) 000401 1779870609.187769 mapwrite 0x0116e8 thru 0x015ba1 (0x44ba bytes) 000402 1779870609.219906 fallocate 0x028b34 thru 0x0302dd (0x77aa bytes) 000403 1779870609.224644 trunc from 0x0055c6 to 0x00cd07 (0x7742 bytes) 000404 1779870609.232471 punch from 0x017a78 to 0x02205b (0xa5e4 bytes) 000405 1779870609.240573 trunc from 0x0380e0 to 0x00c372 (0x2bd6d bytes) 000406 1779870609.291830 fallocate 0x027fc2 thru 0x0368bd (0xe8fc bytes) 000407 1779870609.301627 mapread 0x007fbb thru 0x00c372 (0x43b8 bytes) 000408 1779870609.313826 write 0x031be5 thru 0x03ffff (0xe41b bytes) 000409 1779870609.317726 mapwrite 0x039412 thru 0x03ffff (0x6bee bytes) 000410 1779870609.332444 read 0x013e8a thru 0x01a4f4 (0x666b bytes) 000411 1779870609.343161 mapwrite 0x01af1c thru 0x01c0de (0x11c3 bytes) 000412 1779870609.368546 trunc from 0x040000 to 0x03d417 (0x2be8 bytes) 000413 1779870609.385066 punch from 0x035789 to 0x03d417 (0x7c8f bytes) 000414 1779870609.391789 punch from 0x000855 to 0x00222e (0x19da bytes) 000415 1779870609.396258 fallocate 0x037515 thru 0x03bf30 (0x4a1c bytes) 000416 1779870609.401514 read 0x02d913 thru 0x03cb3e (0xf22c bytes) 000417 1779870609.411136 trunc from 0x005de3 to 0x006e53 (0x1071 bytes) 000418 1779870609.420437 mapwrite 0x00f2ea thru 0x01189a (0x25b1 bytes) 000419 1779870609.443734 mapread 0x009de1 thru 0x00ac8a (0xeaa bytes) 000420 1779870609.452976 MIRROR_RESYNC 5 mirrors 000421 1779870610.824499 write 0x0162af thru 0x01c05b (0x5dad bytes) 000422 1779870610.862585 punch from 0x0231e5 to 0x0302c5 (0xd0e1 bytes) 000423 1779870610.869969 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d418): Mirror 4: 0xe9aeaf06 (stale) Mirror 6: 0xe9aeaf06 (stale) Mirror 7: 0xe9aeaf06 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d418): Mirror 4: 0xe9aeaf06 (stale) Mirror 6: 0xe9aeaf06 (stale) Mirror 7: 0xe9aeaf06 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d418: skipped 000424 1779870611.200251 punch from 0x011c4b to 0x015d49 (0x40ff bytes) 000426 1779870611.206517 fallocate 0x012f4a thru 0x020139 (0xd1f0 bytes) 000427 1779870611.215027 punch from 0x03ce9a to 0x03d417 (0x57e bytes) 000428 1779870611.223454 read 0x033561 thru 0x034041 (0xae1 bytes) 000429 1779870611.229429 read 0x00b259 thru 0x00f0bd (0x3e65 bytes) 000431 1779870611.247887 trunc from 0x03d418 to 0x005ad0 (0x37947 bytes) 000432 1779870611.289733 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x5ad1): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5ad1): Mirror 4: 0xeead7f89 (stale) Mirror 6: 0xeead7f89 (stale) Mirror 7: 0xeead7f89 (stale) CRC-32 checksum value for chunk [0, 0x5ad1): Mirror 1: 0xeead7f89 Mirror 8: 0xeead7f89 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5ad1: skipped 000433 1779870611.931394 fallocate 0x02928b thru 0x0356f1 (0xc467 bytes) 000434 1779870611.975796 write 0x012a46 thru 0x0207f4 (0xddaf bytes) 000435 1779870611.988193 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x207f5): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x207f5): Mirror 4: 0x3421ce6b (stale) Mirror 6: 0x3421ce6b (stale) Mirror 7: 0x3421ce6b (stale) Mirror 8: 0xad39f903 (stale) CRC-32 checksum value for chunk [0, 0x207f5): Mirror 1: 0x327b07e9 Mirror 9: 0x327b07e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x207f5: skipped 000436 1779870612.661081 fallocate 0x03fa76 thru 0x03ffff (0x58a bytes) 000437 1779870612.695277 trunc from 0x01fa64 to 0x0207f4 (0xd91 bytes) 000438 1779870612.701945 read 0x015167 thru 0x01a244 (0x50de bytes) 000440 1779870612.715219 mapread 0x01fb4d thru 0x0207f4 (0xca8 bytes) 000441 1779870612.727279 mapwrite 0x0077ba thru 0x0157dc (0xe023 bytes) 000442 1779870612.765460 mapwrite 0x00669b thru 0x00f871 (0x91d7 bytes) 000443 1779870612.785145 write 0x01c67d thru 0x025457 (0x8ddb bytes) 000444 1779870612.795544 trunc from 0x00ecee to 0x019d27 (0xb03a bytes) 000445 1779870612.800955 trunc from 0x015674 to 0x015940 (0x2cd bytes) 000446 1779870612.808317 mapread 0x006dd8 thru 0x00b977 (0x4ba0 bytes) 000447 1779870612.820034 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25458): Mirror 4: 0xb09681c6 (stale) Mirror 6: 0xb09681c6 (stale) Mirror 7: 0xb09681c6 (stale) Mirror 8: 0xacc7fdb5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25458): Mirror 4: 0xb09681c6 (stale) Mirror 6: 0xb09681c6 (stale) Mirror 7: 0xb09681c6 (stale) Mirror 8: 0xacc7fdb5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25458: skipped 000448 1779870613.099775 fallocate 0x0027ac thru 0x008f39 (0x678e bytes) 000449 1779870613.105397 read 0x013da0 thru 0x019075 (0x52d6 bytes) 000450 1779870613.112598 read 0x014ebd thru 0x024341 (0xf485 bytes) 000451 1779870613.120764 mapwrite 0x028dee thru 0x02b47f (0x2692 bytes) 000452 1779870613.164213 read 0x00a247 thru 0x00d0c4 (0x2e7e bytes) 000453 1779870613.165011 mapread 0x005605 thru 0x00f1ee (0x9bea bytes) 000455 1779870613.167801 trunc from 0x02b480 to 0x03e830 (0x133b1 bytes) 000456 1779870613.182790 read 0x000e04 thru 0x008474 (0x7671 bytes) 000457 1779870613.184405 trunc from 0x03e831 to 0x00619a (0x38696 bytes) 000458 1779870613.199111 read 0x001f61 thru 0x00619a (0x423a bytes) 000461 1779870613.206941 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x619b): Mirror 4: 0x9554f2e0 (stale) Mirror 6: 0x9554f2e0 (stale) Mirror 7: 0x9554f2e0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x619b): Mirror 4: 0x9554f2e0 (stale) Mirror 6: 0x9554f2e0 (stale) Mirror 7: 0x9554f2e0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x619b: skipped 000462 1779870613.463441 MIRROR_RESYNC 4 mirrors 000463 1779870614.114947 trunc from 0x00619b to 0x039cb6 (0x33b1c bytes) 000464 1779870614.162589 mapwrite 0x00923e thru 0x015a8b (0xc84e bytes) 000465 1779870614.198934 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39cb7): Mirror 4: 0x82c0eec6 (stale) Mirror 6: 0x82c0eec6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39cb7): Mirror 4: 0x82c0eec6 (stale) Mirror 6: 0x82c0eec6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39cb7: skipped 000467 1779870614.462423 mapread 0x005b81 thru 0x00d46a (0x78ea bytes) 000469 1779870614.482548 punch from 0x034b74 to 0x037c42 (0x30cf bytes) 000470 1779870614.490068 punch from 0x02d2eb to 0x02f334 (0x204a bytes) 000471 1779870614.495147 write 0x018751 thru 0x01be49 (0x36f9 bytes) 000472 1779870614.513263 trunc from 0x039cb7 to 0x01cce4 (0x1cfd2 bytes) 000473 1779870614.529037 read 0x014de5 thru 0x01cce4 (0x7f00 bytes) 000474 1779870614.529845 read 0x00e164 thru 0x0106a0 (0x253d bytes) 000475 1779870614.530447 mapwrite 0x031b48 thru 0x03b725 (0x9bde bytes) 000476 1779870614.583455 fallocate 0x027010 thru 0x02a566 (0x3557 bytes) 000477 1779870614.591570 trunc from 0x03b726 to 0x01352e (0x281f7 bytes) 000478 1779870614.609450 mapwrite 0x000910 thru 0x00691d (0x600e bytes) 000479 1779870614.631741 read 0x01297d thru 0x01352e (0xbb2 bytes) 000480 1779870614.632445 fallocate 0x025b5a thru 0x03577a (0xfc21 bytes) 000481 1779870614.638542 read 0x002f96 thru 0x012585 (0xf5f0 bytes) 000482 1779870614.640129 write 0x00e8ab thru 0x015cfc (0x7452 bytes) 000484 1779870614.647129 trunc from 0x010243 to 0x0129f8 (0x27b6 bytes) 000485 1779870614.658956 mapwrite 0x003a67 thru 0x00ccb3 (0x924d bytes) 000486 1779870614.680382 fallocate 0x038a79 thru 0x039953 (0xedb bytes) 000487 1779870614.689690 trunc from 0x025851 to 0x02869c (0x2e4c bytes) 000489 1779870614.699935 read 0x0002ea thru 0x007ba0 (0x78b7 bytes) 000491 1779870614.701864 punch from 0x03418c to 0x034873 (0x6e8 bytes) 000492 1779870614.707253 fallocate 0x02bf32 thru 0x031ff9 (0x60c8 bytes) 000493 1779870614.715205 trunc from 0x019092 to 0x022de8 (0x9d57 bytes) 000494 1779870614.725255 trunc from 0x03577b to 0x028046 (0xd734 bytes) 000495 1779870614.740198 fallocate 0x03488b thru 0x037ef5 (0x366b bytes) 000496 1779870614.744844 write 0x017974 thru 0x01afae (0x363b bytes) 000497 1779870614.758102 trunc from 0x034f42 to 0x037ef5 (0x2fb4 bytes) 000498 1779870614.765616 mapread 0x02cedc thru 0x037ef5 (0xb01a bytes) 000499 1779870614.790158 trunc from 0x037ef6 to 0x001900 (0x365f5 bytes) 000500 1779870614.808627 mapread 0x000125 thru 0x001900 (0x17dc bytes) 000501 1779870614.809957 read 0x000cb8 thru 0x001900 (0xc49 bytes) 000502 1779870614.810599 trunc from 0x001901 to 0x029c9d (0x2839d bytes) 000503 1779870614.828791 write 0x01b047 thru 0x01b8e8 (0x8a2 bytes) 000504 1779870614.843103 read 0x0226a7 thru 0x029c9d (0x75f7 bytes) 000505 1779870614.848797 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x29c9e): Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29c9e): Mirror 4: 0xabd4fa70 (stale) Mirror 6: 0xabd4fa70 (stale) CRC-32 checksum value for chunk [0, 0x29c9e): Mirror 1: 0xdb1a76f2 Mirror 7: 0xdb1a76f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29c9e: skipped 000506 1779870615.518400 read 0x0123ac thru 0x013784 (0x13d9 bytes) 000507 1779870615.532304 punch from 0x0126a0 to 0x016b3c (0x449d bytes) 000508 1779870615.569144 punch from 0x023f66 to 0x025b07 (0x1ba2 bytes) 000509 1779870615.574332 write 0x015799 thru 0x022de9 (0xd651 bytes) 000510 1779870615.592495 mapwrite 0x03356a thru 0x03ade5 (0x787c bytes) 000511 1779870615.631144 read 0x0081e2 thru 0x00cc5e (0x4a7d bytes) 000512 1779870615.642045 mapwrite 0x0064c9 thru 0x012a15 (0xc54d bytes) 000513 1779870615.664330 mapwrite 0x017cdf thru 0x02149e (0x97c0 bytes) 000514 1779870615.677072 fallocate 0x02164e thru 0x02f6c2 (0xe075 bytes) 000515 1779870615.681512 mapread 0x035a7f thru 0x03ade5 (0x5367 bytes) 000516 1779870615.686056 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ade6): Mirror 6: 0x60be661f (stale) Mirror 7: 0xe2da03ba (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ade6): Mirror 6: 0x60be661f (stale) Mirror 7: 0xe2da03ba (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ade6: skipped 000517 1779870615.922302 mapwrite 0x018d38 thru 0x02093f (0x7c08 bytes) 000518 1779870615.954424 mapread 0x004031 thru 0x0078cd (0x389d bytes) 000519 1779870615.963073 trunc from 0x03ade6 to 0x018462 (0x22983 bytes) 000520 1779870615.982373 trunc from 0x015800 to 0x018462 (0x2c63 bytes) 000521 1779870615.987350 mapwrite 0x01ef3d thru 0x023904 (0x49c8 bytes) 000522 1779870616.051320 mapwrite 0x03b202 thru 0x03ffff (0x4dfe bytes) 000523 1779870616.093215 mapwrite 0x017d51 thru 0x01f46e (0x771e bytes) 000524 1779870616.116766 punch from 0x03fc95 to 0x03ffff (0x36b bytes) 000525 1779870616.122110 write 0x000323 thru 0x00f824 (0xf502 bytes) 000527 1779870616.129046 trunc from 0x01ec3b to 0x02b3bb (0xc781 bytes) 000528 1779870616.135260 mapread 0x008eba thru 0x00a8ab (0x19f2 bytes) 000529 1779870616.136417 mapread 0x031e15 thru 0x03ffff (0xe1eb bytes) 000531 1779870616.155883 read 0x018869 thru 0x01f848 (0x6fe0 bytes) 000533 1779870616.161938 punch from 0x02ce82 to 0x02cf0c (0x8b bytes) 000534 1779870616.166935 trunc from 0x02d433 to 0x03bf7e (0xeb4c bytes) 000535 1779870616.171891 write 0x02824c thru 0x035143 (0xcef8 bytes) 000536 1779870616.187682 mapwrite 0x0351a1 thru 0x03e018 (0x8e78 bytes) 000537 1779870616.213938 mapread 0x032c38 thru 0x033802 (0xbcb bytes) 000538 1779870616.214878 trunc from 0x040000 to 0x019058 (0x26fa7 bytes) 000539 1779870616.227792 read 0x010bba thru 0x019058 (0x849f bytes) 000540 1779870616.236938 mapread 0x00e760 thru 0x013bac (0x544d bytes) 000542 1779870616.238830 mapwrite 0x0290d6 thru 0x02f3bd (0x62e8 bytes) 000543 1779870616.280399 mapwrite 0x03bfd8 thru 0x03ffff (0x4028 bytes) 000544 1779870616.321219 trunc from 0x03ea3b to 0x03ffff (0x15c5 bytes) 000545 1779870616.329748 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd9d47e32 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd9d47e32 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000546 1779870616.531985 trunc from 0x00916e to 0x00d537 (0x43ca bytes) 000547 1779870616.539509 punch from 0x0371ca to 0x03ffff (0x8e36 bytes) 000548 1779870616.543933 punch from 0x03fe25 to 0x03ffff (0x1db bytes) 000550 1779870616.549440 fallocate 0x007406 thru 0x015114 (0xdd0f bytes) 000551 1779870616.555720 trunc from 0x040000 to 0x02ccb0 (0x1334f bytes) 000552 1779870616.575683 trunc from 0x02ccb1 to 0x01d0a1 (0xfc0f bytes) 000553 1779870616.594454 write 0x00a6ea thru 0x016c69 (0xc580 bytes) 000554 1779870616.604843 write 0x00c3ef thru 0x018123 (0xbd35 bytes) 000555 1779870616.612855 read 0x003f07 thru 0x007c75 (0x3d6f bytes) 000556 1779870616.621323 mapread 0x012433 thru 0x01a64d (0x821b bytes) 000557 1779870616.622512 fallocate 0x02f8ce thru 0x03aab6 (0xb1e9 bytes) 000558 1779870616.627063 punch from 0x01379a to 0x014bfc (0x1463 bytes) 000559 1779870616.636402 mapwrite 0x016c49 thru 0x01e1e4 (0x759c bytes) 000560 1779870616.668839 mapwrite 0x017971 thru 0x024d4c (0xd3dc bytes) 000561 1779870616.709531 mapread 0x001a74 thru 0x008253 (0x67e0 bytes) 000562 1779870616.716213 trunc from 0x024d4d to 0x03b56b (0x1681f bytes) 000563 1779870616.729943 read 0x01049b thru 0x010c46 (0x7ac bytes) 000564 1779870616.730754 read 0x036357 thru 0x03b56b (0x5215 bytes) 000565 1779870616.742182 punch from 0x024a16 to 0x033a68 (0xf053 bytes) 000566 1779870616.747161 trunc from 0x00a04b to 0x018196 (0xe14c bytes) 000567 1779870616.751823 trunc from 0x03b56c to 0x018fe2 (0x22589 bytes) 000568 1779870616.770938 read 0x00df02 thru 0x01142c (0x352b bytes) 000569 1779870616.782555 punch from 0x0087eb to 0x011138 (0x894e bytes) 000570 1779870616.787215 trunc from 0x018fe3 to 0x01a3ac (0x13ca bytes) 000571 1779870616.804994 read 0x012c77 thru 0x01a3ac (0x7736 bytes) 000572 1779870616.815824 mapwrite 0x03b14f thru 0x03ffff (0x4eb1 bytes) 000573 1779870616.855567 trunc from 0x040000 to 0x0190b5 (0x26f4a bytes) 000574 1779870616.866262 fallocate 0x01adf4 thru 0x024ea5 (0xa0b2 bytes) 000575 1779870616.872595 fallocate 0x0062c5 thru 0x00c5d1 (0x630d bytes) 000576 1779870616.877360 mapwrite 0x0366de thru 0x03d15a (0x6a7d bytes) 000577 1779870616.948753 mapwrite 0x015564 thru 0x01556a (0x7 bytes) 000578 1779870616.964084 trunc from 0x00bf03 to 0x0169a5 (0xaaa3 bytes) 000579 1779870616.970349 punch from 0x02be3b to 0x02c125 (0x2eb bytes) 000580 1779870616.974978 trunc from 0x00ee70 to 0x01ba5f (0xcbf0 bytes) 000581 1779870616.979175 write 0x0293cf thru 0x02ca58 (0x368a bytes) 000582 1779870616.989605 mapwrite 0x0167b9 thru 0x02499c (0xe1e4 bytes) 000583 1779870617.073534 write 0x029729 thru 0x02c047 (0x291f bytes) 000584 1779870617.074893 mapwrite 0x02b992 thru 0x0384b5 (0xcb24 bytes) 000585 1779870617.150302 MIRROR_RESYNC 2 mirrors 000586 1779870617.614805 fallocate 0x020ab3 thru 0x02c7c0 (0xbd0e bytes) 000587 1779870617.650427 write 0x016077 thru 0x01e6ff (0x8689 bytes) 000588 1779870617.663009 trunc from 0x019167 to 0x0217c6 (0x8660 bytes) 000589 1779870617.679017 fallocate 0x030a0d thru 0x03201c (0x1610 bytes) 000590 1779870617.686255 punch from 0x0223ab to 0x02c480 (0xa0d6 bytes) 000591 1779870617.692354 write 0x02289a thru 0x02a13f (0x78a6 bytes) 000592 1779870617.705808 fallocate 0x03a70a thru 0x03f0b6 (0x49ad bytes) 000593 1779870617.711284 mapread 0x0257ab thru 0x03149c (0xbcf2 bytes) 000594 1779870617.722248 punch from 0x033617 to 0x037a43 (0x442d bytes) 000596 1779870617.727449 punch from 0x03239e to 0x03f0b6 (0xcd19 bytes) 000597 1779870617.733130 trunc from 0x03130c to 0x036d30 (0x5a25 bytes) 000598 1779870617.740759 read 0x0201a3 thru 0x02d2b0 (0xd10e bytes) 000600 1779870617.742192 punch from 0x0394f3 to 0x03e6b6 (0x51c4 bytes) 000601 1779870617.747595 punch from 0x03d2fa to 0x03f0b6 (0x1dbd bytes) 000603 1779870617.752838 read 0x020e29 thru 0x02cb60 (0xbd38 bytes) 000604 1779870617.753977 trunc from 0x03032f to 0x03e3e1 (0xe0b3 bytes) 000605 1779870617.760840 read 0x0352dc thru 0x03894e (0x3673 bytes) 000606 1779870617.771572 mapread 0x01479e thru 0x019998 (0x51fb bytes) 000607 1779870617.773001 mapwrite 0x03d675 thru 0x03ffff (0x298b bytes) 000608 1779870617.820828 punch from 0x01a9a0 to 0x024448 (0x9aa9 bytes) 000609 1779870617.826410 mapwrite 0x00b037 thru 0x00b987 (0x951 bytes) 000611 1779870617.839009 mapread 0x028b4a thru 0x035463 (0xc91a bytes) 000612 1779870617.845602 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd42a0d48 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5d8a14de Mirror 8: 0x5d8a14de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000613 1779870618.581014 read 0x00ef6d thru 0x00f579 (0x60d bytes) 000614 1779870618.592310 fallocate 0x02fced thru 0x034044 (0x4358 bytes) 000615 1779870618.635166 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x5d8a14de (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x5d8a14de (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000617 1779870618.879383 trunc from 0x02a129 to 0x02f656 (0x552e bytes) 000618 1779870618.885135 mapread 0x024d18 thru 0x0263c9 (0x16b2 bytes) 000619 1779870618.902038 write 0x033138 thru 0x03abf8 (0x7ac1 bytes) 000620 1779870618.923422 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) 000621 1779870619.032991 trunc from 0x03a64d to 0x03ffff (0x59b3 bytes) 000622 1779870619.037190 trunc from 0x01578e to 0x01a860 (0x50d3 bytes) 000624 1779870619.042142 write 0x038f84 thru 0x03ffff (0x707c bytes) 000625 1779870619.050374 punch from 0x02a5b5 to 0x02d1c5 (0x2c11 bytes) 000626 1779870619.056180 mapread 0x014644 thru 0x01a1b5 (0x5b72 bytes) 000627 1779870619.072018 write 0x0299b3 thru 0x038f1c (0xf56a bytes) 000628 1779870619.081635 trunc from 0x01f5fa to 0x021c59 (0x2660 bytes) 000629 1779870619.086033 punch from 0x027683 to 0x02c272 (0x4bf0 bytes) 000631 1779870619.098191 trunc from 0x000dc0 to 0x00ffbe (0xf1ff bytes) 000632 1779870619.102407 trunc from 0x0386ad to 0x03ebab (0x64ff bytes) 000635 1779870619.108477 fallocate 0x0220ab thru 0x026a02 (0x4958 bytes) 000637 1779870619.117420 punch from 0x01106d to 0x013d1c (0x2cb0 bytes) 000638 1779870619.122002 mapwrite 0x0046ad thru 0x00b48b (0x6ddf bytes) 000639 1779870619.144722 trunc from 0x00cd1f to 0x00e8ca (0x1bac bytes) 000640 1779870619.150756 read 0x0259f5 thru 0x02fce2 (0xa2ee bytes) 000641 1779870619.166904 MIRROR_EXTEND to 2 mirrors 000643 1779870619.654698 mapwrite 0x015dbb thru 0x01f824 (0x9a6a bytes) 000644 1779870619.740169 fallocate 0x00ba71 thru 0x01af49 (0xf4d9 bytes) 000645 1779870619.743861 fallocate 0x02172c thru 0x02b70f (0x9fe4 bytes) 000646 1779870619.747777 write 0x036dd2 thru 0x03ffff (0x922e bytes) 000647 1779870619.766308 trunc from 0x01db4b to 0x02d958 (0xfe0e bytes) 000649 1779870619.772443 trunc from 0x040000 to 0x03ec11 (0x13ee bytes) 000650 1779870619.817286 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3ec12): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec12): Mirror 2: 0x5b5550fc (stale) CRC-32 checksum value for chunk [0, 0x3ec12): Mirror 1: 0x4d8812bb Mirror 3: 0x4d8812bb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec12: skipped 000651 1779870620.629262 write 0x003b85 thru 0x007669 (0x3ae5 bytes) 000652 1779870620.680578 trunc from 0x00fa20 to 0x01a0bc (0xa69d bytes) 000653 1779870620.690327 MIRROR_RESYNC 3 mirrors 000654 1779870621.478191 trunc from 0x03ec12 to 0x01cdc1 (0x21e50 bytes) 000655 1779870621.511316 mapread 0x01c705 thru 0x01cdc1 (0x6bd bytes) 000656 1779870621.520179 write 0x022361 thru 0x026138 (0x3dd8 bytes) 000657 1779870621.523260 mapread 0x022377 thru 0x026138 (0x3dc2 bytes) 000658 1779870621.525498 punch from 0x022e85 to 0x026138 (0x32b4 bytes) 000659 1779870621.538080 trunc from 0x01cfbe to 0x01e74b (0x178e bytes) 000660 1779870621.547120 fallocate 0x00f0ff thru 0x01935a (0xa25c bytes) 000661 1779870621.553014 mapwrite 0x01c0ea thru 0x01e3ef (0x2306 bytes) 000662 1779870621.589771 read 0x021beb thru 0x026138 (0x454e bytes) 000663 1779870621.596339 write 0x0001d3 thru 0x00fd66 (0xfb94 bytes) 000664 1779870621.612801 punch from 0x00e395 to 0x015196 (0x6e02 bytes) 000665 1779870621.629009 punch from 0x02038a to 0x022283 (0x1efa bytes) 000666 1779870621.633836 fallocate 0x01e9a8 thru 0x025c83 (0x72dc bytes) 000667 1779870621.641821 mapread 0x00fc41 thru 0x01ea16 (0xedd6 bytes) 000668 1779870621.653259 trunc from 0x016587 to 0x01ceb9 (0x6933 bytes) 000669 1779870621.659022 punch from 0x00f40b to 0x010fbb (0x1bb1 bytes) 000670 1779870621.665755 punch from 0x0105ac to 0x01c01d (0xba72 bytes) 000671 1779870621.670374 write 0x01538d thru 0x01f0be (0x9d32 bytes) 000672 1779870621.679999 mapwrite 0x02bac3 thru 0x034b05 (0x9043 bytes) 000673 1779870621.730528 mapwrite 0x02a22c thru 0x036f94 (0xcd69 bytes) 000674 1779870621.771212 mapread 0x01a402 thru 0x01ad21 (0x920 bytes) 000675 1779870621.772333 trunc from 0x02c38c to 0x034860 (0x84d5 bytes) 000676 1779870621.776805 trunc from 0x03515b to 0x036f94 (0x1e3a bytes) 000678 1779870621.781458 write 0x037010 thru 0x03ffff (0x8ff0 bytes) 000679 1779870621.783357 write 0x001454 thru 0x00e1c2 (0xcd6f bytes) 000680 1779870621.785612 punch from 0x001d77 to 0x00e5cd (0xc857 bytes) 000682 1779870621.803433 trunc from 0x040000 to 0x034c3d (0xb3c2 bytes) 000683 1779870621.828424 write 0x02a411 thru 0x0390f6 (0xece6 bytes) 000684 1779870621.834445 punch from 0x0180c1 to 0x0195fc (0x153c bytes) 000685 1779870621.842310 write 0x00357c thru 0x00f09e (0xbb23 bytes) 000686 1779870621.854256 mapread 0x015687 thru 0x0244bb (0xee35 bytes) 000687 1779870621.873991 fallocate 0x0393df thru 0x03bd8f (0x29b1 bytes) 000688 1779870621.882024 write 0x01996f thru 0x01c58e (0x2c20 bytes) 000689 1779870621.883221 read 0x038f85 thru 0x03bc99 (0x2d15 bytes) 000690 1779870621.891189 mapwrite 0x0357a4 thru 0x03c180 (0x69dd bytes) 000691 1779870621.935937 trunc from 0x007b1b to 0x0119ab (0x9e91 bytes) 000692 1779870621.945533 read 0x00622a thru 0x007552 (0x1329 bytes) 000693 1779870621.960365 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3c181): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c181): Mirror 2: 0x1dba0fa5 (stale) Mirror 3: 0x1dba0fa5 (stale) CRC-32 checksum value for chunk [0, 0x3c181): Mirror 1: 0x97495ae1 Mirror 4: 0x97495ae1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c181: skipped 000694 1779870622.816973 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c181): Mirror 3: 0x1dba0fa5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c181): Mirror 3: 0x1dba0fa5 (stale) CRC-32 checksum value for chunk [0, 0x3c181): Mirror 1: 0x97495ae1 Mirror 4: 0x97495ae1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c181: skipped 000695 1779870623.345927 write 0x00fcc7 thru 0x019fae (0xa2e8 bytes) 000697 1779870623.393165 write 0x00684d thru 0x00941b (0x2bcf bytes) 000698 1779870623.411279 trunc from 0x010550 to 0x01ce6d (0xc91e bytes) 000699 1779870623.424373 write 0x039095 thru 0x03bce9 (0x2c55 bytes) 000700 1779870623.434349 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3c181): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c181): Mirror 3: 0x1dba0fa5 (stale) Mirror 4: 0x97495ae1 (stale) CRC-32 checksum value for chunk [0, 0x3c181): Mirror 1: 0x9baa5209 Mirror 5: 0x9baa5209 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c181: skipped 000701 1779870624.199179 fallocate 0x01e8b7 thru 0x023205 (0x494f bytes) 000702 1779870624.237740 trunc from 0x03c181 to 0x029930 (0x12850 bytes) 000703 1779870624.271080 read 0x02829a thru 0x029930 (0x1697 bytes) 000705 1779870624.279189 trunc from 0x029931 to 0x03cd92 (0x13462 bytes) 000706 1779870624.299143 trunc from 0x017a8e to 0x01f2e5 (0x7858 bytes) 000707 1779870624.307032 punch from 0x038ce3 to 0x03cd92 (0x40b0 bytes) 000708 1779870624.312601 trunc from 0x0357f7 to 0x03cd92 (0x759c bytes) 000709 1779870624.317029 mapread 0x00a140 thru 0x012352 (0x8213 bytes) 000710 1779870624.336176 read 0x03587d thru 0x0398a9 (0x402d bytes) 000712 1779870624.347910 mapwrite 0x01ac7e thru 0x01cbb2 (0x1f35 bytes) 000713 1779870624.360886 trunc from 0x02a403 to 0x036921 (0xc51f bytes) 000714 1779870624.365549 punch from 0x012b19 to 0x012d2d (0x215 bytes) 000716 1779870624.371279 punch from 0x00018a to 0x0024e2 (0x2359 bytes) 000717 1779870624.376270 trunc from 0x00dedb to 0x01c355 (0xe47b bytes) 000718 1779870624.388126 MIRROR_RESYNC 4 mirrors 000719 1779870625.533206 mapwrite 0x020ecd thru 0x02ed9d (0xded1 bytes) 000720 1779870625.642442 trunc from 0x02d825 to 0x03cd92 (0xf56e bytes) 000721 1779870625.648135 trunc from 0x028dd8 to 0x033edf (0xb108 bytes) 000722 1779870625.655584 write 0x031697 thru 0x03eb32 (0xd49c bytes) 000723 1779870625.665068 fallocate 0x0150d0 thru 0x022fe2 (0xdf13 bytes) 000724 1779870625.670785 read 0x031314 thru 0x03d83a (0xc527 bytes) 000725 1779870625.671518 mapread 0x01d3db thru 0x02d3a1 (0xffc7 bytes) 000726 1779870625.681516 read 0x003f74 thru 0x005eff (0x1f8c bytes) 000728 1779870625.696211 fallocate 0x0374d2 thru 0x03a5ca (0x30f9 bytes) 000729 1779870625.700381 mapwrite 0x00453a thru 0x011dac (0xd873 bytes) 000731 1779870625.730260 trunc from 0x03eb33 to 0x00f26d (0x2f8c5 bytes) 000732 1779870625.757830 trunc from 0x00d3b8 to 0x00f26d (0x1eb6 bytes) 000733 1779870625.765554 read 0x007d3e thru 0x00f26d (0x7530 bytes) 000734 1779870625.779283 write 0x03c405 thru 0x03ffff (0x3bfb bytes) 000735 1779870625.780798 fallocate 0x026a39 thru 0x027b99 (0x1161 bytes) 000736 1779870625.794077 MIRROR_RESYNC 4 mirrors 000737 1779870626.687081 fallocate 0x016898 thru 0x0171d5 (0x93e bytes) 000738 1779870626.715722 write 0x01f5dd thru 0x02d5b1 (0xdfd5 bytes) 000739 1779870626.727332 read 0x0209c5 thru 0x02afd3 (0xa60f bytes) 000740 1779870626.728211 read 0x02e369 thru 0x030ac2 (0x275a bytes) 000741 1779870626.739909 MIRROR_RESYNC 4 mirrors 000742 1779870627.798093 MIRROR_EXTEND to 5 mirrors 000743 1779870628.363894 trunc from 0x040000 to 0x020370 (0x1fc8f bytes) 000744 1779870628.413491 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x20371): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20371): Mirror 3: 0x6f0db021 (stale) Mirror 4: 0x6f0db021 (stale) Mirror 5: 0x6f0db021 (stale) Mirror 6: 0x6f0db021 (stale) CRC-32 checksum value for chunk [0, 0x20371): Mirror 1: 0x6f0db021 Mirror 7: 0x6f0db021 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20371: skipped 000745 1779870629.129104 punch from 0x011f56 to 0x01feb9 (0xdf64 bytes) 000746 1779870629.159533 punch from 0x008fc8 to 0x00cc74 (0x3cad bytes) 000747 1779870629.165289 punch from 0x011911 to 0x01a868 (0x8f58 bytes) 000748 1779870629.171279 fallocate 0x0362fa thru 0x0392ec (0x2ff3 bytes) 000749 1779870629.177193 mapwrite 0x016f8a thru 0x017ddc (0xe53 bytes) 000750 1779870629.196839 mapread 0x0024e4 thru 0x00be6a (0x9987 bytes) 000751 1779870629.205952 punch from 0x017851 to 0x01972f (0x1edf bytes) 000752 1779870629.211748 trunc from 0x01b7aa to 0x020370 (0x4bc7 bytes) 000753 1779870629.218201 mapwrite 0x014e6a thru 0x019c83 (0x4e1a bytes) 000754 1779870629.248509 trunc from 0x020371 to 0x0151ed (0xb183 bytes) 000755 1779870629.279576 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x151ee): Mirror 4: 0x3eb8e6e1 (stale) Mirror 5: 0x3eb8e6e1 (stale) Mirror 6: 0x3eb8e6e1 (stale) Mirror 7: 0x3eb8e6e1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x151ee): Mirror 4: 0x3eb8e6e1 (stale) Mirror 5: 0x3eb8e6e1 (stale) Mirror 6: 0x3eb8e6e1 (stale) Mirror 7: 0x3eb8e6e1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x151ee: skipped 000756 1779870629.553560 fallocate 0x001ab0 thru 0x00eeb4 (0xd405 bytes) 000758 1779870629.562463 write 0x001024 thru 0x00aacd (0x9aaa bytes) 000759 1779870629.578890 mapwrite 0x00d639 thru 0x013490 (0x5e58 bytes) 000760 1779870629.604027 read 0x010b02 thru 0x0151ed (0x46ec bytes) 000761 1779870629.604747 punch from 0x0067a2 to 0x006f77 (0x7d6 bytes) 000762 1779870629.609276 mapwrite 0x001a92 thru 0x00fe17 (0xe386 bytes) 000763 1779870629.633079 mapread 0x013943 thru 0x0151ed (0x18ab bytes) 000764 1779870629.635503 fallocate 0x01d76e thru 0x025311 (0x7ba4 bytes) 000765 1779870629.644933 MIRROR_RESYNC 5 mirrors 000766 1779870630.343059 mapwrite 0x030e02 thru 0x034f87 (0x4186 bytes) 000767 1779870630.438151 mapwrite 0x009baf thru 0x00c857 (0x2ca9 bytes) 000768 1779870630.458396 write 0x036698 thru 0x03ffff (0x9968 bytes) 000769 1779870630.460290 mapwrite 0x03fd43 thru 0x03ffff (0x2bd bytes) 000770 1779870630.474915 trunc from 0x040000 to 0x00657e (0x39a81 bytes) 000771 1779870630.491017 trunc from 0x005790 to 0x00657e (0xdef bytes) 000772 1779870630.501380 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x657f): Mirror 4: 0xad3d9ef1 (stale) Mirror 6: 0xad3d9ef1 (stale) Mirror 7: 0xad3d9ef1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x657f): Mirror 4: 0xad3d9ef1 (stale) Mirror 6: 0xad3d9ef1 (stale) Mirror 7: 0xad3d9ef1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x657f: skipped 000773 1779870630.803267 mapwrite 0x002beb thru 0x00abb3 (0x7fc9 bytes) 000774 1779870630.892894 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xabb4): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xabb4): Mirror 4: 0xe354c0f1 (stale) Mirror 6: 0xe354c0f1 (stale) Mirror 7: 0xe354c0f1 (stale) CRC-32 checksum value for chunk [0, 0xabb4): Mirror 1: 0xac7b79d Mirror 8: 0xac7b79d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xabb4: skipped 000775 1779870631.497584 trunc from 0x006de0 to 0x00abb3 (0x3dd4 bytes) 000776 1779870631.536253 fallocate 0x03df20 thru 0x03ffff (0x20e0 bytes) 000777 1779870631.544007 trunc from 0x02caa8 to 0x02f299 (0x27f2 bytes) 000778 1779870631.554285 MIRROR_RESYNC 5 mirrors 000779 1779870632.578829 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) 000780 1779870632.911513 MIRROR_EXTEND to 5 mirrors 000781 1779870633.559502 trunc from 0x01ce5b to 0x0298ef (0xca95 bytes) 000782 1779870633.609082 write 0x021e5b thru 0x02ca96 (0xac3c bytes) 000783 1779870633.623143 read 0x002c35 thru 0x003a2d (0xdf9 bytes) 000784 1779870633.633451 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x22e79dae (stale) Mirror 7: 0x22e79dae (stale) Mirror 8: 0x22e79dae (stale) Mirror 9: 0x22e79dae (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc735ee81 Mirror 10: 0xc735ee81 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000785 1779870634.491283 fallocate 0x018040 thru 0x01d0ca (0x508b bytes) 000786 1779870634.518685 mapread 0x00b149 thru 0x011f03 (0x6dbb bytes) 000787 1779870634.535790 trunc from 0x01a5cc to 0x029415 (0xee4a bytes) 000788 1779870634.547235 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x22e79dae (stale) Mirror 7: 0x22e79dae (stale) Mirror 8: 0x22e79dae (stale) Mirror 9: 0x22e79dae (stale) Mirror 10: 0xc735ee81 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x84f7b390 Mirror 11: 0x84f7b390 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000789 1779870635.494140 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x22e79dae (stale) Mirror 8: 0x22e79dae (stale) Mirror 9: 0x22e79dae (stale) Mirror 10: 0xc735ee81 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x22e79dae (stale) Mirror 8: 0x22e79dae (stale) Mirror 9: 0x22e79dae (stale) Mirror 10: 0xc735ee81 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x84f7b390 Mirror 11: 0x84f7b390 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000791 1779870636.146956 MIRROR_RESYNC 6 mirrors 000792 1779870637.393814 trunc from 0x01691c to 0x0250f7 (0xe7dc bytes) 000793 1779870637.446449 trunc from 0x02d4d6 to 0x037363 (0x9e8e bytes) 000794 1779870637.450794 mapwrite 0x03e11c thru 0x03ffff (0x1ee4 bytes) 000795 1779870637.472545 mapread 0x028c5d thru 0x029544 (0x8e8 bytes) 000796 1779870637.484973 trunc from 0x031ad0 to 0x03dadf (0xc010 bytes) 000797 1779870637.492129 trunc from 0x0321fb to 0x034a5d (0x2863 bytes) 000799 1779870637.500282 read 0x036f8d thru 0x03de18 (0x6e8c bytes) 000800 1779870637.513436 fallocate 0x01f658 thru 0x02089a (0x1243 bytes) 000801 1779870637.518746 fallocate 0x02a7c3 thru 0x03a166 (0xf9a4 bytes) 000802 1779870637.523849 read 0x020555 thru 0x025f3e (0x59ea bytes) 000803 1779870637.543736 MIRROR_RESYNC 6 mirrors 000804 1779870638.962252 mapread 0x024b24 thru 0x028d9e (0x427b bytes) 000805 1779870639.006532 read 0x0135e8 thru 0x01db7b (0xa594 bytes) 000806 1779870639.016391 trunc from 0x03808d to 0x03ffff (0x7f73 bytes) 000807 1779870639.054814 write 0x00e922 thru 0x013de7 (0x54c6 bytes) 000808 1779870639.062323 read 0x01734a thru 0x0266c4 (0xf37b bytes) 000809 1779870639.072028 trunc from 0x030451 to 0x034071 (0x3c21 bytes) 000810 1779870639.081053 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x6a9d5a18 (stale) Mirror 8: 0x6a9d5a18 (stale) Mirror 9: 0x6a9d5a18 (stale) Mirror 10: 0x6a9d5a18 (stale) Mirror 11: 0x6a9d5a18 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x65070ab3 Mirror 12: 0x65070ab3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000811 1779870639.944562 punch from 0x014f2e to 0x023c24 (0xecf7 bytes) 000812 1779870639.997677 trunc from 0x036cbe to 0x03a4e1 (0x3824 bytes) 000813 1779870640.004910 fallocate 0x03202a thru 0x038e40 (0x6e17 bytes) 000814 1779870640.015487 trunc from 0x01efc4 to 0x02a9e1 (0xba1e bytes) 000815 1779870640.023121 punch from 0x0020af to 0x0029d2 (0x924 bytes) 000816 1779870640.027693 punch from 0x0257e7 to 0x02817f (0x2999 bytes) 000817 1779870640.032094 trunc from 0x021d99 to 0x0295f3 (0x785b bytes) 000818 1779870640.045310 MIRROR_RESYNC 7 mirrors 000819 1779870641.875887 punch from 0x005b92 to 0x012baa (0xd019 bytes) 000820 1779870641.920089 fallocate 0x01da48 thru 0x01f81f (0x1dd8 bytes) 000821 1779870641.927353 mapread 0x028fef thru 0x02928d (0x29f bytes) 000822 1779870641.940050 trunc from 0x040000 to 0x020b1a (0x1f4e5 bytes) 000823 1779870641.972036 mapwrite 0x011b44 thru 0x014401 (0x28be bytes) 000824 1779870642.006145 punch from 0x0196b6 to 0x020b1a (0x7465 bytes) 000825 1779870642.020550 punch from 0x00e860 to 0x0196aa (0xae4b bytes) 000826 1779870642.028267 write 0x0126b3 thru 0x016aba (0x4408 bytes) 000827 1779870642.040015 read 0x011d3a thru 0x01e861 (0xcb28 bytes) 000828 1779870642.054877 fallocate 0x037472 thru 0x03ba51 (0x45e0 bytes) 000829 1779870642.059884 mapwrite 0x03055f thru 0x034527 (0x3fc9 bytes) 000830 1779870642.102228 write 0x034dc8 thru 0x03b948 (0x6b81 bytes) 000831 1779870642.108637 punch from 0x03734e to 0x038775 (0x1428 bytes) 000832 1779870642.129205 mapread 0x034d5b thru 0x03ba51 (0x6cf7 bytes) 000833 1779870642.145791 fallocate 0x02d9ce thru 0x030cf6 (0x3329 bytes) 000834 1779870642.166138 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3ba52): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ba52): Mirror 7: 0x4fde8ea3 (stale) Mirror 8: 0x4fde8ea3 (stale) Mirror 9: 0x4fde8ea3 (stale) Mirror 10: 0x4fde8ea3 (stale) Mirror 11: 0x4fde8ea3 (stale) Mirror 12: 0x4fde8ea3 (stale) CRC-32 checksum value for chunk [0, 0x3ba52): Mirror 1: 0x6605c5d3 Mirror 13: 0x6605c5d3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ba52: skipped 000835 1779870642.998775 mapread 0x02cee2 thru 0x03126f (0x438e bytes) 000836 1779870643.047493 read 0x03217c thru 0x03ba51 (0x98d6 bytes) 000837 1779870643.073968 write 0x031296 thru 0x034adb (0x3846 bytes) 000838 1779870643.144454 MIRROR_RESYNC 8 mirrors 000839 1779870644.926749 trunc from 0x024eac to 0x02f19a (0xa2ef bytes) 000840 1779870644.967032 trunc from 0x03ba52 to 0x00bf8a (0x2fac7 bytes) 000841 1779870644.998979 trunc from 0x00904c to 0x00bf8a (0x2f3f bytes) 000842 1779870645.009295 MIRROR_RESYNC 8 mirrors 000843 1779870645.990617 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) 000844 1779870646.303383 punch from 0x0072a1 to 0x00bf8a (0x4cea bytes) 000845 1779870646.339341 read 0x003ffc thru 0x00bf8a (0x7f8f bytes) 000846 1779870646.348553 punch from 0x0000ae to 0x0028c2 (0x2815 bytes) 000847 1779870646.354423 mapwrite 0x00b92c thru 0x018a55 (0xd12a bytes) 000848 1779870646.449621 fallocate 0x039ebd thru 0x03e85a (0x499e bytes) 000849 1779870646.456008 mapwrite 0x01f894 thru 0x01f909 (0x76 bytes) 000850 1779870646.491494 punch from 0x003df8 to 0x0122ab (0xe4b4 bytes) 000851 1779870646.501638 read 0x0105f2 thru 0x013dbd (0x37cc bytes) 000852 1779870646.510275 trunc from 0x03e85b to 0x00310a (0x3b750 bytes) 000853 1779870646.533847 punch from 0x00264e to 0x00310a (0xabd bytes) 000854 1779870646.542315 punch from 0x000d88 to 0x00310a (0x2383 bytes) 000856 1779870646.552047 trunc from 0x000bf8 to 0x00310a (0x2513 bytes) 000857 1779870646.566626 read 0x001f6c thru 0x00310a (0x119f bytes) 000858 1779870646.574161 read 0x000f72 thru 0x00310a (0x2199 bytes) 000860 1779870646.580308 MIRROR_RESYNC 7 mirrors 000862 1779870647.479847 trunc from 0x00239b to 0x00310a (0xd70 bytes) 000863 1779870647.507498 mapread 0x000bc5 thru 0x00310a (0x2546 bytes) 000864 1779870647.537017 fallocate 0x030b15 thru 0x0379b9 (0x6ea5 bytes) 000865 1779870647.546737 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x379ba): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x379ba): Mirror 7: 0x68462220 (stale) Mirror 8: 0x68462220 (stale) Mirror 9: 0x68462220 (stale) Mirror 10: 0x68462220 (stale) Mirror 11: 0x68462220 (stale) Mirror 12: 0x68462220 (stale) CRC-32 checksum value for chunk [0, 0x379ba): Mirror 1: 0x68462220 Mirror 13: 0x68462220 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x379ba: skipped 000866 1779870648.448407 mapread 0x0276bc thru 0x028e78 (0x17bd bytes) 000867 1779870648.470423 read 0x01832f thru 0x022fe9 (0xacbb bytes) 000868 1779870648.487374 read 0x0220cd thru 0x02c812 (0xa746 bytes) 000869 1779870648.501520 trunc from 0x00be86 to 0x015a7e (0x9bf9 bytes) 000870 1779870648.537166 read 0x0097bf thru 0x017561 (0xdda3 bytes) 000871 1779870648.551208 fallocate 0x03f081 thru 0x03ffff (0xf7f bytes) 000872 1779870648.565707 mapwrite 0x00f238 thru 0x011c72 (0x2a3b bytes) 000873 1779870648.587321 write 0x0268bb thru 0x027abf (0x1205 bytes) 000874 1779870648.597720 mapwrite 0x016b79 thru 0x02401d (0xd4a5 bytes) 000875 1779870648.622142 punch from 0x018c29 to 0x01dc2e (0x5006 bytes) 000876 1779870648.635029 mapwrite 0x00e58b thru 0x016535 (0x7fab bytes) 000877 1779870648.677264 MIRROR_RESYNC 8 mirrors 000878 1779870651.047297 fallocate 0x01ac8d thru 0x020a35 (0x5da9 bytes) 000879 1779870651.083127 read 0x015857 thru 0x01efe0 (0x978a bytes) 000880 1779870651.091024 fallocate 0x015312 thru 0x0176e7 (0x23d6 bytes) 000882 1779870651.096746 mapwrite 0x0313ec thru 0x03b3ac (0x9fc1 bytes) 000884 1779870651.155282 trunc from 0x03b3ad to 0x0313d2 (0x9fda bytes) 000885 1779870651.169092 write 0x027059 thru 0x033590 (0xc538 bytes) 000886 1779870651.178888 fallocate 0x019958 thru 0x01c09c (0x2745 bytes) 000887 1779870651.186573 mapwrite 0x01e138 thru 0x02056d (0x2436 bytes) 000888 1779870651.207382 punch from 0x032385 to 0x033590 (0x120c bytes) 000889 1779870651.214971 mapread 0x007442 thru 0x009012 (0x1bd1 bytes) 000890 1779870651.227955 MIRROR_RESYNC 8 mirrors 000891 1779870653.401857 read 0x021313 thru 0x02d62c (0xc31a bytes) 000892 1779870653.418587 punch from 0x00a888 to 0x00ff50 (0x56c9 bytes) 000893 1779870653.461175 punch from 0x027f6b to 0x0301eb (0x8281 bytes) 000894 1779870653.470132 trunc from 0x01f006 to 0x02aa1f (0xba1a bytes) 000895 1779870653.478514 mapwrite 0x01d2b5 thru 0x0239c2 (0x670e bytes) 000896 1779870653.538206 read 0x028961 thru 0x02b681 (0x2d21 bytes) 000897 1779870653.548502 punch from 0x008c58 to 0x017529 (0xe8d2 bytes) 000899 1779870653.555551 mapwrite 0x030754 thru 0x03e7bf (0xe06c bytes) 000900 1779870653.607261 mapread 0x007ae1 thru 0x016011 (0xe531 bytes) 000901 1779870653.695552 read 0x00fe07 thru 0x01ae8e (0xb088 bytes) 000902 1779870653.700885 trunc from 0x03e7c0 to 0x03ad02 (0x3abd bytes) 000903 1779870653.717883 read 0x03161a thru 0x03ad02 (0x96e9 bytes) 000904 1779870653.719255 trunc from 0x02d1b2 to 0x03992d (0xc77c bytes) 000905 1779870653.724528 trunc from 0x03ad03 to 0x037a69 (0x3299 bytes) 000906 1779870653.736492 mapread 0x02705b thru 0x02d12f (0x60d5 bytes) 000907 1779870653.751847 mapread 0x00753e thru 0x00cd35 (0x57f8 bytes) 000908 1779870653.753857 mapread 0x01904e thru 0x019363 (0x316 bytes) 000909 1779870653.755814 trunc from 0x0277d9 to 0x034713 (0xcf3b bytes) 000910 1779870653.766922 MIRROR_RESYNC 8 mirrors 000912 1779870655.740508 write 0x03aee3 thru 0x03ffff (0x511d bytes) 000913 1779870655.765486 write 0x0026cb thru 0x00408e (0x19c4 bytes) 000914 1779870655.776549 trunc from 0x040000 to 0x015f40 (0x2a0bf bytes) 000915 1779870655.793586 write 0x01e926 thru 0x0209d6 (0x20b1 bytes) 000916 1779870655.795004 mapwrite 0x01e633 thru 0x02d541 (0xef0f bytes) 000918 1779870655.860284 punch from 0x0132c7 to 0x018f31 (0x5c6b bytes) 000919 1779870655.864646 mapread 0x010691 thru 0x01e0f5 (0xda65 bytes) 000920 1779870655.880587 mapread 0x021f75 thru 0x02d541 (0xb5cd bytes) 000921 1779870655.882405 read 0x00548c thru 0x00c7c7 (0x733c bytes) 000922 1779870655.892623 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2d542): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d542): Mirror 7: 0xd04be982 (stale) Mirror 8: 0xd04be982 (stale) Mirror 9: 0xd04be982 (stale) Mirror 10: 0xd04be982 (stale) Mirror 11: 0xd04be982 (stale) Mirror 12: 0xd04be982 (stale) Mirror 13: 0xd04be982 (stale) CRC-32 checksum value for chunk [0, 0x2d542): Mirror 1: 0xf81901b6 Mirror 14: 0xf81901b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d542: skipped 000923 1779870656.734110 punch from 0x01375b to 0x0149dd (0x1283 bytes) 000924 1779870656.765615 read 0x00e860 thru 0x011f45 (0x36e6 bytes) 000925 1779870656.771506 mapread 0x00508f thru 0x006c52 (0x1bc4 bytes) 000926 1779870656.786078 mapwrite 0x00b957 thru 0x0186c3 (0xcd6d bytes) 000927 1779870656.828956 fallocate 0x012785 thru 0x01768d (0x4f09 bytes) 000929 1779870656.834813 read 0x024454 thru 0x02c806 (0x83b3 bytes) 000930 1779870656.843941 trunc from 0x02d542 to 0x03ba90 (0xe54f bytes) 000931 1779870656.872970 write 0x00a80c thru 0x0106ce (0x5ec3 bytes) 000932 1779870656.874526 mapwrite 0x03d41f thru 0x03ffff (0x2be1 bytes) 000933 1779870656.920602 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd786888e (stale) Mirror 8: 0xd786888e (stale) Mirror 9: 0xd786888e (stale) Mirror 10: 0xd786888e (stale) Mirror 11: 0xd786888e (stale) Mirror 12: 0xd786888e (stale) Mirror 13: 0xd786888e (stale) Mirror 14: 0x4b0350d0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe35f598a Mirror 15: 0xe35f598a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000934 1779870657.872171 fallocate 0x022f31 thru 0x02fc22 (0xccf2 bytes) 000935 1779870657.937914 trunc from 0x00184b to 0x00facf (0xe285 bytes) 000936 1779870657.948203 trunc from 0x00b2b4 to 0x0133c3 (0x8110 bytes) 000937 1779870657.960322 write 0x037553 thru 0x037cd4 (0x782 bytes) 000938 1779870657.990700 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xd786888e (stale) Mirror 9: 0xd786888e (stale) Mirror 10: 0xd786888e (stale) Mirror 11: 0xd786888e (stale) Mirror 12: 0xd786888e (stale) Mirror 13: 0xd786888e (stale) Mirror 14: 0x4b0350d0 (stale) Mirror 15: 0xe35f598a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xd786888e (stale) Mirror 9: 0xd786888e (stale) Mirror 10: 0xd786888e (stale) Mirror 11: 0xd786888e (stale) Mirror 12: 0xd786888e (stale) Mirror 13: 0xd786888e (stale) Mirror 14: 0x4b0350d0 (stale) Mirror 15: 0xe35f598a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000939 1779870658.523559 trunc from 0x040000 to 0x00e314 (0x31ceb bytes) 000940 1779870658.550617 punch from 0x00b02c to 0x00ded8 (0x2ead bytes) 000941 1779870658.555885 mapwrite 0x014722 thru 0x016a8d (0x236c bytes) 000942 1779870658.614755 trunc from 0x00341a to 0x00578a (0x2371 bytes) 000943 1779870658.622141 fallocate 0x01d3ae thru 0x025ee0 (0x8b33 bytes) 000944 1779870658.632954 trunc from 0x00a723 to 0x017bfc (0xd4da bytes) 000945 1779870658.640474 trunc from 0x00c0ff to 0x0145c2 (0x84c4 bytes) 000946 1779870658.651275 mapread 0x01ffed thru 0x020094 (0xa8 bytes) 000948 1779870658.681870 read 0x00a64e thru 0x0177e7 (0xd19a bytes) 000949 1779870658.694194 read 0x025152 thru 0x025ee0 (0xd8f bytes) 000950 1779870658.695799 mapread 0x02367c thru 0x025ee0 (0x2865 bytes) 000951 1779870658.697347 mapread 0x00fa5f thru 0x0198c3 (0x9e65 bytes) 000952 1779870658.699469 fallocate 0x034e54 thru 0x03b4a9 (0x6656 bytes) 000953 1779870658.712468 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b4aa): Mirror 8: 0x1f0a6c9c (stale) Mirror 9: 0x1f0a6c9c (stale) Mirror 10: 0x1f0a6c9c (stale) Mirror 11: 0x1f0a6c9c (stale) Mirror 12: 0x1f0a6c9c (stale) Mirror 14: 0x4d37c598 (stale) Mirror 15: 0xa1680615 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b4aa): Mirror 8: 0x1f0a6c9c (stale) Mirror 9: 0x1f0a6c9c (stale) Mirror 10: 0x1f0a6c9c (stale) Mirror 11: 0x1f0a6c9c (stale) Mirror 12: 0x1f0a6c9c (stale) Mirror 14: 0x4d37c598 (stale) Mirror 15: 0xa1680615 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b4aa: skipped 000956 1779870659.191017 punch from 0x029ae8 to 0x038373 (0xe88c bytes) 000957 1779870659.203188 write 0x00a40f thru 0x00c48f (0x2081 bytes) 000958 1779870659.231256 fallocate 0x03a09a thru 0x03ffff (0x5f66 bytes) 000959 1779870659.241584 mapread 0x028633 thru 0x036bf8 (0xe5c6 bytes) 000960 1779870659.276645 mapread 0x02e2ad thru 0x03834c (0xa0a0 bytes) 000961 1779870659.277902 fallocate 0x00b8bb thru 0x014ece (0x9614 bytes) 000962 1779870659.284947 punch from 0x0021a8 to 0x00db28 (0xb981 bytes) 000963 1779870659.296343 mapread 0x0346b4 thru 0x0347df (0x12c bytes) 000964 1779870659.297714 punch from 0x02beb7 to 0x02cb4d (0xc97 bytes) 000965 1779870659.303644 mapread 0x008832 thru 0x01000d (0x77dc bytes) 000967 1779870659.316339 punch from 0x01a408 to 0x024bde (0xa7d7 bytes) 000968 1779870659.323260 mapread 0x00c8dd thru 0x00f076 (0x279a bytes) 000969 1779870659.325381 fallocate 0x0095a9 thru 0x016ef6 (0xd94e bytes) 000970 1779870659.336329 mapread 0x0016d3 thru 0x004da3 (0x36d1 bytes) 000971 1779870659.338605 write 0x01ae13 thru 0x01c9f1 (0x1bdf bytes) 000972 1779870659.354381 trunc from 0x01a9ec to 0x023775 (0x8d8a bytes) 000973 1779870659.364097 mapread 0x006179 thru 0x01406b (0xdef3 bytes) 000974 1779870659.371381 fallocate 0x015258 thru 0x01e753 (0x94fc bytes) 000975 1779870659.377508 mapread 0x028c04 thru 0x03757f (0xe97c bytes) 000976 1779870659.389757 mapwrite 0x02bcb8 thru 0x03b26c (0xf5b5 bytes) 000977 1779870659.420984 mapread 0x02f2c9 thru 0x03b4a9 (0xc1e1 bytes) 000979 1779870659.423035 punch from 0x029d11 to 0x03117c (0x746c bytes) 000980 1779870659.430354 trunc from 0x027362 to 0x028092 (0xd31 bytes) 000981 1779870659.433998 punch from 0x014f81 to 0x01ff99 (0xb019 bytes) 000982 1779870659.442795 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b4aa): Mirror 8: 0x1f0a6c9c (stale) Mirror 9: 0x1f0a6c9c (stale) Mirror 10: 0x1f0a6c9c (stale) Mirror 11: 0x1f0a6c9c (stale) Mirror 12: 0x1f0a6c9c (stale) Mirror 15: 0xa1680615 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b4aa): Mirror 8: 0x1f0a6c9c (stale) Mirror 9: 0x1f0a6c9c (stale) Mirror 10: 0x1f0a6c9c (stale) Mirror 11: 0x1f0a6c9c (stale) Mirror 12: 0x1f0a6c9c (stale) Mirror 15: 0xa1680615 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b4aa: skipped 000983 1779870659.921279 trunc from 0x03b4aa to 0x01cd31 (0x1e778 bytes) 000985 1779870659.945807 mapread 0x013866 thru 0x01cd31 (0x94cc bytes) 000986 1779870659.976205 mapwrite 0x03c90e thru 0x03ffff (0x36f2 bytes) 000987 1779870660.030623 punch from 0x02f292 to 0x032868 (0x35d7 bytes) 000988 1779870660.037400 write 0x011dea thru 0x018d54 (0x6f6b bytes) 000989 1779870660.038972 punch from 0x0355ad to 0x03cf33 (0x7987 bytes) 000990 1779870660.044860 write 0x01b82e thru 0x0292d2 (0xdaa5 bytes) 000991 1779870660.056991 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x2b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xd786888e (stale) Mirror 9: 0xd786888e (stale) Mirror 10: 0xd786888e (stale) Mirror 11: 0xd786888e (stale) Mirror 15: 0xe35f598a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xd786888e (stale) Mirror 9: 0xd786888e (stale) Mirror 10: 0xd786888e (stale) Mirror 11: 0xd786888e (stale) Mirror 15: 0xe35f598a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000992 1779870660.441946 mapread 0x03ed0d thru 0x03ffff (0x12f3 bytes) 000993 1779870660.453474 mapread 0x035968 thru 0x03eea6 (0x953f bytes) 000994 1779870660.466651 fallocate 0x034473 thru 0x03e22d (0x9dbb bytes) 000995 1779870660.472507 trunc from 0x001a53 to 0x0069b2 (0x4f60 bytes) 000996 1779870660.479189 mapread 0x03f16a thru 0x03ffff (0xe96 bytes) 000997 1779870660.481398 write 0x017a6e thru 0x0257d6 (0xdd69 bytes) 000998 1779870660.503418 trunc from 0x033d7c to 0x0380f0 (0x4375 bytes) 000999 1779870660.508157 mapread 0x0373f3 thru 0x03fca0 (0x88ae bytes) 001000 1779870660.516246 trunc from 0x003c58 to 0x003fca (0x373 bytes) All operations completed A-OK!