== sanity-flr test 70a: flr mode fsx test ================ 19:54:39 (1789430079) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 80 skipping zero length punch hole skipping zero size read skipping zero length zero range skipping zero size read 000006 1789430081.316542 mapwrite 0x025198 thru 0x033791 (0xe5fa bytes) 000007 1789430081.429104 write 0x00389d thru 0x00404a (0x7ae bytes) fallocating to largest ever: 0x40000 000008 1789430081.454106 fallocate 0x03c3be thru 0x03ffff (0x3c42 bytes) 000009 1789430081.464070 mapwrite 0x014fea thru 0x024e07 (0xfe1e bytes) 000011 1789430081.511659 fallocate 0x01a5fd thru 0x01ae87 (0x88b bytes) 000012 1789430081.523999 write 0x01f30f thru 0x02a63d (0xb32f bytes) 000013 1789430081.525376 fallocate 0x00a646 thru 0x013c48 (0x9603 bytes) 000014 1789430081.539308 MIRROR_EXTEND to 2 mirrors 000015 1789430082.466640 trunc from 0x040000 to 0x02502d (0x1afd2 bytes) 000016 1789430082.543300 write 0x00183e thru 0x003e56 (0x2619 bytes) 000017 1789430082.552701 fallocate 0x03a8c1 thru 0x03e731 (0x3e71 bytes) 000018 1789430082.557850 trunc from 0x017f3b to 0x019604 (0x16ca bytes) 000019 1789430082.561877 punch from 0x03aa87 to 0x03e731 (0x3cab bytes) 000020 1789430082.565174 trunc from 0x023db1 to 0x02e944 (0xab94 bytes) 000022 1789430082.569132 fallocate 0x023c50 thru 0x027773 (0x3b24 bytes) 000023 1789430082.573253 fallocate 0x0145bb thru 0x017120 (0x2b66 bytes) 000024 1789430082.578838 mapread 0x00667d thru 0x009ed7 (0x385b bytes) 000025 1789430082.591974 fallocate 0x02013a thru 0x024d00 (0x4bc7 bytes) 000026 1789430082.600344 trunc from 0x03e732 to 0x03f3d6 (0xca5 bytes) 000027 1789430082.651294 punch from 0x03e335 to 0x03f3d6 (0x10a2 bytes) 000028 1789430082.671317 mapread 0x005374 thru 0x013c66 (0xe8f3 bytes) 000029 1789430082.696798 trunc from 0x025c4c to 0x02b966 (0x5d1b bytes) 000030 1789430082.706976 fallocate 0x00434c thru 0x00d9f9 (0x96ae bytes) 000033 1789430082.718986 punch from 0x0395e4 to 0x03e335 (0x4d52 bytes) 000034 1789430082.729418 mapread 0x01aab0 thru 0x02524c (0xa79d bytes) 000035 1789430082.778697 mapwrite 0x01e3db thru 0x0245d8 (0x61fe bytes) 000036 1789430082.843234 mapwrite 0x0033b8 thru 0x00f2a4 (0xbeed bytes) 000037 1789430082.877172 read 0x038a5c thru 0x03f3d6 (0x697b bytes) 000040 1789430082.888241 write 0x02f869 thru 0x035ef4 (0x668c bytes) 000041 1789430082.921076 read 0x028866 thru 0x032cb9 (0xa454 bytes) 000042 1789430082.942513 trunc from 0x03f3d7 to 0x01dd5b (0x2167b bytes) 000043 1789430082.967753 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1dd5c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1dd5c): Mirror 2: 0x61a7ceea (stale) CRC-32 checksum value for chunk [0, 0x1dd5c): Mirror 1: 0x3728f35 Mirror 3: 0x3728f35 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1dd5c: skipped 000044 1789430083.964506 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) 000045 1789430084.270740 trunc from 0x01dd5c to 0x0292b5 (0xb55a bytes) 000046 1789430084.313478 mapwrite 0x005610 thru 0x012f76 (0xd967 bytes) 000048 1789430084.364883 MIRROR_RESYNC 2 mirrors 000049 1789430085.240985 MIRROR_RESYNC 2 mirrors 000050 1789430085.666995 mapwrite 0x03c050 thru 0x03f573 (0x3524 bytes) 000051 1789430085.818484 punch from 0x022eaf to 0x02a5fe (0x7750 bytes) 000052 1789430085.824048 read 0x037e65 thru 0x03f573 (0x770f bytes) 000053 1789430085.824918 fallocate 0x01a756 thru 0x023b6d (0x9418 bytes) 000054 1789430085.831194 trunc from 0x00d669 to 0x0185d0 (0xaf68 bytes) 000055 1789430085.835951 trunc from 0x00c026 to 0x01b740 (0xf71b bytes) 000057 1789430085.844274 read 0x014ff7 thru 0x023752 (0xe75c bytes) 000058 1789430085.862191 mapread 0x02e421 thru 0x03a57f (0xc15f bytes) 000060 1789430085.863806 read 0x035c71 thru 0x03f573 (0x9903 bytes) 000062 1789430085.866658 trunc from 0x004c06 to 0x01379f (0xeb9a bytes) 000063 1789430085.883109 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) 000064 1789430086.028265 trunc from 0x01493f to 0x016632 (0x1cf4 bytes) 000065 1789430086.034223 punch from 0x0141d2 to 0x01c6c7 (0x84f6 bytes) 000066 1789430086.039885 trunc from 0x0291fd to 0x033f02 (0xad06 bytes) 000067 1789430086.046433 trunc from 0x00c53f to 0x01613d (0x9bff bytes) 000068 1789430086.052277 write 0x018c93 thru 0x020a70 (0x7dde bytes) 000070 1789430086.070641 mapwrite 0x0090eb thru 0x0105d5 (0x74eb bytes) 000073 1789430086.142052 punch from 0x003bc3 to 0x0070f5 (0x3533 bytes) 000075 1789430086.152680 trunc from 0x008d79 to 0x00a77e (0x1a06 bytes) 000076 1789430086.157835 punch from 0x015aca to 0x01bd07 (0x623e bytes) 000077 1789430086.163809 mapwrite 0x01d821 thru 0x02752e (0x9d0e bytes) 000079 1789430086.196982 punch from 0x03aca6 to 0x03f573 (0x48ce bytes) 000080 1789430086.205056 fallocate 0x03a6d0 thru 0x03ffff (0x5930 bytes) 000081 1789430086.210606 write 0x03716a thru 0x03ffff (0x8e96 bytes) 000082 1789430086.216835 read 0x00baf0 thru 0x01776f (0xbc80 bytes) 000083 1789430086.225283 trunc from 0x0117c4 to 0x012e02 (0x163f bytes) 000084 1789430086.230622 mapwrite 0x020690 thru 0x02b8ff (0xb270 bytes) 000085 1789430086.262408 trunc from 0x040000 to 0x028e02 (0x171fd bytes) 000086 1789430086.277674 punch from 0x00d7c5 to 0x01cab7 (0xf2f3 bytes) 000087 1789430086.283295 read 0x026d22 thru 0x028e02 (0x20e1 bytes) 000088 1789430086.284456 trunc from 0x01671c to 0x0226d6 (0xbfbb bytes) 000090 1789430086.294666 MIRROR_EXTEND to 2 mirrors 000091 1789430086.949577 trunc from 0x028e03 to 0x03cb03 (0x13d01 bytes) 000092 1789430087.054199 read 0x00b17f thru 0x00cd06 (0x1b88 bytes) 000093 1789430087.058419 trunc from 0x03cb04 to 0x014c0a (0x27ef9 bytes) 000094 1789430087.078862 fallocate 0x020b66 thru 0x02e9ef (0xde8a bytes) 000095 1789430087.093571 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) 000096 1789430087.235378 punch from 0x00a9bd to 0x014c0a (0xa24e bytes) 000099 1789430087.246178 punch from 0x00432e to 0x007134 (0x2e07 bytes) 000100 1789430087.256121 MIRROR_EXTEND to 2 mirrors 000101 1789430087.899769 fallocate 0x02e0ab thru 0x03408c (0x5fe2 bytes) 000102 1789430087.951876 write 0x03969b thru 0x03a3ed (0xd53 bytes) 000103 1789430087.959399 mapwrite 0x00bfa4 thru 0x00fcb1 (0x3d0e bytes) 000104 1789430088.006818 MIRROR_RESYNC 2 mirrors 000105 1789430088.856361 mapwrite 0x018377 thru 0x01c874 (0x44fe bytes) 000106 1789430088.973344 read 0x032c7b thru 0x0387fe (0x5b84 bytes) 000107 1789430088.988063 trunc from 0x03a3ee to 0x01d5dd (0x1ce10 bytes) 000108 1789430089.006026 fallocate 0x004bbe thru 0x00ed4a (0xa18d bytes) 000109 1789430089.010089 trunc from 0x016fe5 to 0x01d5dd (0x65f9 bytes) 000110 1789430089.018696 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1d5de): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d5de): Mirror 2: 0xf803918d (stale) CRC-32 checksum value for chunk [0, 0x1d5de): Mirror 1: 0xf803918d Mirror 3: 0xf803918d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d5de: skipped 000111 1789430090.073607 read 0x012bf5 thru 0x01d5dd (0xa9e9 bytes) 000112 1789430090.084858 trunc from 0x01d5de to 0x035fbe (0x189e1 bytes) 000113 1789430090.163168 read 0x008de8 thru 0x013351 (0xa56a bytes) 000114 1789430090.184756 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35fbf): Mirror 3: 0x5fedb916 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35fbf): Mirror 3: 0x5fedb916 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35fbf: skipped 000115 1789430090.598108 trunc from 0x035fbf to 0x0144e0 (0x21ade bytes) 000116 1789430090.648073 fallocate 0x036167 thru 0x03ffff (0x9e99 bytes) 000118 1789430090.654820 write 0x022459 thru 0x02bfc4 (0x9b6c bytes) 000119 1789430090.666716 read 0x0144fb thru 0x018d6e (0x4874 bytes) 000120 1789430090.697205 mapwrite 0x015bfb thru 0x01796b (0x1d71 bytes) 000121 1789430090.729191 fallocate 0x00baeb thru 0x00dbe3 (0x20f9 bytes) 000122 1789430090.741237 punch from 0x025105 to 0x02ba75 (0x6971 bytes) 000123 1789430090.756844 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2bfc5): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bfc5): Mirror 3: 0xe3041e00 (stale) CRC-32 checksum value for chunk [0, 0x2bfc5): Mirror 1: 0xc6b5c12c Mirror 4: 0xc6b5c12c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bfc5: skipped 000124 1789430092.132770 fallocate 0x0073bd thru 0x00a793 (0x33d7 bytes) 000126 1789430092.174246 fallocate 0x0004a5 thru 0x006094 (0x5bf0 bytes) 000127 1789430092.181300 mapread 0x02ad13 thru 0x02bfc4 (0x12b2 bytes) 000128 1789430092.195357 punch from 0x00c2b0 to 0x01628a (0x9fdb bytes) 000129 1789430092.201811 write 0x03b3b4 thru 0x03ffff (0x4c4c bytes) 000131 1789430092.209705 read 0x02b608 thru 0x02d170 (0x1b69 bytes) 000132 1789430092.216367 mapread 0x03ec2f thru 0x03ffff (0x13d1 bytes) 000134 1789430092.219678 punch from 0x003c8c to 0x010295 (0xc60a bytes) 000135 1789430092.231230 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x95b45eb9 (stale) Mirror 4: 0x4c6a9a93 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc2090aa2 Mirror 5: 0xc2090aa2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000137 1789430093.332061 write 0x03dddb thru 0x03ffff (0x2225 bytes) 000138 1789430093.392865 punch from 0x02c7f4 to 0x02d6f9 (0xf06 bytes) 000139 1789430093.401706 mapwrite 0x03763c thru 0x03d8a6 (0x626b bytes) 000140 1789430093.486353 read 0x00ad15 thru 0x0109cf (0x5cbb bytes) 000141 1789430093.508397 write 0x0235c3 thru 0x02e7d1 (0xb20f bytes) 000142 1789430093.525837 trunc from 0x040000 to 0x01f364 (0x20c9b bytes) 000143 1789430093.586199 punch from 0x012ee8 to 0x01329c (0x3b5 bytes) 000144 1789430093.591769 mapread 0x01ec2c thru 0x01f364 (0x739 bytes) 000145 1789430093.600094 punch from 0x00b96f to 0x00cc2f (0x12c1 bytes) 000146 1789430093.605395 punch from 0x016424 to 0x01f364 (0x8f41 bytes) 000147 1789430093.613765 read 0x010368 thru 0x01d5e0 (0xd279 bytes) 000148 1789430093.629020 trunc from 0x011d31 to 0x01449d (0x276d bytes) 000149 1789430093.633941 punch from 0x015fb9 to 0x01d9a8 (0x79f0 bytes) 000150 1789430093.639218 fallocate 0x0305b1 thru 0x03f67e (0xf0ce bytes) 000151 1789430093.644105 mapread 0x017702 thru 0x01ea6e (0x736d bytes) 000152 1789430093.714291 read 0x03872f thru 0x03f67e (0x6f50 bytes) 000153 1789430093.737561 MIRROR_RESYNC 4 mirrors 000154 1789430094.653769 trunc from 0x03f67f to 0x01c423 (0x2325b bytes) 000155 1789430094.718340 mapwrite 0x012451 thru 0x021893 (0xf443 bytes) 000156 1789430094.828061 trunc from 0x015339 to 0x021893 (0xc55b bytes) 000157 1789430094.834027 punch from 0x00dda0 to 0x01bfaa (0xe20b bytes) 000158 1789430094.845214 trunc from 0x010c78 to 0x01beaf (0xb238 bytes) 000159 1789430094.855861 mapread 0x006631 thru 0x014277 (0xdc47 bytes) 000160 1789430094.886798 write 0x010a5f thru 0x012514 (0x1ab6 bytes) 000161 1789430094.888651 read 0x00e1e5 thru 0x012bca (0x49e6 bytes) 000163 1789430094.890088 trunc from 0x00a46f to 0x00c1a8 (0x1d3a bytes) 000164 1789430094.896118 write 0x0074ae thru 0x0125fb (0xb14e bytes) 000165 1789430094.898428 punch from 0x00b252 to 0x015540 (0xa2ef bytes) 000166 1789430094.920598 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21894): Mirror 4: 0xc8c20a0a (stale) Mirror 5: 0xc8c20a0a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21894): Mirror 4: 0xc8c20a0a (stale) Mirror 5: 0xc8c20a0a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21894: skipped 000167 1789430095.492255 read 0x01a9f8 thru 0x021893 (0x6e9c bytes) 000168 1789430095.505448 mapread 0x017009 thru 0x01ee92 (0x7e8a bytes) 000169 1789430095.530631 fallocate 0x0019be thru 0x00847c (0x6abf bytes) 000170 1789430095.535720 trunc from 0x021894 to 0x0157b6 (0xc0dd bytes) 000171 1789430095.559728 punch from 0x002643 to 0x00ed86 (0xc744 bytes) 000172 1789430095.571789 fallocate 0x01c977 thru 0x021faa (0x5634 bytes) 000173 1789430095.576785 mapwrite 0x00db38 thru 0x01bcdf (0xe1a8 bytes) 000174 1789430095.644733 mapwrite 0x019d98 thru 0x0244c2 (0xa72b bytes) 000175 1789430095.690715 fallocate 0x02f1d9 thru 0x02f92c (0x754 bytes) 000176 1789430095.697056 mapread 0x00cf8f thru 0x019541 (0xc5b3 bytes) 000177 1789430095.702282 MIRROR_RESYNC 3 mirrors 000178 1789430096.488277 mapread 0x003c88 thru 0x005912 (0x1c8b bytes) 000179 1789430096.512329 trunc from 0x02f92d to 0x032d95 (0x3469 bytes) 000180 1789430096.564952 mapread 0x0286aa thru 0x02c1f8 (0x3b4f bytes) 000181 1789430096.581915 mapread 0x00fa8f thru 0x01801f (0x8591 bytes) 000182 1789430096.614119 read 0x030fa3 thru 0x032d95 (0x1df3 bytes) 000183 1789430096.627621 mapwrite 0x01ee65 thru 0x0275f1 (0x878d bytes) 000184 1789430096.658424 read 0x024939 thru 0x028fcc (0x4694 bytes) 000185 1789430096.676645 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32d96): Mirror 5: 0xdc2ef52d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32d96): Mirror 5: 0xdc2ef52d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32d96: skipped 000186 1789430097.119465 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x32d96): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32d96): Mirror 5: 0xdc2ef52d (stale) CRC-32 checksum value for chunk [0, 0x32d96): Mirror 1: 0xf8c57b74 Mirror 6: 0xf8c57b74 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32d96: skipped 000187 1789430098.157684 fallocate 0x0131af thru 0x020508 (0xd35a bytes) 000188 1789430098.209938 read 0x01f197 thru 0x0298a6 (0xa710 bytes) 000189 1789430098.226956 MIRROR_RESYNC 3 mirrors 000191 1789430099.061686 read 0x01a725 thru 0x0234a6 (0x8d82 bytes) 000192 1789430099.074499 mapwrite 0x03d162 thru 0x03d91b (0x7ba bytes) 000193 1789430099.195132 mapread 0x00760a thru 0x0158b6 (0xe2ad bytes) 000194 1789430099.224969 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3d91c): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d91c): Mirror 5: 0xf1a6f27f (stale) Mirror 6: 0xf1a6f27f (stale) CRC-32 checksum value for chunk [0, 0x3d91c): Mirror 1: 0x6a9c98dd Mirror 7: 0x6a9c98dd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d91c: skipped 000195 1789430100.200490 read 0x019f15 thru 0x01fd4e (0x5e3a bytes) 000196 1789430100.230776 read 0x01ec1a thru 0x02673c (0x7b23 bytes) 000197 1789430100.265520 fallocate 0x00842a thru 0x00bbab (0x3782 bytes) 000198 1789430100.350232 MIRROR_RESYNC 4 mirrors 000199 1789430101.513192 read 0x00e2fa thru 0x01ad36 (0xca3d bytes) 000200 1789430101.527833 write 0x035235 thru 0x03ffff (0xadcb bytes) 000201 1789430101.562731 mapwrite 0x00363c thru 0x00e0f3 (0xaab8 bytes) 000202 1789430101.617257 mapwrite 0x03a65f thru 0x03d269 (0x2c0b bytes) 000203 1789430101.634106 read 0x020bfb thru 0x02cc9e (0xc0a4 bytes) 000204 1789430101.644268 trunc from 0x009ae6 to 0x00edff (0x531a bytes) 000205 1789430101.650611 trunc from 0x040000 to 0x03b2c1 (0x4d3e bytes) 000206 1789430101.675749 punch from 0x0345d6 to 0x037521 (0x2f4c bytes) 000207 1789430101.680628 write 0x01fc82 thru 0x02b119 (0xb498 bytes) 000208 1789430101.688096 MIRROR_RESYNC 4 mirrors 000209 1789430102.728497 punch from 0x029250 to 0x036a0a (0xd7bb bytes) 000210 1789430102.765862 MIRROR_RESYNC 4 mirrors 000211 1789430103.852787 read 0x033069 thru 0x03b2c1 (0x8259 bytes) 000212 1789430103.872099 trunc from 0x03b2c2 to 0x023428 (0x17e99 bytes) 000213 1789430103.915718 mapread 0x021117 thru 0x022c80 (0x1b6a bytes) 000214 1789430103.929638 read 0x005d70 thru 0x00955e (0x37ef bytes) 000215 1789430103.940365 mapread 0x00a466 thru 0x00cfa2 (0x2b3d bytes) 000216 1789430103.941980 read 0x001edd thru 0x005b86 (0x3caa bytes) 000218 1789430103.943417 read 0x007f63 thru 0x00f52e (0x75cc bytes) 000219 1789430103.944624 fallocate 0x0066e4 thru 0x00a392 (0x3caf bytes) 000220 1789430103.949713 trunc from 0x023429 to 0x006a97 (0x1c991 bytes) 000221 1789430103.976301 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6a98): Mirror 6: 0x26905f93 (stale) Mirror 7: 0x26905f93 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6a98): Mirror 6: 0x26905f93 (stale) Mirror 7: 0x26905f93 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6a98: skipped 000223 1789430104.389725 fallocate 0x02f731 thru 0x03539b (0x5c6b bytes) 000224 1789430104.407480 read 0x00593e thru 0x006a97 (0x115a bytes) 000225 1789430104.415845 fallocate 0x03c8c3 thru 0x03ffff (0x373d bytes) 000226 1789430104.428671 trunc from 0x02de14 to 0x03d834 (0xfa21 bytes) 000227 1789430104.436274 read 0x03fa7a thru 0x03ffff (0x586 bytes) 000229 1789430104.462219 mapwrite 0x019470 thru 0x02617d (0xcd0e bytes) 000230 1789430104.493326 write 0x001a59 thru 0x002633 (0xbdb bytes) 000231 1789430104.505527 trunc from 0x028b4b to 0x030ab9 (0x7f6f bytes) 000232 1789430104.511589 write 0x00183d thru 0x010fb3 (0xf777 bytes) 000233 1789430104.516370 fallocate 0x01cb39 thru 0x020e86 (0x434e bytes) 000234 1789430104.524801 read 0x039091 thru 0x03ca43 (0x39b3 bytes) 000235 1789430104.536869 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x54c0a3ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x54c0a3ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000236 1789430104.914594 fallocate 0x0107f8 thru 0x015193 (0x499c bytes) 000238 1789430104.925643 trunc from 0x032d5e to 0x034f87 (0x222a bytes) 000239 1789430104.933370 mapwrite 0x02d6da thru 0x03705f (0x9986 bytes) 000240 1789430104.985041 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) 000241 1789430105.168977 mapwrite 0x00dd11 thru 0x018731 (0xaa21 bytes) 000242 1789430105.260651 write 0x027947 thru 0x0377af (0xfe69 bytes) 000243 1789430105.287667 write 0x01f37d thru 0x024553 (0x51d7 bytes) 000244 1789430105.293685 trunc from 0x040000 to 0x024f29 (0x1b0d6 bytes) 000245 1789430105.325031 trunc from 0x024f2a to 0x008035 (0x1cef4 bytes) 000246 1789430105.338370 mapwrite 0x03e835 thru 0x03ffff (0x17cb bytes) 000247 1789430105.380935 mapread 0x021480 thru 0x02fdee (0xe96f bytes) 000249 1789430105.416317 punch from 0x026796 to 0x034d71 (0xe5dc bytes) 000250 1789430105.423594 write 0x006102 thru 0x01374c (0xd64b bytes) 000251 1789430105.444105 fallocate 0x025932 thru 0x025d1b (0x3ea bytes) 000252 1789430105.450656 read 0x000980 thru 0x0033ff (0x2a80 bytes) 000253 1789430105.462843 punch from 0x02437a to 0x028c9b (0x4922 bytes) 000254 1789430105.468294 mapread 0x02da57 thru 0x035af3 (0x809d bytes) 000255 1789430105.487833 trunc from 0x027924 to 0x02832e (0xa0b bytes) 000256 1789430105.498622 mapread 0x038bed thru 0x03ffff (0x7413 bytes) 000257 1789430105.501192 trunc from 0x00eba4 to 0x017a05 (0x8e62 bytes) 000258 1789430105.521434 mapwrite 0x00e880 thru 0x0143f6 (0x5b77 bytes) 000259 1789430105.570813 fallocate 0x00432f thru 0x0126d6 (0xe3a8 bytes) 000260 1789430105.584994 trunc from 0x040000 to 0x01a554 (0x25aab bytes) 000261 1789430105.624026 mapread 0x00d1fa thru 0x0197cc (0xc5d3 bytes) 000262 1789430105.634101 mapwrite 0x02d4b6 thru 0x034511 (0x705c bytes) 000263 1789430105.677271 write 0x0025df thru 0x002620 (0x42 bytes) 000264 1789430105.679595 mapread 0x004dca thru 0x005ca5 (0xedc bytes) 000266 1789430105.687676 punch from 0x004d40 to 0x00819a (0x345b bytes) 000268 1789430105.697069 mapread 0x01764a thru 0x022c9a (0xb651 bytes) 000269 1789430105.708455 trunc from 0x01d682 to 0x024903 (0x7282 bytes) 000270 1789430105.716558 fallocate 0x0223fb thru 0x025822 (0x3428 bytes) 000271 1789430105.722850 trunc from 0x001ea1 to 0x008ae8 (0x6c48 bytes) 000272 1789430105.732363 mapwrite 0x00b580 thru 0x00dca0 (0x2721 bytes) 000273 1789430105.745165 read 0x01aae4 thru 0x01e3ac (0x38c9 bytes) 000274 1789430105.762956 fallocate 0x0226e7 thru 0x0270c0 (0x49da bytes) 000276 1789430105.770045 read 0x02eac4 thru 0x034511 (0x5a4e bytes) 000277 1789430105.770709 mapread 0x008ea8 thru 0x00b0c9 (0x2222 bytes) 000279 1789430105.773812 mapread 0x013f1c thru 0x021c89 (0xdd6e bytes) 000280 1789430105.775622 mapread 0x0222b4 thru 0x02fdd4 (0xdb21 bytes) 000282 1789430105.777736 trunc from 0x034512 to 0x03eaf6 (0xa5e5 bytes) 000283 1789430105.791095 trunc from 0x000205 to 0x00ea12 (0xe80e bytes) 000284 1789430105.798625 mapread 0x00ea63 thru 0x01c09f (0xd63d bytes) 000286 1789430105.817030 read 0x02da57 thru 0x03c424 (0xe9ce bytes) 000287 1789430105.817752 fallocate 0x03eac0 thru 0x03ffff (0x1540 bytes) 000288 1789430105.824036 trunc from 0x017fb1 to 0x01a822 (0x2872 bytes) 000289 1789430105.829318 trunc from 0x0267f8 to 0x02b401 (0x4c0a bytes) 000290 1789430105.834569 read 0x02e0ed thru 0x03a3c6 (0xc2da bytes) 000291 1789430105.836466 fallocate 0x00d43e thru 0x018639 (0xb1fc bytes) 000292 1789430105.842334 mapwrite 0x01cafe thru 0x0240f4 (0x75f7 bytes) 000293 1789430105.862547 fallocate 0x03f471 thru 0x03ffff (0xb8f bytes) 000294 1789430105.868103 trunc from 0x040000 to 0x011721 (0x2e8de bytes) 000295 1789430105.886629 punch from 0x00f8bf to 0x011721 (0x1e63 bytes) 000297 1789430105.892757 fallocate 0x02b036 thru 0x0388af (0xd87a bytes) 000300 1789430105.899196 write 0x0392df thru 0x03c1cb (0x2eed bytes) 000301 1789430105.901366 read 0x00d6df thru 0x01b493 (0xddb5 bytes) 000302 1789430105.916661 MIRROR_EXTEND to 2 mirrors 000303 1789430106.922117 MIRROR_RESYNC 2 mirrors 000304 1789430107.363497 fallocate 0x00ba70 thru 0x012fa4 (0x7535 bytes) 000305 1789430107.419242 mapwrite 0x037cc0 thru 0x03e997 (0x6cd8 bytes) 000306 1789430107.493684 write 0x02e64b thru 0x03cdf1 (0xe7a7 bytes) 000307 1789430107.500514 trunc from 0x03e998 to 0x029e44 (0x14b53 bytes) 000308 1789430107.520944 write 0x03e763 thru 0x03ffff (0x189d bytes) 000309 1789430107.522710 mapread 0x0355d3 thru 0x03ffff (0xaa2d bytes) 000310 1789430107.542947 mapwrite 0x02dc1c thru 0x035dbb (0x81a0 bytes) 000312 1789430107.590211 read 0x03138a thru 0x03495d (0x35d4 bytes) 000313 1789430107.592952 fallocate 0x019b29 thru 0x020c19 (0x70f1 bytes) 000314 1789430107.605098 mapread 0x032ca7 thru 0x03bd3e (0x9098 bytes) 000315 1789430107.612645 trunc from 0x040000 to 0x0268d9 (0x19726 bytes) 000316 1789430107.646784 punch from 0x01b450 to 0x0268d9 (0xb48a bytes) 000317 1789430107.653092 fallocate 0x03b7a6 thru 0x03d6f4 (0x1f4f bytes) 000318 1789430107.666005 fallocate 0x018802 thru 0x01eae9 (0x62e8 bytes) 000319 1789430107.670584 mapread 0x00fcda thru 0x01f14c (0xf473 bytes) 000320 1789430107.691465 write 0x01c155 thru 0x02720d (0xb0b9 bytes) 000321 1789430107.698993 fallocate 0x02efc5 thru 0x036818 (0x7854 bytes) 000322 1789430107.704860 fallocate 0x0138f2 thru 0x015131 (0x1840 bytes) 000324 1789430107.712569 read 0x01a925 thru 0x01b853 (0xf2f bytes) 000325 1789430107.716945 MIRROR_RESYNC 2 mirrors 000327 1789430108.568850 trunc from 0x02091a to 0x021dc2 (0x14a9 bytes) 000328 1789430108.610706 read 0x028942 thru 0x03356f (0xac2e bytes) 000329 1789430108.621272 trunc from 0x000f0d to 0x00fb51 (0xec45 bytes) 000330 1789430108.627869 fallocate 0x027f4f thru 0x0357ef (0xd8a1 bytes) 000331 1789430108.633984 read 0x01ee42 thru 0x0204dd (0x169c bytes) 000332 1789430108.649460 fallocate 0x029c3c thru 0x02c9f0 (0x2db5 bytes) 000335 1789430108.661120 write 0x022659 thru 0x0284a6 (0x5e4e bytes) 000336 1789430108.667136 fallocate 0x031252 thru 0x037212 (0x5fc1 bytes) 000338 1789430108.676366 trunc from 0x0017fa to 0x00e17d (0xc984 bytes) 000339 1789430108.689009 mapwrite 0x004b1a thru 0x01177f (0xcc66 bytes) 000340 1789430108.841578 mapread 0x00b27e thru 0x014f3f (0x9cc2 bytes) 000341 1789430108.844270 fallocate 0x0163f2 thru 0x025577 (0xf186 bytes) 000342 1789430108.852309 trunc from 0x03d6f5 to 0x03c787 (0xf6d bytes) 000343 1789430108.889757 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) 000344 1789430109.041418 read 0x01d22a thru 0x02aae8 (0xd8bf bytes) 000345 1789430109.057531 read 0x0135c8 thru 0x016966 (0x339f bytes) 000346 1789430109.091947 trunc from 0x03c788 to 0x0285e7 (0x141a0 bytes) 000347 1789430109.146622 fallocate 0x00e6c0 thru 0x00f900 (0x1241 bytes) 000348 1789430109.156772 trunc from 0x004063 to 0x011a96 (0xda34 bytes) 000349 1789430109.165202 mapwrite 0x0335ae thru 0x036b52 (0x35a5 bytes) 000350 1789430109.231920 write 0x02daf9 thru 0x034cbf (0x71c7 bytes) 000351 1789430109.241282 trunc from 0x02ac4c to 0x030cc5 (0x607a bytes) 000352 1789430109.262846 punch from 0x000410 to 0x01033c (0xff2d bytes) 000353 1789430109.271011 read 0x0346c4 thru 0x036b52 (0x248f bytes) 000355 1789430109.273040 trunc from 0x01b726 to 0x01d322 (0x1bfd bytes) 000356 1789430109.281856 trunc from 0x0051ff to 0x0142cd (0xf0cf bytes) 000357 1789430109.289141 mapwrite 0x0068ad thru 0x010446 (0x9b9a bytes) 000358 1789430109.341744 write 0x0305f7 thru 0x03d66d (0xd077 bytes) 000359 1789430109.344013 trunc from 0x03d66e to 0x0180c8 (0x255a5 bytes) 000361 1789430109.367981 fallocate 0x02b0b2 thru 0x0346f3 (0x9642 bytes) 000362 1789430109.375004 write 0x01b627 thru 0x026f87 (0xb961 bytes) 000363 1789430109.388022 trunc from 0x0346f4 to 0x03d612 (0x8f1f bytes) 000364 1789430109.405618 mapread 0x02f7ce thru 0x03069d (0xed0 bytes) 000366 1789430109.418745 trunc from 0x03d613 to 0x018379 (0x25299 bytes) 000367 1789430109.433868 write 0x007e60 thru 0x00ed1e (0x6ebf bytes) 000368 1789430109.435355 trunc from 0x009988 to 0x0128e7 (0x8f60 bytes) 000369 1789430109.450338 mapread 0x007c21 thru 0x007f0d (0x2ed bytes) 000370 1789430109.451920 read 0x017bca thru 0x018379 (0x7b0 bytes) 000373 1789430109.453829 mapread 0x0048bf thru 0x01398a (0xf0cc bytes) 000374 1789430109.465740 mapread 0x00d0b1 thru 0x018379 (0xb2c9 bytes) 000375 1789430109.467769 mapwrite 0x028d41 thru 0x02dae5 (0x4da5 bytes) 000376 1789430109.564453 read 0x02735b thru 0x02dae5 (0x678b bytes) 000378 1789430109.566255 trunc from 0x02dae6 to 0x00db17 (0x1ffce bytes) 000379 1789430109.611828 read 0x0087f6 thru 0x009e2e (0x1639 bytes) 000380 1789430109.612516 mapread 0x007228 thru 0x009b04 (0x28dd bytes) 000381 1789430109.613385 fallocate 0x004aa8 thru 0x00cf3d (0x8496 bytes) 000382 1789430109.630314 fallocate 0x00270f thru 0x0099ba (0x72ac bytes) 000383 1789430109.637547 punch from 0x003727 to 0x00db17 (0xa3f1 bytes) 000385 1789430109.644713 trunc from 0x00173f to 0x004618 (0x2eda bytes) 000386 1789430109.650722 mapread 0x0062ed thru 0x0082d1 (0x1fe5 bytes) 000387 1789430109.661177 mapread 0x0062b8 thru 0x00db17 (0x7860 bytes) 000389 1789430109.662925 trunc from 0x00db18 to 0x02f335 (0x2181e bytes) 000390 1789430109.691455 mapwrite 0x00b0c8 thru 0x013d30 (0x8c69 bytes) 000391 1789430109.727679 trunc from 0x02f336 to 0x033e39 (0x4b04 bytes) 000392 1789430109.751332 fallocate 0x032025 thru 0x035eaf (0x3e8b bytes) 000393 1789430109.764935 trunc from 0x01204a to 0x0218e7 (0xf89e bytes) 000394 1789430109.772842 fallocate 0x03f68b thru 0x03ffff (0x975 bytes) 000395 1789430109.777960 trunc from 0x000cb5 to 0x006f39 (0x6285 bytes) 000397 1789430109.788763 mapread 0x018496 thru 0x01af6c (0x2ad7 bytes) 000398 1789430109.824698 punch from 0x023d30 to 0x028204 (0x44d5 bytes) 000399 1789430109.840038 mapwrite 0x03de06 thru 0x03ffff (0x21fa bytes) 000400 1789430109.898409 punch from 0x037825 to 0x03c54d (0x4d29 bytes) 000401 1789430109.902796 write 0x006339 thru 0x011ac3 (0xb78b bytes) 000402 1789430109.908984 mapread 0x02b354 thru 0x02de61 (0x2b0e bytes) 000403 1789430109.909952 fallocate 0x03df22 thru 0x03e48a (0x569 bytes) 000404 1789430109.914763 trunc from 0x040000 to 0x039876 (0x6789 bytes) 000405 1789430109.937256 trunc from 0x039877 to 0x018e95 (0x209e1 bytes) 000406 1789430109.973246 MIRROR_EXTEND to 2 mirrors 000407 1789430110.845128 MIRROR_EXTEND to 3 mirrors 000408 1789430111.931806 mapwrite 0x00fac3 thru 0x01e7c6 (0xed04 bytes) 000409 1789430112.110803 trunc from 0x0025ed to 0x00acdc (0x86f0 bytes) 000410 1789430112.118015 mapread 0x0111eb thru 0x011c74 (0xa8a bytes) 000411 1789430112.120747 mapread 0x013ef5 thru 0x01e7c6 (0xa8d2 bytes) 000413 1789430112.125731 write 0x0139b4 thru 0x014927 (0xf74 bytes) 000414 1789430112.128772 read 0x00f3b5 thru 0x01d3d6 (0xe022 bytes) 000415 1789430112.130149 trunc from 0x01c08e to 0x01e7c6 (0x2739 bytes) 000416 1789430112.137734 punch from 0x011d53 to 0x0147f1 (0x2a9f bytes) 000417 1789430112.151602 trunc from 0x01e7c7 to 0x031544 (0x12d7e bytes) 000418 1789430112.178498 fallocate 0x01b2d9 thru 0x01c0c1 (0xde9 bytes) 000419 1789430112.190078 mapwrite 0x014398 thru 0x021411 (0xd07a bytes) 000420 1789430112.277219 punch from 0x021cf5 to 0x02cfcd (0xb2d9 bytes) 000422 1789430112.288030 read 0x02d86b thru 0x02e427 (0xbbd bytes) 000423 1789430112.309693 write 0x03cd52 thru 0x03ffff (0x32ae bytes) 000424 1789430112.311426 mapread 0x016421 thru 0x0245e5 (0xe1c5 bytes) 000425 1789430112.319122 mapread 0x033b7e thru 0x03a04d (0x64d0 bytes) 000426 1789430112.339976 fallocate 0x01cbf6 thru 0x01e5cf (0x19da bytes) 000427 1789430112.364403 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x51b5f9d0 (stale) Mirror 3: 0x51b5f9d0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc3b77e53 Mirror 4: 0xc3b77e53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000428 1789430113.524048 fallocate 0x01ed7e thru 0x028a39 (0x9cbc bytes) 000429 1789430113.582264 mapwrite 0x01425b thru 0x017a7a (0x3820 bytes) 000431 1789430113.615618 punch from 0x000306 to 0x000d71 (0xa6c bytes) 000432 1789430113.619843 punch from 0x0151cc to 0x01c34a (0x717f bytes) 000433 1789430113.625323 trunc from 0x040000 to 0x02afe5 (0x1501a bytes) 000434 1789430113.672259 mapread 0x0160a2 thru 0x01f370 (0x92cf bytes) 000435 1789430113.706757 read 0x020ac0 thru 0x02afe5 (0xa526 bytes) 000436 1789430113.724755 trunc from 0x007387 to 0x014fb5 (0xdc2f bytes) 000437 1789430113.735635 fallocate 0x00ca36 thru 0x015dd8 (0x93a3 bytes) 000438 1789430113.741633 mapread 0x01569f thru 0x0249a2 (0xf304 bytes) 000439 1789430113.747032 trunc from 0x02afe6 to 0x021fb8 (0x902d bytes) 000440 1789430113.770585 punch from 0x0055f0 to 0x010d9a (0xb7ab bytes) 000441 1789430113.775738 write 0x038c7c thru 0x03ffff (0x7384 bytes) 000442 1789430113.780558 fallocate 0x0072ba thru 0x00edae (0x7af5 bytes) 000443 1789430113.788781 fallocate 0x008f19 thru 0x00f578 (0x6660 bytes) 000444 1789430113.793512 mapread 0x02acba thru 0x036853 (0xbb9a bytes) 000445 1789430113.808784 mapread 0x03f12d thru 0x03ffff (0xed3 bytes) 000446 1789430113.809739 mapread 0x037da0 thru 0x03ffff (0x8260 bytes) 000447 1789430113.812566 write 0x008454 thru 0x0112d3 (0x8e80 bytes) 000448 1789430113.830533 read 0x0327d9 thru 0x033b66 (0x138e bytes) 000449 1789430113.832735 mapwrite 0x0256e5 thru 0x025f08 (0x824 bytes) 000450 1789430113.873078 read 0x0360a4 thru 0x0398f0 (0x384d bytes) 000451 1789430113.874027 mapwrite 0x03f133 thru 0x03ffff (0xecd bytes) 000452 1789430113.905728 trunc from 0x00ea90 to 0x0171ed (0x875e bytes) 000453 1789430113.917673 write 0x031123 thru 0x03840e (0x72ec bytes) 000454 1789430113.922005 read 0x01d246 thru 0x02ce08 (0xfbc3 bytes) 000455 1789430113.936544 fallocate 0x002ad3 thru 0x004593 (0x1ac1 bytes) 000457 1789430113.945169 mapread 0x019208 thru 0x01bc38 (0x2a31 bytes) 000459 1789430113.948026 read 0x00e07d thru 0x014355 (0x62d9 bytes) 000460 1789430113.949260 read 0x00b545 thru 0x010c74 (0x5730 bytes) 000461 1789430113.949864 read 0x000bdb thru 0x008e9c (0x82c2 bytes) 000462 1789430113.954588 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x51b5f9d0 (stale) Mirror 3: 0x51b5f9d0 (stale) Mirror 4: 0xc3b77e53 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x35a1ef96 Mirror 5: 0x35a1ef96 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000463 1789430115.256396 mapwrite 0x034b35 thru 0x03defa (0x93c6 bytes) 000464 1789430115.354194 read 0x026152 thru 0x03552c (0xf3db bytes) 000465 1789430115.363620 mapwrite 0x014f95 thru 0x015a51 (0xabd bytes) 000466 1789430115.393745 trunc from 0x020bdf to 0x02acd8 (0xa0fa bytes) 000467 1789430115.402736 mapwrite 0x0028fc thru 0x00e740 (0xbe45 bytes) 000468 1789430115.454679 write 0x00c944 thru 0x01823c (0xb8f9 bytes) 000469 1789430115.465373 punch from 0x01be09 to 0x02aa1f (0xec17 bytes) 000470 1789430115.472926 mapread 0x03039b thru 0x035d94 (0x59fa bytes) 000471 1789430115.477294 mapread 0x000bd3 thru 0x00ce6c (0xc29a bytes) 000474 1789430115.500023 trunc from 0x040000 to 0x039557 (0x6aa8 bytes) 000475 1789430115.546551 write 0x02f8fb thru 0x03d49d (0xdba3 bytes) 000477 1789430115.549392 trunc from 0x026742 to 0x0273cf (0xc8e bytes) 000478 1789430115.557103 read 0x03b127 thru 0x03d1c4 (0x209e bytes) 000479 1789430115.557744 mapread 0x01a601 thru 0x02355d (0x8f5d bytes) 000480 1789430115.571742 trunc from 0x03d49e to 0x0082bc (0x351e1 bytes) 000481 1789430115.588270 read 0x008002 thru 0x0082bc (0x2bb bytes) 000482 1789430115.589195 mapwrite 0x01c3ef thru 0x01de1a (0x1a2c bytes) 000483 1789430115.662280 mapread 0x00a4ef thru 0x00b1f5 (0xd07 bytes) 000485 1789430115.669362 read 0x00fea1 thru 0x01b169 (0xb2c9 bytes) 000486 1789430115.671504 write 0x02f2c5 thru 0x039e44 (0xab80 bytes) 000487 1789430115.678030 write 0x0343a4 thru 0x03ffff (0xbc5c bytes) 000488 1789430115.683793 punch from 0x0351b6 to 0x03ffff (0xae4a bytes) 000489 1789430115.722852 read 0x012587 thru 0x014727 (0x21a1 bytes) 000490 1789430115.730806 MIRROR_RESYNC 5 mirrors 000491 1789430117.591736 mapwrite 0x01f61e thru 0x026b46 (0x7529 bytes) 000492 1789430117.700981 write 0x00b2d7 thru 0x00c347 (0x1071 bytes) 000493 1789430117.725228 fallocate 0x01c05d thru 0x029b9e (0xdb42 bytes) 000494 1789430117.739692 mapread 0x0104c4 thru 0x014e0f (0x494c bytes) 000495 1789430117.757790 fallocate 0x0012f9 thru 0x00d95f (0xc667 bytes) 000496 1789430117.766810 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xacef50d9 (stale) Mirror 3: 0xacef50d9 (stale) Mirror 4: 0xacef50d9 (stale) Mirror 5: 0xacef50d9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x50ed2fce Mirror 6: 0x50ed2fce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000497 1789430118.955730 trunc from 0x040000 to 0x0164a4 (0x29b5b bytes) 000498 1789430119.029412 fallocate 0x004465 thru 0x00e95e (0xa4fa bytes) 000499 1789430119.039496 punch from 0x00f2a9 to 0x011559 (0x22b1 bytes) 000500 1789430119.049618 punch from 0x0158ae to 0x0164a4 (0xbf7 bytes) 000501 1789430119.057620 trunc from 0x00fe7c to 0x0164a4 (0x6629 bytes) 000502 1789430119.063346 trunc from 0x0164a5 to 0x00d049 (0x945b bytes) 000503 1789430119.090636 fallocate 0x0229f9 thru 0x026223 (0x382b bytes) 000504 1789430119.095980 trunc from 0x0240a0 to 0x026223 (0x2184 bytes) 000505 1789430119.110769 write 0x02dbca thru 0x031f48 (0x437f bytes) 000506 1789430119.119048 read 0x02ca21 thru 0x02e16d (0x174d bytes) 000507 1789430119.135674 read 0x01ed1f thru 0x02172e (0x2a10 bytes) 000508 1789430119.168377 mapwrite 0x0397fa thru 0x03e34b (0x4b52 bytes) 000510 1789430119.238460 read 0x004401 thru 0x007414 (0x3014 bytes) 000511 1789430119.240718 read 0x001da9 thru 0x00259d (0x7f5 bytes) 000513 1789430119.249400 write 0x013b7a thru 0x020b15 (0xcf9c bytes) 000514 1789430119.257642 MIRROR_RESYNC 6 mirrors 000515 1789430121.595066 trunc from 0x036843 to 0x0398be (0x307c bytes) 000516 1789430121.642368 write 0x02e85c thru 0x03cd37 (0xe4dc bytes) 000517 1789430121.662739 punch from 0x00e5bf to 0x01a6ff (0xc141 bytes) 000518 1789430121.667711 read 0x007f85 thru 0x016fc6 (0xf042 bytes) 000519 1789430121.704796 read 0x038e3c thru 0x03bf63 (0x3128 bytes) 000520 1789430121.708146 write 0x0190c8 thru 0x019ef8 (0xe31 bytes) 000521 1789430121.730338 punch from 0x01c798 to 0x024178 (0x79e1 bytes) 000522 1789430121.743774 write 0x00abcf thru 0x00d4d1 (0x2903 bytes) 000523 1789430121.746288 trunc from 0x01eba3 to 0x024571 (0x59cf bytes) 000524 1789430121.753593 mapread 0x032a1c thru 0x03e34b (0xb930 bytes) 000525 1789430121.761044 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3e34c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e34c): Mirror 2: 0x25b3118d (stale) Mirror 3: 0x25b3118d (stale) Mirror 4: 0x25b3118d (stale) Mirror 5: 0x25b3118d (stale) Mirror 6: 0x25b3118d (stale) CRC-32 checksum value for chunk [0, 0x3e34c): Mirror 1: 0xb0990a41 Mirror 7: 0xb0990a41 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e34c: skipped 000526 1789430123.080370 mapread 0x01a13b thru 0x029247 (0xf10d bytes) 000527 1789430123.156616 trunc from 0x023925 to 0x027aa5 (0x4181 bytes) 000528 1789430123.242391 write 0x033d79 thru 0x03a2df (0x6567 bytes) 000529 1789430123.257460 mapread 0x007240 thru 0x008c1a (0x19db bytes) 000530 1789430123.285206 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3e34c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e34c): Mirror 2: 0x25b3118d (stale) Mirror 3: 0x25b3118d (stale) Mirror 4: 0x25b3118d (stale) Mirror 5: 0x25b3118d (stale) Mirror 6: 0x25b3118d (stale) Mirror 7: 0xb0990a41 (stale) CRC-32 checksum value for chunk [0, 0x3e34c): Mirror 1: 0x1121408d Mirror 8: 0x1121408d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e34c: skipped 000531 1789430124.539760 MIRROR_RESYNC 8 mirrors 000532 1789430127.084278 trunc from 0x03e34c to 0x0198a4 (0x24aa7 bytes) 000534 1789430127.209534 read 0x0156dc thru 0x0198a4 (0x41c9 bytes) 000536 1789430127.225828 read 0x00b558 thru 0x0198a4 (0xe34d bytes) 000537 1789430127.242491 write 0x0371a5 thru 0x03dc5f (0x6abb bytes) 000538 1789430127.250583 write 0x02702f thru 0x031183 (0xa155 bytes) 000539 1789430127.268853 trunc from 0x03d505 to 0x03dc5f (0x75b bytes) 000540 1789430127.294649 write 0x01190f thru 0x01f21a (0xd90c bytes) 000541 1789430127.299547 fallocate 0x012189 thru 0x01955a (0x73d2 bytes) 000542 1789430127.311799 trunc from 0x03dc60 to 0x0313ab (0xc8b4 bytes) 000543 1789430127.336398 mapread 0x01a41f thru 0x0234fc (0x90de bytes) 000544 1789430127.343786 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x313ac): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x313ac): Mirror 2: 0xfc7d316d (stale) Mirror 3: 0xfc7d316d (stale) Mirror 4: 0xfc7d316d (stale) Mirror 5: 0xfc7d316d (stale) Mirror 6: 0xfc7d316d (stale) Mirror 7: 0xfc7d316d (stale) Mirror 8: 0xfc7d316d (stale) CRC-32 checksum value for chunk [0, 0x313ac): Mirror 1: 0x6ea72260 Mirror 9: 0x6ea72260 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x313ac: skipped 000545 1789430128.580969 mapwrite 0x004668 thru 0x00709f (0x2a38 bytes) 000546 1789430128.681454 punch from 0x016d4d to 0x01e6df (0x7993 bytes) 000547 1789430128.687216 read 0x003deb thru 0x00dcda (0x9ef0 bytes) 000548 1789430128.694371 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x313ac): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x313ac): Mirror 2: 0xfc7d316d (stale) Mirror 3: 0xfc7d316d (stale) Mirror 4: 0xfc7d316d (stale) Mirror 5: 0xfc7d316d (stale) Mirror 6: 0xfc7d316d (stale) Mirror 7: 0xfc7d316d (stale) Mirror 8: 0xfc7d316d (stale) Mirror 9: 0x6ea72260 (stale) CRC-32 checksum value for chunk [0, 0x313ac): Mirror 1: 0xe1393f28 Mirror 10: 0xe1393f28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x313ac: skipped 000549 1789430130.075776 trunc from 0x0313ac to 0x013cec (0x1d6bf bytes) 000550 1789430130.169526 read 0x0135c0 thru 0x013cec (0x72d bytes) 000551 1789430130.182686 write 0x0376f3 thru 0x037f15 (0x823 bytes) 000552 1789430130.184510 trunc from 0x037f16 to 0x01d204 (0x1ad11 bytes) 000553 1789430130.214690 fallocate 0x00a603 thru 0x00c839 (0x2237 bytes) 000554 1789430130.221878 read 0x011d4d thru 0x01d204 (0xb4b8 bytes) 000555 1789430130.236163 trunc from 0x011d98 to 0x017743 (0x59ac bytes) 000556 1789430130.242651 punch from 0x01b1fe to 0x01d204 (0x2007 bytes) 000557 1789430130.249584 read 0x008aab thru 0x00b149 (0x269f bytes) 000558 1789430130.250657 read 0x008165 thru 0x008a89 (0x925 bytes) 000559 1789430130.252857 mapwrite 0x02b101 thru 0x03646f (0xb36f bytes) 000560 1789430130.312516 write 0x00a186 thru 0x00e7ef (0x466a bytes) 000561 1789430130.323449 MIRROR_RESYNC 10 mirrors 000562 1789430133.387351 trunc from 0x02373b to 0x02c70d (0x8fd3 bytes) 000563 1789430133.436505 trunc from 0x023635 to 0x03220e (0xebda bytes) 000564 1789430133.450633 mapwrite 0x02582b thru 0x02c794 (0x6f6a bytes) 000565 1789430133.509518 write 0x016e3b thru 0x01b49f (0x4665 bytes) 000566 1789430133.529695 trunc from 0x036470 to 0x01c80b (0x19c64 bytes) 000567 1789430133.558801 fallocate 0x023326 thru 0x02f6d1 (0xc3ac bytes) 000568 1789430133.566744 trunc from 0x01c80c to 0x0045b2 (0x18259 bytes) 000569 1789430133.590622 mapwrite 0x02a67c thru 0x03567c (0xb001 bytes) 000570 1789430133.652603 punch from 0x00aef9 to 0x017c27 (0xcd2f bytes) 000571 1789430133.659677 punch from 0x0287b3 to 0x03567c (0xceca bytes) 000572 1789430133.665099 punch from 0x015571 to 0x01913a (0x3bca bytes) 000573 1789430133.670677 fallocate 0x03c5b7 thru 0x03ffff (0x3a49 bytes) 000574 1789430133.675444 trunc from 0x022553 to 0x0225fd (0xab bytes) 000575 1789430133.680708 punch from 0x032645 to 0x034fe5 (0x29a1 bytes) 000576 1789430133.686865 write 0x035c3b thru 0x03673d (0xb03 bytes) 000577 1789430133.692441 read 0x0105ff thru 0x01f2a5 (0xeca7 bytes) 000578 1789430133.704483 write 0x00ae9a thru 0x017fdd (0xd144 bytes) 000579 1789430133.711312 mapwrite 0x02ca5b thru 0x02efe3 (0x2589 bytes) 000580 1789430133.747405 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3673e): Mirror 2: 0x6320673f (stale) Mirror 3: 0x6320673f (stale) Mirror 4: 0x6320673f (stale) Mirror 5: 0x6320673f (stale) Mirror 6: 0x6320673f (stale) Mirror 7: 0x6320673f (stale) Mirror 9: 0x6320673f (stale) Mirror 10: 0x6320673f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3673e): Mirror 2: 0x6320673f (stale) Mirror 3: 0x6320673f (stale) Mirror 4: 0x6320673f (stale) Mirror 5: 0x6320673f (stale) Mirror 6: 0x6320673f (stale) Mirror 7: 0x6320673f (stale) Mirror 9: 0x6320673f (stale) Mirror 10: 0x6320673f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3673e: skipped 000581 1789430134.385003 punch from 0x0352d2 to 0x03673d (0x146c bytes) 000582 1789430134.403420 MIRROR_RESYNC 9 mirrors 000583 1789430137.390494 trunc from 0x03673e to 0x030dee (0x594f bytes) 000584 1789430137.487374 trunc from 0x00d59a to 0x0144a8 (0x6f0f bytes) 000586 1789430137.501632 trunc from 0x030def to 0x01d4c4 (0x1392a bytes) 000587 1789430137.547133 trunc from 0x01d4c5 to 0x03a690 (0x1d1cc bytes) 000588 1789430137.569653 mapwrite 0x01a8a1 thru 0x025da6 (0xb506 bytes) 000589 1789430137.647987 mapwrite 0x011421 thru 0x011f97 (0xb77 bytes) 000590 1789430137.676764 read 0x030af3 thru 0x030c50 (0x15e bytes) 000591 1789430137.682717 trunc from 0x03a691 to 0x01acd4 (0x1f9bc bytes) 000592 1789430137.715547 MIRROR_RESYNC 9 mirrors 000593 1789430140.200476 punch from 0x0037b4 to 0x008bf1 (0x543e bytes) 000594 1789430140.271099 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1acd5): Mirror 2: 0xd8e698 (stale) Mirror 3: 0xd8e698 (stale) Mirror 4: 0xd8e698 (stale) Mirror 5: 0xd8e698 (stale) Mirror 6: 0xd8e698 (stale) Mirror 7: 0xd8e698 (stale) Mirror 9: 0xd8e698 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1acd5): Mirror 2: 0xd8e698 (stale) Mirror 3: 0xd8e698 (stale) Mirror 4: 0xd8e698 (stale) Mirror 5: 0xd8e698 (stale) Mirror 6: 0xd8e698 (stale) Mirror 7: 0xd8e698 (stale) Mirror 9: 0xd8e698 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1acd5: skipped 000595 1789430140.787912 mapwrite 0x003a1a thru 0x00e529 (0xab10 bytes) 000596 1789430140.859235 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1acd5): Mirror 2: 0xd8e698 (stale) Mirror 3: 0xd8e698 (stale) Mirror 4: 0xd8e698 (stale) Mirror 5: 0xd8e698 (stale) Mirror 6: 0xd8e698 (stale) Mirror 9: 0xd8e698 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1acd5): Mirror 2: 0xd8e698 (stale) Mirror 3: 0xd8e698 (stale) Mirror 4: 0xd8e698 (stale) Mirror 5: 0xd8e698 (stale) Mirror 6: 0xd8e698 (stale) Mirror 9: 0xd8e698 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1acd5: skipped 000597 1789430141.572266 mapread 0x008a56 thru 0x008cc9 (0x274 bytes) 000598 1789430141.593493 trunc from 0x01acd5 to 0x02b344 (0x10670 bytes) 000599 1789430141.621710 trunc from 0x02b345 to 0x014aa9 (0x1689b bytes) 000600 1789430141.646470 mapread 0x00bcae thru 0x00eaaa (0x2dfd bytes) 000601 1789430141.674708 fallocate 0x00c662 thru 0x00cac4 (0x463 bytes) 000602 1789430141.682872 read 0x00a42e thru 0x00d421 (0x2ff4 bytes) 000603 1789430141.683841 trunc from 0x00eaf9 to 0x014aa9 (0x5fb1 bytes) 000604 1789430141.693353 trunc from 0x011fe6 to 0x014aa9 (0x2ac4 bytes) 000605 1789430141.701804 trunc from 0x014aaa to 0x018bb3 (0x410a bytes) 000606 1789430141.727396 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18bb4): Mirror 3: 0x5977245f (stale) Mirror 4: 0x5977245f (stale) Mirror 5: 0x5977245f (stale) Mirror 6: 0x5977245f (stale) Mirror 9: 0x5977245f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18bb4): Mirror 3: 0x5977245f (stale) Mirror 4: 0x5977245f (stale) Mirror 5: 0x5977245f (stale) Mirror 6: 0x5977245f (stale) Mirror 9: 0x5977245f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18bb4: skipped 000607 1789430142.253313 write 0x01ad41 thru 0x01b127 (0x3e7 bytes) 000608 1789430142.265688 trunc from 0x0181b6 to 0x01b127 (0x2f72 bytes) 000609 1789430142.283211 trunc from 0x00571f to 0x0109ab (0xb28d bytes) 000610 1789430142.290604 trunc from 0x01b128 to 0x02ca2e (0x11907 bytes) 000611 1789430142.318163 mapread 0x00eb37 thru 0x01ca63 (0xdf2d bytes) 000612 1789430142.363411 fallocate 0x026784 thru 0x02d1cc (0x6a49 bytes) 000613 1789430142.387709 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ca2f): Mirror 4: 0x38f4c243 (stale) Mirror 5: 0x38f4c243 (stale) Mirror 6: 0x38f4c243 (stale) Mirror 9: 0x38f4c243 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ca2f): Mirror 4: 0x38f4c243 (stale) Mirror 5: 0x38f4c243 (stale) Mirror 6: 0x38f4c243 (stale) Mirror 9: 0x38f4c243 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ca2f: skipped 000614 1789430142.839124 write 0x0012c9 thru 0x00f36a (0xe0a2 bytes) 000615 1789430142.860839 punch from 0x00a19c to 0x00feb9 (0x5d1e bytes) 000616 1789430142.882337 trunc from 0x02ca2f to 0x01e627 (0xe407 bytes) 000617 1789430142.913747 read 0x00e2f5 thru 0x0111eb (0x2ef7 bytes) 000618 1789430142.922599 trunc from 0x00560a to 0x00c3a6 (0x6d9d bytes) 000619 1789430142.927581 fallocate 0x015869 thru 0x01aa79 (0x5211 bytes) 000620 1789430142.933813 mapwrite 0x032bdd thru 0x03ffff (0xd423 bytes) 000621 1789430143.035464 fallocate 0x01b45e thru 0x02792b (0xc4ce bytes) 000622 1789430143.048045 read 0x02075b thru 0x02291e (0x21c4 bytes) 000623 1789430143.068296 punch from 0x02f6b2 to 0x03e7e2 (0xf131 bytes) 000624 1789430143.074456 write 0x02f0a6 thru 0x0386dd (0x9638 bytes) 000625 1789430143.094664 fallocate 0x03be22 thru 0x03ffff (0x41de bytes) 000626 1789430143.101981 fallocate 0x02b4ca thru 0x02e410 (0x2f47 bytes) 000627 1789430143.124356 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x53c27fe9 (stale) Mirror 5: 0x53c27fe9 (stale) Mirror 6: 0x53c27fe9 (stale) Mirror 9: 0x53c27fe9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf6c86a65 Mirror 10: 0xf6c86a65 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000629 1789430144.309495 trunc from 0x01158c to 0x0180e0 (0x6b55 bytes) 000630 1789430144.364938 read 0x03186a thru 0x03ffff (0xe796 bytes) 000631 1789430144.373322 mapread 0x014be4 thru 0x01d290 (0x86ad bytes) 000632 1789430144.394484 trunc from 0x040000 to 0x03a240 (0x5dbf bytes) 000633 1789430144.476751 trunc from 0x03a241 to 0x031791 (0x8aaf bytes) 000634 1789430144.521390 read 0x01fa94 thru 0x02a2cc (0xa839 bytes) 000635 1789430144.544028 fallocate 0x035836 thru 0x03cfdc (0x77a7 bytes) 000637 1789430144.562238 mapread 0x000ab3 thru 0x004143 (0x3691 bytes) 000638 1789430144.566413 trunc from 0x03cfdd to 0x0380a4 (0x4f38 bytes) 000639 1789430144.590012 trunc from 0x0380a5 to 0x02997b (0xe729 bytes) 000640 1789430144.616550 mapread 0x004e4c thru 0x008e57 (0x400c bytes) 000642 1789430144.620404 punch from 0x002770 to 0x007a32 (0x52c3 bytes) 000643 1789430144.630079 fallocate 0x02b31b thru 0x030816 (0x54fc bytes) 000644 1789430144.645495 read 0x0073f6 thru 0x01106e (0x9c79 bytes) 000645 1789430144.666399 mapread 0x01fb8e thru 0x025f25 (0x6398 bytes) 000646 1789430144.668188 trunc from 0x01e85b to 0x02574d (0x6ef3 bytes) 000648 1789430144.681328 trunc from 0x02997c to 0x001ae3 (0x27e98 bytes) 000649 1789430144.704573 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ae4): Mirror 4: 0xfc1e12 (stale) Mirror 6: 0xfc1e12 (stale) Mirror 9: 0xfc1e12 (stale) Mirror 10: 0xf3016965 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ae4): Mirror 4: 0xfc1e12 (stale) Mirror 6: 0xfc1e12 (stale) Mirror 9: 0xfc1e12 (stale) Mirror 10: 0xf3016965 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ae4: skipped 000650 1789430145.176479 trunc from 0x001ae4 to 0x032ee4 (0x31401 bytes) 000651 1789430145.210794 write 0x0390f1 thru 0x03f2be (0x61ce bytes) 000652 1789430145.218208 trunc from 0x03f2bf to 0x018c84 (0x2663a bytes) 000654 1789430145.238470 fallocate 0x03587a thru 0x03ffff (0xa786 bytes) 000655 1789430145.244652 mapread 0x023f72 thru 0x0262ed (0x237c bytes) 000656 1789430145.272377 mapwrite 0x01df0e thru 0x02c7f4 (0xe8e7 bytes) 000657 1789430145.315810 trunc from 0x040000 to 0x03d681 (0x297e bytes) 000659 1789430145.353634 punch from 0x03550e to 0x03cdff (0x78f2 bytes) 000660 1789430145.369828 MIRROR_RESYNC 5 mirrors 000663 1789430146.605249 MIRROR_EXTEND to 6 mirrors 000664 1789430147.735743 write 0x02c40c thru 0x03a0aa (0xdc9f bytes) 000665 1789430147.786782 mapwrite 0x02acfa thru 0x02d63c (0x2943 bytes) 000666 1789430147.852684 fallocate 0x0053a5 thru 0x009bd3 (0x482f bytes) 000667 1789430147.858354 punch from 0x00c828 to 0x01bf46 (0xf71f bytes) 000668 1789430147.871808 write 0x021aaf thru 0x0241e9 (0x273b bytes) 000669 1789430147.886699 trunc from 0x010bca to 0x01899e (0x7dd5 bytes) 000670 1789430147.892627 write 0x02d21f thru 0x03456d (0x734f bytes) 000671 1789430147.894653 write 0x0121bd thru 0x01cf08 (0xad4c bytes) 000672 1789430147.909383 trunc from 0x03d682 to 0x03006a (0xd617 bytes) 000673 1789430147.937755 mapread 0x0293be thru 0x02cf46 (0x3b89 bytes) 000674 1789430147.950245 fallocate 0x01d792 thru 0x02d3ee (0xfc5d bytes) 000675 1789430147.955331 punch from 0x01c75f to 0x029134 (0xc9d6 bytes) 000676 1789430147.980950 read 0x00ba62 thru 0x0193bc (0xd95b bytes) 000677 1789430147.990835 read 0x023ad2 thru 0x02db93 (0xa0c2 bytes) 000678 1789430148.005667 trunc from 0x01d139 to 0x0259bf (0x8887 bytes) 000679 1789430148.017518 punch from 0x026679 to 0x03006a (0x99f2 bytes) 000680 1789430148.034406 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3006b): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3006b): Mirror 4: 0x750a50ae (stale) Mirror 6: 0x750a50ae (stale) Mirror 9: 0x750a50ae (stale) Mirror 10: 0x750a50ae (stale) Mirror 11: 0x750a50ae (stale) CRC-32 checksum value for chunk [0, 0x3006b): Mirror 1: 0xe4631ef1 Mirror 12: 0xe4631ef1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3006b: skipped 000681 1789430149.337327 mapwrite 0x0145d0 thru 0x01be05 (0x7836 bytes) 000682 1789430149.483440 punch from 0x012527 to 0x014622 (0x20fc bytes) 000683 1789430149.493207 trunc from 0x00c015 to 0x00d7a6 (0x1792 bytes) 000684 1789430149.511344 write 0x014a5c thru 0x022b8e (0xe133 bytes) 000685 1789430149.536644 mapwrite 0x03e185 thru 0x03ffff (0x1e7b bytes) 000687 1789430149.633429 write 0x0318c1 thru 0x033275 (0x19b5 bytes) 000688 1789430149.645208 write 0x0213f7 thru 0x02ad94 (0x999e bytes) 000690 1789430149.655028 fallocate 0x023948 thru 0x027239 (0x38f2 bytes) 000691 1789430149.664413 read 0x02bcec thru 0x037dca (0xc0df bytes) 000693 1789430149.676477 fallocate 0x01082a thru 0x0185e3 (0x7dba bytes) 000694 1789430149.683656 fallocate 0x02979b thru 0x02da3e (0x42a4 bytes) 000695 1789430149.689609 read 0x01e766 thru 0x0253b0 (0x6c4b bytes) 000696 1789430149.690735 fallocate 0x009cca thru 0x00c59c (0x28d3 bytes) 000697 1789430149.700969 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x8864f2db (stale) Mirror 6: 0x8864f2db (stale) Mirror 9: 0x8864f2db (stale) Mirror 10: 0x8864f2db (stale) Mirror 11: 0x8864f2db (stale) Mirror 12: 0x674b3674 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x983441c7 Mirror 13: 0x983441c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000698 1789430151.144530 trunc from 0x040000 to 0x014f79 (0x2b086 bytes) 000699 1789430151.242476 MIRROR_RESYNC 8 mirrors 000700 1789430153.312301 trunc from 0x00675d to 0x00f69f (0x8f43 bytes) 000701 1789430153.358444 mapread 0x00b0ac thru 0x014f79 (0x9ece bytes) 000703 1789430153.383646 punch from 0x002679 to 0x005724 (0x30ac bytes) 000704 1789430153.388502 write 0x0204b1 thru 0x024c0b (0x475b bytes) 000705 1789430153.394765 MIRROR_RESYNC 8 mirrors 000706 1789430155.910714 mapwrite 0x03d293 thru 0x03ffff (0x2d6d bytes) 000707 1789430156.024692 mapread 0x0143cc thru 0x01b89d (0x74d2 bytes) 000708 1789430156.051198 trunc from 0x03f1e1 to 0x03ffff (0xe1f bytes) 000709 1789430156.065038 mapwrite 0x01af61 thru 0x021e8f (0x6f2f bytes) 000710 1789430156.119305 read 0x028ace thru 0x036df2 (0xe325 bytes) 000711 1789430156.154345 read 0x03d6d7 thru 0x03ffff (0x2929 bytes) 000712 1789430156.171336 read 0x01c167 thru 0x01f39c (0x3236 bytes) 000713 1789430156.173119 trunc from 0x01d7d1 to 0x026e98 (0x96c8 bytes) 000715 1789430156.184724 mapread 0x01bf7c thru 0x021649 (0x56ce bytes) 000716 1789430156.203745 read 0x00f047 thru 0x00fc54 (0xc0e bytes) 000717 1789430156.205766 trunc from 0x012be0 to 0x01fb66 (0xcf87 bytes) 000718 1789430156.237844 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xbca82291 (stale) Mirror 6: 0xbca82291 (stale) Mirror 9: 0xbca82291 (stale) Mirror 10: 0xbca82291 (stale) Mirror 11: 0xbca82291 (stale) Mirror 12: 0xbca82291 (stale) Mirror 13: 0xbca82291 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf09835f3 Mirror 14: 0xf09835f3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000719 1789430157.501294 trunc from 0x02e6be to 0x032d77 (0x46ba bytes) 000720 1789430157.537986 trunc from 0x008b97 to 0x00c441 (0x38ab bytes) 000721 1789430157.547584 write 0x02d451 thru 0x0368da (0x948a bytes) 000722 1789430157.565587 mapwrite 0x015090 thru 0x0180ee (0x305f bytes) 000723 1789430157.598728 punch from 0x00ce89 to 0x01cc15 (0xfd8d bytes) 000724 1789430157.604562 read 0x025758 thru 0x02a448 (0x4cf1 bytes) 000725 1789430157.635373 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xbca82291 (stale) Mirror 6: 0xbca82291 (stale) Mirror 9: 0xbca82291 (stale) Mirror 10: 0xbca82291 (stale) Mirror 11: 0xbca82291 (stale) Mirror 12: 0xbca82291 (stale) Mirror 13: 0xbca82291 (stale) Mirror 14: 0xf09835f3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf2a74598 Mirror 15: 0xf2a74598 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000726 1789430159.041533 trunc from 0x040000 to 0x03cf0f (0x30f0 bytes) 000727 1789430159.104472 write 0x007226 thru 0x008f6d (0x1d48 bytes) 000728 1789430159.115567 fallocate 0x02ee99 thru 0x038460 (0x95c8 bytes) 000729 1789430159.121139 trunc from 0x03cf10 to 0x013a60 (0x294af bytes) 000730 1789430159.141541 mapread 0x00c7b4 thru 0x013a60 (0x72ad bytes) 000731 1789430159.161664 fallocate 0x01fe5a thru 0x025259 (0x5400 bytes) 000732 1789430159.167514 mapread 0x004b53 thru 0x0125a1 (0xda4f bytes) 000733 1789430159.178267 write 0x00c826 thru 0x00d514 (0xcef bytes) 000734 1789430159.179647 read 0x012b38 thru 0x013a60 (0xf29 bytes) 000736 1789430159.181507 punch from 0x00e094 to 0x013487 (0x53f4 bytes) 000737 1789430159.191433 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13a61): Mirror 4: 0x18e26477 (stale) Mirror 9: 0x18e26477 (stale) Mirror 10: 0x18e26477 (stale) Mirror 11: 0x18e26477 (stale) Mirror 12: 0x18e26477 (stale) Mirror 13: 0x18e26477 (stale) Mirror 14: 0x18e26477 (stale) Mirror 15: 0x5e3da36e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13a61): Mirror 4: 0x18e26477 (stale) Mirror 9: 0x18e26477 (stale) Mirror 10: 0x18e26477 (stale) Mirror 11: 0x18e26477 (stale) Mirror 12: 0x18e26477 (stale) Mirror 13: 0x18e26477 (stale) Mirror 14: 0x18e26477 (stale) Mirror 15: 0x5e3da36e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13a61: skipped 000738 1789430159.835485 trunc from 0x0041b4 to 0x00b80b (0x7658 bytes) 000739 1789430159.845729 trunc from 0x013a61 to 0x0320d9 (0x1e679 bytes) 000740 1789430159.869757 write 0x002915 thru 0x002ae4 (0x1d0 bytes) 000741 1789430159.875836 punch from 0x0107a5 to 0x018b8e (0x83ea bytes) 000742 1789430159.881621 read 0x02d106 thru 0x02e02d (0xf28 bytes) 000743 1789430159.887429 mapwrite 0x027e26 thru 0x0361e4 (0xe3bf bytes) 000744 1789430159.958644 punch from 0x01a062 to 0x02958f (0xf52e bytes) 000745 1789430159.964550 punch from 0x00512a to 0x00d196 (0x806d bytes) 000746 1789430159.969650 fallocate 0x02b990 thru 0x03497d (0x8fee bytes) 000747 1789430159.974605 trunc from 0x01f476 to 0x02b522 (0xc0ad bytes) 000748 1789430159.980500 trunc from 0x0361e5 to 0x035b7e (0x666 bytes) 000749 1789430159.999806 write 0x00ac70 thru 0x0113cf (0x6760 bytes) 000750 1789430160.009639 write 0x015f71 thru 0x022c44 (0xccd4 bytes) 000752 1789430160.021471 write 0x015105 thru 0x01d005 (0x7f01 bytes) 000753 1789430160.022884 write 0x00c5d6 thru 0x00fa0a (0x3435 bytes) 000754 1789430160.025523 trunc from 0x010bc7 to 0x017c8c (0x70c6 bytes) 000755 1789430160.042705 mapread 0x01b440 thru 0x025c46 (0xa807 bytes) 000756 1789430160.054561 mapwrite 0x02db46 thru 0x032527 (0x49e2 bytes) 000757 1789430160.070030 trunc from 0x01ff94 to 0x024ff6 (0x5063 bytes) 000758 1789430160.075070 mapwrite 0x0344c9 thru 0x03ffff (0xbb37 bytes) 000759 1789430160.128943 mapread 0x025eb8 thru 0x02dd52 (0x7e9b bytes) 000761 1789430160.136063 MIRROR_RESYNC 9 mirrors 000762 1789430163.130881 mapwrite 0x0269a5 thru 0x02b259 (0x48b5 bytes) 000763 1789430163.291661 fallocate 0x01c099 thru 0x025c79 (0x9be1 bytes) 000764 1789430163.297942 trunc from 0x040000 to 0x028b26 (0x174d9 bytes) 000766 1789430163.319671 trunc from 0x0185a0 to 0x02026e (0x7ccf bytes) 000767 1789430163.323728 write 0x020557 thru 0x02182b (0x12d5 bytes) 000768 1789430163.339029 fallocate 0x02932d thru 0x02a5ca (0x129e bytes) 000769 1789430163.348248 write 0x00c0d0 thru 0x019487 (0xd3b8 bytes) 000770 1789430163.371799 read 0x02684b thru 0x02a5ca (0x3d80 bytes) 000771 1789430163.388658 fallocate 0x037bc5 thru 0x03ffff (0x843b bytes) 000772 1789430163.393679 trunc from 0x013732 to 0x0211f6 (0xdac5 bytes) 000773 1789430163.426342 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a5cb): Mirror 4: 0xb9a4365d (stale) Mirror 10: 0xb9a4365d (stale) Mirror 11: 0xb9a4365d (stale) Mirror 12: 0xb9a4365d (stale) Mirror 13: 0xb9a4365d (stale) Mirror 14: 0xb9a4365d (stale) Mirror 15: 0xb9a4365d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a5cb): Mirror 4: 0xb9a4365d (stale) Mirror 10: 0xb9a4365d (stale) Mirror 11: 0xb9a4365d (stale) Mirror 12: 0xb9a4365d (stale) Mirror 13: 0xb9a4365d (stale) Mirror 14: 0xb9a4365d (stale) Mirror 15: 0xb9a4365d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a5cb: skipped 000774 1789430163.949563 write 0x010809 thru 0x01ae79 (0xa671 bytes) 000775 1789430163.972045 mapwrite 0x01f071 thru 0x0240b4 (0x5044 bytes) 000776 1789430164.032699 trunc from 0x02a5cb to 0x02a5b4 (0x16 bytes) 000777 1789430164.070259 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a5b5): Mirror 4: 0x645b6af6 (stale) Mirror 10: 0x645b6af6 (stale) Mirror 11: 0x645b6af6 (stale) Mirror 12: 0x645b6af6 (stale) Mirror 13: 0x645b6af6 (stale) Mirror 14: 0x645b6af6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a5b5): Mirror 4: 0x645b6af6 (stale) Mirror 10: 0x645b6af6 (stale) Mirror 11: 0x645b6af6 (stale) Mirror 12: 0x645b6af6 (stale) Mirror 13: 0x645b6af6 (stale) Mirror 14: 0x645b6af6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a5b5: skipped 000778 1789430164.620965 fallocate 0x01219a thru 0x02186d (0xf6d4 bytes) 000779 1789430164.631549 punch from 0x010a8b to 0x01124c (0x7c2 bytes) 000780 1789430164.636763 fallocate 0x02045c thru 0x02ab47 (0xa6ec bytes) 000781 1789430164.641311 punch from 0x0173bb to 0x01c5e7 (0x522d bytes) 000782 1789430164.669274 MIRROR_RESYNC 7 mirrors 000784 1789430166.674964 punch from 0x01b001 to 0x0236ed (0x86ed bytes) 000785 1789430166.713179 punch from 0x017cd6 to 0x01c2ec (0x4617 bytes) 000786 1789430166.723630 mapwrite 0x0232f4 thru 0x02e0ba (0xadc7 bytes) 000787 1789430166.826621 punch from 0x02cdc8 to 0x02d100 (0x339 bytes) 000788 1789430166.842303 write 0x02f37d thru 0x034ae4 (0x5768 bytes) 000789 1789430166.845453 read 0x017795 thru 0x024f5b (0xd7c7 bytes) 000790 1789430166.861353 fallocate 0x02ac25 thru 0x030fb0 (0x638c bytes) 000791 1789430166.869689 punch from 0x0049ca to 0x006d13 (0x234a bytes) 000792 1789430166.875199 fallocate 0x02e754 thru 0x03dba0 (0xf44d bytes) 000793 1789430166.880816 punch from 0x00c177 to 0x0170e2 (0xaf6c bytes) 000794 1789430166.885639 trunc from 0x03465e to 0x039bf7 (0x559a bytes) 000795 1789430166.902071 trunc from 0x00f0e4 to 0x018384 (0x92a1 bytes) 000796 1789430166.907700 mapread 0x02b1e3 thru 0x03952f (0xe34d bytes) 000797 1789430166.934534 trunc from 0x00a57a to 0x00fc65 (0x56ec bytes) 000798 1789430166.940117 mapread 0x029812 thru 0x03743b (0xdc2a bytes) 000799 1789430166.941428 trunc from 0x00b3ff to 0x00fbfd (0x47ff bytes) 000800 1789430166.947515 write 0x012bfb thru 0x016381 (0x3787 bytes) 000801 1789430166.960047 fallocate 0x016370 thru 0x01cd24 (0x69b5 bytes) 000802 1789430166.965359 write 0x037801 thru 0x03dc70 (0x6470 bytes) 000803 1789430166.966833 read 0x000576 thru 0x00a5e3 (0xa06e bytes) 000804 1789430166.978617 fallocate 0x0006f1 thru 0x006103 (0x5a13 bytes) 000805 1789430166.986689 punch from 0x010d79 to 0x019316 (0x859e bytes) 000806 1789430167.001640 mapwrite 0x03463c thru 0x03ffff (0xb9c4 bytes) 000807 1789430167.055812 trunc from 0x040000 to 0x01f515 (0x20aea bytes) 000808 1789430167.085410 MIRROR_RESYNC 7 mirrors 000809 1789430168.502653 punch from 0x008799 to 0x01142a (0x8c92 bytes) 000810 1789430168.561547 trunc from 0x00632b to 0x0087e8 (0x24be bytes) 000812 1789430168.568221 punch from 0x00566a to 0x00de75 (0x880c bytes) 000813 1789430168.574249 mapread 0x000737 thru 0x00c3a2 (0xbc6c bytes) 000814 1789430168.617081 mapwrite 0x0280cd thru 0x032d6e (0xaca2 bytes) 000815 1789430168.723087 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x32d6f): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32d6f): Mirror 4: 0xff96ea25 (stale) Mirror 10: 0xff96ea25 (stale) Mirror 11: 0xff96ea25 (stale) Mirror 12: 0xff96ea25 (stale) Mirror 13: 0xff96ea25 (stale) Mirror 14: 0xff96ea25 (stale) CRC-32 checksum value for chunk [0, 0x32d6f): Mirror 1: 0x2a9b2efe Mirror 15: 0x2a9b2efe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32d6f: skipped 000816 1789430169.923055 punch from 0x012e21 to 0x020b60 (0xdd40 bytes) 000817 1789430169.980653 punch from 0x016cdc to 0x01854b (0x1870 bytes) 000819 1789430169.991215 trunc from 0x032d6f to 0x01503d (0x1dd31 bytes) 000820 1789430170.013792 mapread 0x009627 thru 0x0108e6 (0x72c0 bytes) 000821 1789430170.042708 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1503e): Mirror 4: 0x2dce6df9 (stale) Mirror 10: 0x2dce6df9 (stale) Mirror 11: 0x2dce6df9 (stale) Mirror 12: 0x2dce6df9 (stale) Mirror 14: 0x2dce6df9 (stale) Mirror 15: 0x2dce6df9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1503e): Mirror 4: 0x2dce6df9 (stale) Mirror 10: 0x2dce6df9 (stale) Mirror 11: 0x2dce6df9 (stale) Mirror 12: 0x2dce6df9 (stale) Mirror 14: 0x2dce6df9 (stale) Mirror 15: 0x2dce6df9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1503e: skipped 000822 1789430170.607727 mapread 0x007149 thru 0x011f71 (0xae29 bytes) 000823 1789430170.640333 trunc from 0x01503e to 0x0088a9 (0xc794 bytes) 000824 1789430170.667493 mapwrite 0x01fc8c thru 0x023136 (0x34ab bytes) 000825 1789430170.736882 punch from 0x00f044 to 0x010250 (0x120d bytes) 000826 1789430170.746351 punch from 0x0161e1 to 0x017bfb (0x1a1b bytes) 000827 1789430170.756067 write 0x0297b1 thru 0x033fe5 (0xa835 bytes) 000828 1789430170.760031 read 0x016124 thru 0x0222e8 (0xc1c5 bytes) 000829 1789430170.775017 punch from 0x031b48 to 0x033fe5 (0x249e bytes) 000830 1789430170.804254 trunc from 0x033fe6 to 0x03b1be (0x71d9 bytes) 000832 1789430170.827230 mapread 0x0326dd thru 0x03b1be (0x8ae2 bytes) 000833 1789430170.843586 trunc from 0x03b1bf to 0x01d7b1 (0x1da0d bytes) 000834 1789430170.869359 MIRROR_RESYNC 7 mirrors 000835 1789430172.235777 mapread 0x002c12 thru 0x010bc6 (0xdfb5 bytes) 000836 1789430172.268509 write 0x021f85 thru 0x02ef73 (0xcfef bytes) 000837 1789430172.306488 trunc from 0x0050b8 to 0x009238 (0x4181 bytes) 000838 1789430172.313082 trunc from 0x02ef74 to 0x008abd (0x264b6 bytes) 000839 1789430172.343484 mapwrite 0x02e542 thru 0x03df7d (0xfa3c bytes) 000840 1789430172.424954 mapread 0x00f028 thru 0x01d08d (0xe066 bytes) 000841 1789430172.468367 trunc from 0x03df7e to 0x024b5f (0x1941e bytes) 000842 1789430172.502971 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x24b60): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24b60): Mirror 4: 0x92dd7bf9 (stale) Mirror 10: 0x92dd7bf9 (stale) Mirror 11: 0x92dd7bf9 (stale) Mirror 12: 0x92dd7bf9 (stale) Mirror 14: 0x92dd7bf9 (stale) Mirror 15: 0x92dd7bf9 (stale) CRC-32 checksum value for chunk [0, 0x24b60): Mirror 1: 0x92dd7bf9 Mirror 16: 0x92dd7bf9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24b60: skipped 000843 1789430173.805299 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x24b60): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24b60): Mirror 4: 0x92dd7bf9 (stale) Mirror 10: 0x92dd7bf9 (stale) Mirror 11: 0x92dd7bf9 (stale) Mirror 12: 0x92dd7bf9 (stale) Mirror 14: 0x92dd7bf9 (stale) Mirror 15: 0x92dd7bf9 (stale) CRC-32 checksum value for chunk [0, 0x24b60): Mirror 1: 0x92dd7bf9 Mirror 16: 0x92dd7bf9 Mirror 17: 0x92dd7bf9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24b60: skipped 000844 1789430175.115116 mapwrite 0x009477 thru 0x0185d4 (0xf15e bytes) 000845 1789430175.229181 trunc from 0x0090dc to 0x014c03 (0xbb28 bytes) 000846 1789430175.242160 mapread 0x0072b2 thru 0x0118f0 (0xa63f bytes) 000848 1789430175.257638 punch from 0x009168 to 0x012bf2 (0x9a8b bytes) 000849 1789430175.265323 mapread 0x001198 thru 0x003ce3 (0x2b4c bytes) 000850 1789430175.291132 fallocate 0x01d7ff thru 0x023d4e (0x6550 bytes) 000852 1789430175.305338 mapread 0x00802a thru 0x010933 (0x890a bytes) 000853 1789430175.345301 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24b60): Mirror 4: 0x92dd7bf9 (stale) Mirror 10: 0x92dd7bf9 (stale) Mirror 11: 0x92dd7bf9 (stale) Mirror 12: 0x92dd7bf9 (stale) Mirror 14: 0x92dd7bf9 (stale) Mirror 16: 0x92dd7bf9 (stale) Mirror 17: 0x92dd7bf9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24b60): Mirror 4: 0x92dd7bf9 (stale) Mirror 10: 0x92dd7bf9 (stale) Mirror 11: 0x92dd7bf9 (stale) Mirror 12: 0x92dd7bf9 (stale) Mirror 14: 0x92dd7bf9 (stale) Mirror 16: 0x92dd7bf9 (stale) Mirror 17: 0x92dd7bf9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24b60: skipped 000854 1789430175.961981 trunc from 0x00cc17 to 0x013b51 (0x6f3b bytes) 000855 1789430175.989818 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x24b60): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24b60): Mirror 4: 0x92dd7bf9 (stale) Mirror 10: 0x92dd7bf9 (stale) Mirror 11: 0x92dd7bf9 (stale) Mirror 12: 0x92dd7bf9 (stale) Mirror 14: 0x92dd7bf9 (stale) Mirror 16: 0x92dd7bf9 (stale) Mirror 17: 0x92dd7bf9 (stale) CRC-32 checksum value for chunk [0, 0x24b60): Mirror 1: 0xa28be22e Mirror 18: 0xa28be22e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24b60: skipped 000856 1789430177.300384 write 0x009728 thru 0x014ded (0xb6c6 bytes) 000857 1789430177.371674 mapwrite 0x030e72 thru 0x03238f (0x151e bytes) 000858 1789430177.437122 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32390): Mirror 4: 0x3de2d6c4 (stale) Mirror 10: 0x3de2d6c4 (stale) Mirror 11: 0x3de2d6c4 (stale) Mirror 12: 0x3de2d6c4 (stale) Mirror 14: 0x3de2d6c4 (stale) Mirror 16: 0x3de2d6c4 (stale) Mirror 17: 0x3de2d6c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32390): Mirror 4: 0x3de2d6c4 (stale) Mirror 10: 0x3de2d6c4 (stale) Mirror 11: 0x3de2d6c4 (stale) Mirror 12: 0x3de2d6c4 (stale) Mirror 14: 0x3de2d6c4 (stale) Mirror 16: 0x3de2d6c4 (stale) Mirror 17: 0x3de2d6c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32390: skipped 000859 1789430178.077777 trunc from 0x01e118 to 0x029b74 (0xba5d bytes) 000860 1789430178.082229 mapwrite 0x0188b8 thru 0x0221c3 (0x990c bytes) 000862 1789430178.131283 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x32390): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32390): Mirror 4: 0x3de2d6c4 (stale) Mirror 10: 0x3de2d6c4 (stale) Mirror 11: 0x3de2d6c4 (stale) Mirror 12: 0x3de2d6c4 (stale) Mirror 14: 0x3de2d6c4 (stale) Mirror 16: 0x3de2d6c4 (stale) Mirror 17: 0x3de2d6c4 (stale) CRC-32 checksum value for chunk [0, 0x32390): Mirror 1: 0xf1abf939 Mirror 18: 0xf1abf939 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32390: skipped 000863 1789430179.426980 MIRROR_RESYNC 9 mirrors 000864 1789430181.940578 mapread 0x00fa46 thru 0x01510b (0x56c6 bytes) 000865 1789430181.981361 MIRROR_RESYNC 9 mirrors 000866 1789430182.802482 read 0x014976 thru 0x01b68a (0x6d15 bytes) 000867 1789430182.816186 write 0x02220c thru 0x0315b0 (0xf3a5 bytes) 000868 1789430182.937862 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x32390): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32390): Mirror 4: 0xf1abf939 (stale) Mirror 10: 0xf1abf939 (stale) Mirror 11: 0xf1abf939 (stale) Mirror 12: 0xf1abf939 (stale) Mirror 14: 0xf1abf939 (stale) Mirror 16: 0xf1abf939 (stale) Mirror 17: 0xf1abf939 (stale) Mirror 18: 0xf1abf939 (stale) CRC-32 checksum value for chunk [0, 0x32390): Mirror 1: 0x9263798f Mirror 19: 0x9263798f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32390: skipped 000869 1789430184.645211 mapwrite 0x01fd1d thru 0x0267aa (0x6a8e bytes) 000870 1789430184.779279 trunc from 0x02f885 to 0x03238f (0x2b0b bytes) 000871 1789430184.788767 MIRROR_RESYNC 10 mirrors 000872 1789430187.596558 read 0x00977f thru 0x00d3f1 (0x3c73 bytes) 000873 1789430187.614420 punch from 0x011183 to 0x01eee8 (0xdd66 bytes) 000874 1789430187.675258 mapread 0x02d44e thru 0x03238f (0x4f42 bytes) 000875 1789430187.725590 mapread 0x00ed46 thru 0x0183cd (0x9688 bytes) 000876 1789430187.757924 fallocate 0x01ed1f thru 0x0210b3 (0x2395 bytes) 000877 1789430187.769867 fallocate 0x0279b0 thru 0x0296b5 (0x1d06 bytes) 000878 1789430187.775962 mapread 0x01af84 thru 0x029c4f (0xeccc bytes) 000879 1789430187.793460 fallocate 0x02d723 thru 0x0385c0 (0xae9e bytes) 000880 1789430187.801598 read 0x0020ba thru 0x010104 (0xe04b bytes) 000881 1789430187.829297 MIRROR_RESYNC 10 mirrors 000882 1789430190.712101 trunc from 0x032390 to 0x022a01 (0xf98e bytes) 000883 1789430190.779364 fallocate 0x00d1a0 thru 0x00e555 (0x13b6 bytes) 000884 1789430190.785054 trunc from 0x0008ce to 0x00339d (0x2ad0 bytes) 000885 1789430190.803468 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x22a02): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22a02): Mirror 4: 0x6c148a68 (stale) Mirror 10: 0x6c148a68 (stale) Mirror 11: 0x6c148a68 (stale) Mirror 12: 0x6c148a68 (stale) Mirror 14: 0x6c148a68 (stale) Mirror 16: 0x6c148a68 (stale) Mirror 17: 0x6c148a68 (stale) Mirror 18: 0x6c148a68 (stale) Mirror 19: 0x6c148a68 (stale) CRC-32 checksum value for chunk [0, 0x22a02): Mirror 1: 0x6cc1e8fd Mirror 20: 0x6cc1e8fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22a02: skipped 000886 1789430192.257468 mapread 0x006f1e thru 0x009641 (0x2724 bytes) 000887 1789430192.300277 fallocate 0x00bc2a thru 0x0141bf (0x8596 bytes) 000888 1789430192.357967 mapwrite 0x034a5c thru 0x03b4f5 (0x6a9a bytes) 000889 1789430192.461683 trunc from 0x03b4f6 to 0x003fc1 (0x37534 bytes) 000890 1789430192.487679 mapread 0x0022cd thru 0x003fc1 (0x1cf5 bytes) 000891 1789430192.496700 mapread 0x00170a thru 0x003fc1 (0x28b8 bytes) 000892 1789430192.509192 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3fc2): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fc2): Mirror 4: 0xbef65b61 (stale) Mirror 10: 0xbef65b61 (stale) Mirror 11: 0xbef65b61 (stale) Mirror 12: 0xbef65b61 (stale) Mirror 14: 0xbef65b61 (stale) Mirror 16: 0xbef65b61 (stale) Mirror 17: 0xbef65b61 (stale) Mirror 18: 0xbef65b61 (stale) Mirror 19: 0xbef65b61 (stale) Mirror 20: 0x43399d0d (stale) CRC-32 checksum value for chunk [0, 0x3fc2): Mirror 1: 0x43399d0d Mirror 21: 0x43399d0d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fc2: skipped 000893 1789430194.072517 read 0x0012f3 thru 0x0013fb (0x109 bytes) 000894 1789430194.092139 mapwrite 0x01ca4f thru 0x0207b0 (0x3d62 bytes) 000895 1789430194.227465 read 0x00b2b2 thru 0x01853a (0xd289 bytes) 000896 1789430194.242420 write 0x016d1d thru 0x01c87f (0x5b63 bytes) 000897 1789430194.246243 trunc from 0x0207b1 to 0x038afc (0x1834c bytes) 000898 1789430194.282378 MIRROR_RESYNC 12 mirrors 000899 1789430197.294676 mapwrite 0x0163fb thru 0x01ec92 (0x8898 bytes) 000900 1789430197.413665 MIRROR_SPLIT mirror 9 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38afd): Mirror 4: 0x6fe5e8 (stale) Mirror 10: 0x6fe5e8 (stale) Mirror 11: 0x6fe5e8 (stale) Mirror 12: 0x6fe5e8 (stale) Mirror 14: 0x6fe5e8 (stale) Mirror 16: 0x6fe5e8 (stale) Mirror 17: 0x6fe5e8 (stale) Mirror 18: 0x6fe5e8 (stale) Mirror 20: 0x6fe5e8 (stale) Mirror 21: 0x6fe5e8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38afd): Mirror 4: 0x6fe5e8 (stale) Mirror 10: 0x6fe5e8 (stale) Mirror 11: 0x6fe5e8 (stale) Mirror 12: 0x6fe5e8 (stale) Mirror 14: 0x6fe5e8 (stale) Mirror 16: 0x6fe5e8 (stale) Mirror 17: 0x6fe5e8 (stale) Mirror 18: 0x6fe5e8 (stale) Mirror 20: 0x6fe5e8 (stale) Mirror 21: 0x6fe5e8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38afd: skipped 000901 1789430198.304201 write 0x020e6e thru 0x02e4da (0xd66d bytes) 000902 1789430198.331029 mapwrite 0x03a371 thru 0x03ffff (0x5c8f bytes) 000903 1789430198.416073 read 0x01e8b9 thru 0x023786 (0x4ece bytes) 000904 1789430198.431786 mapread 0x0138ef thru 0x01e45d (0xab6f bytes) 000905 1789430198.452831 read 0x003a17 thru 0x006f19 (0x3503 bytes) 000906 1789430198.481136 MIRROR_RESYNC 11 mirrors 000907 1789430201.263042 mapwrite 0x029ab7 thru 0x03667f (0xcbc9 bytes) 000908 1789430201.420406 read 0x01f75d thru 0x02dd4e (0xe5f2 bytes) 000909 1789430201.428115 trunc from 0x00e158 to 0x019579 (0xb422 bytes) 000910 1789430201.439082 trunc from 0x040000 to 0x038263 (0x7d9c bytes) 000912 1789430201.486835 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38264): Mirror 4: 0xaac5c380 (stale) Mirror 11: 0xaac5c380 (stale) Mirror 12: 0xaac5c380 (stale) Mirror 14: 0xaac5c380 (stale) Mirror 16: 0xaac5c380 (stale) Mirror 17: 0xaac5c380 (stale) Mirror 18: 0xaac5c380 (stale) Mirror 20: 0xaac5c380 (stale) Mirror 21: 0xaac5c380 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38264): Mirror 4: 0xaac5c380 (stale) Mirror 11: 0xaac5c380 (stale) Mirror 12: 0xaac5c380 (stale) Mirror 14: 0xaac5c380 (stale) Mirror 16: 0xaac5c380 (stale) Mirror 17: 0xaac5c380 (stale) Mirror 18: 0xaac5c380 (stale) Mirror 20: 0xaac5c380 (stale) Mirror 21: 0xaac5c380 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38264: skipped 000913 1789430202.331836 punch from 0x0374f3 to 0x038263 (0xd71 bytes) 000914 1789430202.339258 punch from 0x012707 to 0x01b19e (0x8a98 bytes) 000915 1789430202.344731 write 0x03f2dd thru 0x03f8bd (0x5e1 bytes) 000916 1789430202.351185 punch from 0x00ba81 to 0x015274 (0x97f4 bytes) 000917 1789430202.358643 mapwrite 0x00998c thru 0x0172f5 (0xd96a bytes) 000918 1789430202.448299 mapwrite 0x007e46 thru 0x009fe9 (0x21a4 bytes) 000919 1789430202.465054 trunc from 0x021a9f to 0x027371 (0x58d3 bytes) 000920 1789430202.470874 read 0x039e3c thru 0x03adce (0xf93 bytes) 000922 1789430202.478758 trunc from 0x03f8be to 0x022137 (0x1d786 bytes) 000923 1789430202.502081 punch from 0x004809 to 0x0048fa (0xf2 bytes) 000924 1789430202.509350 write 0x00e115 thru 0x00eb9d (0xa89 bytes) 000925 1789430202.512113 write 0x00a347 thru 0x017437 (0xd0f1 bytes) 000927 1789430202.517631 fallocate 0x03c446 thru 0x03ffff (0x3bba bytes) 000928 1789430202.529828 write 0x03c1c9 thru 0x03dc27 (0x1a5f bytes) 000929 1789430202.534246 read 0x016437 thru 0x01fbc3 (0x978d bytes) 000930 1789430202.557332 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dc28): Mirror 4: 0xae672f7e (stale) Mirror 11: 0xae672f7e (stale) Mirror 12: 0xae672f7e (stale) Mirror 14: 0xae672f7e (stale) Mirror 16: 0xae672f7e (stale) Mirror 17: 0xae672f7e (stale) Mirror 18: 0xae672f7e (stale) Mirror 20: 0xae672f7e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc28): Mirror 4: 0xae672f7e (stale) Mirror 11: 0xae672f7e (stale) Mirror 12: 0xae672f7e (stale) Mirror 14: 0xae672f7e (stale) Mirror 16: 0xae672f7e (stale) Mirror 17: 0xae672f7e (stale) Mirror 18: 0xae672f7e (stale) Mirror 20: 0xae672f7e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc28: skipped 000931 1789430203.265089 fallocate 0x03c896 thru 0x03ffff (0x376a bytes) 000932 1789430203.282856 mapread 0x035338 thru 0x036ac0 (0x1789 bytes) 000933 1789430203.321134 punch from 0x03cd96 to 0x03df87 (0x11f2 bytes) 000934 1789430203.334186 trunc from 0x040000 to 0x00cf9e (0x33061 bytes) 000935 1789430203.380807 trunc from 0x00cf9f to 0x01426b (0x72cd bytes) 000936 1789430203.416146 mapread 0x0073cf thru 0x00c58a (0x51bc bytes) 000937 1789430203.425628 fallocate 0x037c27 thru 0x038001 (0x3db bytes) 000938 1789430203.437977 trunc from 0x009b81 to 0x0104e3 (0x6963 bytes) 000939 1789430203.453960 trunc from 0x012b77 to 0x01426b (0x16f5 bytes) 000940 1789430203.460535 punch from 0x00cc68 to 0x01318a (0x6523 bytes) 000941 1789430203.466536 mapread 0x00a29a thru 0x01426b (0x9fd2 bytes) 000942 1789430203.479268 mapread 0x01387e thru 0x01426b (0x9ee bytes) 000944 1789430203.481399 mapread 0x000479 thru 0x008931 (0x84b9 bytes) 000945 1789430203.493490 trunc from 0x01426c to 0x02484c (0x105e1 bytes) 000947 1789430203.513106 mapread 0x0070d8 thru 0x00a499 (0x33c2 bytes) 000948 1789430203.514169 fallocate 0x023cbf thru 0x02c00c (0x834e bytes) 000949 1789430203.538734 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c00d): Mirror 4: 0xa48113f6 (stale) Mirror 11: 0xa48113f6 (stale) Mirror 14: 0xa48113f6 (stale) Mirror 16: 0xa48113f6 (stale) Mirror 17: 0xa48113f6 (stale) Mirror 18: 0xa48113f6 (stale) Mirror 20: 0xa48113f6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c00d): Mirror 4: 0xa48113f6 (stale) Mirror 11: 0xa48113f6 (stale) Mirror 14: 0xa48113f6 (stale) Mirror 16: 0xa48113f6 (stale) Mirror 17: 0xa48113f6 (stale) Mirror 18: 0xa48113f6 (stale) Mirror 20: 0xa48113f6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c00d: skipped 000950 1789430204.152945 trunc from 0x02c00d to 0x0005b8 (0x2ba54 bytes) 000951 1789430204.181564 fallocate 0x0142da thru 0x01e7b1 (0xa4d8 bytes) 000952 1789430204.188573 mapread 0x00051f thru 0x0005b8 (0x9a bytes) 000953 1789430204.196159 write 0x013efd thru 0x01a617 (0x671b bytes) 000954 1789430204.198140 fallocate 0x0229a6 thru 0x027bed (0x5248 bytes) 000955 1789430204.204033 read 0x00dd90 thru 0x01a617 (0xc888 bytes) 000956 1789430204.214241 trunc from 0x01a618 to 0x00ed61 (0xb8b6 bytes) 000957 1789430204.235389 mapread 0x00a773 thru 0x00e7ba (0x4048 bytes) 000958 1789430204.259432 punch from 0x007070 to 0x00ed61 (0x7cf2 bytes) 000960 1789430204.264457 punch from 0x00439d to 0x00e193 (0x9df7 bytes) 000961 1789430204.271490 mapwrite 0x03e74b thru 0x03ffff (0x18b5 bytes) 000962 1789430204.319694 fallocate 0x029a5b thru 0x02bc7c (0x2222 bytes) 000964 1789430204.329095 fallocate 0x02fe1c thru 0x03d0e6 (0xd2cb bytes) 000965 1789430204.340339 punch from 0x022c30 to 0x02e55c (0xb92d bytes) 000966 1789430204.346170 write 0x003a5c thru 0x012181 (0xe726 bytes) 000967 1789430204.358570 read 0x033675 thru 0x03ffff (0xc98b bytes) 000968 1789430204.372097 trunc from 0x038b4f to 0x03ffff (0x74b1 bytes) 000969 1789430204.378343 punch from 0x03c32d to 0x03ffff (0x3cd3 bytes) 000971 1789430204.385666 fallocate 0x019839 thru 0x0266e5 (0xcead bytes) 000972 1789430204.391040 write 0x00c54e thru 0x01bec2 (0xf975 bytes) 000973 1789430204.392817 trunc from 0x040000 to 0x002cb3 (0x3d34c bytes) 000974 1789430204.418282 read 0x0005e0 thru 0x002cb3 (0x26d4 bytes) 000975 1789430204.421272 punch from 0x000756 to 0x002cb3 (0x255e bytes) 000976 1789430204.426300 trunc from 0x002cb4 to 0x01b537 (0x18884 bytes) 000977 1789430204.442966 punch from 0x00036e to 0x0081b3 (0x7e46 bytes) 000978 1789430204.455103 mapwrite 0x012672 thru 0x01be19 (0x97a8 bytes) 000979 1789430204.507612 write 0x02d55c thru 0x03453b (0x6fe0 bytes) 000980 1789430204.509201 fallocate 0x03a496 thru 0x03ffff (0x5b6a bytes) 000981 1789430204.515333 fallocate 0x037a35 thru 0x03ab51 (0x311d bytes) 000982 1789430204.520783 fallocate 0x020552 thru 0x027c8b (0x773a bytes) 000983 1789430204.535262 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xed8e4e35 (stale) Mirror 11: 0xed8e4e35 (stale) Mirror 14: 0xed8e4e35 (stale) Mirror 16: 0xed8e4e35 (stale) Mirror 17: 0xed8e4e35 (stale) Mirror 20: 0xed8e4e35 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xed8e4e35 (stale) Mirror 11: 0xed8e4e35 (stale) Mirror 14: 0xed8e4e35 (stale) Mirror 16: 0xed8e4e35 (stale) Mirror 17: 0xed8e4e35 (stale) Mirror 20: 0xed8e4e35 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000984 1789430205.206492 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xed8e4e35 (stale) Mirror 14: 0xed8e4e35 (stale) Mirror 16: 0xed8e4e35 (stale) Mirror 17: 0xed8e4e35 (stale) Mirror 20: 0xed8e4e35 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xed8e4e35 (stale) Mirror 14: 0xed8e4e35 (stale) Mirror 16: 0xed8e4e35 (stale) Mirror 17: 0xed8e4e35 (stale) Mirror 20: 0xed8e4e35 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000985 1789430205.738716 MIRROR_RESYNC 6 mirrors 000986 1789430207.465692 read 0x00ca6c thru 0x015445 (0x89da bytes) 000987 1789430207.478742 write 0x03f2b7 thru 0x03ffff (0xd49 bytes) 000988 1789430207.527845 read 0x0184e1 thru 0x02525c (0xcd7c bytes) 000989 1789430207.542556 read 0x004a94 thru 0x010db9 (0xc326 bytes) 000990 1789430207.543832 fallocate 0x03dcea thru 0x03ffff (0x2316 bytes) 000991 1789430207.552978 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x56c6a79e (stale) Mirror 16: 0x56c6a79e (stale) Mirror 17: 0x56c6a79e (stale) Mirror 20: 0x56c6a79e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x56c6a79e (stale) Mirror 16: 0x56c6a79e (stale) Mirror 17: 0x56c6a79e (stale) Mirror 20: 0x56c6a79e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000992 1789430208.091923 mapread 0x039e88 thru 0x03ffff (0x6178 bytes) 000994 1789430208.122490 fallocate 0x011842 thru 0x01d5a7 (0xbd66 bytes) 000995 1789430208.130191 punch from 0x006b72 to 0x0091be (0x264d bytes) 000997 1789430208.141738 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x56c6a79e (stale) Mirror 17: 0x56c6a79e (stale) Mirror 20: 0x56c6a79e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x56c6a79e (stale) Mirror 17: 0x56c6a79e (stale) Mirror 20: 0x56c6a79e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000998 1789430208.490915 trunc from 0x01fcd2 to 0x023c09 (0x3f38 bytes) 000999 1789430208.496869 read 0x01b548 thru 0x01ff50 (0x4a09 bytes) 001000 1789430208.507778 mapwrite 0x007d24 thru 0x008902 (0xbdf bytes) All operations completed A-OK!