== sanity-flr test 70a: flr mode fsx test ================ 13:02:22 (1772906542) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 6543 000001 1772906543.289191 mapwrite 0x035fc9 thru 0x037d68 (0x1da0 bytes) zero_range to largest ever: 0x319b0 000002 1772906543.303129 trunc from 0x024959 to 0x0319af (0xd057 bytes) 000004 1772906543.305467 trunc from 0x037d69 to 0x00bd53 (0x2c015 bytes) 000005 1772906543.309774 write 0x000645 thru 0x002c07 (0x25c3 bytes) 000006 1772906543.312927 trunc from 0x00557e to 0x00bd53 (0x67d6 bytes) 000007 1772906543.314788 fallocate 0x006ff3 thru 0x00db9c (0x6baa bytes) 000008 1772906543.316780 mapread 0x00d982 thru 0x00db9c (0x21b bytes) 000009 1772906543.321439 MIRROR_EXTEND to 2 mirrors 000010 1772906543.455824 read 0x002cdf thru 0x00d555 (0xa877 bytes) 000011 1772906543.458133 mapwrite 0x03e665 thru 0x03ffff (0x199b bytes) 000012 1772906543.478603 fallocate 0x008ded thru 0x00dfdc (0x51f0 bytes) 000013 1772906543.480142 fallocate 0x005b8e thru 0x007d3c (0x21af bytes) 000014 1772906543.481648 read 0x01b1c6 thru 0x02391d (0x8758 bytes) 000015 1772906543.485385 mapwrite 0x00a925 thru 0x00d61f (0x2cfb bytes) 000016 1772906543.489747 mapread 0x005948 thru 0x008145 (0x27fe bytes) 000017 1772906543.490506 mapread 0x032d4a thru 0x03c571 (0x9828 bytes) 000018 1772906543.491139 fallocate 0x019c3c thru 0x01e14e (0x4513 bytes) 000019 1772906543.494011 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) 000020 1772906543.525553 read 0x024418 thru 0x0259a7 (0x1590 bytes) 000021 1772906543.527279 read 0x000354 thru 0x002976 (0x2623 bytes) 000022 1772906543.530399 mapread 0x0374b3 thru 0x03ffff (0x8b4d bytes) 000023 1772906543.531196 read 0x031b8c thru 0x03c922 (0xad97 bytes) 000024 1772906543.531672 trunc from 0x040000 to 0x01a68f (0x25970 bytes) 000025 1772906543.536535 fallocate 0x0215d2 thru 0x029195 (0x7bc4 bytes) 000026 1772906543.538301 fallocate 0x004d1b thru 0x00dde1 (0x90c7 bytes) 000027 1772906543.539915 mapwrite 0x010aff thru 0x011961 (0xe63 bytes) fallocating to largest ever: 0x3a4c0 000028 1772906543.544168 fallocate 0x02e5ed thru 0x03a4bf (0xbed3 bytes) 000029 1772906543.545866 trunc from 0x029196 to 0x0267a8 (0x29ed bytes) 000030 1772906543.549857 write 0x02c482 thru 0x0354c9 (0x9048 bytes) 000031 1772906543.550892 punch from 0x00d3ed to 0x011c65 (0x4879 bytes) 000032 1772906543.552518 trunc from 0x017fc8 to 0x027e9a (0xfed3 bytes) 000033 1772906543.553911 punch from 0x032729 to 0x0354c9 (0x2da1 bytes) 000035 1772906543.557709 punch from 0x030881 to 0x0354c9 (0x4c49 bytes) 000038 1772906543.560199 trunc from 0x02dfd9 to 0x0354c9 (0x74f1 bytes) 000039 1772906543.561682 read 0x01041c thru 0x011cbf (0x18a4 bytes) 000040 1772906543.564490 mapread 0x029000 thru 0x03447f (0xb480 bytes) 000042 1772906543.565582 mapwrite 0x03bbb3 thru 0x03ffff (0x444d bytes) 000043 1772906543.575589 read 0x0313c3 thru 0x03eab4 (0xd6f2 bytes) 000044 1772906543.576104 punch from 0x02c48c to 0x03199c (0x5511 bytes) 000045 1772906543.577773 punch from 0x01015f to 0x01b664 (0xb506 bytes) 000046 1772906543.579164 mapread 0x01b671 thru 0x01cd57 (0x16e7 bytes) 000048 1772906543.582364 fallocate 0x029be8 thru 0x03907d (0xf496 bytes) 000049 1772906543.584194 write 0x00b5d4 thru 0x00e196 (0x2bc3 bytes) 000051 1772906543.585508 punch from 0x0179ec to 0x01e761 (0x6d76 bytes) 000052 1772906543.587124 trunc from 0x022643 to 0x02adc8 (0x8786 bytes) 000053 1772906543.588764 write 0x023263 thru 0x0325d6 (0xf374 bytes) 000054 1772906543.590802 fallocate 0x01271c thru 0x020dab (0xe690 bytes) 000055 1772906543.592526 punch from 0x025511 to 0x0330e5 (0xdbd5 bytes) 000056 1772906543.596695 fallocate 0x01fa19 thru 0x028377 (0x895f bytes) 000057 1772906543.598449 mapwrite 0x02d267 thru 0x039c7f (0xca19 bytes) 000058 1772906543.613103 mapwrite 0x0072f9 thru 0x01619f (0xeea7 bytes) 000059 1772906543.619996 write 0x0301d7 thru 0x03d2e6 (0xd110 bytes) 000060 1772906543.622769 MIRROR_EXTEND to 2 mirrors 000061 1772906543.778672 trunc from 0x0219ce to 0x02b5ec (0x9c1f bytes) 000062 1772906543.788885 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) 000063 1772906543.822668 fallocate 0x02c7ce thru 0x03931a (0xcb4d bytes) 000065 1772906543.825095 mapread 0x00b537 thru 0x00e4b6 (0x2f80 bytes) 000066 1772906543.830194 write 0x00b5bb thru 0x00b870 (0x2b6 bytes) 000067 1772906543.831953 write 0x02a623 thru 0x034a7a (0xa458 bytes) 000068 1772906543.836098 trunc from 0x02273a to 0x0273f1 (0x4cb8 bytes) 000069 1772906543.837576 mapread 0x03cd39 thru 0x03ffff (0x32c7 bytes) 000070 1772906543.840092 read 0x02e929 thru 0x03390f (0x4fe7 bytes) 000072 1772906543.841161 mapread 0x011a14 thru 0x01849d (0x6a8a bytes) 000073 1772906543.843653 mapread 0x00bf6c thru 0x017536 (0xb5cb bytes) 000074 1772906543.844379 fallocate 0x0013a0 thru 0x00fbdf (0xe840 bytes) 000076 1772906543.846115 write 0x031ee6 thru 0x038599 (0x66b4 bytes) 000077 1772906543.846830 mapread 0x01c43d thru 0x027219 (0xaddd bytes) 000078 1772906543.849751 mapread 0x026468 thru 0x035f77 (0xfb10 bytes) 000079 1772906543.851016 trunc from 0x040000 to 0x006e6f (0x39190 bytes) 000080 1772906543.859725 mapwrite 0x00a915 thru 0x00b2bf (0x9ab bytes) fallocating to largest ever: 0x40000 000081 1772906543.868888 fallocate 0x03e8f2 thru 0x03ffff (0x170e bytes) 000082 1772906543.870664 trunc from 0x040000 to 0x019156 (0x26ea9 bytes) 000083 1772906543.874262 read 0x0062eb thru 0x013db1 (0xdac7 bytes) 000084 1772906543.876801 trunc from 0x019157 to 0x0308da (0x17784 bytes) 000085 1772906543.880001 punch from 0x01bae7 to 0x0242f0 (0x880a bytes) 000086 1772906543.881411 mapread 0x019362 thru 0x02649a (0xd139 bytes) 000087 1772906543.884383 punch from 0x00444c to 0x006407 (0x1fbc bytes) 000089 1772906543.886337 punch from 0x027f20 to 0x0308da (0x89bb bytes) 000092 1772906543.888318 punch from 0x01619b to 0x0164dc (0x342 bytes) 000093 1772906543.889616 mapwrite 0x018c68 thru 0x01d15a (0x44f3 bytes) 000094 1772906543.895480 MIRROR_EXTEND to 2 mirrors 000095 1772906544.045403 MIRROR_EXTEND to 3 mirrors 000096 1772906544.206627 write 0x0092e7 thru 0x00ea8d (0x57a7 bytes) 000098 1772906544.217655 MIRROR_RESYNC 3 mirrors 000099 1772906544.413880 trunc from 0x00b7f1 to 0x011656 (0x5e66 bytes) 000100 1772906544.421961 trunc from 0x02c17f to 0x030802 (0x4684 bytes) 000101 1772906544.423376 trunc from 0x0308db to 0x01dd49 (0x12b91 bytes) 000102 1772906544.428108 mapread 0x00d479 thru 0x011378 (0x3f00 bytes) 000103 1772906544.434631 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1dd4a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1dd4a): Mirror 2: 0xd550b4f1 (stale) Mirror 3: 0xd550b4f1 (stale) CRC-32 checksum value for chunk [0, 0x1dd4a): Mirror 1: 0x33512c0d Mirror 4: 0x33512c0d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1dd4a: skipped 000104 1772906544.615688 read 0x008576 thru 0x01317d (0xac08 bytes) 000105 1772906544.619262 mapread 0x01b47f thru 0x01dd49 (0x28cb bytes) 000106 1772906544.627099 fallocate 0x0235ba thru 0x02fffb (0xca42 bytes) 000107 1772906544.635778 mapwrite 0x0372a5 thru 0x03ffff (0x8d5b bytes) 000108 1772906544.652692 read 0x001dcc thru 0x008ff9 (0x722e bytes) 000109 1772906544.655773 read 0x035f4f thru 0x03f876 (0x9928 bytes) 000110 1772906544.656308 punch from 0x03adec to 0x03bbc2 (0xdd7 bytes) 000111 1772906544.657807 mapread 0x00d131 thru 0x00e600 (0x14d0 bytes) 000113 1772906544.658742 write 0x010152 thru 0x012b7b (0x2a2a bytes) 000115 1772906544.659737 trunc from 0x040000 to 0x00d7f3 (0x3280c bytes) 000117 1772906544.664772 write 0x0241bf thru 0x02869c (0x44de bytes) 000119 1772906544.666055 write 0x02e88e thru 0x039127 (0xa89a bytes) 000120 1772906544.666919 fallocate 0x03e650 thru 0x03ffff (0x19b0 bytes) 000122 1772906544.668997 write 0x031bc8 thru 0x037ab1 (0x5eea bytes) 000123 1772906544.669688 read 0x02a559 thru 0x036146 (0xbbee bytes) 000124 1772906544.672551 write 0x02f391 thru 0x03a263 (0xaed3 bytes) 000125 1772906544.673313 punch from 0x03c772 to 0x03ffff (0x388e bytes) 000126 1772906544.674741 fallocate 0x01f4f5 thru 0x02a835 (0xb341 bytes) 000127 1772906544.676369 write 0x022672 thru 0x02d402 (0xad91 bytes) 000128 1772906544.677371 write 0x002dd1 thru 0x00ab77 (0x7da7 bytes) 000129 1772906544.678281 mapread 0x015cf7 thru 0x0248d8 (0xebe2 bytes) 000130 1772906544.679250 punch from 0x03919c to 0x03ffff (0x6e64 bytes) 000131 1772906544.685832 read 0x010e02 thru 0x01f9c3 (0xebc2 bytes) 000132 1772906544.686282 trunc from 0x040000 to 0x01f030 (0x20fcf bytes) 000133 1772906544.690466 write 0x003faa thru 0x011a54 (0xdaab bytes) 000134 1772906544.691354 write 0x024422 thru 0x0300f1 (0xbcd0 bytes) 000135 1772906544.692199 trunc from 0x0300f2 to 0x00c7b5 (0x2393c bytes) 000136 1772906544.695896 fallocate 0x02f0d9 thru 0x03b523 (0xc44b bytes) 000137 1772906544.697330 read 0x00265f thru 0x009c8e (0x7630 bytes) 000138 1772906544.698732 MIRROR_RESYNC 4 mirrors 000139 1772906544.840981 trunc from 0x003ff6 to 0x00c7b5 (0x87c0 bytes) 000140 1772906544.848596 trunc from 0x00315b to 0x00c7b5 (0x965b bytes) 000141 1772906544.849939 trunc from 0x008ca5 to 0x008d44 (0xa0 bytes) 000142 1772906544.851251 trunc from 0x00ae9b to 0x00c7b5 (0x191b bytes) 000143 1772906544.852706 fallocate 0x01a0f1 thru 0x01f2d6 (0x51e6 bytes) 000144 1772906544.855389 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xc7b6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc7b6): Mirror 2: 0x6333c2f0 (stale) Mirror 3: 0x6333c2f0 (stale) Mirror 4: 0x6333c2f0 (stale) CRC-32 checksum value for chunk [0, 0xc7b6): Mirror 1: 0x35aca3a4 Mirror 5: 0x35aca3a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc7b6: skipped 000145 1772906545.028044 punch from 0x00664f to 0x009f91 (0x3943 bytes) 000146 1772906545.037869 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xc7b6): Mirror 2: 0x6333c2f0 (stale) Mirror 3: 0x6333c2f0 (stale) Mirror 5: 0x35aca3a4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc7b6): Mirror 2: 0x6333c2f0 (stale) Mirror 3: 0x6333c2f0 (stale) Mirror 5: 0x35aca3a4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc7b6: skipped 000147 1772906545.103138 trunc from 0x007981 to 0x008cc5 (0x1345 bytes) 000149 1772906545.105404 mapwrite 0x0194fd thru 0x01a263 (0xd67 bytes) 000150 1772906545.119010 fallocate 0x02b65c thru 0x03082f (0x51d4 bytes) 000151 1772906545.120471 punch from 0x000a4a to 0x00f8cd (0xee84 bytes) 000153 1772906545.122142 punch from 0x00f40d to 0x01c6c2 (0xd2b6 bytes) 000154 1772906545.123487 write 0x038b70 thru 0x03ffff (0x7490 bytes) 000155 1772906545.125371 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe14d9975 (stale) Mirror 5: 0xbe75819c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe14d9975 (stale) Mirror 5: 0xbe75819c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000156 1772906545.191117 punch from 0x02e814 to 0x03b0b8 (0xc8a5 bytes) 000157 1772906545.192658 write 0x037a4c thru 0x03ffff (0x85b4 bytes) 000158 1772906545.196579 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbe75819c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbe75819c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000159 1772906545.253680 read 0x02df99 thru 0x033f6d (0x5fd5 bytes) 000160 1772906545.255863 trunc from 0x0326a7 to 0x03ffff (0xd959 bytes) 000162 1772906545.257718 punch from 0x03aff5 to 0x03ffff (0x500b bytes) 000163 1772906545.258991 read 0x006c0c thru 0x007e05 (0x11fa bytes) 000164 1772906545.261919 punch from 0x02ae97 to 0x02b6b3 (0x81d bytes) 000165 1772906545.263162 read 0x0292e8 thru 0x02b415 (0x212e bytes) 000166 1772906545.266316 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) 000167 1772906545.292248 write 0x015519 thru 0x021eec (0xc9d4 bytes) 000168 1772906545.296652 MIRROR_EXTEND to 2 mirrors 000169 1772906545.435517 trunc from 0x0263e3 to 0x030519 (0xa137 bytes) 000170 1772906545.444904 read 0x0344b4 thru 0x03b752 (0x729f bytes) 000171 1772906545.446856 mapread 0x01877f thru 0x01ffbd (0x783f bytes) 000172 1772906545.451117 fallocate 0x017c2d thru 0x02117d (0x9551 bytes) 000173 1772906545.452620 mapwrite 0x029efc thru 0x03875c (0xe861 bytes) 000174 1772906545.462075 mapwrite 0x011177 thru 0x01cc2a (0xbab4 bytes) 000175 1772906545.469718 trunc from 0x0388dd to 0x03ffff (0x7723 bytes) 000176 1772906545.471183 read 0x023422 thru 0x031161 (0xdd40 bytes) 000177 1772906545.471625 mapread 0x029fab thru 0x02ce82 (0x2ed8 bytes) 000178 1772906545.472148 fallocate 0x0202e9 thru 0x025409 (0x5121 bytes) 000180 1772906545.474011 write 0x009fbc thru 0x0115a5 (0x75ea bytes) 000181 1772906545.478105 trunc from 0x026369 to 0x028691 (0x2329 bytes) 000183 1772906545.480779 mapwrite 0x03449f thru 0x03ffff (0xbb61 bytes) 000184 1772906545.489211 mapwrite 0x0167e0 thru 0x01d4ea (0x6d0b bytes) 000185 1772906545.495940 mapwrite 0x03044d thru 0x03065b (0x20f bytes) 000186 1772906545.500461 trunc from 0x009f02 to 0x00bbde (0x1cdd bytes) 000187 1772906545.502459 trunc from 0x040000 to 0x01a622 (0x259dd bytes) 000188 1772906545.512933 mapwrite 0x03d465 thru 0x03ffff (0x2b9b bytes) 000189 1772906545.525089 trunc from 0x040000 to 0x021e82 (0x1e17d bytes) 000190 1772906545.529613 fallocate 0x002fd6 thru 0x0031ea (0x215 bytes) 000191 1772906545.531375 read 0x01d21e thru 0x01dfab (0xd8e bytes) 000192 1772906545.533893 trunc from 0x02111b to 0x021e82 (0xd68 bytes) 000193 1772906545.535704 trunc from 0x00f673 to 0x01ccee (0xd67c bytes) 000195 1772906545.537945 write 0x03ece5 thru 0x03ffff (0x131b bytes) 000196 1772906545.538678 punch from 0x00491d to 0x013b12 (0xf1f6 bytes) 000197 1772906545.541634 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) 000198 1772906545.577857 trunc from 0x016253 to 0x01db3a (0x78e8 bytes) 000199 1772906545.579662 trunc from 0x040000 to 0x030e6c (0xf193 bytes) 000200 1772906545.584650 fallocate 0x010c95 thru 0x01d112 (0xc47e bytes) 000201 1772906545.586448 punch from 0x011748 to 0x017bcf (0x6488 bytes) 000202 1772906545.588129 write 0x0300b4 thru 0x03e79b (0xe6e8 bytes) 000203 1772906545.590460 mapwrite 0x03c178 thru 0x03eda5 (0x2c2e bytes) 000204 1772906545.599862 punch from 0x01c8fc to 0x023ea3 (0x75a8 bytes) 000205 1772906545.601726 mapread 0x02bd0c thru 0x03458f (0x8884 bytes) 000206 1772906545.606601 mapwrite 0x02a1de thru 0x03145b (0x727e bytes) 000207 1772906545.613874 write 0x01b821 thru 0x027b83 (0xc363 bytes) 000208 1772906545.617426 punch from 0x019bf9 to 0x01aa51 (0xe59 bytes) 000209 1772906545.619069 trunc from 0x028730 to 0x037ef0 (0xf7c1 bytes) 000210 1772906545.622409 MIRROR_EXTEND to 2 mirrors 000211 1772906545.783375 write 0x00e43e thru 0x010d65 (0x2928 bytes) 000212 1772906545.796148 read 0x0175ab thru 0x018211 (0xc67 bytes) 000213 1772906545.797990 write 0x0250c5 thru 0x02bec5 (0x6e01 bytes) 000214 1772906545.801120 mapread 0x033fe7 thru 0x03e1c6 (0xa1e0 bytes) 000215 1772906545.805626 mapwrite 0x018cae thru 0x01a0c4 (0x1417 bytes) 000216 1772906545.813902 write 0x03e837 thru 0x03ea67 (0x231 bytes) 000217 1772906545.814744 trunc from 0x034e3b to 0x0385ec (0x37b2 bytes) 000218 1772906545.816806 fallocate 0x02d259 thru 0x034072 (0x6e1a bytes) 000219 1772906545.818773 fallocate 0x01a457 thru 0x023d58 (0x9902 bytes) 000221 1772906545.821007 mapread 0x02c7a3 thru 0x0338c3 (0x7121 bytes) 000222 1772906545.823570 MIRROR_RESYNC 2 mirrors 000223 1772906546.033082 trunc from 0x0086f7 to 0x01491b (0xc225 bytes) 000224 1772906546.044523 mapread 0x0319da thru 0x039f58 (0x857f bytes) 000225 1772906546.051143 mapwrite 0x0113f4 thru 0x01a4b4 (0x90c1 bytes) 000226 1772906546.063087 mapwrite 0x00f5b6 thru 0x01e7bb (0xf206 bytes) 000227 1772906546.071569 punch from 0x0134b0 to 0x015e2a (0x297b bytes) 000228 1772906546.073455 mapread 0x01b2ca thru 0x01bd68 (0xa9f bytes) 000229 1772906546.074193 trunc from 0x019040 to 0x01d378 (0x4339 bytes) 000230 1772906546.077695 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) 000231 1772906546.117828 punch from 0x00fdc8 to 0x017e18 (0x8051 bytes) 000232 1772906546.120180 trunc from 0x03eda6 to 0x039f85 (0x4e20 bytes) 000233 1772906546.130529 read 0x02e366 thru 0x0371a0 (0x8e3b bytes) 000234 1772906546.133375 punch from 0x0283b5 to 0x02e396 (0x5fe2 bytes) 000235 1772906546.135273 trunc from 0x039f86 to 0x034bb9 (0x53cc bytes) 000236 1772906546.139949 mapwrite 0x006e3a thru 0x012a05 (0xbbcc bytes) 000237 1772906546.155838 mapwrite 0x03c4ea thru 0x03ffff (0x3b16 bytes) 000238 1772906546.169795 MIRROR_EXTEND to 2 mirrors 000239 1772906546.393680 MIRROR_EXTEND to 3 mirrors 000240 1772906546.586834 read 0x01c752 thru 0x025839 (0x90e8 bytes) 000241 1772906546.590695 MIRROR_EXTEND to 4 mirrors 000243 1772906546.781257 mapwrite 0x004fba thru 0x00733e (0x2385 bytes) 000244 1772906546.815819 mapread 0x0339b4 thru 0x035819 (0x1e66 bytes) 000245 1772906546.818952 trunc from 0x03a84e to 0x03ffff (0x57b2 bytes) 000246 1772906546.820786 trunc from 0x040000 to 0x007406 (0x38bf9 bytes) 000247 1772906546.832568 trunc from 0x0028a7 to 0x004349 (0x1aa3 bytes) 000248 1772906546.834285 trunc from 0x0027c1 to 0x0068b5 (0x40f5 bytes) 000249 1772906546.836257 write 0x00c1f9 thru 0x0109f1 (0x47f9 bytes) 000250 1772906546.837027 write 0x00618a thru 0x012e9f (0xcd16 bytes) 000251 1772906546.840054 mapwrite 0x03893b thru 0x03ffff (0x76c5 bytes) 000252 1772906546.852462 punch from 0x014f68 to 0x01b3fe (0x6497 bytes) 000253 1772906546.854104 trunc from 0x040000 to 0x006911 (0x396ee bytes) 000254 1772906546.858618 punch from 0x0058ab to 0x006911 (0x1067 bytes) 000255 1772906546.860332 punch from 0x005895 to 0x006911 (0x107d bytes) 000256 1772906546.861881 trunc from 0x005261 to 0x006911 (0x16b1 bytes) 000258 1772906546.864140 write 0x01b565 thru 0x01c50a (0xfa6 bytes) 000259 1772906546.865081 punch from 0x015441 to 0x01c50a (0x70ca bytes) 000260 1772906546.868360 mapwrite 0x02ef98 thru 0x036cf4 (0x7d5d bytes) 000261 1772906546.881117 mapwrite 0x02f73b thru 0x03a5f9 (0xaebf bytes) 000262 1772906546.893386 trunc from 0x03a5fa to 0x02aa60 (0xfb99 bytes) 000263 1772906546.897955 mapwrite 0x02137f thru 0x02353b (0x21bd bytes) 000264 1772906546.905275 mapwrite 0x002f69 thru 0x007e13 (0x4eab bytes) 000266 1772906546.913781 punch from 0x015ec1 to 0x022c9e (0xcdde bytes) 000268 1772906546.915908 trunc from 0x02aa61 to 0x012af2 (0x17f6e bytes) 000270 1772906546.920422 write 0x038888 thru 0x038aec (0x265 bytes) 000271 1772906546.921138 punch from 0x019d68 to 0x01e33d (0x45d6 bytes) 000272 1772906546.922704 write 0x038757 thru 0x03ffff (0x78a9 bytes) 000275 1772906546.925275 punch from 0x035573 to 0x03c73f (0x71cd bytes) 000276 1772906546.929239 write 0x003734 thru 0x00a75e (0x702b bytes) 000277 1772906546.930061 mapread 0x027733 thru 0x031fad (0xa87b bytes) 000278 1772906546.935004 write 0x02b5ec thru 0x02c3e8 (0xdfd bytes) 000279 1772906546.937002 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb843879c (stale) Mirror 3: 0xb843879c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb843879c (stale) Mirror 3: 0xb843879c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000281 1772906547.021889 mapwrite 0x034d6a thru 0x03ffff (0xb296 bytes) 000282 1772906547.035715 trunc from 0x040000 to 0x026c09 (0x193f6 bytes) 000284 1772906547.041972 write 0x033027 thru 0x03ffff (0xcfd9 bytes) 000285 1772906547.044603 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb843879c (stale) Mirror 3: 0xb843879c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb23dd259 Mirror 4: 0xb23dd259 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000286 1772906547.290594 read 0x01b42c thru 0x029cb3 (0xe888 bytes) 000287 1772906547.296083 MIRROR_RESYNC 4 mirrors 000288 1772906547.498922 write 0x01ebb3 thru 0x02e918 (0xfd66 bytes) 000289 1772906547.513543 trunc from 0x01ef97 to 0x01ef9c (0x6 bytes) 000290 1772906547.518095 trunc from 0x040000 to 0x013f11 (0x2c0ee bytes) 000291 1772906547.524874 trunc from 0x00952d to 0x00f506 (0x5fda bytes) 000292 1772906547.527190 mapread 0x00dab8 thru 0x013f11 (0x645a bytes) 000293 1772906547.532482 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13f12): Mirror 2: 0xceb71de0 (stale) Mirror 3: 0xceb71de0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13f12): Mirror 2: 0xceb71de0 (stale) Mirror 3: 0xceb71de0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13f12: skipped 000294 1772906547.609581 MIRROR_RESYNC 3 mirrors 000295 1772906547.793704 mapread 0x012c89 thru 0x013f11 (0x1289 bytes) 000296 1772906547.796971 trunc from 0x013f12 to 0x01e2f9 (0xa3e8 bytes) 000297 1772906547.809570 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1e2fa): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e2fa): Mirror 2: 0xae70bf14 (stale) Mirror 3: 0xae70bf14 (stale) CRC-32 checksum value for chunk [0, 0x1e2fa): Mirror 1: 0xae70bf14 Mirror 4: 0xae70bf14 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e2fa: skipped 000298 1772906548.042553 write 0x02539c thru 0x02edb4 (0x9a19 bytes) 000299 1772906548.053672 read 0x02afe8 thru 0x02edb4 (0x3dcd bytes) 000300 1772906548.054133 punch from 0x00f5d9 to 0x0142b5 (0x4cdd bytes) 000301 1772906548.055906 trunc from 0x02edb5 to 0x033568 (0x47b4 bytes) 000302 1772906548.061184 mapwrite 0x00208c thru 0x00505a (0x2fcf bytes) 000303 1772906548.072063 fallocate 0x00f095 thru 0x00f6c6 (0x632 bytes) 000304 1772906548.073938 mapread 0x000978 thru 0x003f9e (0x3627 bytes) 000305 1772906548.075970 mapread 0x0239fe thru 0x033568 (0xfb6b bytes) 000306 1772906548.081555 read 0x0058ab thru 0x010669 (0xadbf bytes) 000307 1772906548.082139 mapread 0x027573 thru 0x033568 (0xbff6 bytes) 000308 1772906548.082919 fallocate 0x026cef thru 0x03416c (0xd47e bytes) 000310 1772906548.085216 write 0x02507f thru 0x02ed7c (0x9cfe bytes) 000311 1772906548.086171 trunc from 0x03416d to 0x021f6a (0x12202 bytes) 000312 1772906548.090924 trunc from 0x0075e0 to 0x00ae76 (0x3897 bytes) 000313 1772906548.092668 mapwrite 0x01d997 thru 0x02375f (0x5dc9 bytes) 000314 1772906548.105429 trunc from 0x023760 to 0x0103b4 (0x133ab bytes) 000315 1772906548.109775 mapwrite 0x01821a thru 0x020901 (0x86e8 bytes) 000316 1772906548.133319 mapwrite 0x027914 thru 0x02ee42 (0x752f bytes) 000317 1772906548.146544 mapwrite 0x02d4f5 thru 0x03cdb1 (0xf8bd bytes) 000318 1772906548.160761 read 0x028d3f thru 0x038212 (0xf4d4 bytes) 000321 1772906548.162003 fallocate 0x006392 thru 0x00d617 (0x7286 bytes) 000322 1772906548.164066 fallocate 0x02035e thru 0x02af94 (0xac37 bytes) 000324 1772906548.166287 write 0x03cf98 thru 0x03ffff (0x3068 bytes) 000325 1772906548.168441 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9dfbaa83 (stale) Mirror 4: 0x9dfbaa83 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9dfbaa83 (stale) Mirror 4: 0x9dfbaa83 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000326 1772906548.251725 read 0x00d739 thru 0x00dab5 (0x37d bytes) 000327 1772906548.253292 mapread 0x02622f thru 0x029302 (0x30d4 bytes) 000329 1772906548.258629 trunc from 0x040000 to 0x017b7e (0x28481 bytes) 000330 1772906548.264790 punch from 0x015c68 to 0x017b7e (0x1f17 bytes) 000331 1772906548.266483 read 0x0178c3 thru 0x017b7e (0x2bc bytes) 000332 1772906548.269388 fallocate 0x03fd90 thru 0x03ffff (0x270 bytes) 000333 1772906548.271257 trunc from 0x017b7f to 0x00bc6b (0xbf13 bytes) 000334 1772906548.275839 read 0x007c69 thru 0x00bc6b (0x4003 bytes) 000335 1772906548.276458 write 0x03c4fa thru 0x03cc5c (0x763 bytes) 000336 1772906548.277341 fallocate 0x039145 thru 0x03b793 (0x264f bytes) 000337 1772906548.279331 mapread 0x00b672 thru 0x00f967 (0x42f6 bytes) 000338 1772906548.283692 write 0x034af3 thru 0x03ffff (0xb50d bytes) 000339 1772906548.285007 punch from 0x031c47 to 0x0398cc (0x7c86 bytes) 000340 1772906548.289880 write 0x0313b7 thru 0x03ffff (0xec49 bytes) 000342 1772906548.292900 write 0x02f152 thru 0x030c99 (0x1b48 bytes) 000343 1772906548.293693 trunc from 0x040000 to 0x02bb2a (0x144d5 bytes) 000344 1772906548.298160 read 0x01db0c thru 0x02bb2a (0xe01f bytes) 000345 1772906548.298821 trunc from 0x02bb2b to 0x01294b (0x191df bytes) 000346 1772906548.303123 punch from 0x00c369 to 0x01294b (0x65e3 bytes) 000347 1772906548.304797 trunc from 0x01294c to 0x0144d2 (0x1b87 bytes) 000348 1772906548.309155 mapread 0x002470 thru 0x007653 (0x51e4 bytes) 000349 1772906548.310426 punch from 0x00c3ce to 0x0144d2 (0x8105 bytes) 000350 1772906548.312282 fallocate 0x001550 thru 0x001eb6 (0x967 bytes) 000351 1772906548.314094 trunc from 0x0144d3 to 0x022042 (0xdb70 bytes) 000352 1772906548.318193 trunc from 0x00903a to 0x013bd7 (0xab9e bytes) 000353 1772906548.319848 mapwrite 0x02fcf6 thru 0x03b54d (0xb858 bytes) 000354 1772906548.335864 fallocate 0x00181d thru 0x00d838 (0xc01c bytes) 000355 1772906548.337734 read 0x038e79 thru 0x03b54d (0x26d5 bytes) 000356 1772906548.338212 read 0x036e5b thru 0x03b54d (0x46f3 bytes) 000357 1772906548.338717 mapwrite 0x01e1bb thru 0x02c1f1 (0xe037 bytes) 000358 1772906548.346690 trunc from 0x03b54e to 0x009c03 (0x3194a bytes) 000359 1772906548.351069 read 0x006b1a thru 0x008d82 (0x2269 bytes) 000362 1772906548.352286 trunc from 0x000820 to 0x009c03 (0x93e4 bytes) 000363 1772906548.354086 read 0x007d40 thru 0x009c03 (0x1ec4 bytes) 000364 1772906548.356688 punch from 0x009646 to 0x009c03 (0x5be bytes) 000365 1772906548.358036 read 0x008a38 thru 0x009c03 (0x11cc bytes) 000366 1772906548.359823 punch from 0x00417c to 0x007963 (0x37e8 bytes) 000367 1772906548.361443 read 0x002c0e thru 0x007400 (0x47f3 bytes) 000368 1772906548.363785 punch from 0x004da7 to 0x009c03 (0x4e5d bytes) 000369 1772906548.365639 write 0x000e75 thru 0x0104dd (0xf669 bytes) 000370 1772906548.366800 write 0x01d247 thru 0x02635b (0x9115 bytes) 000371 1772906548.367732 write 0x02e10d thru 0x03c514 (0xe408 bytes) 000372 1772906548.369055 fallocate 0x0085a6 thru 0x012950 (0xa3ab bytes) 000373 1772906548.371035 mapread 0x01ff5c thru 0x02cf8f (0xd034 bytes) 000374 1772906548.374107 read 0x01d6f1 thru 0x01e02f (0x93f bytes) 000375 1772906548.374612 trunc from 0x021723 to 0x023362 (0x1c40 bytes) 000376 1772906548.379268 write 0x01348f thru 0x01ce4b (0x99bd bytes) 000377 1772906548.380157 mapread 0x01e8e4 thru 0x026aba (0x81d7 bytes) 000378 1772906548.382414 mapread 0x001a40 thru 0x004a55 (0x3016 bytes) 000379 1772906548.383252 trunc from 0x018ab2 to 0x026d63 (0xe2b2 bytes) 000380 1772906548.388610 MIRROR_RESYNC 3 mirrors 000381 1772906548.622749 punch from 0x007f8d to 0x00993f (0x19b3 bytes) 000383 1772906548.636767 read 0x005a96 thru 0x007411 (0x197c bytes) 000384 1772906548.640608 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3c515): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c515): Mirror 2: 0x1f356040 (stale) Mirror 4: 0x1f356040 (stale) CRC-32 checksum value for chunk [0, 0x3c515): Mirror 1: 0x56269775 Mirror 5: 0x56269775 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c515: skipped 000385 1772906548.897489 fallocate 0x03b307 thru 0x03ffff (0x4cf9 bytes) 000386 1772906548.907345 fallocate 0x021ccd thru 0x0289bf (0x6cf3 bytes) 000387 1772906548.909092 mapread 0x01a1c8 thru 0x020bb3 (0x69ec bytes) 000388 1772906548.914742 trunc from 0x034b97 to 0x039922 (0x4d8c bytes) 000389 1772906548.916614 trunc from 0x037b00 to 0x03c514 (0x4a15 bytes) 000390 1772906548.918294 mapwrite 0x020b77 thru 0x02cc63 (0xc0ed bytes) 000391 1772906548.928194 write 0x025c14 thru 0x0291aa (0x3597 bytes) 000392 1772906548.930250 read 0x02f9e3 thru 0x031456 (0x1a74 bytes) 000393 1772906548.932480 fallocate 0x03e601 thru 0x03ffff (0x19ff bytes) 000394 1772906548.934339 trunc from 0x03c515 to 0x01a631 (0x21ee3 bytes) 000396 1772906548.945128 trunc from 0x019b86 to 0x01a631 (0xaac bytes) 000397 1772906548.946996 fallocate 0x01ef57 thru 0x022255 (0x32ff bytes) 000398 1772906548.948892 mapread 0x00a84a thru 0x0141f0 (0x99a7 bytes) 000399 1772906548.954505 mapread 0x007822 thru 0x00d362 (0x5b41 bytes) 000400 1772906548.955394 trunc from 0x022256 to 0x02c50f (0xa2ba bytes) 000401 1772906548.961161 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2c510): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c510): Mirror 2: 0x150a5d54 (stale) Mirror 4: 0x150a5d54 (stale) Mirror 5: 0x65a7ae79 (stale) CRC-32 checksum value for chunk [0, 0x2c510): Mirror 1: 0x65a7ae79 Mirror 6: 0x65a7ae79 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c510: skipped 000402 1772906549.220474 punch from 0x01ca52 to 0x02b6e4 (0xec93 bytes) 000403 1772906549.231088 read 0x000b52 thru 0x0109ec (0xfe9b bytes) 000404 1772906549.234531 read 0x023c21 thru 0x027b9b (0x3f7b bytes) 000405 1772906549.237358 trunc from 0x02c510 to 0x033751 (0x7242 bytes) 000406 1772906549.243388 punch from 0x01db3f to 0x0283db (0xa89d bytes) 000408 1772906549.245906 read 0x0062ab thru 0x01608e (0xfde4 bytes) 000409 1772906549.246742 trunc from 0x033752 to 0x00e771 (0x24fe0 bytes) 000411 1772906549.251553 write 0x020901 thru 0x02abc9 (0xa2c9 bytes) 000412 1772906549.252622 mapwrite 0x024fa7 thru 0x0319fd (0xca57 bytes) 000414 1772906549.266477 punch from 0x02f976 to 0x0319fd (0x2088 bytes) 000415 1772906549.268477 punch from 0x029400 to 0x0319fd (0x85fe bytes) 000416 1772906549.270353 trunc from 0x02c996 to 0x0319fd (0x5068 bytes) 000417 1772906549.272084 trunc from 0x0319fe to 0x02020e (0x117ef bytes) 000418 1772906549.276344 trunc from 0x00f3ed to 0x018fc5 (0x9bd9 bytes) 000419 1772906549.278077 read 0x015272 thru 0x02020e (0xaf9d bytes) 000420 1772906549.280688 mapread 0x014c18 thru 0x01cbab (0x7f94 bytes) 000421 1772906549.281605 write 0x02b7c7 thru 0x037cff (0xc539 bytes) 000422 1772906549.282865 fallocate 0x03b2c0 thru 0x03ffff (0x4d40 bytes) 000423 1772906549.284751 write 0x00623c thru 0x009587 (0x334c bytes) 000424 1772906549.285487 trunc from 0x037d00 to 0x0077de (0x30521 bytes) 000425 1772906549.289920 mapwrite 0x02ea62 thru 0x036a35 (0x7fd4 bytes) 000426 1772906549.304096 write 0x01305e thru 0x01de4f (0xadf2 bytes) 000427 1772906549.307586 trunc from 0x0000ac to 0x004d7a (0x4ccf bytes) 000428 1772906549.309166 trunc from 0x036a36 to 0x015bd6 (0x20e5f bytes) 000429 1772906549.313783 fallocate 0x02dbd6 thru 0x02f47d (0x18a8 bytes) 000430 1772906549.315541 fallocate 0x0156c2 thru 0x01846f (0x2dae bytes) 000431 1772906549.317172 mapwrite 0x0286e6 thru 0x02b8b2 (0x31cd bytes) 000432 1772906549.331971 read 0x0263d3 thru 0x02b8b2 (0x54e0 bytes) 000435 1772906549.336102 mapread 0x0198d6 thru 0x026c58 (0xd383 bytes) 000436 1772906549.336933 trunc from 0x02b8b3 to 0x0211a1 (0xa711 bytes) 000437 1772906549.342962 MIRROR_RESYNC 5 mirrors 000438 1772906549.647310 mapread 0x01dbbe thru 0x01f08d (0x14d0 bytes) 000439 1772906549.652671 mapread 0x0033ed thru 0x01248b (0xf09f bytes) 000440 1772906549.658411 write 0x027966 thru 0x032826 (0xaec1 bytes) 000441 1772906549.668999 mapread 0x013d4b thru 0x017633 (0x38e9 bytes) 000442 1772906549.672023 mapwrite 0x029e63 thru 0x035658 (0xb7f6 bytes) 000443 1772906549.691986 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x35659): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35659): Mirror 2: 0xb377589d (stale) Mirror 4: 0xb377589d (stale) Mirror 5: 0xb377589d (stale) Mirror 6: 0xb377589d (stale) CRC-32 checksum value for chunk [0, 0x35659): Mirror 1: 0x76e8c456 Mirror 7: 0x76e8c456 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35659: skipped 000444 1772906549.930213 trunc from 0x033bf3 to 0x035658 (0x1a66 bytes) 000445 1772906549.941180 trunc from 0x033a17 to 0x035658 (0x1c42 bytes) 000446 1772906549.942796 trunc from 0x030fe1 to 0x0315f9 (0x619 bytes) 000447 1772906549.944333 fallocate 0x0132d1 thru 0x01ce90 (0x9bc0 bytes) 000448 1772906549.946159 read 0x0174cd thru 0x01b81a (0x434e bytes) 000449 1772906549.948809 mapwrite 0x02f626 thru 0x03dced (0xe6c8 bytes) 000450 1772906549.975125 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3dcee): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dcee): Mirror 2: 0x28d181a6 (stale) Mirror 4: 0x28d181a6 (stale) Mirror 5: 0x28d181a6 (stale) Mirror 6: 0x28d181a6 (stale) Mirror 7: 0x4c0fe698 (stale) CRC-32 checksum value for chunk [0, 0x3dcee): Mirror 1: 0x9089d0ee Mirror 8: 0x9089d0ee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dcee: skipped 000451 1772906550.247246 trunc from 0x03dcee to 0x02f03d (0xecb0 bytes) 000452 1772906550.260154 read 0x01135c thru 0x0127d4 (0x1479 bytes) 000453 1772906550.262366 write 0x027600 thru 0x03087f (0x9280 bytes) 000454 1772906550.264525 write 0x00545a thru 0x011bf8 (0xc79f bytes) 000455 1772906550.266819 mapwrite 0x021140 thru 0x024ad8 (0x3999 bytes) 000456 1772906550.275656 trunc from 0x028fd5 to 0x02b6f4 (0x2720 bytes) 000457 1772906550.277729 trunc from 0x001efc to 0x011d5c (0xfe61 bytes) 000458 1772906550.281656 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x30880): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30880): Mirror 2: 0xb17dcde2 (stale) Mirror 4: 0xb17dcde2 (stale) Mirror 5: 0xb17dcde2 (stale) Mirror 6: 0xb17dcde2 (stale) Mirror 7: 0x6c26d199 (stale) Mirror 8: 0xd4d11e42 (stale) CRC-32 checksum value for chunk [0, 0x30880): Mirror 1: 0x656939be Mirror 9: 0x656939be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30880: skipped 000459 1772906550.565054 read 0x00c7d7 thru 0x012433 (0x5c5d bytes) 000460 1772906550.570468 fallocate 0x027254 thru 0x028955 (0x1702 bytes) 000461 1772906550.584372 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30880): Mirror 4: 0xb17dcde2 (stale) Mirror 5: 0xb17dcde2 (stale) Mirror 6: 0xb17dcde2 (stale) Mirror 7: 0x6c26d199 (stale) Mirror 8: 0xd4d11e42 (stale) Mirror 9: 0x656939be (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30880): Mirror 4: 0xb17dcde2 (stale) Mirror 5: 0xb17dcde2 (stale) Mirror 6: 0xb17dcde2 (stale) Mirror 7: 0x6c26d199 (stale) Mirror 8: 0xd4d11e42 (stale) Mirror 9: 0x656939be (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30880: skipped 000462 1772906550.708244 mapread 0x0236fb thru 0x02cac9 (0x93cf bytes) 000463 1772906550.714978 mapread 0x0246a0 thru 0x02cafb (0x845c bytes) 000464 1772906550.716082 mapread 0x01b08a thru 0x024e42 (0x9db9 bytes) 000465 1772906550.719837 trunc from 0x030880 to 0x014aeb (0x1bd94 bytes) 000467 1772906550.732785 write 0x014b29 thru 0x01ab97 (0x606f bytes) 000469 1772906550.734297 fallocate 0x024919 thru 0x0280ff (0x37e7 bytes) 000470 1772906550.738059 MIRROR_RESYNC 7 mirrors 000471 1772906551.089871 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) 000472 1772906551.190786 trunc from 0x0125a2 to 0x0150af (0x2b0e bytes) 000473 1772906551.202066 punch from 0x002787 to 0x008077 (0x58f1 bytes) 000474 1772906551.203900 fallocate 0x01e887 thru 0x01f537 (0xcb1 bytes) 000475 1772906551.206915 MIRROR_RESYNC 6 mirrors 000476 1772906551.537488 read 0x01bba0 thru 0x01f537 (0x3998 bytes) 000477 1772906551.540431 write 0x00dcae thru 0x01d5c1 (0xf914 bytes) 000478 1772906551.555734 fallocate 0x02750c thru 0x033064 (0xbb59 bytes) 000479 1772906551.557803 fallocate 0x02cf70 thru 0x02e30f (0x13a0 bytes) 000480 1772906551.559532 trunc from 0x01aaa8 to 0x0229c0 (0x7f19 bytes) 000481 1772906551.563780 write 0x030379 thru 0x03d135 (0xcdbd bytes) 000482 1772906551.565071 trunc from 0x03d136 to 0x000a24 (0x3c711 bytes) 000483 1772906551.571076 write 0x01861a thru 0x022f03 (0xa8ea bytes) 000485 1772906551.574763 MIRROR_RESYNC 6 mirrors 000486 1772906551.835781 mapwrite 0x0195b0 thru 0x027779 (0xe1ca bytes) 000487 1772906551.863483 mapread 0x00bbd1 thru 0x00d243 (0x1673 bytes) 000488 1772906551.866808 read 0x016750 thru 0x01c5e5 (0x5e96 bytes) 000489 1772906551.867374 punch from 0x006952 to 0x00d5f4 (0x6ca3 bytes) 000490 1772906551.869701 mapwrite 0x01ca44 thru 0x02b612 (0xebcf bytes) 000491 1772906551.885722 punch from 0x015f64 to 0x02339c (0xd439 bytes) 000492 1772906551.888000 write 0x014d1b thru 0x02019a (0xb480 bytes) 000493 1772906551.890914 read 0x0067d3 thru 0x011afc (0xb32a bytes) 000495 1772906551.894742 read 0x005426 thru 0x00b424 (0x5fff bytes) 000496 1772906551.895195 punch from 0x021780 to 0x023099 (0x191a bytes) 000497 1772906551.898600 MIRROR_RESYNC 6 mirrors 000498 1772906552.228940 mapwrite 0x033e6e thru 0x03ffff (0xc192 bytes) 000499 1772906552.254670 read 0x036938 thru 0x03c8bf (0x5f88 bytes) 000500 1772906552.255325 mapread 0x014083 thru 0x01e476 (0xa3f4 bytes) 000501 1772906552.262025 write 0x017229 thru 0x018cc0 (0x1a98 bytes) 000502 1772906552.263052 read 0x03920a thru 0x03ffff (0x6df6 bytes) 000503 1772906552.263572 trunc from 0x02265c to 0x025ce6 (0x368b bytes) 000504 1772906552.265664 trunc from 0x040000 to 0x01fdcb (0x20234 bytes) 000505 1772906552.272496 mapread 0x01bdf9 thru 0x01fdcb (0x3fd3 bytes) 000507 1772906552.273755 trunc from 0x01fdcc to 0x036791 (0x169c6 bytes) 000508 1772906552.279295 read 0x0088db thru 0x00b53a (0x2c60 bytes) 000509 1772906552.284869 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x36792): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36792): Mirror 5: 0x41a5f594 (stale) Mirror 6: 0x41a5f594 (stale) Mirror 7: 0x41a5f594 (stale) Mirror 8: 0x41a5f594 (stale) Mirror 9: 0x41a5f594 (stale) CRC-32 checksum value for chunk [0, 0x36792): Mirror 1: 0x3cf24e12 Mirror 10: 0x3cf24e12 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36792: skipped 000510 1772906552.541028 read 0x02da7a thru 0x032770 (0x4cf7 bytes) 000511 1772906552.546525 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x36792): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36792): Mirror 5: 0x41a5f594 (stale) Mirror 6: 0x41a5f594 (stale) Mirror 7: 0x41a5f594 (stale) Mirror 8: 0x41a5f594 (stale) Mirror 9: 0x41a5f594 (stale) CRC-32 checksum value for chunk [0, 0x36792): Mirror 1: 0x3cf24e12 Mirror 10: 0x3cf24e12 Mirror 11: 0x3cf24e12 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36792: skipped 000512 1772906552.784512 punch from 0x01e46f to 0x0215cb (0x315d bytes) 000513 1772906552.796620 write 0x00d5a2 thru 0x00f7c6 (0x2225 bytes) 000514 1772906552.801165 mapread 0x00bac5 thru 0x00be86 (0x3c2 bytes) 000515 1772906552.804653 mapread 0x024cbc thru 0x02c9f3 (0x7d38 bytes) 000516 1772906552.808468 read 0x02eff6 thru 0x036791 (0x779c bytes) 000518 1772906552.812060 mapread 0x011c25 thru 0x01e1b5 (0xc591 bytes) 000519 1772906552.815525 mapwrite 0x02f739 thru 0x03bc65 (0xc52d bytes) 000521 1772906552.837536 fallocate 0x025fd4 thru 0x033940 (0xd96d bytes) 000522 1772906552.841306 MIRROR_RESYNC 8 mirrors 000523 1772906553.292090 trunc from 0x005a25 to 0x00ebfe (0x91da bytes) 000526 1772906553.301760 punch from 0x003767 to 0x00c87f (0x9119 bytes) 000527 1772906553.303494 write 0x016199 thru 0x0255bb (0xf423 bytes) 000528 1772906553.307091 trunc from 0x024e41 to 0x026d80 (0x1f40 bytes) 000529 1772906553.312339 MIRROR_RESYNC 8 mirrors 000530 1772906553.803878 fallocate 0x03ee9d thru 0x03ffff (0x1163 bytes) 000531 1772906553.815998 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3bc66): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc66): Mirror 5: 0xb52a69a7 (stale) Mirror 6: 0xb52a69a7 (stale) Mirror 7: 0xb52a69a7 (stale) Mirror 8: 0xb52a69a7 (stale) Mirror 9: 0xb52a69a7 (stale) Mirror 10: 0xb52a69a7 (stale) Mirror 11: 0xb52a69a7 (stale) CRC-32 checksum value for chunk [0, 0x3bc66): Mirror 1: 0xb52a69a7 Mirror 12: 0xb52a69a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc66: skipped 000532 1772906554.129799 mapread 0x02827a thru 0x034e77 (0xcbfe bytes) 000533 1772906554.143431 fallocate 0x0105ef thru 0x014932 (0x4344 bytes) 000534 1772906554.158962 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bc66): Mirror 5: 0xb52a69a7 (stale) Mirror 7: 0xb52a69a7 (stale) Mirror 8: 0xb52a69a7 (stale) Mirror 9: 0xb52a69a7 (stale) Mirror 10: 0xb52a69a7 (stale) Mirror 11: 0xb52a69a7 (stale) Mirror 12: 0xb52a69a7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc66): Mirror 5: 0xb52a69a7 (stale) Mirror 7: 0xb52a69a7 (stale) Mirror 8: 0xb52a69a7 (stale) Mirror 9: 0xb52a69a7 (stale) Mirror 10: 0xb52a69a7 (stale) Mirror 11: 0xb52a69a7 (stale) Mirror 12: 0xb52a69a7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc66: skipped 000535 1772906554.319816 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3bc66): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc66): Mirror 5: 0xb52a69a7 (stale) Mirror 7: 0xb52a69a7 (stale) Mirror 8: 0xb52a69a7 (stale) Mirror 9: 0xb52a69a7 (stale) Mirror 10: 0xb52a69a7 (stale) Mirror 11: 0xb52a69a7 (stale) Mirror 12: 0xb52a69a7 (stale) CRC-32 checksum value for chunk [0, 0x3bc66): Mirror 1: 0xb52a69a7 Mirror 13: 0xb52a69a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc66: skipped 000536 1772906554.615103 mapread 0x01598d thru 0x022aa0 (0xd114 bytes) 000537 1772906554.627585 read 0x0291aa thru 0x02f6d4 (0x652b bytes) 000538 1772906554.632761 fallocate 0x01dac1 thru 0x021321 (0x3861 bytes) 000539 1772906554.647308 mapwrite 0x006fc6 thru 0x01187e (0xa8b9 bytes) 000540 1772906554.661526 trunc from 0x03bc66 to 0x021b93 (0x1a0d2 bytes) 000541 1772906554.668958 read 0x004439 thru 0x0054a3 (0x106b bytes) 000542 1772906554.669655 mapwrite 0x03203f thru 0x035276 (0x3238 bytes) 000543 1772906554.682742 punch from 0x017b6a to 0x0190fc (0x1593 bytes) 000544 1772906554.684671 mapread 0x00d633 thru 0x0183f0 (0xadbe bytes) 000546 1772906554.688766 write 0x01857a thru 0x023674 (0xb0fb bytes) 000547 1772906554.689763 punch from 0x031d6e to 0x033e69 (0x20fc bytes) 000549 1772906554.691861 write 0x01401e thru 0x01ead6 (0xaab9 bytes) 000550 1772906554.692771 punch from 0x0296d8 to 0x02d018 (0x3941 bytes) 000552 1772906554.694774 read 0x02e7fc thru 0x035276 (0x6a7b bytes) 000553 1772906554.697590 trunc from 0x035277 to 0x00c64c (0x28c2a bytes) 000555 1772906554.704020 MIRROR_RESYNC 9 mirrors 000556 1772906555.027876 punch from 0x003e80 to 0x00c64c (0x87cd bytes) 000557 1772906555.039061 mapwrite 0x02f873 thru 0x037216 (0x79a4 bytes) 000558 1772906555.059941 punch from 0x00383d to 0x00e121 (0xa8e5 bytes) 000559 1772906555.061620 mapread 0x001980 thru 0x002b98 (0x1219 bytes) 000560 1772906555.064917 read 0x01b249 thru 0x02421b (0x8fd3 bytes) 000561 1772906555.069289 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x37217): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37217): Mirror 5: 0xf6e97e5d (stale) Mirror 7: 0xf6e97e5d (stale) Mirror 8: 0xf6e97e5d (stale) Mirror 9: 0xf6e97e5d (stale) Mirror 10: 0xf6e97e5d (stale) Mirror 11: 0xf6e97e5d (stale) Mirror 12: 0xf6e97e5d (stale) Mirror 13: 0xf6e97e5d (stale) CRC-32 checksum value for chunk [0, 0x37217): Mirror 1: 0x8b54fd82 Mirror 14: 0x8b54fd82 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37217: skipped 000562 1772906555.337332 MIRROR_RESYNC 10 mirrors 000563 1772906555.689133 fallocate 0x030046 thru 0x032e6e (0x2e29 bytes) 000564 1772906555.701677 trunc from 0x037217 to 0x001aa5 (0x35771 bytes) 000565 1772906555.712701 trunc from 0x001aa6 to 0x02a6b2 (0x28c0d bytes) 000566 1772906555.717317 fallocate 0x03052d thru 0x03ec3d (0xe711 bytes) 000568 1772906555.720042 punch from 0x0073d1 to 0x00d6a8 (0x62d8 bytes) 000569 1772906555.721825 fallocate 0x01edb5 thru 0x021b96 (0x2de2 bytes) 000570 1772906555.723961 trunc from 0x02a6b3 to 0x0205fe (0xa0b4 bytes) 000571 1772906555.729067 punch from 0x0067e4 to 0x0158d6 (0xf0f3 bytes) 000573 1772906555.731663 punch from 0x00ffe1 to 0x014e1f (0x4e3f bytes) 000574 1772906555.733838 trunc from 0x0205ff to 0x011190 (0xf46e bytes) 000576 1772906555.739801 trunc from 0x00319c to 0x00ab64 (0x79c9 bytes) 000577 1772906555.741762 trunc from 0x00e47b to 0x011190 (0x2d16 bytes) 000578 1772906555.743520 trunc from 0x008917 to 0x011190 (0x887a bytes) 000579 1772906555.745582 trunc from 0x011191 to 0x0045a3 (0xcbed bytes) 000580 1772906555.750478 fallocate 0x02ed5b thru 0x037816 (0x8abc bytes) 000581 1772906555.753104 mapread 0x00450b thru 0x0045a3 (0x99 bytes) 000582 1772906555.756158 mapread 0x0012b6 thru 0x0045a3 (0x32ee bytes) 000583 1772906555.760730 trunc from 0x0014d2 to 0x0045a3 (0x30d2 bytes) 000584 1772906555.762993 mapwrite 0x02e091 thru 0x0318e5 (0x3855 bytes) 000585 1772906555.776769 fallocate 0x011946 thru 0x016b1f (0x51da bytes) 000586 1772906555.778768 mapread 0x00543a thru 0x00dc71 (0x8838 bytes) 000587 1772906555.782137 mapwrite 0x034988 thru 0x03ffff (0xb678 bytes) 000588 1772906555.799094 trunc from 0x040000 to 0x01090b (0x2f6f4 bytes) 000589 1772906555.804888 punch from 0x00652a to 0x00d95a (0x7431 bytes) 000590 1772906555.808723 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x1090c): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1090c): Mirror 5: 0xa4e28e87 (stale) Mirror 7: 0xa4e28e87 (stale) Mirror 8: 0xa4e28e87 (stale) Mirror 9: 0xa4e28e87 (stale) Mirror 10: 0xa4e28e87 (stale) Mirror 11: 0xa4e28e87 (stale) Mirror 12: 0xa4e28e87 (stale) Mirror 13: 0xa4e28e87 (stale) Mirror 14: 0xa4e28e87 (stale) CRC-32 checksum value for chunk [0, 0x1090c): Mirror 1: 0xa4e28e87 Mirror 15: 0xa4e28e87 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1090c: skipped 000591 1772906556.042570 trunc from 0x01090c to 0x003122 (0xd7e9 bytes) 000592 1772906556.069470 punch from 0x001241 to 0x003122 (0x1ee2 bytes) 000593 1772906556.071472 read 0x002fc2 thru 0x003122 (0x161 bytes) 000594 1772906556.074036 trunc from 0x003123 to 0x009c29 (0x6b07 bytes) 000595 1772906556.081476 read 0x006680 thru 0x009c29 (0x35aa bytes) 000596 1772906556.084681 read 0x009969 thru 0x009c29 (0x2c1 bytes) 000597 1772906556.085380 trunc from 0x005ab4 to 0x009c29 (0x4176 bytes) 000598 1772906556.087458 punch from 0x0085dd to 0x009c29 (0x164d bytes) 000599 1772906556.088986 write 0x0155e6 thru 0x01e671 (0x908c bytes) 000600 1772906556.090451 punch from 0x010496 to 0x01b062 (0xabcd bytes) 000601 1772906556.095252 punch from 0x010ac7 to 0x014fb9 (0x44f3 bytes) 000605 1772906556.098549 mapread 0x011375 thru 0x016e39 (0x5ac5 bytes) 000606 1772906556.103618 read 0x0199fb thru 0x01e671 (0x4c77 bytes) 000608 1772906556.104928 punch from 0x00b00a to 0x00dfc9 (0x2fc0 bytes) 000609 1772906556.107206 trunc from 0x01e672 to 0x022ae8 (0x4477 bytes) 000610 1772906556.113769 punch from 0x011987 to 0x013ec6 (0x2540 bytes) 000611 1772906556.115832 trunc from 0x007c60 to 0x00d409 (0x57aa bytes) 000612 1772906556.119033 punch from 0x0167b6 to 0x018b2c (0x2377 bytes) 000613 1772906556.120905 fallocate 0x027ee9 thru 0x032dec (0xaf04 bytes) 000614 1772906556.123541 punch from 0x007595 to 0x013810 (0xc27c bytes) 000615 1772906556.127416 MIRROR_RESYNC 11 mirrors 000616 1772906556.563052 mapread 0x0114bf thru 0x01e394 (0xced6 bytes) 000617 1772906556.570096 write 0x00605d thru 0x013f0c (0xdeb0 bytes) 000618 1772906556.585101 mapread 0x009707 thru 0x013a90 (0xa38a bytes) 000619 1772906556.586156 trunc from 0x01f452 to 0x022ae8 (0x3697 bytes) 000621 1772906556.588335 mapwrite 0x0211c7 thru 0x0262aa (0x50e4 bytes) 000622 1772906556.609900 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x262ab): Mirror 5: 0x1b8d2277 (stale) Mirror 7: 0x1b8d2277 (stale) Mirror 8: 0x1b8d2277 (stale) Mirror 9: 0x1b8d2277 (stale) Mirror 10: 0x1b8d2277 (stale) Mirror 11: 0x1b8d2277 (stale) Mirror 12: 0x1b8d2277 (stale) Mirror 14: 0x1b8d2277 (stale) Mirror 15: 0x1b8d2277 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x262ab): Mirror 5: 0x1b8d2277 (stale) Mirror 7: 0x1b8d2277 (stale) Mirror 8: 0x1b8d2277 (stale) Mirror 9: 0x1b8d2277 (stale) Mirror 10: 0x1b8d2277 (stale) Mirror 11: 0x1b8d2277 (stale) Mirror 12: 0x1b8d2277 (stale) Mirror 14: 0x1b8d2277 (stale) Mirror 15: 0x1b8d2277 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x262ab: skipped 000623 1772906556.729189 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x262ab): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x262ab): Mirror 5: 0x1b8d2277 (stale) Mirror 7: 0x1b8d2277 (stale) Mirror 8: 0x1b8d2277 (stale) Mirror 9: 0x1b8d2277 (stale) Mirror 10: 0x1b8d2277 (stale) Mirror 11: 0x1b8d2277 (stale) Mirror 12: 0x1b8d2277 (stale) Mirror 14: 0x1b8d2277 (stale) Mirror 15: 0x1b8d2277 (stale) CRC-32 checksum value for chunk [0, 0x262ab): Mirror 1: 0x971656dd Mirror 16: 0x971656dd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x262ab: skipped 000625 1772906556.963490 punch from 0x021c89 to 0x0262aa (0x4622 bytes) 000626 1772906556.975187 trunc from 0x006bb1 to 0x006db9 (0x209 bytes) 000627 1772906556.976665 mapread 0x01fade thru 0x0262aa (0x67cd bytes) 000628 1772906556.981550 read 0x0094ee thru 0x00c51d (0x3030 bytes) 000629 1772906556.983537 mapwrite 0x010018 thru 0x012b0d (0x2af6 bytes) 000630 1772906556.990303 mapwrite 0x030db7 thru 0x03cc3e (0xbe88 bytes) 000631 1772906557.010987 trunc from 0x0059ce to 0x005dcf (0x402 bytes) 000632 1772906557.012803 write 0x038164 thru 0x03ac50 (0x2aed bytes) 000633 1772906557.015197 MIRROR_RESYNC 11 mirrors 000635 1772906557.706811 punch from 0x007daa to 0x010eaf (0x9106 bytes) 000636 1772906557.717016 punch from 0x03c807 to 0x03cc3e (0x438 bytes) 000637 1772906557.719799 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3cc3f): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cc3f): Mirror 5: 0xe7ac7293 (stale) Mirror 7: 0xe7ac7293 (stale) Mirror 8: 0xe7ac7293 (stale) Mirror 9: 0xe7ac7293 (stale) Mirror 10: 0xe7ac7293 (stale) Mirror 11: 0xe7ac7293 (stale) Mirror 12: 0xe7ac7293 (stale) Mirror 14: 0xe7ac7293 (stale) Mirror 15: 0xe7ac7293 (stale) Mirror 16: 0xe7ac7293 (stale) CRC-32 checksum value for chunk [0, 0x3cc3f): Mirror 1: 0x7053815f Mirror 17: 0x7053815f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cc3f: skipped 000638 1772906557.994280 trunc from 0x03cc3f to 0x02af16 (0x11d28 bytes) 000639 1772906558.008515 punch from 0x025ad5 to 0x026ad9 (0x1005 bytes) 000640 1772906558.010084 read 0x00dce0 thru 0x016cba (0x8fdb bytes) 000641 1772906558.012899 mapwrite 0x013602 thru 0x01fc08 (0xc607 bytes) 000642 1772906558.023659 trunc from 0x02af17 to 0x00132f (0x29be7 bytes) 000643 1772906558.028729 write 0x03321e thru 0x038832 (0x5615 bytes) 000644 1772906558.029606 fallocate 0x01f738 thru 0x02f13f (0xfa08 bytes) 000645 1772906558.031306 mapread 0x0106a6 thru 0x01c58b (0xbee6 bytes) 000646 1772906558.035168 read 0x00a991 thru 0x013356 (0x89c6 bytes) 000647 1772906558.035636 trunc from 0x038833 to 0x01863f (0x201f3 bytes) 000648 1772906558.040426 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18640): Mirror 7: 0x3f05bf09 (stale) Mirror 8: 0x3f05bf09 (stale) Mirror 9: 0x3f05bf09 (stale) Mirror 10: 0x3f05bf09 (stale) Mirror 11: 0x3f05bf09 (stale) Mirror 12: 0x3f05bf09 (stale) Mirror 14: 0x3f05bf09 (stale) Mirror 15: 0x3f05bf09 (stale) Mirror 16: 0x3f05bf09 (stale) Mirror 17: 0x73b4f27 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18640): Mirror 7: 0x3f05bf09 (stale) Mirror 8: 0x3f05bf09 (stale) Mirror 9: 0x3f05bf09 (stale) Mirror 10: 0x3f05bf09 (stale) Mirror 11: 0x3f05bf09 (stale) Mirror 12: 0x3f05bf09 (stale) Mirror 14: 0x3f05bf09 (stale) Mirror 15: 0x3f05bf09 (stale) Mirror 16: 0x3f05bf09 (stale) Mirror 17: 0x73b4f27 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18640: skipped 000649 1772906558.164673 mapwrite 0x020af8 thru 0x02ece0 (0xe1e9 bytes) 000650 1772906558.185198 trunc from 0x02ece1 to 0x028715 (0x65cb bytes) 000651 1772906558.189926 trunc from 0x024bda to 0x028715 (0x3b3c bytes) 000652 1772906558.191969 trunc from 0x004da2 to 0x005f5f (0x11be bytes) 000653 1772906558.193498 trunc from 0x028716 to 0x01a8e5 (0xde30 bytes) 000654 1772906558.197402 trunc from 0x01a8e6 to 0x03e826 (0x23f41 bytes) 000655 1772906558.201614 fallocate 0x0364a2 thru 0x03ffff (0x9b5e bytes) 000657 1772906558.203787 mapread 0x024a75 thru 0x02c0e0 (0x766c bytes) 000658 1772906558.206962 fallocate 0x003d4c thru 0x0052c1 (0x1576 bytes) 000659 1772906558.209066 write 0x0388cd thru 0x03dee0 (0x5614 bytes) 000660 1772906558.213653 MIRROR_RESYNC 11 mirrors 000661 1772906558.631680 trunc from 0x036ba8 to 0x03e826 (0x7c7f bytes) 000662 1772906558.642353 read 0x0252ac thru 0x033e84 (0xebd9 bytes) 000663 1772906558.645591 punch from 0x00f030 to 0x01391d (0x48ee bytes) 000664 1772906558.647299 fallocate 0x00d024 thru 0x015011 (0x7fee bytes) 000665 1772906558.650679 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3e827): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e827): Mirror 7: 0x74860ad0 (stale) Mirror 8: 0x74860ad0 (stale) Mirror 9: 0x74860ad0 (stale) Mirror 10: 0x74860ad0 (stale) Mirror 11: 0x74860ad0 (stale) Mirror 12: 0x74860ad0 (stale) Mirror 14: 0x74860ad0 (stale) Mirror 15: 0x74860ad0 (stale) Mirror 16: 0x74860ad0 (stale) Mirror 17: 0x74860ad0 (stale) CRC-32 checksum value for chunk [0, 0x3e827): Mirror 1: 0xa1175b54 Mirror 18: 0xa1175b54 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e827: skipped 000666 1772906558.892740 write 0x0295c4 thru 0x031ebb (0x88f8 bytes) 000667 1772906558.905848 punch from 0x01cbb2 to 0x025b55 (0x8fa4 bytes) 000668 1772906558.908392 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3e827): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e827): Mirror 7: 0x74860ad0 (stale) Mirror 8: 0x74860ad0 (stale) Mirror 9: 0x74860ad0 (stale) Mirror 10: 0x74860ad0 (stale) Mirror 11: 0x74860ad0 (stale) Mirror 12: 0x74860ad0 (stale) Mirror 14: 0x74860ad0 (stale) Mirror 15: 0x74860ad0 (stale) Mirror 16: 0x74860ad0 (stale) Mirror 17: 0x74860ad0 (stale) Mirror 18: 0xa1175b54 (stale) CRC-32 checksum value for chunk [0, 0x3e827): Mirror 1: 0x63bae955 Mirror 19: 0x63bae955 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e827: skipped 000669 1772906559.147814 mapread 0x038b3e thru 0x03e826 (0x5ce9 bytes) 000670 1772906559.155331 write 0x03aeef thru 0x03ffff (0x5111 bytes) 000671 1772906559.167075 punch from 0x02528e to 0x02ab35 (0x58a8 bytes) 000672 1772906559.168663 trunc from 0x027ff5 to 0x02f09c (0x70a8 bytes) 000673 1772906559.171207 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x28954c17 (stale) Mirror 8: 0x28954c17 (stale) Mirror 9: 0x28954c17 (stale) Mirror 10: 0x28954c17 (stale) Mirror 11: 0x28954c17 (stale) Mirror 12: 0x28954c17 (stale) Mirror 14: 0x28954c17 (stale) Mirror 15: 0x28954c17 (stale) Mirror 16: 0x28954c17 (stale) Mirror 17: 0x28954c17 (stale) Mirror 18: 0xe20eea22 (stale) Mirror 19: 0x56734979 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa286c7fd Mirror 20: 0xa286c7fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000674 1772906559.443275 punch from 0x007be2 to 0x00c2be (0x46dd bytes) 000675 1772906559.453252 trunc from 0x00f213 to 0x012ce1 (0x3acf bytes) 000676 1772906559.454768 trunc from 0x040000 to 0x010daf (0x2f250 bytes) 000677 1772906559.461719 mapwrite 0x003bba thru 0x00d0c8 (0x950f bytes) 000678 1772906559.473627 punch from 0x004612 to 0x0056e6 (0x10d5 bytes) 000679 1772906559.475152 trunc from 0x010db0 to 0x01b97a (0xabcb bytes) 000680 1772906559.479551 fallocate 0x004af6 thru 0x009a49 (0x4f54 bytes) 000682 1772906559.482134 mapwrite 0x012f3f thru 0x01b27f (0x8341 bytes) 000683 1772906559.493672 MIRROR_SPLIT mirror 3 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b97b): Mirror 7: 0x7587d44c (stale) Mirror 8: 0x7587d44c (stale) Mirror 10: 0x7587d44c (stale) Mirror 11: 0x7587d44c (stale) Mirror 12: 0x7587d44c (stale) Mirror 14: 0x7587d44c (stale) Mirror 15: 0x7587d44c (stale) Mirror 16: 0x7587d44c (stale) Mirror 17: 0x7587d44c (stale) Mirror 18: 0x7587d44c (stale) Mirror 19: 0x7587d44c (stale) Mirror 20: 0x7587d44c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b97b): Mirror 7: 0x7587d44c (stale) Mirror 8: 0x7587d44c (stale) Mirror 10: 0x7587d44c (stale) Mirror 11: 0x7587d44c (stale) Mirror 12: 0x7587d44c (stale) Mirror 14: 0x7587d44c (stale) Mirror 15: 0x7587d44c (stale) Mirror 16: 0x7587d44c (stale) Mirror 17: 0x7587d44c (stale) Mirror 18: 0x7587d44c (stale) Mirror 19: 0x7587d44c (stale) Mirror 20: 0x7587d44c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b97b: skipped 000684 1772906559.628586 trunc from 0x01b97b to 0x02ceee (0x11574 bytes) 000685 1772906559.633126 mapread 0x013388 thru 0x015dd9 (0x2a52 bytes) 000686 1772906559.639802 MIRROR_RESYNC 13 mirrors 000687 1772906560.241517 write 0x03aadd thru 0x03ffff (0x5523 bytes) 000688 1772906560.251034 mapread 0x00c6c0 thru 0x016e0a (0xa74b bytes) 000689 1772906560.256134 write 0x01f314 thru 0x022625 (0x3312 bytes) 000690 1772906560.258777 trunc from 0x040000 to 0x0073df (0x38c20 bytes) 000691 1772906560.264349 mapwrite 0x006a34 thru 0x00a8b1 (0x3e7e bytes) 000692 1772906560.276699 trunc from 0x00a8b2 to 0x0318ec (0x2703b bytes) 000693 1772906560.281050 mapread 0x00aa3a thru 0x00e318 (0x38df bytes) 000694 1772906560.284016 fallocate 0x000495 thru 0x004445 (0x3fb1 bytes) 000695 1772906560.285936 mapread 0x00e2ee thru 0x00fcbd (0x19d0 bytes) 000696 1772906560.286561 mapwrite 0x02f7b3 thru 0x030e83 (0x16d1 bytes) 000697 1772906560.292267 mapread 0x01a769 thru 0x025bcb (0xb463 bytes) 000699 1772906560.296864 trunc from 0x002f32 to 0x00cb7b (0x9c4a bytes) 000700 1772906560.298555 trunc from 0x00f339 to 0x01c802 (0xd4ca bytes) 000701 1772906560.299991 punch from 0x02e059 to 0x0318ec (0x3894 bytes) 000703 1772906560.301839 write 0x02d8cd thru 0x033d43 (0x6477 bytes) 000705 1772906560.302885 fallocate 0x03bc15 thru 0x03de27 (0x2213 bytes) 000706 1772906560.304696 mapread 0x0132de thru 0x0215f2 (0xe315 bytes) 000707 1772906560.309779 trunc from 0x033d44 to 0x021db1 (0x11f92 bytes) 000708 1772906560.314144 mapread 0x01bf47 thru 0x021db1 (0x5e6b bytes) 000709 1772906560.315974 MIRROR_RESYNC 13 mirrors 000710 1772906560.629941 trunc from 0x021db2 to 0x023e0f (0x205e bytes) 000711 1772906560.645107 mapread 0x01dfef thru 0x023e0f (0x5e21 bytes) 000712 1772906560.650017 fallocate 0x02d3e8 thru 0x035c31 (0x884a bytes) 000713 1772906560.651712 read 0x018935 thru 0x01f1d4 (0x68a0 bytes) 000714 1772906560.652196 fallocate 0x037a85 thru 0x03b788 (0x3d04 bytes) 000715 1772906560.654099 trunc from 0x02890f to 0x035d13 (0xd405 bytes) 000716 1772906560.656830 MIRROR_SPLIT mirror 12 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b789): Mirror 7: 0xeefb574d (stale) Mirror 8: 0xeefb574d (stale) Mirror 10: 0xeefb574d (stale) Mirror 11: 0xeefb574d (stale) Mirror 12: 0xeefb574d (stale) Mirror 14: 0xeefb574d (stale) Mirror 15: 0xeefb574d (stale) Mirror 16: 0xeefb574d (stale) Mirror 17: 0xeefb574d (stale) Mirror 18: 0xeefb574d (stale) Mirror 19: 0xeefb574d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b789): Mirror 7: 0xeefb574d (stale) Mirror 8: 0xeefb574d (stale) Mirror 10: 0xeefb574d (stale) Mirror 11: 0xeefb574d (stale) Mirror 12: 0xeefb574d (stale) Mirror 14: 0xeefb574d (stale) Mirror 15: 0xeefb574d (stale) Mirror 16: 0xeefb574d (stale) Mirror 17: 0xeefb574d (stale) Mirror 18: 0xeefb574d (stale) Mirror 19: 0xeefb574d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b789: skipped 000717 1772906560.801571 mapwrite 0x01ac1a thru 0x0265d6 (0xb9bd bytes) 000718 1772906560.814053 punch from 0x00e038 to 0x01183e (0x3807 bytes) 000719 1772906560.815644 write 0x0351d5 thru 0x03ffff (0xae2b bytes) 000720 1772906560.820945 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000721 1772906560.942289 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000722 1772906561.059061 read 0x024c9c thru 0x0312fc (0xc661 bytes) 000724 1772906561.062375 mapwrite 0x029a91 thru 0x02c3b4 (0x2924 bytes) 000725 1772906561.067691 trunc from 0x040000 to 0x00dfa9 (0x32056 bytes) 000726 1772906561.072903 mapwrite 0x019e2b thru 0x02007b (0x6251 bytes) 000727 1772906561.087168 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2007c): Mirror 7: 0x25c2eb2 (stale) Mirror 8: 0x25c2eb2 (stale) Mirror 10: 0x25c2eb2 (stale) Mirror 11: 0x25c2eb2 (stale) Mirror 12: 0x25c2eb2 (stale) Mirror 14: 0x25c2eb2 (stale) Mirror 15: 0x25c2eb2 (stale) Mirror 19: 0x25c2eb2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2007c): Mirror 7: 0x25c2eb2 (stale) Mirror 8: 0x25c2eb2 (stale) Mirror 10: 0x25c2eb2 (stale) Mirror 11: 0x25c2eb2 (stale) Mirror 12: 0x25c2eb2 (stale) Mirror 14: 0x25c2eb2 (stale) Mirror 15: 0x25c2eb2 (stale) Mirror 19: 0x25c2eb2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2007c: skipped 000728 1772906561.192625 mapread 0x01c221 thru 0x02007b (0x3e5b bytes) 000729 1772906561.197776 mapread 0x016530 thru 0x02007b (0x9b4c bytes) 000730 1772906561.200815 trunc from 0x00edc1 to 0x01e5f7 (0xf837 bytes) 000731 1772906561.203010 read 0x006845 thru 0x007ab0 (0x126c bytes) 000735 1772906561.206092 write 0x0385ac thru 0x03ffff (0x7a54 bytes) 000736 1772906561.208311 fallocate 0x01058a thru 0x01655c (0x5fd3 bytes) 000737 1772906561.210247 punch from 0x0210ec to 0x028ef4 (0x7e09 bytes) 000738 1772906561.211761 trunc from 0x040000 to 0x02384e (0x1c7b1 bytes) 000739 1772906561.215532 trunc from 0x02384f to 0x02380b (0x43 bytes) 000740 1772906561.219268 read 0x020569 thru 0x02089b (0x333 bytes) 000741 1772906561.219861 write 0x03f491 thru 0x03fc15 (0x785 bytes) 000742 1772906561.220813 mapwrite 0x020067 thru 0x029e4c (0x9de6 bytes) 000744 1772906561.229995 write 0x00c081 thru 0x015ea2 (0x9e22 bytes) 000745 1772906561.230788 mapwrite 0x014f0e thru 0x021ec7 (0xcfba bytes) 000746 1772906561.236944 trunc from 0x02a07d to 0x03414c (0xa0d0 bytes) 000747 1772906561.238405 mapread 0x020d78 thru 0x02f62e (0xe8b7 bytes) 000748 1772906561.246010 trunc from 0x00ec49 to 0x016cc3 (0x807b bytes) 000749 1772906561.247557 trunc from 0x0164de to 0x019d83 (0x38a6 bytes) 000750 1772906561.249163 fallocate 0x003059 thru 0x007fdd (0x4f85 bytes) 000751 1772906561.250663 punch from 0x00e87f to 0x011f9d (0x371f bytes) 000752 1772906561.252293 trunc from 0x016d64 to 0x023497 (0xc734 bytes) 000753 1772906561.253981 trunc from 0x03fc16 to 0x00cfa4 (0x32c71 bytes) 000754 1772906561.258085 mapread 0x00248f thru 0x00cfa4 (0xab16 bytes) 000755 1772906561.258878 mapwrite 0x039d11 thru 0x03ffff (0x62ef bytes) 000756 1772906561.274656 trunc from 0x040000 to 0x0107d0 (0x2f82f bytes) 000758 1772906561.278586 trunc from 0x0107d1 to 0x029c2d (0x1945d bytes) 000759 1772906561.281919 trunc from 0x029c2e to 0x006398 (0x23895 bytes) 000760 1772906561.285070 trunc from 0x006399 to 0x00d399 (0x7001 bytes) 000761 1772906561.288136 write 0x02fa1a thru 0x039bff (0xa1e6 bytes) 000762 1772906561.289057 punch from 0x02c796 to 0x038bf1 (0xc45c bytes) 000763 1772906561.292658 write 0x022e13 thru 0x02a208 (0x73f6 bytes) 000764 1772906561.295316 trunc from 0x039c00 to 0x013b75 (0x2608a bytes) 000765 1772906561.298960 mapread 0x00f9a5 thru 0x0107ca (0xe26 bytes) 000766 1772906561.301672 mapread 0x009502 thru 0x00acdf (0x17de bytes) 000767 1772906561.304079 write 0x00a6f7 thru 0x01a2fb (0xfc05 bytes) 000768 1772906561.305143 mapread 0x003910 thru 0x00f359 (0xba4a bytes) 000769 1772906561.307873 read 0x003565 thru 0x00b852 (0x82ee bytes) 000770 1772906561.308351 mapwrite 0x02413b thru 0x02f1eb (0xb0b1 bytes) 000771 1772906561.320989 write 0x02b21e thru 0x02ceca (0x1cad bytes) 000772 1772906561.321718 trunc from 0x003a16 to 0x00a46a (0x6a55 bytes) 000774 1772906561.324135 trunc from 0x002189 to 0x008fbd (0x6e35 bytes) 000775 1772906561.325975 mapread 0x00ba57 thru 0x01963f (0xdbe9 bytes) 000776 1772906561.327188 read 0x02853b thru 0x02f1eb (0x6cb1 bytes) 000779 1772906561.328584 punch from 0x006e46 to 0x0161de (0xf399 bytes) 000780 1772906561.330326 mapread 0x0076dd thru 0x016af3 (0xf417 bytes) 000781 1772906561.333940 read 0x01974c thru 0x022be1 (0x9496 bytes) 000782 1772906561.334501 punch from 0x02e08e to 0x02ebfb (0xb6e bytes) 000783 1772906561.336028 mapread 0x013746 thru 0x0169ea (0x32a5 bytes) 000784 1772906561.336952 trunc from 0x0035ed to 0x00be55 (0x8869 bytes) 000785 1772906561.338618 write 0x018d4a thru 0x022c1c (0x9ed3 bytes) 000786 1772906561.339884 trunc from 0x02f1ec to 0x015529 (0x19cc2 bytes) 000787 1772906561.343871 punch from 0x00c59d to 0x012d6c (0x67d0 bytes) 000788 1772906561.345401 read 0x00ae05 thru 0x015529 (0xa725 bytes) 000789 1772906561.348074 trunc from 0x01552a to 0x029002 (0x13ad9 bytes) 000790 1772906561.352108 punch from 0x00e4a6 to 0x015fd7 (0x7b32 bytes) 000791 1772906561.353694 read 0x015062 thru 0x0215d3 (0xc572 bytes) 000792 1772906561.356556 trunc from 0x029003 to 0x019348 (0xfcba bytes) 000793 1772906561.360041 mapread 0x00926a thru 0x00acea (0x1a81 bytes) 000794 1772906561.360689 fallocate 0x0125d8 thru 0x020174 (0xdb9d bytes) 000795 1772906561.362419 write 0x028d9b thru 0x031995 (0x8bfb bytes) 000796 1772906561.363331 mapwrite 0x019a27 thru 0x01ff76 (0x6550 bytes) 000797 1772906561.374573 mapread 0x009c33 thru 0x0118cf (0x7c9d bytes) 000798 1772906561.376972 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31996): Mirror 7: 0x585a318 (stale) Mirror 10: 0x585a318 (stale) Mirror 11: 0x585a318 (stale) Mirror 12: 0x585a318 (stale) Mirror 14: 0x585a318 (stale) Mirror 15: 0x585a318 (stale) Mirror 19: 0x585a318 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31996): Mirror 7: 0x585a318 (stale) Mirror 10: 0x585a318 (stale) Mirror 11: 0x585a318 (stale) Mirror 12: 0x585a318 (stale) Mirror 14: 0x585a318 (stale) Mirror 15: 0x585a318 (stale) Mirror 19: 0x585a318 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31996: skipped 000799 1772906561.485088 punch from 0x015817 to 0x01fae7 (0xa2d1 bytes) 000801 1772906561.488456 MIRROR_RESYNC 8 mirrors 000802 1772906561.827791 trunc from 0x031996 to 0x03d81c (0xbe87 bytes) 000803 1772906561.843353 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d81d): Mirror 7: 0x74dd7c1b (stale) Mirror 11: 0x74dd7c1b (stale) Mirror 12: 0x74dd7c1b (stale) Mirror 14: 0x74dd7c1b (stale) Mirror 15: 0x74dd7c1b (stale) Mirror 19: 0x74dd7c1b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d81d): Mirror 7: 0x74dd7c1b (stale) Mirror 11: 0x74dd7c1b (stale) Mirror 12: 0x74dd7c1b (stale) Mirror 14: 0x74dd7c1b (stale) Mirror 15: 0x74dd7c1b (stale) Mirror 19: 0x74dd7c1b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d81d: skipped 000804 1772906561.952871 trunc from 0x027ff0 to 0x028f7b (0xf8c bytes) 000806 1772906561.954926 write 0x020620 thru 0x022b4a (0x252b bytes) 000807 1772906561.958999 mapwrite 0x0169c6 thru 0x02320b (0xc846 bytes) 000808 1772906561.970928 write 0x01755a thru 0x01925f (0x1d06 bytes) 000809 1772906561.973250 MIRROR_RESYNC 7 mirrors 000810 1772906562.347095 trunc from 0x02d8eb to 0x035996 (0x80ac bytes) 000811 1772906562.356084 write 0x035c39 thru 0x037b90 (0x1f58 bytes) 000812 1772906562.358902 trunc from 0x03d81d to 0x01c64f (0x211cd bytes) 000813 1772906562.364542 read 0x011dde thru 0x019ae2 (0x7d05 bytes) 000814 1772906562.367520 fallocate 0x02d8e9 thru 0x033585 (0x5c9d bytes) 000815 1772906562.369714 mapread 0x014b06 thru 0x015cea (0x11e5 bytes) 000816 1772906562.370771 mapread 0x013b7c thru 0x01a3f1 (0x6876 bytes) 000817 1772906562.373502 fallocate 0x016e8b thru 0x01b130 (0x42a6 bytes) 000818 1772906562.375495 mapread 0x00a07d thru 0x017b7a (0xdafe bytes) 000819 1772906562.379061 mapwrite 0x035259 thru 0x03b874 (0x661c bytes) 000820 1772906562.390788 write 0x00af28 thru 0x013374 (0x844d bytes) 000821 1772906562.391876 punch from 0x012fe1 to 0x01ef7a (0xbf9a bytes) 000822 1772906562.396113 write 0x03a000 thru 0x03ffff (0x6000 bytes) 000823 1772906562.398366 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x18097a78 (stale) Mirror 11: 0x18097a78 (stale) Mirror 12: 0x18097a78 (stale) Mirror 14: 0x18097a78 (stale) Mirror 15: 0x18097a78 (stale) Mirror 19: 0x18097a78 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3e2a4eea Mirror 20: 0x3e2a4eea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000824 1772906562.637579 punch from 0x0020a6 to 0x004433 (0x238e bytes) 000825 1772906562.648667 trunc from 0x0354e7 to 0x03ffff (0xab19 bytes) 000826 1772906562.651782 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x18097a78 (stale) Mirror 11: 0x18097a78 (stale) Mirror 12: 0x18097a78 (stale) Mirror 14: 0x18097a78 (stale) Mirror 15: 0x18097a78 (stale) Mirror 19: 0x18097a78 (stale) Mirror 20: 0x3e2a4eea (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xad29d4fd Mirror 21: 0xad29d4fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000828 1772906562.898867 write 0x0071c9 thru 0x00fab9 (0x88f1 bytes) 000831 1772906562.913720 write 0x029f85 thru 0x0354cb (0xb547 bytes) 000832 1772906562.918685 trunc from 0x034c47 to 0x036cfd (0x20b7 bytes) 000833 1772906562.922258 read 0x00d1f6 thru 0x010ea3 (0x3cae bytes) 000834 1772906562.924069 write 0x0230f1 thru 0x02c58a (0x949a bytes) 000835 1772906562.924997 write 0x026551 thru 0x028715 (0x21c5 bytes) 000836 1772906562.925865 mapwrite 0x006441 thru 0x00d86b (0x742b bytes) 000837 1772906562.937082 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x18097a78 (stale) Mirror 11: 0x18097a78 (stale) Mirror 14: 0x18097a78 (stale) Mirror 15: 0x18097a78 (stale) Mirror 19: 0x18097a78 (stale) Mirror 20: 0x3e2a4eea (stale) Mirror 21: 0xad29d4fd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x18097a78 (stale) Mirror 11: 0x18097a78 (stale) Mirror 14: 0x18097a78 (stale) Mirror 15: 0x18097a78 (stale) Mirror 19: 0x18097a78 (stale) Mirror 20: 0x3e2a4eea (stale) Mirror 21: 0xad29d4fd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000838 1772906563.063796 mapwrite 0x03efb2 thru 0x03ffff (0x104e bytes) 000839 1772906563.073040 trunc from 0x040000 to 0x0104bb (0x2fb44 bytes) 000840 1772906563.083526 trunc from 0x0104bc to 0x02c247 (0x1bd8c bytes) 000841 1772906563.087439 fallocate 0x0140b6 thru 0x01b8b0 (0x77fb bytes) 000842 1772906563.089138 mapread 0x018855 thru 0x01c496 (0x3c42 bytes) 000843 1772906563.092116 trunc from 0x02c248 to 0x0383a7 (0xc160 bytes) 000844 1772906563.096354 write 0x011198 thru 0x017220 (0x6089 bytes) 000845 1772906563.097546 trunc from 0x00ca57 to 0x00d6c3 (0xc6d bytes) 000846 1772906563.099261 write 0x032c2e thru 0x03b8f5 (0x8cc8 bytes) 000847 1772906563.102215 mapread 0x00a07e thru 0x0169d4 (0xc957 bytes) 000848 1772906563.105126 trunc from 0x03b8f6 to 0x036f7a (0x497b bytes) 000849 1772906563.109112 trunc from 0x036f7b to 0x016081 (0x20ef9 bytes) 000850 1772906563.113534 write 0x03e59f thru 0x03ffff (0x1a61 bytes) 000851 1772906563.114595 trunc from 0x007c7f to 0x012acb (0xae4d bytes) 000852 1772906563.118536 read 0x01a9b1 thru 0x028d5b (0xe3ab bytes) 000853 1772906563.121142 punch from 0x00cf3a to 0x01b892 (0xe959 bytes) 000854 1772906563.122623 trunc from 0x0252d1 to 0x02bb77 (0x68a7 bytes) 000855 1772906563.124097 mapwrite 0x020af0 thru 0x02a738 (0x9c49 bytes) 000857 1772906563.133499 fallocate 0x017d72 thru 0x023f34 (0xc1c3 bytes) 000858 1772906563.135663 fallocate 0x02b1fa thru 0x032de6 (0x7bed bytes) 000859 1772906563.137483 trunc from 0x040000 to 0x017e35 (0x281ca bytes) 000860 1772906563.143294 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x17e36): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17e36): Mirror 7: 0x31426a7e (stale) Mirror 11: 0x31426a7e (stale) Mirror 14: 0x31426a7e (stale) Mirror 15: 0x31426a7e (stale) Mirror 19: 0x31426a7e (stale) Mirror 20: 0x9354966d (stale) Mirror 21: 0x9354966d (stale) CRC-32 checksum value for chunk [0, 0x17e36): Mirror 1: 0xf965db31 Mirror 22: 0xf965db31 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17e36: skipped 000861 1772906563.374727 fallocate 0x011e96 thru 0x018357 (0x64c2 bytes) 000862 1772906563.385125 read 0x0041d1 thru 0x014173 (0xffa3 bytes) 000863 1772906563.387799 punch from 0x00c6f3 to 0x0120c0 (0x59ce bytes) 000864 1772906563.389427 trunc from 0x00143c to 0x00856a (0x712f bytes) 000866 1772906563.391380 trunc from 0x010d25 to 0x018357 (0x7633 bytes) 000867 1772906563.392825 trunc from 0x018358 to 0x013503 (0x4e54 bytes) 000868 1772906563.402359 fallocate 0x02cc20 thru 0x03284b (0x5c2c bytes) 000869 1772906563.405271 MIRROR_RESYNC 9 mirrors 000870 1772906563.722082 punch from 0x008ac6 to 0x012e7b (0xa3b6 bytes) 000871 1772906563.732498 mapwrite 0x008f7a thru 0x010c0a (0x7c91 bytes) 000872 1772906563.744806 trunc from 0x00625b to 0x00c7f5 (0x659b bytes) 000873 1772906563.747098 mapwrite 0x01ca4d thru 0x02c16d (0xf721 bytes) 000874 1772906563.775707 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c16e): Mirror 7: 0x46635a37 (stale) Mirror 11: 0x46635a37 (stale) Mirror 14: 0x46635a37 (stale) Mirror 15: 0x46635a37 (stale) Mirror 19: 0x46635a37 (stale) Mirror 20: 0x46635a37 (stale) Mirror 22: 0x46635a37 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c16e): Mirror 7: 0x46635a37 (stale) Mirror 11: 0x46635a37 (stale) Mirror 14: 0x46635a37 (stale) Mirror 15: 0x46635a37 (stale) Mirror 19: 0x46635a37 (stale) Mirror 20: 0x46635a37 (stale) Mirror 22: 0x46635a37 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c16e: skipped 000875 1772906563.899767 mapread 0x009866 thru 0x00b385 (0x1b20 bytes) 000876 1772906563.905771 mapread 0x008de8 thru 0x012896 (0x9aaf bytes) 000877 1772906563.907616 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c16e): Mirror 7: 0x46635a37 (stale) Mirror 11: 0x46635a37 (stale) Mirror 14: 0x46635a37 (stale) Mirror 19: 0x46635a37 (stale) Mirror 20: 0x46635a37 (stale) Mirror 22: 0x46635a37 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c16e): Mirror 7: 0x46635a37 (stale) Mirror 11: 0x46635a37 (stale) Mirror 14: 0x46635a37 (stale) Mirror 19: 0x46635a37 (stale) Mirror 20: 0x46635a37 (stale) Mirror 22: 0x46635a37 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c16e: skipped 000878 1772906564.014901 mapwrite 0x00d1a4 thru 0x018304 (0xb161 bytes) 000879 1772906564.027438 trunc from 0x00162d to 0x00bd32 (0xa706 bytes) 000880 1772906564.030167 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c16e): Mirror 11: 0x46635a37 (stale) Mirror 14: 0x46635a37 (stale) Mirror 19: 0x46635a37 (stale) Mirror 20: 0x46635a37 (stale) Mirror 22: 0x46635a37 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c16e): Mirror 11: 0x46635a37 (stale) Mirror 14: 0x46635a37 (stale) Mirror 19: 0x46635a37 (stale) Mirror 20: 0x46635a37 (stale) Mirror 22: 0x46635a37 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c16e: skipped 000881 1772906564.125307 write 0x01e60a thru 0x02d8a2 (0xf299 bytes) 000882 1772906564.128464 trunc from 0x02d8a3 to 0x03a317 (0xca75 bytes) 000883 1772906564.132067 trunc from 0x021536 to 0x02a480 (0x8f4b bytes) 000884 1772906564.136005 mapwrite 0x021259 thru 0x021e16 (0xbbe bytes) 000885 1772906564.141170 mapwrite 0x032e21 thru 0x0365f6 (0x37d6 bytes) 000886 1772906564.148414 mapwrite 0x004b10 thru 0x008a9d (0x3f8e bytes) 000887 1772906564.155693 mapwrite 0x016050 thru 0x023119 (0xd0ca bytes) 000888 1772906564.166943 read 0x02fd41 thru 0x03a317 (0xa5d7 bytes) 000889 1772906564.167678 read 0x0370eb thru 0x03a317 (0x322d bytes) 000891 1772906564.168822 fallocate 0x02c514 thru 0x0353a1 (0x8e8e bytes) 000892 1772906564.171061 trunc from 0x0198fe to 0x0214ab (0x7bae bytes) 000893 1772906564.173072 fallocate 0x00c13f thru 0x015529 (0x93eb bytes) 000894 1772906564.175279 trunc from 0x03a318 to 0x02555c (0x14dbb bytes) 000896 1772906564.180820 mapread 0x0166e5 thru 0x024b8f (0xe4ab bytes) 000897 1772906564.184658 trunc from 0x02555d to 0x008818 (0x1cd44 bytes) 000898 1772906564.189517 write 0x0313c6 thru 0x03ffff (0xec3a bytes) 000899 1772906564.190875 write 0x013602 thru 0x014118 (0xb17 bytes) 000900 1772906564.195082 mapwrite 0x002047 thru 0x003256 (0x1210 bytes) 000903 1772906564.202696 trunc from 0x03da58 to 0x03ffff (0x25a8 bytes) 000905 1772906564.205401 punch from 0x034c02 to 0x03ffff (0xb3fe bytes) 000906 1772906564.207523 mapwrite 0x00e697 thru 0x01e1ae (0xfb18 bytes) 000907 1772906564.237060 write 0x027ae3 thru 0x030a91 (0x8faf bytes) 000908 1772906564.238444 read 0x034aa5 thru 0x036b3d (0x2099 bytes) 000909 1772906564.242299 read 0x020ea4 thru 0x02b372 (0xa4cf bytes) 000910 1772906564.243023 mapwrite 0x03670d thru 0x039878 (0x316c bytes) 000911 1772906564.250328 mapread 0x032f4d thru 0x033b57 (0xc0b bytes) 000912 1772906564.251328 punch from 0x030b82 to 0x032bcc (0x204b bytes) 000913 1772906564.253799 mapwrite 0x032383 thru 0x036620 (0x429e bytes) 000914 1772906564.263444 punch from 0x028537 to 0x0360d6 (0xdba0 bytes) 000915 1772906564.265494 write 0x001759 thru 0x003a98 (0x2340 bytes) 000917 1772906564.266691 trunc from 0x003d21 to 0x00e68e (0xa96e bytes) 000918 1772906564.271186 read 0x02af55 thru 0x03277b (0x7827 bytes) 000919 1772906564.275953 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 20: 0xe20eea22 (stale) Mirror 22: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9926ddbf Mirror 23: 0x9926ddbf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000920 1772906564.507034 mapwrite 0x02efb2 thru 0x03ef7e (0xffcd bytes) 000922 1772906564.548803 punch from 0x00a5b1 to 0x00c098 (0x1ae8 bytes) 000923 1772906564.552317 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 20: 0xe20eea22 (stale) Mirror 22: 0xe20eea22 (stale) Mirror 23: 0x9926ddbf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 20: 0xe20eea22 (stale) Mirror 22: 0xe20eea22 (stale) Mirror 23: 0x9926ddbf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000925 1772906564.667365 punch from 0x01cfb2 to 0x01f251 (0x22a0 bytes) 000926 1772906564.669279 mapread 0x004061 thru 0x0098dd (0x587d bytes) 000927 1772906564.674993 punch from 0x03c07f to 0x03ffff (0x3f81 bytes) 000928 1772906564.676829 trunc from 0x003845 to 0x004921 (0x10dd bytes) 000929 1772906564.678650 fallocate 0x009daa thru 0x0126be (0x8915 bytes) 000930 1772906564.680479 punch from 0x01c8ef to 0x01d986 (0x1098 bytes) 000931 1772906564.682082 read 0x038622 thru 0x03ffff (0x79de bytes) 000932 1772906564.684827 fallocate 0x007074 thru 0x007874 (0x801 bytes) 000934 1772906564.686716 mapread 0x01e3d5 thru 0x0227fc (0x4428 bytes) 000935 1772906564.689398 write 0x02c1a4 thru 0x03a01e (0xde7b bytes) 000936 1772906564.695018 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 20: 0xe20eea22 (stale) Mirror 22: 0xe20eea22 (stale) Mirror 23: 0x9926ddbf (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa37b9519 Mirror 24: 0xa37b9519 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000938 1772906564.947619 trunc from 0x040000 to 0x035214 (0xadeb bytes) 000940 1772906564.966875 fallocate 0x0164c7 thru 0x01c858 (0x6392 bytes) 000941 1772906564.968841 read 0x002ca5 thru 0x009654 (0x69b0 bytes) 000942 1772906564.971684 read 0x01a665 thru 0x0226dd (0x8079 bytes) 000943 1772906564.975014 mapwrite 0x03743b thru 0x03ffff (0x8bc5 bytes) 000944 1772906564.987832 write 0x03d604 thru 0x03fe83 (0x2880 bytes) 000945 1772906564.988529 mapread 0x03a8ef thru 0x03bede (0x15f0 bytes) 000946 1772906564.989193 mapread 0x02f018 thru 0x032c0a (0x3bf3 bytes) 000948 1772906564.990346 punch from 0x03b221 to 0x03ffff (0x4ddf bytes) 000949 1772906564.993114 mapread 0x02a772 thru 0x036a51 (0xc2e0 bytes) 000950 1772906564.994348 fallocate 0x015865 thru 0x01c8b8 (0x7054 bytes) 000951 1772906564.996429 mapwrite 0x02af02 thru 0x035b6e (0xac6d bytes) 000952 1772906565.004984 MIRROR_RESYNC 7 mirrors 000953 1772906565.504541 trunc from 0x040000 to 0x02b1e0 (0x14e1f bytes) 000954 1772906565.513515 punch from 0x00edd0 to 0x01ade4 (0xc015 bytes) 000955 1772906565.514916 fallocate 0x03e3b8 thru 0x03ffff (0x1c48 bytes) 000956 1772906565.516451 trunc from 0x040000 to 0x02db90 (0x1246f bytes) 000957 1772906565.521290 read 0x00a816 thru 0x00ee91 (0x467c bytes) 000958 1772906565.523757 punch from 0x024a25 to 0x02db90 (0x916c bytes) 000959 1772906565.525080 mapwrite 0x03e050 thru 0x03ffff (0x1fb0 bytes) 000961 1772906565.535498 fallocate 0x02b9db thru 0x033f93 (0x85b9 bytes) 000962 1772906565.538430 MIRROR_RESYNC 7 mirrors 000963 1772906565.881698 write 0x00dcfc thru 0x01d7f2 (0xfaf7 bytes) 000964 1772906565.892355 trunc from 0x040000 to 0x003cfc (0x3c303 bytes) 000966 1772906565.901871 fallocate 0x0399e5 thru 0x03ffff (0x661b bytes) 000968 1772906565.905269 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x36c84adb (stale) Mirror 19: 0x36c84adb (stale) Mirror 20: 0x36c84adb (stale) Mirror 22: 0x36c84adb (stale) Mirror 23: 0x36c84adb (stale) Mirror 24: 0x36c84adb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x14931f93 Mirror 25: 0x14931f93 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000970 1772906566.113692 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x36c84adb (stale) Mirror 19: 0x36c84adb (stale) Mirror 20: 0x36c84adb (stale) Mirror 22: 0x36c84adb (stale) Mirror 23: 0x36c84adb (stale) Mirror 24: 0x36c84adb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x14931f93 Mirror 25: 0x14931f93 Mirror 26: 0x14931f93 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000972 1772906566.321943 mapread 0x01d5b5 thru 0x0245e5 (0x7031 bytes) 000973 1772906566.327678 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x36c84adb (stale) Mirror 19: 0x36c84adb (stale) Mirror 20: 0x36c84adb (stale) Mirror 22: 0x36c84adb (stale) Mirror 23: 0x36c84adb (stale) Mirror 24: 0x36c84adb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x14931f93 Mirror 25: 0x14931f93 Mirror 26: 0x14931f93 Mirror 27: 0x14931f93 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000974 1772906566.549560 trunc from 0x040000 to 0x023de5 (0x1c21a bytes) 000975 1772906566.566924 mapread 0x01ba44 thru 0x023de5 (0x83a2 bytes) 000976 1772906566.571833 mapread 0x0207de thru 0x023de5 (0x3608 bytes) 000977 1772906566.572483 mapwrite 0x02f369 thru 0x039093 (0x9d2b bytes) 000978 1772906566.585645 trunc from 0x019754 to 0x019ff3 (0x8a0 bytes) 000979 1772906566.587007 trunc from 0x0050de to 0x0073b9 (0x22dc bytes) 000981 1772906566.588730 trunc from 0x010392 to 0x01f4b5 (0xf124 bytes) 000982 1772906566.590156 mapwrite 0x016917 thru 0x01e248 (0x7932 bytes) 000983 1772906566.599736 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x839:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39094): Mirror 19: 0x6eb8b044 (stale) Mirror 20: 0x6eb8b044 (stale) Mirror 22: 0x6eb8b044 (stale) Mirror 23: 0x6eb8b044 (stale) Mirror 24: 0x6eb8b044 (stale) Mirror 25: 0x5b2d0461 (stale) Mirror 26: 0x5b2d0461 (stale) Mirror 27: 0x5b2d0461 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39094): Mirror 19: 0x6eb8b044 (stale) Mirror 20: 0x6eb8b044 (stale) Mirror 22: 0x6eb8b044 (stale) Mirror 23: 0x6eb8b044 (stale) Mirror 24: 0x6eb8b044 (stale) Mirror 25: 0x5b2d0461 (stale) Mirror 26: 0x5b2d0461 (stale) Mirror 27: 0x5b2d0461 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39094: skipped 000984 1772906566.715263 mapwrite 0x0024ec thru 0x0080aa (0x5bbf bytes) 000985 1772906566.725318 mapwrite 0x0248dd thru 0x033059 (0xe77d bytes) 000986 1772906566.736881 mapwrite 0x013fde thru 0x0157d1 (0x17f4 bytes) 000987 1772906566.742788 mapread 0x00dacb thru 0x01ce34 (0xf36a bytes) 000988 1772906566.744684 read 0x000c9f thru 0x0035b2 (0x2914 bytes) 000990 1772906566.746547 punch from 0x01fece to 0x029c6b (0x9d9e bytes) 000991 1772906566.748244 trunc from 0x036a25 to 0x039093 (0x266f bytes) 000992 1772906566.749830 read 0x017b24 thru 0x01dfe9 (0x64c6 bytes) 000993 1772906566.750549 trunc from 0x039094 to 0x017bc1 (0x214d2 bytes) 000994 1772906566.755992 write 0x021c4a thru 0x027c06 (0x5fbd bytes) 000995 1772906566.756843 trunc from 0x00c636 to 0x00d221 (0xbec bytes) 000997 1772906566.758725 read 0x017cc6 thru 0x018df1 (0x112c bytes) 000998 1772906566.760798 mapwrite 0x005748 thru 0x015181 (0xfa3a bytes) 000999 1772906566.767683 trunc from 0x027c07 to 0x015a63 (0x121a3 bytes) 001000 1772906566.771358 punch from 0x00163c to 0x0111b3 (0xfb78 bytes) All operations completed A-OK!