== sanity-flr test 70a: flr mode fsx test ================ 21:39:43 (1788831583) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 1585 skipping zero size read skipping zero size read 000003 1788831585.844040 write 0x016d01 thru 0x01cf05 (0x6205 bytes) 000004 1788831585.851098 trunc from 0x01138a to 0x016daf (0x5a26 bytes) truncating to largest ever: 0x2f89a 000005 1788831585.882114 trunc from 0x01cf06 to 0x02f899 (0x12994 bytes) 000008 1788831585.896676 trunc from 0x02f89a to 0x009ad8 (0x25dc1 bytes) 000009 1788831585.917996 read 0x002d61 thru 0x009ad8 (0x6d78 bytes) 000010 1788831585.928939 punch from 0x004559 to 0x009ad8 (0x5580 bytes) 000011 1788831585.934971 mapwrite 0x010f96 thru 0x0152c3 (0x432e bytes) 000012 1788831585.999211 trunc from 0x0152c4 to 0x02cb15 (0x17852 bytes) 000013 1788831586.039487 read 0x013be5 thru 0x0206d4 (0xcaf0 bytes) 000014 1788831586.068507 write 0x02e203 thru 0x0344b9 (0x62b7 bytes) 000015 1788831586.072211 mapwrite 0x00a57e thru 0x00dc07 (0x368a bytes) 000016 1788831586.122114 write 0x025067 thru 0x025467 (0x401 bytes) 000017 1788831586.123034 write 0x0208e0 thru 0x0281f0 (0x7911 bytes) 000018 1788831586.124244 trunc from 0x0344ba to 0x014da7 (0x1f712 bytes) 000019 1788831586.152625 write 0x00ac09 thru 0x01913c (0xe534 bytes) 000020 1788831586.156567 trunc from 0x017395 to 0x01913c (0x1da8 bytes) 000021 1788831586.191978 trunc from 0x0109e6 to 0x012617 (0x1c32 bytes) fallocating to largest ever: 0x3d2d5 000023 1788831586.204355 fallocate 0x036d9f thru 0x03d2d4 (0x6536 bytes) 000024 1788831586.214091 fallocate 0x005fea thru 0x00f645 (0x965c bytes) 000025 1788831586.219698 punch from 0x0114de to 0x01913c (0x7c5f bytes) fallocating to largest ever: 0x3fc07 000026 1788831586.230471 fallocate 0x030e2b thru 0x03fc06 (0xeddc bytes) 000027 1788831586.240842 punch from 0x00ee1b to 0x01107e (0x2264 bytes) 000028 1788831586.256529 mapwrite 0x02f13c thru 0x030665 (0x152a bytes) 000029 1788831586.307479 trunc from 0x03fc07 to 0x024961 (0x1b2a5 bytes) 000031 1788831586.325255 read 0x024778 thru 0x024961 (0x1ea bytes) 000032 1788831586.336007 write 0x02e160 thru 0x03266a (0x450b bytes) 000033 1788831586.337268 mapread 0x027f41 thru 0x03266a (0xa72a bytes) 000034 1788831586.345090 mapwrite 0x00ea77 thru 0x01c332 (0xd8bc bytes) 000035 1788831586.373364 trunc from 0x025bfc to 0x0298bd (0x3cc2 bytes) 000036 1788831586.378827 trunc from 0x0246f3 to 0x0264a2 (0x1db0 bytes) fallocating to largest ever: 0x40000 000037 1788831586.385449 fallocate 0x039c70 thru 0x03ffff (0x6390 bytes) 000038 1788831586.392064 punch from 0x003eb6 to 0x0041f6 (0x341 bytes) 000039 1788831586.397177 punch from 0x01d961 to 0x01ebdd (0x127d bytes) 000040 1788831586.403138 mapread 0x0293c2 thru 0x02a275 (0xeb4 bytes) 000041 1788831586.414767 mapread 0x028f9a thru 0x035551 (0xc5b8 bytes) 000042 1788831586.420617 punch from 0x02af7f to 0x03a586 (0xf608 bytes) 000043 1788831586.426137 write 0x037cb7 thru 0x03e452 (0x679c bytes) 000044 1788831586.433098 trunc from 0x02ab66 to 0x03428e (0x9729 bytes) 000045 1788831586.442418 MIRROR_EXTEND to 2 mirrors 000046 1788831587.040041 punch from 0x02cd7b to 0x036d38 (0x9fbe bytes) 000047 1788831587.077409 trunc from 0x040000 to 0x009dee (0x36211 bytes) 000048 1788831587.139718 write 0x00211d thru 0x00b2f0 (0x91d4 bytes) 000049 1788831587.151476 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) 000050 1788831587.345142 write 0x0206d4 thru 0x0279fc (0x7329 bytes) 000051 1788831587.350497 write 0x03f0e7 thru 0x03ffff (0xf19 bytes) 000052 1788831587.355652 punch from 0x02bf59 to 0x032b3d (0x6be5 bytes) 000054 1788831587.361885 fallocate 0x0070c0 thru 0x00dd01 (0x6c42 bytes) 000055 1788831587.367701 trunc from 0x040000 to 0x038fb0 (0x704f bytes) 000056 1788831587.386929 trunc from 0x00ccc5 to 0x019acc (0xce08 bytes) 000057 1788831587.392510 punch from 0x0048a8 to 0x00dd63 (0x94bc bytes) 000059 1788831587.399358 mapread 0x0130e0 thru 0x01aacc (0x79ed bytes) 000060 1788831587.437254 MIRROR_EXTEND to 2 mirrors 000062 1788831588.328460 mapread 0x027185 thru 0x035fd5 (0xee51 bytes) 000063 1788831588.459427 mapwrite 0x00329f thru 0x0088b6 (0x5618 bytes) 000064 1788831588.616151 trunc from 0x037400 to 0x038fb0 (0x1bb1 bytes) 000065 1788831588.628336 fallocate 0x03788c thru 0x038cbe (0x1433 bytes) 000066 1788831588.634739 trunc from 0x038fb1 to 0x030f83 (0x802d bytes) 000067 1788831588.697286 write 0x032cc9 thru 0x034bb6 (0x1eee bytes) 000068 1788831588.698916 trunc from 0x000af0 to 0x0020e9 (0x15fa bytes) 000069 1788831588.705215 read 0x023d79 thru 0x032e50 (0xf0d8 bytes) 000070 1788831588.715246 fallocate 0x02eb4d thru 0x037313 (0x87c7 bytes) 000071 1788831588.720538 fallocate 0x03f38e thru 0x03ffff (0xc72 bytes) 000072 1788831588.725878 trunc from 0x026602 to 0x02cf1a (0x6919 bytes) 000073 1788831588.731449 trunc from 0x040000 to 0x03e89f (0x1760 bytes) 000074 1788831588.753126 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e8a0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e8a0): Mirror 2: 0xf7610e4e (stale) CRC-32 checksum value for chunk [0, 0x3e8a0): Mirror 1: 0xe7522cbf Mirror 3: 0xe7522cbf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e8a0: skipped 000075 1788831589.941740 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) 000076 1788831590.322814 read 0x00f66a thru 0x01aead (0xb844 bytes) 000077 1788831590.354775 mapread 0x013503 thru 0x01c4d7 (0x8fd5 bytes) 000078 1788831590.420051 write 0x00e13f thru 0x016039 (0x7efb bytes) 000079 1788831590.489713 read 0x0337e2 thru 0x03d783 (0x9fa2 bytes) 000080 1788831590.501126 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) 000081 1788831590.751214 MIRROR_EXTEND to 2 mirrors 000082 1788831591.718025 write 0x0373ce thru 0x03b615 (0x4248 bytes) 000084 1788831591.782113 read 0x01cb09 thru 0x01e1f6 (0x16ee bytes) 000085 1788831591.793129 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e8a0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e8a0): Mirror 2: 0x9bb67be2 (stale) CRC-32 checksum value for chunk [0, 0x3e8a0): Mirror 1: 0x57d6b185 Mirror 3: 0x57d6b185 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e8a0: skipped 000086 1788831592.797902 trunc from 0x03e8a0 to 0x03cfad (0x18f2 bytes) 000087 1788831592.854262 fallocate 0x02e6ee thru 0x031f50 (0x3863 bytes) 000088 1788831592.859659 mapwrite 0x02db46 thru 0x03238c (0x4847 bytes) 000089 1788831592.899819 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cfae): Mirror 3: 0x7c842d97 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cfae): Mirror 3: 0x7c842d97 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cfae: skipped 000090 1788831593.157359 punch from 0x0376c1 to 0x03cfad (0x58ed bytes) 000091 1788831593.161303 mapwrite 0x0352e2 thru 0x03b536 (0x6255 bytes) 000092 1788831593.183340 mapwrite 0x00f75d thru 0x018719 (0x8fbd bytes) 000093 1788831593.235733 mapread 0x020707 thru 0x030706 (0x10000 bytes) 000094 1788831593.279042 read 0x0269c9 thru 0x02e818 (0x7e50 bytes) 000095 1788831593.279781 write 0x02b0a5 thru 0x037fc8 (0xcf24 bytes) 000096 1788831593.304985 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3cfae): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cfae): Mirror 3: 0x7c842d97 (stale) CRC-32 checksum value for chunk [0, 0x3cfae): Mirror 1: 0xa95f2d2d Mirror 4: 0xa95f2d2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cfae: skipped 000097 1788831594.362918 trunc from 0x00edc7 to 0x010afd (0x1d37 bytes) 000098 1788831594.444584 mapwrite 0x03882d thru 0x039340 (0xb14 bytes) 000100 1788831594.480988 mapwrite 0x02a588 thru 0x02c6e0 (0x2159 bytes) 000101 1788831594.533085 fallocate 0x019ee1 thru 0x027b9f (0xdcbf bytes) 000102 1788831594.543635 trunc from 0x018ac6 to 0x01fd69 (0x72a4 bytes) 000103 1788831594.555323 fallocate 0x00bb27 thru 0x00cb6e (0x1048 bytes) 000104 1788831594.562163 trunc from 0x03cfae to 0x02fa38 (0xd575 bytes) 000105 1788831594.613010 read 0x0113db thru 0x0130d4 (0x1cfa bytes) 000106 1788831594.623830 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fa39): Mirror 3: 0x446c85b0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fa39): Mirror 3: 0x446c85b0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fa39: skipped 000107 1788831594.878259 mapread 0x0216d0 thru 0x02f390 (0xdcc1 bytes) 000108 1788831594.915597 trunc from 0x01bf8b to 0x02aa0b (0xea81 bytes) 000109 1788831594.930154 mapread 0x018af7 thru 0x0274e0 (0xe9ea bytes) 000110 1788831594.970523 write 0x00a5e0 thru 0x018365 (0xdd86 bytes) 000111 1788831594.985308 trunc from 0x006e36 to 0x0143ae (0xd579 bytes) 000112 1788831595.011966 punch from 0x016db9 to 0x016de3 (0x2b bytes) 000114 1788831595.021597 fallocate 0x003188 thru 0x00cf56 (0x9dcf bytes) 000115 1788831595.033316 punch from 0x01bee3 to 0x02abd7 (0xecf5 bytes) 000116 1788831595.056868 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) 000117 1788831595.241619 read 0x01dae2 thru 0x021ac5 (0x3fe4 bytes) 000119 1788831595.251455 mapwrite 0x0361b7 thru 0x03ffff (0x9e49 bytes) 000120 1788831595.306120 read 0x0347f1 thru 0x03b1b7 (0x69c7 bytes) 000124 1788831595.311581 punch from 0x012f7b to 0x01f678 (0xc6fe bytes) 000125 1788831595.318076 read 0x02bdc3 thru 0x03543d (0x967b bytes) 000126 1788831595.332537 punch from 0x00001f to 0x0044ab (0x448d bytes) 000127 1788831595.337717 fallocate 0x00cfe8 thru 0x015b07 (0x8b20 bytes) 000128 1788831595.343541 mapwrite 0x004cb7 thru 0x00cbb6 (0x7f00 bytes) 000129 1788831595.401660 write 0x02f43e thru 0x03dfd0 (0xeb93 bytes) 000130 1788831595.407874 read 0x011b31 thru 0x01bd04 (0xa1d4 bytes) 000131 1788831595.410191 mapread 0x03eabf thru 0x03ffff (0x1541 bytes) 000132 1788831595.417126 punch from 0x020cb4 to 0x02fc61 (0xefae bytes) 000133 1788831595.477658 MIRROR_EXTEND to 2 mirrors 000135 1788831596.847767 read 0x00a074 thru 0x0178b0 (0xd83d bytes) 000136 1788831596.879688 punch from 0x0295b7 to 0x029caf (0x6f9 bytes) 000137 1788831596.968930 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) 000138 1788831597.118906 mapread 0x013d3e thru 0x01c00a (0x82cd bytes) 000139 1788831597.154503 punch from 0x03c2c0 to 0x03ffff (0x3d40 bytes) 000141 1788831597.159125 mapwrite 0x023a38 thru 0x026bfa (0x31c3 bytes) 000142 1788831597.196581 trunc from 0x01980b to 0x02554f (0xbd45 bytes) 000143 1788831597.204635 read 0x0201e8 thru 0x021943 (0x175c bytes) 000147 1788831597.223159 punch from 0x03fb41 to 0x03ffff (0x4bf bytes) 000148 1788831597.230040 punch from 0x038bd6 to 0x03ffff (0x742a bytes) 000149 1788831597.239151 write 0x0024b8 thru 0x009d33 (0x787c bytes) 000150 1788831597.270348 mapread 0x013347 thru 0x01866f (0x5329 bytes) 000151 1788831597.271899 write 0x01a722 thru 0x026267 (0xbb46 bytes) 000152 1788831597.289269 write 0x00ac67 thru 0x019fa6 (0xf340 bytes) 000153 1788831597.308949 write 0x031455 thru 0x03700b (0x5bb7 bytes) 000154 1788831597.335105 punch from 0x0128e4 to 0x0175be (0x4cdb bytes) 000157 1788831597.363573 mapread 0x0118b1 thru 0x01c1ca (0xa91a bytes) 000158 1788831597.376300 mapwrite 0x02891b thru 0x0382f4 (0xf9da bytes) 000160 1788831597.484193 mapread 0x013e6a thru 0x02171c (0xd8b3 bytes) 000161 1788831597.487132 mapwrite 0x02dcd5 thru 0x02ddb2 (0xde bytes) 000162 1788831597.525155 MIRROR_EXTEND to 2 mirrors 000165 1788831598.708074 trunc from 0x040000 to 0x01bec3 (0x2413c bytes) 000166 1788831598.802858 trunc from 0x00f71b to 0x011019 (0x18ff bytes) 000167 1788831598.813042 fallocate 0x037d62 thru 0x03f01d (0x72bc bytes) 000168 1788831598.841081 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1bec4): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bec4): Mirror 2: 0x136123b6 (stale) CRC-32 checksum value for chunk [0, 0x1bec4): Mirror 1: 0x23b1bbe8 Mirror 3: 0x23b1bbe8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bec4: skipped 000169 1788831600.392060 trunc from 0x00c26f to 0x01422d (0x7fbf bytes) 000170 1788831600.478848 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1bec4): Mirror 3: 0x23b1bbe8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bec4): Mirror 3: 0x23b1bbe8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bec4: skipped 000171 1788831600.816792 write 0x022c14 thru 0x031b50 (0xef3d bytes) 000172 1788831600.826048 mapwrite 0x029311 thru 0x02fc42 (0x6932 bytes) 000173 1788831600.849109 MIRROR_RESYNC 2 mirrors 000174 1788831601.871341 punch from 0x002cdc to 0x00375d (0xa82 bytes) 000175 1788831601.957923 fallocate 0x034c28 thru 0x03f62e (0xaa07 bytes) 000177 1788831601.979066 read 0x0195f9 thru 0x01c6a9 (0x30b1 bytes) 000178 1788831601.992677 trunc from 0x03ec2d to 0x03f62e (0xa02 bytes) 000179 1788831602.003041 mapread 0x02148c thru 0x02522b (0x3da0 bytes) 000180 1788831602.050715 mapwrite 0x01185c thru 0x0163d6 (0x4b7b bytes) 000181 1788831602.134259 write 0x0010e6 thru 0x010ba3 (0xfabe bytes) 000182 1788831602.146545 read 0x00e9c1 thru 0x00ec41 (0x281 bytes) 000183 1788831602.157331 read 0x0327c3 thru 0x03f62e (0xce6c bytes) 000184 1788831602.230191 write 0x039d3e thru 0x03ffff (0x62c2 bytes) 000185 1788831602.242979 fallocate 0x00549e thru 0x00f10f (0x9c72 bytes) 000186 1788831602.275777 write 0x02e8a4 thru 0x0331db (0x4938 bytes) 000187 1788831602.283025 mapwrite 0x039944 thru 0x03ffff (0x66bc bytes) 000188 1788831602.332457 mapread 0x03d301 thru 0x03ffff (0x2cff bytes) 000189 1788831602.333365 read 0x03d2e8 thru 0x03ffff (0x2d18 bytes) 000190 1788831602.334030 read 0x000f77 thru 0x006d4f (0x5dd9 bytes) 000191 1788831602.335716 write 0x02f5de thru 0x037c4c (0x866f bytes) 000192 1788831602.337330 trunc from 0x040000 to 0x00291c (0x3d6e3 bytes) 000193 1788831602.404347 write 0x03ba20 thru 0x03d39a (0x197b bytes) 000194 1788831602.405812 trunc from 0x03d39b to 0x00b47f (0x31f1b bytes) 000195 1788831602.454879 trunc from 0x00817b to 0x00b47f (0x3305 bytes) 000196 1788831602.464296 trunc from 0x000697 to 0x00aa7f (0xa3e9 bytes) 000197 1788831602.471257 read 0x004c91 thru 0x008e07 (0x4177 bytes) 000198 1788831602.512262 punch from 0x0035b2 to 0x008df4 (0x5843 bytes) 000199 1788831602.519188 trunc from 0x00b480 to 0x0029bf (0x8ac0 bytes) 000200 1788831602.542251 write 0x0081cf thru 0x00df86 (0x5db8 bytes) 000201 1788831602.545088 trunc from 0x0052dd to 0x00934a (0x406e bytes) 000203 1788831602.563232 mapread 0x00d50b thru 0x00df86 (0xa7c bytes) 000204 1788831602.568974 MIRROR_RESYNC 2 mirrors 000205 1788831603.457103 trunc from 0x001324 to 0x003aea (0x27c7 bytes) 000206 1788831603.490235 write 0x032f78 thru 0x03ffff (0xd088 bytes) 000207 1788831603.500295 mapread 0x0166d2 thru 0x017606 (0xf35 bytes) 000208 1788831603.526416 read 0x00acac thru 0x012cfe (0x8053 bytes) 000209 1788831603.571621 mapread 0x01faf9 thru 0x02e0df (0xe5e7 bytes) 000210 1788831603.636865 trunc from 0x014fb3 to 0x018f13 (0x3f61 bytes) 000211 1788831603.658176 MIRROR_RESYNC 2 mirrors 000212 1788831604.874212 fallocate 0x008304 thru 0x01316e (0xae6b bytes) 000213 1788831604.920260 mapwrite 0x009da7 thru 0x01173b (0x7995 bytes) 000215 1788831604.960035 read 0x0247ae thru 0x02c730 (0x7f83 bytes) 000216 1788831604.971045 mapread 0x03cc80 thru 0x03df81 (0x1302 bytes) 000217 1788831604.982685 mapread 0x01206b thru 0x01d8dc (0xb872 bytes) 000218 1788831605.038893 write 0x03d5cc thru 0x03ffff (0x2a34 bytes) 000219 1788831605.040077 fallocate 0x00f245 thru 0x015ba4 (0x6960 bytes) 000220 1788831605.053048 punch from 0x01642c to 0x0222f9 (0xbece bytes) 000221 1788831605.067261 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) 000222 1788831605.374992 mapwrite 0x0163d6 thru 0x025fbd (0xfbe8 bytes) 000223 1788831605.436147 trunc from 0x040000 to 0x01c1fe (0x23e01 bytes) 000224 1788831605.510898 read 0x0055ee thru 0x010248 (0xac5b bytes) 000226 1788831605.523032 trunc from 0x00daa4 to 0x01973a (0xbc97 bytes) 000227 1788831605.533746 punch from 0x00ff65 to 0x01c1fe (0xc29a bytes) 000228 1788831605.548184 mapread 0x0161b6 thru 0x0183d3 (0x221e bytes) 000229 1788831605.565479 mapread 0x009db1 thru 0x011591 (0x77e1 bytes) 000230 1788831605.572038 trunc from 0x004cfd to 0x00ee4b (0xa14f bytes) 000231 1788831605.580094 fallocate 0x00891f thru 0x00b13b (0x281d bytes) 000232 1788831605.585611 mapread 0x007311 thru 0x011b8b (0xa87b bytes) 000233 1788831605.598287 mapwrite 0x033d7d thru 0x03d242 (0x94c6 bytes) 000234 1788831605.731243 trunc from 0x03d243 to 0x02008f (0x1d1b3 bytes) 000236 1788831605.747962 mapwrite 0x037916 thru 0x039b95 (0x2280 bytes) 000237 1788831605.809142 trunc from 0x01b5f7 to 0x024c20 (0x962a bytes) 000238 1788831605.821634 punch from 0x024fa2 to 0x02b860 (0x68bf bytes) 000239 1788831605.837167 trunc from 0x039b96 to 0x02f337 (0xa85e bytes) 000240 1788831605.864572 mapread 0x00409b thru 0x00c3e9 (0x834f bytes) 000242 1788831605.881890 MIRROR_EXTEND to 2 mirrors 000243 1788831606.574823 trunc from 0x028f67 to 0x02e01c (0x50b6 bytes) 000244 1788831606.621184 read 0x01dfaa thru 0x022393 (0x43ea bytes) 000245 1788831606.640014 fallocate 0x004331 thru 0x00970e (0x53de bytes) 000246 1788831606.647955 mapread 0x018ed0 thru 0x0288cc (0xf9fd bytes) 000247 1788831606.685694 write 0x006baf thru 0x007411 (0x863 bytes) 000248 1788831606.704987 write 0x034581 thru 0x03ffff (0xba7f bytes) 000249 1788831606.719731 trunc from 0x00ca9e to 0x00e9fd (0x1f60 bytes) 000250 1788831606.732101 write 0x0045af thru 0x014521 (0xff73 bytes) 000251 1788831606.747125 punch from 0x02ba3b to 0x03a9d9 (0xef9f bytes) 000252 1788831606.769833 punch from 0x002d8e to 0x010808 (0xda7b bytes) 000253 1788831606.776793 write 0x00208f thru 0x007d5e (0x5cd0 bytes) 000254 1788831606.789866 read 0x03ad84 thru 0x03ffff (0x527c bytes) 000255 1788831606.819954 mapread 0x0293b9 thru 0x030658 (0x72a0 bytes) 000256 1788831606.830864 mapread 0x025238 thru 0x02e50a (0x92d3 bytes) 000257 1788831606.840695 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) 000258 1788831607.102254 punch from 0x03b169 to 0x03f48a (0x4322 bytes) 000259 1788831607.113052 fallocate 0x01fb84 thru 0x023dc8 (0x4245 bytes) 000260 1788831607.122549 mapread 0x023818 thru 0x02d728 (0x9f11 bytes) 000261 1788831607.164566 trunc from 0x01e911 to 0x02da44 (0xf134 bytes) 000262 1788831607.172759 read 0x03fd16 thru 0x03ffff (0x2ea bytes) 000263 1788831607.186131 punch from 0x01f6ca to 0x0280d0 (0x8a07 bytes) 000265 1788831607.207591 punch from 0x0041a8 to 0x010a32 (0xc88b bytes) 000266 1788831607.223979 fallocate 0x003100 thru 0x005f82 (0x2e83 bytes) 000267 1788831607.238286 mapwrite 0x01c5a8 thru 0x028347 (0xbda0 bytes) 000268 1788831607.403627 mapread 0x00cf3e thru 0x017987 (0xaa4a bytes) 000269 1788831607.417306 mapwrite 0x02b216 thru 0x036010 (0xadfb bytes) 000270 1788831607.479806 read 0x004056 thru 0x00f274 (0xb21f bytes) 000271 1788831607.500883 fallocate 0x00e115 thru 0x0176e3 (0x95cf bytes) 000273 1788831607.512139 write 0x02bdf7 thru 0x0379b3 (0xbbbd bytes) 000274 1788831607.540912 MIRROR_EXTEND to 2 mirrors 000275 1788831608.749960 read 0x01a9b5 thru 0x01d4d9 (0x2b25 bytes) 000276 1788831608.787909 trunc from 0x040000 to 0x009281 (0x36d7e bytes) 000277 1788831608.850039 MIRROR_RESYNC 2 mirrors 000278 1788831609.425920 fallocate 0x00f2b1 thru 0x01108d (0x1ddd bytes) 000279 1788831609.460817 trunc from 0x009282 to 0x000694 (0x8bed bytes) 000280 1788831609.484865 mapread 0x000463 thru 0x000694 (0x232 bytes) 000281 1788831609.492561 write 0x031d19 thru 0x03e78f (0xca77 bytes) 000282 1788831609.494191 trunc from 0x03e790 to 0x03329c (0xb4f3 bytes) 000283 1788831609.524106 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3329d): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3329d): Mirror 2: 0xaf61660 (stale) CRC-32 checksum value for chunk [0, 0x3329d): Mirror 1: 0x535f63ed Mirror 3: 0x535f63ed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3329d: skipped 000284 1788831610.335291 trunc from 0x03329d to 0x003255 (0x30047 bytes) 000285 1788831610.398480 mapwrite 0x03cfc4 thru 0x03ffff (0x303c bytes) 000286 1788831610.485018 read 0x02c69d thru 0x02ce35 (0x799 bytes) 000287 1788831610.508615 trunc from 0x040000 to 0x007d31 (0x382ce bytes) 000288 1788831610.549201 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x7d32): Mirror 2: 0x9835b600 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7d32): Mirror 2: 0x9835b600 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7d32: skipped 000289 1788831610.982347 trunc from 0x007d32 to 0x00abdf (0x2eae bytes) 000291 1788831611.052677 mapwrite 0x036e15 thru 0x03dde9 (0x6fd5 bytes) 000293 1788831611.230207 trunc from 0x03b549 to 0x03dde9 (0x28a1 bytes) 000294 1788831611.256217 mapread 0x03449a thru 0x03dde9 (0x9950 bytes) 000295 1788831611.270080 trunc from 0x032d9b to 0x03dde9 (0xb04f bytes) 000297 1788831611.288949 trunc from 0x03ddea to 0x0348eb (0x94fe bytes) 000298 1788831611.323143 write 0x033dd9 thru 0x03ffff (0xc227 bytes) 000299 1788831611.342163 write 0x03848e thru 0x0390e5 (0xc58 bytes) 000300 1788831611.344008 fallocate 0x003615 thru 0x00789f (0x428b bytes) 000302 1788831611.350257 trunc from 0x006513 to 0x015457 (0xef45 bytes) 000303 1788831611.356144 trunc from 0x040000 to 0x008961 (0x3769e bytes) 000304 1788831611.378943 fallocate 0x00b652 thru 0x01272f (0x70de bytes) 000305 1788831611.384954 punch from 0x00c036 to 0x01272f (0x66fa bytes) 000306 1788831611.390443 read 0x0080a8 thru 0x0085f4 (0x54d bytes) 000307 1788831611.396999 trunc from 0x00e80d to 0x01272f (0x3f23 bytes) 000308 1788831611.403188 trunc from 0x012730 to 0x03f908 (0x2d1d9 bytes) 000309 1788831611.420365 read 0x03e03c thru 0x03f908 (0x18cd bytes) 000310 1788831611.457951 read 0x00a333 thru 0x01514a (0xae18 bytes) 000311 1788831611.459120 mapread 0x028f49 thru 0x02ee42 (0x5efa bytes) 000312 1788831611.460959 fallocate 0x017a66 thru 0x01e832 (0x6dcd bytes) 000314 1788831611.468306 write 0x007f71 thru 0x00ffee (0x807e bytes) 000315 1788831611.470474 mapread 0x0068b9 thru 0x009b37 (0x327f bytes) 000316 1788831611.472504 read 0x039e6e thru 0x03bc55 (0x1de8 bytes) 000317 1788831611.473860 write 0x02ed63 thru 0x030533 (0x17d1 bytes) 000318 1788831611.475716 read 0x028420 thru 0x02f49e (0x707f bytes) 000319 1788831611.477189 read 0x010289 thru 0x019451 (0x91c9 bytes) 000321 1788831611.479128 punch from 0x028670 to 0x0290f6 (0xa87 bytes) 000322 1788831611.485145 write 0x01d54b thru 0x02953c (0xbff2 bytes) 000323 1788831611.498299 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) 000324 1788831611.736225 mapwrite 0x032582 thru 0x03c456 (0x9ed5 bytes) 000326 1788831611.857602 fallocate 0x01a392 thru 0x02057e (0x61ed bytes) 000327 1788831611.866935 punch from 0x034729 to 0x03f908 (0xb1e0 bytes) 000328 1788831611.874266 mapwrite 0x0278f1 thru 0x02cc04 (0x5314 bytes) 000329 1788831611.902133 mapwrite 0x03a83b thru 0x03c11f (0x18e5 bytes) 000330 1788831611.932750 MIRROR_EXTEND to 2 mirrors 000331 1788831612.682254 write 0x026a4c thru 0x02eb22 (0x80d7 bytes) 000332 1788831612.726110 punch from 0x03b2ee to 0x03f908 (0x461b bytes) 000333 1788831612.732814 punch from 0x02fafb to 0x030b11 (0x1017 bytes) 000335 1788831612.737923 mapwrite 0x0360a7 thru 0x03ffff (0x9f59 bytes) 000336 1788831612.809440 write 0x02a1f3 thru 0x02a584 (0x392 bytes) 000337 1788831612.821287 MIRROR_RESYNC 2 mirrors 000339 1788831613.505772 fallocate 0x035934 thru 0x03ccbc (0x7389 bytes) 000340 1788831613.528269 write 0x0122f8 thru 0x015bd1 (0x38da bytes) 000341 1788831613.534759 write 0x03d610 thru 0x03ffff (0x29f0 bytes) 000342 1788831613.538030 read 0x01dee7 thru 0x022a93 (0x4bad bytes) 000343 1788831613.545642 read 0x010b9f thru 0x01a7bc (0x9c1e bytes) 000344 1788831613.561744 write 0x02f957 thru 0x039f09 (0xa5b3 bytes) 000345 1788831613.563569 trunc from 0x012261 to 0x0153f8 (0x3198 bytes) 000346 1788831613.585464 fallocate 0x038f78 thru 0x03bf0e (0x2f97 bytes) 000347 1788831613.591685 fallocate 0x02a454 thru 0x02c0cb (0x1c78 bytes) 000348 1788831613.597084 read 0x03f0c4 thru 0x03ffff (0xf3c bytes) 000349 1788831613.598143 fallocate 0x00358d thru 0x0064c4 (0x2f38 bytes) 000350 1788831613.604100 fallocate 0x009978 thru 0x00de35 (0x44be bytes) 000351 1788831613.613079 trunc from 0x040000 to 0x01b715 (0x248ea bytes) 000352 1788831613.639002 fallocate 0x028046 thru 0x0377aa (0xf765 bytes) 000353 1788831613.645263 trunc from 0x01b716 to 0x0364ef (0x1adda bytes) 000354 1788831613.663235 mapwrite 0x0042a8 thru 0x007e4d (0x3ba6 bytes) 000355 1788831613.683608 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x364f0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x364f0): Mirror 2: 0xa2e57b09 (stale) CRC-32 checksum value for chunk [0, 0x364f0): Mirror 1: 0xc626da52 Mirror 3: 0xc626da52 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x364f0: skipped 000356 1788831614.573657 fallocate 0x02a728 thru 0x02e07b (0x3954 bytes) 000357 1788831614.621892 MIRROR_RESYNC 3 mirrors 000358 1788831615.573653 trunc from 0x02144f to 0x02fb93 (0xe745 bytes) 000359 1788831615.595485 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x364f0): Mirror 3: 0xc626da52 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x364f0): Mirror 3: 0xc626da52 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x364f0: skipped 000360 1788831615.916901 mapread 0x032fc3 thru 0x0364ef (0x352d bytes) 000361 1788831615.944845 trunc from 0x0364f0 to 0x012f35 (0x235ba bytes) 000362 1788831615.999590 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x12f36): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12f36): Mirror 3: 0xd0d0d7f1 (stale) CRC-32 checksum value for chunk [0, 0x12f36): Mirror 1: 0xd0d0d7f1 Mirror 4: 0xd0d0d7f1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12f36: skipped 000363 1788831617.566750 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) 000364 1788831618.199732 trunc from 0x00f0e7 to 0x012f35 (0x3e4f bytes) 000365 1788831618.261884 trunc from 0x00a81c to 0x012f35 (0x871a bytes) 000366 1788831618.268940 trunc from 0x012f36 to 0x01d013 (0xa0de bytes) 000368 1788831618.308559 write 0x00c64f thru 0x0174e1 (0xae93 bytes) 000370 1788831618.328036 read 0x00d85c thru 0x00e634 (0xdd9 bytes) 000372 1788831618.330054 write 0x01294a thru 0x018bac (0x6263 bytes) 000373 1788831618.339262 mapread 0x00280f thru 0x0042c3 (0x1ab5 bytes) 000374 1788831618.377853 MIRROR_RESYNC 2 mirrors 000375 1788831619.271713 trunc from 0x00f2ec to 0x01c6b0 (0xd3c5 bytes) 000377 1788831619.328072 mapwrite 0x024ec9 thru 0x02d7ee (0x8926 bytes) 000378 1788831619.587309 trunc from 0x02d7ef to 0x03ff74 (0x12786 bytes) 000379 1788831619.625760 trunc from 0x038dc1 to 0x03db81 (0x4dc1 bytes) 000380 1788831619.632138 punch from 0x02c184 to 0x03418c (0x8009 bytes) 000381 1788831619.645243 mapread 0x00419c thru 0x004ff5 (0xe5a bytes) 000382 1788831619.672812 read 0x00e83a thru 0x015c78 (0x743f bytes) 000383 1788831619.714781 mapread 0x02a8dd thru 0x02dcea (0x340e bytes) 000384 1788831619.733688 trunc from 0x03ff75 to 0x00bc79 (0x342fb bytes) 000385 1788831619.752048 punch from 0x00b5ff to 0x00bc79 (0x67b bytes) 000387 1788831619.759651 mapwrite 0x00bade thru 0x00c02d (0x550 bytes) 000388 1788831619.798157 write 0x038569 thru 0x03ffff (0x7a97 bytes) 000390 1788831619.807417 MIRROR_RESYNC 2 mirrors 000392 1788831620.476038 read 0x03a547 thru 0x03ffff (0x5ab9 bytes) 000393 1788831620.495843 MIRROR_RESYNC 2 mirrors 000394 1788831620.914729 write 0x0130a6 thru 0x0221ff (0xf15a bytes) 000395 1788831620.952792 trunc from 0x040000 to 0x00d1b9 (0x32e46 bytes) 000396 1788831620.978669 mapread 0x007ff9 thru 0x00d1b9 (0x51c1 bytes) 000397 1788831620.999577 trunc from 0x007f8e to 0x00d1b9 (0x522c bytes) 000398 1788831621.005417 trunc from 0x00d1ba to 0x032c8a (0x25ad1 bytes) 000399 1788831621.028008 punch from 0x00b911 to 0x017af8 (0xc1e8 bytes) 000400 1788831621.033681 read 0x00731e thru 0x0120ff (0xade2 bytes) 000401 1788831621.044234 write 0x0007c9 thru 0x006d68 (0x65a0 bytes) 000402 1788831621.055170 punch from 0x0235d9 to 0x0276a1 (0x40c9 bytes) 000403 1788831621.060095 trunc from 0x000e98 to 0x006b89 (0x5cf2 bytes) 000404 1788831621.076330 trunc from 0x01f485 to 0x02949c (0xa018 bytes) 000405 1788831621.081641 write 0x005d74 thru 0x00ecca (0x8f57 bytes) 000406 1788831621.088229 trunc from 0x01fb6c to 0x021215 (0x16aa bytes) 000407 1788831621.094750 mapwrite 0x0134fb thru 0x02139f (0xdea5 bytes) 000408 1788831621.156170 trunc from 0x02b507 to 0x0324fb (0x6ff5 bytes) 000409 1788831621.161131 trunc from 0x032c8b to 0x00c990 (0x262fa bytes) 000410 1788831621.179183 fallocate 0x023bcc thru 0x033b62 (0xff97 bytes) 000411 1788831621.187224 mapread 0x0036be thru 0x00bb00 (0x8443 bytes) 000412 1788831621.198656 trunc from 0x00c991 to 0x035fa1 (0x29611 bytes) 000413 1788831621.218168 mapwrite 0x03d977 thru 0x03ffff (0x2689 bytes) 000414 1788831621.291355 fallocate 0x0225b2 thru 0x02eefe (0xc94d bytes) 000415 1788831621.298729 trunc from 0x040000 to 0x024eca (0x1b135 bytes) 000416 1788831621.321966 trunc from 0x01f80b to 0x020598 (0xd8e bytes) 000418 1788831621.335686 trunc from 0x006a21 to 0x00ef55 (0x8535 bytes) 000419 1788831621.343006 fallocate 0x038427 thru 0x03ef6d (0x6b47 bytes) 000420 1788831621.352005 read 0x001b73 thru 0x009bb6 (0x8044 bytes) 000421 1788831621.374982 write 0x02d3f1 thru 0x03b3b6 (0xdfc6 bytes) 000422 1788831621.376677 trunc from 0x03b3b7 to 0x03c31f (0xf69 bytes) 000423 1788831621.397508 read 0x003551 thru 0x012bb4 (0xf664 bytes) 000424 1788831621.400722 punch from 0x009cbb to 0x00da36 (0x3d7c bytes) 000425 1788831621.405869 read 0x02f996 thru 0x03c31f (0xc98a bytes) 000426 1788831621.424504 MIRROR_RESYNC 2 mirrors 000427 1788831622.080895 mapwrite 0x02998d thru 0x02bc13 (0x2287 bytes) 000428 1788831622.179270 write 0x00356f thru 0x003c6b (0x6fd bytes) 000430 1788831622.185465 trunc from 0x010dc6 to 0x019231 (0x846c bytes) 000431 1788831622.194638 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3c320): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c320): Mirror 4: 0x93076a02 (stale) CRC-32 checksum value for chunk [0, 0x3c320): Mirror 1: 0x30ef36bc Mirror 5: 0x30ef36bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c320: skipped 000432 1788831623.065317 mapread 0x02e89c thru 0x031b4e (0x32b3 bytes) 000433 1788831623.108330 mapread 0x0002a5 thru 0x00ff17 (0xfc73 bytes) 000434 1788831623.133180 read 0x00625b thru 0x00a8c2 (0x4668 bytes) 000435 1788831623.141717 mapwrite 0x03f8cb thru 0x03ffff (0x735 bytes) 000437 1788831623.224109 fallocate 0x0372a9 thru 0x03a35e (0x30b6 bytes) 000438 1788831623.233769 mapwrite 0x019241 thru 0x01df92 (0x4d52 bytes) 000440 1788831623.266936 punch from 0x003789 to 0x00fa7c (0xc2f4 bytes) 000441 1788831623.273095 mapread 0x006be9 thru 0x00e5fd (0x7a15 bytes) 000442 1788831623.290580 trunc from 0x040000 to 0x015fa9 (0x2a056 bytes) 000445 1788831623.325103 mapwrite 0x028138 thru 0x02e1b7 (0x6080 bytes) 000446 1788831623.389552 mapwrite 0x035835 thru 0x03e788 (0x8f54 bytes) 000447 1788831623.450820 punch from 0x00472b to 0x00a8fc (0x61d2 bytes) 000448 1788831623.456912 punch from 0x038abf to 0x03e788 (0x5cca bytes) 000449 1788831623.463458 write 0x038007 thru 0x03ffff (0x7ff9 bytes) 000450 1788831623.469350 write 0x01d97f thru 0x02b7bd (0xde3f bytes) 000451 1788831623.476907 write 0x014677 thru 0x020190 (0xbb1a bytes) 000452 1788831623.480188 read 0x017ae8 thru 0x024d89 (0xd2a2 bytes) 000453 1788831623.486765 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x749a21bf (stale) Mirror 5: 0xcf41df95 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x10620302 Mirror 6: 0x10620302 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000454 1788831624.844658 fallocate 0x032b34 thru 0x03fc58 (0xd125 bytes) 000455 1788831624.880924 trunc from 0x0186d5 to 0x0231f8 (0xab24 bytes) 000456 1788831624.886292 write 0x03aa62 thru 0x03ffff (0x559e bytes) 000457 1788831624.896065 trunc from 0x01f5ab to 0x028c2c (0x9682 bytes) 000458 1788831624.901705 mapwrite 0x02af3d thru 0x039355 (0xe419 bytes) 000459 1788831624.947937 punch from 0x0047c6 to 0x004961 (0x19c bytes) 000460 1788831624.952536 trunc from 0x040000 to 0x03c973 (0x368c bytes) 000462 1788831624.969506 fallocate 0x028303 thru 0x0301b3 (0x7eb1 bytes) 000463 1788831624.975056 write 0x01351e thru 0x021b7d (0xe660 bytes) 000464 1788831624.985592 punch from 0x00c6fd to 0x015dbf (0x96c3 bytes) 000465 1788831624.999318 mapwrite 0x0247b0 thru 0x031649 (0xce9a bytes) 000466 1788831625.042298 trunc from 0x0092ad to 0x010691 (0x73e5 bytes) 000467 1788831625.063573 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3c974): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c974): Mirror 4: 0x36061d9 (stale) Mirror 5: 0x88e8419e (stale) Mirror 6: 0xd1a2c441 (stale) CRC-32 checksum value for chunk [0, 0x3c974): Mirror 1: 0x388e7dca Mirror 7: 0x388e7dca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c974: skipped 000468 1788831626.056691 mapread 0x0148ed thru 0x022cbc (0xe3d0 bytes) 000469 1788831626.097929 trunc from 0x03c974 to 0x029fa7 (0x129cc bytes) 000470 1788831626.183441 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x29fa8): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29fa8): Mirror 4: 0xc100b4fa (stale) Mirror 5: 0xce8c5ab (stale) Mirror 6: 0xa57f98a6 (stale) Mirror 7: 0x61d5a2f1 (stale) CRC-32 checksum value for chunk [0, 0x29fa8): Mirror 1: 0x61d5a2f1 Mirror 8: 0x61d5a2f1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29fa8: skipped 000471 1788831627.389427 write 0x03b49d thru 0x03ffff (0x4b63 bytes) 000472 1788831627.467209 trunc from 0x040000 to 0x024026 (0x1bfd9 bytes) 000473 1788831627.514106 mapread 0x0174d1 thru 0x024026 (0xcb56 bytes) 000474 1788831627.543579 mapwrite 0x03bf94 thru 0x03da02 (0x1a6f bytes) 000475 1788831627.585603 mapread 0x019890 thru 0x026cb7 (0xd428 bytes) 000476 1788831627.601686 mapwrite 0x009f59 thru 0x00c86b (0x2913 bytes) 000477 1788831627.632879 fallocate 0x0364fc thru 0x03dda8 (0x78ad bytes) 000478 1788831627.638832 write 0x00ef6a thru 0x018a3a (0x9ad1 bytes) 000479 1788831627.641745 mapwrite 0x00e219 thru 0x010092 (0x1e7a bytes) 000480 1788831627.667218 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3da03): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3da03): Mirror 4: 0x78cc00bc (stale) Mirror 5: 0xe0147967 (stale) Mirror 6: 0xe1655660 (stale) Mirror 7: 0x3acbdcf3 (stale) Mirror 8: 0x8b6c5f58 (stale) CRC-32 checksum value for chunk [0, 0x3da03): Mirror 1: 0xc1913b1b Mirror 9: 0xc1913b1b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3da03: skipped 000481 1788831628.893887 write 0x00b310 thru 0x018823 (0xd514 bytes) 000482 1788831628.953575 write 0x013460 thru 0x0219bc (0xe55d bytes) 000483 1788831628.960251 trunc from 0x03da03 to 0x00b8b6 (0x3214c bytes) 000484 1788831628.998042 write 0x032d96 thru 0x03ffff (0xd26a bytes) 000485 1788831628.999872 read 0x010f6d thru 0x011a95 (0xb29 bytes) 000486 1788831629.008752 mapwrite 0x019a36 thru 0x020e08 (0x73d3 bytes) 000487 1788831629.081485 fallocate 0x03a124 thru 0x03c020 (0x1efd bytes) 000488 1788831629.090071 trunc from 0x01d743 to 0x020dea (0x36a8 bytes) 000489 1788831629.110504 read 0x027137 thru 0x0365d2 (0xf49c bytes) 000490 1788831629.138642 mapwrite 0x024b6d thru 0x02801f (0x34b3 bytes) 000491 1788831629.198211 read 0x03dd09 thru 0x03ffff (0x22f7 bytes) 000492 1788831629.203036 punch from 0x02964a to 0x034943 (0xb2fa bytes) 000493 1788831629.221006 write 0x01ec54 thru 0x02321b (0x45c8 bytes) 000494 1788831629.226203 write 0x039ce1 thru 0x03ffff (0x631f bytes) 000495 1788831629.240291 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x749a21bf (stale) Mirror 5: 0xcf41df95 (stale) Mirror 7: 0xcef5d54c (stale) Mirror 8: 0xb58e2e0e (stale) Mirror 9: 0x50d1384c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x749a21bf (stale) Mirror 5: 0xcf41df95 (stale) Mirror 7: 0xcef5d54c (stale) Mirror 8: 0xb58e2e0e (stale) Mirror 9: 0x50d1384c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000496 1788831630.146307 trunc from 0x040000 to 0x036f0d (0x90f2 bytes) 000497 1788831630.172855 read 0x0237e9 thru 0x027690 (0x3ea8 bytes) 000498 1788831630.187632 write 0x02b764 thru 0x02ea32 (0x32cf bytes) 000501 1788831630.210136 mapread 0x013bc0 thru 0x01593f (0x1d80 bytes) 000502 1788831630.245363 trunc from 0x01e1b9 to 0x027b08 (0x9950 bytes) 000503 1788831630.251606 trunc from 0x01b8a7 to 0x024257 (0x89b1 bytes) 000504 1788831630.266954 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x36f0e): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36f0e): Mirror 4: 0xa89ee7c4 (stale) Mirror 5: 0x9ade9f01 (stale) Mirror 7: 0x3cfb1f44 (stale) Mirror 8: 0x1583ba7e (stale) Mirror 9: 0xfbe01248 (stale) CRC-32 checksum value for chunk [0, 0x36f0e): Mirror 1: 0x43c281c9 Mirror 10: 0x43c281c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36f0e: skipped 000505 1788831631.993363 punch from 0x012acc to 0x01737f (0x48b4 bytes) 000506 1788831632.040278 write 0x02aa3d thru 0x032af4 (0x80b8 bytes) 000507 1788831632.057231 write 0x010029 thru 0x01bde0 (0xbdb8 bytes) 000508 1788831632.071466 trunc from 0x023686 to 0x033212 (0xfb8d bytes) 000509 1788831632.086661 write 0x008e3b thru 0x00f314 (0x64da bytes) 000510 1788831632.098551 write 0x0208f6 thru 0x027573 (0x6c7e bytes) 000511 1788831632.110274 read 0x007609 thru 0x00a694 (0x308c bytes) 000512 1788831632.117492 read 0x015e9f thru 0x016ffe (0x1160 bytes) 000515 1788831632.127813 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36f0e): Mirror 4: 0xa89ee7c4 (stale) Mirror 5: 0x9ade9f01 (stale) Mirror 8: 0x1583ba7e (stale) Mirror 9: 0xfbe01248 (stale) Mirror 10: 0x43c281c9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36f0e): Mirror 4: 0xa89ee7c4 (stale) Mirror 5: 0x9ade9f01 (stale) Mirror 8: 0x1583ba7e (stale) Mirror 9: 0xfbe01248 (stale) Mirror 10: 0x43c281c9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36f0e: skipped 000516 1788831632.657918 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x36f0e): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36f0e): Mirror 4: 0xa89ee7c4 (stale) Mirror 5: 0x9ade9f01 (stale) Mirror 8: 0x1583ba7e (stale) Mirror 9: 0xfbe01248 (stale) Mirror 10: 0x43c281c9 (stale) CRC-32 checksum value for chunk [0, 0x36f0e): Mirror 1: 0xaf3e14d Mirror 11: 0xaf3e14d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36f0e: skipped 000517 1788831634.101362 fallocate 0x03c4b7 thru 0x03ffff (0x3b49 bytes) 000518 1788831634.161537 punch from 0x00e3ec to 0x00ea59 (0x66e bytes) 000519 1788831634.166648 write 0x02f453 thru 0x03bbd3 (0xc781 bytes) 000520 1788831634.179523 trunc from 0x019dac to 0x02274b (0x89a0 bytes) 000522 1788831634.190455 mapread 0x02aa9a thru 0x034f41 (0xa4a8 bytes) 000523 1788831634.211709 fallocate 0x004191 thru 0x005782 (0x15f2 bytes) 000524 1788831634.217541 mapwrite 0x02475f thru 0x027a80 (0x3322 bytes) 000525 1788831634.245424 punch from 0x025022 to 0x02a731 (0x5710 bytes) 000526 1788831634.256806 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3bbd4): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bbd4): Mirror 4: 0xa871c84 (stale) Mirror 5: 0xa33ad4a4 (stale) Mirror 8: 0xe8ca9e16 (stale) Mirror 9: 0xc407d1ae (stale) Mirror 10: 0x1bd03c2 (stale) Mirror 11: 0x534e036d (stale) CRC-32 checksum value for chunk [0, 0x3bbd4): Mirror 1: 0xa595cd08 Mirror 12: 0xa595cd08 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bbd4: skipped 000527 1788831635.976948 mapwrite 0x034be3 thru 0x035c32 (0x1050 bytes) 000528 1788831636.162867 trunc from 0x026774 to 0x0272c2 (0xb4f bytes) 000529 1788831636.176297 mapwrite 0x0033a1 thru 0x00a223 (0x6e83 bytes) 000530 1788831636.236220 trunc from 0x03bbd4 to 0x03d8a8 (0x1cd5 bytes) 000531 1788831636.338341 read 0x00f95a thru 0x0153ef (0x5a96 bytes) 000532 1788831636.382346 trunc from 0x00eef0 to 0x01782c (0x893d bytes) 000533 1788831636.403746 trunc from 0x019487 to 0x024a01 (0xb57b bytes) 000534 1788831636.413142 mapread 0x03079b thru 0x037332 (0x6b98 bytes) 000535 1788831636.414154 mapread 0x01cb30 thru 0x02a6cb (0xdb9c bytes) 000536 1788831636.470610 fallocate 0x032709 thru 0x03ffff (0xd8f7 bytes) 000537 1788831636.521197 MIRROR_RESYNC 8 mirrors 000538 1788831640.547881 trunc from 0x009ef6 to 0x00d46b (0x3576 bytes) 000539 1788831640.591133 write 0x03ddf2 thru 0x03ffff (0x220e bytes) 000540 1788831640.598248 read 0x020b0a thru 0x02b37a (0xa871 bytes) 000541 1788831640.610040 mapwrite 0x03f24e thru 0x03ffff (0xdb2 bytes) 000542 1788831640.621897 punch from 0x027dab to 0x030208 (0x845e bytes) 000543 1788831640.627812 write 0x025525 thru 0x030513 (0xafef bytes) 000544 1788831640.635292 trunc from 0x00d53c to 0x00ea5a (0x151f bytes) 000545 1788831640.641174 mapread 0x014c15 thru 0x018f48 (0x4334 bytes) 000546 1788831640.661875 punch from 0x01a447 to 0x025a29 (0xb5e3 bytes) 000547 1788831640.678632 MIRROR_RESYNC 8 mirrors 000548 1788831643.033313 punch from 0x00fbad to 0x014601 (0x4a55 bytes) 000550 1788831643.084008 fallocate 0x002d8a thru 0x0059cd (0x2c44 bytes) 000551 1788831643.090132 read 0x02e558 thru 0x035df3 (0x789c bytes) 000553 1788831643.102227 trunc from 0x040000 to 0x015c91 (0x2a36e bytes) 000554 1788831643.129731 mapwrite 0x037a67 thru 0x03b0e7 (0x3681 bytes) 000555 1788831643.220843 MIRROR_RESYNC 8 mirrors 000557 1788831645.352707 fallocate 0x02a0c7 thru 0x036185 (0xc0bf bytes) 000558 1788831645.392445 fallocate 0x015961 thru 0x01d6d2 (0x7d72 bytes) 000559 1788831645.402180 trunc from 0x006807 to 0x00999a (0x3194 bytes) 000560 1788831645.407952 read 0x006850 thru 0x00f4ff (0x8cb0 bytes) 000561 1788831645.419056 fallocate 0x02bf27 thru 0x03bb0e (0xfbe8 bytes) 000562 1788831645.423943 mapwrite 0x038a83 thru 0x03ffff (0x757d bytes) 000564 1788831645.484284 fallocate 0x034bb3 thru 0x03d7c1 (0x8c0f bytes) 000566 1788831645.490565 read 0x032eda thru 0x03ee41 (0xbf68 bytes) 000567 1788831645.502297 mapwrite 0x01c970 thru 0x022c02 (0x6293 bytes) 000568 1788831645.523598 trunc from 0x040000 to 0x02de25 (0x121da bytes) 000569 1788831645.542223 mapread 0x013c4a thru 0x01b24e (0x7605 bytes) 000570 1788831645.543923 fallocate 0x01388f thru 0x022d1e (0xf490 bytes) 000571 1788831645.550136 punch from 0x0058ad to 0x00d706 (0x7e5a bytes) 000572 1788831645.556960 mapwrite 0x039a2a thru 0x03ffff (0x65d6 bytes) 000573 1788831645.637587 mapwrite 0x00c7eb thru 0x00e779 (0x1f8f bytes) 000574 1788831645.666562 trunc from 0x027d01 to 0x031a3b (0x9d3b bytes) 000575 1788831645.672176 trunc from 0x013de1 to 0x01c095 (0x82b5 bytes) 000576 1788831645.679521 mapread 0x02e18b thru 0x03e103 (0xff79 bytes) 000577 1788831645.723358 trunc from 0x02928a to 0x029ce8 (0xa5f bytes) 000579 1788831645.726874 mapwrite 0x000802 thru 0x0060b0 (0x58af bytes) 000580 1788831645.746115 punch from 0x0062a3 to 0x00ab9b (0x48f9 bytes) 000581 1788831645.751348 read 0x00db05 thru 0x012fff (0x54fb bytes) 000582 1788831645.752102 mapread 0x012867 thru 0x021281 (0xea1b bytes) 000584 1788831645.769407 trunc from 0x040000 to 0x009cbb (0x36344 bytes) 000585 1788831645.787667 punch from 0x00759a to 0x009cbb (0x2722 bytes) 000586 1788831645.793084 write 0x03a99d thru 0x03ffff (0x5663 bytes) 000587 1788831645.795206 mapwrite 0x010c80 thru 0x0166a2 (0x5a23 bytes) 000588 1788831645.870345 trunc from 0x040000 to 0x02933e (0x16cc1 bytes) 000589 1788831645.885211 trunc from 0x02933f to 0x015940 (0x139fe bytes) 000590 1788831645.921008 trunc from 0x00ee20 to 0x015940 (0x6b21 bytes) 000592 1788831645.929890 trunc from 0x015941 to 0x01c64b (0x6d0b bytes) 000593 1788831645.966452 punch from 0x00a827 to 0x00d363 (0x2b3d bytes) 000594 1788831645.976507 read 0x0002ac thru 0x00eb7c (0xe8d1 bytes) 000595 1788831645.987007 trunc from 0x01c64c to 0x029492 (0xce47 bytes) 000596 1788831646.021236 read 0x00c2b3 thru 0x01437b (0x80c9 bytes) 000597 1788831646.033159 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29493): Mirror 5: 0x47e9cc64 (stale) Mirror 8: 0x47e9cc64 (stale) Mirror 9: 0x47e9cc64 (stale) Mirror 10: 0x47e9cc64 (stale) Mirror 11: 0x47e9cc64 (stale) Mirror 12: 0x47e9cc64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29493): Mirror 5: 0x47e9cc64 (stale) Mirror 8: 0x47e9cc64 (stale) Mirror 9: 0x47e9cc64 (stale) Mirror 10: 0x47e9cc64 (stale) Mirror 11: 0x47e9cc64 (stale) Mirror 12: 0x47e9cc64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29493: skipped 000598 1788831646.555410 mapread 0x00280d thru 0x00e045 (0xb839 bytes) 000599 1788831646.573640 mapread 0x011f42 thru 0x01ba13 (0x9ad2 bytes) 000600 1788831646.597275 write 0x030d6d thru 0x03d4e1 (0xc775 bytes) 000601 1788831646.605295 write 0x02b4c4 thru 0x02c0d8 (0xc15 bytes) 000602 1788831646.624977 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3d4e2): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d4e2): Mirror 5: 0x685d0e81 (stale) Mirror 8: 0x685d0e81 (stale) Mirror 9: 0x685d0e81 (stale) Mirror 10: 0x685d0e81 (stale) Mirror 11: 0x685d0e81 (stale) Mirror 12: 0x685d0e81 (stale) CRC-32 checksum value for chunk [0, 0x3d4e2): Mirror 1: 0xb6254adb Mirror 13: 0xb6254adb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d4e2: skipped 000603 1788831647.849551 fallocate 0x0154b3 thru 0x02388a (0xe3d8 bytes) 000604 1788831647.925313 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d4e2): Mirror 5: 0x685d0e81 (stale) Mirror 9: 0x685d0e81 (stale) Mirror 10: 0x685d0e81 (stale) Mirror 11: 0x685d0e81 (stale) Mirror 12: 0x685d0e81 (stale) Mirror 13: 0xb6254adb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d4e2): Mirror 5: 0x685d0e81 (stale) Mirror 9: 0x685d0e81 (stale) Mirror 10: 0x685d0e81 (stale) Mirror 11: 0x685d0e81 (stale) Mirror 12: 0x685d0e81 (stale) Mirror 13: 0xb6254adb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d4e2: skipped 000605 1788831648.699262 read 0x039454 thru 0x03d4e1 (0x408e bytes) 000606 1788831648.710507 read 0x0267fa thru 0x032a8c (0xc293 bytes) 000607 1788831648.720673 punch from 0x021509 to 0x028638 (0x7130 bytes) 000608 1788831648.727352 mapwrite 0x020f44 thru 0x02bd6c (0xae29 bytes) 000609 1788831648.853204 read 0x030e64 thru 0x03a5a0 (0x973d bytes) 000610 1788831648.856706 write 0x00a5bb thru 0x00df4a (0x3990 bytes) 000611 1788831648.890442 fallocate 0x01c2eb thru 0x01d3a8 (0x10be bytes) 000612 1788831648.906755 fallocate 0x004e81 thru 0x00e5c3 (0x9743 bytes) 000613 1788831648.920616 mapwrite 0x0059ac thru 0x011853 (0xbea8 bytes) 000614 1788831649.000807 punch from 0x01a86e to 0x02a0ab (0xf83e bytes) 000615 1788831649.010215 write 0x00d135 thru 0x00ef6b (0x1e37 bytes) 000616 1788831649.040264 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d4e2): Mirror 5: 0x685d0e81 (stale) Mirror 9: 0x685d0e81 (stale) Mirror 10: 0x685d0e81 (stale) Mirror 11: 0x685d0e81 (stale) Mirror 12: 0x685d0e81 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d4e2): Mirror 5: 0x685d0e81 (stale) Mirror 9: 0x685d0e81 (stale) Mirror 10: 0x685d0e81 (stale) Mirror 11: 0x685d0e81 (stale) Mirror 12: 0x685d0e81 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d4e2: skipped 000618 1788831649.652142 mapread 0x032427 thru 0x03b20a (0x8de4 bytes) 000619 1788831649.680153 trunc from 0x03d4e2 to 0x0086eb (0x34df6 bytes) 000620 1788831649.702100 trunc from 0x005770 to 0x0086eb (0x2f7c bytes) 000621 1788831649.709002 read 0x0074a6 thru 0x0086eb (0x1246 bytes) 000623 1788831649.716882 trunc from 0x0025f5 to 0x0086eb (0x60f7 bytes) 000624 1788831649.722224 mapwrite 0x03ec2f thru 0x03ffff (0x13d1 bytes) 000625 1788831649.771437 read 0x013f02 thru 0x023b0d (0xfc0c bytes) 000626 1788831649.783314 read 0x02b8bc thru 0x031de1 (0x6526 bytes) 000627 1788831649.788488 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xde58301e (stale) Mirror 9: 0xde58301e (stale) Mirror 10: 0xde58301e (stale) Mirror 11: 0xde58301e (stale) Mirror 12: 0xde58301e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7e39ab8e Mirror 13: 0x7e39ab8e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000628 1788831651.301609 mapwrite 0x00fcce thru 0x013e01 (0x4134 bytes) 000629 1788831651.437707 trunc from 0x040000 to 0x01a60e (0x259f1 bytes) 000630 1788831651.463005 write 0x0072eb thru 0x00bb36 (0x484c bytes) 000632 1788831651.471920 punch from 0x00274d to 0x008546 (0x5dfa bytes) 000633 1788831651.485047 write 0x000203 thru 0x00841f (0x821d bytes) 000634 1788831651.502940 MIRROR_RESYNC 7 mirrors 000635 1788831653.410227 fallocate 0x02cb8b thru 0x035b2c (0x8fa2 bytes) 000636 1788831653.462775 mapread 0x02d53f thru 0x030ff3 (0x3ab5 bytes) 000637 1788831653.503466 fallocate 0x026d28 thru 0x029890 (0x2b69 bytes) 000638 1788831653.522031 trunc from 0x035b2d to 0x00de66 (0x27cc6 bytes) 000639 1788831653.576892 write 0x024b46 thru 0x0293cd (0x4888 bytes) 000640 1788831653.578328 read 0x016c94 thru 0x02391b (0xcc88 bytes) 000642 1788831653.605099 punch from 0x00ec6e to 0x01cb55 (0xdee8 bytes) 000643 1788831653.614590 write 0x00a532 thru 0x01963c (0xf10b bytes) 000644 1788831653.632784 punch from 0x0097d1 to 0x01426e (0xaa9e bytes) 000645 1788831653.668784 mapread 0x027bdc thru 0x0293cd (0x17f2 bytes) 000646 1788831653.669987 fallocate 0x032fa2 thru 0x03c726 (0x9785 bytes) 000647 1788831653.676047 punch from 0x00e0f3 to 0x00e37e (0x28c bytes) 000648 1788831653.680952 read 0x02808f thru 0x035efd (0xde6f bytes) 000649 1788831653.710028 trunc from 0x03c727 to 0x01dde4 (0x1e942 bytes) 000650 1788831653.760774 write 0x013b66 thru 0x018720 (0x4bbb bytes) 000651 1788831653.767615 fallocate 0x02b584 thru 0x02ecba (0x3737 bytes) 000652 1788831653.796543 trunc from 0x008f4b to 0x014b7c (0xbc32 bytes) 000654 1788831653.832745 read 0x0050a2 thru 0x00ab1d (0x5a7c bytes) 000655 1788831653.855678 trunc from 0x016e46 to 0x01baa8 (0x4c63 bytes) 000657 1788831653.875679 write 0x0113ee thru 0x01eead (0xdac0 bytes) 000658 1788831653.895773 MIRROR_RESYNC 7 mirrors 000659 1788831655.902173 MIRROR_RESYNC 7 mirrors 000660 1788831656.364179 punch from 0x0134be to 0x01edc8 (0xb90b bytes) 000661 1788831656.395413 trunc from 0x02ecbb to 0x007a98 (0x27222 bytes) 000662 1788831656.430338 punch from 0x005c5c to 0x007a98 (0x1e3d bytes) 000663 1788831656.439348 write 0x01e581 thru 0x01f410 (0xe90 bytes) 000664 1788831656.446185 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f411): Mirror 5: 0x6baa28b1 (stale) Mirror 10: 0x6baa28b1 (stale) Mirror 11: 0x6baa28b1 (stale) Mirror 12: 0x6baa28b1 (stale) Mirror 13: 0x6baa28b1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f411): Mirror 5: 0x6baa28b1 (stale) Mirror 10: 0x6baa28b1 (stale) Mirror 11: 0x6baa28b1 (stale) Mirror 12: 0x6baa28b1 (stale) Mirror 13: 0x6baa28b1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f411: skipped 000665 1788831656.894982 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f411): Mirror 5: 0x6baa28b1 (stale) Mirror 10: 0x6baa28b1 (stale) Mirror 11: 0x6baa28b1 (stale) Mirror 12: 0x6baa28b1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f411): Mirror 5: 0x6baa28b1 (stale) Mirror 10: 0x6baa28b1 (stale) Mirror 11: 0x6baa28b1 (stale) Mirror 12: 0x6baa28b1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f411: skipped 000666 1788831657.195060 trunc from 0x01f411 to 0x0198b1 (0x5b5f bytes) 000667 1788831657.216851 fallocate 0x01f26a thru 0x02a22c (0xafc3 bytes) 000668 1788831657.220754 read 0x0027b2 thru 0x00a6ca (0x7f19 bytes) 000669 1788831657.233155 write 0x00e94e thru 0x01d4e4 (0xeb97 bytes) 000670 1788831657.240422 MIRROR_RESYNC 5 mirrors 000671 1788831658.404579 MIRROR_EXTEND to 6 mirrors 000673 1788831659.502224 MIRROR_RESYNC 6 mirrors 000674 1788831659.979567 punch from 0x00fb1c to 0x017bbb (0x80a0 bytes) 000675 1788831660.044926 trunc from 0x01d4e5 to 0x016844 (0x6ca0 bytes) 000676 1788831660.096169 trunc from 0x016845 to 0x038bac (0x22368 bytes) 000678 1788831660.170295 MIRROR_RESYNC 6 mirrors 000679 1788831662.828099 mapwrite 0x013194 thru 0x014dd1 (0x1c3e bytes) 000680 1788831662.953057 write 0x0236e0 thru 0x02de8e (0xa7af bytes) 000681 1788831662.969783 write 0x015a97 thru 0x01ba04 (0x5f6e bytes) 000682 1788831662.970755 punch from 0x0075f7 to 0x00c8e7 (0x52f1 bytes) 000683 1788831662.979521 mapwrite 0x01cf97 thru 0x01f995 (0x29ff bytes) 000684 1788831663.033635 trunc from 0x038bad to 0x019b4c (0x1f060 bytes) 000685 1788831663.067430 trunc from 0x00931d to 0x01153d (0x8221 bytes) 000686 1788831663.076877 fallocate 0x00642c thru 0x00c811 (0x63e6 bytes) 000687 1788831663.085853 trunc from 0x0063bc to 0x0091cb (0x2e10 bytes) 000688 1788831663.098480 punch from 0x00d3cd to 0x00db19 (0x74d bytes) 000689 1788831663.111959 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19b4d): Mirror 5: 0x4b59dee3 (stale) Mirror 11: 0x4b59dee3 (stale) Mirror 12: 0x4b59dee3 (stale) Mirror 13: 0x4b59dee3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19b4d): Mirror 5: 0x4b59dee3 (stale) Mirror 11: 0x4b59dee3 (stale) Mirror 12: 0x4b59dee3 (stale) Mirror 13: 0x4b59dee3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19b4d: skipped 000690 1788831663.678283 write 0x01af7a thru 0x028dcd (0xde54 bytes) 000691 1788831663.693860 punch from 0x026789 to 0x028dcd (0x2645 bytes) 000693 1788831663.715607 mapread 0x009ec2 thru 0x00c420 (0x255f bytes) 000695 1788831663.750821 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x28dce): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28dce): Mirror 5: 0x3aeb293c (stale) Mirror 11: 0x3aeb293c (stale) Mirror 12: 0x3aeb293c (stale) Mirror 13: 0x3aeb293c (stale) CRC-32 checksum value for chunk [0, 0x28dce): Mirror 1: 0x21b72a39 Mirror 14: 0x21b72a39 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28dce: skipped 000696 1788831664.983236 mapwrite 0x01e1dc thru 0x028794 (0xa5b9 bytes) 000697 1788831665.122102 write 0x007998 thru 0x014076 (0xc6df bytes) 000698 1788831665.159191 mapread 0x02536d thru 0x028dcd (0x3a61 bytes) 000699 1788831665.166826 write 0x02bde5 thru 0x03481c (0x8a38 bytes) 000700 1788831665.171885 write 0x01fd4c thru 0x02bd4f (0xc004 bytes) 000701 1788831665.178154 trunc from 0x00221b to 0x011c47 (0xfa2d bytes) 000702 1788831665.214255 trunc from 0x01c67f to 0x027893 (0xb215 bytes) 000703 1788831665.229466 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3481d): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3481d): Mirror 5: 0x3e351cea (stale) Mirror 11: 0x3e351cea (stale) Mirror 12: 0x3e351cea (stale) Mirror 13: 0x3e351cea (stale) Mirror 14: 0x667dad26 (stale) CRC-32 checksum value for chunk [0, 0x3481d): Mirror 1: 0x5e9ccbfb Mirror 15: 0x5e9ccbfb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3481d: skipped 000705 1788831666.370011 mapread 0x002b20 thru 0x007868 (0x4d49 bytes) 000706 1788831666.412055 mapwrite 0x014037 thru 0x0153df (0x13a9 bytes) 000707 1788831666.534282 trunc from 0x03481d to 0x023f4d (0x108cf bytes) 000708 1788831666.569058 fallocate 0x02db60 thru 0x03457e (0x6a1f bytes) 000709 1788831666.576921 trunc from 0x023f4e to 0x0205ca (0x3983 bytes) 000710 1788831666.597357 write 0x00bf59 thru 0x00c8ad (0x955 bytes) 000711 1788831666.608765 mapwrite 0x02c4a0 thru 0x03b8b3 (0xf414 bytes) 000712 1788831666.682881 mapwrite 0x027542 thru 0x03460c (0xd0cb bytes) 000713 1788831666.727140 trunc from 0x03b8b4 to 0x01b90c (0x1ffa7 bytes) 000714 1788831666.761545 write 0x039150 thru 0x03ffff (0x6eb0 bytes) 000715 1788831666.762997 write 0x005348 thru 0x008051 (0x2d0a bytes) 000716 1788831666.791785 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xaf707ebd (stale) Mirror 11: 0xaf707ebd (stale) Mirror 13: 0xaf707ebd (stale) Mirror 14: 0x2ea9156f (stale) Mirror 15: 0x1612c76f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xaf707ebd (stale) Mirror 11: 0xaf707ebd (stale) Mirror 13: 0xaf707ebd (stale) Mirror 14: 0x2ea9156f (stale) Mirror 15: 0x1612c76f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000717 1788831667.310523 mapread 0x00879b thru 0x0090c8 (0x92e bytes) 000718 1788831667.327049 trunc from 0x040000 to 0x0366fb (0x9904 bytes) 000720 1788831667.360031 punch from 0x00ae33 to 0x018dba (0xdf88 bytes) 000722 1788831667.371627 fallocate 0x02372f thru 0x0250f1 (0x19c3 bytes) 000723 1788831667.377092 mapread 0x02171a thru 0x02b095 (0x997c bytes) 000724 1788831667.435062 MIRROR_RESYNC 6 mirrors 000725 1788831669.308351 trunc from 0x031369 to 0x0366fb (0x5393 bytes) 000726 1788831669.398166 mapwrite 0x039b65 thru 0x03ffff (0x649b bytes) 000727 1788831669.502910 trunc from 0x040000 to 0x02b01d (0x14fe2 bytes) 000728 1788831669.524260 read 0x013939 thru 0x022bd6 (0xf29e bytes) 000729 1788831669.555491 MIRROR_RESYNC 6 mirrors 000730 1788831671.006745 trunc from 0x02b01e to 0x030ee5 (0x5ec8 bytes) 000731 1788831671.054999 fallocate 0x01e31e thru 0x025b49 (0x782c bytes) 000732 1788831671.061162 mapread 0x00b82f thru 0x013af2 (0x82c4 bytes) 000734 1788831671.087284 mapread 0x00629a thru 0x0069d2 (0x739 bytes) 000736 1788831671.089553 mapread 0x018342 thru 0x0222d0 (0x9f8f bytes) 000737 1788831671.108146 fallocate 0x00c697 thru 0x00f6cf (0x3039 bytes) 000738 1788831671.113790 punch from 0x01d172 to 0x023eb0 (0x6d3f bytes) 000739 1788831671.118999 mapwrite 0x01ea5d thru 0x024aae (0x6052 bytes) 000740 1788831671.147327 fallocate 0x005904 thru 0x00ad48 (0x5445 bytes) 000741 1788831671.153069 mapread 0x027610 thru 0x030ee5 (0x98d6 bytes) 000742 1788831671.162998 mapread 0x0142d6 thru 0x022e31 (0xeb5c bytes) 000743 1788831671.164228 mapwrite 0x01820a thru 0x01865d (0x454 bytes) 000744 1788831671.176798 write 0x02e155 thru 0x03cfc7 (0xee73 bytes) 000745 1788831671.179328 mapread 0x0380e7 thru 0x03cfc7 (0x4ee1 bytes) 000746 1788831671.180517 mapread 0x014ee4 thru 0x018e56 (0x3f73 bytes) 000747 1788831671.181327 read 0x011d5c thru 0x0205d9 (0xe87e bytes) 000748 1788831671.181948 mapwrite 0x012d4c thru 0x02260a (0xf8bf bytes) 000749 1788831671.211534 mapread 0x00c6e3 thru 0x00e2a5 (0x1bc3 bytes) 000750 1788831671.213030 fallocate 0x02187f thru 0x02db03 (0xc285 bytes) 000751 1788831671.223012 write 0x02de9a thru 0x034b87 (0x6cee bytes) 000752 1788831671.235657 trunc from 0x03540e to 0x03cfc7 (0x7bba bytes) 000753 1788831671.248129 MIRROR_RESYNC 6 mirrors 000754 1788831673.428537 MIRROR_EXTEND to 7 mirrors 000755 1788831674.496084 mapwrite 0x000764 thru 0x007b0a (0x73a7 bytes) 000756 1788831674.598967 punch from 0x0251a4 to 0x025787 (0x5e4 bytes) 000758 1788831674.610745 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3cfc8): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cfc8): Mirror 5: 0x1135c6e9 (stale) Mirror 11: 0x1135c6e9 (stale) Mirror 13: 0x1135c6e9 (stale) Mirror 14: 0x1135c6e9 (stale) Mirror 15: 0x1135c6e9 (stale) Mirror 16: 0x1135c6e9 (stale) CRC-32 checksum value for chunk [0, 0x3cfc8): Mirror 1: 0xd3248e36 Mirror 17: 0xd3248e36 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cfc8: skipped 000759 1788831675.716661 fallocate 0x0011f5 thru 0x00453e (0x334a bytes) 000760 1788831675.776575 write 0x0223b9 thru 0x02ffde (0xdc26 bytes) 000761 1788831675.792045 mapread 0x020522 thru 0x02cf86 (0xca65 bytes) 000762 1788831675.802505 write 0x00e951 thru 0x01bf71 (0xd621 bytes) 000763 1788831675.814807 punch from 0x029747 to 0x036179 (0xca33 bytes) 000764 1788831675.832890 mapread 0x01c926 thru 0x026286 (0x9961 bytes) 000765 1788831675.841520 trunc from 0x03cfc8 to 0x017dcb (0x251fc bytes) 000767 1788831675.871057 mapread 0x00d8d6 thru 0x017dcb (0xa4f6 bytes) 000768 1788831675.882144 read 0x009db1 thru 0x014fc9 (0xb219 bytes) 000769 1788831675.883018 punch from 0x0069d4 to 0x00924d (0x287a bytes) 000771 1788831675.889817 write 0x037c9c thru 0x03c8c9 (0x4c2e bytes) 000773 1788831675.892650 trunc from 0x03c8ca to 0x03bc33 (0xc96 bytes) 000774 1788831675.905765 write 0x02c434 thru 0x039798 (0xd365 bytes) 000775 1788831675.914939 mapread 0x006797 thru 0x00f26d (0x8ad7 bytes) 000776 1788831675.925456 mapwrite 0x039de5 thru 0x03fed5 (0x60f1 bytes) 000777 1788831675.977835 read 0x03f259 thru 0x03fed5 (0xc7d bytes) 000779 1788831675.979860 write 0x03a5cd thru 0x03c9c3 (0x23f7 bytes) 000780 1788831675.983475 trunc from 0x03fed6 to 0x03aae7 (0x53ee bytes) 000781 1788831676.001937 trunc from 0x01eacd to 0x01f0c1 (0x5f5 bytes) 000782 1788831676.007110 trunc from 0x02a867 to 0x02bf65 (0x16ff bytes) 000783 1788831676.016790 MIRROR_RESYNC 8 mirrors 000786 1788831679.216483 fallocate 0x035cab thru 0x03ffff (0xa355 bytes) 000787 1788831679.254138 trunc from 0x040000 to 0x0276f0 (0x1890f bytes) 000788 1788831679.280974 mapwrite 0x03d72a thru 0x03ffff (0x28d6 bytes) 000789 1788831679.376299 read 0x002bca thru 0x004cf7 (0x212e bytes) 000790 1788831679.401322 punch from 0x036493 to 0x03ffff (0x9b6d bytes) 000791 1788831679.421420 fallocate 0x01554c thru 0x0242a6 (0xed5b bytes) 000792 1788831679.430516 write 0x0305c7 thru 0x0381b9 (0x7bf3 bytes) 000793 1788831679.445902 punch from 0x004b10 to 0x014440 (0xf931 bytes) 000794 1788831679.454481 write 0x03b58d thru 0x03ffff (0x4a73 bytes) 000795 1788831679.465975 read 0x034b1d thru 0x03841e (0x3902 bytes) 000796 1788831679.467098 read 0x00d230 thru 0x00dad0 (0x8a1 bytes) 000798 1788831679.491158 trunc from 0x040000 to 0x032a52 (0xd5ad bytes) 000799 1788831679.523906 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x32a53): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32a53): Mirror 5: 0xc832d7d1 (stale) Mirror 11: 0xc832d7d1 (stale) Mirror 13: 0xc832d7d1 (stale) Mirror 14: 0xc832d7d1 (stale) Mirror 15: 0xc832d7d1 (stale) Mirror 16: 0xc832d7d1 (stale) Mirror 17: 0xc832d7d1 (stale) CRC-32 checksum value for chunk [0, 0x32a53): Mirror 1: 0xe5030c50 Mirror 18: 0xe5030c50 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32a53: skipped 000800 1788831681.023141 fallocate 0x00002f thru 0x00912b (0x90fd bytes) 000801 1788831681.083940 mapwrite 0x0056d8 thru 0x00c67e (0x6fa7 bytes) 000804 1788831681.135158 trunc from 0x0158c6 to 0x01d58b (0x7cc6 bytes) 000805 1788831681.141353 read 0x006bc7 thru 0x010514 (0x994e bytes) 000807 1788831681.142754 trunc from 0x016448 to 0x01a1e7 (0x3da0 bytes) 000808 1788831681.150943 trunc from 0x032a53 to 0x038ad3 (0x6081 bytes) 000809 1788831681.175574 write 0x02da09 thru 0x0390fc (0xb6f4 bytes) 000811 1788831681.184755 fallocate 0x025fde thru 0x02d494 (0x74b7 bytes) 000812 1788831681.191167 fallocate 0x02d301 thru 0x03253e (0x523e bytes) 000814 1788831681.196804 mapwrite 0x0096e4 thru 0x00e6b6 (0x4fd3 bytes) 000815 1788831681.217820 mapwrite 0x029823 thru 0x02ad55 (0x1533 bytes) 000816 1788831681.243590 mapread 0x002988 thru 0x00541f (0x2a98 bytes) 000817 1788831681.245452 trunc from 0x0148ed to 0x0204c3 (0xbbd7 bytes) 000818 1788831681.252731 mapread 0x020e90 thru 0x02e140 (0xd2b1 bytes) 000819 1788831681.264365 punch from 0x02c652 to 0x0390fc (0xcaab bytes) 000821 1788831681.273176 trunc from 0x01f2b2 to 0x0206bb (0x140a bytes) 000822 1788831681.279510 mapwrite 0x01389c thru 0x0218ca (0xe02f bytes) 000823 1788831681.320966 mapread 0x029475 thru 0x036a00 (0xd58c bytes) 000824 1788831681.348328 MIRROR_RESYNC 9 mirrors 000825 1788831683.678057 read 0x024b06 thru 0x026ce4 (0x21df bytes) 000826 1788831683.687603 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) 000827 1788831684.248680 read 0x023d75 thru 0x02942c (0x56b8 bytes) 000828 1788831684.263853 fallocate 0x00abc9 thru 0x017720 (0xcb58 bytes) 000829 1788831684.331990 mapwrite 0x013268 thru 0x01ba4e (0x87e7 bytes) 000831 1788831684.407432 MIRROR_RESYNC 8 mirrors 000832 1788831686.737236 write 0x01b4c3 thru 0x02a82f (0xf36d bytes) 000833 1788831686.782555 punch from 0x038c7e to 0x0390fc (0x47f bytes) 000834 1788831686.788673 trunc from 0x02e6a7 to 0x03269d (0x3ff7 bytes) 000835 1788831686.797683 punch from 0x025f60 to 0x02d180 (0x7221 bytes) 000836 1788831686.811944 MIRROR_RESYNC 8 mirrors 000837 1788831688.943554 read 0x00463d thru 0x00a679 (0x603d bytes) 000839 1788831688.953941 write 0x016e0a thru 0x01faae (0x8ca5 bytes) 000840 1788831688.997709 mapread 0x0097d2 thru 0x00cbd2 (0x3401 bytes) 000841 1788831689.020723 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x390fd): Mirror 11: 0xbafd389a (stale) Mirror 14: 0xbafd389a (stale) Mirror 15: 0xbafd389a (stale) Mirror 16: 0xbafd389a (stale) Mirror 17: 0xbafd389a (stale) Mirror 18: 0xbafd389a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x390fd): Mirror 11: 0xbafd389a (stale) Mirror 14: 0xbafd389a (stale) Mirror 15: 0xbafd389a (stale) Mirror 16: 0xbafd389a (stale) Mirror 17: 0xbafd389a (stale) Mirror 18: 0xbafd389a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x390fd: skipped 000842 1788831689.531290 mapread 0x00e2c3 thru 0x01363f (0x537d bytes) 000843 1788831689.551489 mapwrite 0x019499 thru 0x01c953 (0x34bb bytes) 000844 1788831689.588577 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x390fd): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x390fd): Mirror 11: 0xbafd389a (stale) Mirror 14: 0xbafd389a (stale) Mirror 15: 0xbafd389a (stale) Mirror 16: 0xbafd389a (stale) Mirror 17: 0xbafd389a (stale) Mirror 18: 0xbafd389a (stale) CRC-32 checksum value for chunk [0, 0x390fd): Mirror 1: 0xa4643a8a Mirror 19: 0xa4643a8a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x390fd: skipped 000845 1788831690.845212 write 0x02922d thru 0x02f336 (0x610a bytes) 000846 1788831690.902462 write 0x014719 thru 0x01f417 (0xacff bytes) 000847 1788831690.915885 trunc from 0x0390fd to 0x003fdf (0x3511d bytes) 000848 1788831690.938988 punch from 0x00210e to 0x003fdf (0x1ed2 bytes) 000849 1788831690.944500 trunc from 0x002b80 to 0x003fdf (0x1460 bytes) 000850 1788831690.958014 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fe0): Mirror 11: 0xf8ba60e2 (stale) Mirror 15: 0xf8ba60e2 (stale) Mirror 16: 0xf8ba60e2 (stale) Mirror 17: 0xf8ba60e2 (stale) Mirror 18: 0xf8ba60e2 (stale) Mirror 19: 0xf8ba60e2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe0): Mirror 11: 0xf8ba60e2 (stale) Mirror 15: 0xf8ba60e2 (stale) Mirror 16: 0xf8ba60e2 (stale) Mirror 17: 0xf8ba60e2 (stale) Mirror 18: 0xf8ba60e2 (stale) Mirror 19: 0xf8ba60e2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe0: skipped 000851 1788831691.323336 mapwrite 0x0375fc thru 0x03d7f7 (0x61fc bytes) 000852 1788831691.370988 fallocate 0x03cc51 thru 0x03ce8c (0x23c bytes) 000853 1788831691.376150 mapwrite 0x00e123 thru 0x0150e5 (0x6fc3 bytes) 000854 1788831691.403758 mapwrite 0x0167ba thru 0x01759e (0xde5 bytes) 000855 1788831691.424340 mapwrite 0x005e47 thru 0x00de1b (0x7fd5 bytes) 000856 1788831691.472594 trunc from 0x02d2c6 to 0x034694 (0x73cf bytes) 000857 1788831691.485153 trunc from 0x03d7f8 to 0x01d92a (0x1fecd bytes) 000858 1788831691.501777 mapread 0x003ed2 thru 0x010af0 (0xcc1f bytes) 000859 1788831691.503016 mapread 0x00b0c8 thru 0x00caab (0x19e4 bytes) 000860 1788831691.503710 fallocate 0x0092c1 thru 0x017260 (0xdfa0 bytes) 000861 1788831691.507580 write 0x039772 thru 0x03ffff (0x688e bytes) 000862 1788831691.509317 read 0x0173b7 thru 0x017d92 (0x9dc bytes) 000863 1788831691.510039 fallocate 0x01f473 thru 0x0261e2 (0x6d70 bytes) 000864 1788831691.518934 MIRROR_RESYNC 7 mirrors 000865 1788831693.179438 fallocate 0x008bda thru 0x015790 (0xcbb7 bytes) 000867 1788831693.199250 read 0x03ea95 thru 0x03f129 (0x695 bytes) 000868 1788831693.202499 trunc from 0x040000 to 0x01fb06 (0x204f9 bytes) 000870 1788831693.214283 fallocate 0x03b830 thru 0x03ffff (0x47d0 bytes) 000871 1788831693.219791 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xbc16b8ec (stale) Mirror 15: 0xbc16b8ec (stale) Mirror 16: 0xbc16b8ec (stale) Mirror 17: 0xbc16b8ec (stale) Mirror 18: 0xbc16b8ec (stale) Mirror 19: 0xbc16b8ec (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x28df28fd Mirror 20: 0x28df28fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000872 1788831693.987514 read 0x01cf78 thru 0x02c1c7 (0xf250 bytes) 000873 1788831694.009645 mapread 0x018b8d thru 0x0196e4 (0xb58 bytes) 000874 1788831694.035761 write 0x00a5c1 thru 0x01a10c (0xfb4c bytes) 000875 1788831694.091537 write 0x02ebf7 thru 0x03414a (0x5554 bytes) 000877 1788831694.101649 write 0x037191 thru 0x03ffff (0x8e6f bytes) 000878 1788831694.107072 fallocate 0x03c409 thru 0x03ffff (0x3bf7 bytes) 000879 1788831694.111272 fallocate 0x01f3c5 thru 0x02ab1b (0xb757 bytes) 000880 1788831694.115900 fallocate 0x0384c1 thru 0x03ffff (0x7b3f bytes) 000881 1788831694.126273 MIRROR_RESYNC 8 mirrors 000883 1788831696.035889 trunc from 0x040000 to 0x025ccf (0x1a330 bytes) 000884 1788831696.102168 punch from 0x017cf6 to 0x01bb98 (0x3ea3 bytes) 000885 1788831696.108452 trunc from 0x025cd0 to 0x02391b (0x23b4 bytes) 000886 1788831696.137429 MIRROR_RESYNC 8 mirrors 000888 1788831697.663503 fallocate 0x00d0c7 thru 0x010e8a (0x3dc4 bytes) 000889 1788831697.704153 trunc from 0x02391c to 0x03cbb5 (0x1929a bytes) 000890 1788831697.728278 read 0x021812 thru 0x02eda3 (0xd592 bytes) 000891 1788831697.736046 trunc from 0x02ee48 to 0x0393d2 (0xa58b bytes) 000892 1788831697.743492 mapread 0x00b2ac thru 0x015ba7 (0xa8fc bytes) 000893 1788831697.780982 read 0x0274d9 thru 0x032a73 (0xb59b bytes) 000894 1788831697.801706 mapread 0x0366e9 thru 0x03791e (0x1236 bytes) 000895 1788831697.811346 MIRROR_RESYNC 8 mirrors 000896 1788831699.503263 MIRROR_RESYNC 8 mirrors 000897 1788831699.957038 trunc from 0x03cbb6 to 0x007f47 (0x34c6e bytes) 000898 1788831700.020416 trunc from 0x007f48 to 0x02d5e6 (0x2569f bytes) 000899 1788831700.041600 trunc from 0x01eea4 to 0x02d23d (0xe39a bytes) 000900 1788831700.046856 mapread 0x01d395 thru 0x025f29 (0x8b95 bytes) 000902 1788831700.072125 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d5e7): Mirror 11: 0x1e6fb73f (stale) Mirror 15: 0x1e6fb73f (stale) Mirror 16: 0x1e6fb73f (stale) Mirror 17: 0x1e6fb73f (stale) Mirror 18: 0x1e6fb73f (stale) Mirror 19: 0x1e6fb73f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d5e7): Mirror 11: 0x1e6fb73f (stale) Mirror 15: 0x1e6fb73f (stale) Mirror 16: 0x1e6fb73f (stale) Mirror 17: 0x1e6fb73f (stale) Mirror 18: 0x1e6fb73f (stale) Mirror 19: 0x1e6fb73f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d5e7: skipped 000903 1788831700.506629 fallocate 0x03ef94 thru 0x03ffff (0x106c bytes) 000904 1788831700.512855 trunc from 0x011934 to 0x01e4af (0xcb7c bytes) 000905 1788831700.517536 trunc from 0x00e1a3 to 0x012014 (0x3e72 bytes) 000906 1788831700.523137 write 0x036a2e thru 0x03ffff (0x95d2 bytes) 000907 1788831700.528679 mapread 0x0202de thru 0x02b578 (0xb29b bytes) 000908 1788831700.558749 mapwrite 0x013f9a thru 0x01f0a4 (0xb10b bytes) 000909 1788831700.589813 punch from 0x01eaa9 to 0x02eaa0 (0xfff8 bytes) 000910 1788831700.597018 fallocate 0x00078c thru 0x0080a7 (0x791c bytes) 000912 1788831700.610267 mapread 0x036447 thru 0x03ffff (0x9bb9 bytes) 000913 1788831700.611316 read 0x000d33 thru 0x005c23 (0x4ef1 bytes) 000915 1788831700.621822 write 0x019158 thru 0x01c6c0 (0x3569 bytes) 000917 1788831700.624478 write 0x03b198 thru 0x03c81e (0x1687 bytes) 000918 1788831700.625798 punch from 0x01c9f1 to 0x021003 (0x4613 bytes) 000919 1788831700.637805 punch from 0x0229f0 to 0x02beba (0x94cb bytes) 000920 1788831700.645421 write 0x0236e2 thru 0x028ba7 (0x54c6 bytes) 000921 1788831700.653774 punch from 0x03bb0c to 0x03ffff (0x44f4 bytes) 000922 1788831700.659967 fallocate 0x033746 thru 0x03c15f (0x8a1a bytes) 000923 1788831700.663987 read 0x01c775 thru 0x0218ad (0x5139 bytes) 000924 1788831700.673470 trunc from 0x040000 to 0x00c72c (0x338d3 bytes) 000925 1788831700.688001 mapread 0x006015 thru 0x00c72c (0x6718 bytes) 000926 1788831700.689050 write 0x03e254 thru 0x03ffff (0x1dac bytes) 000927 1788831700.690138 mapread 0x01b850 thru 0x024478 (0x8c29 bytes) 000928 1788831700.738037 MIRROR_RESYNC 7 mirrors 000929 1788831701.939553 mapwrite 0x016e33 thru 0x021c2d (0xadfb bytes) 000930 1788831702.105438 fallocate 0x0070cf thru 0x015f71 (0xeea3 bytes) 000931 1788831702.111569 punch from 0x0049a3 to 0x00d29a (0x88f8 bytes) 000932 1788831702.117163 trunc from 0x01920f to 0x01e597 (0x5389 bytes) 000933 1788831702.122640 read 0x002d38 thru 0x00982a (0x6af3 bytes) 000934 1788831702.131645 fallocate 0x01b34d thru 0x01f6aa (0x435e bytes) 000935 1788831702.136275 trunc from 0x040000 to 0x02ad38 (0x152c7 bytes) 000936 1788831702.156496 mapwrite 0x03da19 thru 0x03ffff (0x25e7 bytes) 000937 1788831702.201591 MIRROR_RESYNC 7 mirrors 000938 1788831703.684929 punch from 0x01839e to 0x020992 (0x85f5 bytes) 000939 1788831703.717592 punch from 0x002dd0 to 0x00d80c (0xaa3d bytes) 000940 1788831703.723230 punch from 0x02dfd9 to 0x02e405 (0x42d bytes) 000941 1788831703.727333 read 0x01d926 thru 0x029786 (0xbe61 bytes) 000942 1788831703.736150 write 0x02ea84 thru 0x03cc86 (0xe203 bytes) 000943 1788831703.743948 mapread 0x0395c8 thru 0x03bd3d (0x2776 bytes) 000944 1788831703.744656 punch from 0x01dcf6 to 0x02a263 (0xc56e bytes) 000945 1788831703.748182 mapread 0x002bba thru 0x003ab5 (0xefc bytes) 000947 1788831703.755274 write 0x02118a thru 0x02ac29 (0x9aa0 bytes) 000948 1788831703.765119 punch from 0x014a85 to 0x01cc8a (0x8206 bytes) 000949 1788831703.768968 fallocate 0x023a5a thru 0x02b8c4 (0x7e6b bytes) 000950 1788831703.772572 mapread 0x03cc9c thru 0x03ffff (0x3364 bytes) 000951 1788831703.778326 trunc from 0x037ea2 to 0x03ffff (0x815e bytes) 000952 1788831703.823225 trunc from 0x03fc19 to 0x03ffff (0x3e7 bytes) 000953 1788831703.834126 fallocate 0x0235a2 thru 0x033234 (0xfc93 bytes) 000954 1788831703.840339 trunc from 0x040000 to 0x0203cc (0x1fc33 bytes) 000955 1788831703.870306 fallocate 0x003cb8 thru 0x0085c8 (0x4911 bytes) 000956 1788831703.880587 trunc from 0x0139d6 to 0x014184 (0x7af bytes) 000957 1788831703.884615 write 0x02aef9 thru 0x034162 (0x926a bytes) 000958 1788831703.888958 punch from 0x0340b7 to 0x034162 (0xac bytes) 000959 1788831703.923395 mapwrite 0x013222 thru 0x022eae (0xfc8d bytes) 000960 1788831703.960741 fallocate 0x00d4ee thru 0x00eb32 (0x1645 bytes) 000961 1788831703.967420 read 0x006a4a thru 0x01333f (0xc8f6 bytes) 000962 1788831703.980868 MIRROR_RESYNC 7 mirrors 000963 1788831705.387911 write 0x03095c thru 0x03eec5 (0xe56a bytes) 000964 1788831705.419281 fallocate 0x0261d7 thru 0x02d21d (0x7047 bytes) 000965 1788831705.427533 mapread 0x03b268 thru 0x03eec5 (0x3c5e bytes) 000966 1788831705.429142 fallocate 0x0212f4 thru 0x0256aa (0x43b7 bytes) 000968 1788831705.439566 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3eec6): Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eec6): Mirror 11: 0x62290f28 (stale) Mirror 15: 0x62290f28 (stale) Mirror 16: 0x62290f28 (stale) Mirror 17: 0x62290f28 (stale) Mirror 18: 0x62290f28 (stale) Mirror 19: 0x62290f28 (stale) CRC-32 checksum value for chunk [0, 0x3eec6): Mirror 1: 0x1fadbf2 Mirror 20: 0x1fadbf2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eec6: skipped 000969 1788831706.348758 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3eec6): Mirror 15: 0x62290f28 (stale) Mirror 16: 0x62290f28 (stale) Mirror 17: 0x62290f28 (stale) Mirror 18: 0x62290f28 (stale) Mirror 19: 0x62290f28 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eec6): Mirror 15: 0x62290f28 (stale) Mirror 16: 0x62290f28 (stale) Mirror 17: 0x62290f28 (stale) Mirror 18: 0x62290f28 (stale) Mirror 19: 0x62290f28 (stale) CRC-32 checksum value for chunk [0, 0x3eec6): Mirror 1: 0x1fadbf2 Mirror 20: 0x1fadbf2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eec6: skipped 000970 1788831707.179340 trunc from 0x02c200 to 0x02ebb8 (0x29b9 bytes) 000971 1788831707.236703 MIRROR_RESYNC 7 mirrors 000972 1788831708.952090 punch from 0x033441 to 0x038e6a (0x5a2a bytes) 000973 1788831708.982011 punch from 0x03d9b2 to 0x03eec5 (0x1514 bytes) 000974 1788831708.986721 punch from 0x029cf3 to 0x033f2e (0xa23c bytes) 000975 1788831708.990863 mapwrite 0x02684a thru 0x028657 (0x1e0e bytes) 000976 1788831709.019953 trunc from 0x03eec6 to 0x000c2f (0x3e296 bytes) 000977 1788831709.042958 write 0x0070ce thru 0x00ab17 (0x3a4a bytes) 000978 1788831709.044281 mapwrite 0x00b70d thru 0x01855f (0xce53 bytes) 000979 1788831709.114251 mapread 0x002bb3 thru 0x0046fe (0x1b4c bytes) 000980 1788831709.121244 write 0x01afe2 thru 0x01ed19 (0x3d38 bytes) 000981 1788831709.124137 fallocate 0x01e4b9 thru 0x02719d (0x8ce5 bytes) 000982 1788831709.128931 mapread 0x0002d4 thru 0x00d561 (0xd28e bytes) 000983 1788831709.136723 mapwrite 0x024cd9 thru 0x03415e (0xf486 bytes) 000984 1788831709.191831 trunc from 0x01216a to 0x016549 (0x43e0 bytes) 000985 1788831709.196942 mapwrite 0x005689 thru 0x00e31b (0x8c93 bytes) 000986 1788831709.216978 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3415f): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3415f): Mirror 15: 0x8795324 (stale) Mirror 16: 0x8795324 (stale) Mirror 17: 0x8795324 (stale) Mirror 18: 0x8795324 (stale) Mirror 19: 0x8795324 (stale) Mirror 20: 0x8795324 (stale) CRC-32 checksum value for chunk [0, 0x3415f): Mirror 1: 0xd8a2d22e Mirror 21: 0xd8a2d22e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3415f: skipped 000988 1788831710.059919 mapwrite 0x001215 thru 0x004193 (0x2f7f bytes) 000989 1788831710.237112 write 0x008df9 thru 0x01771f (0xe927 bytes) 000990 1788831710.249403 mapwrite 0x030206 thru 0x032d47 (0x2b42 bytes) 000991 1788831710.276071 fallocate 0x005a08 thru 0x00dc92 (0x828b bytes) 000992 1788831710.280679 mapread 0x000947 thru 0x005832 (0x4eec bytes) 000993 1788831710.286248 read 0x00ee8c thru 0x0187e7 (0x995c bytes) 000994 1788831710.300118 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3415f): Mirror 15: 0x8795324 (stale) Mirror 16: 0x8795324 (stale) Mirror 17: 0x8795324 (stale) Mirror 18: 0x8795324 (stale) Mirror 19: 0x8795324 (stale) Mirror 20: 0x8795324 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3415f): Mirror 15: 0x8795324 (stale) Mirror 16: 0x8795324 (stale) Mirror 17: 0x8795324 (stale) Mirror 18: 0x8795324 (stale) Mirror 19: 0x8795324 (stale) Mirror 20: 0x8795324 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3415f: skipped 000995 1788831710.750761 trunc from 0x00c717 to 0x00fe46 (0x3730 bytes) 000996 1788831710.760127 read 0x003a58 thru 0x00f75c (0xbd05 bytes) 000997 1788831710.773898 punch from 0x0245eb to 0x02cfe9 (0x89ff bytes) 000999 1788831710.780220 write 0x022642 thru 0x0226ad (0x6c bytes) 001000 1788831710.793778 trunc from 0x03415f to 0x02f4e0 (0x4c7e bytes) All operations completed A-OK!