== sanity-flr test 70a: flr mode fsx test ================ 18:24:21 (1784413461) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 3461 fallocating to largest ever: 0x1f90f 000001 1784413461.807457 fallocate 0x01ae4e thru 0x01f90e (0x4ac1 bytes) skipping zero size read 000003 1784413461.810949 mapwrite 0x02072b thru 0x026eca (0x67a0 bytes) truncating to largest ever: 0x2ac42 000004 1784413461.825330 trunc from 0x026ecb to 0x02ac41 (0x3d77 bytes) 000005 1784413461.829531 mapread 0x017dd6 thru 0x0211e1 (0x940c bytes) fallocating to largest ever: 0x37dd8 000006 1784413461.832727 fallocate 0x02db93 thru 0x037dd7 (0xa245 bytes) 000007 1784413461.834766 punch from 0x012acd to 0x0164b1 (0x39e5 bytes) 000008 1784413461.836344 trunc from 0x011cfd to 0x014d89 (0x308d bytes) 000010 1784413461.838235 punch from 0x009648 to 0x012984 (0x933d bytes) 000012 1784413461.840317 write 0x01fc94 thru 0x02c977 (0xcce4 bytes) 000013 1784413461.842853 mapread 0x0207d3 thru 0x02dc8a (0xd4b8 bytes) 000014 1784413461.846359 trunc from 0x037dd8 to 0x02b19d (0xcc3a bytes) 000016 1784413461.850882 fallocate 0x01e2ab thru 0x02ad2c (0xca82 bytes) fallocating to largest ever: 0x393a4 000019 1784413461.853625 fallocate 0x030f50 thru 0x0393a3 (0x8454 bytes) 000020 1784413461.855662 trunc from 0x02b19e to 0x0077ce (0x239cf bytes) 000022 1784413461.860491 trunc from 0x0056d5 to 0x0077ce (0x20fa bytes) 000024 1784413461.862586 punch from 0x0019a6 to 0x00720b (0x5866 bytes) 000025 1784413461.864273 write 0x00625d thru 0x00c4cb (0x626f bytes) fallocating to largest ever: 0x40000 000026 1784413461.866950 fallocate 0x03da35 thru 0x03ffff (0x25cb bytes) 000027 1784413461.869193 punch from 0x005865 to 0x00c4cb (0x6c67 bytes) 000028 1784413461.873666 read 0x003543 thru 0x00c4cb (0x8f89 bytes) 000029 1784413461.876322 trunc from 0x00943a to 0x00b68d (0x2254 bytes) 000030 1784413461.878174 trunc from 0x009de3 to 0x00b499 (0x16b7 bytes) 000031 1784413461.879831 fallocate 0x03f615 thru 0x03ffff (0x9eb bytes) 000032 1784413461.881344 mapwrite 0x037137 thru 0x03ffff (0x8ec9 bytes) 000033 1784413461.893965 punch from 0x021bea to 0x022100 (0x517 bytes) 000034 1784413461.895312 write 0x01cd29 thru 0x0272a5 (0xa57d bytes) 000036 1784413461.899021 trunc from 0x040000 to 0x028830 (0x177cf bytes) 000037 1784413461.903513 read 0x0023a6 thru 0x00496e (0x25c9 bytes) 000038 1784413461.906500 trunc from 0x01a667 to 0x02372c (0x90c6 bytes) 000039 1784413461.910747 read 0x014701 thru 0x016205 (0x1b05 bytes) 000040 1784413461.911340 read 0x000f3c thru 0x00664e (0x5713 bytes) 000041 1784413461.913283 MIRROR_EXTEND to 2 mirrors 000042 1784413462.097794 trunc from 0x01fb91 to 0x028830 (0x8ca0 bytes) 000043 1784413462.105982 trunc from 0x028831 to 0x01238f (0x164a1 bytes) 000044 1784413462.114130 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x12390): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12390): Mirror 2: 0x4fbe3909 (stale) CRC-32 checksum value for chunk [0, 0x12390): Mirror 1: 0x4fbe3909 Mirror 3: 0x4fbe3909 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12390: skipped 000045 1784413462.325945 fallocate 0x01ae4c thru 0x01dbe4 (0x2d99 bytes) 000046 1784413462.335665 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1dbe5): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1dbe5): Mirror 2: 0xcb44a79a (stale) Mirror 3: 0xcb44a79a (stale) CRC-32 checksum value for chunk [0, 0x1dbe5): Mirror 1: 0xcb44a79a Mirror 4: 0xcb44a79a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1dbe5: skipped 000047 1784413462.547573 mapwrite 0x027c2a thru 0x035fe7 (0xe3be bytes) 000048 1784413462.574335 mapwrite 0x01e40b thru 0x02a02a (0xbc20 bytes) 000049 1784413462.584701 fallocate 0x014e07 thru 0x01c144 (0x733e bytes) 000050 1784413462.588172 MIRROR_RESYNC 4 mirrors 000051 1784413462.808528 punch from 0x009e1c to 0x014bbf (0xada4 bytes) 000052 1784413462.818773 trunc from 0x004aa7 to 0x01467b (0xfbd5 bytes) 000053 1784413462.820358 fallocate 0x027af5 thru 0x034727 (0xcc33 bytes) 000055 1784413462.822577 trunc from 0x023f11 to 0x02cb94 (0x8c84 bytes) 000056 1784413462.825507 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35fe8): Mirror 3: 0x7aab3384 (stale) Mirror 4: 0x7aab3384 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35fe8): Mirror 3: 0x7aab3384 (stale) Mirror 4: 0x7aab3384 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35fe8: skipped 000057 1784413462.917578 write 0x03a014 thru 0x03ffff (0x5fec bytes) 000058 1784413462.919846 mapwrite 0x00e732 thru 0x01485a (0x6129 bytes) 000059 1784413462.931761 trunc from 0x026f27 to 0x027615 (0x6ef bytes) 000061 1784413462.933734 fallocate 0x02e7da thru 0x0310e2 (0x2909 bytes) 000062 1784413462.935584 read 0x036889 thru 0x03ffff (0x9777 bytes) 000063 1784413462.937561 trunc from 0x040000 to 0x01ddde (0x22221 bytes) 000064 1784413462.946458 mapwrite 0x01caf5 thru 0x01e580 (0x1a8c bytes) 000065 1784413462.957922 write 0x03c27d thru 0x03d90c (0x1690 bytes) 000066 1784413462.958990 mapwrite 0x036b34 thru 0x03ffff (0x94cc bytes) 000067 1784413462.973262 trunc from 0x040000 to 0x014417 (0x2bbe8 bytes) 000068 1784413462.978016 mapwrite 0x03c779 thru 0x03ffff (0x3887 bytes) 000069 1784413462.991873 mapread 0x034c31 thru 0x035369 (0x739 bytes) 000070 1784413462.995289 punch from 0x032f25 to 0x03a462 (0x753e bytes) 000071 1784413462.998134 trunc from 0x01ebca to 0x02315c (0x4593 bytes) 000072 1784413462.999935 trunc from 0x040000 to 0x018b82 (0x2747d bytes) 000073 1784413463.007579 MIRROR_RESYNC 3 mirrors 000074 1784413463.185302 punch from 0x01102a to 0x011227 (0x1fe bytes) 000075 1784413463.196915 MIRROR_RESYNC 3 mirrors 000076 1784413463.365759 trunc from 0x01352d to 0x018b82 (0x5656 bytes) 000077 1784413463.374476 mapread 0x0114c2 thru 0x018b82 (0x76c1 bytes) 000078 1784413463.379783 punch from 0x00a830 to 0x018b82 (0xe353 bytes) 000079 1784413463.381328 trunc from 0x018b83 to 0x02e6fa (0x15b78 bytes) 000080 1784413463.386985 punch from 0x0262c2 to 0x026a58 (0x797 bytes) 000081 1784413463.388872 punch from 0x009441 to 0x00de94 (0x4a54 bytes) 000082 1784413463.390497 write 0x01d098 thru 0x02062c (0x3595 bytes) 000083 1784413463.393215 punch from 0x00f62c to 0x013874 (0x4249 bytes) 000084 1784413463.395881 MIRROR_RESYNC 3 mirrors 000085 1784413463.559019 punch from 0x0216c8 to 0x02e6fa (0xd033 bytes) 000086 1784413463.568512 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2e6fb): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e6fb): Mirror 3: 0x46f4019 (stale) Mirror 4: 0x46f4019 (stale) CRC-32 checksum value for chunk [0, 0x2e6fb): Mirror 1: 0x46f4019 Mirror 5: 0x46f4019 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e6fb: skipped 000087 1784413463.771361 fallocate 0x02c63c thru 0x03c2e3 (0xfca8 bytes) 000089 1784413463.780981 punch from 0x023082 to 0x02ec9e (0xbc1d bytes) 000091 1784413463.783167 mapread 0x02d893 thru 0x037fca (0xa738 bytes) 000092 1784413463.788687 mapread 0x02b802 thru 0x030fa4 (0x57a3 bytes) 000093 1784413463.789626 punch from 0x006ddc to 0x01630f (0xf534 bytes) 000094 1784413463.791248 read 0x01dbfc thru 0x027bb9 (0x9fbe bytes) 000096 1784413463.794050 trunc from 0x03c2e4 to 0x0397c5 (0x2b1e bytes) 000097 1784413463.799747 write 0x023465 thru 0x0281fc (0x4d98 bytes) 000098 1784413463.800484 punch from 0x01e386 to 0x029fa1 (0xbc1c bytes) 000099 1784413463.804411 trunc from 0x0397c6 to 0x01dc87 (0x1bb3e bytes) 000100 1784413463.809075 trunc from 0x01dc88 to 0x02336e (0x56e7 bytes) 000101 1784413463.813188 read 0x0024cf thru 0x008958 (0x648a bytes) 000102 1784413463.816620 punch from 0x009c22 to 0x0165b0 (0xc98f bytes) 000103 1784413463.818325 trunc from 0x02336f to 0x02f45d (0xc0ef bytes) 000104 1784413463.822635 trunc from 0x02f45e to 0x037f13 (0x8ab6 bytes) 000105 1784413463.827875 write 0x0249e5 thru 0x030119 (0xb735 bytes) 000106 1784413463.831163 punch from 0x01087a to 0x01b6c3 (0xae4a bytes) 000107 1784413463.834274 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37f14): Mirror 3: 0xb827ebf1 (stale) Mirror 4: 0xb827ebf1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37f14): Mirror 3: 0xb827ebf1 (stale) Mirror 4: 0xb827ebf1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37f14: skipped 000108 1784413463.914909 fallocate 0x03e29a thru 0x03ffff (0x1d66 bytes) 000109 1784413463.916492 punch from 0x009828 to 0x00ab02 (0x12db bytes) 000110 1784413463.917921 read 0x00074d thru 0x00966e (0x8f22 bytes) 000111 1784413463.920020 mapwrite 0x03939d thru 0x03ffff (0x6c63 bytes) 000112 1784413463.929285 trunc from 0x040000 to 0x01bcac (0x24353 bytes) 000114 1784413463.934667 mapwrite 0x036bc5 thru 0x03e627 (0x7a63 bytes) 000115 1784413463.945863 mapwrite 0x00883e thru 0x012242 (0x9a05 bytes) 000116 1784413463.953942 trunc from 0x034541 to 0x034bcf (0x68f bytes) 000117 1784413463.955588 read 0x02d959 thru 0x03d8ee (0xff96 bytes) 000119 1784413463.958851 trunc from 0x03e628 to 0x0316a4 (0xcf83 bytes) 000120 1784413463.962750 fallocate 0x023c48 thru 0x025a2b (0x1de4 bytes) 000121 1784413463.964648 trunc from 0x00db4f to 0x01598c (0x7e3e bytes) 000122 1784413463.966280 punch from 0x01521b to 0x024f25 (0xfd0b bytes) 000123 1784413463.970159 mapwrite 0x00c84c thru 0x019577 (0xcd2c bytes) 000124 1784413463.989439 fallocate 0x036baf thru 0x03b041 (0x4493 bytes) 000125 1784413463.992082 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x316a5): Mirror 4: 0x399be95b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x316a5): Mirror 4: 0x399be95b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x316a5: skipped 000126 1784413464.062738 write 0x02bda2 thru 0x0398d8 (0xdb37 bytes) 000127 1784413464.065872 fallocate 0x03e5eb thru 0x03ffff (0x1a15 bytes) 000128 1784413464.067569 read 0x01cd67 thru 0x020dee (0x4088 bytes) 000129 1784413464.069717 punch from 0x011cd3 to 0x01f29f (0xd5cd bytes) 000130 1784413464.071087 trunc from 0x00bce7 to 0x01200c (0x6326 bytes) 000131 1784413464.073689 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf7d959fe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe445672 Mirror 5: 0xe445672 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000132 1784413464.269187 write 0x000695 thru 0x00ff54 (0xf8c0 bytes) 000133 1784413464.280298 punch from 0x00785e to 0x01390f (0xc0b2 bytes) 000134 1784413464.284083 trunc from 0x00e311 to 0x0121df (0x3ecf bytes) 000135 1784413464.285729 punch from 0x038a4c to 0x03ffff (0x75b4 bytes) 000136 1784413464.287076 mapread 0x0022f8 thru 0x00f463 (0xd16c bytes) 000137 1784413464.292166 trunc from 0x0302e8 to 0x03b494 (0xb1ad bytes) 000138 1784413464.293956 trunc from 0x0370e9 to 0x03ec85 (0x7b9d bytes) 000139 1784413464.295284 punch from 0x005569 to 0x005baa (0x642 bytes) 000140 1784413464.297971 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xe445672 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xe445672 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000141 1784413464.376932 trunc from 0x040000 to 0x027c73 (0x1838c bytes) 000142 1784413464.386363 trunc from 0x027c74 to 0x0169d3 (0x112a0 bytes) 000143 1784413464.390176 trunc from 0x0123c9 to 0x0169d3 (0x460b bytes) 000144 1784413464.392774 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) 000145 1784413464.429946 mapread 0x010107 thru 0x0169d3 (0x68cd bytes) 000146 1784413464.435208 read 0x007283 thru 0x00d59f (0x631d bytes) 000147 1784413464.438912 MIRROR_EXTEND to 2 mirrors 000148 1784413464.598877 write 0x029c4f thru 0x02eebe (0x5270 bytes) 000149 1784413464.609285 mapwrite 0x02d776 thru 0x0370d3 (0x995e bytes) 000151 1784413464.631064 mapread 0x01c171 thru 0x021e1e (0x5cae bytes) 000152 1784413464.634529 mapwrite 0x014aec thru 0x01b3f2 (0x6907 bytes) 000153 1784413464.642607 trunc from 0x01e999 to 0x02b232 (0xc89a bytes) 000154 1784413464.644254 trunc from 0x0370d4 to 0x03efe1 (0x7f0e bytes) 000155 1784413464.648287 fallocate 0x016d85 thru 0x01fa2a (0x8ca6 bytes) 000156 1784413464.649985 trunc from 0x02301a to 0x02f5a7 (0xc58e bytes) 000157 1784413464.652542 MIRROR_RESYNC 2 mirrors 000158 1784413464.833040 fallocate 0x015039 thru 0x02026c (0xb234 bytes) 000159 1784413464.842999 write 0x027d19 thru 0x037a9f (0xfd87 bytes) 000160 1784413464.847107 mapread 0x009318 thru 0x00c9e6 (0x36cf bytes) 000161 1784413464.852831 punch from 0x02fc6b to 0x0354da (0x5870 bytes) 000162 1784413464.857354 mapread 0x01f084 thru 0x024fd9 (0x5f56 bytes) 000163 1784413464.861906 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) 000165 1784413464.903314 punch from 0x00a1a7 to 0x00a862 (0x6bc bytes) 000166 1784413464.906749 read 0x011d57 thru 0x0214bd (0xf767 bytes) 000167 1784413464.911721 read 0x0176d7 thru 0x024b33 (0xd45d bytes) 000168 1784413464.915749 fallocate 0x00fb12 thru 0x01dcfa (0xe1e9 bytes) 000169 1784413464.918111 write 0x020a1a thru 0x022fa9 (0x2590 bytes) 000171 1784413464.920643 write 0x0306f0 thru 0x03effe (0xe90f bytes) 000172 1784413464.921719 fallocate 0x00d1e5 thru 0x016f6b (0x9d87 bytes) 000174 1784413464.926081 trunc from 0x01c2bc to 0x0273dd (0xb122 bytes) 000175 1784413464.931646 fallocate 0x029b42 thru 0x02f9f3 (0x5eb2 bytes) 000177 1784413464.934223 read 0x020231 thru 0x02a9bb (0xa78b bytes) 000178 1784413464.937510 write 0x0227d5 thru 0x026472 (0x3c9e bytes) 000179 1784413464.938229 trunc from 0x02d8a9 to 0x034978 (0x70d0 bytes) 000180 1784413464.940474 trunc from 0x00e530 to 0x01d1e5 (0xecb6 bytes) 000181 1784413464.942567 trunc from 0x03efff to 0x03fef5 (0xef7 bytes) 000182 1784413464.952209 mapread 0x00d661 thru 0x01b528 (0xdec8 bytes) 000184 1784413464.973430 punch from 0x00dd9b to 0x00e36d (0x5d3 bytes) 000185 1784413464.975020 trunc from 0x00157c to 0x0067d7 (0x525c bytes) 000186 1784413464.977731 MIRROR_EXTEND to 2 mirrors 000187 1784413465.179460 fallocate 0x00cf05 thru 0x011fa8 (0x50a4 bytes) 000188 1784413465.190168 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3fef6): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fef6): Mirror 2: 0xef334c5d (stale) CRC-32 checksum value for chunk [0, 0x3fef6): Mirror 1: 0xef334c5d Mirror 3: 0xef334c5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fef6: skipped 000189 1784413465.451932 mapread 0x02f335 thru 0x038d1d (0x99e9 bytes) 000190 1784413465.457351 write 0x031652 thru 0x03501f (0x39ce bytes) 000191 1784413465.468647 read 0x02df48 thru 0x02eaf2 (0xbab bytes) 000192 1784413465.470214 read 0x027515 thru 0x0276c4 (0x1b0 bytes) 000193 1784413465.473416 trunc from 0x005275 to 0x00fffc (0xad88 bytes) 000194 1784413465.475154 mapwrite 0x03d3e8 thru 0x03ffff (0x2c18 bytes) 000195 1784413465.488798 MIRROR_RESYNC 3 mirrors 000196 1784413465.699588 trunc from 0x001be5 to 0x008e9b (0x72b7 bytes) 000197 1784413465.709653 read 0x018181 thru 0x01eb24 (0x69a4 bytes) 000198 1784413465.712664 mapwrite 0x02f90e thru 0x030abe (0x11b1 bytes) 000199 1784413465.719735 write 0x0151a3 thru 0x024a3d (0xf89b bytes) 000200 1784413465.724548 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xc9f40899 (stale) Mirror 3: 0xc9f40899 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x54046932 Mirror 4: 0x54046932 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000201 1784413465.944749 trunc from 0x00cf7f to 0x00eb00 (0x1b82 bytes) 000202 1784413465.955834 MIRROR_RESYNC 4 mirrors 000203 1784413466.218531 punch from 0x02b663 to 0x03211a (0x6ab8 bytes) 000204 1784413466.227889 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x54046932 (stale) Mirror 3: 0x54046932 (stale) Mirror 4: 0x54046932 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x283f6902 Mirror 5: 0x283f6902 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000205 1784413466.473968 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x54046932 (stale) Mirror 3: 0x54046932 (stale) Mirror 4: 0x54046932 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x54046932 (stale) Mirror 3: 0x54046932 (stale) Mirror 4: 0x54046932 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000206 1784413466.575258 read 0x02593a thru 0x0299b8 (0x407f bytes) 000207 1784413466.578511 mapwrite 0x025a82 thru 0x026b76 (0x10f5 bytes) 000208 1784413466.601962 trunc from 0x040000 to 0x03d933 (0x26cc bytes) 000209 1784413466.608735 punch from 0x00cc4e to 0x00dc1f (0xfd2 bytes) 000212 1784413466.611465 trunc from 0x03d934 to 0x010083 (0x2d8b0 bytes) 000213 1784413466.616701 punch from 0x0089f5 to 0x010083 (0x768f bytes) 000214 1784413466.618751 trunc from 0x010084 to 0x0084a4 (0x7bdf bytes) 000215 1784413466.623931 trunc from 0x006be4 to 0x0084a4 (0x18c1 bytes) 000216 1784413466.626006 read 0x0000fb thru 0x0084a4 (0x83aa bytes) 000218 1784413466.630048 read 0x0069be thru 0x0084a4 (0x1ae7 bytes) 000220 1784413466.631033 trunc from 0x0006b3 to 0x0084a4 (0x7df2 bytes) 000221 1784413466.633720 fallocate 0x008d37 thru 0x0173b7 (0xe681 bytes) 000222 1784413466.636371 trunc from 0x0037f6 to 0x01214c (0xe957 bytes) 000223 1784413466.638692 trunc from 0x0173b8 to 0x012b6e (0x4849 bytes) 000224 1784413466.643964 punch from 0x010717 to 0x01189c (0x1186 bytes) 000225 1784413466.647250 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x12b6f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12b6f): Mirror 2: 0xed44525f (stale) Mirror 3: 0xed44525f (stale) Mirror 4: 0xed44525f (stale) CRC-32 checksum value for chunk [0, 0x12b6f): Mirror 1: 0xe21921d Mirror 5: 0xe21921d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12b6f: skipped 000226 1784413466.887542 punch from 0x00758e to 0x012b6e (0xb5e1 bytes) 000227 1784413466.900171 mapread 0x00499d thru 0x00fdec (0xb450 bytes) 000228 1784413466.908930 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x12b6f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12b6f): Mirror 2: 0xed44525f (stale) Mirror 3: 0xed44525f (stale) Mirror 4: 0xed44525f (stale) Mirror 5: 0xe21921d (stale) CRC-32 checksum value for chunk [0, 0x12b6f): Mirror 1: 0xe21921d Mirror 6: 0xe21921d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12b6f: skipped 000229 1784413467.185756 trunc from 0x012b6f to 0x0177ad (0x4c3f bytes) 000230 1784413467.207115 fallocate 0x02e9f6 thru 0x038018 (0x9623 bytes) 000231 1784413467.211417 write 0x01846c thru 0x01ff61 (0x7af6 bytes) 000232 1784413467.215370 mapread 0x010f45 thru 0x01e258 (0xd314 bytes) 000233 1784413467.221897 mapwrite 0x0125e2 thru 0x01c937 (0xa356 bytes) 000234 1784413467.232877 fallocate 0x02af10 thru 0x0338cd (0x89be bytes) 000235 1784413467.235161 trunc from 0x038019 to 0x01b070 (0x1cfa8 bytes) 000236 1784413467.245279 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b071): Mirror 2: 0x3dfbcc92 (stale) Mirror 3: 0x3dfbcc92 (stale) Mirror 4: 0x3dfbcc92 (stale) Mirror 5: 0xb6eb8df6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b071): Mirror 2: 0x3dfbcc92 (stale) Mirror 3: 0x3dfbcc92 (stale) Mirror 4: 0x3dfbcc92 (stale) Mirror 5: 0xb6eb8df6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b071: skipped 000237 1784413467.338043 mapwrite 0x01cd96 thru 0x02b23f (0xe4aa bytes) 000238 1784413467.359675 read 0x000249 thru 0x0010da (0xe92 bytes) 000239 1784413467.361822 trunc from 0x01f956 to 0x0208be (0xf69 bytes) 000240 1784413467.363521 write 0x0195b6 thru 0x020d38 (0x7783 bytes) 000241 1784413467.365285 mapread 0x01f584 thru 0x02b23f (0xbcbc bytes) 000242 1784413467.366036 trunc from 0x02b240 to 0x015715 (0x15b2a bytes) 000243 1784413467.370228 mapread 0x001073 thru 0x0067c5 (0x5753 bytes) 000244 1784413467.373702 read 0x00b3ff thru 0x010968 (0x556a bytes) 000245 1784413467.374349 mapwrite 0x02ccd7 thru 0x032903 (0x5c2d bytes) 000246 1784413467.386568 write 0x006cc0 thru 0x01677c (0xfabd bytes) 000247 1784413467.387632 write 0x0313dd thru 0x035f33 (0x4b57 bytes) 000248 1784413467.388290 trunc from 0x035f34 to 0x02de06 (0x812d bytes) 000249 1784413467.392201 mapread 0x023428 thru 0x02bbcc (0x87a5 bytes) 000250 1784413467.393001 trunc from 0x02de07 to 0x01b620 (0x127e6 bytes) 000251 1784413467.397428 trunc from 0x004b45 to 0x00af60 (0x641c bytes) 000252 1784413467.401707 read 0x00be11 thru 0x0145a6 (0x8796 bytes) 000253 1784413467.402144 read 0x0191cd thru 0x01b620 (0x2454 bytes) 000254 1784413467.402641 trunc from 0x010b30 to 0x01b620 (0xaaf1 bytes) 000255 1784413467.404686 write 0x0392e4 thru 0x03ffff (0x6d1c bytes) 000257 1784413467.405888 trunc from 0x040000 to 0x03fee6 (0x119 bytes) 000258 1784413467.411444 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3fee7): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fee7): Mirror 2: 0x111b1289 (stale) Mirror 3: 0x111b1289 (stale) Mirror 4: 0x111b1289 (stale) Mirror 5: 0x27f63cd3 (stale) CRC-32 checksum value for chunk [0, 0x3fee7): Mirror 1: 0x3f71a6ce Mirror 6: 0x3f71a6ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fee7: skipped 000259 1784413467.646640 trunc from 0x028f24 to 0x036eec (0xdfc9 bytes) 000260 1784413467.657903 trunc from 0x03fee7 to 0x0206f3 (0x1f7f3 bytes) 000261 1784413467.667769 mapread 0x0159f9 thru 0x0206f3 (0xacfb bytes) 000262 1784413467.675073 mapread 0x0040c6 thru 0x00695d (0x2898 bytes) 000263 1784413467.678545 trunc from 0x0206f4 to 0x02e614 (0xdf21 bytes) 000265 1784413467.684053 punch from 0x011613 to 0x0160bc (0x4aaa bytes) 000266 1784413467.686163 trunc from 0x000b56 to 0x010247 (0xf6f2 bytes) 000267 1784413467.688093 trunc from 0x006742 to 0x0093a0 (0x2c5f bytes) 000268 1784413467.689820 mapwrite 0x022165 thru 0x028503 (0x639f bytes) 000269 1784413467.700513 MIRROR_RESYNC 6 mirrors 000270 1784413468.105769 write 0x026b0d thru 0x0367d2 (0xfcc6 bytes) 000271 1784413468.117663 punch from 0x00f990 to 0x0162f2 (0x6963 bytes) 000272 1784413468.119305 mapread 0x0237d6 thru 0x02bca3 (0x84ce bytes) 000273 1784413468.124976 trunc from 0x0367d3 to 0x014f84 (0x2184e bytes) 000274 1784413468.131567 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14f85): Mirror 3: 0x2b0b6c58 (stale) Mirror 4: 0x2b0b6c58 (stale) Mirror 5: 0x2b0b6c58 (stale) Mirror 6: 0x2b0b6c58 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14f85): Mirror 3: 0x2b0b6c58 (stale) Mirror 4: 0x2b0b6c58 (stale) Mirror 5: 0x2b0b6c58 (stale) Mirror 6: 0x2b0b6c58 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14f85: skipped 000275 1784413468.232944 read 0x0144f7 thru 0x0149f0 (0x4fa bytes) 000276 1784413468.235369 write 0x022db5 thru 0x02a282 (0x74ce bytes) 000277 1784413468.238038 trunc from 0x02a283 to 0x000376 (0x29f0c bytes) 000278 1784413468.243011 mapwrite 0x036103 thru 0x03ffff (0x9efd bytes) 000280 1784413468.260356 punch from 0x01e640 to 0x02a91a (0xc2db bytes) 000281 1784413468.262204 fallocate 0x021252 thru 0x02a346 (0x90f5 bytes) 000282 1784413468.263974 trunc from 0x005799 to 0x007a69 (0x22d1 bytes) 000284 1784413468.265862 fallocate 0x0251cb thru 0x02a13c (0x4f72 bytes) 000285 1784413468.267805 punch from 0x000c60 to 0x0051b2 (0x4553 bytes) 000286 1784413468.269379 fallocate 0x019d1d thru 0x0212a3 (0x7587 bytes) 000287 1784413468.271604 mapread 0x037384 thru 0x03ffff (0x8c7c bytes) 000288 1784413468.272457 trunc from 0x02a730 to 0x02b024 (0x8f5 bytes) 000289 1784413468.274275 punch from 0x03a5ca to 0x03ffff (0x5a36 bytes) 000290 1784413468.276288 read 0x01363e thru 0x02062d (0xcff0 bytes) 000291 1784413468.280746 read 0x0299ca thru 0x032ab8 (0x90ef bytes) 000293 1784413468.281739 read 0x009500 thru 0x014afd (0xb5fe bytes) 000294 1784413468.282177 mapwrite 0x023eff thru 0x02b1c1 (0x72c3 bytes) 000295 1784413468.290057 trunc from 0x040000 to 0x005e42 (0x3a1bd bytes) 000296 1784413468.296962 mapwrite 0x01dd5d thru 0x02ba57 (0xdcfb bytes) 000297 1784413468.315792 read 0x00b091 thru 0x016e0e (0xbd7e bytes) 000298 1784413468.318022 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ba58): Mirror 3: 0xf887d7a (stale) Mirror 5: 0xf887d7a (stale) Mirror 6: 0xf887d7a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ba58): Mirror 3: 0xf887d7a (stale) Mirror 5: 0xf887d7a (stale) Mirror 6: 0xf887d7a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ba58: skipped 000299 1784413468.412485 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2ba58): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ba58): Mirror 3: 0xf887d7a (stale) Mirror 5: 0xf887d7a (stale) Mirror 6: 0xf887d7a (stale) CRC-32 checksum value for chunk [0, 0x2ba58): Mirror 1: 0x96919bff Mirror 7: 0x96919bff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ba58: skipped 000300 1784413468.631425 mapread 0x0061fe thru 0x012de6 (0xcbe9 bytes) 000301 1784413468.643941 fallocate 0x00e12b thru 0x013df4 (0x5cca bytes) 000302 1784413468.655279 MIRROR_RESYNC 5 mirrors 000303 1784413468.884882 write 0x016f02 thru 0x01900e (0x210d bytes) 000304 1784413468.900880 write 0x008529 thru 0x01484d (0xc325 bytes) 000306 1784413468.906604 read 0x01bed2 thru 0x0286f0 (0xc81f bytes) 000307 1784413468.910465 mapwrite 0x02e827 thru 0x03d2b9 (0xea93 bytes) 000308 1784413468.951141 mapread 0x027d68 thru 0x035ee8 (0xe181 bytes) 000309 1784413468.952422 mapwrite 0x02d4e8 thru 0x037028 (0x9b41 bytes) 000310 1784413468.965253 punch from 0x01d0b6 to 0x02bca1 (0xebec bytes) 000311 1784413468.968087 mapread 0x0106a6 thru 0x01a8e0 (0xa23b bytes) 000312 1784413468.972174 punch from 0x005212 to 0x01349d (0xe28c bytes) 000313 1784413468.976611 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3d2ba): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d2ba): Mirror 3: 0x95d409eb (stale) Mirror 5: 0x95d409eb (stale) Mirror 6: 0x95d409eb (stale) Mirror 7: 0x95d409eb (stale) CRC-32 checksum value for chunk [0, 0x3d2ba): Mirror 1: 0xacff646b Mirror 8: 0xacff646b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d2ba: skipped 000314 1784413469.227501 punch from 0x022437 to 0x02ba6a (0x9634 bytes) 000315 1784413469.238748 read 0x026d2b thru 0x02b28a (0x4560 bytes) 000316 1784413469.241690 mapwrite 0x0223bf thru 0x02fdfd (0xda3f bytes) 000317 1784413469.260263 mapwrite 0x02420c thru 0x02a748 (0x653d bytes) 000318 1784413469.267214 trunc from 0x03d2ba to 0x018da4 (0x24515 bytes) 000319 1784413469.276360 fallocate 0x034649 thru 0x037771 (0x3129 bytes) 000320 1784413469.278595 mapwrite 0x02f884 thru 0x03afe4 (0xb761 bytes) 000321 1784413469.295753 trunc from 0x03afe5 to 0x03c175 (0x1191 bytes) 000322 1784413469.301148 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c176): Mirror 3: 0x9bfdf644 (stale) Mirror 5: 0x9bfdf644 (stale) Mirror 6: 0x9bfdf644 (stale) Mirror 7: 0x9bfdf644 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c176): Mirror 3: 0x9bfdf644 (stale) Mirror 5: 0x9bfdf644 (stale) Mirror 6: 0x9bfdf644 (stale) Mirror 7: 0x9bfdf644 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c176: skipped 000323 1784413469.403256 trunc from 0x03c176 to 0x010f0b (0x2b26a bytes) 000324 1784413469.409114 mapwrite 0x005579 thru 0x007dd1 (0x2859 bytes) 000325 1784413469.419797 punch from 0x00873d to 0x00ff45 (0x7809 bytes) 000326 1784413469.421385 mapread 0x0069e3 thru 0x010f0b (0xa529 bytes) 000327 1784413469.424654 trunc from 0x00e73b to 0x010f0b (0x27d1 bytes) 000328 1784413469.426375 punch from 0x000961 to 0x0072b2 (0x6952 bytes) 000329 1784413469.428157 fallocate 0x026f68 thru 0x02a1e7 (0x3280 bytes) 000330 1784413469.430172 fallocate 0x03aa80 thru 0x03f313 (0x4894 bytes) 000331 1784413469.432147 trunc from 0x03f314 to 0x00a493 (0x34e80 bytes) 000332 1784413469.436483 fallocate 0x024a65 thru 0x02befa (0x7496 bytes) 000333 1784413469.438707 trunc from 0x02befb to 0x002c4f (0x292ab bytes) 000334 1784413469.442682 trunc from 0x0005e4 to 0x002c4f (0x266c bytes) 000335 1784413469.444484 fallocate 0x013476 thru 0x01e712 (0xb29d bytes) 000336 1784413469.446065 mapread 0x0129ec thru 0x01bcad (0x92c2 bytes) 000337 1784413469.450707 mapwrite 0x012428 thru 0x01bf8b (0x9b64 bytes) 000338 1784413469.457053 mapread 0x01d239 thru 0x01e712 (0x14da bytes) 000339 1784413469.459223 MIRROR_RESYNC 5 mirrors 000341 1784413469.704598 mapwrite 0x01df63 thru 0x02b6f3 (0xd791 bytes) 000342 1784413469.734556 punch from 0x0022b2 to 0x0051de (0x2f2d bytes) 000343 1784413469.736577 mapread 0x0059e1 thru 0x007141 (0x1761 bytes) 000344 1784413469.739847 mapwrite 0x030391 thru 0x03f783 (0xf3f3 bytes) 000345 1784413469.758303 trunc from 0x03f784 to 0x010927 (0x2ee5c bytes) 000346 1784413469.762780 read 0x00e319 thru 0x00e694 (0x37c bytes) 000347 1784413469.763293 trunc from 0x010928 to 0x01603d (0x5716 bytes) 000348 1784413469.768314 write 0x00be57 thru 0x00d0ad (0x1257 bytes) 000349 1784413469.769296 fallocate 0x0090a4 thru 0x012dd4 (0x9d31 bytes) 000350 1784413469.771766 trunc from 0x01603e to 0x011c27 (0x4416 bytes) 000352 1784413469.777762 trunc from 0x011c28 to 0x023845 (0x11c1e bytes) 000353 1784413469.783372 mapread 0x00415a thru 0x00ca12 (0x88b9 bytes) 000354 1784413469.784242 mapwrite 0x02e184 thru 0x037920 (0x979d bytes) 000355 1784413469.807843 MIRROR_RESYNC 5 mirrors 000356 1784413470.056668 mapread 0x018830 thru 0x018f26 (0x6f7 bytes) 000357 1784413470.058325 punch from 0x0308fd to 0x0338a8 (0x2fac bytes) 000358 1784413470.066723 trunc from 0x037921 to 0x022062 (0x158be bytes) 000359 1784413470.074920 trunc from 0x022063 to 0x017454 (0xac0e bytes) 000360 1784413470.078855 trunc from 0x017455 to 0x030335 (0x18ee1 bytes) 000362 1784413470.083632 punch from 0x02798f to 0x030335 (0x89a7 bytes) 000363 1784413470.085122 mapread 0x02d397 thru 0x030335 (0x2f9f bytes) 000364 1784413470.089176 mapread 0x02b9c1 thru 0x02ea5b (0x309b bytes) 000365 1784413470.090020 mapwrite 0x00daa0 thru 0x010a74 (0x2fd5 bytes) 000366 1784413470.097546 trunc from 0x00c155 to 0x0154ab (0x9357 bytes) 000367 1784413470.100839 MIRROR_RESYNC 5 mirrors 000368 1784413470.347386 MIRROR_RESYNC 5 mirrors 000370 1784413470.468697 mapwrite 0x00fcbc thru 0x014ebc (0x5201 bytes) 000371 1784413470.503560 fallocate 0x0182c0 thru 0x020d9a (0x8adb bytes) 000372 1784413470.505240 mapwrite 0x02b0db thru 0x033634 (0x855a bytes) 000373 1784413470.522707 trunc from 0x033635 to 0x03c31c (0x8ce8 bytes) 000374 1784413470.527288 punch from 0x03161a to 0x0387a0 (0x7187 bytes) 000375 1784413470.530469 MIRROR_RESYNC 5 mirrors 000377 1784413470.858776 mapread 0x0097a5 thru 0x01681c (0xd078 bytes) 000378 1784413470.866139 trunc from 0x00d44a to 0x01164a (0x4201 bytes) 000379 1784413470.875752 mapwrite 0x01e3d0 thru 0x01e8c4 (0x4f5 bytes) 000380 1784413470.881973 trunc from 0x03c31d to 0x0018ca (0x3aa52 bytes) 000381 1784413470.891244 trunc from 0x001527 to 0x0018ca (0x3a4 bytes) 000382 1784413470.892648 fallocate 0x0110c6 thru 0x0199ed (0x8928 bytes) 000383 1784413470.894287 read 0x0133fe thru 0x0199ed (0x65f0 bytes) 000384 1784413470.897587 fallocate 0x02b47a thru 0x02d3c2 (0x1f49 bytes) 000385 1784413470.899719 trunc from 0x0123f3 to 0x0140f7 (0x1d05 bytes) 000386 1784413470.902568 MIRROR_RESYNC 5 mirrors 000387 1784413471.132801 fallocate 0x03ad65 thru 0x03bb77 (0xe13 bytes) 000388 1784413471.142600 mapwrite 0x021a63 thru 0x026eae (0x544c bytes) 000389 1784413471.155436 write 0x03242f thru 0x03d9c1 (0xb593 bytes) 000390 1784413471.158169 write 0x01f8db thru 0x0231e5 (0x390b bytes) 000391 1784413471.159327 write 0x012d0d thru 0x020f03 (0xe1f7 bytes) 000392 1784413471.162135 fallocate 0x017c31 thru 0x01c7da (0x4baa bytes) 000393 1784413471.164748 trunc from 0x03d9c2 to 0x0357cc (0x81f5 bytes) 000394 1784413471.171311 trunc from 0x0357cd to 0x023924 (0x11ea8 bytes) 000395 1784413471.176063 fallocate 0x01c766 thru 0x025be8 (0x9483 bytes) 000396 1784413471.178227 read 0x01ee9d thru 0x023924 (0x4a88 bytes) 000398 1784413471.179309 trunc from 0x01ba11 to 0x020684 (0x4c74 bytes) 000400 1784413471.186322 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x23925): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23925): Mirror 3: 0x6eee4c15 (stale) Mirror 5: 0x6eee4c15 (stale) Mirror 6: 0x6eee4c15 (stale) Mirror 7: 0x6eee4c15 (stale) CRC-32 checksum value for chunk [0, 0x23925): Mirror 1: 0x89efd933 Mirror 8: 0x89efd933 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23925: skipped 000401 1784413471.459948 read 0x01cb41 thru 0x023924 (0x6de4 bytes) 000402 1784413471.464768 mapread 0x012372 thru 0x013bad (0x183c bytes) 000403 1784413471.471366 mapwrite 0x024d9c thru 0x0285a2 (0x3807 bytes) 000404 1784413471.495471 trunc from 0x0285a3 to 0x022f56 (0x564c bytes) 000405 1784413471.500449 write 0x021001 thru 0x02a449 (0x9449 bytes) 000407 1784413471.502194 trunc from 0x01002a to 0x011b4f (0x1b26 bytes) 000408 1784413471.504117 fallocate 0x02939a thru 0x02dd22 (0x4989 bytes) 000409 1784413471.506364 read 0x0274af thru 0x02a449 (0x2f9b bytes) 000410 1784413471.507016 trunc from 0x00d9e7 to 0x012a0a (0x5024 bytes) 000411 1784413471.509138 fallocate 0x02ba93 thru 0x030f14 (0x5482 bytes) 000412 1784413471.511217 write 0x01f9bb thru 0x02f931 (0xff77 bytes) 000413 1784413471.515268 trunc from 0x01c739 to 0x02ace6 (0xe5ae bytes) 000414 1784413471.520653 mapwrite 0x01c98b thru 0x01e105 (0x177b bytes) 000415 1784413471.531623 fallocate 0x01c592 thru 0x029264 (0xccd3 bytes) 000416 1784413471.534954 MIRROR_RESYNC 6 mirrors 000417 1784413471.845748 read 0x009300 thru 0x017bfe (0xe8ff bytes) 000418 1784413471.849626 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) 000419 1784413471.941429 read 0x01e905 thru 0x01f5e3 (0xcdf bytes) 000421 1784413471.943771 mapread 0x01be27 thru 0x023d16 (0x7ef0 bytes) 000422 1784413471.948859 write 0x02c8f2 thru 0x03a80a (0xdf19 bytes) 000423 1784413471.960868 read 0x017226 thru 0x01a325 (0x3100 bytes) 000424 1784413471.964095 punch from 0x020f7b to 0x02ca84 (0xbb0a bytes) 000425 1784413471.968026 fallocate 0x03f51b thru 0x03ffff (0xae5 bytes) 000426 1784413471.969602 read 0x01bb97 thru 0x02a458 (0xe8c2 bytes) 000427 1784413471.972305 trunc from 0x02abce to 0x034be9 (0xa01c bytes) 000428 1784413471.974198 fallocate 0x03d364 thru 0x03dcbf (0x95c bytes) 000429 1784413471.976115 mapread 0x004c55 thru 0x00be44 (0x71f0 bytes) 000430 1784413471.976927 mapwrite 0x0153f8 thru 0x022530 (0xd139 bytes) 000431 1784413471.985107 mapwrite 0x03baf0 thru 0x03ffff (0x4510 bytes) 000433 1784413472.000681 trunc from 0x040000 to 0x010efc (0x2f103 bytes) 000434 1784413472.004776 punch from 0x009045 to 0x010efc (0x7eb8 bytes) 000435 1784413472.006569 punch from 0x00f893 to 0x010efc (0x166a bytes) 000436 1784413472.008349 mapread 0x00e361 thru 0x010efc (0x2b9c bytes) 000437 1784413472.012854 punch from 0x001f17 to 0x00bd98 (0x9e82 bytes) 000439 1784413472.015426 write 0x018ac8 thru 0x01f2a1 (0x67da bytes) 000440 1784413472.016708 write 0x001f7b thru 0x010d23 (0xeda9 bytes) 000441 1784413472.019129 trunc from 0x01db98 to 0x01f2a1 (0x170a bytes) 000442 1784413472.023913 read 0x0090d1 thru 0x009dee (0xd1e bytes) 000444 1784413472.024849 trunc from 0x01f2a2 to 0x033277 (0x13fd6 bytes) 000445 1784413472.030088 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33278): Mirror 3: 0x8d27454b (stale) Mirror 5: 0x8d27454b (stale) Mirror 8: 0x8d27454b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33278): Mirror 3: 0x8d27454b (stale) Mirror 5: 0x8d27454b (stale) Mirror 8: 0x8d27454b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33278: skipped 000446 1784413472.116603 trunc from 0x033278 to 0x03a925 (0x76ae bytes) 000447 1784413472.121295 read 0x01f27f thru 0x0237d1 (0x4553 bytes) 000448 1784413472.123701 fallocate 0x004863 thru 0x00b7dd (0x6f7b bytes) 000449 1784413472.125493 read 0x017dbd thru 0x0193eb (0x162f bytes) 000450 1784413472.128974 read 0x00cdfc thru 0x018c56 (0xbe5b bytes) 000451 1784413472.129672 write 0x02b686 thru 0x0300c6 (0x4a41 bytes) 000452 1784413472.130415 read 0x0240ec thru 0x02c0c2 (0x7fd7 bytes) 000453 1784413472.130810 trunc from 0x029e87 to 0x033300 (0x947a bytes) 000454 1784413472.134460 trunc from 0x03a926 to 0x03f23a (0x4915 bytes) 000455 1784413472.138258 mapwrite 0x00748b thru 0x016441 (0xefb7 bytes) 000456 1784413472.146676 read 0x023a54 thru 0x0295db (0x5b88 bytes) 000457 1784413472.149597 punch from 0x01da15 to 0x01ed9f (0x138b bytes) 000458 1784413472.151370 mapwrite 0x002bd8 thru 0x007243 (0x466c bytes) 000459 1784413472.157029 fallocate 0x021c9e thru 0x028d32 (0x7095 bytes) 000461 1784413472.159750 punch from 0x011682 to 0x01d409 (0xbd88 bytes) 000462 1784413472.162877 MIRROR_RESYNC 4 mirrors 000464 1784413472.392468 punch from 0x02d14e to 0x02feaf (0x2d62 bytes) 000465 1784413472.404485 write 0x02b311 thru 0x02bc8f (0x97f bytes) 000466 1784413472.406738 punch from 0x002b0a to 0x005f97 (0x348e bytes) 000467 1784413472.409015 punch from 0x02f15b to 0x03c8e3 (0xd789 bytes) 000468 1784413472.411010 mapread 0x01027c thru 0x0182e7 (0x806c bytes) 000469 1784413472.417733 fallocate 0x023a45 thru 0x023abb (0x77 bytes) 000470 1784413472.419967 mapwrite 0x027a72 thru 0x03333d (0xb8cc bytes) 000471 1784413472.433113 fallocate 0x032bfd thru 0x03ca85 (0x9e89 bytes) 000473 1784413472.435443 fallocate 0x024687 thru 0x025f08 (0x1882 bytes) 000474 1784413472.437586 trunc from 0x02d772 to 0x03a2a1 (0xcb30 bytes) 000475 1784413472.439939 mapwrite 0x03a3d0 thru 0x03ffff (0x5c30 bytes) 000476 1784413472.459421 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x837502e9 (stale) Mirror 5: 0x837502e9 (stale) Mirror 8: 0x837502e9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6018de6c Mirror 9: 0x6018de6c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000479 1784413472.699850 write 0x0169be thru 0x022d33 (0xc376 bytes) 000480 1784413472.713522 write 0x01f097 thru 0x028b8f (0x9af9 bytes) 000482 1784413472.716744 mapwrite 0x02dd43 thru 0x030965 (0x2c23 bytes) 000483 1784413472.727930 trunc from 0x040000 to 0x00c226 (0x33dd9 bytes) 000484 1784413472.738766 write 0x02b16e thru 0x02bf4f (0xde2 bytes) 000485 1784413472.739856 trunc from 0x02bf50 to 0x007130 (0x24e1f bytes) 000486 1784413472.744417 punch from 0x0053a5 to 0x007130 (0x1d8c bytes) 000487 1784413472.746122 mapread 0x000232 thru 0x0004fd (0x2cc bytes) 000488 1784413472.749086 read 0x001007 thru 0x006e5f (0x5e59 bytes) 000489 1784413472.749571 read 0x004c91 thru 0x0056bd (0xa2d bytes) 000492 1784413472.750747 fallocate 0x031e78 thru 0x032611 (0x79a bytes) 000494 1784413472.753080 mapwrite 0x00539c thru 0x014f51 (0xfbb6 bytes) 000495 1784413472.768239 trunc from 0x014f52 to 0x033ea5 (0x1ef54 bytes) 000496 1784413472.772887 fallocate 0x03b742 thru 0x03ffff (0x48be bytes) 000498 1784413472.774961 read 0x01b30c thru 0x02890f (0xd604 bytes) 000499 1784413472.779976 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x837502e9 (stale) Mirror 5: 0x837502e9 (stale) Mirror 8: 0x837502e9 (stale) Mirror 9: 0x6018de6c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9236f0b8 Mirror 10: 0x9236f0b8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000501 1784413473.008427 punch from 0x03c6b9 to 0x03ffff (0x3947 bytes) 000502 1784413473.017522 punch from 0x02147e to 0x030e6c (0xf9ef bytes) 000503 1784413473.018941 mapread 0x03f839 thru 0x03ffff (0x7c7 bytes) 000504 1784413473.020699 fallocate 0x0040d1 thru 0x007617 (0x3547 bytes) 000505 1784413473.022485 punch from 0x003e47 to 0x006453 (0x260d bytes) 000506 1784413473.024136 read 0x01db44 thru 0x022af5 (0x4fb2 bytes) 000507 1784413473.026828 read 0x008e2e thru 0x011ef1 (0x90c4 bytes) 000508 1784413473.031153 mapread 0x030654 thru 0x03e27f (0xdc2c bytes) 000509 1784413473.032116 mapread 0x01651a thru 0x0191d5 (0x2cbc bytes) 000511 1784413473.034739 MIRROR_RESYNC 6 mirrors 000512 1784413473.322781 trunc from 0x027ecb to 0x02d5d2 (0x5708 bytes) 000513 1784413473.331128 punch from 0x03b735 to 0x03ffff (0x48cb bytes) 000514 1784413473.332689 write 0x03e8a0 thru 0x03ffff (0x1760 bytes) 000515 1784413473.334921 punch from 0x0102a5 to 0x015f98 (0x5cf4 bytes) 000516 1784413473.336635 trunc from 0x040000 to 0x01cf6c (0x23093 bytes) 000517 1784413473.342082 mapread 0x017a71 thru 0x01cf6c (0x54fc bytes) 000518 1784413473.350612 read 0x00ba11 thru 0x01a398 (0xe988 bytes) 000519 1784413473.353877 write 0x03de9b thru 0x03ffff (0x2165 bytes) 000520 1784413473.354861 punch from 0x0371d8 to 0x038949 (0x1772 bytes) 000521 1784413473.356786 punch from 0x0164a2 to 0x019e4e (0x39ad bytes) 000522 1784413473.358651 mapread 0x00ed57 thru 0x01c22e (0xd4d8 bytes) 000523 1784413473.361952 write 0x038915 thru 0x03cc28 (0x4314 bytes) 000525 1784413473.365514 trunc from 0x010a68 to 0x012fa3 (0x253c bytes) 000526 1784413473.367446 write 0x02b0e5 thru 0x02e181 (0x309d bytes) 000527 1784413473.370451 trunc from 0x03bc21 to 0x03ffff (0x43df bytes) 000528 1784413473.376179 fallocate 0x01af87 thru 0x025245 (0xa2bf bytes) 000529 1784413473.380984 write 0x00be85 thru 0x00f5d0 (0x374c bytes) 000531 1784413473.382686 mapwrite 0x02bf94 thru 0x039f53 (0xdfc0 bytes) 000532 1784413473.394286 mapwrite 0x01e97e thru 0x021f0b (0x358e bytes) 000533 1784413473.402564 read 0x01f36f thru 0x02a2e3 (0xaf75 bytes) 000535 1784413473.403474 trunc from 0x040000 to 0x001292 (0x3ed6d bytes) 000536 1784413473.408165 trunc from 0x001293 to 0x00ef69 (0xdcd7 bytes) 000537 1784413473.412036 read 0x00b465 thru 0x00ef69 (0x3b05 bytes) 000538 1784413473.414698 punch from 0x00c165 to 0x00ef69 (0x2e05 bytes) 000539 1784413473.416213 trunc from 0x000f49 to 0x00ce40 (0xbef8 bytes) 000541 1784413473.418387 punch from 0x00b6aa to 0x00ef69 (0x38c0 bytes) 000542 1784413473.419776 mapwrite 0x016440 thru 0x01b3fb (0x4fbc bytes) 000543 1784413473.431218 write 0x0369c8 thru 0x03ffff (0x9638 bytes) 000544 1784413473.432670 mapread 0x01e842 thru 0x02c99a (0xe159 bytes) 000545 1784413473.436544 write 0x03cf96 thru 0x03ffff (0x306a bytes) 000546 1784413473.437206 punch from 0x003dfb to 0x010cdb (0xcee1 bytes) 000547 1784413473.439324 read 0x034b98 thru 0x03b1da (0x6643 bytes) 000548 1784413473.440006 read 0x035951 thru 0x03e0f8 (0x87a8 bytes) 000551 1784413473.441731 fallocate 0x005967 thru 0x007ff4 (0x268e bytes) 000552 1784413473.444010 trunc from 0x01a4ec to 0x01d581 (0x3096 bytes) 000553 1784413473.445799 trunc from 0x0001e7 to 0x0052da (0x50f4 bytes) 000554 1784413473.447695 write 0x02d50f thru 0x02d9e3 (0x4d5 bytes) 000555 1784413473.448656 mapwrite 0x0033e8 thru 0x010c5e (0xd877 bytes) 000556 1784413473.460210 mapwrite 0x01a249 thru 0x021574 (0x732c bytes) 000557 1784413473.467020 read 0x013bd9 thru 0x019a5d (0x5e85 bytes) 000558 1784413473.467507 mapwrite 0x030dc6 thru 0x039177 (0x83b2 bytes) 000560 1784413473.475870 trunc from 0x040000 to 0x035ac1 (0xa53e bytes) 000562 1784413473.481104 mapread 0x00da37 thru 0x018619 (0xabe3 bytes) 000563 1784413473.481974 mapwrite 0x0166f2 thru 0x022d44 (0xc653 bytes) 000564 1784413473.489897 punch from 0x026289 to 0x032341 (0xc0b9 bytes) 000565 1784413473.491671 fallocate 0x0051c0 thru 0x01416e (0xefaf bytes) 000566 1784413473.494642 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x35ac2): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35ac2): Mirror 3: 0xea716421 (stale) Mirror 5: 0xea716421 (stale) Mirror 8: 0xea716421 (stale) Mirror 9: 0xea716421 (stale) Mirror 10: 0xea716421 (stale) CRC-32 checksum value for chunk [0, 0x35ac2): Mirror 1: 0xf7022272 Mirror 11: 0xf7022272 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35ac2: skipped 000567 1784413473.727962 read 0x022d65 thru 0x0251c3 (0x245f bytes) 000568 1784413473.731920 write 0x008f0f thru 0x009a46 (0xb38 bytes) 000569 1784413473.746211 read 0x00f061 thru 0x010dd2 (0x1d72 bytes) 000570 1784413473.750280 mapread 0x0275c3 thru 0x0304bf (0x8efd bytes) 000571 1784413473.752864 MIRROR_RESYNC 7 mirrors 000572 1784413474.214274 mapwrite 0x0113c2 thru 0x01d0b6 (0xbcf5 bytes) 000573 1784413474.254924 mapread 0x0224c2 thru 0x02f51e (0xd05d bytes) 000574 1784413474.261564 trunc from 0x028307 to 0x03581d (0xd517 bytes) 000576 1784413474.265531 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x35ac2): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35ac2): Mirror 3: 0xd9601d92 (stale) Mirror 5: 0xd9601d92 (stale) Mirror 8: 0xd9601d92 (stale) Mirror 9: 0xd9601d92 (stale) Mirror 10: 0xd9601d92 (stale) Mirror 11: 0xd9601d92 (stale) CRC-32 checksum value for chunk [0, 0x35ac2): Mirror 1: 0x5c4d8f0e Mirror 12: 0x5c4d8f0e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35ac2: skipped 000577 1784413474.593992 punch from 0x01af30 to 0x0242cc (0x939d bytes) 000578 1784413474.605022 write 0x014099 thru 0x01988e (0x57f6 bytes) 000579 1784413474.609579 trunc from 0x01c659 to 0x0252da (0x8c82 bytes) 000580 1784413474.611347 punch from 0x01a1b7 to 0x01c5fe (0x2448 bytes) 000581 1784413474.614290 MIRROR_RESYNC 8 mirrors 000582 1784413474.978937 trunc from 0x035ac2 to 0x00ccb9 (0x28e08 bytes) 000583 1784413474.995459 trunc from 0x00ccba to 0x005b52 (0x7167 bytes) 000584 1784413475.000516 trunc from 0x00224d to 0x0045c8 (0x237c bytes) 000585 1784413475.001888 trunc from 0x005b53 to 0x027cb9 (0x22167 bytes) 000586 1784413475.005565 write 0x01935c thru 0x024982 (0xb627 bytes) 000587 1784413475.008798 fallocate 0x0252b0 thru 0x02b083 (0x5dd4 bytes) 000588 1784413475.010812 trunc from 0x0129f4 to 0x018d20 (0x632d bytes) 000589 1784413475.012632 trunc from 0x027cba to 0x01fdd6 (0x7ee3 bytes) 000590 1784413475.017366 read 0x0198c3 thru 0x01fdd6 (0x6514 bytes) 000591 1784413475.017909 punch from 0x003778 to 0x00c91d (0x91a6 bytes) 000592 1784413475.019665 trunc from 0x009eb6 to 0x010bc5 (0x6d10 bytes) 000593 1784413475.021260 punch from 0x0020d5 to 0x003221 (0x114d bytes) 000594 1784413475.024039 MIRROR_RESYNC 8 mirrors 000595 1784413475.314888 trunc from 0x007be6 to 0x00a412 (0x282d bytes) 000596 1784413475.323060 trunc from 0x01097b to 0x01e79e (0xde24 bytes) 000597 1784413475.324765 write 0x03b06a thru 0x03ffff (0x4f96 bytes) 000598 1784413475.325699 punch from 0x03f675 to 0x03ffff (0x98b bytes) 000599 1784413475.328946 mapwrite 0x00a7e0 thru 0x0185f4 (0xde15 bytes) 000600 1784413475.343177 mapwrite 0x000e45 thru 0x00a7f3 (0x99af bytes) 000601 1784413475.351490 fallocate 0x006dc9 thru 0x010764 (0x999c bytes) 000602 1784413475.353087 read 0x01d85d thru 0x02b741 (0xdee5 bytes) 000603 1784413475.355854 read 0x0060bf thru 0x00b7b9 (0x56fb bytes) 000604 1784413475.356560 trunc from 0x040000 to 0x03824a (0x7db5 bytes) 000605 1784413475.365987 mapread 0x005c66 thru 0x015c2b (0xffc6 bytes) 000607 1784413475.367845 read 0x028a00 thru 0x02ea8b (0x608c bytes) 000608 1784413475.370764 mapread 0x01ace0 thru 0x01e62c (0x394d bytes) 000609 1784413475.371441 read 0x010201 thru 0x017a5a (0x785a bytes) 000611 1784413475.372127 write 0x012755 thru 0x01e42c (0xbcd8 bytes) 000612 1784413475.372966 write 0x000f93 thru 0x00424d (0x32bb bytes) 000613 1784413475.374873 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3824b): Mirror 5: 0xa3b8f0e4 (stale) Mirror 8: 0xa3b8f0e4 (stale) Mirror 9: 0xa3b8f0e4 (stale) Mirror 10: 0xa3b8f0e4 (stale) Mirror 11: 0xa3b8f0e4 (stale) Mirror 12: 0xa3b8f0e4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3824b): Mirror 5: 0xa3b8f0e4 (stale) Mirror 8: 0xa3b8f0e4 (stale) Mirror 9: 0xa3b8f0e4 (stale) Mirror 10: 0xa3b8f0e4 (stale) Mirror 11: 0xa3b8f0e4 (stale) Mirror 12: 0xa3b8f0e4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3824b: skipped 000614 1784413475.512527 read 0x00368f thru 0x003e5f (0x7d1 bytes) 000615 1784413475.515014 fallocate 0x03fdcb thru 0x03ffff (0x235 bytes) 000616 1784413475.517509 mapwrite 0x021010 thru 0x0282e4 (0x72d5 bytes) 000617 1784413475.529846 fallocate 0x024649 thru 0x0261b9 (0x1b71 bytes) 000618 1784413475.531992 trunc from 0x00c6c9 to 0x015ece (0x9806 bytes) 000620 1784413475.534317 write 0x0184b5 thru 0x01c853 (0x439f bytes) 000621 1784413475.537848 write 0x009ae2 thru 0x013f07 (0xa426 bytes) 000622 1784413475.540950 trunc from 0x03ab32 to 0x03daee (0x2fbd bytes) 000623 1784413475.542667 mapread 0x0138c8 thru 0x01d7b2 (0x9eeb bytes) 000624 1784413475.544910 write 0x014d38 thru 0x016f68 (0x2231 bytes) 000625 1784413475.545659 write 0x01358e thru 0x021c04 (0xe677 bytes) 000626 1784413475.546564 fallocate 0x031546 thru 0x0345ac (0x3067 bytes) 000627 1784413475.549658 MIRROR_RESYNC 7 mirrors 000628 1784413475.808360 mapread 0x0347ae thru 0x03ffff (0xb852 bytes) 000629 1784413475.816660 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) 000630 1784413475.932131 trunc from 0x040000 to 0x01fdf7 (0x20208 bytes) 000631 1784413475.951954 read 0x011042 thru 0x01b372 (0xa331 bytes) 000632 1784413475.955245 read 0x01242f thru 0x0158e0 (0x34b2 bytes) 000633 1784413475.955974 trunc from 0x01fdf8 to 0x03a68b (0x1a894 bytes) 000634 1784413475.961375 fallocate 0x00f8e3 thru 0x01ae79 (0xb597 bytes) 000635 1784413475.963284 trunc from 0x00d3d4 to 0x01a616 (0xd243 bytes) 000636 1784413475.965372 fallocate 0x01c957 thru 0x0234a5 (0x6b4f bytes) 000637 1784413475.967573 mapread 0x014c58 thru 0x01a5ee (0x5997 bytes) 000638 1784413475.971740 write 0x03553c thru 0x03ffff (0xaac4 bytes) 000639 1784413475.972707 punch from 0x039a06 to 0x03ffff (0x65fa bytes) 000640 1784413475.977158 trunc from 0x03d9ba to 0x03ffff (0x2646 bytes) 000641 1784413475.978942 write 0x01b8c2 thru 0x01f26c (0x39ab bytes) 000642 1784413475.979819 punch from 0x016fef to 0x018f9c (0x1fae bytes) 000644 1784413475.982092 write 0x01c39c thru 0x024511 (0x8176 bytes) 000646 1784413475.983438 mapread 0x005970 thru 0x00eaf3 (0x9184 bytes) 000647 1784413475.984131 mapwrite 0x01e71a thru 0x01f65e (0xf45 bytes) 000648 1784413475.989687 punch from 0x0090e4 to 0x015999 (0xc8b6 bytes) 000649 1784413475.991841 read 0x036de2 thru 0x03ffff (0x921e bytes) 000650 1784413475.995071 mapread 0x015570 thru 0x0252b4 (0xfd45 bytes) 000651 1784413475.995987 mapread 0x0203fb thru 0x029e8c (0x9a92 bytes) 000652 1784413475.996725 fallocate 0x0147ca thru 0x016cb2 (0x24e9 bytes) 000653 1784413475.998585 fallocate 0x01adec thru 0x01d820 (0x2a35 bytes) 000654 1784413476.000458 punch from 0x024ca5 to 0x0313b5 (0xc711 bytes) 000655 1784413476.002374 read 0x02bf08 thru 0x03613a (0xa233 bytes) 000656 1784413476.005611 fallocate 0x035c9a thru 0x03fa21 (0x9d88 bytes) 000657 1784413476.007758 write 0x01babf thru 0x025a36 (0x9f78 bytes) 000658 1784413476.009014 write 0x002bf4 thru 0x009385 (0x6792 bytes) 000659 1784413476.010041 write 0x015d18 thru 0x020c1c (0xaf05 bytes) 000660 1784413476.011228 trunc from 0x040000 to 0x01c873 (0x2378c bytes) 000661 1784413476.016883 punch from 0x00c502 to 0x01b445 (0xef44 bytes) 000662 1784413476.021246 punch from 0x00487d to 0x00fde3 (0xb567 bytes) 000663 1784413476.023133 write 0x038930 thru 0x03ffff (0x76d0 bytes) 000664 1784413476.025224 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x3fd8f02b (stale) Mirror 9: 0x3fd8f02b (stale) Mirror 10: 0x3fd8f02b (stale) Mirror 12: 0x3fd8f02b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x3fd8f02b (stale) Mirror 9: 0x3fd8f02b (stale) Mirror 10: 0x3fd8f02b (stale) Mirror 12: 0x3fd8f02b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000665 1784413476.129953 mapwrite 0x0108a3 thru 0x016790 (0x5eee bytes) 000667 1784413476.141585 punch from 0x014836 to 0x023a7d (0xf248 bytes) 000668 1784413476.143119 trunc from 0x040000 to 0x03e716 (0x18e9 bytes) 000669 1784413476.147991 mapwrite 0x035f51 thru 0x03690b (0x9bb bytes) 000670 1784413476.153959 fallocate 0x022c23 thru 0x030d64 (0xe142 bytes) 000671 1784413476.155750 punch from 0x015637 to 0x021331 (0xbcfb bytes) 000672 1784413476.157136 punch from 0x0367e2 to 0x03964d (0x2e6c bytes) 000673 1784413476.159701 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3e717): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e717): Mirror 8: 0xf9fac53c (stale) Mirror 9: 0xf9fac53c (stale) Mirror 10: 0xf9fac53c (stale) Mirror 12: 0xf9fac53c (stale) CRC-32 checksum value for chunk [0, 0x3e717): Mirror 1: 0x1401943e Mirror 13: 0x1401943e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e717: skipped 000674 1784413476.399511 punch from 0x0288c7 to 0x02f37e (0x6ab8 bytes) 000675 1784413476.410661 trunc from 0x021b4c to 0x02e393 (0xc848 bytes) 000676 1784413476.412774 trunc from 0x03e717 to 0x00376f (0x3afa7 bytes) 000677 1784413476.423991 write 0x018ea8 thru 0x02655d (0xd6b6 bytes) 000678 1784413476.425280 mapread 0x01af68 thru 0x020197 (0x5230 bytes) 000679 1784413476.426018 mapread 0x000242 thru 0x005452 (0x5211 bytes) 000680 1784413476.432930 fallocate 0x02c3a4 thru 0x0385ae (0xc20b bytes) 000681 1784413476.435025 write 0x03f748 thru 0x03ffff (0x8b8 bytes) 000682 1784413476.435999 fallocate 0x02e342 thru 0x0315d0 (0x328f bytes) 000684 1784413476.440485 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x3fd8f02b (stale) Mirror 10: 0x3fd8f02b (stale) Mirror 12: 0x3fd8f02b (stale) Mirror 13: 0xd55f366 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x3fd8f02b (stale) Mirror 10: 0x3fd8f02b (stale) Mirror 12: 0x3fd8f02b (stale) Mirror 13: 0xd55f366 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000685 1784413476.544023 trunc from 0x040000 to 0x0397ef (0x6810 bytes) 000687 1784413476.551181 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x397f0): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x397f0): Mirror 8: 0x42ba8330 (stale) Mirror 10: 0x42ba8330 (stale) Mirror 12: 0x42ba8330 (stale) Mirror 13: 0x30734f1 (stale) CRC-32 checksum value for chunk [0, 0x397f0): Mirror 1: 0x909a5f34 Mirror 14: 0x909a5f34 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x397f0: skipped 000688 1784413476.781645 MIRROR_RESYNC 6 mirrors 000689 1784413477.032619 mapwrite 0x0123b7 thru 0x0170ba (0x4d04 bytes) 000690 1784413477.072756 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x397f0): Mirror 8: 0x909a5f34 (stale) Mirror 10: 0x909a5f34 (stale) Mirror 12: 0x909a5f34 (stale) Mirror 14: 0x909a5f34 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x397f0): Mirror 8: 0x909a5f34 (stale) Mirror 10: 0x909a5f34 (stale) Mirror 12: 0x909a5f34 (stale) Mirror 14: 0x909a5f34 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x397f0: skipped 000691 1784413477.167211 trunc from 0x0397f0 to 0x02561c (0x141d3 bytes) 000692 1784413477.176286 write 0x00eae5 thru 0x01e2d4 (0xf7f0 bytes) 000693 1784413477.179739 write 0x00e321 thru 0x0184f4 (0xa1d4 bytes) 000694 1784413477.180478 punch from 0x00ddb4 to 0x00f0a5 (0x12f2 bytes) 000695 1784413477.184017 punch from 0x012fd9 to 0x016410 (0x3438 bytes) 000696 1784413477.185558 trunc from 0x01b51f to 0x02561c (0xa0fe bytes) 000697 1784413477.187127 mapwrite 0x02f94e thru 0x035dee (0x64a1 bytes) 000698 1784413477.204371 MIRROR_RESYNC 5 mirrors 000699 1784413477.546023 MIRROR_EXTEND to 6 mirrors 000700 1784413477.723329 trunc from 0x00bacc to 0x00f18b (0x36c0 bytes) 000701 1784413477.734204 read 0x01a61f thru 0x01c379 (0x1d5b bytes) 000702 1784413477.736410 mapread 0x00e904 thru 0x01170e (0x2e0b bytes) 000703 1784413477.743248 MIRROR_RESYNC 6 mirrors 000704 1784413478.120194 read 0x013a89 thru 0x021065 (0xd5dd bytes) 000705 1784413478.123000 fallocate 0x034a54 thru 0x03ffff (0xb5ac bytes) 000706 1784413478.132808 read 0x00122d thru 0x0025b5 (0x1389 bytes) 000707 1784413478.136972 read 0x029395 thru 0x038853 (0xf4bf bytes) 000708 1784413478.137484 mapwrite 0x00c48c thru 0x011c7a (0x57ef bytes) 000709 1784413478.144043 read 0x013a4a thru 0x01bf8b (0x8542 bytes) 000710 1784413478.144765 read 0x009744 thru 0x014477 (0xad34 bytes) 000711 1784413478.145372 write 0x00f82a thru 0x01ad6e (0xb545 bytes) 000712 1784413478.146562 punch from 0x03b356 to 0x03ffff (0x4caa bytes) 000713 1784413478.148752 mapwrite 0x0090fe thru 0x014375 (0xb278 bytes) 000715 1784413478.157529 fallocate 0x02a9fa thru 0x033510 (0x8b17 bytes) 000716 1784413478.162091 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xc92ea204 (stale) Mirror 10: 0xc92ea204 (stale) Mirror 12: 0xc92ea204 (stale) Mirror 15: 0xc92ea204 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xc92ea204 (stale) Mirror 10: 0xc92ea204 (stale) Mirror 12: 0xc92ea204 (stale) Mirror 15: 0xc92ea204 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000717 1784413478.270492 mapwrite 0x0026af thru 0x008af3 (0x6445 bytes) 000718 1784413478.281799 trunc from 0x02c2a7 to 0x03aad8 (0xe832 bytes) 000720 1784413478.284985 fallocate 0x018327 thru 0x0217af (0x9489 bytes) 000721 1784413478.286989 punch from 0x01e645 to 0x02b418 (0xcdd4 bytes) 000722 1784413478.289007 write 0x0071ab thru 0x00c9c7 (0x581d bytes) 000723 1784413478.291299 trunc from 0x040000 to 0x02e0c8 (0x11f37 bytes) 000724 1784413478.296302 write 0x037448 thru 0x03ffff (0x8bb8 bytes) 000725 1784413478.297572 fallocate 0x02ef2b thru 0x03d498 (0xe56e bytes) 000726 1784413478.299679 mapwrite 0x006de3 thru 0x00ff50 (0x916e bytes) 000728 1784413478.307896 fallocate 0x03d57f thru 0x03f71f (0x21a1 bytes) 000729 1784413478.310201 punch from 0x0115bd to 0x01adf2 (0x9836 bytes) 000730 1784413478.312145 fallocate 0x020381 thru 0x029c6e (0x98ee bytes) 000731 1784413478.314422 write 0x02493d thru 0x033033 (0xe6f7 bytes) 000732 1784413478.318662 write 0x00c82f thru 0x00df16 (0x16e8 bytes) 000733 1784413478.319636 read 0x010c70 thru 0x01fc0d (0xef9e bytes) 000734 1784413478.323017 write 0x02c6e6 thru 0x02c818 (0x133 bytes) 000735 1784413478.323531 write 0x0195a0 thru 0x0264af (0xcf10 bytes) 000736 1784413478.324853 trunc from 0x040000 to 0x031fc9 (0xe036 bytes) 000737 1784413478.330094 punch from 0x022ce8 to 0x030a8d (0xdda6 bytes) 000738 1784413478.334533 write 0x036ae0 thru 0x03851f (0x1a40 bytes) 000739 1784413478.337003 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x38520): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38520): Mirror 8: 0x261e144a (stale) Mirror 10: 0x261e144a (stale) Mirror 12: 0x261e144a (stale) Mirror 15: 0x261e144a (stale) CRC-32 checksum value for chunk [0, 0x38520): Mirror 1: 0x4a64d128 Mirror 16: 0x4a64d128 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38520: skipped 000740 1784413478.580310 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38520): Mirror 8: 0x261e144a (stale) Mirror 10: 0x261e144a (stale) Mirror 12: 0x261e144a (stale) Mirror 15: 0x261e144a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38520): Mirror 8: 0x261e144a (stale) Mirror 10: 0x261e144a (stale) Mirror 12: 0x261e144a (stale) Mirror 15: 0x261e144a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38520: skipped 000741 1784413478.688379 trunc from 0x004e0d to 0x008c49 (0x3e3d bytes) 000742 1784413478.692447 mapread 0x021145 thru 0x03030b (0xf1c7 bytes) 000743 1784413478.700679 mapwrite 0x002ffa thru 0x01014c (0xd153 bytes) 000744 1784413478.711726 write 0x02cf8b thru 0x037728 (0xa79e bytes) 000745 1784413478.714805 mapread 0x01f6d8 thru 0x021ccd (0x25f6 bytes) 000746 1784413478.715539 read 0x02da03 thru 0x034ad6 (0x70d4 bytes) 000747 1784413478.715903 mapwrite 0x003d67 thru 0x005736 (0x19d0 bytes) 000748 1784413478.721110 punch from 0x001194 to 0x006bac (0x5a19 bytes) 000749 1784413478.722810 punch from 0x02044a to 0x02076d (0x324 bytes) 000750 1784413478.724387 trunc from 0x009d58 to 0x00faff (0x5da8 bytes) 000751 1784413478.725857 write 0x032221 thru 0x0398ce (0x76ae bytes) 000752 1784413478.726686 trunc from 0x0398cf to 0x0349e3 (0x4eeb bytes) 000753 1784413478.734475 mapread 0x01f0b1 thru 0x02b0f4 (0xc044 bytes) 000754 1784413478.737032 read 0x00f82f thru 0x01a035 (0xa807 bytes) 000755 1784413478.740037 trunc from 0x0349e4 to 0x02a11f (0xa8c4 bytes) 000756 1784413478.744007 read 0x0016a9 thru 0x010ea9 (0xf801 bytes) 000757 1784413478.744549 write 0x0250f3 thru 0x032068 (0xcf76 bytes) 000758 1784413478.745568 write 0x031202 thru 0x03d87d (0xc67c bytes) 000759 1784413478.746735 write 0x01ad55 thru 0x021ccf (0x6f7b bytes) 000760 1784413478.747533 trunc from 0x001a88 to 0x00cf8d (0xb506 bytes) 000762 1784413478.749713 trunc from 0x03d87e to 0x03e0a2 (0x825 bytes) 000763 1784413478.753512 mapwrite 0x013f32 thru 0x020de8 (0xceb7 bytes) 000764 1784413478.760644 mapwrite 0x006327 thru 0x00bc36 (0x5910 bytes) 000765 1784413478.768870 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3e0a3): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e0a3): Mirror 8: 0x331ed62e (stale) Mirror 10: 0x331ed62e (stale) Mirror 12: 0x331ed62e (stale) Mirror 15: 0x331ed62e (stale) CRC-32 checksum value for chunk [0, 0x3e0a3): Mirror 1: 0x7886ee3a Mirror 16: 0x7886ee3a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e0a3: skipped 000766 1784413478.998663 trunc from 0x03e0a3 to 0x028ad9 (0x155c9 bytes) 000768 1784413479.012745 punch from 0x0202e7 to 0x020327 (0x41 bytes) 000769 1784413479.014069 mapwrite 0x034a05 thru 0x03ffff (0xb5fb bytes) 000770 1784413479.029512 fallocate 0x038c08 thru 0x03ffff (0x73f8 bytes) 000772 1784413479.031643 trunc from 0x01fc56 to 0x02ac41 (0xafec bytes) 000773 1784413479.033127 trunc from 0x040000 to 0x03c183 (0x3e7c bytes) 000774 1784413479.037227 punch from 0x016cee to 0x01aa7f (0x3d92 bytes) 000775 1784413479.040145 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3c184): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c184): Mirror 8: 0x21299130 (stale) Mirror 10: 0x21299130 (stale) Mirror 12: 0x21299130 (stale) Mirror 15: 0x21299130 (stale) Mirror 16: 0x99a74ff7 (stale) CRC-32 checksum value for chunk [0, 0x3c184): Mirror 1: 0xdd1e4972 Mirror 17: 0xdd1e4972 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c184: skipped 000776 1784413479.292057 punch from 0x0282e6 to 0x0312ad (0x8fc8 bytes) 000777 1784413479.301839 mapread 0x027a4e thru 0x02b133 (0x36e6 bytes) 000778 1784413479.306832 fallocate 0x0150e6 thru 0x022117 (0xd032 bytes) 000779 1784413479.309802 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3c184): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c184): Mirror 8: 0x21299130 (stale) Mirror 10: 0x21299130 (stale) Mirror 12: 0x21299130 (stale) Mirror 15: 0x21299130 (stale) Mirror 16: 0x99a74ff7 (stale) Mirror 17: 0xdd1e4972 (stale) CRC-32 checksum value for chunk [0, 0x3c184): Mirror 1: 0xdd1e4972 Mirror 18: 0xdd1e4972 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c184: skipped 000780 1784413479.570996 punch from 0x03038a to 0x035d87 (0x59fe bytes) 000781 1784413479.581780 write 0x00403c thru 0x007598 (0x355d bytes) 000782 1784413479.585426 punch from 0x01c6fd to 0x02605d (0x9961 bytes) 000783 1784413479.587155 mapwrite 0x0342e8 thru 0x039d27 (0x5a40 bytes) 000785 1784413479.598163 trunc from 0x03c184 to 0x039141 (0x3042 bytes) 000786 1784413479.608890 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x39142): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39142): Mirror 8: 0xa674e834 (stale) Mirror 10: 0xa674e834 (stale) Mirror 12: 0xa674e834 (stale) Mirror 15: 0xa674e834 (stale) Mirror 16: 0xff06fad3 (stale) Mirror 17: 0x1cf100a (stale) Mirror 18: 0x1cf100a (stale) CRC-32 checksum value for chunk [0, 0x39142): Mirror 1: 0x44f98564 Mirror 19: 0x44f98564 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39142: skipped 000787 1784413479.888615 trunc from 0x039142 to 0x00c8f7 (0x2c84a bytes) 000788 1784413479.907707 fallocate 0x00bee7 thru 0x016237 (0xa351 bytes) 000789 1784413479.910675 MIRROR_RESYNC 9 mirrors 000790 1784413480.237253 trunc from 0x0060d7 to 0x00c8f7 (0x6821 bytes) 000791 1784413480.247792 write 0x00afc4 thru 0x00f000 (0x403d bytes) 000792 1784413480.250047 fallocate 0x0012ce thru 0x005f95 (0x4cc8 bytes) 000793 1784413480.252127 punch from 0x00d534 to 0x00f000 (0x1acd bytes) 000794 1784413480.256167 mapwrite 0x013249 thru 0x01566f (0x2427 bytes) 000795 1784413480.276483 read 0x00f2f2 thru 0x01566f (0x637e bytes) 000796 1784413480.277137 trunc from 0x015670 to 0x030374 (0x1ad05 bytes) 000797 1784413480.282865 MIRROR_RESYNC 9 mirrors 000799 1784413480.854600 mapwrite 0x02bccd thru 0x03aa7c (0xedb0 bytes) 000800 1784413480.876914 trunc from 0x03aa7d to 0x00addc (0x2fca0 bytes) 000801 1784413480.881915 mapread 0x004050 thru 0x0055bf (0x1570 bytes) 000802 1784413480.884494 trunc from 0x000a51 to 0x00896d (0x7f1d bytes) 000803 1784413480.887492 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xaddd): Mirror 8: 0xe2476098 (stale) Mirror 10: 0xe2476098 (stale) Mirror 12: 0xe2476098 (stale) Mirror 15: 0xe2476098 (stale) Mirror 16: 0xe2476098 (stale) Mirror 17: 0xe2476098 (stale) Mirror 18: 0xe2476098 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xaddd): Mirror 8: 0xe2476098 (stale) Mirror 10: 0xe2476098 (stale) Mirror 12: 0xe2476098 (stale) Mirror 15: 0xe2476098 (stale) Mirror 16: 0xe2476098 (stale) Mirror 17: 0xe2476098 (stale) Mirror 18: 0xe2476098 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xaddd: skipped 000804 1784413480.981974 mapread 0x000ea5 thru 0x003a5e (0x2bba bytes) 000805 1784413480.987507 trunc from 0x00addd to 0x03e757 (0x3397b bytes) 000806 1784413480.992080 trunc from 0x004374 to 0x0141e5 (0xfe72 bytes) 000807 1784413480.993628 trunc from 0x03e758 to 0x0367f6 (0x7f61 bytes) 000808 1784413480.997171 punch from 0x02bd2e to 0x0329bb (0x6c8e bytes) 000809 1784413480.998539 read 0x02dfb6 thru 0x0367f6 (0x8841 bytes) 000810 1784413481.002282 MIRROR_RESYNC 8 mirrors 000811 1784413481.260113 trunc from 0x0367f7 to 0x003919 (0x32edd bytes) 000813 1784413481.270900 trunc from 0x000e62 to 0x003919 (0x2ab8 bytes) 000814 1784413481.272481 trunc from 0x00391a to 0x002c40 (0xcd9 bytes) 000815 1784413481.278553 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c41): Mirror 8: 0x51dfec10 (stale) Mirror 10: 0x51dfec10 (stale) Mirror 12: 0x51dfec10 (stale) Mirror 16: 0x51dfec10 (stale) Mirror 17: 0x51dfec10 (stale) Mirror 18: 0x51dfec10 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c41): Mirror 8: 0x51dfec10 (stale) Mirror 10: 0x51dfec10 (stale) Mirror 12: 0x51dfec10 (stale) Mirror 16: 0x51dfec10 (stale) Mirror 17: 0x51dfec10 (stale) Mirror 18: 0x51dfec10 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c41: skipped 000816 1784413481.375902 mapwrite 0x03c31d thru 0x03f6a8 (0x338c bytes) 000817 1784413481.388643 mapread 0x03b911 thru 0x03f6a8 (0x3d98 bytes) 000818 1784413481.389251 mapread 0x00b7b6 thru 0x011776 (0x5fc1 bytes) 000819 1784413481.391947 read 0x016fbf thru 0x01e84e (0x7890 bytes) 000821 1784413481.394577 trunc from 0x03ac94 to 0x03f6a8 (0x4a15 bytes) 000822 1784413481.396289 trunc from 0x023d2c to 0x02eccb (0xafa0 bytes) 000823 1784413481.397706 mapread 0x02fd85 thru 0x036a00 (0x6c7c bytes) 000824 1784413481.400550 trunc from 0x03f6a9 to 0x0210db (0x1e5cd bytes) 000825 1784413481.405711 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x210dc): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x210dc): Mirror 8: 0x69d41392 (stale) Mirror 10: 0x69d41392 (stale) Mirror 12: 0x69d41392 (stale) Mirror 16: 0x69d41392 (stale) Mirror 17: 0x69d41392 (stale) Mirror 18: 0x69d41392 (stale) CRC-32 checksum value for chunk [0, 0x210dc): Mirror 1: 0x69d41392 Mirror 19: 0x69d41392 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x210dc: skipped 000826 1784413481.619309 mapwrite 0x02d437 thru 0x02df23 (0xaed bytes) 000827 1784413481.640854 mapwrite 0x00bb98 thru 0x00f7c9 (0x3c32 bytes) 000829 1784413481.648725 read 0x017269 thru 0x018041 (0xdd9 bytes) 000830 1784413481.650159 write 0x03edc9 thru 0x03ffff (0x1237 bytes) 000831 1784413481.651928 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000833 1784413481.758004 read 0x03e99d thru 0x03ffff (0x1663 bytes) 000834 1784413481.759848 trunc from 0x007d9d to 0x0171ed (0xf451 bytes) 000835 1784413481.761566 mapread 0x021f35 thru 0x02fca7 (0xdd73 bytes) 000837 1784413481.769245 trunc from 0x040000 to 0x002df2 (0x3d20d bytes) 000838 1784413481.774502 trunc from 0x002df3 to 0x02bda4 (0x28fb2 bytes) 000839 1784413481.778592 mapread 0x025576 thru 0x02bda4 (0x682f bytes) 000840 1784413481.781978 mapread 0x01dbe5 thru 0x0279e3 (0x9dff bytes) 000841 1784413481.785070 mapwrite 0x00baaa thru 0x016511 (0xaa68 bytes) 000842 1784413481.795881 trunc from 0x02bda5 to 0x01c834 (0xf570 bytes) 000843 1784413481.800571 read 0x000247 thru 0x00dc3a (0xd9f4 bytes) 000844 1784413481.802925 read 0x00e7b8 thru 0x018fad (0xa7f6 bytes) 000845 1784413481.803595 mapread 0x0108da thru 0x012d77 (0x249e bytes) 000846 1784413481.804543 mapread 0x00a4b0 thru 0x00f669 (0x51ba bytes) 000847 1784413481.805491 trunc from 0x0192a2 to 0x01c834 (0x3593 bytes) 000848 1784413481.807358 mapread 0x00ac27 thru 0x010e13 (0x61ed bytes) 000849 1784413481.807949 fallocate 0x003e32 thru 0x008097 (0x4266 bytes) 000850 1784413481.809708 mapread 0x01593a thru 0x01c834 (0x6efb bytes) 000851 1784413481.812102 write 0x0355f5 thru 0x03ea4f (0x945b bytes) 000853 1784413481.813596 punch from 0x0290e7 to 0x03323e (0xa158 bytes) 000854 1784413481.815270 read 0x01abac thru 0x01dd5f (0x31b4 bytes) 000855 1784413481.817958 punch from 0x00a524 to 0x0156dc (0xb1b9 bytes) 000857 1784413481.822278 MIRROR_RESYNC 7 mirrors 000858 1784413482.164380 trunc from 0x03ea50 to 0x0010ed (0x3d962 bytes) 000859 1784413482.173027 read 0x000e64 thru 0x0010ed (0x28a bytes) 000860 1784413482.174821 trunc from 0x0010ee to 0x003584 (0x2497 bytes) 000861 1784413482.179483 read 0x001bb9 thru 0x003584 (0x19cc bytes) 000862 1784413482.181148 read 0x003043 thru 0x003584 (0x542 bytes) 000863 1784413482.181659 write 0x03e507 thru 0x03ffff (0x1af9 bytes) 000864 1784413482.182364 trunc from 0x040000 to 0x004392 (0x3bc6d bytes) 000865 1784413482.186339 mapwrite 0x035b3b thru 0x03ec78 (0x913e bytes) 000866 1784413482.199582 mapwrite 0x0178a7 thru 0x01b99b (0x40f5 bytes) 000867 1784413482.204363 trunc from 0x0060d7 to 0x01440c (0xe336 bytes) 000868 1784413482.206366 fallocate 0x029097 thru 0x0332b5 (0xa21f bytes) 000870 1784413482.208607 fallocate 0x003029 thru 0x004b8f (0x1b67 bytes) 000872 1784413482.210726 mapwrite 0x02a804 thru 0x039567 (0xed64 bytes) 000873 1784413482.218091 read 0x002aa8 thru 0x004cd8 (0x2231 bytes) 000874 1784413482.218786 read 0x00b27b thru 0x017079 (0xbdff bytes) 000875 1784413482.221811 write 0x0314a0 thru 0x034ef8 (0x3a59 bytes) 000877 1784413482.223229 mapread 0x006485 thru 0x00a5e5 (0x4161 bytes) 000878 1784413482.224330 write 0x01daef thru 0x029e94 (0xc3a6 bytes) 000879 1784413482.225790 mapread 0x015953 thru 0x019b68 (0x4216 bytes) 000880 1784413482.226671 trunc from 0x02ccfc to 0x03b3b8 (0xe6bd bytes) 000881 1784413482.231205 trunc from 0x01ae7f to 0x029720 (0xe8a2 bytes) 000882 1784413482.233106 trunc from 0x00b349 to 0x016582 (0xb23a bytes) 000883 1784413482.236176 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3ec79): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec79): Mirror 8: 0xf6df991c (stale) Mirror 10: 0xf6df991c (stale) Mirror 12: 0xf6df991c (stale) Mirror 16: 0xf6df991c (stale) Mirror 17: 0xf6df991c (stale) Mirror 19: 0xf6df991c (stale) CRC-32 checksum value for chunk [0, 0x3ec79): Mirror 1: 0xecb5a80a Mirror 20: 0xecb5a80a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec79: skipped 000884 1784413482.468714 trunc from 0x03ec79 to 0x01ec52 (0x20026 bytes) 000885 1784413482.488115 trunc from 0x006f82 to 0x00ae3c (0x3ebb bytes) 000886 1784413482.490022 mapread 0x017afc thru 0x01ec52 (0x7157 bytes) 000887 1784413482.495276 mapread 0x00aeef thru 0x011c3f (0x6d51 bytes) 000888 1784413482.498052 trunc from 0x00c6f3 to 0x01463e (0x7f4c bytes) 000889 1784413482.499644 read 0x0067a8 thru 0x01657f (0xfdd8 bytes) 000890 1784413482.502696 read 0x015e80 thru 0x01ec52 (0x8dd3 bytes) 000891 1784413482.504598 MIRROR_RESYNC 8 mirrors 000892 1784413482.816186 fallocate 0x0291a9 thru 0x03292e (0x9786 bytes) 000893 1784413482.826695 mapread 0x013b18 thru 0x01ec52 (0xb13b bytes) 000894 1784413482.833502 fallocate 0x001379 thru 0x003414 (0x209c bytes) 000895 1784413482.835530 read 0x0080fe thru 0x00c11d (0x4020 bytes) 000896 1784413482.838568 trunc from 0x01ec53 to 0x03fe8c (0x2123a bytes) 000897 1784413482.849068 trunc from 0x038307 to 0x03fe8c (0x7b86 bytes) 000898 1784413482.850779 trunc from 0x03fe8d to 0x007000 (0x38e8c bytes) 000899 1784413482.855750 trunc from 0x0018f1 to 0x007000 (0x5710 bytes) 000900 1784413482.857455 mapread 0x006814 thru 0x007000 (0x7ed bytes) 000901 1784413482.860141 mapread 0x005b6d thru 0x007000 (0x1494 bytes) 000902 1784413482.860833 trunc from 0x007001 to 0x0047bb (0x2845 bytes) 000903 1784413482.865097 punch from 0x0008ea to 0x0047bb (0x3ed2 bytes) 000904 1784413482.866785 read 0x002cac thru 0x0047bb (0x1b10 bytes) 000905 1784413482.868995 mapread 0x00161a thru 0x002ee5 (0x18cc bytes) 000906 1784413482.870995 MIRROR_RESYNC 8 mirrors 000907 1784413483.112328 read 0x0019b8 thru 0x0047bb (0x2e04 bytes) 000908 1784413483.114077 punch from 0x00340a to 0x0047bb (0x13b2 bytes) 000911 1784413483.122913 trunc from 0x0044c6 to 0x0047bb (0x2f6 bytes) 000912 1784413483.124333 read 0x001914 thru 0x0047bb (0x2ea8 bytes) 000913 1784413483.126918 fallocate 0x033e5e thru 0x03e5fd (0xa7a0 bytes) 000914 1784413483.129000 write 0x01aebb thru 0x026277 (0xb3bd bytes) 000915 1784413483.130104 read 0x025b13 thru 0x026277 (0x765 bytes) 000916 1784413483.130527 mapread 0x017cd6 thru 0x01d4b2 (0x57dd bytes) 000917 1784413483.132995 punch from 0x01179b to 0x014213 (0x2a79 bytes) 000918 1784413483.134502 mapwrite 0x001e96 thru 0x00db7f (0xbcea bytes) 000919 1784413483.141370 read 0x01d798 thru 0x01fd93 (0x25fc bytes) 000920 1784413483.141786 punch from 0x0054aa to 0x00a0b5 (0x4c0c bytes) 000921 1784413483.143659 trunc from 0x01a11f to 0x01a181 (0x63 bytes) 000923 1784413483.146747 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x26278): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26278): Mirror 8: 0x359ea92d (stale) Mirror 10: 0x359ea92d (stale) Mirror 12: 0x359ea92d (stale) Mirror 16: 0x359ea92d (stale) Mirror 17: 0x359ea92d (stale) Mirror 19: 0x359ea92d (stale) Mirror 20: 0x359ea92d (stale) CRC-32 checksum value for chunk [0, 0x26278): Mirror 1: 0x77a54b30 Mirror 21: 0x77a54b30 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26278: skipped 000924 1784413483.370501 trunc from 0x026278 to 0x00303f (0x23238 bytes) 000925 1784413483.385983 mapwrite 0x039391 thru 0x03f89d (0x650d bytes) 000926 1784413483.399944 write 0x000ba0 thru 0x0042d4 (0x3735 bytes) 000927 1784413483.402516 write 0x00cf3d thru 0x0141e1 (0x72a5 bytes) 000928 1784413483.405232 punch from 0x037b12 to 0x03ecc4 (0x71b3 bytes) 000929 1784413483.407747 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f89e): Mirror 10: 0xc6442b36 (stale) Mirror 12: 0xc6442b36 (stale) Mirror 16: 0xc6442b36 (stale) Mirror 17: 0xc6442b36 (stale) Mirror 19: 0xc6442b36 (stale) Mirror 20: 0xc6442b36 (stale) Mirror 21: 0x19887457 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f89e): Mirror 10: 0xc6442b36 (stale) Mirror 12: 0xc6442b36 (stale) Mirror 16: 0xc6442b36 (stale) Mirror 17: 0xc6442b36 (stale) Mirror 19: 0xc6442b36 (stale) Mirror 20: 0xc6442b36 (stale) Mirror 21: 0x19887457 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f89e: skipped 000930 1784413483.519577 trunc from 0x007ef7 to 0x00c999 (0x4aa3 bytes) 000931 1784413483.521430 fallocate 0x022e66 thru 0x03299e (0xfb39 bytes) 000932 1784413483.523020 read 0x00509b thru 0x00a1e4 (0x514a bytes) 000933 1784413483.525830 read 0x039d31 thru 0x039ef1 (0x1c1 bytes) 000934 1784413483.529048 mapread 0x02a270 thru 0x0322d2 (0x8063 bytes) 000935 1784413483.531242 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f89e): Mirror 10: 0xc6442b36 (stale) Mirror 12: 0xc6442b36 (stale) Mirror 17: 0xc6442b36 (stale) Mirror 19: 0xc6442b36 (stale) Mirror 20: 0xc6442b36 (stale) Mirror 21: 0x19887457 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f89e): Mirror 10: 0xc6442b36 (stale) Mirror 12: 0xc6442b36 (stale) Mirror 17: 0xc6442b36 (stale) Mirror 19: 0xc6442b36 (stale) Mirror 20: 0xc6442b36 (stale) Mirror 21: 0x19887457 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f89e: skipped 000936 1784413483.640747 punch from 0x0260e6 to 0x0268f3 (0x80e bytes) 000937 1784413483.642436 write 0x02e241 thru 0x03d92f (0xf6ef bytes) 000938 1784413483.646925 read 0x011c44 thru 0x012f76 (0x1333 bytes) 000939 1784413483.648699 trunc from 0x039ebf to 0x03f89d (0x59df bytes) 000940 1784413483.654054 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f89e): Mirror 10: 0xc6442b36 (stale) Mirror 12: 0xc6442b36 (stale) Mirror 17: 0xc6442b36 (stale) Mirror 19: 0xc6442b36 (stale) Mirror 21: 0x19887457 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f89e): Mirror 10: 0xc6442b36 (stale) Mirror 12: 0xc6442b36 (stale) Mirror 17: 0xc6442b36 (stale) Mirror 19: 0xc6442b36 (stale) Mirror 21: 0x19887457 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f89e: skipped 000941 1784413483.750059 punch from 0x004746 to 0x0113e4 (0xcc9f bytes) 000942 1784413483.751767 punch from 0x019cb8 to 0x0201eb (0x6534 bytes) 000943 1784413483.753382 trunc from 0x023628 to 0x024ca3 (0x167c bytes) 000944 1784413483.754813 write 0x00842d thru 0x00fde6 (0x79ba bytes) 000945 1784413483.758779 read 0x00b4b6 thru 0x017c87 (0xc7d2 bytes) 000946 1784413483.761331 write 0x007f84 thru 0x00e4f3 (0x6570 bytes) 000947 1784413483.763383 fallocate 0x03619c thru 0x03ffff (0x9e64 bytes) 000948 1784413483.765200 read 0x000cca thru 0x00cb2c (0xbe63 bytes) 000949 1784413483.768349 trunc from 0x03f89e to 0x003be9 (0x3bcb4 bytes) 000950 1784413483.773804 trunc from 0x003bea to 0x000271 (0x3978 bytes) 000951 1784413483.778530 read 0x0000ef thru 0x000271 (0x183 bytes) 000952 1784413483.778951 mapwrite 0x021f5c thru 0x02ccc0 (0xad65 bytes) 000953 1784413483.794725 punch from 0x0128d4 to 0x02277d (0xfeaa bytes) 000954 1784413483.797141 fallocate 0x01c206 thru 0x02ac4e (0xea49 bytes) 000956 1784413483.799868 fallocate 0x0322d3 thru 0x034659 (0x2387 bytes) 000957 1784413483.805217 write 0x005250 thru 0x00766d (0x241e bytes) 000959 1784413483.806680 fallocate 0x03c7d1 thru 0x03ffff (0x382f bytes) 000960 1784413483.811133 MIRROR_RESYNC 6 mirrors 000961 1784413484.144269 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) 000962 1784413484.241098 punch from 0x02f983 to 0x036750 (0x6dce bytes) 000963 1784413484.249418 trunc from 0x00188f to 0x004306 (0x2a78 bytes) 000964 1784413484.250923 mapwrite 0x005901 thru 0x009160 (0x3860 bytes) 000965 1784413484.261327 write 0x02cc0f thru 0x02f9c3 (0x2db5 bytes) 000966 1784413484.266303 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xe0e780f3 (stale) Mirror 12: 0xe0e780f3 (stale) Mirror 17: 0xe0e780f3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xe0e780f3 (stale) Mirror 12: 0xe0e780f3 (stale) Mirror 17: 0xe0e780f3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000967 1784413484.357804 write 0x01595a thru 0x021a87 (0xc12e bytes) 000968 1784413484.363690 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xe0e780f3 (stale) Mirror 12: 0xe0e780f3 (stale) Mirror 17: 0xe0e780f3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf28be64e Mirror 18: 0xf28be64e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000969 1784413484.597978 mapread 0x02438f thru 0x029559 (0x51cb bytes) 000970 1784413484.606882 read 0x007f85 thru 0x00d035 (0x50b1 bytes) 000971 1784413484.610844 mapwrite 0x01af24 thru 0x025795 (0xa872 bytes) 000973 1784413484.651948 mapread 0x00046b thru 0x00ea2d (0xe5c3 bytes) 000974 1784413484.656841 MIRROR_RESYNC 5 mirrors 000975 1784413484.978355 trunc from 0x040000 to 0x038d85 (0x727a bytes) 000976 1784413484.997765 punch from 0x01ffec to 0x02a0fc (0xa111 bytes) 000977 1784413484.999559 trunc from 0x038d86 to 0x02495a (0x1442b bytes) 000978 1784413485.006100 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2495b): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2495b): Mirror 10: 0x618cd048 (stale) Mirror 12: 0x618cd048 (stale) Mirror 17: 0x618cd048 (stale) Mirror 18: 0x618cd048 (stale) CRC-32 checksum value for chunk [0, 0x2495b): Mirror 1: 0xc40ed65e Mirror 19: 0xc40ed65e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2495b: skipped 000979 1784413485.253820 MIRROR_RESYNC 6 mirrors 000980 1784413485.556013 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x783:0x0]: Invalid argument (22) 000981 1784413485.667373 mapwrite 0x0242d7 thru 0x02eb5d (0xa887 bytes) 000982 1784413485.696014 mapwrite 0x00d060 thru 0x016960 (0x9901 bytes) 000984 1784413485.712249 read 0x00a7e3 thru 0x016941 (0xc15f bytes) 000985 1784413485.712989 trunc from 0x020738 to 0x029588 (0x8e51 bytes) 000986 1784413485.715557 read 0x01cf00 thru 0x024c6f (0x7d70 bytes) 000987 1784413485.719381 trunc from 0x01f243 to 0x022c67 (0x3a25 bytes) 000988 1784413485.722666 write 0x02d3cd thru 0x02db6b (0x79f bytes) 000989 1784413485.723546 write 0x00370c thru 0x006e18 (0x370d bytes) 000990 1784413485.724221 write 0x00f4ee thru 0x019473 (0x9f86 bytes) 000991 1784413485.725206 fallocate 0x03c08b thru 0x03cb3f (0xab5 bytes) 000992 1784413485.727790 mapread 0x01614a thru 0x0165b5 (0x46c bytes) 000994 1784413485.729013 trunc from 0x02eb5e to 0x02e4aa (0x6b3 bytes) 000995 1784413485.736437 mapwrite 0x015581 thru 0x015650 (0xd0 bytes) 000996 1784413485.742998 trunc from 0x00cb73 to 0x00d81a (0xca8 bytes) 000997 1784413485.745202 fallocate 0x0374bc thru 0x039fe1 (0x2b26 bytes) 000998 1784413485.747311 trunc from 0x02e4ab to 0x033e2f (0x5985 bytes) 000999 1784413485.752102 fallocate 0x02a2f0 thru 0x030ec5 (0x6bd6 bytes) 001000 1784413485.753844 write 0x023fd3 thru 0x02db67 (0x9b95 bytes) All operations completed A-OK!