== sanity-flr test 70a: flr mode fsx test ================ 21:32:34 (1788917554) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 7555 truncating to largest ever: 0x1ca3c 000002 1788917555.556584 trunc from 00000000 to 0x01ca3b (0x1ca3c bytes) 000003 1788917555.563322 write 0x01c0d8 thru 0x0264fa (0xa423 bytes) 000004 1788917555.567252 punch from 0x0127b0 to 0x01d77e (0xafcf bytes) 000005 1788917555.574893 punch from 0x0036e0 to 0x00bbdc (0x84fd bytes) 000006 1788917555.577490 mapread 0x017a89 thru 0x01a26a (0x27e2 bytes) 000007 1788917555.592917 MIRROR_EXTEND to 2 mirrors 000008 1788917555.832664 read 0x00a609 thru 0x013e27 (0x981f bytes) 000009 1788917555.836330 punch from 0x01ec3a to 0x0264fa (0x78c1 bytes) 000010 1788917555.849563 read 0x00b5a0 thru 0x010516 (0x4f77 bytes) 000011 1788917555.856075 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x264fb): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x264fb): Mirror 2: 0xdc9617fa (stale) CRC-32 checksum value for chunk [0, 0x264fb): Mirror 1: 0x622e4b9b Mirror 3: 0x622e4b9b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x264fb: skipped 000012 1788917556.239954 mapread 0x00a09f thru 0x01059e (0x6500 bytes) 000013 1788917556.255553 trunc from 0x0264fb to 0x012868 (0x13c92 bytes) 000014 1788917556.281966 mapwrite 0x035731 thru 0x035acf (0x39f bytes) 000015 1788917556.304695 trunc from 0x035ad0 to 0x00d3da (0x286f5 bytes) 000016 1788917556.314092 read 0x00c824 thru 0x00d3da (0xbb7 bytes) 000017 1788917556.319301 trunc from 0x001a52 to 0x00d3da (0xb989 bytes) 000018 1788917556.324619 mapread 0x0095b6 thru 0x00d3da (0x3e25 bytes) 000019 1788917556.332202 trunc from 0x00d3db to 0x016ca5 (0x98cb bytes) 000020 1788917556.350031 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16ca6): Mirror 3: 0x4bb8d14e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16ca6): Mirror 3: 0x4bb8d14e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16ca6: skipped 000021 1788917556.457444 read 0x0099ae thru 0x00d266 (0x38b9 bytes) fallocating to largest ever: 0x270a5 000022 1788917556.461107 fallocate 0x01bb55 thru 0x0270a4 (0xb550 bytes) 000023 1788917556.463730 punch from 0x0156a0 to 0x024adf (0xf440 bytes) 000024 1788917556.466407 read 0x01fe37 thru 0x02241f (0x25e9 bytes) 000026 1788917556.471654 mapread 0x01cb3a thru 0x024f72 (0x8439 bytes) 000027 1788917556.472772 read 0x01de87 thru 0x0270a4 (0x921e bytes) 000028 1788917556.473368 write 0x00b1a3 thru 0x00cdb5 (0x1c13 bytes) 000029 1788917556.477326 trunc from 0x0270a5 to 0x0262ce (0xdd6 bytes) 000030 1788917556.486712 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) 000031 1788917556.569245 write 0x01029f thru 0x01d911 (0xd673 bytes) 000032 1788917556.576500 mapwrite 0x01213f thru 0x014e57 (0x2d19 bytes) 000033 1788917556.592174 read 0x019b24 thru 0x01ab30 (0x100d bytes) 000035 1788917556.593648 write 0x001839 thru 0x00e529 (0xccf1 bytes) 000038 1788917556.600285 mapwrite 0x03bb31 thru 0x03be4b (0x31b bytes) 000039 1788917556.615473 read 0x01e231 thru 0x0283b6 (0xa186 bytes) 000040 1788917556.620033 trunc from 0x03be4c to 0x00663d (0x3580e bytes) 000041 1788917556.626692 write 0x00ebf9 thru 0x018ce8 (0xa0f0 bytes) fallocating to largest ever: 0x39164 000043 1788917556.629334 fallocate 0x02bd7e thru 0x039163 (0xd3e6 bytes) fallocating to largest ever: 0x40000 000046 1788917556.633665 fallocate 0x03eb09 thru 0x03ffff (0x14f7 bytes) 000047 1788917556.636862 read 0x009316 thru 0x014ec7 (0xbbb2 bytes) 000049 1788917556.642672 mapread 0x003156 thru 0x00c52c (0x93d7 bytes) 000050 1788917556.643665 mapread 0x01d500 thru 0x01f51d (0x201e bytes) 000051 1788917556.644396 punch from 0x012272 to 0x01a30a (0x8099 bytes) 000052 1788917556.651737 MIRROR_EXTEND to 2 mirrors 000053 1788917556.927740 punch from 0x028fd4 to 0x0341eb (0xb218 bytes) 000054 1788917556.945735 mapread 0x033bf7 thru 0x03924a (0x5654 bytes) 000055 1788917556.955099 punch from 0x013860 to 0x01530f (0x1ab0 bytes) 000056 1788917556.958566 trunc from 0x03c2c0 to 0x03ffff (0x3d40 bytes) 000057 1788917556.963267 read 0x02bbce thru 0x031bc0 (0x5ff3 bytes) 000058 1788917556.967673 trunc from 0x0075c7 to 0x014d7a (0xd7b4 bytes) 000059 1788917556.971548 fallocate 0x0371ce thru 0x039ff8 (0x2e2b bytes) 000060 1788917556.975544 trunc from 0x040000 to 0x031831 (0xe7ce bytes) 000061 1788917557.000601 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) 000062 1788917557.049270 punch from 0x002d76 to 0x00a41e (0x76a9 bytes) 000063 1788917557.051991 fallocate 0x00a021 thru 0x00c428 (0x2408 bytes) 000064 1788917557.057826 trunc from 0x00d96d to 0x01d6c2 (0xfd56 bytes) 000065 1788917557.061652 punch from 0x02ad0e to 0x031831 (0x6b24 bytes) 000066 1788917557.064953 mapwrite 0x01887b thru 0x0204b4 (0x7c3a bytes) 000067 1788917557.086966 trunc from 0x002369 to 0x0040ca (0x1d62 bytes) 000068 1788917557.090487 trunc from 0x031832 to 0x034401 (0x2bd0 bytes) 000069 1788917557.105844 mapread 0x02e600 thru 0x02e656 (0x57 bytes) 000070 1788917557.112297 mapread 0x0228fd thru 0x03168d (0xed91 bytes) 000071 1788917557.117274 read 0x002f41 thru 0x006ea5 (0x3f65 bytes) 000072 1788917557.122548 mapwrite 0x0199d6 thru 0x027421 (0xda4c bytes) 000073 1788917557.135455 punch from 0x0244c5 to 0x02b6c8 (0x7204 bytes) 000074 1788917557.139578 trunc from 0x034402 to 0x00388f (0x30b72 bytes) 000075 1788917557.149290 mapwrite 0x00c793 thru 0x016764 (0x9fd2 bytes) 000076 1788917557.183879 punch from 0x003bfe to 0x0110ba (0xd4bd bytes) 000077 1788917557.187674 fallocate 0x01e8ac thru 0x01fc3c (0x1391 bytes) 000078 1788917557.194188 mapwrite 0x02fbbd thru 0x034d25 (0x5169 bytes) 000081 1788917557.235169 trunc from 0x034d26 to 0x010013 (0x24d12 bytes) 000083 1788917557.246979 MIRROR_EXTEND to 2 mirrors 000085 1788917557.454655 mapwrite 0x034ad2 thru 0x03f816 (0xad45 bytes) 000086 1788917557.488208 write 0x029485 thru 0x02e08e (0x4c0a bytes) 000087 1788917557.492433 mapread 0x0014f7 thru 0x00650a (0x5014 bytes) 000088 1788917557.496178 trunc from 0x03cc84 to 0x03f816 (0x2b93 bytes) 000089 1788917557.499284 mapwrite 0x01502d thru 0x023d11 (0xece5 bytes) 000090 1788917557.518130 MIRROR_RESYNC 2 mirrors 000091 1788917557.794431 write 0x01c2fd thru 0x028103 (0xbe07 bytes) 000092 1788917557.807508 fallocate 0x01bb1d thru 0x027754 (0xbc38 bytes) 000094 1788917557.810622 punch from 0x02bfc2 to 0x02fa7a (0x3ab9 bytes) 000095 1788917557.812946 fallocate 0x02fec3 thru 0x034f42 (0x5080 bytes) 000096 1788917557.815392 read 0x00b64b thru 0x019a44 (0xe3fa bytes) 000097 1788917557.820328 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3f817): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f817): Mirror 2: 0xd5b122c0 (stale) CRC-32 checksum value for chunk [0, 0x3f817): Mirror 1: 0xb5972fe6 Mirror 3: 0xb5972fe6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f817: skipped 000098 1788917558.127314 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3f817): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f817): Mirror 2: 0xd5b122c0 (stale) CRC-32 checksum value for chunk [0, 0x3f817): Mirror 1: 0xb5972fe6 Mirror 3: 0xb5972fe6 Mirror 4: 0xb5972fe6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f817: skipped 000099 1788917558.438420 read 0x01c38e thru 0x01f746 (0x33b9 bytes) 000100 1788917558.440703 mapwrite 0x02e6a9 thru 0x03dfca (0xf922 bytes) 000102 1788917558.480692 mapwrite 0x005209 thru 0x0133e2 (0xe1da bytes) 000103 1788917558.494961 mapwrite 0x027760 thru 0x02cb6c (0x540d bytes) 000104 1788917558.505182 trunc from 0x03f817 to 0x0234d0 (0x1c346 bytes) 000105 1788917558.518936 trunc from 0x0234d1 to 0x01343a (0x10096 bytes) 000106 1788917558.524841 punch from 0x004891 to 0x01240f (0xdb7f bytes) 000107 1788917558.527134 trunc from 0x01343b to 0x022229 (0xedef bytes) 000108 1788917558.532922 fallocate 0x01460a thru 0x01cd3c (0x8733 bytes) 000109 1788917558.535337 read 0x0075db thru 0x0101ef (0x8c15 bytes) 000110 1788917558.539955 trunc from 0x02222a to 0x012bdd (0xf64c bytes) 000111 1788917558.546046 punch from 0x0015c6 to 0x00c3a7 (0xade2 bytes) 000113 1788917558.549062 trunc from 0x012bde to 0x0227d5 (0xfbf8 bytes) 000114 1788917558.554448 write 0x032ae3 thru 0x03ffff (0xd51d bytes) 000115 1788917558.556003 punch from 0x00b7cf to 0x0138f8 (0x812a bytes) 000116 1788917558.560586 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xcd9b70fc (stale) Mirror 3: 0x38c1d6fe (stale) Mirror 4: 0x38c1d6fe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x52144581 Mirror 5: 0x52144581 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000117 1788917558.863863 punch from 0x03ad1c to 0x03ec7b (0x3f60 bytes) 000118 1788917558.875646 fallocate 0x012aca thru 0x01db26 (0xb05d bytes) 000119 1788917558.877939 write 0x02ae3b thru 0x02babc (0xc82 bytes) 000120 1788917558.882798 write 0x0245f5 thru 0x027348 (0x2d54 bytes) 000121 1788917558.886297 mapwrite 0x011904 thru 0x018838 (0x6f35 bytes) 000122 1788917558.899603 punch from 0x03dcd8 to 0x03ffff (0x2328 bytes) 000123 1788917558.901908 fallocate 0x01235c thru 0x020a94 (0xe739 bytes) 000124 1788917558.907560 trunc from 0x040000 to 0x02fbd3 (0x1042c bytes) 000125 1788917558.918819 mapread 0x00b4da thru 0x00e460 (0x2f87 bytes) 000126 1788917558.922849 mapread 0x019c62 thru 0x0257fc (0xbb9b bytes) 000127 1788917558.926871 mapwrite 0x0202af thru 0x029345 (0x9097 bytes) 000128 1788917558.936814 mapwrite 0x00bfd0 thru 0x018823 (0xc854 bytes) 000129 1788917558.946284 write 0x026ac6 thru 0x0280d3 (0x160e bytes) 000130 1788917558.947242 write 0x004d71 thru 0x008803 (0x3a93 bytes) 000131 1788917558.948099 trunc from 0x0054fd to 0x0059bd (0x4c1 bytes) 000132 1788917558.953460 punch from 0x021b3f to 0x02e1fa (0xc6bc bytes) 000133 1788917558.956069 punch from 0x018ee5 to 0x0245f6 (0xb712 bytes) 000134 1788917558.958315 mapwrite 0x037e40 thru 0x03abca (0x2d8b bytes) 000135 1788917558.974067 mapwrite 0x000cbe thru 0x004212 (0x3555 bytes) 000136 1788917558.983146 mapread 0x029232 thru 0x030b78 (0x7947 bytes) 000137 1788917558.987285 write 0x010217 thru 0x0141ed (0x3fd7 bytes) 000138 1788917558.990068 MIRROR_RESYNC 5 mirrors 000139 1788917559.370147 write 0x030e1e thru 0x0371b9 (0x639c bytes) 000142 1788917559.386071 mapwrite 0x02dc8a thru 0x034a8d (0x6e04 bytes) 000143 1788917559.404301 mapwrite 0x00db23 thru 0x01cad9 (0xefb7 bytes) 000144 1788917559.425876 trunc from 0x03abcb to 0x02c693 (0xe537 bytes) 000145 1788917559.434113 punch from 0x02c148 to 0x02c693 (0x54c bytes) 000146 1788917559.436567 mapread 0x00ff02 thru 0x01c0b6 (0xc1b5 bytes) 000147 1788917559.437787 trunc from 0x0265c7 to 0x02c693 (0x60cd bytes) 000148 1788917559.440263 write 0x032eb7 thru 0x03fe41 (0xcf8b bytes) 000149 1788917559.441814 trunc from 0x00b2dc to 0x0180c6 (0xcdeb bytes) 000150 1788917559.444849 mapwrite 0x030e1c thru 0x03cfcb (0xc1b0 bytes) 000151 1788917559.457273 punch from 0x014be5 to 0x015c52 (0x106e bytes) 000152 1788917559.459687 mapwrite 0x00a971 thru 0x015e91 (0xb521 bytes) 000153 1788917559.473714 fallocate 0x00c3be thru 0x014a34 (0x8677 bytes) 000154 1788917559.475942 mapwrite 0x016184 thru 0x019e8c (0x3d09 bytes) 000155 1788917559.482644 punch from 0x01e512 to 0x02e00b (0xfafa bytes) 000156 1788917559.484996 mapread 0x02334f thru 0x02ffdc (0xcc8e bytes) 000157 1788917559.490726 mapread 0x005b1b thru 0x00e6f8 (0x8bde bytes) 000158 1788917559.491691 write 0x01b1d0 thru 0x021d8f (0x6bc0 bytes) 000159 1788917559.492793 fallocate 0x025e69 thru 0x029241 (0x33d9 bytes) 000160 1788917559.495409 fallocate 0x00a52f thru 0x00d440 (0x2f12 bytes) 000161 1788917559.497339 mapwrite 0x034321 thru 0x03f982 (0xb662 bytes) 000162 1788917559.507199 mapwrite 0x00d7cb thru 0x016def (0x9625 bytes) 000163 1788917559.515106 punch from 0x02f486 to 0x03e92a (0xf4a5 bytes) 000164 1788917559.517472 trunc from 0x03fe42 to 0x0258ae (0x1a593 bytes) 000165 1788917559.524006 trunc from 0x020f7d to 0x0258ae (0x4932 bytes) 000166 1788917559.526870 punch from 0x017593 to 0x0258ae (0xe31c bytes) 000168 1788917559.529799 trunc from 0x00f877 to 0x01d75f (0xdee9 bytes) 000169 1788917559.532582 write 0x01c760 thru 0x023c59 (0x74fa bytes) 000170 1788917559.536959 trunc from 0x0258af to 0x026261 (0x9b3 bytes) 000171 1788917559.545209 write 0x0300fb thru 0x03c188 (0xc08e bytes) 000172 1788917559.546757 write 0x0063dd thru 0x0105a0 (0xa1c4 bytes) 000173 1788917559.549716 trunc from 0x037714 to 0x03c188 (0x4a75 bytes) 000174 1788917559.554673 punch from 0x000266 to 0x008c6f (0x8a0a bytes) 000175 1788917559.556661 punch from 0x039929 to 0x03c188 (0x2860 bytes) 000176 1788917559.558387 read 0x004044 thru 0x0126c6 (0xe683 bytes) 000177 1788917559.561064 read 0x00082d thru 0x00be70 (0xb644 bytes) 000178 1788917559.564442 read 0x01948d thru 0x0213af (0x7f23 bytes) 000179 1788917559.566890 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c189): Mirror 3: 0xa9a22f97 (stale) Mirror 4: 0xa9a22f97 (stale) Mirror 5: 0xa9a22f97 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c189): Mirror 3: 0xa9a22f97 (stale) Mirror 4: 0xa9a22f97 (stale) Mirror 5: 0xa9a22f97 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c189: skipped 000180 1788917559.699594 read 0x0191b4 thru 0x01aa23 (0x1870 bytes) 000181 1788917559.702385 fallocate 0x003f7f thru 0x013012 (0xf094 bytes) 000182 1788917559.706628 MIRROR_RESYNC 4 mirrors 000183 1788917560.242630 read 0x02eb03 thru 0x036802 (0x7d00 bytes) 000184 1788917560.245321 read 0x01c9a2 thru 0x0210ef (0x474e bytes) 000185 1788917560.248507 trunc from 0x03c189 to 0x008121 (0x34067 bytes) 000186 1788917560.263734 mapwrite 0x038cf8 thru 0x03a95f (0x1c68 bytes) 000187 1788917560.282384 read 0x02d4f5 thru 0x03a95f (0xd46b bytes) 000188 1788917560.286685 read 0x0370a6 thru 0x03a95f (0x38ba bytes) 000190 1788917560.287453 mapread 0x0248b4 thru 0x026a2b (0x2178 bytes) 000191 1788917560.288054 read 0x002cea thru 0x00c2c9 (0x95e0 bytes) 000192 1788917560.288530 trunc from 0x03a960 to 0x03b58b (0xc2c bytes) 000193 1788917560.293885 mapread 0x01c1b0 thru 0x020520 (0x4371 bytes) 000194 1788917560.294930 fallocate 0x02e454 thru 0x02ed80 (0x92d bytes) 000195 1788917560.297810 read 0x019dde thru 0x0201b2 (0x63d5 bytes) 000196 1788917560.298284 trunc from 0x03b58c to 0x008d35 (0x32856 bytes) 000197 1788917560.306691 mapread 0x0059be thru 0x008d35 (0x3378 bytes) 000198 1788917560.307712 punch from 0x006f89 to 0x008d35 (0x1dad bytes) 000199 1788917560.310419 trunc from 0x001be2 to 0x00246d (0x88c bytes) 000200 1788917560.312537 trunc from 0x002e2c to 0x008d35 (0x5f0a bytes) 000201 1788917560.314818 mapwrite 0x012a20 thru 0x01bea4 (0x9485 bytes) 000202 1788917560.336953 fallocate 0x034073 thru 0x03f266 (0xb1f4 bytes) 000203 1788917560.339880 write 0x0293a9 thru 0x02eae0 (0x5738 bytes) 000204 1788917560.341111 mapwrite 0x03e232 thru 0x03ffff (0x1dce bytes) 000205 1788917560.358400 write 0x00a928 thru 0x00bcca (0x13a3 bytes) 000208 1788917560.361137 write 0x03f05a thru 0x03ffff (0xfa6 bytes) 000209 1788917560.362074 trunc from 0x040000 to 0x026468 (0x19b97 bytes) 000210 1788917560.369276 write 0x02837d thru 0x02dd6c (0x59f0 bytes) 000211 1788917560.370397 trunc from 0x010d2c to 0x0123b1 (0x1686 bytes) 000213 1788917560.373330 read 0x00745d thru 0x008900 (0x14a4 bytes) 000214 1788917560.374054 trunc from 0x02dd6d to 0x0113b0 (0x1c9bc bytes) 000215 1788917560.380255 mapwrite 0x00254c thru 0x008805 (0x62ba bytes) 000216 1788917560.390703 trunc from 0x00fe51 to 0x0113b0 (0x1560 bytes) 000217 1788917560.393604 fallocate 0x038116 thru 0x03e57c (0x6467 bytes) 000218 1788917560.396754 fallocate 0x00ca31 thru 0x010b16 (0x40e6 bytes) 000219 1788917560.399769 fallocate 0x02d09b thru 0x034abe (0x7a24 bytes) 000220 1788917560.402852 mapwrite 0x000f81 thru 0x00ff0a (0xef8a bytes) 000221 1788917560.418787 read 0x01db29 thru 0x02c092 (0xe56a bytes) 000222 1788917560.419553 write 0x0346c7 thru 0x03aa44 (0x637e bytes) 000223 1788917560.420894 mapread 0x0194e4 thru 0x0282ae (0xedcb bytes) 000225 1788917560.422423 trunc from 0x03aa45 to 0x03baa5 (0x1061 bytes) 000226 1788917560.429100 mapwrite 0x035543 thru 0x038dc8 (0x3886 bytes) 000227 1788917560.439736 MIRROR_RESYNC 4 mirrors 000228 1788917560.734956 MIRROR_EXTEND to 5 mirrors 000229 1788917560.954095 MIRROR_RESYNC 5 mirrors 000230 1788917561.123783 mapread 0x00bfb8 thru 0x00cc48 (0xc91 bytes) 000231 1788917561.128482 fallocate 0x02f226 thru 0x03f1da (0xffb5 bytes) 000232 1788917561.146074 punch from 0x000917 to 0x00bd47 (0xb431 bytes) 000234 1788917561.149260 mapwrite 0x015650 thru 0x0227e7 (0xd198 bytes) 000235 1788917561.179380 mapread 0x012890 thru 0x020d3a (0xe4ab bytes) 000236 1788917561.180691 mapwrite 0x03c476 thru 0x03ffff (0x3b8a bytes) 000237 1788917561.217851 MIRROR_RESYNC 5 mirrors 000238 1788917561.658077 fallocate 0x01adaf thru 0x020acf (0x5d21 bytes) 000239 1788917561.675572 punch from 0x038a75 to 0x03eb43 (0x60cf bytes) 000240 1788917561.678252 read 0x0279e7 thru 0x03523f (0xd859 bytes) 000241 1788917561.682779 mapwrite 0x03f1e2 thru 0x03ffff (0xe1e bytes) 000242 1788917561.695121 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xfef80896 (stale) Mirror 4: 0xfef80896 (stale) Mirror 5: 0xfef80896 (stale) Mirror 6: 0xfef80896 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x971a0026 Mirror 7: 0x971a0026 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000243 1788917562.079895 trunc from 0x040000 to 0x01e32f (0x21cd0 bytes) 000244 1788917562.104309 punch from 0x00c251 to 0x00d80b (0x15bb bytes) 000245 1788917562.108973 punch from 0x00939f to 0x01381b (0xa47d bytes) 000246 1788917562.112022 write 0x03fdd3 thru 0x03ffff (0x22d bytes) 000247 1788917562.114860 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xfef80896 (stale) Mirror 4: 0xfef80896 (stale) Mirror 5: 0xfef80896 (stale) Mirror 6: 0xfef80896 (stale) Mirror 7: 0x971a0026 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x280b2890 Mirror 8: 0x280b2890 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000248 1788917562.451332 trunc from 0x040000 to 0x00750a (0x38af5 bytes) 000249 1788917562.473653 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x750b): Mirror 4: 0x2041eef (stale) Mirror 5: 0x2041eef (stale) Mirror 6: 0x2041eef (stale) Mirror 7: 0x2041eef (stale) Mirror 8: 0x2041eef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x750b): Mirror 4: 0x2041eef (stale) Mirror 5: 0x2041eef (stale) Mirror 6: 0x2041eef (stale) Mirror 7: 0x2041eef (stale) Mirror 8: 0x2041eef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x750b: skipped 000250 1788917562.602831 trunc from 0x000805 to 0x00750a (0x6d06 bytes) 000251 1788917562.606339 mapwrite 0x03eb51 thru 0x03ffff (0x14af bytes) 000252 1788917562.631464 trunc from 0x02b807 to 0x037153 (0xb94d bytes) 000253 1788917562.634184 read 0x01cf34 thru 0x0274f6 (0xa5c3 bytes) 000254 1788917562.639295 write 0x037841 thru 0x03ffff (0x87bf bytes) 000255 1788917562.642471 trunc from 0x0093b7 to 0x00fdfb (0x6a45 bytes) 000256 1788917562.645103 mapwrite 0x01164d thru 0x01ebe5 (0xd599 bytes) 000257 1788917562.663568 mapwrite 0x010642 thru 0x01cbc1 (0xc580 bytes) 000259 1788917562.675040 mapwrite 0x030bf9 thru 0x03275c (0x1b64 bytes) 000260 1788917562.684330 write 0x00889b thru 0x013973 (0xb0d9 bytes) 000261 1788917562.689211 mapread 0x02abbc thru 0x03661a (0xba5f bytes) 000262 1788917562.690267 trunc from 0x040000 to 0x031ee6 (0xe119 bytes) 000263 1788917562.697443 mapread 0x007934 thru 0x00f1ac (0x7879 bytes) 000264 1788917562.701546 trunc from 0x00328a to 0x00aed7 (0x7c4e bytes) 000265 1788917562.708508 fallocate 0x00d3a6 thru 0x01424e (0x6ea9 bytes) 000267 1788917562.710995 mapread 0x008790 thru 0x00d71d (0x4f8e bytes) 000268 1788917562.714599 fallocate 0x012598 thru 0x02132d (0xed96 bytes) 000269 1788917562.716842 trunc from 0x0257c4 to 0x02da06 (0x8243 bytes) 000271 1788917562.718994 mapread 0x016139 thru 0x024b05 (0xe9cd bytes) 000272 1788917562.719860 write 0x029fee thru 0x030437 (0x644a bytes) 000273 1788917562.722503 trunc from 0x025442 to 0x0296e5 (0x42a4 bytes) 000274 1788917562.727200 fallocate 0x03a280 thru 0x03ffff (0x5d80 bytes) 000275 1788917562.729730 write 0x03ae0e thru 0x03cb47 (0x1d3a bytes) 000276 1788917562.730552 trunc from 0x03cb48 to 0x033cf3 (0x8e54 bytes) 000278 1788917562.740417 write 0x03caa0 thru 0x03dcfe (0x125f bytes) 000279 1788917562.741658 mapwrite 0x000b77 thru 0x006f40 (0x63ca bytes) 000280 1788917562.753421 fallocate 0x015dab thru 0x01ef45 (0x919b bytes) 000281 1788917562.755685 punch from 0x01748e to 0x01fb75 (0x86e8 bytes) 000282 1788917562.757813 trunc from 0x004fb6 to 0x007af0 (0x2b3b bytes) 000283 1788917562.759759 fallocate 0x02866c thru 0x02c3aa (0x3d3f bytes) 000284 1788917562.761715 mapwrite 0x01f33f thru 0x02d663 (0xe325 bytes) 000285 1788917562.776513 trunc from 0x027c1c to 0x0335f5 (0xb9da bytes) 000286 1788917562.779010 mapwrite 0x032451 thru 0x03edac (0xc95c bytes) 000287 1788917562.801512 MIRROR_RESYNC 6 mirrors 000288 1788917563.308194 trunc from 0x026105 to 0x034307 (0xe203 bytes) 000289 1788917563.317403 write 0x01efe2 thru 0x02eede (0xfefd bytes) 000291 1788917563.323219 MIRROR_RESYNC 6 mirrors 000292 1788917563.858892 trunc from 0x0224fe to 0x02364e (0x1151 bytes) 000293 1788917563.868423 mapread 0x014c12 thru 0x01f698 (0xaa87 bytes) 000294 1788917563.878330 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3edad): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3edad): Mirror 4: 0x3c2d42be (stale) Mirror 5: 0x3c2d42be (stale) Mirror 6: 0x3c2d42be (stale) Mirror 7: 0x3c2d42be (stale) Mirror 8: 0x3c2d42be (stale) CRC-32 checksum value for chunk [0, 0x3edad): Mirror 1: 0xae2da690 Mirror 9: 0xae2da690 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3edad: skipped 000295 1788917564.238598 write 0x032306 thru 0x03ffff (0xdcfa bytes) 000296 1788917564.254196 fallocate 0x02edf8 thru 0x032bc7 (0x3dd0 bytes) 000297 1788917564.256297 trunc from 0x040000 to 0x02497b (0x1b684 bytes) 000298 1788917564.261891 write 0x00fab8 thru 0x01af6a (0xb4b3 bytes) 000299 1788917564.265688 mapwrite 0x022af7 thru 0x0257f0 (0x2cfa bytes) 000300 1788917564.282864 trunc from 0x0016d9 to 0x0032ea (0x1c12 bytes) 000301 1788917564.284885 mapread 0x0102e3 thru 0x012073 (0x1d91 bytes) 000302 1788917564.285595 read 0x01a9f9 thru 0x0257f0 (0xadf8 bytes) 000303 1788917564.287851 fallocate 0x03673c thru 0x03bae1 (0x53a6 bytes) 000304 1788917564.290145 mapread 0x00bc8b thru 0x018515 (0xc88b bytes) 000305 1788917564.293465 punch from 0x01f78a to 0x02cb6e (0xd3e5 bytes) 000306 1788917564.296993 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bae2): Mirror 4: 0xffc0c89a (stale) Mirror 5: 0xffc0c89a (stale) Mirror 6: 0xffc0c89a (stale) Mirror 7: 0xffc0c89a (stale) Mirror 8: 0xffc0c89a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bae2): Mirror 4: 0xffc0c89a (stale) Mirror 5: 0xffc0c89a (stale) Mirror 6: 0xffc0c89a (stale) Mirror 7: 0xffc0c89a (stale) Mirror 8: 0xffc0c89a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bae2: skipped 000307 1788917564.431151 mapwrite 0x03b683 thru 0x03ffff (0x497d bytes) 000308 1788917564.449309 write 0x034113 thru 0x034280 (0x16e bytes) 000309 1788917564.451656 read 0x00e3d5 thru 0x00f4d1 (0x10fd bytes) 000310 1788917564.453967 fallocate 0x00b606 thru 0x00eab2 (0x34ad bytes) 000311 1788917564.456315 read 0x03f0ba thru 0x03ffff (0xf46 bytes) 000313 1788917564.457311 fallocate 0x01e7a8 thru 0x029874 (0xb0cd bytes) 000314 1788917564.461004 MIRROR_RESYNC 6 mirrors 000316 1788917565.048651 MIRROR_RESYNC 6 mirrors 000317 1788917565.223070 trunc from 0x024f7a to 0x026676 (0x16fd bytes) 000319 1788917565.234446 read 0x01e848 thru 0x024a8e (0x6247 bytes) 000320 1788917565.237126 punch from 0x02e9df to 0x034d51 (0x6373 bytes) 000321 1788917565.238891 write 0x00b5a6 thru 0x0174dc (0xbf37 bytes) 000322 1788917565.242601 trunc from 0x040000 to 0x01addf (0x25220 bytes) 000323 1788917565.253781 mapwrite 0x000da7 thru 0x00dca5 (0xceff bytes) 000324 1788917565.271597 read 0x00670e thru 0x00d417 (0x6d0a bytes) 000325 1788917565.272196 punch from 0x00a0a5 to 0x00aaff (0xa5b bytes) 000327 1788917565.274893 mapwrite 0x02ae61 thru 0x037c2d (0xcdcd bytes) 000328 1788917565.293030 mapwrite 0x001fb0 thru 0x00e8ae (0xc8ff bytes) 000329 1788917565.302165 punch from 0x021370 to 0x021736 (0x3c7 bytes) 000330 1788917565.304051 trunc from 0x037c2e to 0x027a90 (0x1019d bytes) 000331 1788917565.308917 write 0x01785d thru 0x0205ed (0x8d91 bytes) 000332 1788917565.309901 punch from 0x0259e4 to 0x027a90 (0x20ad bytes) 000333 1788917565.311532 trunc from 0x027a91 to 0x01ecd7 (0x8db9 bytes) 000335 1788917565.317613 punch from 0x00321b to 0x00bc03 (0x89e9 bytes) 000336 1788917565.321177 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1ecd8): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ecd8): Mirror 4: 0x83c4adc2 (stale) Mirror 5: 0x83c4adc2 (stale) Mirror 6: 0x83c4adc2 (stale) Mirror 7: 0x83c4adc2 (stale) Mirror 8: 0x83c4adc2 (stale) CRC-32 checksum value for chunk [0, 0x1ecd8): Mirror 1: 0xa0b7f26d Mirror 9: 0xa0b7f26d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ecd8: skipped 000338 1788917565.611533 mapwrite 0x03bb0c thru 0x03c7cd (0xcc2 bytes) 000339 1788917565.643880 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c7ce): Mirror 4: 0x7ec735f5 (stale) Mirror 5: 0x7ec735f5 (stale) Mirror 7: 0x7ec735f5 (stale) Mirror 8: 0x7ec735f5 (stale) Mirror 9: 0x4f0d1fba (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c7ce): Mirror 4: 0x7ec735f5 (stale) Mirror 5: 0x7ec735f5 (stale) Mirror 7: 0x7ec735f5 (stale) Mirror 8: 0x7ec735f5 (stale) Mirror 9: 0x4f0d1fba (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c7ce: skipped 000340 1788917565.771155 read 0x03b8f2 thru 0x03c7cd (0xedc bytes) 000341 1788917565.773066 read 0x03427e thru 0x03c7cd (0x8550 bytes) 000342 1788917565.776833 write 0x02eada thru 0x03cb60 (0xe087 bytes) 000343 1788917565.779168 mapread 0x016ee1 thru 0x024a8a (0xdbaa bytes) 000344 1788917565.781800 MIRROR_RESYNC 6 mirrors 000345 1788917566.192764 mapread 0x00b9bf thru 0x013318 (0x795a bytes) 000346 1788917566.198507 punch from 0x01c804 to 0x022a1a (0x6217 bytes) 000347 1788917566.207681 punch from 0x0184e7 to 0x026278 (0xdd92 bytes) 000348 1788917566.209317 mapread 0x02dac9 thru 0x033861 (0x5d99 bytes) 000349 1788917566.212135 mapwrite 0x00607b thru 0x015c5a (0xfbe0 bytes) 000351 1788917566.224968 trunc from 0x03cb61 to 0x006ef7 (0x35c69 bytes) 000352 1788917566.232510 fallocate 0x020fdc thru 0x02403a (0x305f bytes) 000353 1788917566.235289 mapwrite 0x02bdd8 thru 0x034e7f (0x90a8 bytes) 000354 1788917566.255001 read 0x016aa7 thru 0x01b53d (0x4a97 bytes) 000356 1788917566.258766 punch from 0x01a542 to 0x01c607 (0x20c6 bytes) 000357 1788917566.260809 punch from 0x028009 to 0x02d4e2 (0x54da bytes) 000358 1788917566.263054 read 0x03312f thru 0x034e7f (0x1d51 bytes) 000359 1788917566.266859 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34e80): Mirror 4: 0x301943b3 (stale) Mirror 7: 0x301943b3 (stale) Mirror 8: 0x301943b3 (stale) Mirror 9: 0x301943b3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34e80): Mirror 4: 0x301943b3 (stale) Mirror 7: 0x301943b3 (stale) Mirror 8: 0x301943b3 (stale) Mirror 9: 0x301943b3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34e80: skipped 000360 1788917566.423489 mapread 0x012c5a thru 0x01729d (0x4644 bytes) 000361 1788917566.429677 fallocate 0x02d9ae thru 0x0356fc (0x7d4f bytes) 000362 1788917566.433320 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x34e80): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34e80): Mirror 4: 0x301943b3 (stale) Mirror 7: 0x301943b3 (stale) Mirror 8: 0x301943b3 (stale) Mirror 9: 0x301943b3 (stale) CRC-32 checksum value for chunk [0, 0x34e80): Mirror 1: 0x5123d9af Mirror 10: 0x5123d9af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34e80: skipped 000363 1788917566.712654 write 0x0175ee thru 0x019c8d (0x26a0 bytes) 000364 1788917566.730209 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34e80): Mirror 4: 0x301943b3 (stale) Mirror 7: 0x301943b3 (stale) Mirror 8: 0x301943b3 (stale) Mirror 9: 0x301943b3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34e80): Mirror 4: 0x301943b3 (stale) Mirror 7: 0x301943b3 (stale) Mirror 8: 0x301943b3 (stale) Mirror 9: 0x301943b3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34e80: skipped 000365 1788917566.860633 trunc from 0x034e80 to 0x0114e3 (0x2399c bytes) 000366 1788917566.870613 trunc from 0x0114e4 to 0x033d61 (0x2287e bytes) 000368 1788917566.875516 punch from 0x00e010 to 0x015913 (0x7904 bytes) 000369 1788917566.877071 trunc from 0x000786 to 0x0090ca (0x8945 bytes) 000370 1788917566.878989 punch from 0x0156dc to 0x0206ce (0xaff3 bytes) 000371 1788917566.880788 trunc from 0x00ccbf to 0x01562c (0x896e bytes) 000372 1788917566.882747 mapwrite 0x00306b thru 0x004abd (0x1a53 bytes) 000373 1788917566.891313 fallocate 0x028120 thru 0x0283a2 (0x283 bytes) 000374 1788917566.893599 mapread 0x021b5b thru 0x0311c3 (0xf669 bytes) 000375 1788917566.901000 read 0x01f64b thru 0x028224 (0x8bda bytes) 000376 1788917566.901575 punch from 0x02a9b9 to 0x030df0 (0x6438 bytes) 000377 1788917566.903473 punch from 0x00c45a to 0x014a5c (0x8603 bytes) 000378 1788917566.905072 punch from 0x009654 to 0x00e1f4 (0x4ba1 bytes) 000379 1788917566.906754 read 0x010469 thru 0x01a364 (0x9efc bytes) 000380 1788917566.910771 fallocate 0x036f04 thru 0x03ffff (0x90fc bytes) 000381 1788917566.913405 trunc from 0x013ba4 to 0x0153db (0x1838 bytes) 000382 1788917566.916016 trunc from 0x033ae3 to 0x033d61 (0x27f bytes) 000383 1788917566.918010 read 0x01975e thru 0x02975c (0xffff bytes) 000384 1788917566.918534 mapwrite 0x01e411 thru 0x01f824 (0x1414 bytes) 000385 1788917566.923792 mapread 0x02372b thru 0x02c252 (0x8b28 bytes) 000386 1788917566.924825 read 0x006ba2 thru 0x013a36 (0xce95 bytes) 000387 1788917566.928553 trunc from 0x007e4d to 0x015089 (0xd23d bytes) 000388 1788917566.930669 trunc from 0x0127fd to 0x01aa1a (0x821e bytes) 000389 1788917566.932280 write 0x021589 thru 0x02f1c1 (0xdc39 bytes) 000390 1788917566.933256 fallocate 0x02925b thru 0x0326b0 (0x9456 bytes) 000391 1788917566.935160 fallocate 0x01ff26 thru 0x02f59a (0xf675 bytes) 000392 1788917566.937230 mapwrite 0x03e7bc thru 0x03ffff (0x1844 bytes) 000393 1788917566.951600 mapwrite 0x02bdf8 thru 0x02efd2 (0x31db bytes) 000394 1788917566.958158 mapwrite 0x00098e thru 0x003e9d (0x3510 bytes) 000395 1788917566.965207 read 0x037a24 thru 0x039cc0 (0x229d bytes) 000396 1788917566.965768 trunc from 0x03a1dc to 0x03ffff (0x5e24 bytes) 000397 1788917566.968003 punch from 0x0141bc to 0x01b433 (0x7278 bytes) 000398 1788917566.970002 fallocate 0x028986 thru 0x0321f2 (0x986d bytes) 000399 1788917566.972437 mapread 0x02a269 thru 0x030802 (0x659a bytes) 000400 1788917566.973471 read 0x014300 thru 0x017be4 (0x38e5 bytes) 000401 1788917566.977507 trunc from 0x040000 to 0x039b07 (0x64f8 bytes) 000402 1788917566.983049 mapwrite 0x00120a thru 0x00d6bd (0xc4b4 bytes) 000403 1788917566.992151 mapwrite 0x03e317 thru 0x03ffff (0x1ce9 bytes) 000404 1788917567.003826 read 0x024962 thru 0x02efe7 (0xa686 bytes) 000405 1788917567.004419 trunc from 0x0308e0 to 0x03f868 (0xef89 bytes) 000406 1788917567.006689 mapread 0x03b19f thru 0x03f35b (0x41bd bytes) 000407 1788917567.010320 read 0x014c89 thru 0x01d010 (0x8388 bytes) 000408 1788917567.011032 trunc from 0x022314 to 0x030be6 (0xe8d3 bytes) 000409 1788917567.013440 trunc from 0x00785f to 0x0133e0 (0xbb82 bytes) 000410 1788917567.015436 mapread 0x01ac8c thru 0x01ec74 (0x3fe9 bytes) 000411 1788917567.016146 read 0x009302 thru 0x018c85 (0xf984 bytes) 000413 1788917567.019548 mapread 0x0384b2 thru 0x03ffff (0x7b4e bytes) 000414 1788917567.020298 punch from 0x020abb to 0x024d74 (0x42ba bytes) 000415 1788917567.022028 mapwrite 0x03eff3 thru 0x03ffff (0x100d bytes) 000416 1788917567.029140 MIRROR_RESYNC 5 mirrors 000418 1788917567.388406 fallocate 0x00b32f thru 0x00b4fb (0x1cd bytes) 000419 1788917567.400819 read 0x01ae96 thru 0x02895f (0xdaca bytes) 000421 1788917567.405063 trunc from 0x040000 to 0x015bc7 (0x2a438 bytes) 000422 1788917567.419009 write 0x000428 thru 0x0072f1 (0x6eca bytes) 000423 1788917567.423269 mapread 0x0134f4 thru 0x015bc7 (0x26d4 bytes) 000424 1788917567.430658 punch from 0x013a14 to 0x0155ba (0x1ba7 bytes) 000425 1788917567.433074 mapwrite 0x00655e thru 0x010f3b (0xa9de bytes) 000426 1788917567.443968 trunc from 0x015bc8 to 0x03a7c2 (0x24bfb bytes) 000427 1788917567.448939 trunc from 0x03a7c3 to 0x035832 (0x4f90 bytes) 000428 1788917567.453699 mapread 0x0254f3 thru 0x02b65c (0x616a bytes) 000429 1788917567.457631 mapwrite 0x004e9f thru 0x010a39 (0xbb9b bytes) 000430 1788917567.467553 mapwrite 0x0314a7 thru 0x03a968 (0x94c2 bytes) 000431 1788917567.485633 trunc from 0x01ca5d to 0x0292a3 (0xc847 bytes) 000433 1788917567.488469 mapwrite 0x00c4fa thru 0x01bd49 (0xf850 bytes) 000434 1788917567.503054 fallocate 0x0198c7 thru 0x020b61 (0x729b bytes) 000435 1788917567.505737 trunc from 0x033c6a to 0x03a968 (0x6cff bytes) 000436 1788917567.508313 mapwrite 0x02932c thru 0x02ce35 (0x3b0a bytes) 000437 1788917567.520515 MIRROR_RESYNC 5 mirrors 000438 1788917567.946307 fallocate 0x024c77 thru 0x02d9df (0x8d69 bytes) 000439 1788917567.958507 punch from 0x00db64 to 0x010e7f (0x331c bytes) 000440 1788917567.961062 trunc from 0x03a969 to 0x027105 (0x13863 bytes) 000441 1788917567.973529 trunc from 0x027106 to 0x01c514 (0xabf1 bytes) 000442 1788917567.983171 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c515): Mirror 4: 0x4ec7f844 (stale) Mirror 8: 0x4ec7f844 (stale) Mirror 9: 0x4ec7f844 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c515): Mirror 4: 0x4ec7f844 (stale) Mirror 8: 0x4ec7f844 (stale) Mirror 9: 0x4ec7f844 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c515: skipped 000443 1788917568.098653 fallocate 0x01626f thru 0x01c1cd (0x5f5f bytes) 000444 1788917568.101450 fallocate 0x00e412 thru 0x0183c0 (0x9faf bytes) 000445 1788917568.104230 punch from 0x00cb9c to 0x017ae7 (0xaf4c bytes) 000446 1788917568.106825 trunc from 0x0137e8 to 0x0188bc (0x50d5 bytes) 000447 1788917568.109291 fallocate 0x0112ea thru 0x01c8f0 (0xb607 bytes) 000448 1788917568.112041 trunc from 0x01c8f1 to 0x016668 (0x6288 bytes) 000449 1788917568.119766 mapwrite 0x01c4ac thru 0x024272 (0x7dc7 bytes) 000450 1788917568.145088 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x24273): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24273): Mirror 4: 0xe0302a5a (stale) Mirror 8: 0xe0302a5a (stale) Mirror 9: 0xe0302a5a (stale) CRC-32 checksum value for chunk [0, 0x24273): Mirror 1: 0xded76825 Mirror 10: 0xded76825 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24273: skipped 000451 1788917568.468931 punch from 0x001eef to 0x0087e2 (0x68f4 bytes) 000452 1788917568.482614 read 0x003e09 thru 0x004ee9 (0x10e1 bytes) 000454 1788917568.486241 write 0x03849c thru 0x03dc02 (0x5767 bytes) 000455 1788917568.491235 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dc03): Mirror 4: 0x7db9dbea (stale) Mirror 8: 0x7db9dbea (stale) Mirror 9: 0x7db9dbea (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc03): Mirror 4: 0x7db9dbea (stale) Mirror 8: 0x7db9dbea (stale) Mirror 9: 0x7db9dbea (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc03: skipped 000457 1788917568.633812 read 0x020595 thru 0x029c49 (0x96b5 bytes) 000458 1788917568.637747 write 0x027591 thru 0x027ea7 (0x917 bytes) 000459 1788917568.641925 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dc03): Mirror 8: 0x7db9dbea (stale) Mirror 9: 0x7db9dbea (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc03): Mirror 8: 0x7db9dbea (stale) Mirror 9: 0x7db9dbea (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc03: skipped 000460 1788917568.752761 mapread 0x03d815 thru 0x03dc02 (0x3ee bytes) 000461 1788917568.755915 fallocate 0x006acf thru 0x013f18 (0xd44a bytes) 000462 1788917568.758582 mapwrite 0x02c11a thru 0x03249e (0x6385 bytes) 000463 1788917568.771727 mapread 0x02a5f0 thru 0x035631 (0xb042 bytes) 000464 1788917568.772853 write 0x01cf8d thru 0x01db14 (0xb88 bytes) 000465 1788917568.780844 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3dc03): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc03): Mirror 8: 0x7db9dbea (stale) Mirror 9: 0x7db9dbea (stale) CRC-32 checksum value for chunk [0, 0x3dc03): Mirror 1: 0xec5069c5 Mirror 10: 0xec5069c5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc03: skipped 000466 1788917569.077064 mapread 0x0100e2 thru 0x01fd2d (0xfc4c bytes) 000467 1788917569.088152 fallocate 0x02873e thru 0x033dd4 (0xb697 bytes) 000468 1788917569.100449 trunc from 0x004001 to 0x013bb2 (0xfbb2 bytes) 000469 1788917569.102645 mapwrite 0x02dd4d thru 0x03910d (0xb3c1 bytes) 000470 1788917569.115126 mapwrite 0x02a9dd thru 0x0391ba (0xe7de bytes) 000471 1788917569.125216 punch from 0x015770 to 0x01fa50 (0xa2e1 bytes) 000472 1788917569.127306 write 0x00a50a thru 0x018848 (0xe33f bytes) 000474 1788917569.133228 trunc from 0x0061b8 to 0x0106a6 (0xa4ef bytes) 000477 1788917569.139737 mapwrite 0x009e16 thru 0x00a4d4 (0x6bf bytes) 000478 1788917569.147949 mapread 0x02941e thru 0x02a1f5 (0xdd8 bytes) 000479 1788917569.149330 mapwrite 0x02a608 thru 0x02c2d2 (0x1ccb bytes) 000480 1788917569.154316 punch from 0x01254e to 0x0139e5 (0x1498 bytes) 000481 1788917569.156453 trunc from 0x03dc03 to 0x016bed (0x27015 bytes) 000482 1788917569.170259 fallocate 0x00db1d thru 0x016d23 (0x9207 bytes) 000483 1788917569.174876 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x16d24): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16d24): Mirror 8: 0xb6f21682 (stale) Mirror 9: 0xb6f21682 (stale) Mirror 10: 0xb0f7cab8 (stale) CRC-32 checksum value for chunk [0, 0x16d24): Mirror 1: 0x7d08eb52 Mirror 11: 0x7d08eb52 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16d24: skipped 000484 1788917569.467210 mapread 0x00c64e thru 0x010005 (0x39b8 bytes) 000485 1788917569.479458 mapread 0x012b56 thru 0x016d23 (0x41ce bytes) 000486 1788917569.484683 trunc from 0x016d24 to 0x0237f0 (0xcacd bytes) 000487 1788917569.506150 punch from 0x018be1 to 0x01c3cd (0x37ed bytes) 000488 1788917569.508538 punch from 0x01f4fc to 0x0237f0 (0x42f5 bytes) 000489 1788917569.512108 MIRROR_RESYNC 5 mirrors 000490 1788917569.979872 write 0x034a4b thru 0x03d797 (0x8d4d bytes) 000491 1788917569.990061 MIRROR_RESYNC 5 mirrors 000492 1788917570.361616 read 0x03bd93 thru 0x03d797 (0x1a05 bytes) 000493 1788917570.363835 punch from 0x0214f2 to 0x030135 (0xec44 bytes) 000494 1788917570.372265 mapread 0x0096b2 thru 0x0152e7 (0xbc36 bytes) 000495 1788917570.379576 trunc from 0x03d798 to 0x03a5d7 (0x31c0 bytes) 000496 1788917570.384581 mapread 0x019096 thru 0x024f14 (0xbe7f bytes) 000497 1788917570.387950 mapwrite 0x0216d0 thru 0x029718 (0x8049 bytes) 000498 1788917570.396996 read 0x00ce40 thru 0x01cad2 (0xfc93 bytes) 000499 1788917570.397744 mapwrite 0x03c896 thru 0x03ffff (0x376a bytes) 000500 1788917570.408617 punch from 0x009f36 to 0x013315 (0x93e0 bytes) 000501 1788917570.410816 trunc from 0x040000 to 0x02143d (0x1ebc2 bytes) 000502 1788917570.415723 trunc from 0x000d37 to 0x00aa9d (0x9d67 bytes) 000503 1788917570.417746 fallocate 0x01a671 thru 0x02a2dc (0xfc6c bytes) 000504 1788917570.419392 write 0x022ea1 thru 0x02aafc (0x7c5c bytes) 000505 1788917570.420513 punch from 0x015b8e to 0x01d22b (0x769e bytes) 000506 1788917570.422166 trunc from 0x02aafd to 0x0322cb (0x77cf bytes) 000507 1788917570.426282 trunc from 0x02af08 to 0x0315f9 (0x66f2 bytes) 000508 1788917570.430282 trunc from 0x0322cc to 0x02d3da (0x4ef1 bytes) 000510 1788917570.436247 trunc from 0x00c77a to 0x015b89 (0x9410 bytes) 000511 1788917570.438798 mapread 0x024f3d thru 0x02d3da (0x849e bytes) 000513 1788917570.446563 trunc from 0x02d3db to 0x00d3ce (0x2000c bytes) 000514 1788917570.451917 punch from 0x002404 to 0x00d3ce (0xafcb bytes) 000515 1788917570.453863 write 0x03f8d4 thru 0x03ffff (0x72c bytes) 000516 1788917570.456844 MIRROR_RESYNC 5 mirrors 000517 1788917570.717988 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) 000518 1788917570.833992 trunc from 0x014c33 to 0x015a06 (0xdd4 bytes) 000519 1788917570.846567 trunc from 0x03fcf2 to 0x03ffff (0x30e bytes) 000521 1788917570.848975 mapread 0x0364f5 thru 0x036ba0 (0x6ac bytes) 000523 1788917570.852491 fallocate 0x01fa52 thru 0x02bc21 (0xc1d0 bytes) 000524 1788917570.856180 read 0x01befc thru 0x0226c3 (0x67c8 bytes) 000527 1788917570.861269 mapread 0x03e496 thru 0x03ffff (0x1b6a bytes) 000528 1788917570.869557 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9f25c626 (stale) Mirror 9: 0x9f25c626 (stale) Mirror 11: 0x9f25c626 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd4a53484 Mirror 12: 0xd4a53484 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000529 1788917571.143795 trunc from 0x00b431 to 0x0148ea (0x94ba bytes) 000530 1788917571.155380 trunc from 0x040000 to 0x00f487 (0x30b78 bytes) 000531 1788917571.168290 read 0x00bdd0 thru 0x00f487 (0x36b8 bytes) 000532 1788917571.171429 mapread 0x004256 thru 0x00527e (0x1029 bytes) 000535 1788917571.177452 write 0x00cca9 thru 0x01aaa6 (0xddfe bytes) 000537 1788917571.179299 punch from 0x019b0b to 0x01aaa6 (0xf9c bytes) 000538 1788917571.186192 read 0x00a9de thru 0x00fb9f (0x51c2 bytes) 000539 1788917571.190672 mapread 0x000bd6 thru 0x00a7fa (0x9c25 bytes) 000540 1788917571.191858 read 0x0170bd thru 0x0174b9 (0x3fd bytes) 000541 1788917571.192365 mapread 0x00d81f thru 0x015960 (0x8142 bytes) 000542 1788917571.193324 trunc from 0x00faa1 to 0x017069 (0x75c9 bytes) 000543 1788917571.196159 mapwrite 0x034816 thru 0x03f762 (0xaf4d bytes) 000544 1788917571.222322 fallocate 0x0214d5 thru 0x026c22 (0x574e bytes) 000545 1788917571.227230 MIRROR_RESYNC 5 mirrors 000546 1788917571.652408 punch from 0x02eda3 to 0x035202 (0x6460 bytes) 000547 1788917571.662437 mapwrite 0x008d09 thru 0x0124fa (0x97f2 bytes) 000548 1788917571.677402 trunc from 0x03f763 to 0x017be7 (0x27b7b bytes) 000549 1788917571.691741 mapread 0x011cd6 thru 0x0165e0 (0x490b bytes) 000551 1788917571.696541 fallocate 0x0049fd thru 0x00ca9d (0x80a1 bytes) 000552 1788917571.699305 trunc from 0x017be8 to 0x01c43f (0x4858 bytes) 000553 1788917571.705024 write 0x03785a thru 0x03aa0d (0x31b4 bytes) 000554 1788917571.708165 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3aa0e): Mirror 8: 0xffed292a (stale) Mirror 9: 0xffed292a (stale) Mirror 11: 0xffed292a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aa0e): Mirror 8: 0xffed292a (stale) Mirror 9: 0xffed292a (stale) Mirror 11: 0xffed292a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aa0e: skipped 000556 1788917571.836523 punch from 0x01fbe4 to 0x024304 (0x4721 bytes) 000558 1788917571.841456 trunc from 0x01c98e to 0x02313e (0x67b1 bytes) 000559 1788917571.847042 trunc from 0x03aa0e to 0x004787 (0x36286 bytes) 000560 1788917571.862670 fallocate 0x03f870 thru 0x03ffff (0x790 bytes) 000561 1788917571.865956 mapwrite 0x015cc6 thru 0x024f2a (0xf265 bytes) 000562 1788917571.905448 mapread 0x00f217 thru 0x015156 (0x5f40 bytes) 000563 1788917571.910807 punch from 0x01fde5 to 0x024f2a (0x5146 bytes) 000564 1788917571.913579 trunc from 0x024f2b to 0x02e7e4 (0x98ba bytes) 000565 1788917571.919719 mapread 0x01e3bb thru 0x0283d6 (0xa01c bytes) 000566 1788917571.931314 mapwrite 0x0336cf thru 0x0372cf (0x3c01 bytes) 000567 1788917571.947692 write 0x02cc5b thru 0x036044 (0x93ea bytes) 000568 1788917571.949214 trunc from 0x035031 to 0x0372cf (0x229f bytes) 000569 1788917571.955829 fallocate 0x013dc6 thru 0x01e7ab (0xa9e6 bytes) 000570 1788917571.958071 trunc from 0x003c97 to 0x0135f7 (0xf961 bytes) 000571 1788917571.960243 trunc from 0x0372d0 to 0x019fb0 (0x1d31f bytes) 000572 1788917571.968135 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x19fb1): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19fb1): Mirror 8: 0xae96cc26 (stale) Mirror 9: 0xae96cc26 (stale) Mirror 11: 0xae96cc26 (stale) CRC-32 checksum value for chunk [0, 0x19fb1): Mirror 1: 0x9fc789ec Mirror 12: 0x9fc789ec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19fb1: skipped 000573 1788917572.276216 mapread 0x0066cc thru 0x0104c5 (0x9dfa bytes) 000574 1788917572.298266 mapread 0x01844b thru 0x01885e (0x414 bytes) 000575 1788917572.309405 mapwrite 0x02b38a thru 0x030097 (0x4d0e bytes) 000576 1788917572.348952 mapwrite 0x03f041 thru 0x03ffff (0xfbf bytes) 000577 1788917572.369770 mapread 0x01cb25 thru 0x026ea7 (0xa383 bytes) 000579 1788917572.374802 trunc from 0x040000 to 0x001d07 (0x3e2f8 bytes) 000580 1788917572.381541 mapread 0x0009d7 thru 0x001d07 (0x1331 bytes) 000581 1788917572.384608 mapread 0x000027 thru 0x001d07 (0x1ce1 bytes) 000583 1788917572.386152 punch from 0x000873 to 0x000eae (0x63c bytes) 000584 1788917572.388706 read 0x001302 thru 0x001573 (0x272 bytes) 000585 1788917572.391467 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d08): Mirror 8: 0xfa1e21e8 (stale) Mirror 11: 0xfa1e21e8 (stale) Mirror 12: 0xfa1e21e8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d08): Mirror 8: 0xfa1e21e8 (stale) Mirror 11: 0xfa1e21e8 (stale) Mirror 12: 0xfa1e21e8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d08: skipped 000587 1788917572.505611 trunc from 0x001d08 to 0x0236a8 (0x219a1 bytes) 000588 1788917572.513115 mapread 0x00c198 thru 0x00f1d1 (0x303a bytes) 000589 1788917572.520474 mapwrite 0x00cc02 thru 0x017b76 (0xaf75 bytes) 000590 1788917572.534131 mapwrite 0x025e27 thru 0x032ac2 (0xcc9c bytes) 000591 1788917572.557815 mapread 0x01bd71 thru 0x028440 (0xc6d0 bytes) 000592 1788917572.559256 trunc from 0x0083b9 to 0x00acea (0x2932 bytes) 000593 1788917572.561902 trunc from 0x032ac3 to 0x02374f (0xf373 bytes) 000594 1788917572.567762 punch from 0x00a8f6 to 0x00b51a (0xc25 bytes) 000595 1788917572.570027 write 0x011aaf thru 0x013e0a (0x235c bytes) 000596 1788917572.570868 punch from 0x00d977 to 0x013a9b (0x6125 bytes) 000597 1788917572.575193 read 0x018649 thru 0x018a3f (0x3f7 bytes) 000599 1788917572.576288 read 0x0195c0 thru 0x01d60f (0x4050 bytes) 000600 1788917572.576805 trunc from 0x023750 to 0x036311 (0x12bc2 bytes) 000602 1788917572.584721 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x36312): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36312): Mirror 8: 0x8da94fab (stale) Mirror 11: 0x8da94fab (stale) Mirror 12: 0xec20f7ab (stale) CRC-32 checksum value for chunk [0, 0x36312): Mirror 1: 0x72eaf794 Mirror 13: 0x72eaf794 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36312: skipped 000603 1788917572.952027 trunc from 0x0026d7 to 0x00b201 (0x8b2b bytes) 000604 1788917572.964556 trunc from 0x034d72 to 0x034f4d (0x1dc bytes) 000605 1788917572.966616 trunc from 0x036312 to 0x02a823 (0xbaee bytes) 000606 1788917572.973944 trunc from 0x02a824 to 0x011fd0 (0x18853 bytes) 000607 1788917572.979009 fallocate 0x01c668 thru 0x01fb67 (0x3500 bytes) 000608 1788917572.981279 mapread 0x002a46 thru 0x002b18 (0xd3 bytes) 000609 1788917572.984153 trunc from 0x011fd1 to 0x03e337 (0x2c367 bytes) 000610 1788917572.990140 fallocate 0x010091 thru 0x015203 (0x5173 bytes) 000611 1788917572.992779 mapwrite 0x026864 thru 0x02f194 (0x8931 bytes) 000612 1788917573.005507 trunc from 0x0376bf to 0x03a7bf (0x3101 bytes) 000613 1788917573.007935 trunc from 0x01ae9b to 0x02953d (0xe6a3 bytes) 000616 1788917573.011506 read 0x029778 thru 0x033905 (0xa18e bytes) 000617 1788917573.015410 fallocate 0x03ef43 thru 0x03ffff (0x10bd bytes) 000618 1788917573.017853 write 0x0153b3 thru 0x01a7cc (0x541a bytes) 000619 1788917573.022213 fallocate 0x00ae5e thru 0x0114d7 (0x667a bytes) 000620 1788917573.024925 read 0x00a38c thru 0x00c769 (0x23de bytes) 000621 1788917573.031812 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e338): Mirror 11: 0x80d45b58 (stale) Mirror 12: 0x582bec26 (stale) Mirror 13: 0x15e6b9c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e338): Mirror 11: 0x80d45b58 (stale) Mirror 12: 0x582bec26 (stale) Mirror 13: 0x15e6b9c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e338: skipped 000622 1788917573.153872 mapwrite 0x013587 thru 0x0159b9 (0x2433 bytes) 000623 1788917573.170009 MIRROR_RESYNC 4 mirrors 000624 1788917573.548771 write 0x01fbd2 thru 0x024b83 (0x4fb2 bytes) 000625 1788917573.562996 write 0x01c006 thru 0x01d79d (0x1798 bytes) 000626 1788917573.566742 read 0x011b3e thru 0x01cde0 (0xb2a3 bytes) 000627 1788917573.569986 mapwrite 0x02eff9 thru 0x0397cf (0xa7d7 bytes) 000628 1788917573.589537 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e338): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e338): Mirror 11: 0x8ff5f0d1 (stale) Mirror 12: 0x8ff5f0d1 (stale) Mirror 13: 0x8ff5f0d1 (stale) CRC-32 checksum value for chunk [0, 0x3e338): Mirror 1: 0x2fce6076 Mirror 14: 0x2fce6076 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e338: skipped 000629 1788917573.916596 punch from 0x03bc6a to 0x03e337 (0x26ce bytes) 000630 1788917573.928509 fallocate 0x03718c thru 0x03bbb4 (0x4a29 bytes) 000631 1788917573.930790 fallocate 0x00ee1e thru 0x01dad2 (0xecb5 bytes) 000632 1788917573.932661 punch from 0x003c26 to 0x008ef8 (0x52d3 bytes) 000633 1788917573.934548 write 0x03a451 thru 0x03d290 (0x2e40 bytes) 000634 1788917573.940845 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e338): Mirror 12: 0x8ff5f0d1 (stale) Mirror 13: 0x8ff5f0d1 (stale) Mirror 14: 0x2fce6076 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e338): Mirror 12: 0x8ff5f0d1 (stale) Mirror 13: 0x8ff5f0d1 (stale) Mirror 14: 0x2fce6076 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e338: skipped 000635 1788917574.058594 mapwrite 0x03b955 thru 0x03ffff (0x46ab bytes) 000636 1788917574.080888 read 0x019cb9 thru 0x026c1e (0xcf66 bytes) 000637 1788917574.084910 mapread 0x01c32d thru 0x01fd89 (0x3a5d bytes) 000638 1788917574.087831 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xd9659f74 (stale) Mirror 13: 0xd9659f74 (stale) Mirror 14: 0x7d5803ef (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3c963af1 Mirror 15: 0x3c963af1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000640 1788917574.373463 mapread 0x0369c2 thru 0x03ae98 (0x44d7 bytes) 000641 1788917574.384762 write 0x03c388 thru 0x03ffff (0x3c78 bytes) 000642 1788917574.399926 trunc from 0x040000 to 0x01490b (0x2b6f4 bytes) 000643 1788917574.412486 mapread 0x00a191 thru 0x01490b (0xa77b bytes) 000644 1788917574.418023 punch from 0x012d90 to 0x01490b (0x1b7c bytes) 000645 1788917574.420404 mapread 0x00f719 thru 0x012563 (0x2e4b bytes) 000647 1788917574.423232 trunc from 0x01490c to 0x01df5d (0x9652 bytes) 000648 1788917574.427906 mapread 0x01df59 thru 0x01df5d (0x5 bytes) 000649 1788917574.431164 write 0x010812 thru 0x01bd49 (0xb538 bytes) 000650 1788917574.432024 trunc from 0x01df5e to 0x00526d (0x18cf0 bytes) 000651 1788917574.436798 fallocate 0x033327 thru 0x036695 (0x336f bytes) 000652 1788917574.439206 mapread 0x0036c4 thru 0x00526d (0x1baa bytes) 000653 1788917574.440239 write 0x0242a6 thru 0x02e872 (0xa5cd bytes) 000654 1788917574.441414 punch from 0x027d6e to 0x02af8a (0x321d bytes) 000655 1788917574.446123 fallocate 0x02eae7 thru 0x035f63 (0x747d bytes) 000656 1788917574.449467 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x35f64): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35f64): Mirror 12: 0x9e27bc8f (stale) Mirror 13: 0x9e27bc8f (stale) Mirror 14: 0x916a8ad2 (stale) Mirror 15: 0x916a8ad2 (stale) CRC-32 checksum value for chunk [0, 0x35f64): Mirror 1: 0xc10a8c6b Mirror 16: 0xc10a8c6b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35f64: skipped 000657 1788917574.708835 mapwrite 0x00fe93 thru 0x01d446 (0xd5b4 bytes) 000658 1788917574.752475 punch from 0x00fda3 to 0x017b7f (0x7ddd bytes) 000659 1788917574.756190 MIRROR_RESYNC 6 mirrors 000660 1788917575.286207 read 0x026763 thru 0x02d5a9 (0x6e47 bytes) 000661 1788917575.289024 trunc from 0x035f64 to 0x01f74a (0x16819 bytes) 000662 1788917575.299280 punch from 0x0123a6 to 0x01f74a (0xd3a5 bytes) 000663 1788917575.301177 trunc from 0x01d5b9 to 0x01e958 (0x13a0 bytes) 000664 1788917575.302946 mapwrite 0x005279 thru 0x00a821 (0x55a9 bytes) 000666 1788917575.315031 trunc from 0x01f74b to 0x031113 (0x119c9 bytes) 000667 1788917575.321673 write 0x00b8a6 thru 0x013950 (0x80ab bytes) 000668 1788917575.324751 trunc from 0x02add5 to 0x031113 (0x633f bytes) 000669 1788917575.327170 read 0x0176d3 thru 0x01e2c5 (0x6bf3 bytes) 000670 1788917575.333732 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x31114): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31114): Mirror 12: 0xd34a65a3 (stale) Mirror 13: 0xd34a65a3 (stale) Mirror 14: 0xd34a65a3 (stale) Mirror 15: 0xd34a65a3 (stale) Mirror 16: 0xd34a65a3 (stale) CRC-32 checksum value for chunk [0, 0x31114): Mirror 1: 0x91292bd9 Mirror 17: 0x91292bd9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31114: skipped 000671 1788917575.636499 trunc from 0x01338a to 0x01c90c (0x9583 bytes) 000672 1788917575.649664 trunc from 0x015959 to 0x0238e8 (0xdf90 bytes) 000673 1788917575.653631 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31114): Mirror 12: 0xd34a65a3 (stale) Mirror 13: 0xd34a65a3 (stale) Mirror 14: 0xd34a65a3 (stale) Mirror 15: 0xd34a65a3 (stale) Mirror 17: 0x91292bd9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31114): Mirror 12: 0xd34a65a3 (stale) Mirror 13: 0xd34a65a3 (stale) Mirror 14: 0xd34a65a3 (stale) Mirror 15: 0xd34a65a3 (stale) Mirror 17: 0x91292bd9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31114: skipped 000674 1788917575.790758 write 0x0216d1 thru 0x022ff2 (0x1922 bytes) 000675 1788917575.795652 punch from 0x00d36c to 0x011cb0 (0x4945 bytes) 000676 1788917575.798014 mapread 0x011589 thru 0x01e6d7 (0xd14f bytes) 000677 1788917575.809162 write 0x017f34 thru 0x01b48c (0x3559 bytes) 000678 1788917575.810209 write 0x0284e9 thru 0x035fb6 (0xdace bytes) 000679 1788917575.813551 write 0x00809e thru 0x00ac09 (0x2b6c bytes) 000680 1788917575.817443 trunc from 0x035fb7 to 0x026174 (0xfe42 bytes) 000681 1788917575.829389 punch from 0x00a0df to 0x00b195 (0x10b7 bytes) 000682 1788917575.837108 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x26175): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26175): Mirror 12: 0x37aea8d0 (stale) Mirror 13: 0x37aea8d0 (stale) Mirror 14: 0x37aea8d0 (stale) Mirror 15: 0x37aea8d0 (stale) Mirror 17: 0xc534fb46 (stale) CRC-32 checksum value for chunk [0, 0x26175): Mirror 1: 0xa0e27346 Mirror 18: 0xa0e27346 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26175: skipped 000683 1788917576.167943 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26175): Mirror 12: 0x37aea8d0 (stale) Mirror 13: 0x37aea8d0 (stale) Mirror 15: 0x37aea8d0 (stale) Mirror 17: 0xc534fb46 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26175): Mirror 12: 0x37aea8d0 (stale) Mirror 13: 0x37aea8d0 (stale) Mirror 15: 0x37aea8d0 (stale) Mirror 17: 0xc534fb46 (stale) CRC-32 checksum value for chunk [0, 0x26175): Mirror 1: 0xa0e27346 Mirror 18: 0xa0e27346 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26175: skipped 000684 1788917576.429403 trunc from 0x026175 to 0x03a2e5 (0x14171 bytes) 000685 1788917576.449586 trunc from 0x03a2e6 to 0x03a780 (0x49b bytes) 000686 1788917576.456276 fallocate 0x022730 thru 0x02b38f (0x8c60 bytes) 000687 1788917576.458682 punch from 0x01659f to 0x02085a (0xa2bc bytes) 000688 1788917576.461014 mapread 0x000e39 thru 0x00c4a9 (0xb671 bytes) 000689 1788917576.469701 write 0x0321e0 thru 0x033827 (0x1648 bytes) 000693 1788917576.474464 trunc from 0x03a781 to 0x01a710 (0x20070 bytes) 000695 1788917576.480016 mapwrite 0x00c056 thru 0x01ad7b (0xed26 bytes) 000696 1788917576.499184 trunc from 0x01ad7c to 0x007692 (0x136e9 bytes) 000697 1788917576.504998 trunc from 0x007693 to 0x006bce (0xac4 bytes) 000698 1788917576.512222 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6bcf): Mirror 13: 0x8d53f7e8 (stale) Mirror 15: 0x8d53f7e8 (stale) Mirror 17: 0x89cbb519 (stale) Mirror 18: 0x89cbb519 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6bcf): Mirror 13: 0x8d53f7e8 (stale) Mirror 15: 0x8d53f7e8 (stale) Mirror 17: 0x89cbb519 (stale) Mirror 18: 0x89cbb519 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6bcf: skipped 000699 1788917576.612172 read 0x0065d4 thru 0x006bce (0x5fb bytes) 000700 1788917576.614087 mapwrite 0x03637c thru 0x039e4e (0x3ad3 bytes) 000701 1788917576.630915 read 0x0225de thru 0x02fe43 (0xd866 bytes) 000702 1788917576.635058 write 0x03bdbb thru 0x03ffff (0x4245 bytes) 000703 1788917576.635997 punch from 0x03090a to 0x03f6cb (0xedc2 bytes) 000704 1788917576.642732 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xd85e412c (stale) Mirror 15: 0xd85e412c (stale) Mirror 17: 0x65ebbafe (stale) Mirror 18: 0x6c7ae5ee (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xadc07952 Mirror 19: 0xadc07952 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000705 1788917576.895515 trunc from 0x0264bd to 0x02ccdd (0x6821 bytes) 000706 1788917576.904857 trunc from 0x040000 to 0x03dd2b (0x22d4 bytes) 000707 1788917576.916079 mapwrite 0x00484e thru 0x0147f5 (0xffa8 bytes) 000708 1788917576.933345 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dd2c): Mirror 13: 0x3fe7ea7e (stale) Mirror 15: 0x3fe7ea7e (stale) Mirror 17: 0xdb2d4b32 (stale) Mirror 18: 0x23480678 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd2c): Mirror 13: 0x3fe7ea7e (stale) Mirror 15: 0x3fe7ea7e (stale) Mirror 17: 0xdb2d4b32 (stale) Mirror 18: 0x23480678 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd2c: skipped 000709 1788917577.046788 trunc from 0x03dd2c to 0x005864 (0x384c7 bytes) 000710 1788917577.052298 write 0x02401d thru 0x02877e (0x4762 bytes) 000711 1788917577.053099 write 0x035791 thru 0x03bca6 (0x6516 bytes) 000713 1788917577.054244 fallocate 0x01dc66 thru 0x02227b (0x4616 bytes) 000714 1788917577.056238 trunc from 0x03bca7 to 0x00d229 (0x2ea7d bytes) 000715 1788917577.061181 mapread 0x006363 thru 0x00d229 (0x6ec7 bytes) 000716 1788917577.067167 write 0x0022e2 thru 0x011ab4 (0xf7d3 bytes) 000718 1788917577.068926 mapread 0x0057e2 thru 0x006afa (0x1319 bytes) 000719 1788917577.069547 punch from 0x00b2b9 to 0x011ab4 (0x67fc bytes) 000720 1788917577.074217 trunc from 0x011ab5 to 0x00d418 (0x469c bytes) 000721 1788917577.078693 trunc from 0x00d419 to 0x011ae1 (0x46c9 bytes) 000722 1788917577.082857 mapwrite 0x012359 thru 0x016ce1 (0x4989 bytes) 000723 1788917577.096124 punch from 0x0129bd to 0x016ce1 (0x4325 bytes) 000724 1788917577.098189 read 0x005aae thru 0x015729 (0xfc7c bytes) 000726 1788917577.101106 trunc from 0x016ce2 to 0x00fc2a (0x70b7 bytes) 000727 1788917577.105552 write 0x0215b6 thru 0x029dfe (0x8849 bytes) 000728 1788917577.106542 mapwrite 0x022e94 thru 0x032db4 (0xff21 bytes) 000729 1788917577.122244 mapwrite 0x029a6e thru 0x036bed (0xd180 bytes) 000730 1788917577.136792 trunc from 0x036bee to 0x020b87 (0x16066 bytes) 000731 1788917577.142102 write 0x02967a thru 0x02c20e (0x2b95 bytes) 000732 1788917577.143207 write 0x02ec3f thru 0x0337f4 (0x4bb6 bytes) 000733 1788917577.144255 mapwrite 0x009c2b thru 0x00f797 (0x5b6d bytes) 000735 1788917577.151873 mapread 0x0082f8 thru 0x012e36 (0xab3f bytes) 000736 1788917577.155319 fallocate 0x028241 thru 0x02920c (0xfcc bytes) 000738 1788917577.157892 write 0x027471 thru 0x035103 (0xdc93 bytes) 000739 1788917577.160235 mapread 0x027473 thru 0x02a0ec (0x2c7a bytes) 000740 1788917577.162807 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x35104): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35104): Mirror 13: 0xbed164e9 (stale) Mirror 15: 0xbed164e9 (stale) Mirror 17: 0x5a8c2f87 (stale) Mirror 18: 0x4d725c87 (stale) CRC-32 checksum value for chunk [0, 0x35104): Mirror 1: 0x62845904 Mirror 19: 0x62845904 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35104: skipped 000741 1788917577.408897 fallocate 0x03d265 thru 0x03ffff (0x2d9b bytes) 000742 1788917577.420559 read 0x00c5ae thru 0x01b7e2 (0xf235 bytes) 000743 1788917577.424049 write 0x01f04f thru 0x02db62 (0xeb14 bytes) 000744 1788917577.429405 fallocate 0x026c32 thru 0x03396f (0xcd3e bytes) 000745 1788917577.431589 mapread 0x012298 thru 0x01577b (0x34e4 bytes) 000746 1788917577.432283 read 0x0188f3 thru 0x01c8e9 (0x3ff7 bytes) 000747 1788917577.435792 punch from 0x010e92 to 0x012c34 (0x1da3 bytes) 000748 1788917577.437938 mapread 0x021ffc thru 0x028d1f (0x6d24 bytes) 000750 1788917577.439213 trunc from 0x035104 to 0x02dce0 (0x7423 bytes) 000751 1788917577.451651 read 0x01b4de thru 0x01b55a (0x7d bytes) 000752 1788917577.452180 punch from 0x009154 to 0x0171c8 (0xe075 bytes) 000753 1788917577.454769 trunc from 0x015532 to 0x01f184 (0x9c53 bytes) 000754 1788917577.461134 read 0x0101f7 thru 0x01fe0f (0xfc19 bytes) 000755 1788917577.465498 trunc from 0x020809 to 0x02dce0 (0xd4d8 bytes) 000756 1788917577.468153 trunc from 0x02dce1 to 0x036faa (0x92ca bytes) 000757 1788917577.474267 trunc from 0x01d413 to 0x01dcc0 (0x8ae bytes) 000758 1788917577.477616 MIRROR_RESYNC 6 mirrors 000759 1788917577.942783 mapread 0x0299cf thru 0x035d88 (0xc3ba bytes) 000760 1788917577.950701 mapwrite 0x0032e8 thru 0x00f5ce (0xc2e7 bytes) 000761 1788917577.990667 punch from 0x02fde6 to 0x036faa (0x71c5 bytes) 000762 1788917577.992435 mapread 0x01fa33 thru 0x024a4b (0x5019 bytes) 000763 1788917577.995595 trunc from 0x036fab to 0x00b427 (0x2bb83 bytes) 000764 1788917578.005817 mapwrite 0x0120e3 thru 0x0177bb (0x56d9 bytes) 000765 1788917578.019389 read 0x016cf5 thru 0x0177bb (0xac7 bytes) 000767 1788917578.020271 mapwrite 0x00ffc5 thru 0x01f0ad (0xf0e9 bytes) 000768 1788917578.037941 write 0x0070bc thru 0x00ae23 (0x3d68 bytes) 000769 1788917578.038861 trunc from 0x01f0ae to 0x018cf0 (0x63bd bytes) 000770 1788917578.044113 mapwrite 0x0338a4 thru 0x03ba7f (0x81dc bytes) 000772 1788917578.060009 fallocate 0x01a217 thru 0x01cbb8 (0x29a2 bytes) 000773 1788917578.062412 punch from 0x0155b8 to 0x024370 (0xedb9 bytes) 000774 1788917578.064699 punch from 0x01d89a to 0x024fe0 (0x7747 bytes) 000775 1788917578.069691 mapwrite 0x018276 thru 0x01d38f (0x511a bytes) 000776 1788917578.079785 punch from 0x02c92b to 0x036361 (0x9a37 bytes) 000777 1788917578.082255 mapwrite 0x03f260 thru 0x03ffff (0xda0 bytes) 000778 1788917578.094056 fallocate 0x00a32f thru 0x0147a2 (0xa474 bytes) 000779 1788917578.096408 punch from 0x000591 to 0x00d5fd (0xd06d bytes) 000780 1788917578.098674 punch from 0x0257c1 to 0x031dd7 (0xc617 bytes) 000781 1788917578.102535 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x6e6acbfe (stale) Mirror 15: 0x6e6acbfe (stale) Mirror 17: 0x6e6acbfe (stale) Mirror 18: 0x6e6acbfe (stale) Mirror 19: 0x6e6acbfe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6fb1bc22 Mirror 20: 0x6fb1bc22 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000782 1788917578.414269 fallocate 0x006313 thru 0x0097a2 (0x3490 bytes) 000783 1788917578.426822 trunc from 0x040000 to 0x029d77 (0x16288 bytes) 000784 1788917578.440535 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29d78): Mirror 13: 0xa26045fe (stale) Mirror 15: 0xa26045fe (stale) Mirror 17: 0xa26045fe (stale) Mirror 18: 0xa26045fe (stale) Mirror 19: 0xa26045fe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29d78): Mirror 13: 0xa26045fe (stale) Mirror 15: 0xa26045fe (stale) Mirror 17: 0xa26045fe (stale) Mirror 18: 0xa26045fe (stale) Mirror 19: 0xa26045fe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29d78: skipped 000785 1788917578.575254 mapread 0x025a0f thru 0x027d51 (0x2343 bytes) 000786 1788917578.582408 mapread 0x01e681 thru 0x021b2a (0x34aa bytes) 000787 1788917578.586158 fallocate 0x039f6c thru 0x03ffff (0x6094 bytes) 000788 1788917578.588989 fallocate 0x03b64a thru 0x03ffff (0x49b6 bytes) 000789 1788917578.591596 mapread 0x036a41 thru 0x03a16c (0x372c bytes) 000790 1788917578.597636 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x6e6acbfe (stale) Mirror 15: 0x6e6acbfe (stale) Mirror 17: 0x6e6acbfe (stale) Mirror 18: 0x6e6acbfe (stale) Mirror 19: 0x6e6acbfe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x960c332d Mirror 20: 0x960c332d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000791 1788917578.884854 mapwrite 0x01671e thru 0x01caae (0x6391 bytes) 000792 1788917578.922451 mapwrite 0x0309bb thru 0x03bbea (0xb230 bytes) 000794 1788917578.936171 fallocate 0x033c12 thru 0x03ffff (0xc3ee bytes) 000796 1788917578.939088 mapwrite 0x03134b thru 0x032549 (0x11ff bytes) 000797 1788917578.948433 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x6e6acbfe (stale) Mirror 15: 0x6e6acbfe (stale) Mirror 17: 0x6e6acbfe (stale) Mirror 18: 0x6e6acbfe (stale) Mirror 19: 0x6e6acbfe (stale) Mirror 20: 0x960c332d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc1aa8718 Mirror 21: 0xc1aa8718 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000798 1788917579.266169 MIRROR_RESYNC 8 mirrors 000799 1788917579.688664 mapread 0x018603 thru 0x01e06f (0x5a6d bytes) 000800 1788917579.694284 trunc from 0x01becd to 0x029e75 (0xdfa9 bytes) 000801 1788917579.706680 MIRROR_RESYNC 8 mirrors 000802 1788917580.193676 read 0x01f0ca thru 0x02dbb3 (0xeaea bytes) 000804 1788917580.196509 fallocate 0x03d338 thru 0x03ffff (0x2cc8 bytes) 000806 1788917580.209762 mapread 0x0119bf thru 0x018be7 (0x7229 bytes) 000807 1788917580.218706 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xb91d1a66 (stale) Mirror 15: 0xb91d1a66 (stale) Mirror 17: 0xb91d1a66 (stale) Mirror 18: 0xb91d1a66 (stale) Mirror 19: 0xb91d1a66 (stale) Mirror 20: 0xb91d1a66 (stale) Mirror 21: 0xb91d1a66 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb91d1a66 Mirror 22: 0xb91d1a66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000808 1788917580.568624 trunc from 0x01e701 to 0x024871 (0x6171 bytes) 000809 1788917580.580205 fallocate 0x01ee3c thru 0x02d2cb (0xe490 bytes) 000810 1788917580.582219 write 0x03e1a9 thru 0x03ffff (0x1e57 bytes) 000811 1788917580.585534 trunc from 0x040000 to 0x00e143 (0x31ebc bytes) 000812 1788917580.591194 mapwrite 0x034def thru 0x03dae0 (0x8cf2 bytes) 000813 1788917580.607499 trunc from 0x01ff18 to 0x023e81 (0x3f6a bytes) 000814 1788917580.610730 MIRROR_RESYNC 9 mirrors 000815 1788917581.026455 write 0x033579 thru 0x03f052 (0xbada bytes) 000817 1788917581.044577 trunc from 0x03f053 to 0x01d413 (0x21c3f bytes) 000818 1788917581.059467 mapwrite 0x02dc28 thru 0x03d635 (0xfa0e bytes) 000820 1788917581.091257 read 0x032f76 thru 0x0351b7 (0x2242 bytes) 000822 1788917581.092597 mapwrite 0x032790 thru 0x03f569 (0xcdda bytes) 000824 1788917581.121373 punch from 0x00730c to 0x00e268 (0x6f5d bytes) 000825 1788917581.127522 fallocate 0x0167cc thru 0x02634a (0xfb7f bytes) 000826 1788917581.130804 trunc from 0x01e4f0 to 0x02250c (0x401d bytes) 000827 1788917581.133616 trunc from 0x03f56a to 0x03bc2f (0x393a bytes) 000828 1788917581.140261 mapread 0x01d1c6 thru 0x02a072 (0xcead bytes) 000829 1788917581.146929 fallocate 0x038e79 thru 0x03ffff (0x7187 bytes) 000830 1788917581.149946 punch from 0x01780a to 0x01cd4d (0x5544 bytes) 000831 1788917581.156035 MIRROR_RESYNC 9 mirrors 000832 1788917581.602987 write 0x03d47c thru 0x03ffff (0x2b84 bytes) 000833 1788917581.619143 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x7d3f01ff (stale) Mirror 17: 0x7d3f01ff (stale) Mirror 18: 0x7d3f01ff (stale) Mirror 19: 0x7d3f01ff (stale) Mirror 20: 0x7d3f01ff (stale) Mirror 21: 0x7d3f01ff (stale) Mirror 22: 0x7d3f01ff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x7d3f01ff (stale) Mirror 17: 0x7d3f01ff (stale) Mirror 18: 0x7d3f01ff (stale) Mirror 19: 0x7d3f01ff (stale) Mirror 20: 0x7d3f01ff (stale) Mirror 21: 0x7d3f01ff (stale) Mirror 22: 0x7d3f01ff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000834 1788917581.778210 mapwrite 0x00e465 thru 0x01374e (0x52ea bytes) 000835 1788917581.792452 mapwrite 0x038449 thru 0x03c8e4 (0x449c bytes) 000836 1788917581.802093 trunc from 0x040000 to 0x0155ec (0x2aa13 bytes) 000837 1788917581.813652 punch from 0x00c4bf to 0x00f3b1 (0x2ef3 bytes) 000838 1788917581.815654 punch from 0x011ad5 to 0x0155ec (0x3b18 bytes) 000839 1788917581.817672 punch from 0x011ea1 to 0x0155ec (0x374c bytes) 000842 1788917581.820337 trunc from 0x00172d to 0x002932 (0x1206 bytes) 000843 1788917581.823903 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x155ed): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x155ed): Mirror 15: 0x9ac43911 (stale) Mirror 17: 0x9ac43911 (stale) Mirror 18: 0x9ac43911 (stale) Mirror 19: 0x9ac43911 (stale) Mirror 20: 0x9ac43911 (stale) Mirror 21: 0x9ac43911 (stale) Mirror 22: 0x9ac43911 (stale) CRC-32 checksum value for chunk [0, 0x155ed): Mirror 1: 0x4db03924 Mirror 23: 0x4db03924 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x155ed: skipped 000844 1788917582.107962 write 0x0060fb thru 0x00efd7 (0x8edd bytes) 000845 1788917582.122421 trunc from 0x00cbd5 to 0x0155ec (0x8a18 bytes) 000846 1788917582.127052 mapread 0x012f82 thru 0x0155ec (0x266b bytes) 000847 1788917582.133431 fallocate 0x0359ae thru 0x03ffff (0xa652 bytes) 000848 1788917582.135842 fallocate 0x02169b thru 0x026ec5 (0x582b bytes) 000849 1788917582.137827 trunc from 0x040000 to 0x0330f6 (0xcf09 bytes) 000850 1788917582.149894 fallocate 0x03f76f thru 0x03ffff (0x891 bytes) 000852 1788917582.152534 mapread 0x033a0f thru 0x03d8cf (0x9ec1 bytes) 000853 1788917582.158896 write 0x0108f4 thru 0x012641 (0x1d4e bytes) 000854 1788917582.161841 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x7d3f01ff (stale) Mirror 17: 0x7d3f01ff (stale) Mirror 18: 0x7d3f01ff (stale) Mirror 19: 0x7d3f01ff (stale) Mirror 20: 0x7d3f01ff (stale) Mirror 21: 0x7d3f01ff (stale) Mirror 22: 0x7d3f01ff (stale) Mirror 23: 0xab7752db (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3334fabb Mirror 24: 0x3334fabb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000855 1788917582.478618 trunc from 0x0378f0 to 0x038190 (0x8a1 bytes) 000856 1788917582.490158 fallocate 0x02c242 thru 0x03c1ef (0xffae bytes) 000857 1788917582.492955 punch from 0x0054b7 to 0x009219 (0x3d63 bytes) 000858 1788917582.496907 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x7d3f01ff (stale) Mirror 17: 0x7d3f01ff (stale) Mirror 18: 0x7d3f01ff (stale) Mirror 19: 0x7d3f01ff (stale) Mirror 20: 0x7d3f01ff (stale) Mirror 21: 0x7d3f01ff (stale) Mirror 22: 0x7d3f01ff (stale) Mirror 23: 0xab7752db (stale) Mirror 24: 0x3334fabb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x41a7d22a Mirror 25: 0x41a7d22a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000859 1788917582.809202 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x7d3f01ff (stale) Mirror 17: 0x7d3f01ff (stale) Mirror 18: 0x7d3f01ff (stale) Mirror 19: 0x7d3f01ff (stale) Mirror 20: 0x7d3f01ff (stale) Mirror 21: 0x7d3f01ff (stale) Mirror 22: 0x7d3f01ff (stale) Mirror 23: 0xab7752db (stale) Mirror 24: 0x3334fabb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x41a7d22a Mirror 25: 0x41a7d22a Mirror 26: 0x41a7d22a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000860 1788917583.136338 fallocate 0x01e0c2 thru 0x02199b (0x38da bytes) 000861 1788917583.149627 trunc from 0x040000 to 0x002fa5 (0x3d05a bytes) 000863 1788917583.163485 mapread 0x002ef6 thru 0x002fa5 (0xb0 bytes) 000864 1788917583.167289 mapread 0x0023c9 thru 0x002fa5 (0xbdd bytes) 000866 1788917583.170483 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fa6): Mirror 15: 0xea677484 (stale) Mirror 17: 0xea677484 (stale) Mirror 18: 0xea677484 (stale) Mirror 19: 0xea677484 (stale) Mirror 20: 0xea677484 (stale) Mirror 22: 0xea677484 (stale) Mirror 23: 0xea677484 (stale) Mirror 24: 0xea677484 (stale) Mirror 25: 0xea677484 (stale) Mirror 26: 0xea677484 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fa6): Mirror 15: 0xea677484 (stale) Mirror 17: 0xea677484 (stale) Mirror 18: 0xea677484 (stale) Mirror 19: 0xea677484 (stale) Mirror 20: 0xea677484 (stale) Mirror 22: 0xea677484 (stale) Mirror 23: 0xea677484 (stale) Mirror 24: 0xea677484 (stale) Mirror 25: 0xea677484 (stale) Mirror 26: 0xea677484 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fa6: skipped 000867 1788917583.319232 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fa6): Mirror 15: 0xea677484 (stale) Mirror 17: 0xea677484 (stale) Mirror 18: 0xea677484 (stale) Mirror 19: 0xea677484 (stale) Mirror 20: 0xea677484 (stale) Mirror 22: 0xea677484 (stale) Mirror 24: 0xea677484 (stale) Mirror 25: 0xea677484 (stale) Mirror 26: 0xea677484 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fa6): Mirror 15: 0xea677484 (stale) Mirror 17: 0xea677484 (stale) Mirror 18: 0xea677484 (stale) Mirror 19: 0xea677484 (stale) Mirror 20: 0xea677484 (stale) Mirror 22: 0xea677484 (stale) Mirror 24: 0xea677484 (stale) Mirror 25: 0xea677484 (stale) Mirror 26: 0xea677484 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fa6: skipped 000868 1788917583.453810 trunc from 0x000d8a to 0x002fa5 (0x221c bytes) 000869 1788917583.456223 mapwrite 0x0327bc thru 0x036bf9 (0x443e bytes) 000870 1788917583.479408 trunc from 0x036bfa to 0x00b499 (0x2b760 bytes) 000871 1788917583.486443 trunc from 0x00b49a to 0x03d42a (0x31f91 bytes) 000872 1788917583.491850 fallocate 0x0383bc thru 0x03ffff (0x7c44 bytes) 000873 1788917583.494189 punch from 0x03f26f to 0x03ffff (0xd91 bytes) 000874 1788917583.496278 read 0x000417 thru 0x009c0c (0x97f6 bytes) 000875 1788917583.501188 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x7d3f01ff (stale) Mirror 17: 0x7d3f01ff (stale) Mirror 18: 0x7d3f01ff (stale) Mirror 19: 0x7d3f01ff (stale) Mirror 20: 0x7d3f01ff (stale) Mirror 22: 0x7d3f01ff (stale) Mirror 25: 0x41a7d22a (stale) Mirror 26: 0x41a7d22a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x7d3f01ff (stale) Mirror 17: 0x7d3f01ff (stale) Mirror 18: 0x7d3f01ff (stale) Mirror 19: 0x7d3f01ff (stale) Mirror 20: 0x7d3f01ff (stale) Mirror 22: 0x7d3f01ff (stale) Mirror 25: 0x41a7d22a (stale) Mirror 26: 0x41a7d22a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000876 1788917583.667986 punch from 0x004c25 to 0x0111c5 (0xc5a1 bytes) 000877 1788917583.670412 trunc from 0x02ac3a to 0x02b432 (0x7f9 bytes) 000878 1788917583.672540 trunc from 0x017e29 to 0x01ecc2 (0x6e9a bytes) 000879 1788917583.674642 mapwrite 0x01fd03 thru 0x021efe (0x21fc bytes) 000880 1788917583.687004 mapread 0x001e2a thru 0x00c60e (0xa7e5 bytes) 000881 1788917583.691465 mapwrite 0x025f24 thru 0x02a619 (0x46f6 bytes) 000882 1788917583.702512 fallocate 0x03f422 thru 0x03ffff (0xbde bytes) 000883 1788917583.706772 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x7d3f01ff (stale) Mirror 17: 0x7d3f01ff (stale) Mirror 18: 0x7d3f01ff (stale) Mirror 19: 0x7d3f01ff (stale) Mirror 20: 0x7d3f01ff (stale) Mirror 22: 0x7d3f01ff (stale) Mirror 25: 0x41a7d22a (stale) Mirror 26: 0x41a7d22a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe63b0ec8 Mirror 27: 0xe63b0ec8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000884 1788917584.031057 fallocate 0x01af00 thru 0x02685f (0xb960 bytes) 000885 1788917584.044597 write 0x01e0d8 thru 0x01ea96 (0x9bf bytes) 000886 1788917584.048208 read 0x029dc3 thru 0x02d658 (0x3896 bytes) 000888 1788917584.051475 write 0x03131a thru 0x036346 (0x502d bytes) 000889 1788917584.054807 trunc from 0x040000 to 0x031a44 (0xe5bb bytes) 000890 1788917584.068805 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x31a45): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31a45): Mirror 15: 0xa591ea7f (stale) Mirror 17: 0xa591ea7f (stale) Mirror 18: 0xa591ea7f (stale) Mirror 19: 0xa591ea7f (stale) Mirror 20: 0xa591ea7f (stale) Mirror 22: 0xa591ea7f (stale) Mirror 25: 0x1ed6d437 (stale) Mirror 26: 0x1ed6d437 (stale) Mirror 27: 0xeb48af2c (stale) CRC-32 checksum value for chunk [0, 0x31a45): Mirror 1: 0xee1dc325 Mirror 28: 0xee1dc325 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31a45: skipped 000891 1788917584.392088 punch from 0x01ae74 to 0x021c69 (0x6df6 bytes) 000892 1788917584.404277 write 0x018042 thru 0x025d09 (0xdcc8 bytes) 000894 1788917584.408864 trunc from 0x02475d to 0x02a89b (0x613f bytes) 000896 1788917584.413394 mapread 0x011d62 thru 0x0208fd (0xeb9c bytes) 000897 1788917584.421132 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x31a45): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31a45): Mirror 15: 0xa591ea7f (stale) Mirror 17: 0xa591ea7f (stale) Mirror 18: 0xa591ea7f (stale) Mirror 19: 0xa591ea7f (stale) Mirror 20: 0xa591ea7f (stale) Mirror 22: 0xa591ea7f (stale) Mirror 25: 0x1ed6d437 (stale) Mirror 26: 0x1ed6d437 (stale) Mirror 27: 0xeb48af2c (stale) Mirror 28: 0xee1dc325 (stale) CRC-32 checksum value for chunk [0, 0x31a45): Mirror 1: 0xd0fbffde Mirror 29: 0xd0fbffde lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31a45: skipped 000898 1788917584.748327 mapread 0x01526b thru 0x02140d (0xc1a3 bytes) 000899 1788917584.766321 trunc from 0x031a45 to 0x01cca1 (0x14da3 bytes) 000900 1788917584.790804 write 0x004c15 thru 0x013b18 (0xef04 bytes) 000901 1788917584.794613 mapwrite 0x018634 thru 0x01c0d0 (0x3a9d bytes) 000902 1788917584.808625 fallocate 0x01d63d thru 0x02a4bc (0xce80 bytes) 000903 1788917584.811304 fallocate 0x012a7b thru 0x018c84 (0x620a bytes) 000904 1788917584.813518 mapread 0x001de3 thru 0x010ffa (0xf218 bytes) 000905 1788917584.816790 trunc from 0x02a4bd to 0x03d9c3 (0x13507 bytes) 000906 1788917584.823798 trunc from 0x03d9c4 to 0x012ad7 (0x2aeec bytes) 000907 1788917584.830141 mapread 0x00439a thru 0x0060e8 (0x1d4f bytes) 000908 1788917584.831158 read 0x00ec23 thru 0x012ad7 (0x3eb5 bytes) 000909 1788917584.831621 fallocate 0x0220f5 thru 0x025bc5 (0x3ad1 bytes) 000910 1788917584.836185 MIRROR_RESYNC 12 mirrors 000911 1788917585.455764 trunc from 0x007926 to 0x01237b (0xaa56 bytes) 000912 1788917585.467836 punch from 0x00ac29 to 0x019172 (0xe54a bytes) 000913 1788917585.470020 fallocate 0x0143cd thru 0x01ef6f (0xaba3 bytes) 000914 1788917585.472164 mapwrite 0x0126bd thru 0x01a3e7 (0x7d2b bytes) 000915 1788917585.484730 trunc from 0x019268 to 0x022bf1 (0x998a bytes) 000916 1788917585.486824 trunc from 0x025bc6 to 0x01007d (0x15b48 bytes) 000917 1788917585.492795 trunc from 0x01007e to 0x03a579 (0x2a4fc bytes) 000918 1788917585.497403 write 0x028714 thru 0x036cc5 (0xe5b2 bytes) 000919 1788917585.501924 punch from 0x01491e to 0x02288d (0xdf70 bytes) 000920 1788917585.504119 read 0x039416 thru 0x0399ca (0x5b5 bytes) 000921 1788917585.506497 trunc from 0x039c90 to 0x03a579 (0x8ea bytes) 000922 1788917585.510333 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3a57a): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a57a): Mirror 15: 0x9795e51a (stale) Mirror 17: 0x9795e51a (stale) Mirror 18: 0x9795e51a (stale) Mirror 19: 0x9795e51a (stale) Mirror 20: 0x9795e51a (stale) Mirror 22: 0x9795e51a (stale) Mirror 25: 0x9795e51a (stale) Mirror 26: 0x9795e51a (stale) Mirror 27: 0x9795e51a (stale) Mirror 28: 0x9795e51a (stale) Mirror 29: 0x9795e51a (stale) CRC-32 checksum value for chunk [0, 0x3a57a): Mirror 1: 0x59a9c5bb Mirror 30: 0x59a9c5bb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a57a: skipped 000923 1788917585.866825 trunc from 0x0388ef to 0x03a579 (0x1c8b bytes) 000924 1788917585.879679 trunc from 0x03510b to 0x038ec4 (0x3dba bytes) 000925 1788917585.881445 read 0x01b4ce thru 0x01fcd1 (0x4804 bytes) 000926 1788917585.883969 trunc from 0x03a57a to 0x026645 (0x13f34 bytes) 000927 1788917585.894623 read 0x00c9aa thru 0x01c4e1 (0xfb38 bytes) 000928 1788917585.897893 trunc from 0x026646 to 0x03fb83 (0x1953e bytes) 000929 1788917585.901797 fallocate 0x02b9db thru 0x02ffc0 (0x45e6 bytes) 000930 1788917585.903629 mapwrite 0x00cd05 thru 0x01b165 (0xe461 bytes) 000931 1788917585.912272 read 0x02e612 thru 0x033688 (0x5077 bytes) 000932 1788917585.915855 mapread 0x03abce thru 0x03e25c (0x368f bytes) 000933 1788917585.918427 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3fb84): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb84): Mirror 15: 0xc5755819 (stale) Mirror 17: 0xc5755819 (stale) Mirror 18: 0xc5755819 (stale) Mirror 19: 0xc5755819 (stale) Mirror 20: 0xc5755819 (stale) Mirror 22: 0xc5755819 (stale) Mirror 25: 0xc5755819 (stale) Mirror 26: 0xc5755819 (stale) Mirror 27: 0xc5755819 (stale) Mirror 28: 0xc5755819 (stale) Mirror 29: 0xc5755819 (stale) Mirror 30: 0x2b86dcab (stale) CRC-32 checksum value for chunk [0, 0x3fb84): Mirror 1: 0x1ae62733 Mirror 31: 0x1ae62733 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb84: skipped 000934 1788917586.275876 MIRROR_SPLIT mirror 12 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fb84): Mirror 15: 0xc5755819 (stale) Mirror 17: 0xc5755819 (stale) Mirror 18: 0xc5755819 (stale) Mirror 19: 0xc5755819 (stale) Mirror 20: 0xc5755819 (stale) Mirror 22: 0xc5755819 (stale) Mirror 25: 0xc5755819 (stale) Mirror 26: 0xc5755819 (stale) Mirror 27: 0xc5755819 (stale) Mirror 28: 0xc5755819 (stale) Mirror 29: 0xc5755819 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb84): Mirror 15: 0xc5755819 (stale) Mirror 17: 0xc5755819 (stale) Mirror 18: 0xc5755819 (stale) Mirror 19: 0xc5755819 (stale) Mirror 20: 0xc5755819 (stale) Mirror 22: 0xc5755819 (stale) Mirror 25: 0xc5755819 (stale) Mirror 26: 0xc5755819 (stale) Mirror 27: 0xc5755819 (stale) Mirror 28: 0xc5755819 (stale) Mirror 29: 0xc5755819 (stale) CRC-32 checksum value for chunk [0, 0x3fb84): Mirror 1: 0x1ae62733 Mirror 31: 0x1ae62733 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb84: skipped 000935 1788917586.643223 mapwrite 0x021132 thru 0x02a29f (0x916e bytes) 000936 1788917586.693573 read 0x0281d9 thru 0x036f43 (0xed6b bytes) 000937 1788917586.701151 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3fb84): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb84): Mirror 15: 0xc5755819 (stale) Mirror 17: 0xc5755819 (stale) Mirror 18: 0xc5755819 (stale) Mirror 19: 0xc5755819 (stale) Mirror 20: 0xc5755819 (stale) Mirror 22: 0xc5755819 (stale) Mirror 25: 0xc5755819 (stale) Mirror 26: 0xc5755819 (stale) Mirror 27: 0xc5755819 (stale) Mirror 28: 0xc5755819 (stale) Mirror 29: 0xc5755819 (stale) Mirror 31: 0x1ae62733 (stale) CRC-32 checksum value for chunk [0, 0x3fb84): Mirror 1: 0x24fb6c7 Mirror 32: 0x24fb6c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb84: skipped 000938 1788917587.138240 trunc from 0x03fb84 to 0x026148 (0x19a3b bytes) 000939 1788917587.169554 trunc from 0x026149 to 0x007fbf (0x1e189 bytes) 000940 1788917587.176800 trunc from 0x007fc0 to 0x007c33 (0x38c bytes) 000941 1788917587.183940 trunc from 0x007c34 to 0x016f56 (0xf323 bytes) 000942 1788917587.189934 mapwrite 0x01b3d8 thru 0x01efc5 (0x3bee bytes) 000943 1788917587.208387 mapread 0x007ff4 thru 0x00de15 (0x5e22 bytes) 000944 1788917587.214859 MIRROR_RESYNC 14 mirrors 000945 1788917587.952509 fallocate 0x02ad2a thru 0x02b9ab (0xc82 bytes) 000946 1788917587.967044 write 0x026720 thru 0x033abe (0xd39f bytes) 000947 1788917587.968338 punch from 0x0156cc to 0x0216cd (0xc002 bytes) 000948 1788917587.971002 trunc from 0x024b9f to 0x033abe (0xef20 bytes) 000949 1788917587.978584 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x33abf): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33abf): Mirror 15: 0x91fe3bdc (stale) Mirror 17: 0x91fe3bdc (stale) Mirror 18: 0x91fe3bdc (stale) Mirror 19: 0x91fe3bdc (stale) Mirror 20: 0x91fe3bdc (stale) Mirror 22: 0x91fe3bdc (stale) Mirror 25: 0x91fe3bdc (stale) Mirror 26: 0x91fe3bdc (stale) Mirror 27: 0x91fe3bdc (stale) Mirror 28: 0x91fe3bdc (stale) Mirror 29: 0x91fe3bdc (stale) Mirror 31: 0x91fe3bdc (stale) Mirror 32: 0x91fe3bdc (stale) CRC-32 checksum value for chunk [0, 0x33abf): Mirror 1: 0xf7801ce2 Mirror 33: 0xf7801ce2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33abf: skipped 000950 1788917588.339530 mapread 0x02ac1f thru 0x02f53c (0x491e bytes) 000951 1788917588.348769 write 0x027ec4 thru 0x031c17 (0x9d54 bytes) 000952 1788917588.363342 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x33abf): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33abf): Mirror 15: 0x91fe3bdc (stale) Mirror 17: 0x91fe3bdc (stale) Mirror 18: 0x91fe3bdc (stale) Mirror 19: 0x91fe3bdc (stale) Mirror 20: 0x91fe3bdc (stale) Mirror 22: 0x91fe3bdc (stale) Mirror 25: 0x91fe3bdc (stale) Mirror 26: 0x91fe3bdc (stale) Mirror 27: 0x91fe3bdc (stale) Mirror 28: 0x91fe3bdc (stale) Mirror 29: 0x91fe3bdc (stale) Mirror 31: 0x91fe3bdc (stale) Mirror 32: 0x91fe3bdc (stale) Mirror 33: 0xf7801ce2 (stale) CRC-32 checksum value for chunk [0, 0x33abf): Mirror 1: 0xa11733c9 Mirror 34: 0xa11733c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33abf: skipped 000953 1788917588.768813 write 0x00af88 thru 0x019397 (0xe410 bytes) 000954 1788917588.790969 mapwrite 0x02a83d thru 0x036bf1 (0xc3b5 bytes) 000956 1788917588.818909 read 0x02a0b8 thru 0x02d9de (0x3927 bytes) 000957 1788917588.819486 fallocate 0x005943 thru 0x008513 (0x2bd1 bytes) 000958 1788917588.821994 trunc from 0x034a5c to 0x036bf1 (0x2196 bytes) 000960 1788917588.827404 write 0x03a443 thru 0x03db3c (0x36fa bytes) 000963 1788917588.829409 write 0x01b5bf thru 0x01c073 (0xab5 bytes) 000966 1788917588.834970 read 0x035681 thru 0x03db3c (0x84bc bytes) 000968 1788917588.839578 trunc from 0x03c2d6 to 0x03db3c (0x1867 bytes) 000969 1788917588.845772 read 0x01481b thru 0x01b21e (0x6a04 bytes) 000972 1788917588.847503 read 0x0243a7 thru 0x027f59 (0x3bb3 bytes) 000973 1788917588.848149 trunc from 0x03db3d to 0x01fae0 (0x1e05c bytes) 000974 1788917588.854678 mapread 0x005b08 thru 0x00b435 (0x592e bytes) 000975 1788917588.855613 mapread 0x0070bb thru 0x00a004 (0x2f4a bytes) 000976 1788917588.856507 fallocate 0x0089d2 thru 0x00a448 (0x1a77 bytes) 000977 1788917588.859430 fallocate 0x0281af thru 0x035907 (0xd759 bytes) 000978 1788917588.862076 mapwrite 0x02ee08 thru 0x03ea20 (0xfc19 bytes) 000979 1788917588.882064 mapread 0x0264d4 thru 0x03518e (0xecbb bytes) 000980 1788917588.885012 MIRROR_SPLIT mirror 1 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ea21): Mirror 17: 0x2f811c53 (stale) Mirror 18: 0x2f811c53 (stale) Mirror 19: 0x2f811c53 (stale) Mirror 20: 0x2f811c53 (stale) Mirror 22: 0x2f811c53 (stale) Mirror 25: 0x2f811c53 (stale) Mirror 26: 0x2f811c53 (stale) Mirror 27: 0x2f811c53 (stale) Mirror 28: 0x2f811c53 (stale) Mirror 29: 0x2f811c53 (stale) Mirror 31: 0x2f811c53 (stale) Mirror 32: 0x2f811c53 (stale) Mirror 33: 0x7d3fbaf1 (stale) Mirror 34: 0xdb8e42dd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ea21): Mirror 17: 0x2f811c53 (stale) Mirror 18: 0x2f811c53 (stale) Mirror 19: 0x2f811c53 (stale) Mirror 20: 0x2f811c53 (stale) Mirror 22: 0x2f811c53 (stale) Mirror 25: 0x2f811c53 (stale) Mirror 26: 0x2f811c53 (stale) Mirror 27: 0x2f811c53 (stale) Mirror 28: 0x2f811c53 (stale) Mirror 29: 0x2f811c53 (stale) Mirror 31: 0x2f811c53 (stale) Mirror 32: 0x2f811c53 (stale) Mirror 33: 0x7d3fbaf1 (stale) Mirror 34: 0xdb8e42dd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ea21: skipped 000981 1788917589.114655 fallocate 0x02e9b8 thru 0x033de0 (0x5429 bytes) 000982 1788917589.117506 read 0x024c2f thru 0x03305e (0xe430 bytes) 000983 1788917589.121768 trunc from 0x03ae8a to 0x03ea20 (0x3b97 bytes) 000984 1788917589.124081 read 0x025cdc thru 0x02d0eb (0x7410 bytes) 000985 1788917589.124658 trunc from 0x03ea21 to 0x031f4b (0xcad5 bytes) 000986 1788917589.132646 fallocate 0x025042 thru 0x02ce66 (0x7e25 bytes) 000987 1788917589.135310 fallocate 0x00832c thru 0x00b052 (0x2d27 bytes) 000988 1788917589.138087 mapread 0x0146c5 thru 0x022415 (0xdd51 bytes) 000989 1788917589.142892 fallocate 0x004488 thru 0x0095db (0x5154 bytes) 000990 1788917589.145825 trunc from 0x031f4c to 0x020d47 (0x11204 bytes) 000991 1788917589.157474 MIRROR_SPLIT mirror 5 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20d48): Mirror 17: 0x6094927d (stale) Mirror 18: 0x6094927d (stale) Mirror 19: 0x6094927d (stale) Mirror 20: 0x6094927d (stale) Mirror 25: 0x6094927d (stale) Mirror 26: 0x6094927d (stale) Mirror 27: 0x6094927d (stale) Mirror 28: 0x6094927d (stale) Mirror 29: 0x6094927d (stale) Mirror 31: 0x6094927d (stale) Mirror 32: 0x6094927d (stale) Mirror 33: 0x685bae70 (stale) Mirror 34: 0x685bae70 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20d48): Mirror 17: 0x6094927d (stale) Mirror 18: 0x6094927d (stale) Mirror 19: 0x6094927d (stale) Mirror 20: 0x6094927d (stale) Mirror 25: 0x6094927d (stale) Mirror 26: 0x6094927d (stale) Mirror 27: 0x6094927d (stale) Mirror 28: 0x6094927d (stale) Mirror 29: 0x6094927d (stale) Mirror 31: 0x6094927d (stale) Mirror 32: 0x6094927d (stale) Mirror 33: 0x685bae70 (stale) Mirror 34: 0x685bae70 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20d48: skipped 000992 1788917589.367233 mapwrite 0x00df13 thru 0x017199 (0x9287 bytes) 000993 1788917589.383490 trunc from 0x007f0f to 0x0123cd (0xa4bf bytes) 000994 1788917589.387719 MIRROR_SPLIT mirror 5 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20d48): Mirror 17: 0x6094927d (stale) Mirror 18: 0x6094927d (stale) Mirror 19: 0x6094927d (stale) Mirror 20: 0x6094927d (stale) Mirror 26: 0x6094927d (stale) Mirror 27: 0x6094927d (stale) Mirror 28: 0x6094927d (stale) Mirror 29: 0x6094927d (stale) Mirror 31: 0x6094927d (stale) Mirror 32: 0x6094927d (stale) Mirror 33: 0x685bae70 (stale) Mirror 34: 0x685bae70 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20d48): Mirror 17: 0x6094927d (stale) Mirror 18: 0x6094927d (stale) Mirror 19: 0x6094927d (stale) Mirror 20: 0x6094927d (stale) Mirror 26: 0x6094927d (stale) Mirror 27: 0x6094927d (stale) Mirror 28: 0x6094927d (stale) Mirror 29: 0x6094927d (stale) Mirror 31: 0x6094927d (stale) Mirror 32: 0x6094927d (stale) Mirror 33: 0x685bae70 (stale) Mirror 34: 0x685bae70 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20d48: skipped 000995 1788917589.576191 trunc from 0x020d48 to 0x0342f9 (0x135b2 bytes) 000996 1788917589.582732 fallocate 0x026591 thru 0x02665f (0xcf bytes) 000998 1788917589.586158 read 0x02c12f thru 0x0342f9 (0x81cb bytes) 000999 1788917589.592248 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x342fa): Mirror 18: 0x61a65f1a (stale) Mirror 19: 0x61a65f1a (stale) Mirror 20: 0x61a65f1a (stale) Mirror 26: 0x61a65f1a (stale) Mirror 27: 0x61a65f1a (stale) Mirror 28: 0x61a65f1a (stale) Mirror 29: 0x61a65f1a (stale) Mirror 31: 0x61a65f1a (stale) Mirror 32: 0x61a65f1a (stale) Mirror 33: 0xf38b56e2 (stale) Mirror 34: 0xc655c8d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x342fa): Mirror 18: 0x61a65f1a (stale) Mirror 19: 0x61a65f1a (stale) Mirror 20: 0x61a65f1a (stale) Mirror 26: 0x61a65f1a (stale) Mirror 27: 0x61a65f1a (stale) Mirror 28: 0x61a65f1a (stale) Mirror 29: 0x61a65f1a (stale) Mirror 31: 0x61a65f1a (stale) Mirror 32: 0x61a65f1a (stale) Mirror 33: 0xf38b56e2 (stale) Mirror 34: 0xc655c8d1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x342fa: skipped 001000 1788917589.831628 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x672:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x342fa): Mirror 18: 0x61a65f1a (stale) Mirror 19: 0x61a65f1a (stale) Mirror 20: 0x61a65f1a (stale) Mirror 26: 0x61a65f1a (stale) Mirror 27: 0x61a65f1a (stale) Mirror 28: 0x61a65f1a (stale) Mirror 29: 0x61a65f1a (stale) Mirror 32: 0x61a65f1a (stale) Mirror 33: 0xf38b56e2 (stale) Mirror 34: 0xc655c8d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x342fa): Mirror 18: 0x61a65f1a (stale) Mirror 19: 0x61a65f1a (stale) Mirror 20: 0x61a65f1a (stale) Mirror 26: 0x61a65f1a (stale) Mirror 27: 0x61a65f1a (stale) Mirror 28: 0x61a65f1a (stale) Mirror 29: 0x61a65f1a (stale) Mirror 32: 0x61a65f1a (stale) Mirror 33: 0xf38b56e2 (stale) Mirror 34: 0xc655c8d1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x342fa: skipped All operations completed A-OK!