== sanity-flr test 70a: flr mode fsx test ================ 10:10:51 (1788531051) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 1053 skipping zero size read truncating to largest ever: 0x3ac6b 000002 1788531054.211785 trunc from 00000000 to 0x03ac6a (0x3ac6b bytes) 000003 1788531054.230673 fallocate 0x0008ba thru 0x00f661 (0xeda8 bytes) 000004 1788531054.235556 trunc from 0x03870d to 0x03ac6a (0x255e bytes) 000005 1788531054.240476 mapwrite 0x0036d0 thru 0x00b9c9 (0x82fa bytes) 000006 1788531054.277682 trunc from 0x03ac6b to 0x037f53 (0x2d17 bytes) 000007 1788531054.299290 mapread 0x032fe3 thru 0x037f53 (0x4f71 bytes) 000009 1788531054.314186 trunc from 0x037f54 to 0x032f9f (0x4fb4 bytes) 000010 1788531054.343121 mapwrite 0x01538d thru 0x02136b (0xbfdf bytes) 000011 1788531054.395244 punch from 0x00c4f4 to 0x0103b5 (0x3ec2 bytes) 000012 1788531054.402523 mapread 0x020675 thru 0x027fb9 (0x7945 bytes) 000013 1788531054.411671 write 0x02ce57 thru 0x02ef33 (0x20dd bytes) 000014 1788531054.415151 read 0x01b91f thru 0x02b407 (0xfae9 bytes) 000015 1788531054.416587 mapwrite 0x039c23 thru 0x03ffff (0x63dd bytes) 000016 1788531054.487015 punch from 0x00f3e8 to 0x0113fc (0x2015 bytes) 000017 1788531054.494360 trunc from 0x040000 to 0x0228b6 (0x1d749 bytes) 000019 1788531054.510961 fallocate 0x00f4c8 thru 0x010467 (0xfa0 bytes) 000021 1788531054.523569 read 0x021e5b thru 0x0228b6 (0xa5c bytes) 000022 1788531054.524830 fallocate 0x0066cf thru 0x011c4c (0xb57e bytes) 000024 1788531054.530436 mapwrite 0x03f96b thru 0x03ffff (0x695 bytes) 000025 1788531054.585300 fallocate 0x006f1b thru 0x00f3da (0x84c0 bytes) 000026 1788531054.602332 punch from 0x006c6c to 0x015859 (0xebee bytes) 000027 1788531054.617633 mapread 0x01efd5 thru 0x0203d7 (0x1403 bytes) 000028 1788531054.618570 mapwrite 0x02aeb5 thru 0x037518 (0xc664 bytes) truncating to largest ever: 0x3f0ea 000029 1788531054.652790 trunc from 0x040000 to 0x03f0e9 (0xf16 bytes) 000030 1788531054.677634 punch from 0x03ef96 to 0x03f0e9 (0x154 bytes) fallocating to largest ever: 0x40000 000031 1788531054.683658 fallocate 0x03aee8 thru 0x03ffff (0x5118 bytes) 000033 1788531054.690295 trunc from 0x03f0ea to 0x01e73d (0x209ac bytes) 000034 1788531054.712879 mapread 0x018870 thru 0x01d056 (0x47e7 bytes) 000036 1788531054.714641 fallocate 0x039c5d thru 0x03f09c (0x5440 bytes) 000037 1788531054.720930 trunc from 0x02b95c to 0x035112 (0x97b7 bytes) 000038 1788531054.725293 trunc from 0x03f09d to 0x0066b1 (0x389eb bytes) 000039 1788531054.743664 punch from 0x002e6a to 0x0066b1 (0x3848 bytes) 000040 1788531054.749122 write 0x017a96 thru 0x0197db (0x1d46 bytes) 000041 1788531054.750603 read 0x00f72b thru 0x0134fa (0x3dd0 bytes) 000042 1788531054.761278 mapwrite 0x03b569 thru 0x03ffff (0x4a97 bytes) 000043 1788531054.849227 punch from 0x03591d to 0x035bf5 (0x2d9 bytes) 000044 1788531054.865265 write 0x03465d thru 0x03a9cb (0x636f bytes) 000045 1788531054.867299 write 0x01594b thru 0x023028 (0xd6de bytes) 000046 1788531054.876922 punch from 0x00ad22 to 0x01917e (0xe45d bytes) 000047 1788531054.919804 punch from 0x010665 to 0x010d41 (0x6dd bytes) 000048 1788531054.933149 trunc from 0x040000 to 0x029abd (0x16542 bytes) 000049 1788531054.985306 trunc from 0x029abe to 0x004e37 (0x24c86 bytes) 000050 1788531055.013186 trunc from 0x004e38 to 0x036650 (0x31819 bytes) 000053 1788531055.070120 read 0x011384 thru 0x0204bf (0xf13c bytes) 000054 1788531055.092891 punch from 0x0092b6 to 0x017cd8 (0xea23 bytes) 000056 1788531055.107734 fallocate 0x011b7a thru 0x01b05d (0x94e4 bytes) 000057 1788531055.118924 mapread 0x02313c thru 0x02e240 (0xb105 bytes) 000058 1788531055.130333 trunc from 0x0202cd to 0x0218f0 (0x1624 bytes) 000059 1788531055.146347 write 0x0112d2 thru 0x0178b0 (0x65df bytes) 000060 1788531055.175286 punch from 0x0098f8 to 0x00b67d (0x1d86 bytes) 000061 1788531055.185614 write 0x01fce6 thru 0x0213a9 (0x16c4 bytes) 000062 1788531055.207474 mapwrite 0x0366c4 thru 0x03c229 (0x5b66 bytes) 000063 1788531055.318573 mapwrite 0x029262 thru 0x036e30 (0xdbcf bytes) 000064 1788531055.370003 fallocate 0x03a7ea thru 0x03ffff (0x5816 bytes) 000065 1788531055.380104 trunc from 0x038534 to 0x03c229 (0x3cf6 bytes) 000066 1788531055.395616 trunc from 0x00e219 to 0x014988 (0x6770 bytes) 000067 1788531055.418424 MIRROR_EXTEND to 2 mirrors 000069 1788531056.407165 mapwrite 0x00b936 thru 0x00bd05 (0x3d0 bytes) 000070 1788531056.493360 trunc from 0x03c22a to 0x023bd9 (0x18650 bytes) 000071 1788531056.524275 write 0x01dfb0 thru 0x0282a8 (0xa2f9 bytes) 000072 1788531056.532866 write 0x031956 thru 0x03ef90 (0xd63b bytes) 000073 1788531056.535614 trunc from 0x03ef91 to 0x00ef87 (0x30009 bytes) 000074 1788531056.553064 punch from 0x009543 to 0x00ef87 (0x5a45 bytes) 000075 1788531056.563606 fallocate 0x02f88f thru 0x035b64 (0x62d6 bytes) 000076 1788531056.582588 trunc from 0x00be18 to 0x00ef87 (0x3170 bytes) 000077 1788531056.591614 read 0x000c81 thru 0x00e552 (0xd8d2 bytes) 000078 1788531056.615871 mapwrite 0x023445 thru 0x024b91 (0x174d bytes) 000079 1788531056.710392 fallocate 0x012376 thru 0x01cd24 (0xa9af bytes) 000080 1788531056.731968 fallocate 0x03b86d thru 0x03ffff (0x4793 bytes) 000081 1788531056.743175 trunc from 0x040000 to 0x0080da (0x37f25 bytes) 000082 1788531056.759354 trunc from 0x0080db to 0x00c898 (0x47be bytes) 000083 1788531056.778026 read 0x003ab2 thru 0x009b67 (0x60b6 bytes) 000084 1788531056.786880 mapwrite 0x006e1f thru 0x009e22 (0x3004 bytes) 000085 1788531056.809147 trunc from 0x00c899 to 0x02a3ea (0x1db52 bytes) 000086 1788531056.836095 read 0x029c6f thru 0x02a3ea (0x77c bytes) 000088 1788531056.861799 fallocate 0x03110f thru 0x0380a6 (0x6f98 bytes) 000089 1788531056.870000 write 0x027f74 thru 0x0373b2 (0xf43f bytes) 000090 1788531056.886690 trunc from 0x0380a7 to 0x03f5a9 (0x7503 bytes) 000091 1788531056.958684 write 0x02e350 thru 0x036604 (0x82b5 bytes) 000092 1788531056.961038 mapwrite 0x0304ca thru 0x034457 (0x3f8e bytes) 000093 1788531056.996683 mapread 0x013d59 thru 0x01562b (0x18d3 bytes) 000094 1788531057.001601 mapread 0x03e58d thru 0x03f5a9 (0x101d bytes) 000096 1788531057.039787 mapwrite 0x01d0cb thru 0x0294c8 (0xc3fe bytes) 000097 1788531057.072699 punch from 0x01e179 to 0x02292c (0x47b4 bytes) 000099 1788531057.087696 read 0x026ddb thru 0x02cc5b (0x5e81 bytes) 000100 1788531057.090169 mapread 0x030e0f thru 0x03f5a9 (0xe79b bytes) 000101 1788531057.092623 trunc from 0x03f5aa to 0x01e654 (0x20f55 bytes) 000102 1788531057.119776 punch from 0x0074aa to 0x00a3a2 (0x2ef9 bytes) 000103 1788531057.128478 trunc from 0x01e655 to 0x007a05 (0x16c4f bytes) 000104 1788531057.183596 mapwrite 0x00f098 thru 0x014562 (0x54cb bytes) 000105 1788531057.296994 fallocate 0x027ba5 thru 0x02ccd6 (0x5132 bytes) 000106 1788531057.305026 punch from 0x01211f to 0x014562 (0x2444 bytes) 000107 1788531057.313965 fallocate 0x009ea9 thru 0x011155 (0x72ad bytes) 000108 1788531057.320814 write 0x03a97b thru 0x03ffff (0x5685 bytes) 000109 1788531057.322040 fallocate 0x014443 thru 0x022bb0 (0xe76e bytes) 000110 1788531057.327118 mapwrite 0x0393b4 thru 0x0397e5 (0x432 bytes) 000111 1788531057.354879 write 0x030184 thru 0x03a474 (0xa2f1 bytes) 000112 1788531057.356903 write 0x0232e1 thru 0x031538 (0xe258 bytes) 000113 1788531057.360688 fallocate 0x027d74 thru 0x0299d1 (0x1c5e bytes) 000114 1788531057.368624 mapwrite 0x003a27 thru 0x011e5d (0xe437 bytes) 000115 1788531057.406001 MIRROR_RESYNC 2 mirrors 000116 1788531057.917897 write 0x03f655 thru 0x03ffff (0x9ab bytes) 000117 1788531057.981611 trunc from 0x03ce75 to 0x03f43e (0x25ca bytes) 000118 1788531058.000518 fallocate 0x0369f2 thru 0x03ffff (0x960e bytes) 000119 1788531058.025271 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb8a88b38 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9b439cd2 Mirror 3: 0x9b439cd2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000120 1788531059.182862 mapwrite 0x01588d thru 0x01bfd9 (0x674d bytes) 000121 1788531059.298854 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb8a88b38 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb8a88b38 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000122 1788531059.660588 mapread 0x00c90a thru 0x01297c (0x6073 bytes) 000123 1788531059.689691 punch from 0x00bdcf to 0x00c2b6 (0x4e8 bytes) 000124 1788531059.694989 fallocate 0x035ce9 thru 0x03ffff (0xa317 bytes) 000126 1788531059.708418 MIRROR_RESYNC 2 mirrors 000127 1788531060.586655 punch from 0x01994a to 0x025ac7 (0xc17e bytes) 000128 1788531060.623985 fallocate 0x01892f thru 0x025487 (0xcb59 bytes) 000129 1788531060.632185 mapwrite 0x0351e3 thru 0x03ffff (0xae1d bytes) 000130 1788531060.678313 mapwrite 0x00e316 thru 0x019d6d (0xba58 bytes) 000131 1788531060.781220 write 0x01d7bd thru 0x02046e (0x2cb2 bytes) 000132 1788531060.802246 mapread 0x01116f thru 0x011e97 (0xd29 bytes) 000133 1788531060.803838 punch from 0x0012c2 to 0x002097 (0xdd6 bytes) 000134 1788531060.819200 fallocate 0x010826 thru 0x020425 (0xfc00 bytes) 000135 1788531060.839086 fallocate 0x012d5c thru 0x02284e (0xfaf3 bytes) 000136 1788531060.854331 punch from 0x027da8 to 0x02bb11 (0x3d6a bytes) 000137 1788531060.872775 punch from 0x02a8bc to 0x03654f (0xbc94 bytes) 000138 1788531060.891180 fallocate 0x00ffcb thru 0x014974 (0x49aa bytes) 000139 1788531060.902708 trunc from 0x040000 to 0x006a51 (0x395ae bytes) 000140 1788531060.944245 trunc from 0x006a52 to 0x018f03 (0x124b2 bytes) 000141 1788531060.964693 punch from 0x0007ec to 0x00c5b6 (0xbdcb bytes) 000142 1788531060.975405 MIRROR_RESYNC 2 mirrors 000143 1788531061.535320 mapwrite 0x028bc1 thru 0x0347dd (0xbc1d bytes) 000144 1788531061.693661 trunc from 0x02a322 to 0x02c8fe (0x25dd bytes) 000146 1788531061.700612 trunc from 0x025cb2 to 0x0347dd (0xeb2c bytes) 000147 1788531061.708117 fallocate 0x03ea84 thru 0x03f01f (0x59c bytes) 000148 1788531061.723095 trunc from 0x002053 to 0x002cc3 (0xc71 bytes) 000149 1788531061.730282 mapwrite 0x00d5f8 thru 0x0152d2 (0x7cdb bytes) 000150 1788531061.777973 fallocate 0x02fb4c thru 0x03cc1c (0xd0d1 bytes) 000151 1788531061.785799 fallocate 0x002aac thru 0x00ec6d (0xc1c2 bytes) 000152 1788531061.791543 mapread 0x01751e thru 0x0196f4 (0x21d7 bytes) 000153 1788531061.803986 trunc from 0x03f020 to 0x007ab7 (0x37568 bytes) 000154 1788531061.825716 trunc from 0x007ab8 to 0x0167c0 (0xed09 bytes) 000155 1788531061.847827 mapwrite 0x010d94 thru 0x015340 (0x45ad bytes) 000156 1788531061.889710 punch from 0x004abd to 0x009188 (0x46cc bytes) 000157 1788531061.898036 punch from 0x0138c7 to 0x0167c0 (0x2efa bytes) 000158 1788531061.904266 write 0x002b0b thru 0x00d379 (0xa86f bytes) 000159 1788531061.911108 punch from 0x010b83 to 0x0167c0 (0x5c3e bytes) 000160 1788531061.920029 write 0x01691d thru 0x01df1b (0x75ff bytes) 000161 1788531061.933877 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1df1c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1df1c): Mirror 2: 0x7fad1dd2 (stale) CRC-32 checksum value for chunk [0, 0x1df1c): Mirror 1: 0x6393f67e Mirror 3: 0x6393f67e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1df1c: skipped 000162 1788531062.790309 fallocate 0x0130d2 thru 0x018287 (0x51b6 bytes) 000163 1788531062.839850 read 0x01af76 thru 0x01df1b (0x2fa6 bytes) 000164 1788531062.868744 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1df1c): Mirror 3: 0x6393f67e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1df1c): Mirror 3: 0x6393f67e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1df1c: skipped 000165 1788531063.252663 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000166 1788531063.481206 trunc from 0x01df1c to 0x007099 (0x16e82 bytes) 000167 1788531063.507658 read 0x003dd4 thru 0x007099 (0x32c6 bytes) 000168 1788531063.515530 fallocate 0x005fc5 thru 0x012176 (0xc1b2 bytes) 000169 1788531063.521522 fallocate 0x02646d thru 0x029ca1 (0x3835 bytes) 000170 1788531063.527586 trunc from 0x029ca2 to 0x03ecef (0x1504e bytes) 000171 1788531063.548413 trunc from 0x02f4cb to 0x038691 (0x91c7 bytes) 000173 1788531063.557815 mapwrite 0x036363 thru 0x03d217 (0x6eb5 bytes) 000174 1788531063.604787 read 0x010366 thru 0x01fd7d (0xfa18 bytes) 000175 1788531063.647267 write 0x02ec57 thru 0x0382ed (0x9697 bytes) 000176 1788531063.653264 mapwrite 0x01c647 thru 0x029f42 (0xd8fc bytes) 000177 1788531063.738064 MIRROR_EXTEND to 2 mirrors 000178 1788531064.817935 trunc from 0x030f6f to 0x03a67a (0x970c bytes) 000179 1788531064.867481 read 0x00a737 thru 0x011b57 (0x7421 bytes) 000180 1788531064.880898 fallocate 0x01c1c3 thru 0x02884c (0xc68a bytes) 000181 1788531064.885811 read 0x033920 thru 0x03ecef (0xb3d0 bytes) 000182 1788531064.898912 fallocate 0x024d70 thru 0x02a270 (0x5501 bytes) 000183 1788531064.910141 mapwrite 0x0099d7 thru 0x013845 (0x9e6f bytes) 000184 1788531064.948224 mapread 0x00ce1d thru 0x0151fa (0x83de bytes) 000185 1788531064.949629 read 0x0177ec thru 0x01fd35 (0x854a bytes) 000186 1788531064.952045 write 0x033455 thru 0x03d508 (0xa0b4 bytes) 000187 1788531064.961628 read 0x005771 thru 0x00e033 (0x88c3 bytes) 000188 1788531064.962648 trunc from 0x03ecf0 to 0x00ab37 (0x341b8 bytes) 000190 1788531064.997944 mapwrite 0x003734 thru 0x006f1b (0x37e8 bytes) 000192 1788531065.019921 punch from 0x008d3f to 0x00ab37 (0x1df9 bytes) 000193 1788531065.025741 read 0x0014be thru 0x006f31 (0x5a74 bytes) 000194 1788531065.026712 trunc from 0x002f8a to 0x007f31 (0x4fa8 bytes) 000195 1788531065.043394 trunc from 0x0000c7 to 0x0027a4 (0x26de bytes) 000196 1788531065.054205 MIRROR_RESYNC 2 mirrors 000197 1788531065.898599 write 0x00e474 thru 0x0182c4 (0x9e51 bytes) 000198 1788531065.940744 trunc from 0x00198f to 0x003c3e (0x22b0 bytes) 000199 1788531065.950580 write 0x037750 thru 0x03ffff (0x88b0 bytes) 000200 1788531065.954136 fallocate 0x012488 thru 0x020db5 (0xe92e bytes) 000201 1788531065.960906 read 0x03401b thru 0x037528 (0x350e bytes) 000202 1788531065.970343 read 0x02461d thru 0x02467e (0x62 bytes) 000203 1788531065.989706 write 0x028a2c thru 0x02a5b3 (0x1b88 bytes) 000204 1788531065.991139 punch from 0x017222 to 0x024358 (0xd137 bytes) 000205 1788531066.008035 mapread 0x003d29 thru 0x003de4 (0xbc bytes) 000206 1788531066.010540 trunc from 0x040000 to 0x032361 (0xdc9e bytes) 000207 1788531066.050090 trunc from 0x0126da to 0x01fdd4 (0xd6fb bytes) 000208 1788531066.055925 write 0x021573 thru 0x025929 (0x43b7 bytes) 000209 1788531066.063252 fallocate 0x01f039 thru 0x02a0a4 (0xb06c bytes) 000210 1788531066.070098 fallocate 0x038c07 thru 0x03ffff (0x73f9 bytes) 000211 1788531066.077254 write 0x020c8d thru 0x026d08 (0x607c bytes) 000212 1788531066.095731 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000213 1788531066.273182 punch from 0x00ba3b to 0x0162ec (0xa8b2 bytes) 000214 1788531066.282733 trunc from 0x002756 to 0x003024 (0x8cf bytes) 000215 1788531066.286919 mapwrite 0x03bd80 thru 0x03ffff (0x4280 bytes) 000216 1788531066.370917 read 0x01d23f thru 0x02c324 (0xf0e6 bytes) 000217 1788531066.403939 mapwrite 0x000bfc thru 0x005d75 (0x517a bytes) 000223 1788531066.520697 read 0x01f59a thru 0x02ee4b (0xf8b2 bytes) 000226 1788531066.545633 write 0x02bab5 thru 0x03afa4 (0xf4f0 bytes) 000227 1788531066.567172 trunc from 0x0093a3 to 0x017ee0 (0xeb3e bytes) 000228 1788531066.576943 mapread 0x014de1 thru 0x019969 (0x4b89 bytes) 000230 1788531066.615515 punch from 0x03f0fd to 0x03ffff (0xf03 bytes) 000231 1788531066.625137 trunc from 0x040000 to 0x017815 (0x287ea bytes) 000232 1788531066.652897 write 0x008ce0 thru 0x014670 (0xb991 bytes) 000233 1788531066.656514 write 0x00435d thru 0x00fb61 (0xb805 bytes) 000235 1788531066.659823 write 0x02ca15 thru 0x032f8b (0x6577 bytes) 000236 1788531066.665538 read 0x02cba1 thru 0x032f8b (0x63eb bytes) 000237 1788531066.666162 write 0x0272ed thru 0x033801 (0xc515 bytes) 000239 1788531066.686515 mapwrite 0x01cacb thru 0x0259d6 (0x8f0c bytes) 000240 1788531066.741173 read 0x00069d thru 0x00ccc9 (0xc62d bytes) 000241 1788531066.742910 fallocate 0x0237eb thru 0x02c2c4 (0x8ada bytes) 000242 1788531066.756915 write 0x023b95 thru 0x03201b (0xe487 bytes) 000243 1788531066.759964 write 0x03d678 thru 0x03ffff (0x2988 bytes) 000244 1788531066.762049 fallocate 0x024e60 thru 0x02a4ed (0x568e bytes) 000245 1788531066.771128 trunc from 0x040000 to 0x01b466 (0x24b99 bytes) 000246 1788531066.809378 trunc from 0x013114 to 0x01b466 (0x8353 bytes) 000247 1788531066.816124 fallocate 0x0325a5 thru 0x03550b (0x2f67 bytes) 000249 1788531066.827961 fallocate 0x01cf4b thru 0x01eef0 (0x1fa6 bytes) 000251 1788531066.841934 punch from 0x00a8fd to 0x00b7cc (0xed0 bytes) 000252 1788531066.850875 fallocate 0x0272ef thru 0x02c319 (0x502b bytes) 000253 1788531066.856105 punch from 0x012b05 to 0x0206ca (0xdbc6 bytes) 000255 1788531066.862018 mapread 0x03491b thru 0x03550b (0xbf1 bytes) 000256 1788531066.873234 mapwrite 0x02fc62 thru 0x03c693 (0xca32 bytes) 000257 1788531066.913956 mapwrite 0x0383c9 thru 0x03846b (0xa3 bytes) 000259 1788531066.931203 mapread 0x0174ed thru 0x01d6b2 (0x61c6 bytes) 000260 1788531066.932572 punch from 0x011eb9 to 0x01f86a (0xd9b2 bytes) 000261 1788531066.942331 write 0x0015b2 thru 0x00ee2b (0xd87a bytes) 000262 1788531066.944377 write 0x03d643 thru 0x03d7fc (0x1ba bytes) 000263 1788531066.945705 read 0x006feb thru 0x00a8c0 (0x38d6 bytes) 000264 1788531066.946325 mapwrite 0x03a5a7 thru 0x03ffff (0x5a59 bytes) 000266 1788531066.992645 write 0x00c46f thru 0x0199e3 (0xd575 bytes) 000267 1788531066.994942 mapwrite 0x015e54 thru 0x0247f9 (0xe9a6 bytes) 000269 1788531067.015936 read 0x0340bc thru 0x03ffff (0xbf44 bytes) 000270 1788531067.016925 trunc from 0x040000 to 0x014554 (0x2baab bytes) 000271 1788531067.035329 mapread 0x005aee thru 0x01083c (0xad4f bytes) 000272 1788531067.036642 trunc from 0x004eb9 to 0x00f557 (0xa69f bytes) 000273 1788531067.042483 mapread 0x00fe0b thru 0x0132c3 (0x34b9 bytes) 000274 1788531067.052242 mapread 0x0128ff thru 0x014554 (0x1c56 bytes) 000275 1788531067.053163 trunc from 0x014555 to 0x03413a (0x1fbe6 bytes) 000276 1788531067.068915 fallocate 0x027e44 thru 0x03107b (0x9238 bytes) 000277 1788531067.073852 read 0x00c067 thru 0x010f32 (0x4ecc bytes) 000278 1788531067.074644 mapread 0x02d0ad thru 0x03413a (0x708e bytes) 000279 1788531067.085099 trunc from 0x0126dc to 0x017ab9 (0x53de bytes) 000280 1788531067.090305 mapwrite 0x01e9ce thru 0x02578c (0x6dbf bytes) 000281 1788531067.104571 fallocate 0x01e679 thru 0x022bdc (0x4564 bytes) 000282 1788531067.109409 trunc from 0x01e6ac to 0x01ec1b (0x570 bytes) 000283 1788531067.114593 trunc from 0x0157af to 0x01cd4a (0x759c bytes) 000284 1788531067.119922 trunc from 0x03413b to 0x03e00c (0x9ed2 bytes) 000285 1788531067.144886 mapwrite 0x017e0e thru 0x022418 (0xa60b bytes) 000286 1788531067.256425 trunc from 0x000bca to 0x001040 (0x477 bytes) 000287 1788531067.267237 write 0x0084b1 thru 0x013d69 (0xb8b9 bytes) 000288 1788531067.276017 fallocate 0x003502 thru 0x009fdb (0x6ada bytes) 000289 1788531067.284157 write 0x01b28f thru 0x027ca4 (0xca16 bytes) 000292 1788531067.287382 trunc from 0x03e00d to 0x006edd (0x3712f bytes) 000294 1788531067.315919 mapwrite 0x002c44 thru 0x00a532 (0x78ef bytes) 000295 1788531067.375555 fallocate 0x01b76a thru 0x020d9d (0x5634 bytes) 000296 1788531067.382111 fallocate 0x03e3dc thru 0x03ffff (0x1c24 bytes) 000297 1788531067.390859 write 0x003862 thru 0x00595a (0x20f9 bytes) 000298 1788531067.392626 fallocate 0x01cc45 thru 0x02c3fa (0xf7b6 bytes) 000300 1788531067.398624 fallocate 0x033e9e thru 0x03ffff (0xc162 bytes) 000303 1788531067.408621 mapwrite 0x02d295 thru 0x02e20b (0xf77 bytes) 000304 1788531067.491137 trunc from 0x00919b to 0x0130c0 (0x9f26 bytes) 000305 1788531067.498917 mapwrite 0x028208 thru 0x03525a (0xd053 bytes) 000306 1788531067.651258 punch from 0x00f37d to 0x01d748 (0xe3cc bytes) 000307 1788531067.656257 write 0x02e562 thru 0x037670 (0x910f bytes) 000308 1788531067.657922 write 0x027000 thru 0x02af78 (0x3f79 bytes) 000309 1788531067.659235 read 0x02859e thru 0x034ba2 (0xc605 bytes) 000310 1788531067.660171 punch from 0x03167b to 0x037670 (0x5ff6 bytes) 000311 1788531067.679253 punch from 0x006faf to 0x007269 (0x2bb bytes) 000312 1788531067.687943 write 0x030ef2 thru 0x034db6 (0x3ec5 bytes) 000315 1788531067.729999 mapwrite 0x0270d2 thru 0x02832c (0x125b bytes) 000317 1788531067.776114 read 0x02931b thru 0x036226 (0xcf0c bytes) 000318 1788531067.783458 punch from 0x01a183 to 0x01d967 (0x37e5 bytes) 000319 1788531067.789888 mapwrite 0x0029b5 thru 0x00f5b6 (0xcc02 bytes) 000320 1788531067.858029 read 0x019e33 thru 0x02266f (0x883d bytes) 000321 1788531067.880522 mapread 0x035779 thru 0x037670 (0x1ef8 bytes) 000322 1788531067.884981 fallocate 0x000ff4 thru 0x00d55a (0xc567 bytes) 000323 1788531067.903204 write 0x005c96 thru 0x00cc83 (0x6fee bytes) 000324 1788531067.908417 fallocate 0x02f290 thru 0x03b51a (0xc28b bytes) 000325 1788531067.916250 fallocate 0x016195 thru 0x01acef (0x4b5b bytes) 000326 1788531067.933241 fallocate 0x01ec9b thru 0x02c48d (0xd7f3 bytes) 000327 1788531067.941824 read 0x0126d1 thru 0x019ff3 (0x7923 bytes) 000329 1788531067.943244 mapread 0x005c3d thru 0x01141e (0xb7e2 bytes) 000330 1788531067.944170 write 0x0281b9 thru 0x02c0d2 (0x3f1a bytes) 000332 1788531067.948929 punch from 0x0185e8 to 0x021b9f (0x95b8 bytes) 000333 1788531067.954466 trunc from 0x03b51b to 0x0355b3 (0x5f67 bytes) 000334 1788531067.971908 punch from 0x014600 to 0x023fbf (0xf9c0 bytes) 000335 1788531067.977707 punch from 0x00fcd5 to 0x00fd67 (0x93 bytes) 000336 1788531067.982470 punch from 0x023728 to 0x02c107 (0x89e0 bytes) 000338 1788531068.003204 mapread 0x030955 thru 0x0355b3 (0x4c5f bytes) 000339 1788531068.004651 punch from 0x0197ed to 0x01f753 (0x5f67 bytes) 000340 1788531068.009384 mapread 0x003f61 thru 0x00b18e (0x722e bytes) 000341 1788531068.016729 MIRROR_EXTEND to 2 mirrors 000342 1788531068.878069 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000343 1788531069.021442 mapwrite 0x03e140 thru 0x03ffff (0x1ec0 bytes) 000344 1788531069.100412 fallocate 0x01f2be thru 0x02b5c1 (0xc304 bytes) 000345 1788531069.105623 punch from 0x026c3e to 0x028309 (0x16cc bytes) 000346 1788531069.114348 mapwrite 0x017690 thru 0x01f785 (0x80f6 bytes) 000349 1788531069.159199 trunc from 0x040000 to 0x02fd41 (0x102be bytes) 000350 1788531069.206548 read 0x021b2c thru 0x023ee9 (0x23be bytes) 000351 1788531069.217933 mapwrite 0x032764 thru 0x03be4c (0x96e9 bytes) 000352 1788531069.296949 punch from 0x0078d1 to 0x011f5f (0xa68f bytes) 000353 1788531069.304892 mapread 0x010f71 thru 0x018289 (0x7319 bytes) 000354 1788531069.323432 fallocate 0x00477b thru 0x01354a (0xedd0 bytes) 000355 1788531069.331028 trunc from 0x02d358 to 0x03abf2 (0xd89b bytes) 000356 1788531069.337645 mapwrite 0x03e2d1 thru 0x03ffff (0x1d2f bytes) 000357 1788531069.381080 write 0x035e4a thru 0x03ffff (0xa1b6 bytes) 000359 1788531069.394662 mapread 0x02a8d1 thru 0x033204 (0x8934 bytes) 000360 1788531069.440370 MIRROR_EXTEND to 2 mirrors 000363 1788531070.244130 fallocate 0x013097 thru 0x01f6be (0xc628 bytes) 000364 1788531070.283581 mapwrite 0x020950 thru 0x02aebe (0xa56f bytes) 000366 1788531070.325739 trunc from 0x040000 to 0x015676 (0x2a989 bytes) 000367 1788531070.384035 trunc from 0x00f6d5 to 0x015676 (0x5fa2 bytes) 000368 1788531070.391853 mapread 0x011d87 thru 0x013d64 (0x1fde bytes) 000369 1788531070.407442 trunc from 0x015677 to 0x00a154 (0xb522 bytes) 000370 1788531070.433521 punch from 0x001718 to 0x008c9b (0x7584 bytes) 000371 1788531070.439412 write 0x02fd63 thru 0x03f8b1 (0xfb4f bytes) 000372 1788531070.442401 write 0x001d8f thru 0x004c90 (0x2f02 bytes) 000373 1788531070.453030 punch from 0x009544 to 0x010d3a (0x77f7 bytes) 000374 1788531070.458597 punch from 0x028451 to 0x02bdf8 (0x39a8 bytes) 000375 1788531070.463398 trunc from 0x03f8b2 to 0x0293a4 (0x1650d bytes) 000376 1788531070.488727 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000377 1788531070.658453 punch from 0x0228a5 to 0x0293a4 (0x6b00 bytes) 000378 1788531070.664785 fallocate 0x02672c thru 0x02752d (0xe02 bytes) 000380 1788531070.673225 read 0x0050f0 thru 0x00a4e5 (0x53f6 bytes) 000381 1788531070.687478 mapwrite 0x00f3d5 thru 0x0111c6 (0x1df2 bytes) 000383 1788531070.766032 trunc from 0x002da9 to 0x0093c4 (0x661c bytes) 000384 1788531070.771561 fallocate 0x025fa5 thru 0x030544 (0xa5a0 bytes) 000385 1788531070.783612 trunc from 0x0109f0 to 0x01182e (0xe3f bytes) 000386 1788531070.789989 punch from 0x00ac73 to 0x012f86 (0x8314 bytes) 000387 1788531070.800958 punch from 0x013d0b to 0x017679 (0x396f bytes) 000388 1788531070.817291 trunc from 0x023a89 to 0x02f463 (0xb9db bytes) 000389 1788531070.825553 mapread 0x00416d thru 0x0116fc (0xd590 bytes) 000391 1788531070.848090 mapread 0x029701 thru 0x030544 (0x6e44 bytes) 000392 1788531070.862599 read 0x022391 thru 0x02f68f (0xd2ff bytes) 000393 1788531070.868054 MIRROR_EXTEND to 2 mirrors 000394 1788531071.807410 read 0x023d7a thru 0x023f0a (0x191 bytes) 000395 1788531071.828290 write 0x00948c thru 0x017799 (0xe30e bytes) 000396 1788531071.927814 write 0x001b38 thru 0x006d00 (0x51c9 bytes) 000397 1788531071.942054 fallocate 0x011cc9 thru 0x015367 (0x369f bytes) 000398 1788531071.948796 fallocate 0x033010 thru 0x03988d (0x687e bytes) 000399 1788531071.959067 read 0x00b7b5 thru 0x01094b (0x5197 bytes) 000400 1788531071.959930 trunc from 0x019c6c to 0x01be91 (0x2226 bytes) 000401 1788531071.964900 write 0x018424 thru 0x021946 (0x9523 bytes) 000402 1788531071.992176 write 0x025bde thru 0x02d046 (0x7469 bytes) 000403 1788531071.997156 punch from 0x02e0ed to 0x030544 (0x2458 bytes) 000404 1788531072.006530 trunc from 0x030545 to 0x003dbb (0x2c789 bytes) 000405 1788531072.043654 fallocate 0x033e72 thru 0x03ffff (0xc18e bytes) 000406 1788531072.062441 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3dbc): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dbc): Mirror 2: 0xb9b8abd2 (stale) CRC-32 checksum value for chunk [0, 0x3dbc): Mirror 1: 0x8f024865 Mirror 3: 0x8f024865 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dbc: skipped 000407 1788531073.068093 mapwrite 0x00615e thru 0x014d44 (0xebe7 bytes) 000408 1788531073.237017 mapread 0x0016fb thru 0x0076a6 (0x5fac bytes) 000409 1788531073.243290 fallocate 0x03c86f thru 0x03ffff (0x3791 bytes) 000410 1788531073.271964 mapwrite 0x02d00b thru 0x036875 (0x986b bytes) 000411 1788531073.378642 trunc from 0x040000 to 0x00d950 (0x326af bytes) 000412 1788531073.406946 read 0x009ea6 thru 0x00d1a7 (0x3302 bytes) 000413 1788531073.407859 read 0x004164 thru 0x00d950 (0x97ed bytes) 000416 1788531073.410670 read 0x008f6c thru 0x00d950 (0x49e5 bytes) 000417 1788531073.411236 fallocate 0x018e88 thru 0x0213e6 (0x855f bytes) 000418 1788531073.418471 mapwrite 0x00c3b3 thru 0x00f7de (0x342c bytes) 000419 1788531073.485896 fallocate 0x017bc2 thru 0x0255c9 (0xda08 bytes) 000420 1788531073.494671 mapread 0x00b152 thru 0x014db5 (0x9c64 bytes) 000421 1788531073.511188 trunc from 0x022724 to 0x0255c9 (0x2ea6 bytes) 000424 1788531073.517452 mapread 0x000d71 thru 0x007199 (0x6429 bytes) 000425 1788531073.518906 trunc from 0x0255ca to 0x015100 (0x104c9 bytes) 000426 1788531073.548809 MIRROR_RESYNC 3 mirrors 000427 1788531074.232091 write 0x02c534 thru 0x039726 (0xd1f3 bytes) 000428 1788531074.270094 punch from 0x011085 to 0x015cd2 (0x4c4e bytes) 000429 1788531074.277118 fallocate 0x027235 thru 0x0326ea (0xb4b6 bytes) 000430 1788531074.283097 write 0x0049ba thru 0x01323c (0xe883 bytes) 000431 1788531074.301864 write 0x006e2e thru 0x00e63d (0x7810 bytes) 000432 1788531074.310854 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x39727): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39727): Mirror 2: 0x8484031b (stale) Mirror 3: 0x8484031b (stale) CRC-32 checksum value for chunk [0, 0x39727): Mirror 1: 0xa59154c2 Mirror 4: 0xa59154c2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39727: skipped 000433 1788531075.569709 trunc from 0x023ca0 to 0x0268ac (0x2c0d bytes) 000434 1788531075.644467 write 0x02590e thru 0x03310e (0xd801 bytes) 000435 1788531075.691222 trunc from 0x01f7e3 to 0x021319 (0x1b37 bytes) 000436 1788531075.731336 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39727): Mirror 2: 0x8484031b (stale) Mirror 3: 0x8484031b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39727): Mirror 2: 0x8484031b (stale) Mirror 3: 0x8484031b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39727: skipped 000437 1788531076.088656 fallocate 0x00df20 thru 0x012b27 (0x4c08 bytes) 000438 1788531076.096143 write 0x002635 thru 0x0046b0 (0x207c bytes) 000439 1788531076.110468 fallocate 0x022374 thru 0x02a5be (0x824b bytes) 000440 1788531076.119879 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39727): Mirror 2: 0x8484031b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39727): Mirror 2: 0x8484031b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39727: skipped 000441 1788531076.481182 mapread 0x012571 thru 0x01a10f (0x7b9f bytes) 000442 1788531076.513339 trunc from 0x01328d to 0x02026f (0xcfe3 bytes) 000443 1788531076.527872 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x39727): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39727): Mirror 2: 0x8484031b (stale) CRC-32 checksum value for chunk [0, 0x39727): Mirror 1: 0x6074fbcb Mirror 3: 0x6074fbcb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39727: skipped 000444 1788531077.987206 punch from 0x009513 to 0x00ff45 (0x6a33 bytes) 000446 1788531078.100932 punch from 0x030436 to 0x039726 (0x92f1 bytes) 000447 1788531078.118167 trunc from 0x00cb80 to 0x01c41e (0xf89f bytes) 000448 1788531078.131277 fallocate 0x0143fa thru 0x021142 (0xcd49 bytes) 000449 1788531078.143804 read 0x01e35b thru 0x02151f (0x31c5 bytes) 000450 1788531078.156036 fallocate 0x014c42 thru 0x01c4c8 (0x7887 bytes) 000452 1788531078.178425 fallocate 0x023c0b thru 0x0329ec (0xede2 bytes) 000453 1788531078.192642 fallocate 0x006578 thru 0x01511d (0xeba6 bytes) 000454 1788531078.210840 punch from 0x00c132 to 0x013a38 (0x7907 bytes) 000457 1788531078.218340 mapwrite 0x03fdd8 thru 0x03ffff (0x228 bytes) 000458 1788531078.336666 trunc from 0x02f052 to 0x02f0f7 (0xa6 bytes) 000459 1788531078.351074 trunc from 0x021371 to 0x02b792 (0xa422 bytes) 000460 1788531078.377834 MIRROR_RESYNC 3 mirrors 000461 1788531079.712342 MIRROR_EXTEND to 4 mirrors 000463 1788531080.784872 fallocate 0x009dbb thru 0x00aebf (0x1105 bytes) 000464 1788531080.846039 trunc from 0x040000 to 0x0397ad (0x6852 bytes) 000465 1788531080.880411 mapwrite 0x030dcb thru 0x03c496 (0xb6cc bytes) 000466 1788531080.974926 trunc from 0x009c18 to 0x00ef4f (0x5338 bytes) 000467 1788531080.984076 fallocate 0x029fb1 thru 0x0324b6 (0x8506 bytes) 000468 1788531081.001323 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3c497): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c497): Mirror 2: 0xa66bee5d (stale) Mirror 3: 0xa66bee5d (stale) Mirror 4: 0xa66bee5d (stale) CRC-32 checksum value for chunk [0, 0x3c497): Mirror 1: 0xa4add88d Mirror 5: 0xa4add88d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c497: skipped 000470 1788531082.049217 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3c497): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c497): Mirror 2: 0xa66bee5d (stale) Mirror 3: 0xa66bee5d (stale) Mirror 4: 0xa66bee5d (stale) CRC-32 checksum value for chunk [0, 0x3c497): Mirror 1: 0xa4add88d Mirror 5: 0xa4add88d Mirror 6: 0xa4add88d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c497: skipped 000471 1788531083.062006 mapread 0x034e50 thru 0x03c496 (0x7647 bytes) 000472 1788531083.080400 trunc from 0x03c497 to 0x02130b (0x1b18b bytes) 000473 1788531083.166305 write 0x01c3b7 thru 0x029989 (0xd5d3 bytes) 000474 1788531083.178153 trunc from 0x0262a5 to 0x029989 (0x36e5 bytes) 000475 1788531083.214764 trunc from 0x00c8bd to 0x013c3a (0x737e bytes) 000476 1788531083.231656 write 0x0106f2 thru 0x01be71 (0xb780 bytes) 000478 1788531083.259559 write 0x00954e thru 0x0105ce (0x7081 bytes) 000479 1788531083.284113 write 0x0342dc thru 0x03ffff (0xbd24 bytes) 000480 1788531083.301914 read 0x021309 thru 0x02d24e (0xbf46 bytes) 000481 1788531083.352230 read 0x028b36 thru 0x035126 (0xc5f1 bytes) 000482 1788531083.399583 write 0x03350c thru 0x035847 (0x233c bytes) 000483 1788531083.401099 fallocate 0x00c64a thru 0x012bc3 (0x657a bytes) 000484 1788531083.428446 read 0x03a075 thru 0x03ffff (0x5f8b bytes) 000485 1788531083.437889 MIRROR_RESYNC 6 mirrors 000486 1788531085.000781 fallocate 0x010594 thru 0x016138 (0x5ba5 bytes) 000487 1788531085.038372 mapwrite 0x002454 thru 0x00f9d8 (0xd585 bytes) 000488 1788531085.091036 read 0x02a603 thru 0x030ad5 (0x64d3 bytes) 000489 1788531085.102677 fallocate 0x037868 thru 0x03fd61 (0x84fa bytes) 000490 1788531085.108123 read 0x03d0bd thru 0x03ffff (0x2f43 bytes) 000492 1788531085.135864 fallocate 0x0238cc thru 0x02436f (0xaa4 bytes) 000493 1788531085.141464 trunc from 0x030060 to 0x03383d (0x37de bytes) 000494 1788531085.148675 mapread 0x00f239 thru 0x017015 (0x7ddd bytes) 000495 1788531085.149810 punch from 0x02c8cf to 0x03183a (0x4f6c bytes) 000496 1788531085.154974 fallocate 0x022e4d thru 0x02d11a (0xa2ce bytes) 000497 1788531085.160714 write 0x012aa2 thru 0x012f2f (0x48e bytes) 000498 1788531085.161974 trunc from 0x040000 to 0x03242d (0xdbd2 bytes) 000499 1788531085.198566 read 0x0185da thru 0x01a14a (0x1b71 bytes) 000500 1788531085.199181 write 0x03934a thru 0x03ffff (0x6cb6 bytes) 000501 1788531085.202624 trunc from 0x040000 to 0x00bb78 (0x34487 bytes) 000502 1788531085.235721 mapread 0x00b654 thru 0x00bb78 (0x525 bytes) 000503 1788531085.236742 punch from 0x003745 to 0x009f6c (0x6828 bytes) 000504 1788531085.245189 fallocate 0x035498 thru 0x039388 (0x3ef1 bytes) 000505 1788531085.250868 punch from 0x0005bd to 0x009aec (0x9530 bytes) 000506 1788531085.258277 fallocate 0x0022bc thru 0x01090b (0xe650 bytes) 000507 1788531085.266996 mapread 0x0094a8 thru 0x00acbe (0x1817 bytes) 000508 1788531085.278512 punch from 0x002b9b to 0x010396 (0xd7fc bytes) 000510 1788531085.284970 trunc from 0x01043e to 0x01090b (0x4ce bytes) 000511 1788531085.290873 read 0x006b74 thru 0x0106e7 (0x9b74 bytes) 000512 1788531085.306187 mapwrite 0x03f233 thru 0x03ffff (0xdcd bytes) 000513 1788531085.354270 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x15c78e05 (stale) Mirror 3: 0x15c78e05 (stale) Mirror 4: 0x15c78e05 (stale) Mirror 5: 0x15c78e05 (stale) Mirror 6: 0x15c78e05 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x32f8b566 Mirror 7: 0x32f8b566 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000514 1788531086.410175 trunc from 0x040000 to 0x007135 (0x38eca bytes) 000515 1788531086.500602 write 0x029f64 thru 0x02a759 (0x7f6 bytes) 000516 1788531086.501801 mapwrite 0x008e19 thru 0x00f8bd (0x6aa5 bytes) 000517 1788531086.577980 write 0x002ef6 thru 0x0122bc (0xf3c7 bytes) 000518 1788531086.591898 trunc from 0x015fed to 0x024563 (0xe577 bytes) 000519 1788531086.604870 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2a75a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a75a): Mirror 2: 0xd62f3a6 (stale) Mirror 3: 0xd62f3a6 (stale) Mirror 4: 0xd62f3a6 (stale) Mirror 5: 0xd62f3a6 (stale) Mirror 6: 0xd62f3a6 (stale) Mirror 7: 0x2cc1e1c5 (stale) CRC-32 checksum value for chunk [0, 0x2a75a): Mirror 1: 0x52577c66 Mirror 8: 0x52577c66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a75a: skipped 000520 1788531087.912461 read 0x00a3bc thru 0x00b4c8 (0x110d bytes) 000521 1788531087.949878 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2a75a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a75a): Mirror 2: 0xd62f3a6 (stale) Mirror 3: 0xd62f3a6 (stale) Mirror 4: 0xd62f3a6 (stale) Mirror 5: 0xd62f3a6 (stale) Mirror 6: 0xd62f3a6 (stale) Mirror 7: 0x2cc1e1c5 (stale) CRC-32 checksum value for chunk [0, 0x2a75a): Mirror 1: 0x52577c66 Mirror 8: 0x52577c66 Mirror 9: 0x52577c66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a75a: skipped 000522 1788531089.274395 read 0x0199ff thru 0x022d92 (0x9394 bytes) 000523 1788531089.284062 punch from 0x000b75 to 0x00dabc (0xcf48 bytes) 000524 1788531089.362805 punch from 0x018133 to 0x01bf04 (0x3dd2 bytes) 000525 1788531089.371409 trunc from 0x02a75a to 0x028556 (0x2203 bytes) 000526 1788531089.418543 MIRROR_RESYNC 9 mirrors 000527 1788531092.129940 read 0x01c2c7 thru 0x028106 (0xbe40 bytes) 000528 1788531092.142608 mapwrite 0x0146ec thru 0x018363 (0x3c78 bytes) 000529 1788531092.257470 punch from 0x000020 to 0x00d339 (0xd31a bytes) 000530 1788531092.265169 trunc from 0x0194fe to 0x028556 (0xf059 bytes) 000532 1788531092.272402 fallocate 0x0354c6 thru 0x03fa95 (0xa5d0 bytes) 000533 1788531092.277785 mapread 0x01448f thru 0x023aa1 (0xf613 bytes) 000534 1788531092.322859 MIRROR_RESYNC 9 mirrors 000535 1788531095.189563 write 0x02fe26 thru 0x03d3ec (0xd5c7 bytes) 000536 1788531095.245387 read 0x0083fc thru 0x00fb0a (0x770f bytes) 000537 1788531095.263271 punch from 0x021542 to 0x0227e7 (0x12a6 bytes) 000538 1788531095.289891 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3d3ed): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3ed): Mirror 2: 0x4ee9b718 (stale) Mirror 3: 0x4ee9b718 (stale) Mirror 4: 0x4ee9b718 (stale) Mirror 5: 0x4ee9b718 (stale) Mirror 6: 0x4ee9b718 (stale) Mirror 7: 0x4ee9b718 (stale) Mirror 8: 0x4ee9b718 (stale) Mirror 9: 0x4ee9b718 (stale) CRC-32 checksum value for chunk [0, 0x3d3ed): Mirror 1: 0x64d53d88 Mirror 10: 0x64d53d88 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3ed: skipped 000540 1788531096.553150 trunc from 0x03d3ed to 0x011760 (0x2bc8c bytes) 000541 1788531096.667384 mapread 0x0104ca thru 0x011760 (0x1297 bytes) 000542 1788531096.689693 mapread 0x00126f thru 0x00d8b7 (0xc649 bytes) 000543 1788531096.712724 trunc from 0x010199 to 0x011760 (0x15c8 bytes) 000544 1788531096.726018 read 0x00e567 thru 0x011760 (0x31fa bytes) 000545 1788531096.747137 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x11761): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11761): Mirror 2: 0xda6e91d2 (stale) Mirror 3: 0xda6e91d2 (stale) Mirror 4: 0xda6e91d2 (stale) Mirror 5: 0xda6e91d2 (stale) Mirror 6: 0xda6e91d2 (stale) Mirror 7: 0xda6e91d2 (stale) Mirror 8: 0xda6e91d2 (stale) Mirror 9: 0xda6e91d2 (stale) Mirror 10: 0xda6e91d2 (stale) CRC-32 checksum value for chunk [0, 0x11761): Mirror 1: 0x626a7d65 Mirror 11: 0x626a7d65 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11761: skipped 000546 1788531098.312444 write 0x00df3a thru 0x00f02f (0x10f6 bytes) 000547 1788531098.439715 write 0x0350cb thru 0x03c284 (0x71ba bytes) 000548 1788531098.447911 MIRROR_RESYNC 11 mirrors 000549 1788531101.380943 trunc from 0x032983 to 0x03c284 (0x9902 bytes) 000550 1788531101.429252 trunc from 0x03c285 to 0x02c005 (0x1027f bytes) 000551 1788531101.467349 mapread 0x00b9cc thru 0x019875 (0xdeaa bytes) 000552 1788531101.532366 trunc from 0x0291cf to 0x02c005 (0x2e37 bytes) 000553 1788531101.544904 write 0x01fdf6 thru 0x02c936 (0xcb41 bytes) 000554 1788531101.558528 trunc from 0x02c937 to 0x031f00 (0x55ca bytes) 000555 1788531101.574452 mapread 0x010894 thru 0x0129c3 (0x2130 bytes) 000556 1788531101.575351 write 0x010edd thru 0x01c634 (0xb758 bytes) 000557 1788531101.577929 fallocate 0x03675e thru 0x03ffff (0x98a2 bytes) 000558 1788531101.583347 write 0x0245e8 thru 0x026bc5 (0x25de bytes) 000560 1788531101.584825 write 0x035dd3 thru 0x03ffff (0xa22d bytes) 000561 1788531101.591554 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xab0d3b73 (stale) Mirror 3: 0xab0d3b73 (stale) Mirror 4: 0xab0d3b73 (stale) Mirror 5: 0xab0d3b73 (stale) Mirror 6: 0xab0d3b73 (stale) Mirror 7: 0xab0d3b73 (stale) Mirror 8: 0xab0d3b73 (stale) Mirror 9: 0xab0d3b73 (stale) Mirror 11: 0xab0d3b73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xab0d3b73 (stale) Mirror 3: 0xab0d3b73 (stale) Mirror 4: 0xab0d3b73 (stale) Mirror 5: 0xab0d3b73 (stale) Mirror 6: 0xab0d3b73 (stale) Mirror 7: 0xab0d3b73 (stale) Mirror 8: 0xab0d3b73 (stale) Mirror 9: 0xab0d3b73 (stale) Mirror 11: 0xab0d3b73 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000562 1788531102.304821 fallocate 0x03cff8 thru 0x03df61 (0xf6a bytes) 000563 1788531102.311917 read 0x03d165 thru 0x03e82b (0x16c7 bytes) 000564 1788531102.319696 punch from 0x01de50 to 0x02003f (0x21f0 bytes) 000566 1788531102.342384 write 0x01457b thru 0x01c42f (0x7eb5 bytes) 000567 1788531102.368294 fallocate 0x0312c3 thru 0x034e03 (0x3b41 bytes) 000568 1788531102.377920 write 0x027757 thru 0x035835 (0xe0df bytes) 000569 1788531102.414216 MIRROR_RESYNC 10 mirrors 000570 1788531104.991325 mapwrite 0x026201 thru 0x03211b (0xbf1b bytes) 000571 1788531105.185253 fallocate 0x011151 thru 0x01285b (0x170b bytes) 000572 1788531105.191981 trunc from 0x02523f to 0x02f8ed (0xa6af bytes) 000573 1788531105.199107 punch from 0x02bca2 to 0x03834f (0xc6ae bytes) 000574 1788531105.214743 mapread 0x029d17 thru 0x02d0e3 (0x33cd bytes) 000575 1788531105.270743 mapwrite 0x014949 thru 0x018beb (0x42a3 bytes) 000576 1788531105.369050 read 0x00b07f thru 0x00d994 (0x2916 bytes) 000577 1788531105.376147 write 0x005faa thru 0x014b66 (0xebbd bytes) 000578 1788531105.408228 trunc from 0x040000 to 0x025883 (0x1a77c bytes) 000579 1788531105.446378 fallocate 0x028a80 thru 0x029cdc (0x125d bytes) 000580 1788531105.455696 fallocate 0x02e6ee thru 0x03865b (0x9f6e bytes) 000581 1788531105.469853 mapwrite 0x01933e thru 0x027303 (0xdfc6 bytes) 000582 1788531105.603215 read 0x0211f5 thru 0x021a1c (0x828 bytes) 000583 1788531105.603889 punch from 0x0246b6 to 0x02e665 (0x9fb0 bytes) 000586 1788531105.610083 punch from 0x0089b4 to 0x00d871 (0x4ebe bytes) 000588 1788531105.617325 write 0x000bab thru 0x00346e (0x28c4 bytes) 000590 1788531105.629970 trunc from 0x03865c to 0x03b5f6 (0x2f9b bytes) 000591 1788531105.644127 write 0x030be5 thru 0x030f3b (0x357 bytes) 000593 1788531105.645539 punch from 0x00311c to 0x004d0e (0x1bf3 bytes) 000594 1788531105.666270 write 0x01ad96 thru 0x027082 (0xc2ed bytes) 000595 1788531105.667870 mapread 0x01f3d9 thru 0x02bac0 (0xc6e8 bytes) 000596 1788531105.669634 mapread 0x019223 thru 0x02875f (0xf53d bytes) 000597 1788531105.671033 read 0x02f661 thru 0x03b097 (0xba37 bytes) 000599 1788531105.681255 mapread 0x006606 thru 0x00d015 (0x6a10 bytes) 000600 1788531105.686590 MIRROR_RESYNC 10 mirrors 000601 1788531109.475777 mapwrite 0x02ee78 thru 0x02f361 (0x4ea bytes) 000602 1788531109.678208 fallocate 0x02321d thru 0x0326d2 (0xf4b6 bytes) 000603 1788531109.701424 write 0x028a99 thru 0x02fb5a (0x70c2 bytes) 000604 1788531109.712259 mapread 0x020ab8 thru 0x025579 (0x4ac2 bytes) 000605 1788531109.748440 trunc from 0x034ae5 to 0x03b5f6 (0x6b12 bytes) 000606 1788531109.754053 trunc from 0x039c96 to 0x03b5f6 (0x1961 bytes) 000607 1788531109.761265 write 0x02c47f thru 0x03926a (0xcdec bytes) 000609 1788531109.770277 trunc from 0x03b5f7 to 0x0206e7 (0x1af0f bytes) 000610 1788531109.801215 write 0x029fbe thru 0x0322cb (0x830e bytes) 000611 1788531109.808952 punch from 0x02f320 to 0x030bd9 (0x18ba bytes) 000612 1788531109.847959 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x322cc): Mirror 3: 0x695b4b17 (stale) Mirror 4: 0x695b4b17 (stale) Mirror 5: 0x695b4b17 (stale) Mirror 6: 0x695b4b17 (stale) Mirror 7: 0x695b4b17 (stale) Mirror 8: 0x695b4b17 (stale) Mirror 9: 0x695b4b17 (stale) Mirror 11: 0x695b4b17 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x322cc): Mirror 3: 0x695b4b17 (stale) Mirror 4: 0x695b4b17 (stale) Mirror 5: 0x695b4b17 (stale) Mirror 6: 0x695b4b17 (stale) Mirror 7: 0x695b4b17 (stale) Mirror 8: 0x695b4b17 (stale) Mirror 9: 0x695b4b17 (stale) Mirror 11: 0x695b4b17 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x322cc: skipped 000613 1788531110.698638 write 0x0065da thru 0x013444 (0xce6b bytes) 000614 1788531110.717414 mapread 0x0253c0 thru 0x02c929 (0x756a bytes) 000615 1788531110.765056 mapwrite 0x002235 thru 0x009d30 (0x7afc bytes) 000616 1788531110.860363 fallocate 0x02d00f thru 0x03a3b1 (0xd3a3 bytes) 000617 1788531110.873267 mapwrite 0x005a9d thru 0x00eb10 (0x9074 bytes) 000618 1788531110.923033 trunc from 0x02adc4 to 0x033182 (0x83bf bytes) 000619 1788531110.937864 write 0x024bce thru 0x026c72 (0x20a5 bytes) 000620 1788531110.944176 write 0x012d34 thru 0x0218c2 (0xeb8f bytes) 000621 1788531110.946283 mapwrite 0x020f32 thru 0x030252 (0xf321 bytes) 000623 1788531111.050978 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3a3b2): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a3b2): Mirror 3: 0x7bbb9095 (stale) Mirror 4: 0x7bbb9095 (stale) Mirror 5: 0x7bbb9095 (stale) Mirror 6: 0x7bbb9095 (stale) Mirror 7: 0x7bbb9095 (stale) Mirror 8: 0x7bbb9095 (stale) Mirror 9: 0x7bbb9095 (stale) Mirror 11: 0x7bbb9095 (stale) CRC-32 checksum value for chunk [0, 0x3a3b2): Mirror 1: 0x49d24ff9 Mirror 12: 0x49d24ff9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a3b2: skipped 000624 1788531112.555657 fallocate 0x008c78 thru 0x014e4a (0xc1d3 bytes) 000625 1788531112.692071 mapread 0x019321 thru 0x027506 (0xe1e6 bytes) 000626 1788531112.721188 trunc from 0x034c8d to 0x03a3b1 (0x5725 bytes) 000627 1788531112.726840 mapread 0x0344d7 thru 0x03a3b1 (0x5edb bytes) 000628 1788531112.741725 trunc from 0x0248e1 to 0x031686 (0xcda6 bytes) 000629 1788531112.749929 punch from 0x01d072 to 0x0293c8 (0xc357 bytes) 000630 1788531112.773279 read 0x012f7b thru 0x0194f0 (0x6576 bytes) 000631 1788531112.794051 read 0x00d16a thru 0x016132 (0x8fc9 bytes) 000632 1788531112.853272 trunc from 0x03a3b2 to 0x034f89 (0x5428 bytes) 000634 1788531112.933344 fallocate 0x0327bd thru 0x03d299 (0xaadd bytes) 000635 1788531112.941185 fallocate 0x02f3f4 thru 0x034490 (0x509d bytes) 000636 1788531112.947282 punch from 0x02324a to 0x02c7bf (0x9576 bytes) 000637 1788531112.953177 trunc from 0x019b70 to 0x02182b (0x7cbc bytes) 000638 1788531112.959743 read 0x02d873 thru 0x037d32 (0xa4c0 bytes) 000639 1788531112.974233 read 0x00dfec thru 0x01ad9c (0xcdb1 bytes) 000640 1788531112.975408 fallocate 0x017e4f thru 0x023844 (0xb9f6 bytes) 000641 1788531112.988626 mapwrite 0x00c764 thru 0x013242 (0x6adf bytes) 000642 1788531113.021683 mapread 0x0154d9 thru 0x021af5 (0xc61d bytes) 000643 1788531113.024480 mapread 0x024c56 thru 0x034621 (0xf9cc bytes) 000644 1788531113.025961 trunc from 0x027bd8 to 0x0336f0 (0xbb19 bytes) 000645 1788531113.037027 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d29a): Mirror 3: 0x78c295c (stale) Mirror 4: 0x78c295c (stale) Mirror 5: 0x78c295c (stale) Mirror 6: 0x78c295c (stale) Mirror 7: 0x78c295c (stale) Mirror 8: 0x78c295c (stale) Mirror 9: 0x78c295c (stale) Mirror 11: 0x78c295c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d29a): Mirror 3: 0x78c295c (stale) Mirror 4: 0x78c295c (stale) Mirror 5: 0x78c295c (stale) Mirror 6: 0x78c295c (stale) Mirror 7: 0x78c295c (stale) Mirror 8: 0x78c295c (stale) Mirror 9: 0x78c295c (stale) Mirror 11: 0x78c295c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d29a: skipped 000647 1788531113.848424 fallocate 0x03d1c1 thru 0x03ffff (0x2e3f bytes) 000648 1788531113.862560 mapread 0x008903 thru 0x00ea86 (0x6184 bytes) 000649 1788531113.908634 trunc from 0x00134d to 0x0039e8 (0x269c bytes) 000650 1788531113.914354 punch from 0x00c036 to 0x015341 (0x930c bytes) 000652 1788531113.922773 read 0x02f75f thru 0x032c32 (0x34d4 bytes) 000653 1788531113.928439 mapread 0x0164e0 thru 0x020324 (0x9e45 bytes) 000654 1788531113.961178 mapwrite 0x037632 thru 0x03ffff (0x89ce bytes) 000655 1788531114.026948 write 0x01fff1 thru 0x025500 (0x5510 bytes) 000656 1788531114.031207 read 0x03b624 thru 0x03e2b8 (0x2c95 bytes) 000658 1788531114.033815 mapread 0x0306fe thru 0x03b651 (0xaf54 bytes) 000659 1788531114.042388 MIRROR_RESYNC 9 mirrors 000660 1788531118.500045 read 0x02fc3a thru 0x036d0f (0x70d6 bytes) 000661 1788531118.524918 write 0x02c460 thru 0x033885 (0x7426 bytes) 000662 1788531118.586950 MIRROR_RESYNC 9 mirrors 000663 1788531123.748912 mapread 0x015a35 thru 0x025a22 (0xffee bytes) 000664 1788531123.792392 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000665 1788531124.626041 fallocate 0x0277ec thru 0x03026c (0x8a81 bytes) 000666 1788531124.728305 trunc from 0x040000 to 0x02579a (0x1a865 bytes) 000668 1788531124.767099 write 0x02633d thru 0x02aa25 (0x46e9 bytes) 000669 1788531124.784706 MIRROR_RESYNC 8 mirrors 000670 1788531127.388054 punch from 0x021e30 to 0x02aa25 (0x8bf6 bytes) 000672 1788531127.467862 trunc from 0x00c9cf to 0x01930c (0xc93e bytes) 000673 1788531127.474848 mapread 0x00a8d9 thru 0x00dea7 (0x35cf bytes) 000674 1788531127.527080 trunc from 0x0290fb to 0x02aa25 (0x192b bytes) 000675 1788531127.534751 punch from 0x019ab0 to 0x01c449 (0x299a bytes) 000676 1788531127.546179 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2aa26): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aa26): Mirror 3: 0xf2d0fbe6 (stale) Mirror 5: 0xf2d0fbe6 (stale) Mirror 6: 0xf2d0fbe6 (stale) Mirror 7: 0xf2d0fbe6 (stale) Mirror 8: 0xf2d0fbe6 (stale) Mirror 9: 0xf2d0fbe6 (stale) Mirror 11: 0xf2d0fbe6 (stale) CRC-32 checksum value for chunk [0, 0x2aa26): Mirror 1: 0xcc54438c Mirror 12: 0xcc54438c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aa26: skipped 000677 1788531129.376919 punch from 0x028d01 to 0x02aa25 (0x1d25 bytes) 000678 1788531129.469860 trunc from 0x00b6dd to 0x016b75 (0xb499 bytes) 000679 1788531129.483254 fallocate 0x03dda0 thru 0x03ffff (0x2260 bytes) 000680 1788531129.492621 punch from 0x002d1e to 0x00a257 (0x753a bytes) 000681 1788531129.501998 punch from 0x010fb0 to 0x01dad2 (0xcb23 bytes) 000682 1788531129.521650 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x277fb066 (stale) Mirror 5: 0x277fb066 (stale) Mirror 7: 0x277fb066 (stale) Mirror 8: 0x277fb066 (stale) Mirror 9: 0x277fb066 (stale) Mirror 11: 0x277fb066 (stale) Mirror 12: 0xed18cbd6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x277fb066 (stale) Mirror 5: 0x277fb066 (stale) Mirror 7: 0x277fb066 (stale) Mirror 8: 0x277fb066 (stale) Mirror 9: 0x277fb066 (stale) Mirror 11: 0x277fb066 (stale) Mirror 12: 0xed18cbd6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000683 1788531130.237767 punch from 0x03c82f to 0x03ffff (0x37d1 bytes) 000684 1788531130.244268 trunc from 0x00d6a3 to 0x016a6e (0x93cc bytes) 000685 1788531130.257283 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x277fb066 (stale) Mirror 5: 0x277fb066 (stale) Mirror 7: 0x277fb066 (stale) Mirror 8: 0x277fb066 (stale) Mirror 9: 0x277fb066 (stale) Mirror 11: 0x277fb066 (stale) Mirror 12: 0xed18cbd6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x52ad6c55 Mirror 13: 0x52ad6c55 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000686 1788531132.265388 mapread 0x01c7cd thru 0x02c13b (0xf96f bytes) 000687 1788531132.360996 trunc from 0x040000 to 0x001228 (0x3edd7 bytes) 000689 1788531132.492293 write 0x021092 thru 0x02ff8b (0xeefa bytes) 000690 1788531132.499355 mapread 0x00e586 thru 0x013995 (0x5410 bytes) 000691 1788531132.518107 write 0x01107a thru 0x0167da (0x5761 bytes) 000693 1788531132.523409 trunc from 0x02ff8c to 0x0184fb (0x17a90 bytes) 000694 1788531132.562407 trunc from 0x013fe9 to 0x01746b (0x3483 bytes) 000695 1788531132.592426 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x184fc): Mirror 5: 0xe5620483 (stale) Mirror 7: 0xe5620483 (stale) Mirror 8: 0xe5620483 (stale) Mirror 9: 0xe5620483 (stale) Mirror 11: 0xe5620483 (stale) Mirror 12: 0xf0d1879 (stale) Mirror 13: 0x5afeca0a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x184fc): Mirror 5: 0xe5620483 (stale) Mirror 7: 0xe5620483 (stale) Mirror 8: 0xe5620483 (stale) Mirror 9: 0xe5620483 (stale) Mirror 11: 0xe5620483 (stale) Mirror 12: 0xf0d1879 (stale) Mirror 13: 0x5afeca0a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x184fc: skipped 000696 1788531133.335226 read 0x00f874 thru 0x013760 (0x3eed bytes) 000697 1788531133.349840 mapread 0x0140b0 thru 0x0184fb (0x444c bytes) 000698 1788531133.366407 read 0x009f5f thru 0x012199 (0x823b bytes) 000699 1788531133.377031 fallocate 0x01bb7a thru 0x023e00 (0x8287 bytes) 000700 1788531133.382778 trunc from 0x011e5f to 0x017623 (0x57c5 bytes) 000701 1788531133.388072 read 0x006a39 thru 0x00d5df (0x6ba7 bytes) 000702 1788531133.388915 punch from 0x0038a9 to 0x00a409 (0x6b61 bytes) 000703 1788531133.394109 trunc from 0x0184fc to 0x02c5e9 (0x140ee bytes) 000705 1788531133.421158 fallocate 0x015ce3 thru 0x024873 (0xeb91 bytes) 000706 1788531133.427464 trunc from 0x02c5ea to 0x038498 (0xbeaf bytes) 000708 1788531133.449004 trunc from 0x01ba45 to 0x02689a (0xae56 bytes) 000709 1788531133.454439 trunc from 0x010bf8 to 0x013d1c (0x3125 bytes) 000710 1788531133.459825 write 0x030f2b thru 0x038273 (0x7349 bytes) 000712 1788531133.479566 mapwrite 0x03d10d thru 0x03ffff (0x2ef3 bytes) 000714 1788531133.536353 mapread 0x000e51 thru 0x001b8e (0xd3e bytes) 000715 1788531133.538060 trunc from 0x02b763 to 0x03758d (0xbe2b bytes) 000716 1788531133.546142 write 0x00d5fb thru 0x01c1c6 (0xebcc bytes) 000717 1788531133.549046 mapread 0x0252dd thru 0x02551f (0x243 bytes) 000718 1788531133.550927 mapwrite 0x0264f4 thru 0x02e1ef (0x7cfc bytes) 000719 1788531133.606947 trunc from 0x040000 to 0x008f2d (0x370d2 bytes) 000720 1788531133.633401 trunc from 0x006256 to 0x008f2d (0x2cd8 bytes) 000721 1788531133.640057 trunc from 0x008f2e to 0x01e320 (0x153f3 bytes) 000722 1788531133.656699 trunc from 0x01e321 to 0x0149af (0x9971 bytes) 000723 1788531133.676202 trunc from 0x00f6f3 to 0x011c89 (0x2597 bytes) 000725 1788531133.682674 trunc from 0x0019f7 to 0x0108a9 (0xeeb3 bytes) 000726 1788531133.691389 mapwrite 0x02b0ad thru 0x02ee08 (0x3d5c bytes) 000727 1788531133.747739 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ee09): Mirror 7: 0xe0b14277 (stale) Mirror 8: 0xe0b14277 (stale) Mirror 9: 0xe0b14277 (stale) Mirror 11: 0xe0b14277 (stale) Mirror 12: 0x6eaf61e3 (stale) Mirror 13: 0x7d20aaa3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ee09): Mirror 7: 0xe0b14277 (stale) Mirror 8: 0xe0b14277 (stale) Mirror 9: 0xe0b14277 (stale) Mirror 11: 0xe0b14277 (stale) Mirror 12: 0x6eaf61e3 (stale) Mirror 13: 0x7d20aaa3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ee09: skipped 000728 1788531134.405400 mapwrite 0x036388 thru 0x03d081 (0x6cfa bytes) 000729 1788531134.498912 write 0x019cdf thru 0x022cdf (0x9001 bytes) 000730 1788531134.520205 read 0x009d26 thru 0x00af1c (0x11f7 bytes) 000731 1788531134.536034 mapread 0x025c9b thru 0x031f02 (0xc268 bytes) 000732 1788531134.582216 mapwrite 0x01c30e thru 0x01e513 (0x2206 bytes) 000733 1788531134.601980 fallocate 0x022800 thru 0x031c0c (0xf40d bytes) 000734 1788531134.615198 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3d082): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d082): Mirror 7: 0x37379c94 (stale) Mirror 8: 0x37379c94 (stale) Mirror 9: 0x37379c94 (stale) Mirror 11: 0x37379c94 (stale) Mirror 12: 0x9e2e701 (stale) Mirror 13: 0x597d8cd1 (stale) CRC-32 checksum value for chunk [0, 0x3d082): Mirror 1: 0x12dcae80 Mirror 14: 0x12dcae80 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d082: skipped 000735 1788531136.089669 punch from 0x020c7a to 0x024ca1 (0x4028 bytes) 000736 1788531136.167729 mapread 0x006857 thru 0x00ebab (0x8355 bytes) 000738 1788531136.199731 write 0x01bf17 thru 0x022b28 (0x6c12 bytes) 000739 1788531136.220010 trunc from 0x03d082 to 0x0053b6 (0x37ccb bytes) 000740 1788531136.252222 trunc from 0x000bff to 0x0053b6 (0x47b8 bytes) 000741 1788531136.257856 trunc from 0x0053b7 to 0x0162e4 (0x10f2e bytes) 000742 1788531136.284697 mapread 0x009951 thru 0x00c421 (0x2ad1 bytes) 000744 1788531136.322258 write 0x036698 thru 0x03dd45 (0x76ae bytes) 000745 1788531136.324782 mapread 0x02bc89 thru 0x0392e8 (0xd660 bytes) 000746 1788531136.378360 fallocate 0x014897 thru 0x018e63 (0x45cd bytes) 000747 1788531136.393550 punch from 0x00fd80 to 0x013482 (0x3703 bytes) 000748 1788531136.401658 trunc from 0x03dd46 to 0x03e4ca (0x785 bytes) 000749 1788531136.424278 write 0x03ab38 thru 0x03ffff (0x54c8 bytes) 000750 1788531136.427703 mapwrite 0x037cf3 thru 0x03a4e5 (0x27f3 bytes) 000751 1788531136.461119 mapwrite 0x023dcc thru 0x02a90b (0x6b40 bytes) 000752 1788531136.495652 mapwrite 0x032340 thru 0x03d154 (0xae15 bytes) 000753 1788531136.548770 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x277fb066 (stale) Mirror 8: 0x277fb066 (stale) Mirror 9: 0x277fb066 (stale) Mirror 11: 0x277fb066 (stale) Mirror 12: 0xed18cbd6 (stale) Mirror 14: 0x4fceebda (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x277fb066 (stale) Mirror 8: 0x277fb066 (stale) Mirror 9: 0x277fb066 (stale) Mirror 11: 0x277fb066 (stale) Mirror 12: 0xed18cbd6 (stale) Mirror 14: 0x4fceebda (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000754 1788531137.259100 trunc from 0x040000 to 0x03f82e (0x7d1 bytes) 000755 1788531137.287270 fallocate 0x012844 thru 0x01cfb7 (0xa774 bytes) 000756 1788531137.306276 mapwrite 0x002146 thru 0x00f9a1 (0xd85c bytes) 000757 1788531137.368755 write 0x003375 thru 0x00bea3 (0x8b2f bytes) 000758 1788531137.370102 mapwrite 0x013dce thru 0x0141ac (0x3df bytes) 000759 1788531137.444828 mapread 0x03232b thru 0x036699 (0x436f bytes) 000760 1788531137.467496 mapwrite 0x02252f thru 0x02a0d7 (0x7ba9 bytes) 000761 1788531137.518354 mapwrite 0x0038d3 thru 0x004282 (0x9b0 bytes) 000762 1788531137.536629 mapwrite 0x02bf46 thru 0x033a16 (0x7ad1 bytes) 000764 1788531137.558781 write 0x019264 thru 0x01b9d1 (0x276e bytes) 000765 1788531137.559824 read 0x018a81 thru 0x0213dd (0x895d bytes) 000766 1788531137.565169 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3f82f): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f82f): Mirror 7: 0x789c076b (stale) Mirror 8: 0x789c076b (stale) Mirror 9: 0x789c076b (stale) Mirror 11: 0x789c076b (stale) Mirror 12: 0x55d9be78 (stale) Mirror 14: 0x50138c1e (stale) CRC-32 checksum value for chunk [0, 0x3f82f): Mirror 1: 0xa0e110a Mirror 15: 0xa0e110a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f82f: skipped 000767 1788531138.702840 trunc from 0x03f82f to 0x02bb0f (0x13d1f bytes) 000769 1788531138.781075 read 0x024275 thru 0x02b4ed (0x7279 bytes) 000770 1788531138.790718 punch from 0x027091 to 0x02bb0f (0x4a7f bytes) 000771 1788531138.796174 mapread 0x02a174 thru 0x02bb0f (0x199c bytes) 000772 1788531138.805993 trunc from 0x02bb10 to 0x02b986 (0x189 bytes) 000773 1788531138.830604 punch from 0x0267eb to 0x02b986 (0x519c bytes) 000775 1788531138.839942 mapwrite 0x02042a thru 0x021f1f (0x1af6 bytes) 000776 1788531138.870406 punch from 0x0124fb to 0x01d623 (0xb129 bytes) 000777 1788531138.876642 read 0x0139fc thru 0x017a42 (0x4047 bytes) 000778 1788531138.888910 trunc from 0x02b987 to 0x023f3e (0x7a48 bytes) 000780 1788531138.906707 mapread 0x01666e thru 0x019e1c (0x37af bytes) 000781 1788531138.907845 mapwrite 0x0266f4 thru 0x0294f6 (0x2e03 bytes) 000782 1788531138.964092 mapwrite 0x002c9f thru 0x0039c4 (0xd26 bytes) 000783 1788531138.975364 punch from 0x00adae to 0x0162b9 (0xb50c bytes) 000784 1788531138.981669 mapread 0x013bfc thru 0x01f225 (0xb62a bytes) 000785 1788531139.001265 mapwrite 0x0071f1 thru 0x0148dd (0xd6ed bytes) 000786 1788531139.069080 MIRROR_RESYNC 8 mirrors 000787 1788531141.619089 trunc from 0x0294f7 to 0x01c75a (0xcd9c bytes) 000788 1788531141.668667 trunc from 0x004e98 to 0x011215 (0xc37e bytes) 000789 1788531141.675685 trunc from 0x01c75b to 0x02480b (0x80b1 bytes) 000790 1788531141.710015 trunc from 0x02480c to 0x013631 (0x111da bytes) 000791 1788531141.735589 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x13632): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13632): Mirror 7: 0x781196e7 (stale) Mirror 8: 0x781196e7 (stale) Mirror 9: 0x781196e7 (stale) Mirror 11: 0x781196e7 (stale) Mirror 12: 0x781196e7 (stale) Mirror 14: 0x781196e7 (stale) Mirror 15: 0x781196e7 (stale) CRC-32 checksum value for chunk [0, 0x13632): Mirror 1: 0xa9e97c9c Mirror 16: 0xa9e97c9c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13632: skipped 000792 1788531143.335629 punch from 0x002ca7 to 0x0056c3 (0x2a1d bytes) 000793 1788531143.437591 mapwrite 0x00199b thru 0x00db5f (0xc1c5 bytes) 000794 1788531143.505638 write 0x03a05e thru 0x03ffff (0x5fa2 bytes) 000795 1788531143.533577 MIRROR_RESYNC 9 mirrors 000796 1788531145.944565 trunc from 0x040000 to 0x01e27c (0x21d83 bytes) 000797 1788531146.009238 trunc from 0x01e27d to 0x00d289 (0x10ff3 bytes) 000799 1788531146.054148 fallocate 0x02295f thru 0x028de6 (0x6488 bytes) 000800 1788531146.067760 read 0x005e0a thru 0x006e96 (0x108d bytes) 000801 1788531146.075317 fallocate 0x009cb5 thru 0x018f73 (0xf2bf bytes) 000802 1788531146.100122 read 0x001350 thru 0x00e68d (0xd33e bytes) 000805 1788531146.134989 fallocate 0x01d1be thru 0x026410 (0x9253 bytes) 000806 1788531146.145839 trunc from 0x000b39 to 0x002f69 (0x2431 bytes) 000807 1788531146.163903 trunc from 0x018f74 to 0x00268c (0x168e7 bytes) 000809 1788531146.206818 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x268d): Mirror 7: 0xec5f6246 (stale) Mirror 8: 0xec5f6246 (stale) Mirror 9: 0xec5f6246 (stale) Mirror 11: 0xec5f6246 (stale) Mirror 12: 0xec5f6246 (stale) Mirror 15: 0xec5f6246 (stale) Mirror 16: 0xec5f6246 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x268d): Mirror 7: 0xec5f6246 (stale) Mirror 8: 0xec5f6246 (stale) Mirror 9: 0xec5f6246 (stale) Mirror 11: 0xec5f6246 (stale) Mirror 12: 0xec5f6246 (stale) Mirror 15: 0xec5f6246 (stale) Mirror 16: 0xec5f6246 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x268d: skipped 000810 1788531146.655892 trunc from 0x00096c to 0x00268c (0x1d21 bytes) 000812 1788531146.662439 fallocate 0x02e123 thru 0x03636d (0x824b bytes) 000813 1788531146.669847 trunc from 0x00268d to 0x0048a3 (0x2217 bytes) 000814 1788531146.699390 MIRROR_RESYNC 8 mirrors 000815 1788531148.254801 mapread 0x001530 thru 0x0048a3 (0x3374 bytes) 000816 1788531148.279259 fallocate 0x002ba4 thru 0x004828 (0x1c85 bytes) 000817 1788531148.329372 mapwrite 0x015a2f thru 0x01d8d7 (0x7ea9 bytes) 000819 1788531148.408692 mapread 0x00285a thru 0x00c542 (0x9ce9 bytes) 000820 1788531148.431829 mapwrite 0x00f136 thru 0x01dbad (0xea78 bytes) 000821 1788531148.499770 read 0x005478 thru 0x010ff0 (0xbb79 bytes) 000822 1788531148.503269 mapread 0x00eac2 thru 0x01a07a (0xb5b9 bytes) 000823 1788531148.508889 read 0x006ed8 thru 0x00cb3e (0x5c67 bytes) 000824 1788531148.509865 fallocate 0x0288e2 thru 0x02f25b (0x697a bytes) 000826 1788531148.530138 fallocate 0x030529 thru 0x03f0ac (0xeb84 bytes) 000827 1788531148.561057 MIRROR_RESYNC 8 mirrors 000828 1788531151.552372 punch from 0x003d78 to 0x00e877 (0xab00 bytes) 000829 1788531151.617229 write 0x02d866 thru 0x03380b (0x5fa6 bytes) 000830 1788531151.640899 write 0x0072ca thru 0x00ea2e (0x7765 bytes) 000831 1788531151.671527 write 0x011a40 thru 0x013701 (0x1cc2 bytes) 000832 1788531151.685940 fallocate 0x00375a thru 0x00bbc0 (0x8467 bytes) 000833 1788531151.700011 trunc from 0x00b7cf to 0x01939f (0xdbd1 bytes) 000834 1788531151.737981 mapread 0x020b63 thru 0x02438a (0x3828 bytes) 000835 1788531151.775951 trunc from 0x03f0ad to 0x038bf1 (0x64bb bytes) 000836 1788531151.825819 write 0x00057e thru 0x00c4b1 (0xbf34 bytes) 000838 1788531151.847874 mapwrite 0x02294d thru 0x02fb8c (0xd240 bytes) 000839 1788531151.887371 mapwrite 0x00f732 thru 0x01e146 (0xea15 bytes) 000840 1788531151.957367 trunc from 0x038bf2 to 0x017347 (0x218aa bytes) 000841 1788531151.987361 read 0x00392e thru 0x007fb9 (0x468c bytes) 000842 1788531151.991291 punch from 0x00c3c9 to 0x017347 (0xaf7f bytes) 000843 1788531152.001175 write 0x0369e8 thru 0x03f25e (0x8877 bytes) 000844 1788531152.015962 read 0x0121e0 thru 0x013ec5 (0x1ce6 bytes) 000845 1788531152.031796 punch from 0x024663 to 0x0318a4 (0xd242 bytes) 000846 1788531152.040214 fallocate 0x012cf8 thru 0x01ecb2 (0xbfbb bytes) 000847 1788531152.050213 fallocate 0x0143ef thru 0x021635 (0xd247 bytes) 000849 1788531152.074136 punch from 0x006450 to 0x008ce4 (0x2895 bytes) 000850 1788531152.087384 read 0x03e745 thru 0x03f25e (0xb1a bytes) 000851 1788531152.090132 punch from 0x01af98 to 0x0267cb (0xb834 bytes) 000852 1788531152.102942 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f25f): Mirror 7: 0x8cd1143b (stale) Mirror 8: 0x8cd1143b (stale) Mirror 9: 0x8cd1143b (stale) Mirror 11: 0x8cd1143b (stale) Mirror 12: 0x8cd1143b (stale) Mirror 15: 0x8cd1143b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f25f): Mirror 7: 0x8cd1143b (stale) Mirror 8: 0x8cd1143b (stale) Mirror 9: 0x8cd1143b (stale) Mirror 11: 0x8cd1143b (stale) Mirror 12: 0x8cd1143b (stale) Mirror 15: 0x8cd1143b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f25f: skipped 000853 1788531152.693970 mapwrite 0x033398 thru 0x037a2c (0x4695 bytes) 000854 1788531152.731924 trunc from 0x03f25f to 0x00eb1e (0x30740 bytes) 000856 1788531152.759319 fallocate 0x019272 thru 0x024457 (0xb1e6 bytes) 000857 1788531152.764516 fallocate 0x019d58 thru 0x020501 (0x67aa bytes) 000858 1788531152.769202 mapread 0x020650 thru 0x024457 (0x3e08 bytes) 000859 1788531152.788646 MIRROR_RESYNC 7 mirrors 000860 1788531154.632035 mapwrite 0x03748f thru 0x039715 (0x2287 bytes) 000861 1788531154.730942 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39716): Mirror 7: 0xc67f963 (stale) Mirror 8: 0xc67f963 (stale) Mirror 9: 0xc67f963 (stale) Mirror 12: 0xc67f963 (stale) Mirror 15: 0xc67f963 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39716): Mirror 7: 0xc67f963 (stale) Mirror 8: 0xc67f963 (stale) Mirror 9: 0xc67f963 (stale) Mirror 12: 0xc67f963 (stale) Mirror 15: 0xc67f963 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39716: skipped 000863 1788531155.536680 trunc from 0x039716 to 0x009f4c (0x2f7c9 bytes) 000864 1788531155.558607 mapwrite 0x03f0f8 thru 0x03ffff (0xf08 bytes) 000865 1788531155.596662 read 0x01ea0d thru 0x02bc3e (0xd232 bytes) 000866 1788531155.605709 punch from 0x03a37c to 0x03b8dd (0x1562 bytes) 000868 1788531155.613811 punch from 0x002a62 to 0x00949d (0x6a3c bytes) 000869 1788531155.619103 write 0x016b60 thru 0x018db9 (0x225a bytes) 000870 1788531155.629252 read 0x00da3f thru 0x01b6c9 (0xdc8b bytes) 000871 1788531155.652055 MIRROR_RESYNC 6 mirrors 000872 1788531157.582258 mapread 0x002a34 thru 0x00caba (0xa087 bytes) 000873 1788531157.616903 read 0x0158e6 thru 0x021831 (0xbf4c bytes) 000874 1788531157.634584 mapwrite 0x031c40 thru 0x03fb8a (0xdf4b bytes) 000875 1788531157.787750 trunc from 0x040000 to 0x033781 (0xc87e bytes) 000876 1788531157.811317 read 0x0010c4 thru 0x00f956 (0xe893 bytes) 000877 1788531157.838771 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33782): Mirror 7: 0xdd5d55b9 (stale) Mirror 8: 0xdd5d55b9 (stale) Mirror 12: 0xdd5d55b9 (stale) Mirror 15: 0xdd5d55b9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33782): Mirror 7: 0xdd5d55b9 (stale) Mirror 8: 0xdd5d55b9 (stale) Mirror 12: 0xdd5d55b9 (stale) Mirror 15: 0xdd5d55b9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33782: skipped 000878 1788531158.296411 mapwrite 0x02161a thru 0x029177 (0x7b5e bytes) 000879 1788531158.338041 mapwrite 0x02e94a thru 0x037b53 (0x920a bytes) 000880 1788531158.399608 trunc from 0x037b54 to 0x014125 (0x23a2e bytes) 000882 1788531158.420463 fallocate 0x005da0 thru 0x00b0a1 (0x5302 bytes) 000883 1788531158.428195 fallocate 0x010e95 thru 0x018d24 (0x7e90 bytes) 000884 1788531158.433889 read 0x001d38 thru 0x004874 (0x2b3d bytes) 000885 1788531158.441008 fallocate 0x026542 thru 0x032582 (0xc041 bytes) 000886 1788531158.447297 fallocate 0x036f3b thru 0x039f44 (0x300a bytes) 000887 1788531158.454130 punch from 0x006c59 to 0x01497a (0xdd22 bytes) 000888 1788531158.460288 mapread 0x014437 thru 0x022747 (0xe311 bytes) 000889 1788531158.478110 trunc from 0x039f45 to 0x0313be (0x8b86 bytes) 000890 1788531158.499151 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x313bf): Mirror 8: 0x9c41d5f7 (stale) Mirror 12: 0x9c41d5f7 (stale) Mirror 15: 0x9c41d5f7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x313bf): Mirror 8: 0x9c41d5f7 (stale) Mirror 12: 0x9c41d5f7 (stale) Mirror 15: 0x9c41d5f7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x313bf: skipped 000891 1788531159.016377 mapwrite 0x02f962 thru 0x03e68f (0xed2e bytes) 000892 1788531159.238536 mapread 0x027850 thru 0x0287b2 (0xf63 bytes) 000893 1788531159.264502 trunc from 0x03e690 to 0x01cfb4 (0x216db bytes) 000894 1788531159.280311 write 0x00e390 thru 0x01c1ec (0xde5d bytes) 000895 1788531159.298002 punch from 0x00883c to 0x01041e (0x7be3 bytes) 000896 1788531159.326689 fallocate 0x01ab0f thru 0x020d91 (0x6283 bytes) 000897 1788531159.335696 write 0x024ea3 thru 0x027986 (0x2ae4 bytes) 000898 1788531159.348793 fallocate 0x03f438 thru 0x03ffff (0xbc8 bytes) 000899 1788531159.368279 trunc from 0x027987 to 0x014fb7 (0x129cf bytes) 000900 1788531159.429813 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x14fb8): Mirror 8: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14fb8): Mirror 8: 0x9610a28d (stale) Mirror 12: 0x9610a28d (stale) Mirror 15: 0x9610a28d (stale) CRC-32 checksum value for chunk [0, 0x14fb8): Mirror 1: 0x34c2ee4c Mirror 16: 0x34c2ee4c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14fb8: skipped 000901 1788531160.499098 write 0x016582 thru 0x026112 (0xfb91 bytes) 000902 1788531160.567524 fallocate 0x015fba thru 0x017668 (0x16af bytes) 000903 1788531160.574884 punch from 0x00a6ae to 0x01411c (0x9a6f bytes) 000906 1788531160.588594 trunc from 0x006917 to 0x00c76f (0x5e59 bytes) 000908 1788531160.600265 trunc from 0x026113 to 0x02037b (0x5d97 bytes) 000909 1788531160.634188 mapread 0x014bc9 thru 0x01b5b0 (0x69e8 bytes) 000910 1788531160.653153 write 0x002b77 thru 0x00e3fd (0xb887 bytes) 000911 1788531160.682584 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2037c): Mirror 8: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2037c): Mirror 8: 0x75d705a2 (stale) Mirror 12: 0x75d705a2 (stale) Mirror 15: 0x75d705a2 (stale) Mirror 16: 0x8db21bda (stale) CRC-32 checksum value for chunk [0, 0x2037c): Mirror 1: 0xad47bfa7 Mirror 17: 0xad47bfa7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2037c: skipped 000912 1788531162.224090 read 0x01488f thru 0x02037b (0xbaed bytes) 000914 1788531162.259158 punch from 0x01885f to 0x019b8a (0x132c bytes) 000915 1788531162.329837 read 0x00e29b thru 0x01c41e (0xe184 bytes) 000916 1788531162.350040 punch from 0x0191d6 to 0x01ed41 (0x5b6c bytes) 000917 1788531162.361880 mapread 0x00d7fa thru 0x01ac50 (0xd457 bytes) 000918 1788531162.395129 trunc from 0x02037c to 0x005d7a (0x1a601 bytes) 000919 1788531162.472398 trunc from 0x0037b9 to 0x005d7a (0x25c2 bytes) 000920 1788531162.483806 mapread 0x003238 thru 0x005d7a (0x2b43 bytes) 000921 1788531162.507839 trunc from 0x003011 to 0x00302b (0x1b bytes) 000922 1788531162.527023 MIRROR_RESYNC 6 mirrors 000923 1788531163.606748 mapread 0x003b40 thru 0x005d7a (0x223b bytes) 000924 1788531163.626248 punch from 0x00599f to 0x005d7a (0x3dc bytes) 000925 1788531163.684168 read 0x005246 thru 0x005d7a (0xb35 bytes) 000926 1788531163.691563 mapwrite 0x007de9 thru 0x00f010 (0x7228 bytes) 000927 1788531163.738844 fallocate 0x011be9 thru 0x01bc54 (0xa06c bytes) 000928 1788531163.745569 mapwrite 0x026fac thru 0x02bcbc (0x4d11 bytes) 000929 1788531163.793467 fallocate 0x02845f thru 0x030495 (0x8037 bytes) 000930 1788531163.802820 read 0x02b89b thru 0x030495 (0x4bfb bytes) 000931 1788531163.813750 punch from 0x0184fb to 0x019937 (0x143d bytes) 000932 1788531163.818475 punch from 0x0281fe to 0x02fe5a (0x7c5d bytes) 000933 1788531163.824412 mapwrite 0x0056c3 thru 0x008c8d (0x35cb bytes) 000935 1788531163.841388 trunc from 0x005504 to 0x00b8ce (0x63cb bytes) 000936 1788531163.846989 read 0x02729d thru 0x030495 (0x91f9 bytes) 000939 1788531163.856784 punch from 0x014198 to 0x01bffc (0x7e65 bytes) 000940 1788531163.862189 punch from 0x013d6d to 0x01b5fc (0x7890 bytes) 000941 1788531163.866829 read 0x021744 thru 0x022b4b (0x1408 bytes) 000942 1788531163.868318 mapread 0x0173ec thru 0x024978 (0xd58d bytes) 000943 1788531163.882584 mapwrite 0x033f92 thru 0x03ffff (0xc06e bytes) 000944 1788531163.936443 trunc from 0x040000 to 0x03aa6e (0x5591 bytes) 000945 1788531163.954554 read 0x037627 thru 0x03aa6e (0x3448 bytes) 000947 1788531163.955657 fallocate 0x00f278 thru 0x01b958 (0xc6e1 bytes) 000948 1788531163.962447 mapread 0x0357f0 thru 0x03aa6e (0x527f bytes) 000949 1788531163.964174 fallocate 0x0199d8 thru 0x022045 (0x866e bytes) 000950 1788531163.969429 read 0x021344 thru 0x02b115 (0x9dd2 bytes) 000951 1788531163.971098 fallocate 0x02a4ca thru 0x02ddae (0x38e5 bytes) 000952 1788531163.977076 read 0x02d679 thru 0x0322f2 (0x4c7a bytes) 000953 1788531163.978053 read 0x008981 thru 0x013c57 (0xb2d7 bytes) 000954 1788531163.978839 read 0x0130f0 thru 0x01b4cb (0x83dc bytes) 000955 1788531163.980191 fallocate 0x028108 thru 0x033f1f (0xbe18 bytes) 000956 1788531163.985453 mapwrite 0x013d0c thru 0x01557a (0x186f bytes) 000957 1788531163.998578 mapread 0x011c29 thru 0x012c82 (0x105a bytes) 000959 1788531164.000091 mapread 0x028e1c thru 0x034f4e (0xc133 bytes) 000960 1788531164.002006 fallocate 0x021d63 thru 0x023c37 (0x1ed5 bytes) 000961 1788531164.010189 trunc from 0x03443a to 0x039fe3 (0x5baa bytes) 000962 1788531164.017570 fallocate 0x00d0fd thru 0x013763 (0x6667 bytes) 000964 1788531164.022840 fallocate 0x02c406 thru 0x03b33d (0xef38 bytes) 000965 1788531164.028578 mapwrite 0x03ecc5 thru 0x03ffff (0x133b bytes) 000966 1788531164.076704 trunc from 0x013d65 to 0x01e7f6 (0xaa92 bytes) 000967 1788531164.083968 fallocate 0x01f984 thru 0x026924 (0x6fa1 bytes) 000968 1788531164.089996 read 0x03bb4c thru 0x03ffff (0x44b4 bytes) 000969 1788531164.090715 fallocate 0x02a041 thru 0x02a7be (0x77e bytes) 000970 1788531164.096014 mapread 0x025f16 thru 0x02b37d (0x5468 bytes) 000971 1788531164.097687 mapread 0x02b005 thru 0x0300e9 (0x50e5 bytes) 000972 1788531164.100664 fallocate 0x01272d thru 0x01bfd5 (0x98a9 bytes) 000973 1788531164.106919 trunc from 0x01037d to 0x012d9c (0x2a20 bytes) 000974 1788531164.112775 write 0x015fa9 thru 0x021538 (0xb590 bytes) 000975 1788531164.139245 write 0x03589a thru 0x03ffff (0xa766 bytes) 000976 1788531164.144877 trunc from 0x00ecbc to 0x01beee (0xd233 bytes) 000977 1788531164.173796 fallocate 0x01dad0 thru 0x029741 (0xbc72 bytes) 000978 1788531164.179841 punch from 0x03e351 to 0x03ffff (0x1caf bytes) 000980 1788531164.187031 trunc from 0x00bef6 to 0x00fbf9 (0x3d04 bytes) 000981 1788531164.204247 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xb04180a9 (stale) Mirror 12: 0xb04180a9 (stale) Mirror 15: 0xb04180a9 (stale) Mirror 17: 0xb04180a9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xb04180a9 (stale) Mirror 12: 0xb04180a9 (stale) Mirror 15: 0xb04180a9 (stale) Mirror 17: 0xb04180a9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000982 1788531164.741626 read 0x0360ef thru 0x039e58 (0x3d6a bytes) 000983 1788531164.752213 trunc from 0x040000 to 0x022cd0 (0x1d32f bytes) 000985 1788531164.806231 mapread 0x00f307 thru 0x01ec2f (0xf929 bytes) 000986 1788531164.854447 trunc from 0x01a7d9 to 0x022cd0 (0x84f8 bytes) 000987 1788531164.881620 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x22cd1): Mirror 8: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22cd1): Mirror 8: 0xbe2708 (stale) Mirror 12: 0xbe2708 (stale) Mirror 15: 0xbe2708 (stale) Mirror 17: 0xbe2708 (stale) CRC-32 checksum value for chunk [0, 0x22cd1): Mirror 1: 0x2fa49cc8 Mirror 18: 0x2fa49cc8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22cd1: skipped 000988 1788531166.200380 mapwrite 0x032247 thru 0x03f3e0 (0xd19a bytes) 000989 1788531166.320944 read 0x00bf7d thru 0x0188db (0xc95f bytes) 000990 1788531166.332277 punch from 0x00e4fb to 0x0100b1 (0x1bb7 bytes) 000991 1788531166.337924 trunc from 0x03f3e1 to 0x01125c (0x2e184 bytes) 000992 1788531166.373635 MIRROR_RESYNC 6 mirrors 000993 1788531168.251596 trunc from 0x006825 to 0x01125c (0xaa38 bytes) 000994 1788531168.286101 trunc from 0x01125d to 0x038631 (0x273d5 bytes) 000995 1788531168.318637 MIRROR_RESYNC 6 mirrors 000996 1788531169.874773 trunc from 0x023981 to 0x0335fd (0xfc7d bytes) 000997 1788531169.920793 trunc from 0x038632 to 0x02b59d (0xd094 bytes) 000998 1788531169.948605 read 0x01caa7 thru 0x025732 (0x8c8c bytes) 000999 1788531169.960685 trunc from 0x02b59e to 0x001bb8 (0x299e5 bytes) 001000 1788531169.987745 punch from 0x0016be to 0x001bb8 (0x4fb bytes) All operations completed A-OK!