== sanity-flr test 70a: flr mode fsx test ================ 09:22:36 (1790774556) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 4559 000001 1790774559.405277 write 0x01427c thru 0x021662 (0xd3e7 bytes) 000002 1790774559.426205 write 0x00c8e0 thru 0x01b019 (0xe73a bytes) 000003 1790774559.436042 mapread 0x0157a8 thru 0x021662 (0xbebb bytes) 000004 1790774559.438132 mapwrite 0x03632a thru 0x03ffff (0x9cd6 bytes) 000005 1790774559.521288 trunc from 0x02e0c3 to 0x02e4e9 (0x427 bytes) 000006 1790774559.527278 write 0x005d39 thru 0x013c5b (0xdf23 bytes) 000007 1790774559.538182 mapwrite 0x0098c5 thru 0x00fc79 (0x63b5 bytes) zero_range to largest ever: 0x40000 000008 1790774559.559914 trunc from 0x03c397 to 0x03ffff (0x3c69 bytes) 000009 1790774559.569009 read 0x00d314 thru 0x0148df (0x75cc bytes) 000010 1790774559.569841 read 0x029cc8 thru 0x02d398 (0x36d1 bytes) 000011 1790774559.588687 mapwrite 0x00c65e thru 0x014597 (0x7f3a bytes) 000013 1790774559.616200 punch from 0x03bcab to 0x03c87e (0xbd4 bytes) 000014 1790774559.624442 trunc from 0x001ac7 to 0x00573a (0x3c74 bytes) 000015 1790774559.670218 MIRROR_EXTEND to 2 mirrors 000016 1790774560.681549 write 0x001f51 thru 0x00863f (0x66ef bytes) 000017 1790774560.760806 mapread 0x00803f thru 0x01421a (0xc1dc bytes) 000018 1790774560.801074 punch from 0x02f711 to 0x031ae7 (0x23d7 bytes) 000019 1790774560.806912 write 0x000472 thru 0x00a28e (0x9e1d bytes) 000020 1790774560.818675 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) 000021 1790774561.047812 trunc from 0x040000 to 0x02df32 (0x120cd bytes) 000022 1790774561.083167 mapwrite 0x01588d thru 0x015d3f (0x4b3 bytes) 000024 1790774561.132847 mapwrite 0x03c12c thru 0x03ffff (0x3ed4 bytes) 000025 1790774561.215204 trunc from 0x02d159 to 0x0304c8 (0x3370 bytes) 000029 1790774561.235578 read 0x03bf90 thru 0x03ffff (0x4070 bytes) 000030 1790774561.237818 mapwrite 0x0002f1 thru 0x01000c (0xfd1c bytes) 000031 1790774561.320111 mapwrite 0x01db61 thru 0x022519 (0x49b9 bytes) 000035 1790774561.401958 trunc from 0x028d36 to 0x03419f (0xb46a bytes) 000037 1790774561.416671 mapread 0x03a302 thru 0x03c124 (0x1e23 bytes) 000038 1790774561.418739 trunc from 0x02f51c to 0x03a00f (0xaaf4 bytes) 000039 1790774561.439484 mapread 0x00739e thru 0x00fef0 (0x8b53 bytes) 000040 1790774561.440779 write 0x01812a thru 0x01bb53 (0x3a2a bytes) 000041 1790774561.446800 write 0x01df6e thru 0x02b129 (0xd1bc bytes) 000042 1790774561.456735 punch from 0x015a56 to 0x0252a9 (0xf854 bytes) 000043 1790774561.519885 trunc from 0x040000 to 0x02e0e3 (0x11f1c bytes) 000044 1790774561.537437 read 0x027be4 thru 0x02e0e3 (0x6500 bytes) 000047 1790774561.559814 fallocate 0x000a78 thru 0x001756 (0xcdf bytes) 000048 1790774561.580769 trunc from 0x02e0e4 to 0x005d86 (0x2835d bytes) 000049 1790774561.633460 mapread 0x001bbe thru 0x002ec4 (0x1307 bytes) 000050 1790774561.636656 read 0x00507a thru 0x005d86 (0xd0d bytes) 000051 1790774561.641059 mapread 0x001d97 thru 0x005d86 (0x3ff0 bytes) 000052 1790774561.642818 fallocate 0x039bf2 thru 0x03ffff (0x640e bytes) 000053 1790774561.654080 trunc from 0x005d87 to 0x03b83f (0x35ab9 bytes) 000054 1790774561.682685 trunc from 0x03b840 to 0x01f2dc (0x1c563 bytes) 000055 1790774561.707298 trunc from 0x01f2dd to 0x003832 (0x1baaa bytes) 000056 1790774561.749787 trunc from 0x003833 to 0x01c360 (0x18b2e bytes) 000058 1790774561.791537 read 0x017479 thru 0x017511 (0x99 bytes) 000059 1790774561.823152 read 0x00d6b7 thru 0x01455a (0x6ea4 bytes) 000060 1790774561.824044 read 0x01973a thru 0x01c360 (0x2c27 bytes) 000061 1790774561.828826 mapwrite 0x03c1b4 thru 0x03ffff (0x3e4c bytes) 000062 1790774561.917409 read 0x00af0f thru 0x00d741 (0x2833 bytes) 000063 1790774561.918483 mapread 0x0022c3 thru 0x0065ac (0x42ea bytes) 000064 1790774561.920591 read 0x02b0e2 thru 0x03a62b (0xf54a bytes) 000065 1790774561.923446 trunc from 0x040000 to 0x03bf3b (0x40c4 bytes) 000066 1790774561.946256 trunc from 0x03bf3c to 0x00b5a4 (0x30997 bytes) 000067 1790774562.003676 mapread 0x00192c thru 0x003ab5 (0x218a bytes) 000068 1790774562.006538 trunc from 0x00b5a5 to 0x0381b3 (0x2cc0f bytes) 000069 1790774562.038182 trunc from 0x0381b4 to 0x0037a4 (0x34a0f bytes) 000070 1790774562.060393 write 0x01f061 thru 0x0299ad (0xa94d bytes) 000071 1790774562.062036 fallocate 0x01058e thru 0x014766 (0x41d9 bytes) 000072 1790774562.074715 mapwrite 0x03743f thru 0x039855 (0x2417 bytes) 000073 1790774562.183700 read 0x00e538 thru 0x01674d (0x8216 bytes) 000074 1790774562.190633 mapread 0x02f9fa thru 0x032c94 (0x329b bytes) 000075 1790774562.194474 write 0x02278c thru 0x0307c1 (0xe036 bytes) 000076 1790774562.210587 MIRROR_EXTEND to 2 mirrors 000077 1790774563.443551 punch from 0x00ed6c to 0x0152d6 (0x656b bytes) 000078 1790774563.521443 trunc from 0x027145 to 0x03105a (0x9f16 bytes) 000080 1790774563.528268 mapwrite 0x0253ef thru 0x02f95a (0xa56c bytes) 000081 1790774563.629986 mapwrite 0x03a1dc thru 0x03ffff (0x5e24 bytes) 000082 1790774563.794619 punch from 0x024531 to 0x02464f (0x11f bytes) 000084 1790774563.816346 mapread 0x0282b0 thru 0x029575 (0x12c6 bytes) 000085 1790774563.820465 mapread 0x01fa09 thru 0x0291f4 (0x97ec bytes) 000086 1790774563.832548 read 0x0178f0 thru 0x0212a7 (0x99b8 bytes) 000087 1790774563.836969 mapwrite 0x0253f0 thru 0x02eecd (0x9ade bytes) 000088 1790774563.858719 punch from 0x00116e to 0x0065cb (0x545e bytes) 000089 1790774563.864687 fallocate 0x03fff8 thru 0x03ffff (0x8 bytes) 000090 1790774563.870663 trunc from 0x040000 to 0x02a882 (0x1577d bytes) 000091 1790774563.889093 mapwrite 0x019818 thru 0x027cc2 (0xe4ab bytes) 000092 1790774563.909663 fallocate 0x000fe5 thru 0x00f5dc (0xe5f8 bytes) 000093 1790774563.914504 mapread 0x00276c thru 0x0053b3 (0x2c48 bytes) 000094 1790774563.924958 mapwrite 0x01a933 thru 0x0278b6 (0xcf84 bytes) 000096 1790774563.944272 read 0x027362 thru 0x029ac0 (0x275f bytes) 000098 1790774563.945434 fallocate 0x00d5db thru 0x016b2a (0x9550 bytes) 000099 1790774563.951367 mapwrite 0x020d9c thru 0x029975 (0x8bda bytes) 000100 1790774563.971178 mapwrite 0x02bba9 thru 0x03af6d (0xf3c5 bytes) 000102 1790774564.018765 mapread 0x01e0a7 thru 0x02533f (0x7299 bytes) 000103 1790774564.019715 trunc from 0x03af6e to 0x026e7b (0x140f2 bytes) 000104 1790774564.040920 punch from 0x0226a0 to 0x026e7b (0x47dc bytes) 000105 1790774564.047274 mapread 0x024b44 thru 0x024f64 (0x421 bytes) 000106 1790774564.053915 trunc from 0x026e7c to 0x03e367 (0x174ec bytes) 000107 1790774564.070804 write 0x008491 thru 0x016400 (0xdf70 bytes) 000108 1790774564.072441 fallocate 0x02a98d thru 0x0339f9 (0x906d bytes) 000109 1790774564.078457 mapread 0x033c22 thru 0x03e367 (0xa746 bytes) 000110 1790774564.118793 trunc from 0x0199d7 to 0x020c08 (0x7232 bytes) 000111 1790774564.124265 fallocate 0x01c774 thru 0x01ceb0 (0x73d bytes) 000112 1790774564.129567 trunc from 0x03e368 to 0x0083d0 (0x35f97 bytes) 000113 1790774564.146998 punch from 0x001ccf to 0x007ec1 (0x61f3 bytes) 000114 1790774564.153289 mapwrite 0x035d35 thru 0x03fdf4 (0xa0c0 bytes) 000115 1790774564.239269 punch from 0x03cb9d to 0x03fdf4 (0x3258 bytes) 000116 1790774564.246496 fallocate 0x037fc7 thru 0x03a947 (0x2981 bytes) 000117 1790774564.251097 trunc from 0x03fdf5 to 0x03b7bb (0x4639 bytes) 000118 1790774564.268977 write 0x018992 thru 0x01a064 (0x16d3 bytes) 000119 1790774564.280191 fallocate 0x000e14 thru 0x01040b (0xf5f8 bytes) 000120 1790774564.285460 mapread 0x013f0d thru 0x01f2a5 (0xb399 bytes) 000121 1790774564.356212 MIRROR_RESYNC 2 mirrors 000122 1790774565.209765 fallocate 0x032eb9 thru 0x03381e (0x966 bytes) 000123 1790774565.276903 read 0x01a344 thru 0x01f1a4 (0x4e61 bytes) 000124 1790774565.317638 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b7bc): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b7bc): Mirror 2: 0x730cd94c (stale) CRC-32 checksum value for chunk [0, 0x3b7bc): Mirror 1: 0x730cd94c Mirror 3: 0x730cd94c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b7bc: skipped 000125 1790774566.709802 read 0x02450e thru 0x02aec8 (0x69bb bytes) 000126 1790774566.723965 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) 000127 1790774567.184644 trunc from 0x031bc4 to 0x03b15c (0x9599 bytes) 000128 1790774567.260667 mapread 0x006289 thru 0x00cc7a (0x69f2 bytes) 000129 1790774567.351618 MIRROR_RESYNC 2 mirrors 000130 1790774568.477167 mapwrite 0x028a99 thru 0x0320b5 (0x961d bytes) 000131 1790774568.596952 trunc from 0x008c4d to 0x01823a (0xf5ee bytes) 000132 1790774568.607381 read 0x0080c8 thru 0x00b958 (0x3891 bytes) 000133 1790774568.615112 write 0x006e70 thru 0x013e37 (0xcfc8 bytes) 000134 1790774568.627119 trunc from 0x002a5e to 0x00525b (0x27fe bytes) 000135 1790774568.632035 read 0x01e9a4 thru 0x0273d4 (0x8a31 bytes) 000136 1790774568.649609 trunc from 0x03b7bc to 0x03e0c6 (0x290b bytes) 000137 1790774568.671103 punch from 0x02ff52 to 0x031983 (0x1a32 bytes) 000138 1790774568.680902 mapread 0x02bf28 thru 0x03ad7a (0xee53 bytes) 000139 1790774568.700045 fallocate 0x02a806 thru 0x039eec (0xf6e7 bytes) 000140 1790774568.705060 punch from 0x028311 to 0x028bd9 (0x8c9 bytes) 000141 1790774568.710301 trunc from 0x03e0c7 to 0x01f474 (0x1ec52 bytes) 000142 1790774568.724418 trunc from 0x01f475 to 0x036671 (0x171fd bytes) 000143 1790774568.739394 trunc from 0x036672 to 0x02f94f (0x6d22 bytes) 000145 1790774568.762653 punch from 0x01770b to 0x024d7a (0xd670 bytes) 000146 1790774568.768622 fallocate 0x038f0c thru 0x03ffff (0x70f4 bytes) 000147 1790774568.773968 read 0x009d32 thru 0x0158b6 (0xbb85 bytes) 000148 1790774568.775107 trunc from 0x02f950 to 0x009913 (0x2603c bytes) 000149 1790774568.796110 mapwrite 0x03bd46 thru 0x03ffff (0x42ba bytes) 000150 1790774568.841366 mapwrite 0x037c51 thru 0x03ffff (0x83af bytes) 000151 1790774568.861185 mapwrite 0x02a9e8 thru 0x02b9b4 (0xfcd bytes) 000152 1790774568.872952 trunc from 0x040000 to 0x02b900 (0x146ff bytes) 000154 1790774568.889417 fallocate 0x011cc9 thru 0x016ef9 (0x5231 bytes) 000156 1790774568.917682 mapread 0x0159db thru 0x01b1ce (0x57f4 bytes) 000157 1790774568.918699 write 0x003c29 thru 0x00db41 (0x9f19 bytes) 000158 1790774568.927483 fallocate 0x008caf thru 0x008cfb (0x4d bytes) 000159 1790774568.940259 fallocate 0x0080bf thru 0x0143c6 (0xc308 bytes) 000160 1790774568.947232 mapwrite 0x01aa75 thru 0x01e946 (0x3ed2 bytes) 000161 1790774569.013275 mapwrite 0x038b55 thru 0x03ffff (0x74ab bytes) 000162 1790774569.222729 punch from 0x0377bd to 0x039d5f (0x25a3 bytes) 000164 1790774569.233571 fallocate 0x01bb46 thru 0x0230b9 (0x7574 bytes) 000165 1790774569.256207 read 0x0115f7 thru 0x011b8e (0x598 bytes) 000166 1790774569.263246 trunc from 0x040000 to 0x0252d9 (0x1ad26 bytes) 000167 1790774569.303247 mapread 0x006cb9 thru 0x00725c (0x5a4 bytes) 000168 1790774569.316998 trunc from 0x023df0 to 0x0252d9 (0x14ea bytes) 000169 1790774569.342732 mapwrite 0x0158b2 thru 0x01b03b (0x578a bytes) 000170 1790774569.387371 trunc from 0x007b4c to 0x00e7a1 (0x6c56 bytes) 000171 1790774569.395943 write 0x00e9a2 thru 0x013821 (0x4e80 bytes) 000172 1790774569.410721 trunc from 0x00595c to 0x009196 (0x383b bytes) 000173 1790774569.418377 mapread 0x0006d1 thru 0x00e98d (0xe2bd bytes) 000174 1790774569.451117 mapread 0x0002ec thru 0x007373 (0x7088 bytes) 000175 1790774569.453164 punch from 0x01ecb3 to 0x0252d9 (0x6627 bytes) 000176 1790774569.458769 mapwrite 0x00499d thru 0x0096d0 (0x4d34 bytes) 000177 1790774569.504533 fallocate 0x011e65 thru 0x01f5e6 (0xd782 bytes) 000178 1790774569.514918 trunc from 0x0252da to 0x01036b (0x14f6e bytes) 000179 1790774569.538689 mapread 0x0069a7 thru 0x00738a (0x9e4 bytes) 000180 1790774569.539662 fallocate 0x02d920 thru 0x032df2 (0x54d3 bytes) 000181 1790774569.553578 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) 000182 1790774569.787802 trunc from 0x009984 to 0x00b580 (0x1bfd bytes) 000183 1790774569.794701 fallocate 0x002cea thru 0x00db6c (0xae83 bytes) 000184 1790774569.803990 mapwrite 0x035b48 thru 0x035fd0 (0x489 bytes) 000185 1790774569.885708 mapread 0x0117f5 thru 0x01f5c0 (0xddcc bytes) 000186 1790774569.924723 mapwrite 0x039150 thru 0x03f588 (0x6439 bytes) 000187 1790774569.970365 mapwrite 0x004304 thru 0x014035 (0xfd32 bytes) 000188 1790774570.020922 mapwrite 0x01f70b thru 0x026a45 (0x733b bytes) 000191 1790774570.068059 mapwrite 0x02c055 thru 0x032dbf (0x6d6b bytes) 000192 1790774570.149862 trunc from 0x03f589 to 0x02783d (0x17d4b bytes) 000193 1790774570.199136 mapread 0x021939 thru 0x022e7f (0x1547 bytes) 000194 1790774570.200621 fallocate 0x00e030 thru 0x0111fa (0x31cb bytes) 000196 1790774570.216015 MIRROR_EXTEND to 2 mirrors 000197 1790774571.338067 punch from 0x013496 to 0x0143f6 (0xf61 bytes) 000198 1790774571.408616 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) 000199 1790774571.594634 write 0x01c2fb thru 0x01d977 (0x167d bytes) 000201 1790774571.613160 trunc from 0x02783e to 0x03ba2b (0x141ee bytes) 000204 1790774571.657600 fallocate 0x01eb8b thru 0x024de8 (0x625e bytes) 000205 1790774571.662670 write 0x0029d9 thru 0x00ee24 (0xc44c bytes) 000206 1790774571.693078 trunc from 0x03ba2c to 0x005bc3 (0x35e68 bytes) 000208 1790774571.722877 trunc from 0x005bc4 to 0x03631b (0x30758 bytes) 000209 1790774571.755112 trunc from 0x03631c to 0x004ba8 (0x31773 bytes) 000210 1790774571.812256 write 0x02b428 thru 0x038c73 (0xd84c bytes) 000212 1790774571.817480 mapread 0x01c6e4 thru 0x021f40 (0x585d bytes) 000213 1790774571.856259 write 0x0017e2 thru 0x008463 (0x6c82 bytes) 000215 1790774571.873179 write 0x02c638 thru 0x0347e9 (0x81b2 bytes) 000216 1790774571.877076 trunc from 0x038c74 to 0x012794 (0x264df bytes) 000217 1790774571.905297 punch from 0x00a2ae to 0x012794 (0x84e7 bytes) 000218 1790774571.915171 trunc from 0x012795 to 0x018922 (0x618e bytes) 000220 1790774571.940219 write 0x026c0b thru 0x031cf0 (0xb0e6 bytes) 000221 1790774571.941837 trunc from 0x01851f to 0x022ce6 (0xa7c8 bytes) 000222 1790774571.952257 punch from 0x014686 to 0x01b0fb (0x6a76 bytes) 000223 1790774571.963147 mapwrite 0x001d18 thru 0x0035c2 (0x18ab bytes) 000224 1790774571.987420 trunc from 0x031cf1 to 0x03fb6f (0xde7f bytes) 000225 1790774572.021424 MIRROR_EXTEND to 2 mirrors 000226 1790774573.546582 trunc from 0x03455f to 0x037552 (0x2ff4 bytes) 000227 1790774573.597617 read 0x021475 thru 0x021f7d (0xb09 bytes) 000228 1790774573.606744 mapwrite 0x03db8e thru 0x03ffff (0x2472 bytes) 000229 1790774573.697452 punch from 0x031748 to 0x033efc (0x27b5 bytes) 000230 1790774573.706476 fallocate 0x02297f thru 0x02ea18 (0xc09a bytes) 000231 1790774573.721035 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb21d2cbe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7964acac Mirror 3: 0x7964acac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000233 1790774575.413460 fallocate 0x03b226 thru 0x03ffff (0x4dda bytes) 000234 1790774575.465600 read 0x03447b thru 0x03f526 (0xb0ac bytes) 000235 1790774575.480133 mapwrite 0x039749 thru 0x03ffff (0x68b7 bytes) 000236 1790774575.524100 fallocate 0x033174 thru 0x035512 (0x239f bytes) 000237 1790774575.552291 read 0x010304 thru 0x01f603 (0xf300 bytes) 000239 1790774575.609132 fallocate 0x03f45b thru 0x03ffff (0xba5 bytes) 000240 1790774575.644797 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb21d2cbe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb21d2cbe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000241 1790774576.060307 fallocate 0x03ce0e thru 0x03ffff (0x31f2 bytes) 000242 1790774576.067825 trunc from 0x040000 to 0x019178 (0x26e87 bytes) 000243 1790774576.094648 fallocate 0x0174a2 thru 0x01980d (0x236c bytes) 000244 1790774576.100640 punch from 0x0150be to 0x019178 (0x40bb bytes) 000245 1790774576.105579 fallocate 0x01acee thru 0x028913 (0xdc26 bytes) 000246 1790774576.118233 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) 000247 1790774576.362646 fallocate 0x0048ad thru 0x00b9f3 (0x7147 bytes) 000248 1790774576.387037 mapread 0x011fbf thru 0x01b2de (0x9320 bytes) 000250 1790774576.451156 mapwrite 0x006412 thru 0x00dff7 (0x7be6 bytes) 000251 1790774576.510763 fallocate 0x01e353 thru 0x01eb8c (0x83a bytes) 000252 1790774576.521198 write 0x017f15 thru 0x01f201 (0x72ed bytes) 000253 1790774576.551551 mapread 0x01d886 thru 0x02529a (0x7a15 bytes) 000254 1790774576.597636 write 0x00f462 thru 0x01da9e (0xe63d bytes) 000255 1790774576.604551 mapwrite 0x00dcc1 thru 0x010b0c (0x2e4c bytes) 000259 1790774576.646388 punch from 0x01db14 to 0x028913 (0xae00 bytes) 000260 1790774576.674456 trunc from 0x028914 to 0x02892f (0x1c bytes) 000262 1790774576.721732 mapwrite 0x030cd2 thru 0x038d25 (0x8054 bytes) 000263 1790774576.808400 read 0x009989 thru 0x00cb45 (0x31bd bytes) 000264 1790774576.809102 fallocate 0x0250dd thru 0x02d12e (0x8052 bytes) 000265 1790774576.821064 mapwrite 0x037fcb thru 0x03fd76 (0x7dac bytes) 000266 1790774576.944975 punch from 0x035c3f to 0x03cbbf (0x6f81 bytes) 000267 1790774576.987081 MIRROR_EXTEND to 2 mirrors 000268 1790774578.341254 read 0x021c38 thru 0x02358b (0x1954 bytes) 000269 1790774578.359623 fallocate 0x02975f thru 0x038eb1 (0xf753 bytes) 000270 1790774578.430071 trunc from 0x03fd77 to 0x01c208 (0x23b6e bytes) 000271 1790774578.460485 fallocate 0x0128ea thru 0x018c2f (0x6346 bytes) 000272 1790774578.466504 read 0x01a270 thru 0x01c182 (0x1f13 bytes) 000273 1790774578.479019 trunc from 0x01c209 to 0x00f1b0 (0xd058 bytes) 000275 1790774578.501574 fallocate 0x010452 thru 0x0117e6 (0x1395 bytes) 000276 1790774578.508991 punch from 0x00559a to 0x00aded (0x5854 bytes) 000277 1790774578.516129 fallocate 0x0095c0 thru 0x00eb2a (0x556b bytes) 000278 1790774578.523036 fallocate 0x0141fd thru 0x01ddbe (0x9bc2 bytes) 000279 1790774578.529123 read 0x008b9e thru 0x009f73 (0x13d6 bytes) 000280 1790774578.547654 mapread 0x00d09d thru 0x015c0b (0x8b6f bytes) 000281 1790774578.554679 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1ddbf): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ddbf): Mirror 2: 0x44055071 (stale) CRC-32 checksum value for chunk [0, 0x1ddbf): Mirror 1: 0x1a4d0bc6 Mirror 3: 0x1a4d0bc6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ddbf: skipped 000282 1790774580.095725 mapread 0x01a4ac thru 0x01c19c (0x1cf1 bytes) 000283 1790774580.152232 trunc from 0x00ce50 to 0x00e361 (0x1512 bytes) 000284 1790774580.237755 trunc from 0x00627e to 0x010c20 (0xa9a3 bytes) 000285 1790774580.257145 fallocate 0x039595 thru 0x03ffff (0x6a6b bytes) 000289 1790774580.280228 fallocate 0x03c3a1 thru 0x03ffff (0x3c5f bytes) 000290 1790774580.296939 punch from 0x03d05a to 0x03ffff (0x2fa6 bytes) 000291 1790774580.310589 trunc from 0x040000 to 0x025313 (0x1acec bytes) 000292 1790774580.403125 punch from 0x0212ff to 0x025313 (0x4015 bytes) 000293 1790774580.411282 trunc from 0x01a389 to 0x01f730 (0x53a8 bytes) 000294 1790774580.420196 mapread 0x00f04f thru 0x012a02 (0x39b4 bytes) 000295 1790774580.439431 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x25314): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25314): Mirror 2: 0xf703f512 (stale) Mirror 3: 0x4d47ae0a (stale) CRC-32 checksum value for chunk [0, 0x25314): Mirror 1: 0x107b809e Mirror 4: 0x107b809e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25314: skipped 000296 1790774582.291616 write 0x0209d8 thru 0x02f34c (0xe975 bytes) 000297 1790774582.397871 read 0x025cd8 thru 0x02f34c (0x9675 bytes) 000298 1790774582.398985 punch from 0x02090e to 0x027c26 (0x7319 bytes) 000299 1790774582.435502 write 0x03681c thru 0x03e33f (0x7b24 bytes) 000300 1790774582.437111 punch from 0x0399ea to 0x03e33f (0x4956 bytes) 000301 1790774582.473933 mapread 0x01531f thru 0x0232d1 (0xdfb3 bytes) 000302 1790774582.525745 mapwrite 0x01d2bc thru 0x023c86 (0x69cb bytes) 000304 1790774582.570977 read 0x01f6fc thru 0x02e608 (0xef0d bytes) 000305 1790774582.574135 mapwrite 0x003400 thru 0x00e16f (0xad70 bytes) 000306 1790774582.636996 trunc from 0x03dbb8 to 0x03e33f (0x788 bytes) 000307 1790774582.649811 trunc from 0x0334ad to 0x03e33f (0xae93 bytes) 000308 1790774582.659569 trunc from 0x03e340 to 0x01358f (0x2adb0 bytes) 000309 1790774582.695255 read 0x006049 thru 0x009115 (0x30cd bytes) 000310 1790774582.699646 trunc from 0x013590 to 0x0076f7 (0xbe98 bytes) 000311 1790774582.734264 write 0x033d7e thru 0x0352b6 (0x1539 bytes) 000312 1790774582.738977 punch from 0x000348 to 0x00a04a (0x9d03 bytes) 000313 1790774582.748393 trunc from 0x009b99 to 0x00db2e (0x3f96 bytes) 000314 1790774582.756222 fallocate 0x00a8e6 thru 0x010b04 (0x621f bytes) 000315 1790774582.765009 mapread 0x0244a9 thru 0x026be9 (0x2741 bytes) 000316 1790774582.784962 read 0x00a679 thru 0x014137 (0x9abf bytes) 000318 1790774582.786403 trunc from 0x0352b7 to 0x0063e4 (0x2eed2 bytes) 000319 1790774582.811113 trunc from 0x00402b to 0x0063e4 (0x23ba bytes) 000320 1790774582.820033 write 0x00d19e thru 0x012651 (0x54b4 bytes) 000323 1790774582.825113 trunc from 0x012652 to 0x022ccc (0x1067b bytes) 000324 1790774582.848148 punch from 0x01ae77 to 0x021431 (0x65bb bytes) 000325 1790774582.857616 trunc from 0x022ccd to 0x028176 (0x54aa bytes) 000326 1790774582.881116 read 0x00a881 thru 0x00b411 (0xb91 bytes) 000327 1790774582.895282 trunc from 0x026270 to 0x026d06 (0xa97 bytes) 000328 1790774582.903168 fallocate 0x0275a9 thru 0x034b2c (0xd584 bytes) 000329 1790774582.908286 punch from 0x013da0 to 0x0220f6 (0xe357 bytes) 000330 1790774582.913520 trunc from 0x009faa to 0x00eada (0x4b31 bytes) 000332 1790774582.945107 read 0x01210d thru 0x0144d8 (0x23cc bytes) 000333 1790774582.957857 mapread 0x02b968 thru 0x031814 (0x5ead bytes) 000334 1790774582.966221 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x34b2d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34b2d): Mirror 2: 0xc587bef3 (stale) Mirror 3: 0x3ad41baa (stale) Mirror 4: 0xf82c3efc (stale) CRC-32 checksum value for chunk [0, 0x34b2d): Mirror 1: 0xf2ad1e8a Mirror 5: 0xf2ad1e8a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34b2d: skipped 000335 1790774584.651888 punch from 0x020b2b to 0x02db35 (0xd00b bytes) 000336 1790774584.705277 write 0x01ccd8 thru 0x026bbc (0x9ee5 bytes) 000337 1790774584.725062 mapwrite 0x012ae4 thru 0x01a258 (0x7775 bytes) 000338 1790774584.775703 mapread 0x015264 thru 0x0212b4 (0xc051 bytes) 000340 1790774584.784807 MIRROR_RESYNC 5 mirrors 000341 1790774586.786026 mapread 0x032d78 thru 0x034b2c (0x1db5 bytes) 000344 1790774586.824085 write 0x0118a7 thru 0x01bd21 (0xa47b bytes) 000345 1790774586.902018 trunc from 0x00d9df to 0x014281 (0x68a3 bytes) 000346 1790774586.931220 trunc from 0x01b6e4 to 0x0236eb (0x8008 bytes) 000347 1790774586.940834 read 0x02ea88 thru 0x0304e6 (0x1a5f bytes) 000348 1790774586.950991 mapwrite 0x034a64 thru 0x035a9b (0x1038 bytes) 000349 1790774587.013019 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x35a9c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35a9c): Mirror 2: 0x38905653 (stale) Mirror 3: 0x38905653 (stale) Mirror 4: 0x38905653 (stale) Mirror 5: 0x38905653 (stale) CRC-32 checksum value for chunk [0, 0x35a9c): Mirror 1: 0x383f2ef4 Mirror 6: 0x383f2ef4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35a9c: skipped 000350 1790774588.633085 trunc from 0x035a9c to 0x000285 (0x35816 bytes) 000351 1790774588.713445 mapread 0x000200 thru 0x000285 (0x86 bytes) 000352 1790774588.723007 mapread 0x0001da thru 0x000285 (0xac bytes) 000353 1790774588.724444 trunc from 0x000286 to 0x0383f9 (0x38174 bytes) 000354 1790774588.749528 mapread 0x0289f5 thru 0x036769 (0xdd75 bytes) 000355 1790774588.831942 MIRROR_RESYNC 6 mirrors 000357 1790774590.495089 mapread 0x00a855 thru 0x016708 (0xbeb4 bytes) 000358 1790774590.525369 punch from 0x00b112 to 0x00e68c (0x357b bytes) 000359 1790774590.577306 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x383fa): Mirror 2: 0x6ea7c65c (stale) Mirror 4: 0x6ea7c65c (stale) Mirror 5: 0x6ea7c65c (stale) Mirror 6: 0x6ea7c65c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x383fa): Mirror 2: 0x6ea7c65c (stale) Mirror 4: 0x6ea7c65c (stale) Mirror 5: 0x6ea7c65c (stale) Mirror 6: 0x6ea7c65c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x383fa: skipped 000360 1790774590.939780 punch from 0x014a54 to 0x01c268 (0x7815 bytes) 000361 1790774590.945355 mapread 0x0195df thru 0x0199d2 (0x3f4 bytes) 000362 1790774590.957746 MIRROR_RESYNC 5 mirrors 000363 1790774591.980935 write 0x03accf thru 0x03ffff (0x5331 bytes) 000364 1790774592.036533 read 0x01e31e thru 0x029b6e (0xb851 bytes) 000365 1790774592.050520 write 0x014f13 thru 0x01ed82 (0x9e70 bytes) 000366 1790774592.065677 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 5: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 5: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000367 1790774592.553964 read 0x00c2d6 thru 0x00f420 (0x314b bytes) 000368 1790774592.568517 MIRROR_RESYNC 4 mirrors 000369 1790774593.607065 trunc from 0x029cf5 to 0x036616 (0xc922 bytes) 000370 1790774593.645515 write 0x01aef0 thru 0x029c8a (0xed9b bytes) 000371 1790774593.657188 trunc from 0x03049e to 0x03a8ea (0xa44d bytes) 000372 1790774593.663750 mapread 0x023dda thru 0x024315 (0x53c bytes) 000373 1790774593.666073 read 0x011dd9 thru 0x01a71d (0x8945 bytes) 000374 1790774593.681455 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x83bbd9d8 (stale) Mirror 4: 0x83bbd9d8 (stale) Mirror 5: 0x83bbd9d8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xae6c069a Mirror 6: 0xae6c069a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000375 1790774594.807735 mapwrite 0x029916 thru 0x02f815 (0x5f00 bytes) 000376 1790774594.965166 mapread 0x03252a thru 0x03ffff (0xdad6 bytes) 000377 1790774595.001998 fallocate 0x03766c thru 0x039365 (0x1cfa bytes) 000379 1790774595.024939 mapwrite 0x0214b5 thru 0x021970 (0x4bc bytes) 000380 1790774595.073387 mapread 0x0025b2 thru 0x00636f (0x3dbe bytes) 000381 1790774595.107810 write 0x038c8b thru 0x03e3a9 (0x571f bytes) 000382 1790774595.117427 read 0x016e7a thru 0x0206e5 (0x986c bytes) 000383 1790774595.127404 mapwrite 0x03145a thru 0x03e04d (0xcbf4 bytes) 000384 1790774595.164098 fallocate 0x02012e thru 0x0298fa (0x97cd bytes) 000385 1790774595.171868 read 0x030b10 thru 0x037425 (0x6916 bytes) 000386 1790774595.172922 read 0x038262 thru 0x03ffff (0x7d9e bytes) 000387 1790774595.174052 trunc from 0x014036 to 0x01c7c9 (0x8794 bytes) 000388 1790774595.181984 mapwrite 0x00a091 thru 0x0168aa (0xc81a bytes) 000389 1790774595.239136 punch from 0x0082a1 to 0x00a8cb (0x262b bytes) 000391 1790774595.247040 trunc from 0x040000 to 0x03ae85 (0x517a bytes) 000392 1790774595.278461 trunc from 0x03ae86 to 0x001984 (0x39501 bytes) 000393 1790774595.310216 punch from 0x0015c9 to 0x0015de (0x16 bytes) 000394 1790774595.314732 mapwrite 0x02cb2f thru 0x02e5a2 (0x1a74 bytes) 000395 1790774595.382414 trunc from 0x004c69 to 0x00fdd5 (0xb16d bytes) 000396 1790774595.392931 punch from 0x026686 to 0x02e5a2 (0x7f1d bytes) 000399 1790774595.402725 trunc from 0x02a8d0 to 0x02e5a2 (0x3cd3 bytes) 000400 1790774595.415310 write 0x025160 thru 0x033d4d (0xebee bytes) 000401 1790774595.422672 trunc from 0x018f63 to 0x02266e (0x970c bytes) 000402 1790774595.429544 read 0x0280d8 thru 0x033d4d (0xbc76 bytes) 000403 1790774595.430148 trunc from 0x018155 to 0x024b11 (0xc9bd bytes) 000404 1790774595.442256 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x33d4e): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33d4e): Mirror 2: 0x6b5bd5a4 (stale) Mirror 4: 0x6b5bd5a4 (stale) Mirror 5: 0x6b5bd5a4 (stale) Mirror 6: 0xa3977cf0 (stale) CRC-32 checksum value for chunk [0, 0x33d4e): Mirror 1: 0xc19cf3fe Mirror 7: 0xc19cf3fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33d4e: skipped 000405 1790774596.368786 write 0x014d39 thru 0x017ad9 (0x2da1 bytes) 000406 1790774596.488897 fallocate 0x00e6c4 thru 0x0185d4 (0x9f11 bytes) 000407 1790774596.507028 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x33d4e): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33d4e): Mirror 2: 0x6b5bd5a4 (stale) Mirror 4: 0x6b5bd5a4 (stale) Mirror 5: 0x6b5bd5a4 (stale) Mirror 6: 0xa3977cf0 (stale) Mirror 7: 0xc19cf3fe (stale) CRC-32 checksum value for chunk [0, 0x33d4e): Mirror 1: 0x47b2c5c9 Mirror 8: 0x47b2c5c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33d4e: skipped 000408 1790774598.133547 trunc from 0x033d4e to 0x004f8f (0x2edbe bytes) 000409 1790774598.272947 mapread 0x004722 thru 0x004f8f (0x86e bytes) 000410 1790774598.286264 trunc from 0x004e77 to 0x004f8f (0x119 bytes) 000411 1790774598.299815 mapwrite 0x01dd3f thru 0x02c072 (0xe334 bytes) 000412 1790774598.424950 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c073): Mirror 4: 0xb3abcf97 (stale) Mirror 5: 0xb3abcf97 (stale) Mirror 6: 0x828c0f3b (stale) Mirror 7: 0x71613c05 (stale) Mirror 8: 0x386dff92 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c073): Mirror 4: 0xb3abcf97 (stale) Mirror 5: 0xb3abcf97 (stale) Mirror 6: 0x828c0f3b (stale) Mirror 7: 0x71613c05 (stale) Mirror 8: 0x386dff92 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c073: skipped 000413 1790774599.029838 fallocate 0x019098 thru 0x021362 (0x82cb bytes) 000414 1790774599.042568 read 0x021e11 thru 0x023194 (0x1384 bytes) 000415 1790774599.054295 mapwrite 0x013033 thru 0x01558c (0x255a bytes) 000416 1790774599.100214 trunc from 0x02c073 to 0x02adf7 (0x127b bytes) 000417 1790774599.146283 write 0x009d28 thru 0x0175da (0xd8b3 bytes) 000418 1790774599.155788 mapread 0x0005b9 thru 0x008aa0 (0x84e8 bytes) 000419 1790774599.200276 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2adf8): Mirror 5: 0x7c9e23af (stale) Mirror 6: 0xe2c1a6e5 (stale) Mirror 7: 0xabebb926 (stale) Mirror 8: 0xa2d68c6c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2adf8): Mirror 5: 0x7c9e23af (stale) Mirror 6: 0xe2c1a6e5 (stale) Mirror 7: 0xabebb926 (stale) Mirror 8: 0xa2d68c6c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2adf8: skipped 000420 1790774599.700236 MIRROR_RESYNC 5 mirrors 000421 1790774601.476920 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) 000422 1790774602.161003 write 0x032ea7 thru 0x039f66 (0x70c0 bytes) 000423 1790774602.212920 punch from 0x018334 to 0x022858 (0xa525 bytes) 000424 1790774602.226970 MIRROR_RESYNC 4 mirrors 000425 1790774603.584405 mapwrite 0x03db79 thru 0x03ffff (0x2487 bytes) 000426 1790774603.662672 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x78301318 (stale) Mirror 8: 0x78301318 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x78301318 (stale) Mirror 8: 0x78301318 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000427 1790774603.999886 MIRROR_RESYNC 3 mirrors 000428 1790774605.652711 mapread 0x00dd83 thru 0x01ca03 (0xec81 bytes) 000429 1790774605.718407 punch from 0x01799a to 0x0240f4 (0xc75b bytes) 000431 1790774605.784448 fallocate 0x024869 thru 0x02f0bc (0xa854 bytes) 000432 1790774605.797485 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4e74b758 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4e74b758 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000433 1790774606.322731 fallocate 0x03be52 thru 0x03f58e (0x373d bytes) 000434 1790774606.332916 mapread 0x03d04f thru 0x03ffff (0x2fb1 bytes) 000435 1790774606.361877 read 0x03ffd5 thru 0x03ffff (0x2b bytes) 000436 1790774606.363107 trunc from 0x040000 to 0x01c62c (0x239d3 bytes) 000437 1790774606.396103 trunc from 0x01c62d to 0x03b54c (0x1ef20 bytes) 000438 1790774606.425617 punch from 0x022a6f to 0x0237a3 (0xd35 bytes) 000439 1790774606.431587 mapread 0x00336e thru 0x01025b (0xceee bytes) 000440 1790774606.444191 write 0x00fa32 thru 0x015d75 (0x6344 bytes) 000442 1790774606.451178 trunc from 0x014c16 to 0x0161cf (0x15ba bytes) 000443 1790774606.469624 trunc from 0x03b54d to 0x01dfe3 (0x1d569 bytes) 000444 1790774606.494945 mapread 0x018025 thru 0x01dfe3 (0x5fbf bytes) 000445 1790774606.508364 trunc from 0x004d40 to 0x00ae4f (0x6110 bytes) 000447 1790774606.514604 mapread 0x01a0e4 thru 0x01dfe3 (0x3f00 bytes) 000448 1790774606.515514 trunc from 0x00b087 to 0x014da2 (0x9d1c bytes) 000449 1790774606.543825 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) 000450 1790774606.735468 mapread 0x0132c4 thru 0x0135f8 (0x335 bytes) 000451 1790774606.744436 trunc from 0x00adaa to 0x00d710 (0x2967 bytes) 000452 1790774606.758182 MIRROR_EXTEND to 2 mirrors 000453 1790774607.513578 trunc from 0x01dfe4 to 0x03aca2 (0x1ccbf bytes) 000454 1790774607.590981 fallocate 0x032542 thru 0x03cfe6 (0xaaa5 bytes) 000455 1790774607.598992 mapwrite 0x00bbcc thru 0x011297 (0x56cc bytes) 000456 1790774607.638399 fallocate 0x038c33 thru 0x03ffff (0x73cd bytes) 000457 1790774607.648272 MIRROR_RESYNC 2 mirrors 000458 1790774608.720801 MIRROR_RESYNC 2 mirrors 000460 1790774609.307423 write 0x02569b thru 0x031e6b (0xc7d1 bytes) 000461 1790774609.409986 mapread 0x01c0db thru 0x0275f6 (0xb51c bytes) 000462 1790774609.474245 trunc from 0x040000 to 0x031455 (0xebaa bytes) 000463 1790774609.516053 punch from 0x01bda6 to 0x01d43e (0x1699 bytes) 000464 1790774609.535734 read 0x008b88 thru 0x011555 (0x89ce bytes) 000466 1790774609.564656 fallocate 0x02c097 thru 0x033833 (0x779d bytes) 000467 1790774609.576745 trunc from 0x011335 to 0x019be6 (0x88b2 bytes) 000468 1790774609.588805 write 0x0298b5 thru 0x03350a (0x9c56 bytes) 000469 1790774609.612495 read 0x0061e7 thru 0x006be1 (0x9fb bytes) 000470 1790774609.628065 trunc from 0x033834 to 0x008875 (0x2afbe bytes) 000471 1790774609.662938 trunc from 0x008876 to 0x00dac5 (0x5250 bytes) 000472 1790774609.693235 fallocate 0x015f1d thru 0x019c40 (0x3d24 bytes) 000473 1790774609.712374 trunc from 0x00dac6 to 0x00741d (0x66a8 bytes) 000474 1790774609.751450 write 0x02c0e6 thru 0x035487 (0x93a2 bytes) 000475 1790774609.763523 trunc from 0x035488 to 0x035423 (0x64 bytes) 000476 1790774609.815545 trunc from 0x034394 to 0x035423 (0x1090 bytes) 000477 1790774609.859716 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) 000478 1790774610.136463 punch from 0x022ce4 to 0x0280d8 (0x53f5 bytes) 000479 1790774610.147009 punch from 0x008328 to 0x00d058 (0x4d31 bytes) 000480 1790774610.155817 trunc from 0x035424 to 0x01a21a (0x1b209 bytes) 000481 1790774610.195015 fallocate 0x0262d1 thru 0x03542f (0xf15f bytes) 000483 1790774610.210268 mapwrite 0x00ddfe thru 0x016203 (0x8406 bytes) 000484 1790774610.273373 mapwrite 0x01bd59 thru 0x02af82 (0xf22a bytes) 000485 1790774610.362011 punch from 0x028320 to 0x02af82 (0x2c63 bytes) 000486 1790774610.370924 mapwrite 0x039e8d thru 0x03e325 (0x4499 bytes) 000488 1790774610.441946 punch from 0x02a55d to 0x039679 (0xf11d bytes) 000489 1790774610.450917 mapread 0x01fcf3 thru 0x02a493 (0xa7a1 bytes) 000490 1790774610.471894 read 0x01e757 thru 0x025786 (0x7030 bytes) 000491 1790774610.473881 mapwrite 0x025682 thru 0x02cf74 (0x78f3 bytes) 000492 1790774610.519113 punch from 0x016603 to 0x0200d8 (0x9ad6 bytes) 000493 1790774610.526355 fallocate 0x013cff thru 0x0152c3 (0x15c5 bytes) 000495 1790774610.533274 trunc from 0x0290a0 to 0x033658 (0xa5b9 bytes) 000496 1790774610.541947 read 0x00c84d thru 0x01bad6 (0xf28a bytes) 000497 1790774610.627273 fallocate 0x002b06 thru 0x00a114 (0x760f bytes) 000498 1790774610.637278 fallocate 0x034bea thru 0x03a32c (0x5743 bytes) 000500 1790774610.651358 punch from 0x015aae to 0x018738 (0x2c8b bytes) 000501 1790774610.659084 mapwrite 0x01623c thru 0x0206a3 (0xa468 bytes) 000503 1790774610.710452 trunc from 0x03a1b6 to 0x03b144 (0xf8f bytes) 000504 1790774610.719221 write 0x013d86 thru 0x023641 (0xf8bc bytes) 000505 1790774610.722031 trunc from 0x03e326 to 0x03be39 (0x24ec bytes) 000506 1790774610.739374 mapwrite 0x00c145 thru 0x014953 (0x880f bytes) 000508 1790774610.764744 mapwrite 0x011a6e thru 0x01c860 (0xadf3 bytes) 000509 1790774610.789852 mapwrite 0x001c62 thru 0x005058 (0x33f7 bytes) 000510 1790774610.823596 mapread 0x00e51c thru 0x00edbd (0x8a2 bytes) 000511 1790774610.825005 mapread 0x00c9d8 thru 0x019092 (0xc6bb bytes) 000514 1790774610.829236 read 0x00acc3 thru 0x010dfb (0x6139 bytes) 000515 1790774610.830394 read 0x0009aa thru 0x0034df (0x2b36 bytes) 000516 1790774610.831254 write 0x02cfd5 thru 0x0319ad (0x49d9 bytes) 000517 1790774610.833201 read 0x031295 thru 0x03690a (0x5676 bytes) 000518 1790774610.833899 punch from 0x003699 to 0x006506 (0x2e6e bytes) 000519 1790774610.842230 mapwrite 0x00088e thru 0x002001 (0x1774 bytes) 000520 1790774610.864870 write 0x0122f0 thru 0x015ca6 (0x39b7 bytes) 000521 1790774610.867625 mapread 0x028c0f thru 0x033fe8 (0xb3da bytes) 000523 1790774610.869837 trunc from 0x03be3a to 0x018d7c (0x230bd bytes) 000524 1790774610.894376 fallocate 0x01837b thru 0x021b1f (0x97a5 bytes) 000525 1790774610.906884 mapread 0x0015a5 thru 0x00c522 (0xaf7e bytes) 000526 1790774610.942604 read 0x004357 thru 0x00601b (0x1cc5 bytes) 000527 1790774610.957594 MIRROR_EXTEND to 2 mirrors 000528 1790774612.198997 mapwrite 0x006f61 thru 0x0162bd (0xf35d bytes) 000529 1790774612.306285 write 0x02d36f thru 0x03a479 (0xd10b bytes) 000530 1790774612.314210 read 0x03044f thru 0x03a479 (0xa02b bytes) 000531 1790774612.315082 trunc from 0x03a47a to 0x02fb7f (0xa8fa bytes) 000532 1790774612.335051 mapread 0x02c8c9 thru 0x02fb7f (0x32b7 bytes) 000533 1790774612.343781 mapwrite 0x00f053 thru 0x013a06 (0x49b4 bytes) 000534 1790774612.359031 trunc from 0x02fb80 to 0x033b9a (0x401b bytes) 000535 1790774612.373810 read 0x0203cd thru 0x02abb1 (0xa7e5 bytes) 000536 1790774612.399566 mapwrite 0x01e05f thru 0x028432 (0xa3d4 bytes) 000537 1790774612.428968 mapread 0x032e4a thru 0x033b9a (0xd51 bytes) 000538 1790774612.430504 mapread 0x030d6b thru 0x033b9a (0x2e30 bytes) 000539 1790774612.437489 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) 000540 1790774612.632042 mapwrite 0x00dedf thru 0x011453 (0x3575 bytes) 000541 1790774612.687776 write 0x00e392 thru 0x00f7a2 (0x1411 bytes) 000542 1790774612.693990 mapread 0x004504 thru 0x0055ca (0x10c7 bytes) 000543 1790774612.709952 mapread 0x0163b5 thru 0x01cf6a (0x6bb6 bytes) 000544 1790774612.719680 punch from 0x026e6d to 0x033b9a (0xcd2e bytes) 000545 1790774612.724459 read 0x001a76 thru 0x011141 (0xf6cc bytes) 000546 1790774612.725552 trunc from 0x026d9f to 0x033b9a (0xcdfc bytes) 000547 1790774612.730734 trunc from 0x033b9b to 0x02b12f (0x8a6b bytes) 000549 1790774612.749529 fallocate 0x00cf31 thru 0x0175da (0xa6aa bytes) 000550 1790774612.755301 mapread 0x0044d4 thru 0x00c980 (0x84ad bytes) 000551 1790774612.758883 read 0x0180e5 thru 0x020271 (0x818d bytes) 000552 1790774612.759864 mapread 0x0096cf thru 0x011b30 (0x8462 bytes) 000553 1790774612.761633 read 0x005a55 thru 0x0140b3 (0xe65f bytes) 000554 1790774612.762890 trunc from 0x023168 to 0x02362e (0x4c7 bytes) 000555 1790774612.769832 trunc from 0x007be3 to 0x014b39 (0xcf57 bytes) 000557 1790774612.787913 MIRROR_EXTEND to 2 mirrors 000558 1790774614.341419 mapwrite 0x01ad57 thru 0x02090e (0x5bb8 bytes) 000559 1790774614.463916 punch from 0x00df0c to 0x01124e (0x3343 bytes) 000560 1790774614.470355 trunc from 0x024843 to 0x025974 (0x1132 bytes) 000561 1790774614.477205 fallocate 0x01f709 thru 0x028df1 (0x96e9 bytes) 000562 1790774614.483638 read 0x00dcf7 thru 0x017b15 (0x9e1f bytes) 000563 1790774614.493671 write 0x02477d thru 0x02d20c (0x8a90 bytes) 000564 1790774614.507831 punch from 0x00539d to 0x014fa6 (0xfc0a bytes) 000565 1790774614.512709 mapwrite 0x021e50 thru 0x02c15f (0xa310 bytes) 000566 1790774614.530183 mapwrite 0x024e43 thru 0x02fd28 (0xaee6 bytes) 000567 1790774614.625186 punch from 0x003016 to 0x0103b4 (0xd39f bytes) 000568 1790774614.635863 write 0x00e404 thru 0x00f257 (0xe54 bytes) 000569 1790774614.664804 fallocate 0x01a3f6 thru 0x02004a (0x5c55 bytes) 000570 1790774614.676676 trunc from 0x02fd29 to 0x01f179 (0x10baf bytes) 000572 1790774614.736236 trunc from 0x005fac to 0x014828 (0xe87d bytes) 000573 1790774614.781985 write 0x01b522 thru 0x021f2f (0x6a0e bytes) 000574 1790774614.783226 read 0x01accb thru 0x021f2f (0x7265 bytes) 000575 1790774614.783798 punch from 0x01c660 to 0x01f100 (0x2aa1 bytes) 000576 1790774614.822671 trunc from 0x00ccb2 to 0x0177dc (0xab2b bytes) 000577 1790774614.844038 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x21f30): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21f30): Mirror 2: 0xc66ecaaa (stale) CRC-32 checksum value for chunk [0, 0x21f30): Mirror 1: 0x58d4c8ad Mirror 3: 0x58d4c8ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21f30: skipped 000578 1790774616.440653 trunc from 0x000972 to 0x0041a5 (0x3834 bytes) 000579 1790774616.510115 read 0x018041 thru 0x021f2f (0x9eef bytes) 000580 1790774616.557862 MIRROR_RESYNC 3 mirrors 000581 1790774617.887568 read 0x00067c thru 0x0063d7 (0x5d5c bytes) 000582 1790774617.900099 trunc from 0x0141ea to 0x014581 (0x398 bytes) 000583 1790774617.951420 write 0x0126ce thru 0x01f772 (0xd0a5 bytes) 000584 1790774617.966619 punch from 0x00c63a to 0x014667 (0x802e bytes) 000585 1790774617.985578 trunc from 0x019b2d to 0x020781 (0x6c55 bytes) 000586 1790774617.991668 read 0x0213f5 thru 0x021f2f (0xb3b bytes) 000587 1790774618.003953 fallocate 0x000539 thru 0x002a7e (0x2546 bytes) 000588 1790774618.009826 read 0x010457 thru 0x01ccec (0xc896 bytes) 000589 1790774618.010851 mapwrite 0x01b419 thru 0x029ee2 (0xeaca bytes) 000590 1790774618.066562 fallocate 0x0313a2 thru 0x03a94b (0x95aa bytes) 000591 1790774618.074279 trunc from 0x03a94c to 0x03604d (0x48fe bytes) 000592 1790774618.094268 mapread 0x02b601 thru 0x032b25 (0x7525 bytes) 000593 1790774618.106294 write 0x02a132 thru 0x02b5b1 (0x1480 bytes) 000594 1790774618.107710 mapwrite 0x0160d3 thru 0x017636 (0x1564 bytes) 000596 1790774618.130894 fallocate 0x01061f thru 0x01d5e1 (0xcfc3 bytes) 000597 1790774618.136540 mapwrite 0x02838e thru 0x03163a (0x92ad bytes) 000598 1790774618.170937 fallocate 0x0011cd thru 0x00e469 (0xd29d bytes) 000599 1790774618.194429 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3604e): Mirror 3: 0x147abee9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3604e): Mirror 3: 0x147abee9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3604e: skipped 000600 1790774618.486235 trunc from 0x03604e to 0x012a87 (0x235c6 bytes) 000602 1790774618.515256 mapread 0x00558e thru 0x0106a7 (0xb11a bytes) 000604 1790774618.538127 fallocate 0x0386e7 thru 0x03ffff (0x7919 bytes) 000605 1790774618.543287 read 0x01869b thru 0x026097 (0xd9fd bytes) 000606 1790774618.559596 punch from 0x022332 to 0x022dd6 (0xaa5 bytes) 000607 1790774618.565822 mapread 0x0166e9 thru 0x02387d (0xd195 bytes) 000608 1790774618.586992 mapwrite 0x028018 thru 0x02cdc0 (0x4da9 bytes) 000610 1790774618.626476 punch from 0x030db4 to 0x035c33 (0x4e80 bytes) 000611 1790774618.632895 mapread 0x025625 thru 0x0259c8 (0x3a4 bytes) 000612 1790774618.633930 mapread 0x03edfa thru 0x03f117 (0x31e bytes) 000613 1790774618.673773 mapwrite 0x0209cb thru 0x020a07 (0x3d bytes) 000614 1790774618.693291 trunc from 0x040000 to 0x023bdb (0x1c424 bytes) 000615 1790774618.723086 write 0x0386dd thru 0x03a038 (0x195c bytes) 000616 1790774618.724239 fallocate 0x034a8f thru 0x03ffff (0xb571 bytes) 000618 1790774618.738866 MIRROR_RESYNC 2 mirrors 000619 1790774619.458651 trunc from 0x022539 to 0x02f9ad (0xd475 bytes) 000620 1790774619.518106 punch from 0x028736 to 0x033b99 (0xb464 bytes) 000621 1790774619.527814 trunc from 0x040000 to 0x0021fa (0x3de05 bytes) 000622 1790774619.553295 fallocate 0x011858 thru 0x01e52d (0xccd6 bytes) 000623 1790774619.561152 write 0x0246c7 thru 0x02ab8f (0x64c9 bytes) 000625 1790774619.571151 MIRROR_RESYNC 2 mirrors 000626 1790774620.306222 read 0x00f6af thru 0x011d6b (0x26bd bytes) 000627 1790774620.313982 fallocate 0x01a28d thru 0x01bdde (0x1b52 bytes) 000628 1790774620.361765 mapread 0x02923c thru 0x02ab8f (0x1954 bytes) 000629 1790774620.375253 trunc from 0x018be2 to 0x0224fe (0x991d bytes) 000630 1790774620.381785 write 0x037451 thru 0x03ffff (0x8baf bytes) 000631 1790774620.383822 trunc from 0x02566a to 0x02d55b (0x7ef2 bytes) 000632 1790774620.389736 read 0x0004d0 thru 0x00409d (0x3bce bytes) 000633 1790774620.424919 mapwrite 0x010985 thru 0x014060 (0x36dc bytes) 000634 1790774620.442842 mapread 0x0387c8 thru 0x03ffff (0x7838 bytes) 000635 1790774620.445108 trunc from 0x040000 to 0x027cd2 (0x1832d bytes) 000636 1790774620.470191 punch from 0x0115a9 to 0x0139e2 (0x243a bytes) 000637 1790774620.477130 read 0x01ebbc thru 0x01fb36 (0xf7b bytes) 000638 1790774620.479084 read 0x004789 thru 0x00849e (0x3d16 bytes) 000639 1790774620.480616 mapread 0x00190d thru 0x00c3f0 (0xaae4 bytes) 000640 1790774620.482077 punch from 0x01381f to 0x01d9c5 (0xa1a7 bytes) 000641 1790774620.487607 read 0x007e26 thru 0x00f213 (0x73ee bytes) 000642 1790774620.489072 fallocate 0x01483a thru 0x01be1f (0x75e6 bytes) 000643 1790774620.494905 trunc from 0x00490c to 0x00d8c9 (0x8fbe bytes) 000645 1790774620.500936 punch from 0x01971e to 0x0253b0 (0xbc93 bytes) 000646 1790774620.512590 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x27cd3): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27cd3): Mirror 3: 0x2364d508 (stale) CRC-32 checksum value for chunk [0, 0x27cd3): Mirror 1: 0x83aa6194 Mirror 4: 0x83aa6194 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27cd3: skipped 000647 1790774621.461983 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x27cd3): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27cd3): Mirror 3: 0x2364d508 (stale) CRC-32 checksum value for chunk [0, 0x27cd3): Mirror 1: 0x83aa6194 Mirror 4: 0x83aa6194 Mirror 5: 0x83aa6194 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27cd3: skipped 000648 1790774622.535951 punch from 0x01d89b to 0x0259f2 (0x8158 bytes) 000649 1790774622.580196 fallocate 0x03cde1 thru 0x03ffff (0x321f bytes) 000650 1790774622.589028 write 0x00a57f thru 0x016fce (0xca50 bytes) 000651 1790774622.617753 write 0x005c25 thru 0x007c78 (0x2054 bytes) 000652 1790774622.652490 write 0x0128fe thru 0x016272 (0x3975 bytes) 000653 1790774622.653448 read 0x006436 thru 0x007983 (0x154e bytes) 000654 1790774622.653957 trunc from 0x020a65 to 0x02f4fa (0xea96 bytes) 000655 1790774622.669668 mapread 0x011744 thru 0x015ff1 (0x48ae bytes) 000656 1790774622.671305 punch from 0x0359d7 to 0x0376d1 (0x1cfb bytes) 000657 1790774622.676980 fallocate 0x000977 thru 0x0103fc (0xfa86 bytes) 000658 1790774622.691217 write 0x0211ac thru 0x0242ab (0x3100 bytes) 000659 1790774622.715827 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x8b64bb43 (stale) Mirror 5: 0x8b64bb43 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x8b64bb43 (stale) Mirror 5: 0x8b64bb43 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000660 1790774623.107238 trunc from 0x040000 to 0x03dad2 (0x252d bytes) 000661 1790774623.139299 write 0x000616 thru 0x008a71 (0x845c bytes) 000663 1790774623.153861 mapwrite 0x01fb5f thru 0x02f3ae (0xf850 bytes) 000664 1790774623.220964 mapwrite 0x0047be thru 0x010270 (0xbab3 bytes) 000665 1790774623.288781 fallocate 0x016056 thru 0x01ccf4 (0x6c9f bytes) 000666 1790774623.295051 write 0x02903f thru 0x02bbfe (0x2bc0 bytes) 000667 1790774623.295978 mapread 0x0360c7 thru 0x03dad2 (0x7a0c bytes) 000668 1790774623.319759 mapwrite 0x013dee thru 0x01c5a7 (0x87ba bytes) 000669 1790774623.384684 fallocate 0x03b628 thru 0x03ffff (0x49d8 bytes) 000672 1790774623.413879 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x8b64bb43 (stale) Mirror 5: 0x8b64bb43 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc2dd166b Mirror 6: 0xc2dd166b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000673 1790774624.783218 trunc from 0x040000 to 0x01ff0b (0x200f4 bytes) 000674 1790774624.872019 trunc from 0x01ff0c to 0x007a83 (0x18488 bytes) 000675 1790774624.894224 write 0x015582 thru 0x019e8f (0x490e bytes) 000676 1790774624.897238 punch from 0x016110 to 0x019e8f (0x3d80 bytes) 000677 1790774624.912730 mapread 0x000eb5 thru 0x00e7f3 (0xd93f bytes) 000678 1790774624.937509 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19e90): Mirror 4: 0xd4c3b83b (stale) Mirror 5: 0xd4c3b83b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19e90): Mirror 4: 0xd4c3b83b (stale) Mirror 5: 0xd4c3b83b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19e90: skipped 000679 1790774625.409079 mapwrite 0x03548f thru 0x03f286 (0x9df8 bytes) 000680 1790774625.481038 mapread 0x01d231 thru 0x02a318 (0xd0e8 bytes) 000681 1790774625.503823 trunc from 0x03c1b2 to 0x03f286 (0x30d5 bytes) 000682 1790774625.510636 fallocate 0x01df4a thru 0x028d6c (0xae23 bytes) 000683 1790774625.516074 read 0x0217d2 thru 0x02ce23 (0xb652 bytes) 000684 1790774625.517125 trunc from 0x03f287 to 0x03d3ae (0x1ed8 bytes) 000685 1790774625.538137 MIRROR_RESYNC 3 mirrors 000686 1790774626.957785 mapread 0x02418e thru 0x028a38 (0x48ab bytes) 000687 1790774626.989092 fallocate 0x0114b0 thru 0x013a07 (0x2558 bytes) 000688 1790774627.033961 fallocate 0x00d9d8 thru 0x01471a (0x6d43 bytes) 000689 1790774627.040817 mapwrite 0x0331e3 thru 0x03ffff (0xce1d bytes) 000690 1790774627.135832 read 0x032a58 thru 0x03ffff (0xd5a8 bytes) 000691 1790774627.136847 mapwrite 0x004b41 thru 0x006b8b (0x204b bytes) 000692 1790774627.165448 read 0x002274 thru 0x00af6d (0x8cfa bytes) 000693 1790774627.166856 write 0x02d33e thru 0x03d00b (0xfcce bytes) 000694 1790774627.168788 mapread 0x02dc11 thru 0x036e0d (0x91fd bytes) 000695 1790774627.170804 mapwrite 0x02409d thru 0x02bb93 (0x7af7 bytes) 000696 1790774627.210951 mapwrite 0x00f4e6 thru 0x01850b (0x9026 bytes) 000697 1790774627.238581 fallocate 0x003d42 thru 0x01084f (0xcb0e bytes) 000698 1790774627.244130 punch from 0x02adee to 0x034452 (0x9665 bytes) 000699 1790774627.250617 write 0x03e8dc thru 0x03ffff (0x1724 bytes) 000700 1790774627.251793 trunc from 0x00be74 to 0x019785 (0xd912 bytes) 000701 1790774627.258609 mapwrite 0x0393a3 thru 0x03f37b (0x5fd9 bytes) 000702 1790774627.281870 mapread 0x0099e3 thru 0x019783 (0xfda1 bytes) 000703 1790774627.356817 trunc from 0x040000 to 0x0371a6 (0x8e59 bytes) 000704 1790774627.379255 punch from 0x024134 to 0x0295e2 (0x54af bytes) 000705 1790774627.387050 punch from 0x00bf28 to 0x010f48 (0x5021 bytes) 000706 1790774627.392594 trunc from 0x0371a7 to 0x03577d (0x1a29 bytes) 000707 1790774627.411809 fallocate 0x00dfa2 thru 0x017f43 (0x9fa2 bytes) 000708 1790774627.421399 fallocate 0x028d17 thru 0x033447 (0xa731 bytes) 000709 1790774627.428247 mapread 0x024815 thru 0x0317b0 (0xcf9c bytes) 000710 1790774627.554099 trunc from 0x030504 to 0x03577d (0x527a bytes) 000711 1790774627.560185 punch from 0x011f5a to 0x018afc (0x6ba3 bytes) 000712 1790774627.565781 read 0x02e057 thru 0x033ce4 (0x5c8e bytes) 000714 1790774627.579745 mapread 0x00cd4f thru 0x01a68d (0xd93f bytes) 000715 1790774627.581947 punch from 0x02d24b to 0x03577d (0x8533 bytes) 000716 1790774627.591685 mapwrite 0x02fbd5 thru 0x033603 (0x3a2f bytes) 000717 1790774627.683858 mapwrite 0x0195ed thru 0x01d029 (0x3a3d bytes) 000718 1790774627.712926 trunc from 0x003e6f to 0x0109c9 (0xcb5b bytes) 000719 1790774627.719576 punch from 0x02a195 to 0x02e1a9 (0x4015 bytes) 000720 1790774627.733063 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3577e): Mirror 5: 0x925b8257 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3577e): Mirror 5: 0x925b8257 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3577e: skipped 000721 1790774628.092737 read 0x0139c6 thru 0x01d2ce (0x9909 bytes) 000723 1790774628.113694 punch from 0x003859 to 0x008fb4 (0x575c bytes) 000724 1790774628.123909 punch from 0x00825d to 0x012a96 (0xa83a bytes) 000725 1790774628.128851 read 0x00fc7a thru 0x019d9e (0xa125 bytes) 000726 1790774628.149044 read 0x00a63e thru 0x019621 (0xefe4 bytes) 000727 1790774628.150589 fallocate 0x010858 thru 0x018943 (0x80ec bytes) 000728 1790774628.156768 trunc from 0x035636 to 0x03577d (0x148 bytes) 000729 1790774628.162711 trunc from 0x03577e to 0x005d0c (0x2fa71 bytes) 000730 1790774628.196161 trunc from 0x00387b to 0x005d0c (0x2492 bytes) 000731 1790774628.201593 trunc from 0x005d0d to 0x01a6d6 (0x149ca bytes) 000732 1790774628.217861 read 0x015d14 thru 0x01711a (0x1407 bytes) 000733 1790774628.228732 write 0x03d623 thru 0x03ffff (0x29dd bytes) 000734 1790774628.230232 read 0x02da89 thru 0x037db1 (0xa329 bytes) 000735 1790774628.244012 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) 000736 1790774628.373611 MIRROR_EXTEND to 2 mirrors 000737 1790774629.096951 mapread 0x03f3b8 thru 0x03ffff (0xc48 bytes) 000738 1790774629.105845 mapwrite 0x03f0be thru 0x03ffff (0xf42 bytes) 000739 1790774629.291531 read 0x03b42c thru 0x03d5a3 (0x2178 bytes) 000740 1790774629.308146 trunc from 0x040000 to 0x031f8a (0xe075 bytes) 000741 1790774629.416288 write 0x024abd thru 0x032a83 (0xdfc7 bytes) 000742 1790774629.437198 punch from 0x02a9c0 to 0x030079 (0x56ba bytes) 000744 1790774629.493761 trunc from 0x032a84 to 0x00169a (0x313e9 bytes) 000745 1790774629.514065 mapread 0x00156e thru 0x00169a (0x12d bytes) 000746 1790774629.522577 read 0x00068d thru 0x00169a (0x100e bytes) 000747 1790774629.529609 mapread 0x000797 thru 0x00169a (0xf04 bytes) 000748 1790774629.530744 punch from 0x0012a6 to 0x00169a (0x3f5 bytes) 000749 1790774629.544992 MIRROR_RESYNC 2 mirrors 000750 1790774630.004996 trunc from 0x000e3c to 0x00169a (0x85f bytes) 000751 1790774630.038021 mapread 0x0012c0 thru 0x00169a (0x3db bytes) 000752 1790774630.045810 fallocate 0x03071f thru 0x033fd1 (0x38b3 bytes) 000753 1790774630.051797 punch from 0x001502 to 0x00169a (0x199 bytes) 000754 1790774630.058216 punch from 0x0009fd to 0x00169a (0xc9e bytes) 000756 1790774630.064648 punch from 0x00094c to 0x00169a (0xd4f bytes) 000757 1790774630.071017 trunc from 0x00100c to 0x00169a (0x68f bytes) 000758 1790774630.077072 read 0x0002ae thru 0x00169a (0x13ed bytes) 000759 1790774630.083463 trunc from 0x000e29 to 0x00169a (0x872 bytes) 000760 1790774630.101163 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x169b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x169b): Mirror 2: 0x4ebefcff (stale) CRC-32 checksum value for chunk [0, 0x169b): Mirror 1: 0x97c52418 Mirror 3: 0x97c52418 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x169b: skipped 000761 1790774630.980625 write 0x025d5d thru 0x031627 (0xb8cb bytes) 000762 1790774631.032160 trunc from 0x02224b to 0x0292f9 (0x70af bytes) 000763 1790774631.049173 write 0x013ef3 thru 0x01986f (0x597d bytes) 000764 1790774631.060648 trunc from 0x031628 to 0x02b6db (0x5f4c bytes) 000765 1790774631.081579 punch from 0x01fee4 to 0x02125a (0x1377 bytes) 000766 1790774631.087979 mapwrite 0x03cd79 thru 0x03ffff (0x3287 bytes) 000767 1790774631.170504 punch from 0x029492 to 0x037dd2 (0xe941 bytes) 000768 1790774631.179916 read 0x00e7e9 thru 0x0178a6 (0x90be bytes) 000769 1790774631.195390 mapwrite 0x007536 thru 0x008ef1 (0x19bc bytes) 000770 1790774631.234763 fallocate 0x015f4a thru 0x01dbb1 (0x7c68 bytes) 000771 1790774631.242412 read 0x00cde0 thru 0x01074f (0x3970 bytes) 000772 1790774631.243159 trunc from 0x014fec to 0x01b3ec (0x6401 bytes) 000773 1790774631.256447 mapread 0x002f3c thru 0x010791 (0xd856 bytes) 000774 1790774631.257661 mapread 0x006b20 thru 0x015f03 (0xf3e4 bytes) 000775 1790774631.279662 fallocate 0x02cc86 thru 0x039911 (0xcc8c bytes) 000776 1790774631.286423 punch from 0x002e75 to 0x008bcd (0x5d59 bytes) 000777 1790774631.293797 mapread 0x0347e9 thru 0x03ffff (0xb817 bytes) 000778 1790774631.295552 mapwrite 0x0282c5 thru 0x032740 (0xa47c bytes) 000779 1790774631.322664 trunc from 0x0220b9 to 0x02f0ee (0xd036 bytes) 000780 1790774631.331606 mapwrite 0x01272e thru 0x01b4d1 (0x8da4 bytes) 000781 1790774631.361749 read 0x00bd88 thru 0x01b4da (0xf753 bytes) 000782 1790774631.364670 trunc from 0x039fe6 to 0x03ffff (0x601a bytes) 000783 1790774631.376207 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x75f0e58b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x75f0e58b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000784 1790774631.692103 trunc from 0x02f2ba to 0x038643 (0x938a bytes) 000786 1790774631.705550 fallocate 0x01906f thru 0x019b48 (0xada bytes) 000787 1790774631.721184 trunc from 0x040000 to 0x006c9d (0x39362 bytes) 000788 1790774631.781486 trunc from 0x006c9e to 0x02bcbd (0x25020 bytes) 000790 1790774631.815696 mapwrite 0x02e0b3 thru 0x035b41 (0x7a8f bytes) 000791 1790774631.984577 fallocate 0x03370d thru 0x03ffff (0xc8f3 bytes) 000792 1790774631.999988 mapwrite 0x01c59a thru 0x01dcc6 (0x172d bytes) 000793 1790774632.070168 write 0x012ff5 thru 0x01e090 (0xb09c bytes) 000794 1790774632.091940 write 0x03fa17 thru 0x03ffff (0x5e9 bytes) 000796 1790774632.105706 read 0x022e56 thru 0x0303bd (0xd568 bytes) 000797 1790774632.114404 trunc from 0x040000 to 0x00ae61 (0x3519e bytes) 000798 1790774632.148671 mapread 0x000d8e thru 0x0041fb (0x346e bytes) 000800 1790774632.181471 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xae62): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xae62): Mirror 3: 0x8641c617 (stale) CRC-32 checksum value for chunk [0, 0xae62): Mirror 1: 0x8641c617 Mirror 4: 0x8641c617 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xae62: skipped 000801 1790774633.364936 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) 000802 1790774633.712051 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) 000804 1790774633.875575 trunc from 0x00ae62 to 0x032d2b (0x27eca bytes) 000805 1790774633.974434 trunc from 0x00a78e to 0x00e6c5 (0x3f38 bytes) 000806 1790774633.989956 mapread 0x02d386 thru 0x032d2b (0x59a6 bytes) 000808 1790774634.034675 mapread 0x02cd05 thru 0x0319bd (0x4cb9 bytes) 000810 1790774634.039716 mapread 0x026272 thru 0x02bb32 (0x58c1 bytes) 000811 1790774634.059921 mapwrite 0x02dc54 thru 0x03b23c (0xd5e9 bytes) 000812 1790774634.140626 trunc from 0x02d652 to 0x031fbe (0x496d bytes) 000813 1790774634.150835 trunc from 0x03b23d to 0x00a25f (0x30fdd bytes) 000814 1790774634.176612 read 0x000da6 thru 0x00a25f (0x94ba bytes) 000816 1790774634.207864 punch from 0x002326 to 0x0060ec (0x3dc7 bytes) 000817 1790774634.218809 mapwrite 0x01bbef thru 0x02bbc9 (0xffdb bytes) 000818 1790774634.287084 mapread 0x0299c8 thru 0x02bbc9 (0x2202 bytes) 000819 1790774634.287914 mapwrite 0x03a97b thru 0x03ffff (0x5685 bytes) 000821 1790774634.346298 mapwrite 0x02456f thru 0x02ed5e (0xa7f0 bytes) 000822 1790774634.377777 mapread 0x0099a5 thru 0x016286 (0xc8e2 bytes) 000823 1790774634.395176 trunc from 0x02c610 to 0x03975e (0xd14f bytes) 000824 1790774634.401589 trunc from 0x010075 to 0x017de0 (0x7d6c bytes) 000825 1790774634.408481 punch from 0x01e3e6 to 0x01f5ff (0x121a bytes) 000826 1790774634.415550 trunc from 0x040000 to 0x02733f (0x18cc0 bytes) 000827 1790774634.439155 trunc from 0x021a65 to 0x02733f (0x58db bytes) 000828 1790774634.445910 trunc from 0x00d00a to 0x015060 (0x8057 bytes) 000829 1790774634.452714 fallocate 0x01f6b6 thru 0x024f6f (0x58ba bytes) 000830 1790774634.456940 mapwrite 0x01382f thru 0x0186d9 (0x4eab bytes) 000831 1790774634.495282 mapread 0x01c47d thru 0x02733f (0xaec3 bytes) 000832 1790774634.513502 trunc from 0x024362 to 0x02733f (0x2fde bytes) 000833 1790774634.520040 mapwrite 0x0236a0 thru 0x02e348 (0xaca9 bytes) 000834 1790774634.588956 fallocate 0x0358a5 thru 0x036d61 (0x14bd bytes) 000836 1790774634.594765 punch from 0x014e40 to 0x020a69 (0xbc2a bytes) 000837 1790774634.603055 mapread 0x02a38e thru 0x02e348 (0x3fbb bytes) 000838 1790774634.604553 trunc from 0x02e349 to 0x02a36c (0x3fdc bytes) 000839 1790774634.623601 trunc from 0x008699 to 0x016587 (0xdeef bytes) 000840 1790774634.631489 punch from 0x02248c to 0x029168 (0x6cdd bytes) 000842 1790774634.640461 write 0x006cee thru 0x00a1f1 (0x3504 bytes) 000843 1790774634.647108 punch from 0x00c38c to 0x0152eb (0x8f60 bytes) 000844 1790774634.657876 punch from 0x0035c2 to 0x007f3e (0x497d bytes) 000845 1790774634.686937 read 0x029730 thru 0x02a36c (0xc3d bytes) 000846 1790774634.726822 mapread 0x014ae2 thru 0x0176cc (0x2beb bytes) 000847 1790774634.734925 MIRROR_EXTEND to 2 mirrors 000848 1790774635.721013 mapwrite 0x0278ca thru 0x03596c (0xe0a3 bytes) 000849 1790774635.843770 fallocate 0x01f67a thru 0x026f5c (0x78e3 bytes) 000850 1790774635.850624 write 0x031f94 thru 0x03bf82 (0x9fef bytes) 000851 1790774635.859116 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3bf83): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bf83): Mirror 2: 0xe3884432 (stale) CRC-32 checksum value for chunk [0, 0x3bf83): Mirror 1: 0x567e3320 Mirror 3: 0x567e3320 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bf83: skipped 000852 1790774637.022135 fallocate 0x0070d4 thru 0x00944b (0x2378 bytes) 000853 1790774637.084138 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bf83): Mirror 3: 0x567e3320 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bf83): Mirror 3: 0x567e3320 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bf83: skipped 000854 1790774637.374696 punch from 0x0209da to 0x0229d6 (0x1ffd bytes) 000855 1790774637.378074 read 0x032bf2 thru 0x035df5 (0x3204 bytes) 000856 1790774637.382904 mapwrite 0x01b189 thru 0x027723 (0xc59b bytes) 000857 1790774637.425899 MIRROR_RESYNC 2 mirrors 000858 1790774638.067279 fallocate 0x00af71 thru 0x013bde (0x8c6e bytes) 000859 1790774638.112130 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3bf83): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bf83): Mirror 3: 0x7a416ca2 (stale) CRC-32 checksum value for chunk [0, 0x3bf83): Mirror 1: 0x7a416ca2 Mirror 4: 0x7a416ca2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bf83: skipped 000860 1790774638.826301 trunc from 0x012138 to 0x014fdc (0x2ea5 bytes) 000861 1790774638.879651 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3bf83): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bf83): Mirror 3: 0x7a416ca2 (stale) Mirror 4: 0x7a416ca2 (stale) CRC-32 checksum value for chunk [0, 0x3bf83): Mirror 1: 0x7a416ca2 Mirror 5: 0x7a416ca2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bf83: skipped 000863 1790774639.956232 write 0x02778f thru 0x02e02d (0x689f bytes) 000864 1790774640.015890 MIRROR_RESYNC 4 mirrors 000865 1790774641.247156 punch from 0x03958f to 0x03bf82 (0x29f4 bytes) 000867 1790774641.295083 punch from 0x021271 to 0x02c4a7 (0xb237 bytes) 000868 1790774641.303388 trunc from 0x03a168 to 0x03bf82 (0x1e1b bytes) 000869 1790774641.312048 punch from 0x032c19 to 0x035d5e (0x3146 bytes) 000870 1790774641.319986 trunc from 0x03bf83 to 0x037951 (0x4631 bytes) 000871 1790774641.346841 trunc from 0x0096d0 to 0x013b01 (0xa432 bytes) 000872 1790774641.353740 mapwrite 0x024a4e thru 0x029ef2 (0x54a5 bytes) 000873 1790774641.392609 mapread 0x015348 thru 0x019bfe (0x48b7 bytes) 000874 1790774641.403452 mapread 0x0201cf thru 0x029eab (0x9cdd bytes) 000875 1790774641.404441 read 0x028524 thru 0x037067 (0xeb44 bytes) 000876 1790774641.414379 punch from 0x01a742 to 0x0221a7 (0x7a66 bytes) 000877 1790774641.419409 write 0x024ae3 thru 0x02bef7 (0x7415 bytes) 000878 1790774641.420688 trunc from 0x037952 to 0x013df5 (0x23b5c bytes) 000879 1790774641.438830 write 0x03d405 thru 0x03ffff (0x2bfb bytes) 000880 1790774641.440077 trunc from 0x02f876 to 0x0306c1 (0xe4c bytes) 000881 1790774641.446050 mapread 0x01a568 thru 0x02914a (0xebe3 bytes) 000883 1790774641.466312 mapread 0x03b7e0 thru 0x03ffff (0x4820 bytes) 000885 1790774641.475238 trunc from 0x040000 to 0x015c2d (0x2a3d2 bytes) 000886 1790774641.496112 write 0x001933 thru 0x010379 (0xea47 bytes) 000887 1790774641.504374 read 0x007bf5 thru 0x00d2f2 (0x56fe bytes) 000888 1790774641.505067 punch from 0x003092 to 0x003f72 (0xee1 bytes) 000889 1790774641.520998 fallocate 0x03398b thru 0x03fe9d (0xc513 bytes) 000891 1790774641.526646 fallocate 0x0346d2 thru 0x03ffff (0xb92e bytes) 000892 1790774641.531664 mapwrite 0x01b057 thru 0x0234e7 (0x8491 bytes) 000893 1790774641.561665 fallocate 0x028b67 thru 0x0377a9 (0xec43 bytes) 000894 1790774641.567946 write 0x02a043 thru 0x03784a (0xd808 bytes) 000895 1790774641.569730 mapread 0x02ea20 thru 0x03def1 (0xf4d2 bytes) 000896 1790774641.571489 write 0x02de38 thru 0x034e0d (0x6fd6 bytes) 000897 1790774641.572953 trunc from 0x03fe9e to 0x01fd9f (0x200fe bytes) 000899 1790774641.600540 trunc from 0x01fda0 to 0x003d57 (0x1c048 bytes) 000900 1790774641.621983 mapread 0x000cef thru 0x003d57 (0x3069 bytes) 000901 1790774641.622937 mapwrite 0x03f27c thru 0x03ffff (0xd84 bytes) 000902 1790774641.664120 mapwrite 0x030ca6 thru 0x03b948 (0xaca3 bytes) 000903 1790774641.747690 mapread 0x01b0a5 thru 0x01bbab (0xb07 bytes) 000904 1790774641.753240 read 0x004ffc thru 0x008c49 (0x3c4e bytes) 000905 1790774641.771088 punch from 0x02dfb9 to 0x035f07 (0x7f4f bytes) 000906 1790774641.776314 mapread 0x01c4f6 thru 0x01e17d (0x1c88 bytes) 000907 1790774641.777445 punch from 0x0149e8 to 0x020b4d (0xc166 bytes) 000908 1790774641.785924 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb628e3e2 (stale) Mirror 4: 0xb628e3e2 (stale) Mirror 5: 0xb628e3e2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf937f57 Mirror 6: 0xf937f57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000909 1790774642.522086 trunc from 0x028305 to 0x0336a5 (0xb3a1 bytes) 000910 1790774642.579484 write 0x00b77f thru 0x0114dc (0x5d5e bytes) 000911 1790774642.602077 fallocate 0x02fc86 thru 0x037e9a (0x8215 bytes) 000913 1790774642.622886 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb628e3e2 (stale) Mirror 4: 0xb628e3e2 (stale) Mirror 6: 0xf937f57 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb628e3e2 (stale) Mirror 4: 0xb628e3e2 (stale) Mirror 6: 0xf937f57 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000914 1790774643.086541 punch from 0x031257 to 0x038a9f (0x7849 bytes) 000915 1790774643.093214 mapread 0x010c60 thru 0x01141c (0x7bd bytes) 000916 1790774643.113379 punch from 0x032bf9 to 0x033b04 (0xf0c bytes) 000917 1790774643.120651 write 0x017cff thru 0x01fb0d (0x7e0f bytes) 000918 1790774643.141565 mapwrite 0x033e40 thru 0x03ba21 (0x7be2 bytes) 000919 1790774643.182361 mapwrite 0x00fa30 thru 0x01863f (0x8c10 bytes) 000920 1790774643.231973 mapwrite 0x01510e thru 0x018a47 (0x393a bytes) 000922 1790774643.256888 trunc from 0x040000 to 0x0106a4 (0x2f95b bytes) 000923 1790774643.292393 fallocate 0x007bf8 thru 0x017a69 (0xfe72 bytes) 000925 1790774643.304137 trunc from 0x0019a7 to 0x00fcd8 (0xe332 bytes) 000926 1790774643.314798 fallocate 0x033912 thru 0x03cf59 (0x9648 bytes) 000927 1790774643.322604 trunc from 0x025084 to 0x026c1b (0x1b98 bytes) 000928 1790774643.331872 read 0x002e37 thru 0x00b601 (0x87cb bytes) 000929 1790774643.347546 read 0x011125 thru 0x0158fb (0x47d7 bytes) 000930 1790774643.368395 mapwrite 0x03da18 thru 0x03ffff (0x25e8 bytes) 000931 1790774643.416901 mapread 0x023bfc thru 0x02fcdf (0xc0e4 bytes) 000932 1790774643.418126 trunc from 0x004049 to 0x00fc07 (0xbbbf bytes) 000933 1790774643.437248 fallocate 0x01b52f thru 0x01fb14 (0x45e6 bytes) 000934 1790774643.445100 trunc from 0x040000 to 0x00d6d6 (0x32929 bytes) 000935 1790774643.485050 punch from 0x007f38 to 0x00d6d6 (0x579f bytes) 000936 1790774643.503487 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd6d7): Mirror 3: 0xd637f5db (stale) Mirror 4: 0xd637f5db (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd6d7): Mirror 3: 0xd637f5db (stale) Mirror 4: 0xd637f5db (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd6d7: skipped 000937 1790774643.852446 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xd6d7): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd6d7): Mirror 3: 0xd637f5db (stale) Mirror 4: 0xd637f5db (stale) CRC-32 checksum value for chunk [0, 0xd6d7): Mirror 1: 0x70ddfffc Mirror 5: 0x70ddfffc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd6d7: skipped 000938 1790774645.089202 fallocate 0x0178ba thru 0x022bd3 (0xb31a bytes) 000939 1790774645.173998 punch from 0x01b40d to 0x021f7a (0x6b6e bytes) 000940 1790774645.188743 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0xa4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22bd4): Mirror 4: 0x80e38e12 (stale) Mirror 5: 0x137992b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22bd4): Mirror 4: 0x80e38e12 (stale) Mirror 5: 0x137992b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22bd4: skipped 000941 1790774645.610440 trunc from 0x003f26 to 0x012c22 (0xecfd bytes) 000942 1790774645.617005 punch from 0x01e183 to 0x022bd3 (0x4a51 bytes) 000943 1790774645.622711 punch from 0x020b4b to 0x022bd3 (0x2089 bytes) 000944 1790774645.629250 fallocate 0x03baf2 thru 0x03ffff (0x450e bytes) 000945 1790774645.634453 punch from 0x009f65 to 0x011450 (0x74ec bytes) 000946 1790774645.644203 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x22bd4): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22bd4): Mirror 4: 0x80e38e12 (stale) Mirror 5: 0x137992b (stale) CRC-32 checksum value for chunk [0, 0x22bd4): Mirror 1: 0x137992b Mirror 6: 0x137992b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22bd4: skipped 000947 1790774646.690848 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x22bd4): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22bd4): Mirror 4: 0x80e38e12 (stale) Mirror 5: 0x137992b (stale) CRC-32 checksum value for chunk [0, 0x22bd4): Mirror 1: 0x137992b Mirror 6: 0x137992b Mirror 7: 0x137992b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22bd4: skipped 000948 1790774647.951207 read 0x01b6e4 thru 0x022bd3 (0x74f0 bytes) 000949 1790774647.983985 trunc from 0x022bd4 to 0x02a57e (0x79ab bytes) 000950 1790774648.078156 mapread 0x00b56b thru 0x00ddbe (0x2854 bytes) 000951 1790774648.116823 read 0x027e90 thru 0x02a57e (0x26ef bytes) 000952 1790774648.161644 read 0x01afcb thru 0x0204e6 (0x551c bytes) 000953 1790774648.162583 mapread 0x018573 thru 0x01fe60 (0x78ee bytes) 000954 1790774648.166013 mapread 0x0228da thru 0x0251b7 (0x28de bytes) 000955 1790774648.167940 write 0x02da6c thru 0x032c74 (0x5209 bytes) 000956 1790774648.171436 mapread 0x032915 thru 0x032c74 (0x360 bytes) 000957 1790774648.174457 trunc from 0x032c75 to 0x03a867 (0x7bf3 bytes) 000958 1790774648.228300 write 0x03cb64 thru 0x03e24a (0x16e7 bytes) 000959 1790774648.231821 write 0x0219dc thru 0x023dbf (0x23e4 bytes) 000961 1790774648.235220 trunc from 0x00f329 to 0x018b17 (0x97ef bytes) 000962 1790774648.244289 read 0x027261 thru 0x02e9c7 (0x7767 bytes) 000964 1790774648.266914 mapwrite 0x014e3f thru 0x01edf8 (0x9fba bytes) 000965 1790774648.293051 mapwrite 0x005e68 thru 0x00d1a1 (0x733a bytes) 000966 1790774648.315044 trunc from 0x03e24b to 0x0139ed (0x2a85d bytes) 000967 1790774648.340100 MIRROR_RESYNC 5 mirrors 000968 1790774649.780165 trunc from 0x0139ee to 0x007153 (0xc89a bytes) 000969 1790774649.881058 trunc from 0x0056c1 to 0x007153 (0x1a93 bytes) 000970 1790774649.894642 read 0x006963 thru 0x007153 (0x7f1 bytes) 000971 1790774649.909856 write 0x00e15c thru 0x016c26 (0x8acb bytes) 000972 1790774649.911712 fallocate 0x0246a7 thru 0x02d425 (0x8d7f bytes) 000973 1790774649.927367 mapread 0x01535e thru 0x016c26 (0x18c9 bytes) 000974 1790774649.943467 MIRROR_RESYNC 5 mirrors 000975 1790774651.992949 mapread 0x00c1ac thru 0x00d03d (0xe92 bytes) 000976 1790774652.004945 punch from 0x001be3 to 0x0081fb (0x6619 bytes) 000978 1790774652.053437 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x16c27): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16c27): Mirror 4: 0xe9306268 (stale) Mirror 5: 0xe9306268 (stale) Mirror 6: 0xe9306268 (stale) Mirror 7: 0xe9306268 (stale) CRC-32 checksum value for chunk [0, 0x16c27): Mirror 1: 0xe9306268 Mirror 8: 0xe9306268 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16c27: skipped 000979 1790774652.856429 mapwrite 0x034060 thru 0x03b1ad (0x714e bytes) 000980 1790774652.961108 fallocate 0x030917 thru 0x030d4e (0x438 bytes) 000981 1790774652.970099 read 0x039cf2 thru 0x03b1ad (0x14bc bytes) 000982 1790774652.970767 trunc from 0x0008a0 to 0x00afcc (0xa72d bytes) 000983 1790774652.979481 trunc from 0x012af1 to 0x018b11 (0x6021 bytes) 000984 1790774652.985264 mapread 0x002f72 thru 0x0110c0 (0xe14f bytes) 000985 1790774653.008616 read 0x02b4b5 thru 0x0359f7 (0xa543 bytes) 000986 1790774653.031767 mapwrite 0x00458b thru 0x007ff0 (0x3a66 bytes) 000987 1790774653.048607 trunc from 0x03b1ae to 0x01ba1f (0x1f78e bytes) 000988 1790774653.085396 MIRROR_RESYNC 6 mirrors 000989 1790774654.919437 mapwrite 0x02d2c1 thru 0x033b92 (0x68d2 bytes) 000990 1790774655.058385 mapwrite 0x035b1a thru 0x03e3ad (0x8894 bytes) 000993 1790774655.146775 mapread 0x020424 thru 0x023768 (0x3345 bytes) 000995 1790774655.162229 trunc from 0x021353 to 0x02db36 (0xc7e4 bytes) 000996 1790774655.172664 mapwrite 0x036b6e thru 0x03b7b1 (0x4c44 bytes) 000997 1790774655.213702 mapwrite 0x00e551 thru 0x0142a8 (0x5d58 bytes) 000998 1790774655.276096 mapread 0x00334d thru 0x010589 (0xd23d bytes) 000999 1790774655.310393 mapread 0x03d985 thru 0x03e3ad (0xa29 bytes) 001000 1790774655.312561 mapwrite 0x00779d thru 0x013e79 (0xc6dd bytes) All operations completed A-OK!