== sanity-flr test 70a: flr mode fsx test ================ 20:30:04 (1789777804) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 7808 000001 1789777808.420208 mapwrite 0x023068 thru 0x025102 (0x209b bytes) 000002 1789777808.496225 mapread 0x01f5bd thru 0x025102 (0x5b46 bytes) 000003 1789777808.497410 mapread 0x008efe thru 0x0101e4 (0x72e7 bytes) zero_range to largest ever: 0x1a6f0 000004 1789777808.515487 trunc from 0x0143bb to 0x01a6ef (0x6335 bytes) 000005 1789777808.520570 punch from 0x0195fd to 0x01d56b (0x3f6f bytes) 000007 1789777808.531918 mapread 0x014b62 thru 0x0240b0 (0xf54f bytes) 000008 1789777808.550762 write 0x00e734 thru 0x010ac8 (0x2395 bytes) zero_range to largest ever: 0x23ea6 000009 1789777808.552562 trunc from 0x01e100 to 0x023ea5 (0x5da6 bytes) 000010 1789777808.558703 write 0x0011d9 thru 0x00a35d (0x9185 bytes) 000011 1789777808.560035 read 0x013ecb thru 0x0210f1 (0xd227 bytes) 000012 1789777808.567906 write 0x02298c thru 0x03010c (0xd781 bytes) 000013 1789777808.576436 write 0x019f6d thru 0x0219c7 (0x7a5b bytes) fallocating to largest ever: 0x2d4b9 000014 1789777808.578323 fallocate 0x020442 thru 0x02d4b8 (0xd077 bytes) truncating to largest ever: 0x30abb 000015 1789777808.584287 trunc from 0x03010d to 0x030aba (0x9ae bytes) 000016 1789777808.605695 read 0x017023 thru 0x022691 (0xb66f bytes) 000017 1789777808.607672 read 0x00324d thru 0x00cec4 (0x9c78 bytes) 000018 1789777808.619574 trunc from 0x029091 to 0x02bb36 (0x2aa6 bytes) 000019 1789777808.686563 fallocate 0x011574 thru 0x013bf0 (0x267d bytes) 000021 1789777808.693579 fallocate 0x015720 thru 0x01aca5 (0x5586 bytes) 000023 1789777808.718646 trunc from 0x002d32 to 0x00f859 (0xcb28 bytes) 000024 1789777808.744275 MIRROR_EXTEND to 2 mirrors 000025 1789777809.827104 mapread 0x02b660 thru 0x030aba (0x545b bytes) 000026 1789777809.860667 trunc from 0x030abb to 0x01f029 (0x11a91 bytes) 000027 1789777809.928738 fallocate 0x01186b thru 0x01ae1e (0x95b4 bytes) 000028 1789777809.935240 read 0x00b293 thru 0x01ad7c (0xfaea bytes) 000029 1789777809.949292 trunc from 0x00bf64 to 0x00fa68 (0x3b05 bytes) 000030 1789777809.962503 write 0x02466d thru 0x02c874 (0x8208 bytes) 000031 1789777809.970022 mapwrite 0x003232 thru 0x013187 (0xff56 bytes) 000032 1789777810.002999 trunc from 0x02c875 to 0x001ddc (0x2aa98 bytes) 000033 1789777810.028259 punch from 0x001cac to 0x001ddc (0x131 bytes) 000034 1789777810.042636 fallocate 0x003b8b thru 0x0128a0 (0xed16 bytes) 000035 1789777810.066403 trunc from 0x001ddd to 0x00cddb (0xafff bytes) 000036 1789777810.110084 write 0x0312f3 thru 0x03f1d2 (0xdee0 bytes) zero_range to largest ever: 0x3f1d3 000039 1789777810.122751 trunc from 0x03a66a to 0x03f1d2 (0x4b69 bytes) 000040 1789777810.158540 mapwrite 0x00d697 thru 0x010000 (0x296a bytes) 000041 1789777810.220143 mapwrite 0x030a9a thru 0x0310bf (0x626 bytes) 000042 1789777810.289851 fallocate 0x037659 thru 0x03a53d (0x2ee5 bytes) 000043 1789777810.300508 mapread 0x0361b5 thru 0x03f1d2 (0x901e bytes) 000044 1789777810.321424 fallocate 0x00f844 thru 0x016cfb (0x74b8 bytes) 000045 1789777810.340417 fallocate 0x016ea3 thru 0x018f72 (0x20d0 bytes) 000046 1789777810.354701 trunc from 0x03f1d3 to 0x033c4f (0xb583 bytes) fallocating to largest ever: 0x40000 000047 1789777810.417459 fallocate 0x036765 thru 0x03ffff (0x989b bytes) 000048 1789777810.442560 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd5f5a30 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7cef3431 Mirror 3: 0x7cef3431 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000050 1789777811.627037 write 0x010059 thru 0x01c41e (0xc3c6 bytes) 000052 1789777811.723008 punch from 0x017071 to 0x01d5b9 (0x6549 bytes) 000053 1789777811.769025 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7cef3431 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7cef3431 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000054 1789777812.298453 mapread 0x030083 thru 0x03d74a (0xd6c8 bytes) 000055 1789777812.343230 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000056 1789777812.593501 trunc from 0x040000 to 0x0016e2 (0x3e91d bytes) 000057 1789777812.617824 write 0x018d8e thru 0x01ee88 (0x60fb bytes) 000058 1789777812.619101 write 0x028a3c thru 0x02f32c (0x68f1 bytes) 000059 1789777812.623719 trunc from 0x00513e to 0x012187 (0xd04a bytes) 000060 1789777812.631734 read 0x01c34e thru 0x01c374 (0x27 bytes) 000061 1789777812.632600 punch from 0x00f1c8 to 0x00fe0e (0xc47 bytes) 000062 1789777812.637539 fallocate 0x00e7c0 thru 0x01a203 (0xba44 bytes) 000063 1789777812.643520 trunc from 0x02f32d to 0x024fb0 (0xa37c bytes) 000064 1789777812.661422 punch from 0x020f49 to 0x024fb0 (0x4068 bytes) 000066 1789777812.667596 punch from 0x01991e to 0x01e21b (0x48fe bytes) 000067 1789777812.682592 read 0x00fb8f thru 0x01010d (0x57f bytes) 000068 1789777812.708820 mapread 0x010960 thru 0x01340b (0x2aac bytes) 000070 1789777812.710128 mapwrite 0x017842 thru 0x01b55a (0x3d19 bytes) 000071 1789777812.728340 trunc from 0x018d56 to 0x01e74d (0x59f8 bytes) 000072 1789777812.734321 write 0x000f1d thru 0x00b492 (0xa576 bytes) 000073 1789777812.737512 fallocate 0x039ed4 thru 0x03dc08 (0x3d35 bytes) 000074 1789777812.744702 trunc from 0x03dc09 to 0x0346fd (0x950b bytes) 000075 1789777812.765562 read 0x02cce3 thru 0x0346fd (0x7a1b bytes) 000076 1789777812.775028 fallocate 0x03d4e4 thru 0x03ffff (0x2b1c bytes) 000077 1789777812.781612 trunc from 0x016a38 to 0x0226aa (0xbc73 bytes) 000079 1789777812.787656 trunc from 0x040000 to 0x03eed3 (0x112c bytes) 000080 1789777812.808483 trunc from 0x03eed4 to 0x005aa7 (0x3942c bytes) 000081 1789777812.824324 mapread 0x004ee9 thru 0x005aa7 (0xbbf bytes) 000082 1789777812.834894 MIRROR_EXTEND to 2 mirrors 000083 1789777813.593783 read 0x002cb8 thru 0x00414e (0x1497 bytes) 000084 1789777813.605643 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000085 1789777813.868691 read 0x00230c thru 0x005aa7 (0x379c bytes) 000086 1789777813.889891 punch from 0x002d1a to 0x005aa7 (0x2d8e bytes) 000087 1789777813.939502 trunc from 0x003592 to 0x005aa7 (0x2516 bytes) 000088 1789777813.950998 mapwrite 0x03e265 thru 0x03ffff (0x1d9b bytes) 000089 1789777814.028771 trunc from 0x005301 to 0x00a452 (0x5152 bytes) 000090 1789777814.036462 read 0x0048f5 thru 0x011b2a (0xd236 bytes) 000091 1789777814.058567 write 0x00677f thru 0x0124e8 (0xbd6a bytes) 000092 1789777814.060991 fallocate 0x02c869 thru 0x039225 (0xc9bd bytes) 000094 1789777814.073035 trunc from 0x01af12 to 0x0288e1 (0xd9d0 bytes) 000095 1789777814.082846 write 0x00b17f thru 0x0104c7 (0x5349 bytes) 000097 1789777814.088179 write 0x01f4d8 thru 0x0279c2 (0x84eb bytes) 000098 1789777814.124105 mapread 0x019b6a thru 0x0250e2 (0xb579 bytes) 000099 1789777814.156961 punch from 0x02d616 to 0x03d181 (0xfb6c bytes) 000100 1789777814.164499 mapwrite 0x003246 thru 0x00a26d (0x7028 bytes) 000102 1789777814.200819 read 0x03a7ed thru 0x03ffff (0x5813 bytes) 000104 1789777814.219093 fallocate 0x004f9b thru 0x009dd4 (0x4e3a bytes) 000105 1789777814.225528 write 0x01e2e1 thru 0x02d8e2 (0xf602 bytes) 000106 1789777814.227768 trunc from 0x034184 to 0x03da1b (0x9898 bytes) 000107 1789777814.233933 punch from 0x02473a to 0x02e4d2 (0x9d99 bytes) 000108 1789777814.274101 mapread 0x00718d thru 0x00fea7 (0x8d1b bytes) 000109 1789777814.278760 punch from 0x00ef8b to 0x00fb71 (0xbe7 bytes) 000110 1789777814.290540 trunc from 0x01eae0 to 0x0207f4 (0x1d15 bytes) 000111 1789777814.309561 fallocate 0x01aaa7 thru 0x0266dc (0xbc36 bytes) 000112 1789777814.319535 read 0x019f04 thru 0x01f3fd (0x54fa bytes) 000113 1789777814.344987 write 0x0127cc thru 0x01c017 (0x984c bytes) 000114 1789777814.348655 trunc from 0x040000 to 0x02d78a (0x12875 bytes) 000115 1789777814.377104 trunc from 0x026d51 to 0x02a3db (0x368b bytes) 000116 1789777814.391509 mapwrite 0x03f293 thru 0x03ffff (0xd6d bytes) 000117 1789777814.552974 mapread 0x022bea thru 0x0300be (0xd4d5 bytes) 000119 1789777814.690028 trunc from 0x03b7f5 to 0x03ffff (0x480b bytes) 000120 1789777814.702995 punch from 0x00e740 to 0x01337c (0x4c3d bytes) 000121 1789777814.721056 write 0x00dc50 thru 0x012378 (0x4729 bytes) 000122 1789777814.752956 write 0x01f44c thru 0x02e18e (0xed43 bytes) 000124 1789777814.764134 trunc from 0x040000 to 0x029ce3 (0x1631c bytes) 000125 1789777814.808605 mapwrite 0x02a47a thru 0x034fed (0xab74 bytes) 000126 1789777814.982129 mapread 0x01506c thru 0x016d43 (0x1cd8 bytes) 000127 1789777814.985790 write 0x0281fb thru 0x02a6b5 (0x24bb bytes) 000128 1789777814.989093 mapread 0x01442f thru 0x01f30a (0xaedc bytes) 000129 1789777814.991109 mapwrite 0x0184b1 thru 0x01d5fa (0x514a bytes) 000130 1789777815.028445 mapwrite 0x02fec8 thru 0x038dbb (0x8ef4 bytes) 000132 1789777815.176859 mapread 0x028c6c thru 0x02bf42 (0x32d7 bytes) 000133 1789777815.177812 write 0x02d32f thru 0x0313fb (0x40cd bytes) 000135 1789777815.185754 punch from 0x013cb5 to 0x023aed (0xfe39 bytes) 000136 1789777815.194672 mapwrite 0x03a389 thru 0x03ffff (0x5c77 bytes) 000138 1789777815.314628 punch from 0x02fab5 to 0x03da25 (0xdf71 bytes) 000140 1789777815.325618 trunc from 0x040000 to 0x002c3c (0x3d3c3 bytes) 000141 1789777815.351458 punch from 0x001f21 to 0x002c3c (0xd1c bytes) 000142 1789777815.357329 fallocate 0x00c285 thru 0x00d7b3 (0x152f bytes) 000143 1789777815.375397 mapread 0x003a45 thru 0x00d7b3 (0x9d6f bytes) 000144 1789777815.460360 mapwrite 0x015af5 thru 0x01916e (0x367a bytes) 000145 1789777815.563303 MIRROR_EXTEND to 2 mirrors 000146 1789777816.576316 mapwrite 0x02a064 thru 0x0362f3 (0xc290 bytes) 000147 1789777816.731514 mapread 0x031c8d thru 0x0362f3 (0x4667 bytes) 000148 1789777816.734114 trunc from 0x0362f4 to 0x030589 (0x5d6a bytes) 000150 1789777816.762567 punch from 0x00c06f to 0x00db34 (0x1ac6 bytes) 000151 1789777816.768329 write 0x00ea01 thru 0x014285 (0x5885 bytes) 000152 1789777816.781526 trunc from 0x01e572 to 0x02928c (0xad1b bytes) 000153 1789777816.787370 trunc from 0x03058a to 0x005984 (0x2ac05 bytes) 000154 1789777816.805526 trunc from 0x002c17 to 0x005984 (0x2d6e bytes) 000156 1789777816.813142 fallocate 0x03abba thru 0x03ffff (0x5446 bytes) 000157 1789777816.818299 punch from 0x00341e to 0x005984 (0x2567 bytes) 000158 1789777816.824253 fallocate 0x01e7f3 thru 0x02b6c4 (0xced2 bytes) 000159 1789777816.832531 punch from 0x0053c7 to 0x005984 (0x5be bytes) 000160 1789777816.839184 fallocate 0x0092f6 thru 0x00e70f (0x541a bytes) 000161 1789777816.845464 read 0x00991d thru 0x00e70f (0x4df3 bytes) 000162 1789777816.863991 mapwrite 0x019368 thru 0x02281e (0x94b7 bytes) 000163 1789777816.937376 read 0x0167a1 thru 0x02281e (0xc07e bytes) 000164 1789777816.943444 mapread 0x0087ad thru 0x0094a6 (0xcfa bytes) 000165 1789777816.956630 read 0x01c128 thru 0x020cb4 (0x4b8d bytes) 000166 1789777816.957720 trunc from 0x002a23 to 0x0109ca (0xdfa8 bytes) 000167 1789777816.965444 mapwrite 0x01c26f thru 0x028193 (0xbf25 bytes) 000168 1789777817.022997 mapwrite 0x02c4ea thru 0x037ef3 (0xba0a bytes) 000169 1789777817.081403 write 0x030812 thru 0x03c82d (0xc01c bytes) 000170 1789777817.085216 punch from 0x029cca to 0x03588c (0xbbc3 bytes) 000172 1789777817.107353 trunc from 0x030597 to 0x039de9 (0x9853 bytes) 000173 1789777817.113380 mapread 0x020e84 thru 0x028324 (0x74a1 bytes) 000174 1789777817.116449 punch from 0x013d2a to 0x01e8e8 (0xabbf bytes) 000175 1789777817.125510 mapread 0x00e81d thru 0x012772 (0x3f56 bytes) 000176 1789777817.129306 mapread 0x028049 thru 0x032272 (0xa22a bytes) 000177 1789777817.248361 punch from 0x012ff3 to 0x01e1f5 (0xb203 bytes) 000178 1789777817.262753 write 0x0294b4 thru 0x02db9c (0x46e9 bytes) 000179 1789777817.265498 punch from 0x018c32 to 0x01c6fe (0x3acd bytes) 000180 1789777817.275891 fallocate 0x01e6cd thru 0x02dfdb (0xf90f bytes) 000181 1789777817.291260 trunc from 0x03c82e to 0x01a9f3 (0x21e3a bytes) 000182 1789777817.315410 mapread 0x0048a1 thru 0x00ee70 (0xa5d0 bytes) 000183 1789777817.334014 MIRROR_RESYNC 2 mirrors 000184 1789777818.241045 fallocate 0x01a21b thru 0x01fc47 (0x5a2d bytes) 000185 1789777818.326058 write 0x015dfd thru 0x0250f8 (0xf2fc bytes) 000186 1789777818.339749 trunc from 0x0250f9 to 0x03d987 (0x1888f bytes) 000187 1789777818.447538 read 0x003592 thru 0x00720c (0x3c7b bytes) 000188 1789777818.457682 trunc from 0x03d988 to 0x012bd5 (0x2adb2 bytes) 000189 1789777818.493380 trunc from 0x012bd6 to 0x021c13 (0xf03e bytes) 000190 1789777818.548917 read 0x00a381 thru 0x00c3de (0x205e bytes) 000191 1789777818.580361 read 0x0136a6 thru 0x02066e (0xcfc9 bytes) 000192 1789777818.580991 trunc from 0x00b3fe to 0x0146fa (0x92fd bytes) 000193 1789777818.593013 punch from 0x00b336 to 0x012a89 (0x7754 bytes) 000194 1789777818.598725 mapwrite 0x02da8a thru 0x033d73 (0x62ea bytes) 000195 1789777818.642115 mapwrite 0x010927 thru 0x011b4e (0x1228 bytes) 000196 1789777818.656081 fallocate 0x02ebd5 thru 0x0328f0 (0x3d1c bytes) 000197 1789777818.661369 punch from 0x018a73 to 0x0211d7 (0x8765 bytes) 000198 1789777818.666407 trunc from 0x033d74 to 0x002b99 (0x311da bytes) 000199 1789777818.686143 mapread 0x0012b3 thru 0x002b99 (0x18e7 bytes) 000200 1789777818.687534 read 0x00195c thru 0x002b99 (0x123e bytes) 000201 1789777818.694386 MIRROR_RESYNC 2 mirrors 000202 1789777819.367085 fallocate 0x017e38 thru 0x0186cc (0x895 bytes) 000203 1789777819.422247 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2b9a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b9a): Mirror 2: 0x2365fe75 (stale) CRC-32 checksum value for chunk [0, 0x2b9a): Mirror 1: 0x2365fe75 Mirror 3: 0x2365fe75 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b9a: skipped 000204 1789777820.368036 read 0x00088a thru 0x002b99 (0x2310 bytes) 000205 1789777820.392136 fallocate 0x02b0fb thru 0x0374d9 (0xc3df bytes) 000206 1789777820.480708 fallocate 0x01cd00 thru 0x02865f (0xb960 bytes) 000207 1789777820.486773 read 0x000e42 thru 0x002b99 (0x1d58 bytes) 000208 1789777820.494095 punch from 0x001486 to 0x002b99 (0x1714 bytes) 000209 1789777820.501609 trunc from 0x002b9a to 0x00caec (0x9f53 bytes) 000210 1789777820.526221 trunc from 0x00caed to 0x03c9fb (0x2ff0f bytes) 000211 1789777820.541448 write 0x0095fd thru 0x00df98 (0x499c bytes) 000212 1789777820.577479 mapwrite 0x02b197 thru 0x0324d0 (0x733a bytes) 000213 1789777820.605520 mapread 0x014c67 thru 0x017a85 (0x2e1f bytes) 000214 1789777820.606783 punch from 0x017ced to 0x02458c (0xc8a0 bytes) 000215 1789777820.611770 read 0x03239f thru 0x03c9fb (0xa65d bytes) 000216 1789777820.616565 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3c9fc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c9fc): Mirror 2: 0x79960e11 (stale) Mirror 3: 0x79960e11 (stale) CRC-32 checksum value for chunk [0, 0x3c9fc): Mirror 1: 0x22935d05 Mirror 4: 0x22935d05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c9fc: skipped 000217 1789777822.065979 MIRROR_RESYNC 4 mirrors 000218 1789777824.010765 read 0x0352f4 thru 0x03c9fb (0x7708 bytes) 000219 1789777824.022057 trunc from 0x030828 to 0x03c9fb (0xc1d4 bytes) 000220 1789777824.079780 fallocate 0x02312f thru 0x026ac4 (0x3996 bytes) 000221 1789777824.089568 mapread 0x034f9b thru 0x03c9fb (0x7a61 bytes) 000222 1789777824.124508 punch from 0x0027ac to 0x00f06e (0xc8c3 bytes) 000223 1789777824.131845 trunc from 0x02b995 to 0x03732a (0xb996 bytes) 000224 1789777824.138401 mapwrite 0x014fe9 thru 0x01f68f (0xa6a7 bytes) 000225 1789777824.188143 mapread 0x02a78e thru 0x02bc64 (0x14d7 bytes) 000226 1789777824.201970 trunc from 0x03c9fc to 0x008145 (0x348b6 bytes) 000227 1789777824.227340 read 0x00627f thru 0x008145 (0x1ec7 bytes) 000228 1789777824.247265 MIRROR_RESYNC 4 mirrors 000229 1789777825.000819 fallocate 0x002760 thru 0x00e955 (0xc1f6 bytes) 000230 1789777825.078794 mapread 0x0087bd thru 0x00e955 (0x6199 bytes) 000231 1789777825.131889 punch from 0x0006b0 to 0x007c9d (0x75ee bytes) 000232 1789777825.146438 mapread 0x0003f8 thru 0x0025d0 (0x21d9 bytes) 000233 1789777825.169993 trunc from 0x003aa6 to 0x00e955 (0xaeb0 bytes) 000234 1789777825.183670 read 0x003247 thru 0x006b3b (0x38f5 bytes) 000235 1789777825.205346 punch from 0x001519 to 0x0080e4 (0x6bcc bytes) 000236 1789777825.215338 trunc from 0x00e956 to 0x00ad0d (0x3c48 bytes) 000237 1789777825.321784 read 0x00657b thru 0x00ad0d (0x4793 bytes) 000238 1789777825.341934 read 0x007736 thru 0x0096a5 (0x1f70 bytes) 000239 1789777825.342831 trunc from 0x00ad0e to 0x034980 (0x29c73 bytes) 000240 1789777825.372342 fallocate 0x002fb1 thru 0x008064 (0x50b4 bytes) 000241 1789777825.383799 read 0x01e12b thru 0x02a39a (0xc270 bytes) 000242 1789777825.411697 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x34981): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34981): Mirror 2: 0x73afa298 (stale) Mirror 3: 0x73afa298 (stale) Mirror 4: 0x73afa298 (stale) CRC-32 checksum value for chunk [0, 0x34981): Mirror 1: 0x507d4879 Mirror 5: 0x507d4879 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34981: skipped 000243 1789777826.741126 MIRROR_RESYNC 5 mirrors 000244 1789777827.880751 fallocate 0x02d0e1 thru 0x034b48 (0x7a68 bytes) 000245 1789777827.968733 punch from 0x014c40 to 0x01a9c9 (0x5d8a bytes) 000247 1789777827.987128 read 0x02d21c thru 0x032a89 (0x586e bytes) 000248 1789777828.006708 read 0x018056 thru 0x018cd0 (0xc7b bytes) 000249 1789777828.048257 mapread 0x000b1a thru 0x0045cc (0x3ab3 bytes) 000250 1789777828.057128 trunc from 0x004d63 to 0x007c05 (0x2ea3 bytes) 000251 1789777828.075985 fallocate 0x03abd1 thru 0x03ffff (0x542f bytes) 000252 1789777828.086104 trunc from 0x03f90d to 0x03ffff (0x6f3 bytes) 000253 1789777828.093366 trunc from 0x040000 to 0x037a69 (0x8596 bytes) 000254 1789777828.118326 write 0x01e42b thru 0x024da6 (0x697c bytes) 000255 1789777828.119887 mapread 0x002769 thru 0x00f89f (0xd137 bytes) 000257 1789777828.149925 write 0x012f01 thru 0x01c2d0 (0x93d0 bytes) 000259 1789777828.153834 fallocate 0x00aa90 thru 0x01a27d (0xf7ee bytes) 000260 1789777828.170319 punch from 0x021e67 to 0x029889 (0x7a23 bytes) 000261 1789777828.224207 mapread 0x01318e thru 0x02195c (0xe7cf bytes) 000262 1789777828.234340 read 0x01a71a thru 0x02589d (0xb184 bytes) 000263 1789777828.254900 write 0x026ba8 thru 0x02ae3d (0x4296 bytes) 000264 1789777828.256212 punch from 0x012ea4 to 0x01da8d (0xabea bytes) 000265 1789777828.281704 MIRROR_RESYNC 5 mirrors 000266 1789777830.835650 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000267 1789777831.377314 punch from 0x00ec1a to 0x014088 (0x546f bytes) 000268 1789777831.449887 MIRROR_RESYNC 4 mirrors 000269 1789777833.104073 read 0x02e08a thru 0x037a69 (0x99e0 bytes) 000270 1789777833.115921 mapread 0x024f4e thru 0x03295c (0xda0f bytes) 000271 1789777833.143080 mapread 0x0298c8 thru 0x0377a0 (0xded9 bytes) 000272 1789777833.144840 write 0x03b1ff thru 0x03ffff (0x4e01 bytes) 000273 1789777833.177835 mapwrite 0x03e21e thru 0x03ffff (0x1de2 bytes) 000274 1789777833.198654 read 0x031bba thru 0x03825e (0x66a5 bytes) 000275 1789777833.213115 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa0813c98 (stale) Mirror 4: 0xa0813c98 (stale) Mirror 5: 0xa0813c98 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5f527cc1 Mirror 6: 0x5f527cc1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000276 1789777834.519104 trunc from 0x00c5bb to 0x015b2c (0x9572 bytes) 000277 1789777834.592299 punch from 0x038e8c to 0x03ffff (0x7174 bytes) 000278 1789777834.600406 mapread 0x01a804 thru 0x01e2b6 (0x3ab3 bytes) 000279 1789777834.632899 write 0x0292fe thru 0x02cd1f (0x3a22 bytes) 000280 1789777834.652889 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa0813c98 (stale) Mirror 4: 0xa0813c98 (stale) Mirror 6: 0x5f527cc1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa0813c98 (stale) Mirror 4: 0xa0813c98 (stale) Mirror 6: 0x5f527cc1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000283 1789777835.262790 read 0x01bbae thru 0x02175e (0x5bb1 bytes) 000284 1789777835.279474 mapwrite 0x004500 thru 0x0081b1 (0x3cb2 bytes) 000285 1789777835.369231 write 0x00e6ff thru 0x01978e (0xb090 bytes) 000286 1789777835.405375 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa0813c98 (stale) Mirror 4: 0xa0813c98 (stale) Mirror 6: 0x5f527cc1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1cbd7ed1 Mirror 7: 0x1cbd7ed1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000288 1789777836.865457 trunc from 0x020548 to 0x0303ea (0xfea3 bytes) 000289 1789777837.003834 trunc from 0x01585d to 0x01acd6 (0x547a bytes) 000290 1789777837.013381 mapread 0x0160e3 thru 0x016584 (0x4a2 bytes) 000291 1789777837.022184 punch from 0x0324b7 to 0x0395b8 (0x7102 bytes) 000292 1789777837.031098 trunc from 0x00657d to 0x00b079 (0x4afd bytes) 000293 1789777837.048543 mapread 0x033309 thru 0x03ffff (0xccf7 bytes) 000294 1789777837.117280 MIRROR_RESYNC 5 mirrors 000295 1789777839.180528 trunc from 0x00aabe to 0x00cffb (0x253e bytes) 000296 1789777839.238136 mapwrite 0x032ec5 thru 0x03ffff (0xd13b bytes) 000297 1789777839.295781 trunc from 0x040000 to 0x00b1a8 (0x34e57 bytes) 000298 1789777839.316506 read 0x006c42 thru 0x00b1a8 (0x4567 bytes) 000299 1789777839.326646 write 0x00b82e thru 0x0109d3 (0x51a6 bytes) 000301 1789777839.328573 read 0x000bc9 thru 0x001d54 (0x118c bytes) 000302 1789777839.342765 fallocate 0x00e0b9 thru 0x01d312 (0xf25a bytes) 000303 1789777839.352588 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d313): Mirror 4: 0xd9b047d9 (stale) Mirror 6: 0xd9b047d9 (stale) Mirror 7: 0xd9b047d9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d313): Mirror 4: 0xd9b047d9 (stale) Mirror 6: 0xd9b047d9 (stale) Mirror 7: 0xd9b047d9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d313: skipped 000305 1789777840.030739 mapwrite 0x023bf1 thru 0x0294b6 (0x58c6 bytes) 000306 1789777840.095799 mapread 0x0209c8 thru 0x022ad5 (0x210e bytes) 000307 1789777840.098540 trunc from 0x022724 to 0x02568f (0x2f6c bytes) 000308 1789777840.109002 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x294b7): Mirror 4: 0xc38b8f9d (stale) Mirror 6: 0xc38b8f9d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x294b7): Mirror 4: 0xc38b8f9d (stale) Mirror 6: 0xc38b8f9d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x294b7: skipped 000310 1789777840.538433 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x294b7): Mirror 6: 0xc38b8f9d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x294b7): Mirror 6: 0xc38b8f9d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x294b7: skipped 000311 1789777840.840831 read 0x0237ef thru 0x024d05 (0x1517 bytes) 000313 1789777840.856828 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000314 1789777841.011054 write 0x02ea33 thru 0x0375b9 (0x8b87 bytes) 000316 1789777841.018779 write 0x01d378 thru 0x0228fb (0x5584 bytes) 000317 1789777841.030040 read 0x022e35 thru 0x031ea1 (0xf06d bytes) 000318 1789777841.040591 trunc from 0x0375ba to 0x03f8d1 (0x8318 bytes) 000320 1789777841.062708 fallocate 0x03019f thru 0x03d213 (0xd075 bytes) 000321 1789777841.068286 fallocate 0x00d095 thru 0x012f19 (0x5e85 bytes) 000323 1789777841.074251 mapread 0x005c8c thru 0x00d3bd (0x7732 bytes) 000324 1789777841.097781 fallocate 0x015dd3 thru 0x01b338 (0x5566 bytes) 000326 1789777841.103830 mapwrite 0x0265c3 thru 0x0314ab (0xaee9 bytes) 000327 1789777841.132593 trunc from 0x03f8d2 to 0x03808c (0x7845 bytes) 000329 1789777841.170565 mapwrite 0x01b0be thru 0x01d9d8 (0x291b bytes) 000330 1789777841.221635 MIRROR_EXTEND to 2 mirrors 000331 1789777842.770304 trunc from 0x03808d to 0x0124e2 (0x25baa bytes) 000332 1789777842.859364 read 0x003509 thru 0x0113ef (0xdee7 bytes) 000333 1789777842.874062 mapread 0x008a6b thru 0x00b45a (0x29f0 bytes) 000334 1789777842.876324 punch from 0x00d71b to 0x0124e2 (0x4dc8 bytes) 000335 1789777842.909760 trunc from 0x0124e3 to 0x024627 (0x12145 bytes) 000336 1789777842.952971 trunc from 0x010f64 to 0x01edeb (0xde88 bytes) 000337 1789777842.971751 punch from 0x003e7d to 0x00adef (0x6f73 bytes) 000338 1789777843.004931 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000340 1789777843.313662 write 0x0379fd thru 0x03edb8 (0x73bc bytes) 000341 1789777843.323642 read 0x00184d thru 0x010d17 (0xf4cb bytes) 000342 1789777843.336115 mapread 0x001456 thru 0x007579 (0x6124 bytes) 000344 1789777843.337818 punch from 0x021120 to 0x02acd5 (0x9bb6 bytes) 000345 1789777843.344058 trunc from 0x03edb9 to 0x009e8b (0x34f2d bytes) 000347 1789777843.371715 MIRROR_EXTEND to 2 mirrors 000348 1789777844.041412 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000349 1789777844.192884 mapwrite 0x03938a thru 0x03ffff (0x6c76 bytes) 000350 1789777844.331205 read 0x02e11e thru 0x03bbbb (0xda9e bytes) 000351 1789777844.344559 fallocate 0x0332c4 thru 0x03862c (0x5369 bytes) 000352 1789777844.354743 read 0x0013ca thru 0x00e6d4 (0xd30b bytes) 000353 1789777844.384119 mapwrite 0x01fed8 thru 0x0218b7 (0x19e0 bytes) 000354 1789777844.421210 mapwrite 0x00815f thru 0x010420 (0x82c2 bytes) 000356 1789777844.460048 trunc from 0x040000 to 0x02e3bf (0x11c40 bytes) 000357 1789777844.506407 mapread 0x00d889 thru 0x01d5d9 (0xfd51 bytes) 000358 1789777844.511607 punch from 0x00a8f1 to 0x01957a (0xec8a bytes) 000359 1789777844.521382 write 0x02c454 thru 0x03b8a9 (0xf456 bytes) 000360 1789777844.524705 trunc from 0x015334 to 0x021fae (0xcc7b bytes) 000361 1789777844.536726 fallocate 0x02579d thru 0x02dbbe (0x8422 bytes) 000363 1789777844.550063 punch from 0x0010b9 to 0x008a34 (0x797c bytes) 000364 1789777844.564256 write 0x025baa thru 0x030205 (0xa65c bytes) 000365 1789777844.566220 trunc from 0x0192f4 to 0x01bf93 (0x2ca0 bytes) 000366 1789777844.594040 fallocate 0x038591 thru 0x03ffff (0x7a6f bytes) 000367 1789777844.601561 trunc from 0x040000 to 0x01a418 (0x25be7 bytes) 000368 1789777844.628938 write 0x00dce3 thru 0x01c513 (0xe831 bytes) 000369 1789777844.652992 mapwrite 0x037181 thru 0x03a8b3 (0x3733 bytes) 000370 1789777844.779317 write 0x03afb3 thru 0x03fa45 (0x4a93 bytes) 000371 1789777844.780510 punch from 0x01e2d0 to 0x024abd (0x67ee bytes) 000372 1789777844.788724 trunc from 0x03fa46 to 0x00a018 (0x35a2d bytes) 000373 1789777844.827751 trunc from 0x00a019 to 0x020833 (0x1681b bytes) 000374 1789777844.850663 mapread 0x009ec5 thru 0x016d3d (0xce79 bytes) 000375 1789777844.994064 trunc from 0x020834 to 0x0307f7 (0xffc4 bytes) 000376 1789777845.012770 punch from 0x017897 to 0x01e869 (0x6fd3 bytes) 000377 1789777845.019036 read 0x0278f1 thru 0x028320 (0xa30 bytes) 000378 1789777845.033059 read 0x02eb56 thru 0x0307f7 (0x1ca2 bytes) 000380 1789777845.035871 trunc from 0x0307f8 to 0x012b99 (0x1dc5e bytes) 000381 1789777845.059713 trunc from 0x012b9a to 0x01da7b (0xaee2 bytes) 000382 1789777845.078030 punch from 0x00eaf6 to 0x016655 (0x7b60 bytes) 000383 1789777845.084175 fallocate 0x03cd46 thru 0x03ffff (0x32ba bytes) 000384 1789777845.089963 trunc from 0x026314 to 0x030bf4 (0xa8e1 bytes) 000385 1789777845.096532 fallocate 0x01d3f5 thru 0x02518f (0x7d9b bytes) 000386 1789777845.104967 trunc from 0x040000 to 0x016e45 (0x291ba bytes) 000387 1789777845.122844 read 0x00d2e9 thru 0x016e45 (0x9b5d bytes) 000388 1789777845.134579 mapwrite 0x019c25 thru 0x01afb9 (0x1395 bytes) 000389 1789777845.191028 mapread 0x0074a0 thru 0x011e86 (0xa9e7 bytes) 000390 1789777845.192116 punch from 0x001126 to 0x00ecef (0xdbca bytes) 000391 1789777845.211692 write 0x0398e8 thru 0x03ffff (0x6718 bytes) 000392 1789777845.217465 fallocate 0x03c08b thru 0x03d6ca (0x1640 bytes) 000393 1789777845.235376 punch from 0x0027b0 to 0x008c85 (0x64d6 bytes) 000394 1789777845.249344 write 0x022174 thru 0x027743 (0x55d0 bytes) 000395 1789777845.286262 write 0x034a13 thru 0x036e89 (0x2477 bytes) 000396 1789777845.287229 punch from 0x01d11e to 0x01deb6 (0xd99 bytes) 000398 1789777845.303708 trunc from 0x0384a2 to 0x03ffff (0x7b5e bytes) 000399 1789777845.322638 read 0x023c92 thru 0x024319 (0x688 bytes) 000400 1789777845.323286 trunc from 0x040000 to 0x030b5b (0xf4a4 bytes) 000401 1789777845.349664 punch from 0x00274c to 0x0055b2 (0x2e67 bytes) 000402 1789777845.354738 write 0x028265 thru 0x02f56c (0x7308 bytes) 000404 1789777845.357066 trunc from 0x0059e2 to 0x0126d2 (0xccf1 bytes) 000405 1789777845.362388 fallocate 0x00cf5f thru 0x01808d (0xb12f bytes) 000406 1789777845.369329 read 0x0139d2 thru 0x01d3aa (0x99d9 bytes) 000407 1789777845.383917 mapwrite 0x00a835 thru 0x01a629 (0xfdf5 bytes) 000408 1789777845.407742 read 0x00754a thru 0x00ef17 (0x79ce bytes) 000409 1789777845.408456 fallocate 0x01356b thru 0x01b7d1 (0x8267 bytes) 000410 1789777845.417910 mapwrite 0x01d8b6 thru 0x028ddb (0xb526 bytes) 000411 1789777845.459226 write 0x016927 thru 0x022f24 (0xc5fe bytes) 000412 1789777845.464684 mapread 0x016282 thru 0x018105 (0x1e84 bytes) 000414 1789777845.468012 fallocate 0x036758 thru 0x03e4c5 (0x7d6e bytes) 000415 1789777845.473947 read 0x038707 thru 0x03e4c5 (0x5dbf bytes) 000416 1789777845.498390 read 0x03e047 thru 0x03e4c5 (0x47f bytes) 000417 1789777845.498915 trunc from 0x038cf3 to 0x03e4c5 (0x57d3 bytes) 000418 1789777845.505099 mapwrite 0x000908 thru 0x0046cb (0x3dc4 bytes) 000419 1789777845.535684 write 0x01394e thru 0x016c37 (0x32ea bytes) 000421 1789777845.537183 read 0x01b991 thru 0x028c08 (0xd278 bytes) 000422 1789777845.537723 read 0x02cdbb thru 0x036ca7 (0x9eed bytes) 000423 1789777845.545218 mapwrite 0x01743a thru 0x02002b (0x8bf2 bytes) 000424 1789777845.578872 read 0x021408 thru 0x02691c (0x5515 bytes) 000425 1789777845.581772 mapread 0x03927b thru 0x03e34b (0x50d1 bytes) 000426 1789777845.604488 trunc from 0x006430 to 0x00ed9f (0x8970 bytes) 000427 1789777845.626076 read 0x025336 thru 0x02d0b6 (0x7d81 bytes) 000428 1789777845.646880 MIRROR_EXTEND to 2 mirrors 000429 1789777846.592757 trunc from 0x03e4c6 to 0x02d0a5 (0x11420 bytes) 000430 1789777846.721783 trunc from 0x02d0a6 to 0x007a15 (0x25690 bytes) 000431 1789777846.754509 read 0x003aef thru 0x007a15 (0x3f27 bytes) 000433 1789777846.776794 read 0x004e46 thru 0x007a15 (0x2bd0 bytes) 000434 1789777846.778069 mapwrite 0x013b2b thru 0x020661 (0xcb37 bytes) 000435 1789777846.853699 mapread 0x017a76 thru 0x019ea5 (0x2430 bytes) 000436 1789777846.857339 write 0x01defa thru 0x0298aa (0xb9b1 bytes) 000438 1789777846.860692 trunc from 0x022ca8 to 0x025342 (0x269b bytes) 000439 1789777846.898716 read 0x00ae74 thru 0x012198 (0x7325 bytes) 000440 1789777846.899444 trunc from 0x0064db to 0x00daca (0x75f0 bytes) 000441 1789777846.906665 punch from 0x005438 to 0x00a625 (0x51ee bytes) 000444 1789777846.928847 trunc from 0x009b96 to 0x00f463 (0x58ce bytes) 000446 1789777846.954531 trunc from 0x0185b2 to 0x01aece (0x291d bytes) 000447 1789777846.967025 mapread 0x014f93 thru 0x0204d5 (0xb543 bytes) 000448 1789777847.006024 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000449 1789777847.247675 punch from 0x021bec to 0x0298aa (0x7cbf bytes) 000450 1789777847.257006 punch from 0x00f679 to 0x01d1a1 (0xdb29 bytes) 000451 1789777847.265725 punch from 0x01cc92 to 0x025844 (0x8bb3 bytes) 000452 1789777847.271109 write 0x004b8f thru 0x0085f8 (0x3a6a bytes) 000453 1789777847.285674 fallocate 0x022e24 thru 0x030305 (0xd4e2 bytes) 000454 1789777847.291440 mapread 0x01efd3 thru 0x020ab3 (0x1ae1 bytes) 000457 1789777847.317382 MIRROR_EXTEND to 2 mirrors 000459 1789777848.222305 punch from 0x003c06 to 0x007007 (0x3402 bytes) 000460 1789777848.293731 trunc from 0x0298ab to 0x033ed7 (0xa62d bytes) 000461 1789777848.334383 trunc from 0x033ed8 to 0x032939 (0x159e bytes) 000462 1789777848.359554 mapwrite 0x022592 thru 0x03179f (0xf20e bytes) 000463 1789777848.446581 write 0x03a537 thru 0x03ffff (0x5ac9 bytes) 000464 1789777848.447896 mapread 0x03968f thru 0x03ffff (0x6971 bytes) 000465 1789777848.462085 fallocate 0x030bce thru 0x03f55b (0xe98e bytes) 000466 1789777848.473599 mapwrite 0x0143ca thru 0x0210da (0xcd11 bytes) 000468 1789777848.548573 read 0x0374b3 thru 0x0374ba (0x8 bytes) 000470 1789777848.549748 mapread 0x008492 thru 0x009193 (0xd02 bytes) 000471 1789777848.563731 fallocate 0x01b368 thru 0x02a5fa (0xf293 bytes) 000472 1789777848.574543 trunc from 0x03ae8d to 0x03f3d7 (0x454b bytes) 000473 1789777848.587391 mapread 0x008276 thru 0x0135b4 (0xb33f bytes) 000474 1789777848.589427 trunc from 0x031509 to 0x03eab4 (0xd5ac bytes) 000475 1789777848.600836 mapread 0x013b14 thru 0x01bd27 (0x8214 bytes) 000476 1789777848.601824 trunc from 0x040000 to 0x00c7ff (0x33800 bytes) 000478 1789777848.622089 fallocate 0x00f5a2 thru 0x011806 (0x2265 bytes) 000479 1789777848.633949 punch from 0x00f436 to 0x011806 (0x23d1 bytes) 000480 1789777848.639671 punch from 0x00021b to 0x005e5a (0x5c40 bytes) 000481 1789777848.658729 mapwrite 0x03b197 thru 0x03fceb (0x4b55 bytes) 000482 1789777848.780017 mapread 0x02d850 thru 0x034b8b (0x733c bytes) 000483 1789777848.798575 trunc from 0x03fcec to 0x03fe99 (0x1ae bytes) 000484 1789777848.827101 punch from 0x02fa20 to 0x03bfb8 (0xc599 bytes) 000485 1789777848.833241 write 0x034ab4 thru 0x03ffff (0xb54c bytes) 000486 1789777848.851779 punch from 0x002cbc to 0x00dad9 (0xae1e bytes) 000487 1789777848.866331 mapread 0x01fa45 thru 0x02d811 (0xddcd bytes) 000488 1789777848.895721 punch from 0x01b363 to 0x0280b9 (0xcd57 bytes) 000489 1789777848.903682 read 0x03a11c thru 0x03ffff (0x5ee4 bytes) 000490 1789777848.904598 mapread 0x02b740 thru 0x02f633 (0x3ef4 bytes) 000491 1789777848.928971 mapread 0x02c411 thru 0x030729 (0x4319 bytes) 000492 1789777848.929890 write 0x00b88f thru 0x01607a (0xa7ec bytes) 000493 1789777848.943891 mapwrite 0x014941 thru 0x020839 (0xbef9 bytes) 000494 1789777848.994822 mapread 0x027238 thru 0x030037 (0x8e00 bytes) 000495 1789777848.998801 write 0x0346ab thru 0x03ffff (0xb955 bytes) 000496 1789777849.001763 read 0x023f16 thru 0x028b64 (0x4c4f bytes) 000497 1789777849.002960 trunc from 0x034b0b to 0x03c24d (0x7743 bytes) 000498 1789777849.034869 trunc from 0x040000 to 0x005b54 (0x3a4ab bytes) 000499 1789777849.066425 punch from 0x000d1f to 0x002f83 (0x2265 bytes) 000500 1789777849.081857 write 0x002dbf thru 0x00b469 (0x86ab bytes) 000501 1789777849.091090 fallocate 0x001252 thru 0x00acd1 (0x9a80 bytes) 000503 1789777849.098869 trunc from 0x00027a to 0x000b85 (0x90c bytes) 000504 1789777849.107463 punch from 0x002072 to 0x00597d (0x390c bytes) 000505 1789777849.134568 mapread 0x001b0e thru 0x00681e (0x4d11 bytes) 000508 1789777849.180380 trunc from 0x00b46a to 0x02817d (0x1cd14 bytes) 000509 1789777849.252251 read 0x0142c0 thru 0x02258f (0xe2d0 bytes) 000510 1789777849.290635 trunc from 0x003768 to 0x0117c8 (0xe061 bytes) 000511 1789777849.304697 trunc from 0x02817e to 0x01060f (0x17b6e bytes) 000512 1789777849.350676 write 0x026192 thru 0x027b1c (0x198b bytes) 000513 1789777849.356350 read 0x003eed thru 0x007b69 (0x3c7d bytes) 000515 1789777849.388659 read 0x022d36 thru 0x027b1c (0x4de7 bytes) 000516 1789777849.389466 read 0x01d7a8 thru 0x027b1c (0xa375 bytes) 000517 1789777849.391704 read 0x00f243 thru 0x01c903 (0xd6c1 bytes) 000518 1789777849.392759 mapread 0x020987 thru 0x027b1c (0x7196 bytes) 000519 1789777849.394797 read 0x01d12d thru 0x01efaf (0x1e83 bytes) 000520 1789777849.396218 trunc from 0x00d26e to 0x013ca8 (0x6a3b bytes) 000521 1789777849.414978 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x27b1d): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27b1d): Mirror 2: 0xddd66ac6 (stale) CRC-32 checksum value for chunk [0, 0x27b1d): Mirror 1: 0xaa043b27 Mirror 3: 0xaa043b27 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27b1d: skipped 000522 1789777850.477831 mapread 0x00fef6 thru 0x01c9a7 (0xcab2 bytes) 000523 1789777850.543568 mapwrite 0x03e631 thru 0x03ffff (0x19cf bytes) 000524 1789777850.737800 punch from 0x0069fa to 0x015cad (0xf2b4 bytes) 000525 1789777850.746286 punch from 0x00689c to 0x011c25 (0xb38a bytes) 000526 1789777850.753764 mapread 0x0344b2 thru 0x03ffff (0xbb4e bytes) 000527 1789777850.779563 trunc from 0x024085 to 0x0327d4 (0xe750 bytes) 000528 1789777850.785714 fallocate 0x01f23d thru 0x0241cd (0x4f91 bytes) 000529 1789777850.795681 trunc from 0x040000 to 0x03842f (0x7bd0 bytes) 000530 1789777850.831392 mapread 0x01dd70 thru 0x02dbfb (0xfe8c bytes) 000531 1789777850.863935 mapwrite 0x01590f thru 0x019de0 (0x44d2 bytes) 000532 1789777850.899765 write 0x013e91 thru 0x01c1ec (0x835c bytes) 000533 1789777850.901873 mapwrite 0x0056cd thru 0x00a1e5 (0x4b19 bytes) 000534 1789777850.959454 trunc from 0x038430 to 0x00c9cf (0x2ba60 bytes) 000535 1789777850.986753 punch from 0x007fc3 to 0x00c9cf (0x4a0d bytes) 000536 1789777850.997878 trunc from 0x006c8f to 0x00c9cf (0x5d41 bytes) 000537 1789777851.003610 fallocate 0x0191ee thru 0x026268 (0xd07b bytes) 000538 1789777851.013518 mapwrite 0x03ea5b thru 0x03ffff (0x15a5 bytes) 000539 1789777851.067870 punch from 0x03d52b to 0x03ffff (0x2ad5 bytes) 000540 1789777851.073445 write 0x0241db thru 0x031bbc (0xd9e2 bytes) 000541 1789777851.090118 mapwrite 0x0039cc thru 0x01188d (0xdec2 bytes) 000542 1789777851.138534 write 0x024bff thru 0x027dcd (0x31cf bytes) 000543 1789777851.139975 fallocate 0x01b487 thru 0x02998f (0xe509 bytes) 000544 1789777851.146699 fallocate 0x0142e9 thru 0x01a996 (0x66ae bytes) 000545 1789777851.152913 trunc from 0x040000 to 0x01c540 (0x23abf bytes) 000547 1789777851.177825 write 0x014dc0 thru 0x01f4f0 (0xa731 bytes) 000548 1789777851.182745 fallocate 0x012841 thru 0x015925 (0x30e5 bytes) 000550 1789777851.189743 mapwrite 0x018c4c thru 0x023562 (0xa917 bytes) 000551 1789777851.237403 mapread 0x004cb2 thru 0x0062d8 (0x1627 bytes) 000552 1789777851.239121 mapread 0x00a0a9 thru 0x0127ed (0x8745 bytes) 000553 1789777851.240451 write 0x01dfbb thru 0x022193 (0x41d9 bytes) 000555 1789777851.248479 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x23563): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23563): Mirror 2: 0xb9a72de7 (stale) Mirror 3: 0x4fdbf390 (stale) CRC-32 checksum value for chunk [0, 0x23563): Mirror 1: 0xe05a5279 Mirror 4: 0xe05a5279 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23563: skipped 000556 1789777852.221867 trunc from 0x023563 to 0x000cc9 (0x22899 bytes) 000557 1789777852.429840 mapread 0x00066d thru 0x000cc9 (0x65d bytes) 000558 1789777852.451866 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xcca): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcca): Mirror 2: 0xc7ccd812 (stale) Mirror 3: 0xa7f5b727 (stale) Mirror 4: 0xa7f5b727 (stale) CRC-32 checksum value for chunk [0, 0xcca): Mirror 1: 0xa7f5b727 Mirror 5: 0xa7f5b727 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcca: skipped 000560 1789777853.219472 trunc from 0x000b3b to 0x000cc9 (0x18f bytes) 000561 1789777853.270104 MIRROR_RESYNC 5 mirrors 000562 1789777854.175236 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000563 1789777854.580439 mapwrite 0x014f3c thru 0x01fcc0 (0xad85 bytes) 000564 1789777854.676682 read 0x0114ee thru 0x013f92 (0x2aa5 bytes) 000565 1789777854.677335 trunc from 0x00b92c to 0x01a8ae (0xef83 bytes) 000566 1789777854.683772 read 0x003b89 thru 0x00575b (0x1bd3 bytes) 000567 1789777854.701682 mapread 0x01d908 thru 0x01fcc0 (0x23b9 bytes) 000568 1789777854.703049 punch from 0x00c877 to 0x016145 (0x98cf bytes) 000569 1789777854.712476 MIRROR_RESYNC 4 mirrors 000570 1789777855.619083 write 0x03b378 thru 0x03e190 (0x2e19 bytes) 000571 1789777855.646756 trunc from 0x03e191 to 0x03ddcc (0x3c4 bytes) 000572 1789777855.669474 mapread 0x01d4e3 thru 0x020d2a (0x3848 bytes) 000573 1789777855.691474 punch from 0x0173e0 to 0x01c545 (0x5166 bytes) 000574 1789777855.697493 trunc from 0x03ddcd to 0x02df6b (0xfe61 bytes) 000575 1789777855.717408 punch from 0x013f9f to 0x020571 (0xc5d3 bytes) 000576 1789777855.723402 punch from 0x02b377 to 0x02df6b (0x2bf5 bytes) 000577 1789777855.727898 trunc from 0x01c55d to 0x0297e5 (0xd289 bytes) 000578 1789777855.734021 trunc from 0x02df6c to 0x00110a (0x2ce61 bytes) 000580 1789777855.752924 trunc from 0x000acf to 0x00110a (0x63c bytes) 000581 1789777855.758118 fallocate 0x019702 thru 0x0283a8 (0xeca7 bytes) 000582 1789777855.763345 trunc from 0x00110b to 0x03a9a1 (0x39897 bytes) 000583 1789777855.780833 read 0x0021ba thru 0x00c342 (0xa189 bytes) 000584 1789777855.790035 punch from 0x00e916 to 0x012bf5 (0x42e0 bytes) 000585 1789777855.796834 fallocate 0x002d5c thru 0x00bf13 (0x91b8 bytes) 000587 1789777855.833459 MIRROR_RESYNC 4 mirrors 000588 1789777857.032543 mapwrite 0x009a6e thru 0x012ba0 (0x9133 bytes) 000589 1789777857.192757 trunc from 0x03a9a2 to 0x022f6c (0x17a35 bytes) 000590 1789777857.254522 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22f6d): Mirror 3: 0x86e978a9 (stale) Mirror 4: 0x86e978a9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22f6d): Mirror 3: 0x86e978a9 (stale) Mirror 4: 0x86e978a9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22f6d: skipped 000591 1789777857.768687 fallocate 0x006463 thru 0x011709 (0xb2a7 bytes) 000592 1789777857.781851 MIRROR_RESYNC 3 mirrors 000593 1789777858.680245 read 0x004c9c thru 0x00f999 (0xacfe bytes) 000594 1789777858.703211 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000595 1789777859.137386 fallocate 0x03581a thru 0x03ae1b (0x5602 bytes) 000596 1789777859.224192 fallocate 0x00e6e6 thru 0x01ddf3 (0xf70e bytes) 000597 1789777859.238223 trunc from 0x017685 to 0x01f30b (0x7c87 bytes) 000598 1789777859.247820 punch from 0x01bf94 to 0x01cb45 (0xbb2 bytes) 000599 1789777859.264334 write 0x00f9d9 thru 0x016b04 (0x712c bytes) 000600 1789777859.294762 mapread 0x00f494 thru 0x01cee0 (0xda4d bytes) 000601 1789777859.329615 mapwrite 0x02dbeb thru 0x030942 (0x2d58 bytes) 000603 1789777859.415481 trunc from 0x030943 to 0x02bf10 (0x4a32 bytes) 000604 1789777859.440124 punch from 0x012e07 to 0x01fe8e (0xd088 bytes) 000605 1789777859.449831 trunc from 0x02bf11 to 0x00d0fc (0x1ee14 bytes) 000606 1789777859.481213 mapwrite 0x038569 thru 0x03ffff (0x7a97 bytes) 000607 1789777859.530690 trunc from 0x040000 to 0x0176f4 (0x2890b bytes) 000608 1789777859.562297 trunc from 0x0176f5 to 0x02ac67 (0x13573 bytes) 000609 1789777859.582481 mapread 0x0119f2 thru 0x01ba7c (0xa08b bytes) 000610 1789777859.608215 fallocate 0x00f1ad thru 0x01bf23 (0xcd77 bytes) 000611 1789777859.624120 write 0x008ecf thru 0x01574b (0xc87d bytes) 000613 1789777859.632823 write 0x01ce36 thru 0x02a0b5 (0xd280 bytes) 000614 1789777859.642109 write 0x0152b8 thru 0x020ccb (0xba14 bytes) 000615 1789777859.643945 write 0x035afc thru 0x03b822 (0x5d27 bytes) 000616 1789777859.646499 trunc from 0x03b823 to 0x02e420 (0xd402 bytes) 000618 1789777859.665819 mapread 0x02339d thru 0x02c16a (0x8dce bytes) 000619 1789777859.677500 trunc from 0x0065f2 to 0x010d8e (0xa79d bytes) 000620 1789777859.712976 trunc from 0x02e421 to 0x02f4e4 (0x10c4 bytes) 000621 1789777859.737645 trunc from 0x014df4 to 0x015fd8 (0x11e5 bytes) 000622 1789777859.744817 read 0x004072 thru 0x009b2e (0x5abd bytes) 000623 1789777859.754815 mapread 0x000892 thru 0x002caa (0x2419 bytes) 000624 1789777859.767732 trunc from 0x01365b to 0x01a71d (0x70c3 bytes) 000625 1789777859.774814 read 0x020f45 thru 0x022df1 (0x1ead bytes) 000626 1789777859.781387 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000627 1789777859.934802 read 0x02abc9 thru 0x02f4e4 (0x491c bytes) 000628 1789777859.949510 mapread 0x00d62d thru 0x013f85 (0x6959 bytes) 000629 1789777859.974697 mapread 0x02df48 thru 0x02f4e4 (0x159d bytes) 000630 1789777859.975633 trunc from 0x023876 to 0x02f4e4 (0xbc6f bytes) 000632 1789777859.982251 mapwrite 0x021dc4 thru 0x027a4d (0x5c8a bytes) 000633 1789777860.013735 punch from 0x028b54 to 0x02f006 (0x64b3 bytes) 000634 1789777860.019653 trunc from 0x02f4e5 to 0x021e42 (0xd6a2 bytes) 000637 1789777860.046188 trunc from 0x004d3f to 0x00e19b (0x945d bytes) 000638 1789777860.051294 punch from 0x0140c4 to 0x0163d4 (0x2311 bytes) 000639 1789777860.057264 trunc from 0x01aac3 to 0x01ae79 (0x3b7 bytes) 000640 1789777860.062082 mapread 0x0140f2 thru 0x021e42 (0xdd51 bytes) 000641 1789777860.077121 mapread 0x01b37f thru 0x021e42 (0x6ac4 bytes) 000642 1789777860.077939 fallocate 0x002be2 thru 0x002fa6 (0x3c5 bytes) 000643 1789777860.083635 punch from 0x003ffe to 0x00be7b (0x7e7e bytes) 000644 1789777860.091656 trunc from 0x00bbcf to 0x00cf20 (0x1352 bytes) 000645 1789777860.098636 write 0x008c66 thru 0x00a99f (0x1d3a bytes) 000647 1789777860.117332 write 0x037429 thru 0x03e204 (0x6ddc bytes) 000648 1789777860.118996 mapread 0x0342e5 thru 0x03b539 (0x7255 bytes) 000649 1789777860.128726 fallocate 0x01dbbb thru 0x025277 (0x76bd bytes) 000650 1789777860.134814 read 0x032335 thru 0x0348a8 (0x2574 bytes) 000652 1789777860.135799 fallocate 0x0083b5 thru 0x00e76e (0x63ba bytes) 000653 1789777860.141940 trunc from 0x03e205 to 0x03c34c (0x1eb8 bytes) 000654 1789777860.165049 trunc from 0x03c34d to 0x029f15 (0x12437 bytes) 000655 1789777860.180755 trunc from 0x016e11 to 0x01c83c (0x5a2c bytes) 000656 1789777860.187947 punch from 0x00f850 to 0x017c3b (0x83ec bytes) 000657 1789777860.193202 trunc from 0x029f16 to 0x0221ae (0x7d67 bytes) 000658 1789777860.214616 fallocate 0x027943 thru 0x02c475 (0x4b33 bytes) 000659 1789777860.221043 write 0x00cf99 thru 0x0135e0 (0x6648 bytes) 000660 1789777860.245206 punch from 0x021c6d to 0x02c475 (0xa809 bytes) 000661 1789777860.255612 MIRROR_EXTEND to 2 mirrors 000662 1789777861.150208 mapread 0x006360 thru 0x00ace0 (0x4981 bytes) 000663 1789777861.198210 write 0x036b8e thru 0x03d946 (0x6db9 bytes) 000664 1789777861.278654 write 0x03f94d thru 0x03ffff (0x6b3 bytes) 000665 1789777861.280268 mapwrite 0x0391e6 thru 0x03ffff (0x6e1a bytes) 000666 1789777861.336387 punch from 0x02479c to 0x02c187 (0x79ec bytes) 000667 1789777861.345404 fallocate 0x031854 thru 0x03f666 (0xde13 bytes) 000668 1789777861.357450 mapread 0x007416 thru 0x0118ad (0xa498 bytes) 000669 1789777861.386093 punch from 0x03b4d5 to 0x03ffff (0x4b2b bytes) 000670 1789777861.393507 write 0x00c874 thru 0x01088c (0x4019 bytes) 000671 1789777861.394583 punch from 0x03cebd to 0x03ffff (0x3143 bytes) 000672 1789777861.402262 mapwrite 0x001246 thru 0x00ceea (0xbca5 bytes) 000674 1789777861.450482 read 0x025bed thru 0x02a29e (0x46b2 bytes) 000675 1789777861.474641 read 0x0186ce thru 0x01ec1f (0x6552 bytes) 000676 1789777861.512356 write 0x000477 thru 0x001c88 (0x1812 bytes) 000677 1789777861.515685 punch from 0x0079ce to 0x00fc25 (0x8258 bytes) 000678 1789777861.528660 MIRROR_RESYNC 2 mirrors 000679 1789777862.501548 write 0x002c90 thru 0x011428 (0xe799 bytes) 000680 1789777862.599237 write 0x0041cc thru 0x0051d6 (0x100b bytes) 000681 1789777862.604541 mapwrite 0x019845 thru 0x025d08 (0xc4c4 bytes) 000682 1789777862.752127 trunc from 0x040000 to 0x00f77c (0x30883 bytes) 000683 1789777862.797597 write 0x034233 thru 0x034b12 (0x8e0 bytes) 000684 1789777862.799837 write 0x000e74 thru 0x002b85 (0x1d12 bytes) 000685 1789777862.818479 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000686 1789777863.102206 mapwrite 0x0061e6 thru 0x00879c (0x25b7 bytes) 000687 1789777863.185246 trunc from 0x015f62 to 0x01df72 (0x8011 bytes) 000688 1789777863.190075 trunc from 0x034b13 to 0x01811b (0x1c9f7 bytes) 000689 1789777863.233250 fallocate 0x02c551 thru 0x02c98b (0x43b bytes) 000690 1789777863.250252 punch from 0x00ccfd to 0x011e71 (0x5175 bytes) 000692 1789777863.257348 read 0x0070e6 thru 0x0169da (0xf8f5 bytes) 000693 1789777863.270313 trunc from 0x01811c to 0x039de5 (0x21cca bytes) 000694 1789777863.301046 trunc from 0x037ed4 to 0x039de5 (0x1f12 bytes) 000695 1789777863.309378 trunc from 0x00a201 to 0x0185c4 (0xe3c4 bytes) 000696 1789777863.325894 punch from 0x0184ee to 0x019164 (0xc77 bytes) 000698 1789777863.334924 punch from 0x01ece4 to 0x02312c (0x4449 bytes) 000699 1789777863.350203 trunc from 0x039de6 to 0x01a71f (0x1f6c6 bytes) 000700 1789777863.395462 punch from 0x00a543 to 0x0147c3 (0xa281 bytes) 000701 1789777863.412429 fallocate 0x02f342 thru 0x03a36d (0xb02c bytes) 000702 1789777863.431755 punch from 0x0180d0 to 0x01a71f (0x2650 bytes) 000704 1789777863.451114 trunc from 0x013728 to 0x016b49 (0x3422 bytes) 000705 1789777863.458031 read 0x00b5a9 thru 0x00f0fc (0x3b54 bytes) 000706 1789777863.491015 punch from 0x005f28 to 0x00870f (0x27e8 bytes) 000707 1789777863.497824 read 0x017532 thru 0x018d84 (0x1853 bytes) 000708 1789777863.498593 read 0x0132bf thru 0x01a71f (0x7461 bytes) 000710 1789777863.504506 trunc from 0x004ac3 to 0x00f021 (0xa55f bytes) 000711 1789777863.516547 write 0x005bc9 thru 0x00c452 (0x688a bytes) 000712 1789777863.530958 read 0x004eab thru 0x00bbbf (0x6d15 bytes) 000713 1789777863.531740 punch from 0x019a18 to 0x01a71f (0xd08 bytes) 000714 1789777863.543400 punch from 0x0102a1 to 0x01426b (0x3fcb bytes) 000715 1789777863.553986 mapwrite 0x02dcfb thru 0x03c446 (0xe74c bytes) 000716 1789777863.717183 write 0x03370c thru 0x03b7e9 (0x80de bytes) 000717 1789777863.718384 read 0x029d12 thru 0x0359bc (0xbcab bytes) 000718 1789777863.719793 mapread 0x021a19 thru 0x0251e4 (0x37cc bytes) 000719 1789777863.720757 punch from 0x01f40a to 0x026c7b (0x7872 bytes) 000720 1789777863.728266 mapread 0x019fe9 thru 0x026d93 (0xcdab bytes) 000721 1789777863.757913 trunc from 0x03c447 to 0x0055f7 (0x36e4f bytes) 000722 1789777863.786592 read 0x001e18 thru 0x0047af (0x2998 bytes) 000723 1789777863.788086 write 0x02d604 thru 0x030568 (0x2f65 bytes) 000724 1789777863.798340 read 0x02e5a7 thru 0x02fc7a (0x16d4 bytes) 000725 1789777863.813605 MIRROR_EXTEND to 2 mirrors 000726 1789777864.931743 trunc from 0x030569 to 0x00b4bd (0x250ab bytes) 000727 1789777865.003001 trunc from 0x00b4be to 0x0267c8 (0x1b30b bytes) 000728 1789777865.028093 trunc from 0x00dc44 to 0x00f8c9 (0x1c86 bytes) 000729 1789777865.033576 punch from 0x00b081 to 0x0177c9 (0xc749 bytes) 000730 1789777865.043552 punch from 0x024622 to 0x024832 (0x211 bytes) 000731 1789777865.049701 write 0x03eba3 thru 0x03ffff (0x145d bytes) 000732 1789777865.057360 MIRROR_RESYNC 2 mirrors 000733 1789777866.075129 write 0x03c860 thru 0x03ffff (0x37a0 bytes) 000734 1789777866.139374 read 0x03f0b5 thru 0x03ffff (0xf4b bytes) 000735 1789777866.139992 trunc from 0x040000 to 0x01ad8a (0x25275 bytes) 000736 1789777866.184385 trunc from 0x01ad8b to 0x02da19 (0x12c8f bytes) 000737 1789777866.203803 fallocate 0x03a085 thru 0x03ffff (0x5f7b bytes) 000738 1789777866.221671 trunc from 0x00b803 to 0x011bda (0x63d8 bytes) 000739 1789777866.234327 write 0x022cd5 thru 0x024533 (0x185f bytes) 000740 1789777866.267187 mapwrite 0x004c75 thru 0x00d29a (0x8626 bytes) 000741 1789777866.381109 mapread 0x02031f thru 0x02d582 (0xd264 bytes) 000742 1789777866.429447 trunc from 0x02a2fb to 0x02da19 (0x371f bytes) 000744 1789777866.447034 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000745 1789777866.744894 fallocate 0x03c44c thru 0x03ffff (0x3bb4 bytes) 000746 1789777866.752876 punch from 0x013565 to 0x0174cd (0x3f69 bytes) 000747 1789777866.761770 read 0x00050f thru 0x00a245 (0x9d37 bytes) 000748 1789777866.791814 trunc from 0x02da1a to 0x02dcd4 (0x2bb bytes) 000749 1789777866.851663 punch from 0x0071e2 to 0x015478 (0xe297 bytes) 000750 1789777866.856398 trunc from 0x006ac6 to 0x007688 (0xbc3 bytes) 000751 1789777866.869869 mapread 0x018f07 thru 0x020cfa (0x7df4 bytes) 000752 1789777866.919676 punch from 0x000dfd to 0x002e46 (0x204a bytes) 000753 1789777866.934409 mapread 0x02a360 thru 0x02dcd4 (0x3975 bytes) 000754 1789777866.967440 MIRROR_EXTEND to 2 mirrors 000755 1789777867.791642 trunc from 0x011b68 to 0x01c12c (0xa5c5 bytes) 000756 1789777867.830419 read 0x02c0cb thru 0x02dcd4 (0x1c0a bytes) 000757 1789777867.850528 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000758 1789777868.219593 trunc from 0x0281bd to 0x02dcd4 (0x5b18 bytes) 000759 1789777868.246073 mapread 0x011d6f thru 0x0197a4 (0x7a36 bytes) 000760 1789777868.290231 trunc from 0x02dcd5 to 0x027cec (0x5fe8 bytes) 000761 1789777868.325799 read 0x00ec56 thru 0x013ef6 (0x52a1 bytes) 000762 1789777868.326502 fallocate 0x038e01 thru 0x03ffff (0x71ff bytes) 000763 1789777868.346412 punch from 0x0219a2 to 0x027369 (0x59c8 bytes) 000765 1789777868.376056 read 0x02147b thru 0x027cec (0x6872 bytes) 000766 1789777868.397121 punch from 0x020de3 to 0x027cec (0x6f0a bytes) 000767 1789777868.403492 read 0x01d4f5 thru 0x027cec (0xa7f8 bytes) 000769 1789777868.415012 read 0x007bcf thru 0x01423c (0xc66e bytes) 000770 1789777868.416581 trunc from 0x027ced to 0x02f871 (0x7b85 bytes) 000771 1789777868.439410 mapwrite 0x01a72e thru 0x02861b (0xdeee bytes) 000772 1789777868.478411 trunc from 0x02f872 to 0x007cb6 (0x27bbb bytes) 000773 1789777868.495438 read 0x001576 thru 0x007cb6 (0x6741 bytes) 000774 1789777868.496064 trunc from 0x006c02 to 0x007cb6 (0x10b5 bytes) 000775 1789777868.502529 trunc from 0x007cb7 to 0x02f7d0 (0x27b1a bytes) 000777 1789777868.524577 mapread 0x00438a thru 0x00b126 (0x6d9d bytes) 000778 1789777868.536954 write 0x02fb51 thru 0x039bc2 (0xa072 bytes) 000779 1789777868.540379 fallocate 0x003311 thru 0x009834 (0x6524 bytes) 000780 1789777868.545932 mapwrite 0x022c3f thru 0x028431 (0x57f3 bytes) 000782 1789777868.565872 trunc from 0x0312aa to 0x03822d (0x6f84 bytes) 000784 1789777868.572501 mapwrite 0x03bf9a thru 0x03ffff (0x4066 bytes) 000785 1789777868.640130 fallocate 0x002dac thru 0x00ff5e (0xd1b3 bytes) 000786 1789777868.671452 mapread 0x00245f thru 0x0028ea (0x48c bytes) 000787 1789777868.672293 read 0x00d0a8 thru 0x011476 (0x43cf bytes) 000788 1789777868.672873 write 0x020e2b thru 0x029a25 (0x8bfb bytes) 000789 1789777868.682182 read 0x02033d thru 0x02c4af (0xc173 bytes) 000790 1789777868.686369 trunc from 0x040000 to 0x02e1e2 (0x11e1d bytes) 000793 1789777868.746971 mapread 0x027e5e thru 0x02ac12 (0x2db5 bytes) 000794 1789777868.749012 fallocate 0x01f2b7 thru 0x02393f (0x4689 bytes) 000795 1789777868.765483 trunc from 0x008b4a to 0x00b0e1 (0x2598 bytes) 000796 1789777868.772395 fallocate 0x0242a5 thru 0x0309dc (0xc738 bytes) 000797 1789777868.794178 read 0x03010a thru 0x0309dc (0x8d3 bytes) 000799 1789777868.822000 punch from 0x02a2fc to 0x02c754 (0x2459 bytes) 000801 1789777868.849928 fallocate 0x03aaab thru 0x03af99 (0x4ef bytes) 000802 1789777868.857177 read 0x00ddf7 thru 0x016877 (0x8a81 bytes) 000804 1789777868.865141 fallocate 0x0176c7 thru 0x019e70 (0x27aa bytes) 000805 1789777868.880635 mapwrite 0x005b88 thru 0x00ca0a (0x6e83 bytes) 000806 1789777868.914862 trunc from 0x0309dd to 0x0268c8 (0xa114 bytes) 000807 1789777868.949035 trunc from 0x0268c9 to 0x03f858 (0x18f90 bytes) 000809 1789777868.984469 trunc from 0x03f859 to 0x00bd3c (0x33b1c bytes) 000810 1789777869.004587 mapread 0x001332 thru 0x00bd3c (0xaa0b bytes) 000812 1789777869.011629 read 0x006fe3 thru 0x00bd3c (0x4d5a bytes) 000813 1789777869.015344 write 0x002db0 thru 0x0038ab (0xafc bytes) 000814 1789777869.017528 mapread 0x0033be thru 0x00bd3c (0x897f bytes) 000815 1789777869.020617 mapread 0x002ce5 thru 0x0044bc (0x17d8 bytes) 000817 1789777869.024136 mapread 0x00a454 thru 0x00ac1f (0x7cc bytes) 000818 1789777869.025912 punch from 0x007325 to 0x00bd3c (0x4a18 bytes) 000819 1789777869.033706 read 0x0088b5 thru 0x00bd3c (0x3488 bytes) 000820 1789777869.059497 trunc from 0x00183b to 0x00b4d6 (0x9c9c bytes) 000821 1789777869.080470 write 0x018960 thru 0x027010 (0xe6b1 bytes) 000822 1789777869.087007 trunc from 0x027011 to 0x00ce15 (0x1a1fb bytes) 000823 1789777869.107272 write 0x03e004 thru 0x03ffff (0x1ffc bytes) 000824 1789777869.108634 write 0x01a6d3 thru 0x01fd56 (0x5684 bytes) 000826 1789777869.124180 trunc from 0x040000 to 0x02dec3 (0x1213c bytes) 000827 1789777869.147705 trunc from 0x02dec4 to 0x013276 (0x1ac4d bytes) 000828 1789777869.167383 write 0x0153a8 thru 0x020463 (0xb0bc bytes) 000829 1789777869.169933 trunc from 0x006607 to 0x00b9af (0x53a9 bytes) 000830 1789777869.177032 trunc from 0x00ed41 to 0x01d65d (0xe91d bytes) 000831 1789777869.201143 read 0x019488 thru 0x020463 (0x6fdc bytes) 000832 1789777869.224570 mapwrite 0x03baa2 thru 0x03fae2 (0x4041 bytes) 000833 1789777869.337359 punch from 0x0218ee to 0x021ecb (0x5de bytes) 000834 1789777869.345145 punch from 0x022d80 to 0x0309ca (0xdc4b bytes) 000835 1789777869.358039 mapread 0x0111a3 thru 0x013d24 (0x2b82 bytes) 000836 1789777869.359374 write 0x011fec thru 0x019c2b (0x7c40 bytes) 000837 1789777869.365892 fallocate 0x037f17 thru 0x03ffff (0x80e9 bytes) 000838 1789777869.372533 trunc from 0x011424 to 0x015c75 (0x4852 bytes) 000839 1789777869.391911 fallocate 0x02ba36 thru 0x02cadb (0x10a6 bytes) 000840 1789777869.397503 mapwrite 0x00dc7c thru 0x018ed8 (0xb25d bytes) 000841 1789777869.449478 fallocate 0x022cb6 thru 0x022e7e (0x1c9 bytes) 000842 1789777869.455443 trunc from 0x02bf44 to 0x03aeb2 (0xef6f bytes) 000843 1789777869.460488 punch from 0x02600a to 0x029df0 (0x3de7 bytes) 000844 1789777869.464491 punch from 0x024286 to 0x02554c (0x12c7 bytes) 000845 1789777869.469568 trunc from 0x040000 to 0x03fbc9 (0x436 bytes) 000846 1789777869.489836 mapwrite 0x02dfe0 thru 0x03bde8 (0xde09 bytes) 000847 1789777869.625705 punch from 0x001405 to 0x00c398 (0xaf94 bytes) 000848 1789777869.646095 MIRROR_EXTEND to 2 mirrors 000849 1789777871.070522 fallocate 0x03ebf7 thru 0x03ffff (0x1409 bytes) 000850 1789777871.155312 mapread 0x02348f thru 0x023e4e (0x9c0 bytes) 000851 1789777871.177441 mapread 0x03592a thru 0x03d621 (0x7cf8 bytes) 000852 1789777871.233827 mapwrite 0x025897 thru 0x028612 (0x2d7c bytes) 000853 1789777871.327922 trunc from 0x03fbca to 0x020c98 (0x1ef31 bytes) 000855 1789777871.406541 fallocate 0x00d1a6 thru 0x0128fe (0x5759 bytes) 000856 1789777871.429373 MIRROR_RESYNC 2 mirrors 000857 1789777872.315686 fallocate 0x02ab99 thru 0x037859 (0xccc1 bytes) 000859 1789777872.372917 mapread 0x00af0b thru 0x01996f (0xea65 bytes) 000860 1789777872.409017 read 0x001542 thru 0x00bd12 (0xa7d1 bytes) 000861 1789777872.416273 mapread 0x024a28 thru 0x0281af (0x3788 bytes) 000862 1789777872.441639 fallocate 0x003a53 thru 0x005630 (0x1bde bytes) 000863 1789777872.458514 write 0x00e60a thru 0x01c53e (0xdf35 bytes) 000864 1789777872.462330 mapread 0x009d16 thru 0x00bbe1 (0x1ecc bytes) 000865 1789777872.464502 read 0x030804 thru 0x0370c5 (0x68c2 bytes) 000866 1789777872.478507 trunc from 0x03785a to 0x03f6bf (0x7e66 bytes) 000867 1789777872.517054 trunc from 0x03f6c0 to 0x00a5c6 (0x350f9 bytes) 000868 1789777872.565665 write 0x006ec2 thru 0x00fdc7 (0x8f06 bytes) 000871 1789777872.573041 trunc from 0x00fdc8 to 0x0082e1 (0x7ae6 bytes) 000872 1789777872.619785 mapwrite 0x0249f5 thru 0x033e96 (0xf4a2 bytes) 000873 1789777872.873097 mapread 0x00e339 thru 0x011d0e (0x39d6 bytes) 000874 1789777872.900234 punch from 0x0048f0 to 0x00d6a4 (0x8db5 bytes) 000875 1789777872.906636 mapread 0x00bc36 thru 0x01869d (0xca68 bytes) 000876 1789777872.987469 trunc from 0x01c94e to 0x02632c (0x99df bytes) 000877 1789777872.992774 trunc from 0x01ee53 to 0x02334a (0x44f8 bytes) 000878 1789777872.998965 fallocate 0x01cfd0 thru 0x02a26a (0xd29b bytes) 000879 1789777873.004700 mapwrite 0x034443 thru 0x03ffff (0xbbbd bytes) 000880 1789777873.117589 mapread 0x026790 thru 0x030502 (0x9d73 bytes) 000881 1789777873.136145 punch from 0x02b8cd to 0x03269c (0x6dd0 bytes) 000882 1789777873.149126 read 0x003292 thru 0x005ecf (0x2c3e bytes) 000883 1789777873.189678 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000885 1789777873.382815 punch from 0x023646 to 0x030db9 (0xd774 bytes) 000886 1789777873.394816 MIRROR_EXTEND to 2 mirrors 000887 1789777874.247802 mapread 0x00bce9 thru 0x01617c (0xa494 bytes) 000888 1789777874.293966 trunc from 0x0366b3 to 0x03ffff (0x994d bytes) 000889 1789777874.338331 trunc from 0x03faf7 to 0x03ffff (0x509 bytes) 000890 1789777874.344387 fallocate 0x0310a3 thru 0x036451 (0x53af bytes) 000891 1789777874.349762 write 0x022204 thru 0x02b70f (0x950c bytes) 000892 1789777874.368263 read 0x02facd thru 0x036cd3 (0x7207 bytes) 000893 1789777874.378971 mapread 0x020acf thru 0x02dd1b (0xd24d bytes) 000894 1789777874.389408 read 0x007316 thru 0x01596f (0xe65a bytes) 000896 1789777874.403875 read 0x0038f1 thru 0x00b17d (0x788d bytes) 000897 1789777874.404825 fallocate 0x03b51d thru 0x03ffff (0x4ae3 bytes) 000898 1789777874.419979 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xca4441a0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe45b6bdf Mirror 3: 0xe45b6bdf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000899 1789777875.975900 fallocate 0x00cbc5 thru 0x014878 (0x7cb4 bytes) 000900 1789777876.039968 trunc from 0x0171df to 0x023d7a (0xcb9c bytes) 000902 1789777876.047843 write 0x03bf2f thru 0x03ffff (0x40d1 bytes) 000903 1789777876.061634 trunc from 0x013c23 to 0x015c94 (0x2072 bytes) 000904 1789777876.070396 trunc from 0x0305ae to 0x034b53 (0x45a6 bytes) 000905 1789777876.080720 trunc from 0x040000 to 0x010925 (0x2f6da bytes) 000906 1789777876.120936 MIRROR_RESYNC 3 mirrors 000907 1789777877.191852 trunc from 0x010926 to 0x03c6d2 (0x2bdad bytes) 000908 1789777877.259099 read 0x037ce9 thru 0x03c6d2 (0x49ea bytes) 000909 1789777877.269536 trunc from 0x021145 to 0x022562 (0x141e bytes) 000910 1789777877.279957 trunc from 0x0271c7 to 0x0357d3 (0xe60d bytes) 000911 1789777877.286934 trunc from 0x021dc4 to 0x029930 (0x7b6d bytes) 000912 1789777877.301903 read 0x010af3 thru 0x019228 (0x8736 bytes) 000913 1789777877.317141 trunc from 0x03c6d3 to 0x032483 (0xa24f bytes) 000915 1789777877.355795 mapwrite 0x005ee4 thru 0x008ce2 (0x2dff bytes) 000916 1789777877.376954 trunc from 0x032484 to 0x02c1f9 (0x628a bytes) 000917 1789777877.396399 mapwrite 0x01f40d thru 0x02ea66 (0xf65a bytes) 000918 1789777877.485787 MIRROR_RESYNC 3 mirrors 000919 1789777878.690609 mapwrite 0x010938 thru 0x01abdf (0xa2a8 bytes) 000920 1789777878.813915 trunc from 0x02ea67 to 0x017919 (0x1714d bytes) 000921 1789777878.839392 trunc from 0x01791a to 0x017b87 (0x26e bytes) 000922 1789777878.864024 punch from 0x003fd4 to 0x0125f6 (0xe623 bytes) 000923 1789777878.871445 mapwrite 0x012835 thru 0x01546e (0x2c3a bytes) 000924 1789777878.896576 trunc from 0x017b88 to 0x01460b (0x357c bytes) 000925 1789777878.917077 write 0x00dcbf thru 0x0139dd (0x5d1f bytes) 000926 1789777878.918570 write 0x03ad18 thru 0x03ad46 (0x2f bytes) 000927 1789777878.921449 mapwrite 0x031965 thru 0x0350a0 (0x373c bytes) 000928 1789777878.974578 mapread 0x012f10 thru 0x01d057 (0xa148 bytes) 000929 1789777879.017196 mapread 0x02f1ca thru 0x03274b (0x3582 bytes) 000930 1789777879.018382 punch from 0x009a7a to 0x00dc21 (0x41a8 bytes) 000931 1789777879.035042 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ad47): Mirror 3: 0xb0fc2687 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad47): Mirror 3: 0xb0fc2687 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad47: skipped 000932 1789777879.551772 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3ad47): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad47): Mirror 3: 0xb0fc2687 (stale) CRC-32 checksum value for chunk [0, 0x3ad47): Mirror 1: 0xf065c950 Mirror 4: 0xf065c950 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad47: skipped 000933 1789777880.838079 mapread 0x001561 thru 0x003a09 (0x24a9 bytes) 000935 1789777880.929635 mapwrite 0x0250db thru 0x0322ff (0xd225 bytes) 000937 1789777881.151710 punch from 0x016b53 to 0x01ae57 (0x4305 bytes) 000938 1789777881.174679 write 0x028620 thru 0x029404 (0xde5 bytes) 000939 1789777881.198849 mapread 0x030b6b thru 0x03ad46 (0xa1dc bytes) 000940 1789777881.215807 mapwrite 0x012b87 thru 0x0209ff (0xde79 bytes) 000941 1789777881.270785 punch from 0x03754a to 0x03938d (0x1e44 bytes) 000943 1789777881.278331 mapread 0x036500 thru 0x03a222 (0x3d23 bytes) 000944 1789777881.289059 mapread 0x01dcab thru 0x026efe (0x9254 bytes) 000945 1789777881.293988 mapread 0x003f7b thru 0x006f32 (0x2fb8 bytes) 000946 1789777881.316081 mapread 0x0290ff thru 0x038233 (0xf135 bytes) 000947 1789777881.322821 mapread 0x018da9 thru 0x027d42 (0xef9a bytes) 000948 1789777881.325615 punch from 0x036292 to 0x03ad46 (0x4ab5 bytes) 000950 1789777881.338297 mapread 0x022925 thru 0x02f44c (0xcb28 bytes) 000951 1789777881.339741 fallocate 0x0296ea thru 0x03074a (0x7061 bytes) 000952 1789777881.353334 trunc from 0x03ad47 to 0x026b09 (0x1423d bytes) 000954 1789777881.400108 read 0x01cb58 thru 0x01fca5 (0x314e bytes) 000955 1789777881.404731 read 0x01ed05 thru 0x023514 (0x4810 bytes) 000956 1789777881.405485 mapread 0x021aac thru 0x026b09 (0x505e bytes) 000957 1789777881.410389 trunc from 0x026b0a to 0x023f6f (0x2b9a bytes) 000958 1789777881.455740 fallocate 0x024277 thru 0x02b118 (0x6ea2 bytes) 000959 1789777881.481708 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x23f70): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23f70): Mirror 3: 0xe1b0529c (stale) Mirror 4: 0xadd3c2c4 (stale) CRC-32 checksum value for chunk [0, 0x23f70): Mirror 1: 0x44d38641 Mirror 5: 0x44d38641 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23f70: skipped 000960 1789777882.996788 trunc from 0x011e43 to 0x018686 (0x6844 bytes) 000961 1789777883.040455 write 0x01e8ee thru 0x01fad2 (0x11e5 bytes) 000963 1789777883.062978 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x23f70): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23f70): Mirror 3: 0xe1b0529c (stale) Mirror 4: 0xadd3c2c4 (stale) Mirror 5: 0x44d38641 (stale) CRC-32 checksum value for chunk [0, 0x23f70): Mirror 1: 0xb4b4417 Mirror 6: 0xb4b4417 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23f70: skipped 000964 1789777884.979814 mapwrite 0x00d4f2 thru 0x015efd (0x8a0c bytes) 000965 1789777885.177943 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x23f70): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23f70): Mirror 3: 0xe1b0529c (stale) Mirror 4: 0xadd3c2c4 (stale) Mirror 5: 0x44d38641 (stale) Mirror 6: 0xb4b4417 (stale) CRC-32 checksum value for chunk [0, 0x23f70): Mirror 1: 0x271115f Mirror 7: 0x271115f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23f70: skipped 000966 1789777886.515559 punch from 0x00eb9e to 0x0112d4 (0x2737 bytes) 000967 1789777886.565718 punch from 0x01159e to 0x01f9e6 (0xe449 bytes) 000968 1789777886.575216 punch from 0x007d4b to 0x0159d6 (0xdc8c bytes) 000969 1789777886.584533 fallocate 0x022a1d thru 0x02dfb7 (0xb59b bytes) 000970 1789777886.597221 fallocate 0x007d12 thru 0x00c650 (0x493f bytes) 000971 1789777886.603899 trunc from 0x023f70 to 0x019297 (0xacd8 bytes) 000972 1789777886.642213 punch from 0x007eda to 0x012529 (0xa650 bytes) 000973 1789777886.655806 mapread 0x013859 thru 0x016881 (0x3029 bytes) 000974 1789777886.679951 read 0x000cce thru 0x00fd48 (0xf07b bytes) 000975 1789777886.694032 mapwrite 0x01fdab thru 0x025315 (0x556b bytes) 000976 1789777886.758583 MIRROR_RESYNC 6 mirrors 000977 1789777888.435597 trunc from 0x01a3f0 to 0x01a993 (0x5a4 bytes) 000978 1789777888.467124 read 0x018b6d thru 0x025315 (0xc7a9 bytes) 000979 1789777888.482642 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x25316): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25316): Mirror 3: 0xec0c1247 (stale) Mirror 4: 0xec0c1247 (stale) Mirror 5: 0xec0c1247 (stale) Mirror 6: 0xec0c1247 (stale) Mirror 7: 0xec0c1247 (stale) CRC-32 checksum value for chunk [0, 0x25316): Mirror 1: 0xec0c1247 Mirror 8: 0xec0c1247 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25316: skipped 000980 1789777890.016091 mapread 0x00c734 thru 0x01af58 (0xe825 bytes) 000981 1789777890.117445 write 0x02509d thru 0x02d433 (0x8397 bytes) 000983 1789777890.207046 mapwrite 0x03da18 thru 0x03ffff (0x25e8 bytes) 000984 1789777890.317742 trunc from 0x040000 to 0x024394 (0x1bc6b bytes) 000985 1789777890.347597 read 0x00d798 thru 0x01867b (0xaee4 bytes) 000986 1789777890.367200 trunc from 0x024395 to 0x0052b7 (0x1f0dd bytes) 000987 1789777890.396751 fallocate 0x01586b thru 0x01a433 (0x4bc9 bytes) 000988 1789777890.406624 trunc from 0x0052b8 to 0x006657 (0x13a0 bytes) 000990 1789777890.450575 punch from 0x004082 to 0x006657 (0x25d6 bytes) 000992 1789777890.467089 read 0x002cea thru 0x006657 (0x396e bytes) 000993 1789777890.483054 mapwrite 0x02f92a thru 0x0396aa (0x9d81 bytes) 000994 1789777890.574508 mapwrite 0x01a11e thru 0x0201e3 (0x60c6 bytes) 000995 1789777890.599219 fallocate 0x003f33 thru 0x00b595 (0x7663 bytes) 000996 1789777890.605101 trunc from 0x008a01 to 0x017817 (0xee17 bytes) 000998 1789777890.611122 fallocate 0x027a20 thru 0x028939 (0xf1a bytes) 001000 1789777890.624791 read 0x00b609 thru 0x01b5a3 (0xff9b bytes) All operations completed A-OK!