== sanity-flr test 70a: flr mode fsx test ================ 22:31:39 (1784341899) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 1900 skipping zero length punch hole skipping zero length punch hole 000003 1784341900.374786 mapwrite 0x03a74e thru 0x03ffff (0x58b2 bytes) 000004 1784341900.393473 read 0x03032c thru 0x03e58a (0xe25f bytes) 000005 1784341900.396267 read 0x035fdd thru 0x03ffff (0xa023 bytes) 000006 1784341900.396868 read 0x00e8ae thru 0x01cc58 (0xe3ab bytes) 000007 1784341900.401528 write 0x01e960 thru 0x025063 (0x6704 bytes) 000008 1784341900.402447 read 0x028bd1 thru 0x02cc0b (0x403b bytes) 000009 1784341900.402954 punch from 0x01210b to 0x01d85f (0xb755 bytes) 000011 1784341900.405623 punch from 0x033f84 to 0x03ffff (0xc07c bytes) 000012 1784341900.407506 punch from 0x00a691 to 0x016fe5 (0xc955 bytes) 000013 1784341900.409316 mapwrite 0x001149 thru 0x0107c1 (0xf679 bytes) 000014 1784341900.421073 write 0x02d7a8 thru 0x03267c (0x4ed5 bytes) 000015 1784341900.421952 mapwrite 0x004ab4 thru 0x00bbdf (0x712c bytes) zero_range to largest ever: 0x39445 000016 1784341900.428066 trunc from 0x02b196 to 0x039444 (0xe2af bytes) 000017 1784341900.429903 write 0x00e608 thru 0x01e062 (0xfa5b bytes) 000018 1784341900.431266 read 0x008133 thru 0x01283f (0xa70d bytes) 000019 1784341900.431753 read 0x027d91 thru 0x031b68 (0x9dd8 bytes) 000020 1784341900.435000 trunc from 0x01aa56 to 0x01efe7 (0x4592 bytes) fallocating to largest ever: 0x3b035 000021 1784341900.439164 fallocate 0x0391a4 thru 0x03b034 (0x1e91 bytes) 000022 1784341900.440981 mapread 0x02fd96 thru 0x039d2b (0x9f96 bytes) 000023 1784341900.441945 punch from 0x02124d to 0x023120 (0x1ed4 bytes) 000024 1784341900.443626 punch from 0x00ed5c to 0x019f5d (0xb202 bytes) 000025 1784341900.445188 fallocate 0x01d70a thru 0x028fdb (0xb8d2 bytes) 000026 1784341900.446974 mapread 0x03c531 thru 0x03ffff (0x3acf bytes) 000027 1784341900.447648 read 0x02c6ed thru 0x02fe2d (0x3741 bytes) 000028 1784341900.448089 punch from 0x03a9a5 to 0x03ffff (0x565b bytes) 000029 1784341900.449628 write 0x020099 thru 0x02069c (0x604 bytes) 000030 1784341900.450248 read 0x00b0c7 thru 0x00b6c9 (0x603 bytes) 000031 1784341900.450674 fallocate 0x001b56 thru 0x0076de (0x5b89 bytes) 000032 1784341900.452425 fallocate 0x0109fe thru 0x01d21d (0xc820 bytes) 000034 1784341900.454752 read 0x01f999 thru 0x024fc3 (0x562b bytes) 000035 1784341900.458165 mapread 0x036cd8 thru 0x03b35a (0x4683 bytes) fallocating to largest ever: 0x40000 000036 1784341900.458887 fallocate 0x032cd4 thru 0x03ffff (0xd32c bytes) 000038 1784341900.461593 trunc from 0x0115f2 to 0x01a452 (0x8e61 bytes) 000039 1784341900.463888 trunc from 0x040000 to 0x00ed25 (0x312da bytes) 000040 1784341900.468760 trunc from 0x00ed26 to 0x027c16 (0x18ef1 bytes) 000041 1784341900.473117 trunc from 0x01324b to 0x016c0c (0x39c2 bytes) 000042 1784341900.474758 write 0x0128bf thru 0x020b71 (0xe2b3 bytes) 000043 1784341900.478331 punch from 0x001534 to 0x00286d (0x133a bytes) 000044 1784341900.480125 read 0x026c93 thru 0x027c16 (0xf84 bytes) 000045 1784341900.483064 trunc from 0x024415 to 0x027c16 (0x3802 bytes) 000046 1784341900.484902 read 0x011bf2 thru 0x020171 (0xe580 bytes) 000047 1784341900.485383 write 0x01165d thru 0x01eafc (0xd4a0 bytes) 000050 1784341900.487450 punch from 0x01bbf0 to 0x027c16 (0xc027 bytes) 000051 1784341900.492017 trunc from 0x027c17 to 0x028e84 (0x126e bytes) 000052 1784341900.496592 trunc from 0x028e85 to 0x01cdc9 (0xc0bb bytes) 000054 1784341900.502131 mapwrite 0x00b708 thru 0x016664 (0xaf5d bytes) 000055 1784341900.510255 mapwrite 0x03329f thru 0x03f4fa (0xc25c bytes) 000056 1784341900.524959 write 0x0002e2 thru 0x00db76 (0xd895 bytes) 000057 1784341900.526036 trunc from 0x00a448 to 0x0137d1 (0x938a bytes) 000059 1784341900.531781 punch from 0x00ea08 to 0x017209 (0x8802 bytes) 000060 1784341900.535715 MIRROR_EXTEND to 2 mirrors 000061 1784341900.700911 trunc from 0x01dcb1 to 0x028745 (0xaa95 bytes) 000062 1784341900.710518 trunc from 0x03f4fb to 0x017d06 (0x277f4 bytes) 000063 1784341900.720927 punch from 0x011106 to 0x015bfa (0x4af5 bytes) 000064 1784341900.722887 read 0x00d450 thru 0x017033 (0x9be4 bytes) 000065 1784341900.726097 trunc from 0x017d07 to 0x03d4fe (0x257f8 bytes) 000066 1784341900.730478 trunc from 0x005684 to 0x008f33 (0x38b0 bytes) 000067 1784341900.732474 mapread 0x03c061 thru 0x03d4fe (0x149e bytes) 000068 1784341900.736028 read 0x00dea7 thru 0x01a07f (0xc1d9 bytes) 000069 1784341900.739523 fallocate 0x03d026 thru 0x03ffff (0x2fda bytes) 000070 1784341900.741542 write 0x00e774 thru 0x017159 (0x89e6 bytes) 000071 1784341900.742382 punch from 0x033d4b to 0x03f315 (0xb5cb bytes) 000072 1784341900.745873 MIRROR_RESYNC 2 mirrors 000073 1784341900.916066 MIRROR_EXTEND to 3 mirrors 000074 1784341901.085860 read 0x034db5 thru 0x037e17 (0x3063 bytes) 000075 1784341901.087961 trunc from 0x040000 to 0x0394b4 (0x6b4b bytes) 000076 1784341901.099006 mapwrite 0x00811e thru 0x01610b (0xdfee bytes) 000077 1784341901.117071 MIRROR_RESYNC 3 mirrors 000079 1784341901.316187 mapread 0x01fed5 thru 0x021a9e (0x1bca bytes) 000080 1784341901.321925 punch from 0x02cf91 to 0x031869 (0x48d9 bytes) 000081 1784341901.331942 read 0x0080d9 thru 0x00c6f7 (0x461f bytes) 000082 1784341901.336024 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x394b5): Mirror 3: 0xc7d71c38 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x394b5): Mirror 3: 0xc7d71c38 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x394b5: skipped 000083 1784341901.405444 punch from 0x009d7b to 0x010d6c (0x6ff2 bytes) 000084 1784341901.407388 fallocate 0x03b6d2 thru 0x03ffff (0x492e bytes) 000085 1784341901.410394 MIRROR_RESYNC 2 mirrors 000086 1784341901.573598 mapwrite 0x013573 thru 0x020585 (0xd013 bytes) 000087 1784341901.610343 punch from 0x001027 to 0x00cdea (0xbdc4 bytes) 000088 1784341901.612379 mapread 0x016b56 thru 0x017638 (0xae3 bytes) 000089 1784341901.613299 fallocate 0x0216db thru 0x0260a3 (0x49c9 bytes) 000090 1784341901.615547 write 0x035820 thru 0x0392ed (0x3ace bytes) 000091 1784341901.619984 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) 000092 1784341901.657569 write 0x0100dd thru 0x01638f (0x62b3 bytes) 000093 1784341901.661951 mapread 0x025f33 thru 0x02bd5c (0x5e2a bytes) 000094 1784341901.667724 read 0x02a2d5 thru 0x02ee7b (0x4ba7 bytes) 000095 1784341901.668423 trunc from 0x032ede to 0x0394b4 (0x65d7 bytes) 000096 1784341901.670223 trunc from 0x0394b5 to 0x01062b (0x28e89 bytes) 000098 1784341901.680045 mapwrite 0x015d25 thru 0x01c516 (0x67f2 bytes) 000099 1784341901.693198 trunc from 0x01105b to 0x01933c (0x82e2 bytes) 000100 1784341901.695391 mapread 0x00d202 thru 0x01c3db (0xf1da bytes) 000101 1784341901.700745 punch from 0x016c89 to 0x01c516 (0x588e bytes) 000102 1784341901.702670 trunc from 0x01c517 to 0x037c65 (0x1b74f bytes) 000103 1784341901.707484 mapread 0x015e29 thru 0x025ced (0xfec5 bytes) 000104 1784341901.713316 mapwrite 0x01285c thru 0x019686 (0x6e2b bytes) 000106 1784341901.720922 mapwrite 0x038ea0 thru 0x03bc6b (0x2dcc bytes) 000107 1784341901.733732 fallocate 0x005226 thru 0x009de3 (0x4bbe bytes) 000108 1784341901.735910 write 0x03a71b thru 0x03ffff (0x58e5 bytes) 000109 1784341901.736929 mapwrite 0x026685 thru 0x02a78a (0x4106 bytes) 000110 1784341901.747148 MIRROR_EXTEND to 2 mirrors 000111 1784341901.937035 trunc from 0x02f39a to 0x03ed48 (0xf9af bytes) 000112 1784341901.947900 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa149c98f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x43502118 Mirror 3: 0x43502118 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000114 1784341902.207383 mapread 0x0256ce thru 0x02fdd2 (0xa705 bytes) 000115 1784341902.217548 mapwrite 0x01cf64 thru 0x02324d (0x62ea bytes) 000116 1784341902.250458 mapread 0x00f4ce thru 0x00fc1d (0x750 bytes) 000117 1784341902.253191 read 0x00884c thru 0x00b504 (0x2cb9 bytes) 000118 1784341902.253629 mapread 0x00da6f thru 0x0123e3 (0x4975 bytes) 000119 1784341902.254382 write 0x016e3d thru 0x01c647 (0x580b bytes) 000120 1784341902.257573 MIRROR_RESYNC 3 mirrors 000121 1784341902.484077 trunc from 0x040000 to 0x01f68e (0x20971 bytes) 000122 1784341902.501569 mapwrite 0x013df0 thru 0x02376f (0xf980 bytes) 000123 1784341902.524120 fallocate 0x0319c2 thru 0x0351d3 (0x3812 bytes) 000124 1784341902.529290 mapread 0x02d662 thru 0x033918 (0x62b7 bytes) 000125 1784341902.533040 read 0x01c432 thru 0x02249d (0x606c bytes) 000128 1784341902.534434 trunc from 0x0351d4 to 0x01bd8a (0x19449 bytes) 000130 1784341902.540271 mapwrite 0x0319cb thru 0x035f9c (0x45d2 bytes) 000131 1784341902.555888 mapwrite 0x0063ea thru 0x008b45 (0x275c bytes) 000132 1784341902.563851 write 0x014681 thru 0x01ec65 (0xa5e5 bytes) 000133 1784341902.566370 read 0x017089 thru 0x0200f4 (0x906c bytes) 000134 1784341902.571007 MIRROR_RESYNC 3 mirrors 000135 1784341902.812633 mapread 0x0003b7 thru 0x00fa7d (0xf6c7 bytes) 000136 1784341902.819336 read 0x00a565 thru 0x018df2 (0xe88e bytes) 000137 1784341902.821712 mapread 0x032d01 thru 0x035f9c (0x329c bytes) 000138 1784341902.824487 trunc from 0x035f9d to 0x02b042 (0xaf5a bytes) 000139 1784341902.839414 punch from 0x0154f6 to 0x01f8b1 (0xa3bc bytes) 000140 1784341902.841048 read 0x00bb13 thru 0x00d170 (0x165e bytes) 000141 1784341902.844020 write 0x03ccc0 thru 0x03ffff (0x3340 bytes) 000142 1784341902.844742 mapwrite 0x02450d thru 0x0272eb (0x2ddf bytes) 000143 1784341902.849444 trunc from 0x02eb4e to 0x03cf9c (0xe44f bytes) 000144 1784341902.850938 trunc from 0x02bf9e to 0x038ac1 (0xcb24 bytes) 000145 1784341902.852265 write 0x012541 thru 0x017fa8 (0x5a68 bytes) 000146 1784341902.853115 punch from 0x017193 to 0x01c583 (0x53f1 bytes) 000147 1784341902.856543 read 0x038bb8 thru 0x03ffff (0x7448 bytes) 000150 1784341902.859758 read 0x029f7f thru 0x0369c1 (0xca43 bytes) 000151 1784341902.861431 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x153df315 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x153df315 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000152 1784341902.931145 MIRROR_RESYNC 2 mirrors 000153 1784341903.138329 fallocate 0x03c0b7 thru 0x03e4d4 (0x241e bytes) 000154 1784341903.147508 punch from 0x02dd7b to 0x039931 (0xbbb7 bytes) 000155 1784341903.149208 punch from 0x00cf79 to 0x01acc7 (0xdd4f bytes) 000156 1784341903.150725 punch from 0x0236fa to 0x02c822 (0x9129 bytes) 000157 1784341903.152253 trunc from 0x02597a to 0x03567b (0xfd02 bytes) 000158 1784341903.153866 trunc from 0x040000 to 0x035151 (0xaeae bytes) 000159 1784341903.159141 fallocate 0x00838d thru 0x00c499 (0x410d bytes) 000160 1784341903.161174 mapread 0x033688 thru 0x03495d (0x12d6 bytes) 000161 1784341903.164346 trunc from 0x035152 to 0x00569c (0x2fab5 bytes) 000162 1784341903.168338 mapread 0x0027b9 thru 0x00569c (0x2ee4 bytes) 000163 1784341903.170857 read 0x0037bc thru 0x00569c (0x1ee1 bytes) 000164 1784341903.171218 mapread 0x000f66 thru 0x005585 (0x4620 bytes) 000165 1784341903.173128 fallocate 0x028db5 thru 0x035090 (0xc2dc bytes) 000166 1784341903.174990 write 0x0187f2 thru 0x01b758 (0x2f67 bytes) 000167 1784341903.175980 read 0x0045ee thru 0x00e9c3 (0xa3d6 bytes) 000168 1784341903.178943 read 0x015ae1 thru 0x019be7 (0x4107 bytes) 000169 1784341903.179493 trunc from 0x01b759 to 0x00fa70 (0xbce8 bytes) 000170 1784341903.183911 trunc from 0x00fa71 to 0x00ffba (0x54a bytes) 000171 1784341903.187682 trunc from 0x00ffbb to 0x0136e4 (0x372a bytes) 000173 1784341903.192820 fallocate 0x015bcf thru 0x0207d6 (0xac08 bytes) 000175 1784341903.194988 punch from 0x00732d to 0x00e0ac (0x6d80 bytes) 000176 1784341903.196465 trunc from 0x010768 to 0x0177db (0x7074 bytes) 000177 1784341903.199550 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x207d7): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x207d7): Mirror 3: 0x42a4ba2f (stale) CRC-32 checksum value for chunk [0, 0x207d7): Mirror 1: 0x2edd8bd0 Mirror 4: 0x2edd8bd0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x207d7: skipped 000178 1784341903.411450 punch from 0x000909 to 0x00b2c8 (0xa9c0 bytes) 000179 1784341903.422243 fallocate 0x02e5df thru 0x036782 (0x81a4 bytes) 000180 1784341903.424228 trunc from 0x0207d7 to 0x022304 (0x1b2e bytes) 000182 1784341903.435210 mapwrite 0x000868 thru 0x0057e7 (0x4f80 bytes) 000183 1784341903.448656 trunc from 0x00ebab to 0x011737 (0x2b8d bytes) 000184 1784341903.450501 trunc from 0x022305 to 0x014396 (0xdf6e bytes) 000185 1784341903.454472 mapwrite 0x013983 thru 0x022d69 (0xf3e7 bytes) 000186 1784341903.472055 mapread 0x0051fd thru 0x00ec81 (0x9a85 bytes) 000187 1784341903.472880 mapwrite 0x023fdc thru 0x024195 (0x1ba bytes) 000188 1784341903.484111 trunc from 0x00faf4 to 0x01ac22 (0xb12f bytes) 000189 1784341903.486152 punch from 0x022d8c to 0x024195 (0x140a bytes) 000190 1784341903.488053 fallocate 0x030d1b thru 0x0379ef (0x6cd5 bytes) 000191 1784341903.490377 trunc from 0x024196 to 0x027df6 (0x3c61 bytes) 000192 1784341903.495666 read 0x016bcb thru 0x0225b2 (0xb9e8 bytes) 000193 1784341903.501312 write 0x02b87f thru 0x02e20b (0x298d bytes) 000194 1784341903.502179 trunc from 0x02dfb4 to 0x02e20b (0x258 bytes) 000196 1784341903.506377 trunc from 0x010755 to 0x011677 (0xf23 bytes) 000197 1784341903.508303 write 0x03f071 thru 0x03ffff (0xf8f bytes) 000198 1784341903.509315 read 0x01b560 thru 0x0242b2 (0x8d53 bytes) 000199 1784341903.513001 fallocate 0x00daad thru 0x016669 (0x8bbd bytes) 000200 1784341903.515071 trunc from 0x0218b2 to 0x02ca1e (0xb16d bytes) 000201 1784341903.517136 mapwrite 0x009a75 thru 0x01192e (0x7eba bytes) 000202 1784341903.526335 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x6e2edcc4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x6e2edcc4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000203 1784341903.606352 read 0x02abc7 thru 0x02bd14 (0x114e bytes) 000204 1784341903.609501 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x6e2edcc4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9455cc98 Mirror 4: 0x9455cc98 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000206 1784341903.835491 mapread 0x02344f thru 0x02ad39 (0x78eb bytes) 000207 1784341903.844585 trunc from 0x02df3a to 0x036210 (0x82d7 bytes) 000208 1784341903.855302 mapread 0x02d1ac thru 0x0375f6 (0xa44b bytes) 000210 1784341903.861082 write 0x020767 thru 0x02bbca (0xb464 bytes) 000211 1784341903.864309 punch from 0x03344f to 0x03aa34 (0x75e6 bytes) 000212 1784341903.866155 write 0x001f50 thru 0x008698 (0x6749 bytes) 000213 1784341903.869682 mapwrite 0x0282e0 thru 0x034502 (0xc223 bytes) 000214 1784341903.879376 trunc from 0x040000 to 0x02ebbb (0x11444 bytes) 000215 1784341903.890154 mapread 0x00d774 thru 0x015778 (0x8005 bytes) 000216 1784341903.893225 mapread 0x002443 thru 0x00fdee (0xd9ac bytes) 000217 1784341903.894142 read 0x02898b thru 0x02b5a4 (0x2c1a bytes) 000219 1784341903.894968 mapread 0x018e24 thru 0x024ca2 (0xbe7f bytes) 000220 1784341903.897810 punch from 0x02ad0b to 0x02ebbb (0x3eb1 bytes) 000221 1784341903.899643 write 0x020430 thru 0x0288fb (0x84cc bytes) 000222 1784341903.900905 mapwrite 0x0082e3 thru 0x0141c0 (0xbede bytes) 000223 1784341903.908956 fallocate 0x03ddd9 thru 0x03ffff (0x2227 bytes) 000224 1784341903.910758 punch from 0x0384d3 to 0x03cccc (0x47fa bytes) 000225 1784341903.912357 write 0x020358 thru 0x02ba5f (0xb708 bytes) 000226 1784341903.914725 trunc from 0x03711e to 0x037cea (0xbcd bytes) 000227 1784341903.916676 read 0x00f3f0 thru 0x01c6e8 (0xd2f9 bytes) 000229 1784341903.917529 trunc from 0x0294f7 to 0x031e6a (0x8974 bytes) 000230 1784341903.922374 write 0x03ed9e thru 0x03ffff (0x1262 bytes) 000232 1784341903.926325 read 0x024c9b thru 0x027bd4 (0x2f3a bytes) 000234 1784341903.927119 write 0x028ce8 thru 0x02ab5f (0x1e78 bytes) 000235 1784341903.929456 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9455cc98 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9455cc98 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000237 1784341904.007327 punch from 0x00a346 to 0x015ed1 (0xbb8c bytes) 000238 1784341904.009146 trunc from 0x00576b to 0x012959 (0xd1ef bytes) 000239 1784341904.010725 trunc from 0x0016aa to 0x008d75 (0x76cc bytes) 000240 1784341904.012549 punch from 0x0342a7 to 0x03ec51 (0xa9ab bytes) 000242 1784341904.014771 trunc from 0x03124f to 0x034d5a (0x3b0c bytes) 000243 1784341904.016345 write 0x03195b thru 0x035f8f (0x4635 bytes) 000244 1784341904.021598 MIRROR_RESYNC 2 mirrors 000245 1784341904.215148 MIRROR_RESYNC 2 mirrors 000246 1784341904.320858 punch from 0x00df1e to 0x01807f (0xa162 bytes) 000247 1784341904.329928 fallocate 0x0168a2 thru 0x01fab0 (0x920f bytes) 000248 1784341904.332175 mapwrite 0x03791e thru 0x039ac6 (0x21a9 bytes) 000249 1784341904.342847 MIRROR_RESYNC 2 mirrors 000250 1784341904.519637 mapread 0x02dc6d thru 0x02fd40 (0x20d4 bytes) 000251 1784341904.524475 mapwrite 0x016fad thru 0x0190c9 (0x211d bytes) 000252 1784341904.552739 write 0x0215cb thru 0x029517 (0x7f4d bytes) 000253 1784341904.555943 mapwrite 0x008706 thru 0x016bd1 (0xe4cc bytes) 000254 1784341904.566477 punch from 0x03fd4e to 0x03ffff (0x2b2 bytes) 000255 1784341904.568101 read 0x02f426 thru 0x03092c (0x1507 bytes) 000256 1784341904.570048 write 0x03d280 thru 0x03ffff (0x2d80 bytes) 000257 1784341904.571933 mapwrite 0x02f175 thru 0x03e06f (0xeefb bytes) 000258 1784341904.583045 punch from 0x02437d to 0x02f2d3 (0xaf57 bytes) 000260 1784341904.585376 trunc from 0x040000 to 0x01a2be (0x25d41 bytes) 000261 1784341904.596446 mapwrite 0x03d3e2 thru 0x03e4d3 (0x10f2 bytes) 000262 1784341904.608842 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e4d4): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e4d4): Mirror 4: 0xf4ae054 (stale) CRC-32 checksum value for chunk [0, 0x3e4d4): Mirror 1: 0x92e4d639 Mirror 5: 0x92e4d639 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e4d4: skipped 000263 1784341904.818897 mapwrite 0x024e39 thru 0x029f5c (0x5124 bytes) 000264 1784341904.854431 punch from 0x002dd5 to 0x00e5b7 (0xb7e3 bytes) 000265 1784341904.856286 read 0x0379c7 thru 0x03e4d3 (0x6b0d bytes) 000267 1784341904.859088 fallocate 0x00a693 thru 0x01265a (0x7fc8 bytes) 000268 1784341904.860885 mapwrite 0x031f85 thru 0x0331b9 (0x1235 bytes) 000269 1784341904.867247 write 0x00c7ee thru 0x0122f5 (0x5b08 bytes) 000270 1784341904.871482 fallocate 0x024522 thru 0x029872 (0x5351 bytes) 000271 1784341904.873764 mapwrite 0x02f5e7 thru 0x0357d6 (0x61f0 bytes) 000272 1784341904.880941 write 0x002306 thru 0x005484 (0x317f bytes) 000273 1784341904.884255 mapread 0x02600b thru 0x02fc99 (0x9c8f bytes) 000274 1784341904.885100 trunc from 0x018cd2 to 0x0195b0 (0x8df bytes) 000275 1784341904.887172 mapwrite 0x0337be thru 0x03ffff (0xc842 bytes) 000276 1784341904.908037 read 0x001f05 thru 0x011a50 (0xfb4c bytes) 000277 1784341904.911250 fallocate 0x026f28 thru 0x02d0c8 (0x61a1 bytes) 000278 1784341904.913413 trunc from 0x003855 to 0x004675 (0xe21 bytes) 000279 1784341904.914992 fallocate 0x01283e thru 0x01d6b4 (0xae77 bytes) 000280 1784341904.916500 mapread 0x028974 thru 0x02a82d (0x1eba bytes) 000281 1784341904.917168 punch from 0x032e7e to 0x03ffff (0xd182 bytes) 000282 1784341904.919084 mapread 0x026a5f thru 0x034500 (0xdaa2 bytes) 000283 1784341904.923293 fallocate 0x0051ec thru 0x009dda (0x4bef bytes) 000284 1784341904.925455 write 0x00b92a thru 0x01848f (0xcb66 bytes) 000285 1784341904.928480 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xb8f5c350 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xb8f5c350 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000286 1784341905.007510 fallocate 0x001270 thru 0x001ba9 (0x93a bytes) 000287 1784341905.009298 fallocate 0x039318 thru 0x03ffff (0x6ce8 bytes) 000289 1784341905.011533 read 0x029e03 thru 0x039153 (0xf351 bytes) 000290 1784341905.015151 write 0x01d469 thru 0x027e0f (0xa9a7 bytes) 000291 1784341905.020228 trunc from 0x040000 to 0x03606d (0x9f92 bytes) 000292 1784341905.026059 punch from 0x011c34 to 0x0156e7 (0x3ab4 bytes) 000294 1784341905.028382 trunc from 0x03606e to 0x01efde (0x1708f bytes) 000295 1784341905.034512 MIRROR_RESYNC 2 mirrors 000296 1784341905.205447 write 0x03c048 thru 0x03ffff (0x3fb8 bytes) 000297 1784341905.214036 read 0x02229c thru 0x02b1d1 (0x8f36 bytes) 000298 1784341905.216556 mapread 0x03da9d thru 0x03ffff (0x2563 bytes) 000299 1784341905.217231 trunc from 0x040000 to 0x00d13f (0x32ec0 bytes) 000300 1784341905.227273 write 0x0357c6 thru 0x038841 (0x307c bytes) 000301 1784341905.228173 mapread 0x034fa3 thru 0x038841 (0x389f bytes) 000302 1784341905.232002 MIRROR_RESYNC 2 mirrors 000303 1784341905.395670 punch from 0x030f7a to 0x038841 (0x78c8 bytes) 000304 1784341905.404528 trunc from 0x0297d9 to 0x02f7a9 (0x5fd1 bytes) 000305 1784341905.406220 mapread 0x0003da thru 0x00575e (0x5385 bytes) 000306 1784341905.412544 mapread 0x0048e6 thru 0x005628 (0xd43 bytes) 000307 1784341905.413360 punch from 0x006d9e to 0x008fe9 (0x224c bytes) 000308 1784341905.415322 mapread 0x015d9b thru 0x01b8ed (0x5b53 bytes) 000309 1784341905.418423 mapread 0x018c9d thru 0x023fd2 (0xb336 bytes) 000311 1784341905.421882 mapread 0x02378a thru 0x02d3aa (0x9c21 bytes) 000312 1784341905.424699 mapwrite 0x005025 thru 0x0064c9 (0x14a5 bytes) 000313 1784341905.430491 mapread 0x00eeaa thru 0x01069f (0x17f6 bytes) 000314 1784341905.431231 fallocate 0x0028a6 thru 0x007d02 (0x545d bytes) 000315 1784341905.433169 trunc from 0x038842 to 0x0396c3 (0xe82 bytes) 000316 1784341905.443235 trunc from 0x0396c4 to 0x01d53e (0x1c185 bytes) 000317 1784341905.447658 mapwrite 0x022a06 thru 0x0299a8 (0x6fa3 bytes) 000319 1784341905.460272 fallocate 0x02bf3a thru 0x03bf14 (0xffdb bytes) 000320 1784341905.462154 trunc from 0x03bf15 to 0x0243bc (0x17b58 bytes) 000321 1784341905.466946 fallocate 0x031494 thru 0x0390bc (0x7c29 bytes) 000322 1784341905.468957 punch from 0x012e69 to 0x01c303 (0x949b bytes) 000323 1784341905.470631 read 0x01a200 thru 0x01eb31 (0x4932 bytes) 000324 1784341905.472782 fallocate 0x02ecfa thru 0x031c0d (0x2f14 bytes) 000325 1784341905.474609 mapread 0x02ff8a thru 0x031c0d (0x1c84 bytes) 000326 1784341905.477351 mapread 0x00d768 thru 0x00ed5d (0x15f6 bytes) 000327 1784341905.478017 trunc from 0x017bd4 to 0x01e685 (0x6ab2 bytes) 000328 1784341905.479755 trunc from 0x0062a9 to 0x00c0ad (0x5e05 bytes) 000330 1784341905.482233 read 0x029a58 thru 0x02d3bf (0x3968 bytes) 000331 1784341905.482930 trunc from 0x01cda0 to 0x021ebe (0x511f bytes) 000332 1784341905.484859 trunc from 0x031c0e to 0x01538c (0x1c881 bytes) 000333 1784341905.489654 punch from 0x005a4d to 0x008d39 (0x32ed bytes) 000334 1784341905.491308 punch from 0x009223 to 0x011bbe (0x899c bytes) 000335 1784341905.493087 write 0x02e2de thru 0x039f56 (0xbc79 bytes) 000336 1784341905.494574 punch from 0x028632 to 0x02a5d4 (0x1fa3 bytes) 000337 1784341905.496176 punch from 0x02c78a to 0x03294f (0x61c6 bytes) 000338 1784341905.500044 fallocate 0x016243 thru 0x020498 (0xa256 bytes) 000340 1784341905.503985 MIRROR_RESYNC 2 mirrors 000341 1784341905.640170 trunc from 0x01d277 to 0x025540 (0x82ca bytes) 000342 1784341905.649993 write 0x021884 thru 0x02dbad (0xc32a bytes) 000343 1784341905.653792 read 0x009460 thru 0x01936c (0xff0d bytes) 000344 1784341905.657317 trunc from 0x000163 to 0x0091cc (0x906a bytes) 000345 1784341905.659552 trunc from 0x039f57 to 0x013b64 (0x263f2 bytes) 000346 1784341905.670884 punch from 0x00ac3b to 0x013b64 (0x8f2a bytes) 000347 1784341905.673215 fallocate 0x00671b thru 0x009297 (0x2b7d bytes) 000348 1784341905.675249 write 0x00ae26 thru 0x01524a (0xa425 bytes) 000349 1784341905.677860 mapwrite 0x002fed thru 0x012c23 (0xfc37 bytes) 000350 1784341905.692086 fallocate 0x0006d0 thru 0x00a6e6 (0xa017 bytes) 000351 1784341905.694291 fallocate 0x0150b6 thru 0x01693e (0x1889 bytes) 000352 1784341905.696534 mapwrite 0x0132d5 thru 0x01c2ac (0x8fd8 bytes) 000353 1784341905.710022 mapread 0x003c72 thru 0x011359 (0xd6e8 bytes) 000354 1784341905.710956 fallocate 0x03e5d1 thru 0x03ffff (0x1a2f bytes) 000355 1784341905.713127 fallocate 0x02575c thru 0x0344e3 (0xed88 bytes) 000356 1784341905.715124 punch from 0x002269 to 0x004ca3 (0x2a3b bytes) 000357 1784341905.717360 trunc from 0x01c2ad to 0x009730 (0x12b7c bytes) 000358 1784341905.722253 mapwrite 0x01cedf thru 0x025cab (0x8dcd bytes) 000359 1784341905.739150 write 0x00537d thru 0x00e6c4 (0x9348 bytes) 000360 1784341905.743662 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) 000361 1784341905.785991 read 0x011249 thru 0x01c9a7 (0xb75f bytes) 000362 1784341905.789370 mapwrite 0x004925 thru 0x00d40c (0x8ae8 bytes) 000365 1784341905.803308 punch from 0x0043d5 to 0x01403a (0xfc66 bytes) 000366 1784341905.805739 write 0x03eafb thru 0x03ffff (0x1505 bytes) 000367 1784341905.808156 mapwrite 0x024593 thru 0x02a66f (0x60dd bytes) 000368 1784341905.818178 write 0x00c388 thru 0x01b0fc (0xed75 bytes) 000369 1784341905.821435 trunc from 0x040000 to 0x01155e (0x2eaa1 bytes) 000370 1784341905.826475 mapread 0x003fbc thru 0x006baa (0x2bef bytes) 000371 1784341905.830097 mapread 0x0017c7 thru 0x00d3dc (0xbc16 bytes) 000374 1784341905.832107 fallocate 0x021d3a thru 0x02e7a1 (0xca68 bytes) 000375 1784341905.834207 trunc from 0x02610d to 0x02e7a1 (0x8695 bytes) 000377 1784341905.836687 trunc from 0x001cfe to 0x00a9b9 (0x8cbc bytes) 000378 1784341905.838684 fallocate 0x009f22 thru 0x010c9f (0x6d7e bytes) 000379 1784341905.840569 fallocate 0x02bea1 thru 0x034376 (0x84d6 bytes) 000380 1784341905.842162 trunc from 0x02e7a2 to 0x03c500 (0xdd5f bytes) 000381 1784341905.846234 fallocate 0x01375c thru 0x01f19b (0xba40 bytes) 000384 1784341905.849643 punch from 0x03741d to 0x03b2a7 (0x3e8b bytes) 000385 1784341905.851293 mapread 0x0396e5 thru 0x03c500 (0x2e1c bytes) 000386 1784341905.854382 mapread 0x002bb7 thru 0x00e39c (0xb7e6 bytes) 000387 1784341905.857686 mapwrite 0x030100 thru 0x0366c8 (0x65c9 bytes) 000388 1784341905.865961 trunc from 0x018180 to 0x021e02 (0x9c83 bytes) 000390 1784341905.868424 fallocate 0x02e767 thru 0x03ad56 (0xc5f0 bytes) 000391 1784341905.870170 write 0x0388ed thru 0x03ffff (0x7713 bytes) 000392 1784341905.871053 trunc from 0x0164f4 to 0x0232c1 (0xcdce bytes) 000394 1784341905.873347 mapwrite 0x012e5c thru 0x0161d2 (0x3377 bytes) 000395 1784341905.880892 mapread 0x01b665 thru 0x024450 (0x8dec bytes) 000396 1784341905.885820 punch from 0x015ab7 to 0x0198b3 (0x3dfd bytes) 000397 1784341905.887518 write 0x023518 thru 0x02e477 (0xaf60 bytes) 000399 1784341905.888771 write 0x00b028 thru 0x013ef3 (0x8ecc bytes) 000400 1784341905.889531 fallocate 0x0316b0 thru 0x03fbe0 (0xe531 bytes) 000401 1784341905.891411 read 0x03f93a thru 0x03fa60 (0x127 bytes) 000402 1784341905.891860 mapread 0x01eaac thru 0x023970 (0x4ec5 bytes) 000403 1784341905.892471 write 0x02896a thru 0x032e00 (0xa497 bytes) 000404 1784341905.893495 read 0x0388c2 thru 0x03ffff (0x773e bytes) 000405 1784341905.893978 fallocate 0x016825 thru 0x019009 (0x27e5 bytes) 000406 1784341905.896053 write 0x008f47 thru 0x00db0b (0x4bc5 bytes) 000407 1784341905.896783 trunc from 0x040000 to 0x02fafa (0x10505 bytes) 000408 1784341905.901434 mapwrite 0x01f1c3 thru 0x01f9ad (0x7eb bytes) 000409 1784341905.906747 read 0x00e007 thru 0x018a14 (0xaa0e bytes) 000410 1784341905.909438 read 0x014417 thru 0x023671 (0xf25b bytes) 000411 1784341905.910061 mapread 0x013cdf thru 0x018f60 (0x5282 bytes) 000413 1784341905.911139 punch from 0x00fabb to 0x0198c6 (0x9e0c bytes) 000414 1784341905.913068 write 0x02c7ee thru 0x03b680 (0xee93 bytes) 000415 1784341905.914356 read 0x01e412 thru 0x01fe2c (0x1a1b bytes) 000416 1784341905.914836 punch from 0x035636 to 0x0372ad (0x1c78 bytes) 000417 1784341905.919348 read 0x037600 thru 0x03b680 (0x4081 bytes) 000418 1784341905.922386 write 0x034075 thru 0x035b46 (0x1ad2 bytes) 000419 1784341905.923077 trunc from 0x03b681 to 0x01d0fe (0x1e582 bytes) 000420 1784341905.927491 mapread 0x01340b thru 0x01a9d2 (0x75c8 bytes) 000421 1784341905.929443 MIRROR_EXTEND to 2 mirrors 000422 1784341906.092294 trunc from 0x01d0ff to 0x01bfa1 (0x115d bytes) 000423 1784341906.104325 read 0x015cf4 thru 0x01bfa1 (0x62ae bytes) 000424 1784341906.107093 read 0x00f5d3 thru 0x01b11b (0xbb49 bytes) 000425 1784341906.109973 mapwrite 0x026b1c thru 0x02f407 (0x88ec bytes) 000426 1784341906.124891 read 0x00b225 thru 0x00ca4d (0x1829 bytes) 000428 1784341906.125860 trunc from 0x01ce46 to 0x025de9 (0x8fa4 bytes) 000429 1784341906.127699 trunc from 0x02f408 to 0x01dabf (0x11948 bytes) 000430 1784341906.132222 mapwrite 0x003a1f thru 0x010acc (0xd0ae bytes) 000431 1784341906.140466 mapread 0x0182ae thru 0x01dabf (0x5812 bytes) 000433 1784341906.142896 write 0x032d77 thru 0x03ffff (0xd289 bytes) 000434 1784341906.144074 trunc from 0x03bf16 to 0x03ffff (0x40ea bytes) 000435 1784341906.148500 trunc from 0x02917e to 0x034ab9 (0xb93c bytes) 000436 1784341906.150348 trunc from 0x040000 to 0x003fc0 (0x3c03f bytes) 000437 1784341906.155181 write 0x03698b thru 0x03ffff (0x9675 bytes) 000438 1784341906.156303 mapread 0x009f4d thru 0x00ee30 (0x4ee4 bytes) 000439 1784341906.165655 mapwrite 0x03dfeb thru 0x03ffff (0x2015 bytes) 000440 1784341906.171696 mapread 0x037813 thru 0x03e413 (0x6c01 bytes) 000441 1784341906.174646 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf34c7791 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x582214a6 Mirror 3: 0x582214a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000442 1784341906.382172 punch from 0x029159 to 0x0316de (0x8586 bytes) 000443 1784341906.392235 read 0x024f73 thru 0x026b2b (0x1bb9 bytes) 000444 1784341906.394467 punch from 0x0306d6 to 0x0373b4 (0x6cdf bytes) 000447 1784341906.397113 mapwrite 0x03041b thru 0x03eeaa (0xea90 bytes) 000448 1784341906.412066 trunc from 0x040000 to 0x003d6a (0x3c295 bytes) 000449 1784341906.423220 fallocate 0x0342e8 thru 0x037b17 (0x3830 bytes) 000451 1784341906.425510 fallocate 0x012452 thru 0x01cb83 (0xa732 bytes) 000452 1784341906.427518 trunc from 0x037b18 to 0x00a86b (0x2d2ac bytes) 000453 1784341906.432052 read 0x005ac1 thru 0x00a74e (0x4c8e bytes) 000455 1784341906.435437 write 0x018938 thru 0x01cfd5 (0x469e bytes) 000456 1784341906.436516 punch from 0x019b2b to 0x01cfd5 (0x34ab bytes) 000457 1784341906.440686 punch from 0x013d9a to 0x01cfd5 (0x923c bytes) 000458 1784341906.442498 trunc from 0x012e28 to 0x01cfd5 (0xa1ae bytes) 000459 1784341906.444554 read 0x019ada thru 0x01cfd5 (0x34fc bytes) 000460 1784341906.447871 fallocate 0x00f221 thru 0x0153d1 (0x61b1 bytes) 000461 1784341906.449702 write 0x007efe thru 0x01735d (0xf460 bytes) 000462 1784341906.450722 read 0x01c5eb thru 0x01cb9b (0x5b1 bytes) 000464 1784341906.451725 mapread 0x005b1d thru 0x0103b1 (0xa895 bytes) 000465 1784341906.452589 read 0x00f727 thru 0x01999e (0xa278 bytes) 000466 1784341906.452989 mapread 0x018c23 thru 0x01cfd5 (0x43b3 bytes) 000467 1784341906.455103 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1cfd6): Mirror 2: 0x72101769 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cfd6): Mirror 2: 0x72101769 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cfd6: skipped 000468 1784341906.532927 read 0x01a8fb thru 0x01cfd5 (0x26db bytes) 000469 1784341906.534912 read 0x013761 thru 0x01a6a2 (0x6f42 bytes) 000470 1784341906.537818 mapwrite 0x021d74 thru 0x02fc83 (0xdf10 bytes) 000471 1784341906.552765 mapread 0x003e3a thru 0x013b60 (0xfd27 bytes) 000472 1784341906.553585 mapread 0x01784c thru 0x01a64d (0x2e02 bytes) 000473 1784341906.554214 fallocate 0x020c05 thru 0x02fe2a (0xf226 bytes) 000474 1784341906.556164 trunc from 0x0101e2 to 0x01759c (0x73bb bytes) 000475 1784341906.558210 punch from 0x01df06 to 0x026a8f (0x8b8a bytes) 000476 1784341906.559876 read 0x0006ba thru 0x00d427 (0xcd6e bytes) 000477 1784341906.560364 trunc from 0x02fe2b to 0x0227b8 (0xd672 bytes) 000478 1784341906.564566 write 0x017349 thru 0x01836e (0x1026 bytes) 000479 1784341906.567402 mapread 0x020714 thru 0x0227b8 (0x20a5 bytes) 000480 1784341906.568128 mapread 0x00087a thru 0x00b777 (0xaefe bytes) 000481 1784341906.568953 trunc from 0x0133d9 to 0x01cab4 (0x96dc bytes) 000483 1784341906.573312 mapread 0x01b9aa thru 0x01c8cf (0xf26 bytes) 000484 1784341906.577247 mapread 0x01d607 thru 0x0227b8 (0x51b2 bytes) 000485 1784341906.578028 read 0x001479 thru 0x005385 (0x3f0d bytes) 000486 1784341906.578395 read 0x022775 thru 0x0227b8 (0x44 bytes) 000487 1784341906.578770 mapread 0x006508 thru 0x00b709 (0x5202 bytes) 000488 1784341906.579359 write 0x01f6f4 thru 0x028ab7 (0x93c4 bytes) 000489 1784341906.580347 trunc from 0x00ac81 to 0x013265 (0x85e5 bytes) 000490 1784341906.582560 mapread 0x0030b9 thru 0x00faa5 (0xc9ed bytes) 000491 1784341906.586280 fallocate 0x02d87d thru 0x0399a2 (0xc126 bytes) 000492 1784341906.588272 fallocate 0x001ddd thru 0x00c443 (0xa667 bytes) 000493 1784341906.590188 punch from 0x00ce4e to 0x0180de (0xb291 bytes) 000494 1784341906.592033 trunc from 0x016016 to 0x01d872 (0x785d bytes) 000495 1784341906.594144 fallocate 0x0251b0 thru 0x03168b (0xc4dc bytes) 000496 1784341906.596043 trunc from 0x03964d to 0x0399a2 (0x356 bytes) 000497 1784341906.597934 mapwrite 0x0116c0 thru 0x01b64a (0x9f8b bytes) 000498 1784341906.622729 mapread 0x027294 thru 0x032fe2 (0xbd4f bytes) 000500 1784341906.624329 mapwrite 0x01608f thru 0x0210a4 (0xb016 bytes) 000501 1784341906.635069 mapread 0x00c7f8 thru 0x0181f0 (0xb9f9 bytes) 000502 1784341906.642388 read 0x029165 thru 0x02f503 (0x639f bytes) 000503 1784341906.642866 read 0x025d57 thru 0x0335e5 (0xd88f bytes) 000504 1784341906.643229 fallocate 0x00b12b thru 0x017ff6 (0xcecc bytes) 000505 1784341906.645430 fallocate 0x0230ff thru 0x02f2e4 (0xc1e6 bytes) 000507 1784341906.647986 mapread 0x035870 thru 0x0399a2 (0x4133 bytes) 000508 1784341906.648764 read 0x009750 thru 0x013b85 (0xa436 bytes) 000509 1784341906.649212 write 0x02fade thru 0x033d9b (0x42be bytes) 000510 1784341906.649976 read 0x018523 thru 0x01e0d8 (0x5bb6 bytes) 000511 1784341906.650334 write 0x02bd5e thru 0x031f27 (0x61ca bytes) 000513 1784341906.651856 write 0x039f34 thru 0x03b819 (0x18e6 bytes) 000514 1784341906.652873 fallocate 0x007349 thru 0x01635c (0xf014 bytes) 000515 1784341906.655284 write 0x0353ff thru 0x03ffff (0xac01 bytes) 000516 1784341906.656523 trunc from 0x040000 to 0x03d583 (0x2a7c bytes) 000517 1784341906.661359 punch from 0x033e59 to 0x03d583 (0x972b bytes) 000518 1784341906.666145 trunc from 0x03d584 to 0x030449 (0xd13a bytes) 000520 1784341906.671957 trunc from 0x002873 to 0x003bab (0x1339 bytes) 000521 1784341906.674356 read 0x028b5c thru 0x02fe8c (0x7331 bytes) 000522 1784341906.675114 mapread 0x015630 thru 0x01bca3 (0x6674 bytes) 000523 1784341906.676138 trunc from 0x03044a to 0x0289b0 (0x7a99 bytes) 000524 1784341906.681576 punch from 0x003765 to 0x0048eb (0x1187 bytes) 000525 1784341906.683907 punch from 0x01eb61 to 0x0289b0 (0x9e50 bytes) 000526 1784341906.686547 punch from 0x01184a to 0x01cb72 (0xb329 bytes) 000527 1784341906.688934 mapread 0x01b4ef thru 0x027cd8 (0xc7ea bytes) 000528 1784341906.693151 punch from 0x0246f5 to 0x0289b0 (0x42bc bytes) 000529 1784341906.695554 trunc from 0x00fbef to 0x01f02c (0xf43e bytes) 000530 1784341906.699832 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) 000532 1784341906.744292 mapread 0x019bd3 thru 0x0275af (0xd9dd bytes) 000533 1784341906.756300 punch from 0x00f49f to 0x0120cc (0x2c2e bytes) 000534 1784341906.758358 fallocate 0x00f2b3 thru 0x017c6e (0x89bc bytes) 000535 1784341906.760669 mapread 0x00cde2 thru 0x01315d (0x637c bytes) 000536 1784341906.764420 trunc from 0x019fe2 to 0x0284c0 (0xe4df bytes) 000537 1784341906.766957 punch from 0x005b64 to 0x008c24 (0x30c1 bytes) 000538 1784341906.769467 trunc from 0x0289b1 to 0x033eb3 (0xb503 bytes) 000539 1784341906.776430 punch from 0x006dac to 0x009ffd (0x3252 bytes) 000540 1784341906.778511 mapread 0x011689 thru 0x013ce6 (0x265e bytes) 000541 1784341906.779193 trunc from 0x033eb4 to 0x011a21 (0x22492 bytes) 000542 1784341906.785040 write 0x01e362 thru 0x01f253 (0xef2 bytes) 000543 1784341906.786009 write 0x017696 thru 0x026c6d (0xf5d8 bytes) 000544 1784341906.789028 fallocate 0x01de60 thru 0x020c6d (0x2e0e bytes) 000546 1784341906.791675 trunc from 0x026c6e to 0x016dde (0xfe8f bytes) 000547 1784341906.796698 fallocate 0x037811 thru 0x03ffff (0x87ef bytes) 000548 1784341906.798837 trunc from 0x004c8a to 0x00e7b3 (0x9b2a bytes) 000549 1784341906.800562 fallocate 0x00d90a thru 0x01d156 (0xf84d bytes) 000550 1784341906.802507 fallocate 0x00c4c2 thru 0x0198af (0xd3ee bytes) 000551 1784341906.804458 read 0x00160b thru 0x00268c (0x1082 bytes) 000552 1784341906.806548 mapread 0x009230 thru 0x016d9d (0xdb6e bytes) 000553 1784341906.811473 write 0x02cbb2 thru 0x0331a4 (0x65f3 bytes) 000554 1784341906.812460 fallocate 0x0343bb thru 0x038e34 (0x4a7a bytes) 000555 1784341906.814143 trunc from 0x038e35 to 0x03a9b8 (0x1b84 bytes) 000557 1784341906.821709 MIRROR_EXTEND to 2 mirrors 000560 1784341906.996582 punch from 0x0195ef to 0x01c2a8 (0x2cba bytes) 000561 1784341907.006392 trunc from 0x008f90 to 0x00cf5d (0x3fce bytes) 000562 1784341907.008053 trunc from 0x03a9b9 to 0x01f168 (0x1b850 bytes) 000563 1784341907.019541 trunc from 0x000d3f to 0x00ef1a (0xe1dc bytes) 000564 1784341907.021380 mapwrite 0x00a77f thru 0x01404a (0x98cc bytes) 000565 1784341907.034578 mapread 0x017be6 thru 0x01f168 (0x7583 bytes) 000566 1784341907.038596 mapwrite 0x00c0d0 thru 0x01204c (0x5f7d bytes) 000569 1784341907.046390 read 0x013618 thru 0x01be52 (0x883b bytes) 000570 1784341907.046919 punch from 0x01c713 to 0x01f168 (0x2a56 bytes) 000571 1784341907.049178 fallocate 0x01777e thru 0x01f567 (0x7dea bytes) 000572 1784341907.051444 write 0x00fcff thru 0x01f000 (0xf302 bytes) 000573 1784341907.054389 trunc from 0x01f568 to 0x02bc04 (0xc69d bytes) 000574 1784341907.059182 trunc from 0x02bc05 to 0x025137 (0x6acd bytes) 000575 1784341907.063451 read 0x003541 thru 0x00ab71 (0x7631 bytes) 000576 1784341907.067867 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x25138): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25138): Mirror 2: 0x8171c23b (stale) CRC-32 checksum value for chunk [0, 0x25138): Mirror 1: 0x1c5950c6 Mirror 3: 0x1c5950c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25138: skipped 000577 1784341907.285254 trunc from 0x025138 to 0x02947b (0x4344 bytes) 000578 1784341907.302645 write 0x02e219 thru 0x032fdf (0x4dc7 bytes) 000579 1784341907.303584 trunc from 0x0300be to 0x032fdf (0x2f22 bytes) 000580 1784341907.308255 trunc from 0x032fe0 to 0x00fc8f (0x23350 bytes) 000582 1784341907.315667 mapwrite 0x00744b thru 0x00a471 (0x3027 bytes) 000583 1784341907.327070 fallocate 0x035980 thru 0x03c846 (0x6ec7 bytes) 000585 1784341907.330194 trunc from 0x00fc90 to 0x0134b3 (0x3824 bytes) 000586 1784341907.335697 punch from 0x002299 to 0x0109e8 (0xe750 bytes) 000587 1784341907.338023 read 0x0024a9 thru 0x00a624 (0x817c bytes) 000588 1784341907.341106 trunc from 0x00a9ef to 0x0134b3 (0x8ac5 bytes) 000590 1784341907.343428 mapread 0x00e26e thru 0x0134b3 (0x5246 bytes) 000591 1784341907.349110 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x134b4): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x134b4): Mirror 2: 0xe3453999 (stale) Mirror 3: 0x7e48ebfe (stale) CRC-32 checksum value for chunk [0, 0x134b4): Mirror 1: 0xe3453999 Mirror 4: 0xe3453999 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x134b4: skipped 000592 1784341907.561660 punch from 0x00934c to 0x0134b3 (0xa168 bytes) 000593 1784341907.571694 trunc from 0x0134b4 to 0x0237d4 (0x10321 bytes) 000594 1784341907.581495 mapread 0x0119a5 thru 0x0205e2 (0xec3e bytes) 000595 1784341907.588749 mapread 0x00d825 thru 0x0118bd (0x4099 bytes) 000596 1784341907.590781 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x237d5): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x237d5): Mirror 2: 0xb4ccf7ad (stale) Mirror 3: 0x4118d597 (stale) Mirror 4: 0xb4ccf7ad (stale) CRC-32 checksum value for chunk [0, 0x237d5): Mirror 1: 0xb4ccf7ad Mirror 5: 0xb4ccf7ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x237d5: skipped 000597 1784341907.829609 punch from 0x00737d to 0x00b5c4 (0x4248 bytes) 000598 1784341907.840478 mapread 0x020575 thru 0x021b29 (0x15b5 bytes) 000599 1784341907.845409 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x237d5): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x237d5): Mirror 2: 0xb4ccf7ad (stale) Mirror 3: 0x4118d597 (stale) Mirror 4: 0xb4ccf7ad (stale) Mirror 5: 0xb4ccf7ad (stale) CRC-32 checksum value for chunk [0, 0x237d5): Mirror 1: 0xb4ccf7ad Mirror 6: 0xb4ccf7ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x237d5: skipped 000600 1784341908.097481 trunc from 0x0237d5 to 0x033a96 (0x102c2 bytes) 000601 1784341908.114203 fallocate 0x033deb thru 0x037f0f (0x4125 bytes) 000602 1784341908.116306 mapread 0x00f11e thru 0x01d486 (0xe369 bytes) 000603 1784341908.124691 trunc from 0x02195d to 0x0223d8 (0xa7c bytes) 000605 1784341908.127185 punch from 0x011156 to 0x013b90 (0x2a3b bytes) 000606 1784341908.128903 punch from 0x0284a2 to 0x033a96 (0xb5f5 bytes) 000607 1784341908.130586 trunc from 0x0129db to 0x0165ed (0x3c13 bytes) 000608 1784341908.132453 trunc from 0x033a97 to 0x01eb0e (0x14f88 bytes) 000609 1784341908.138665 trunc from 0x01eb0f to 0x008d1f (0x15def bytes) 000610 1784341908.145072 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x8d20): Mirror 2: 0x9b530872 (stale) Mirror 3: 0x9b530872 (stale) Mirror 4: 0x9b530872 (stale) Mirror 6: 0x9b530872 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8d20): Mirror 2: 0x9b530872 (stale) Mirror 3: 0x9b530872 (stale) Mirror 4: 0x9b530872 (stale) Mirror 6: 0x9b530872 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8d20: skipped 000611 1784341908.257461 mapread 0x00314f thru 0x006779 (0x362b bytes) 000612 1784341908.263200 punch from 0x0073c4 to 0x008d1f (0x195c bytes) 000613 1784341908.265161 fallocate 0x01c3d4 thru 0x01d5c2 (0x11ef bytes) 000614 1784341908.267272 mapwrite 0x0146d0 thru 0x023e3c (0xf76d bytes) 000615 1784341908.285852 trunc from 0x023e3d to 0x01c9b4 (0x7488 bytes) 000616 1784341908.291177 punch from 0x00989f to 0x00d8f2 (0x4054 bytes) 000617 1784341908.293581 trunc from 0x01c9b5 to 0x0396ed (0x1cd39 bytes) 000620 1784341908.299373 mapread 0x01726f thru 0x024f29 (0xdcbb bytes) 000622 1784341908.303783 punch from 0x003e70 to 0x00b850 (0x79e1 bytes) 000624 1784341908.308405 MIRROR_RESYNC 5 mirrors 000625 1784341908.595033 mapwrite 0x01205a thru 0x01aa92 (0x8a39 bytes) 000626 1784341908.628529 trunc from 0x0396ee to 0x01b836 (0x1deb7 bytes) 000627 1784341908.641245 mapwrite 0x00c82d thru 0x01b1c1 (0xe995 bytes) 000628 1784341908.650897 punch from 0x002a33 to 0x00cb51 (0xa11f bytes) 000629 1784341908.653414 mapwrite 0x01e44a thru 0x02837d (0x9f34 bytes) 000630 1784341908.671652 read 0x024256 thru 0x024f38 (0xce3 bytes) 000631 1784341908.672222 trunc from 0x02837e to 0x0198ef (0xea8e bytes) 000632 1784341908.678424 trunc from 0x009747 to 0x0098c2 (0x17c bytes) 000633 1784341908.680354 mapread 0x01218c thru 0x0198ef (0x7764 bytes) 000634 1784341908.681163 trunc from 0x0198f0 to 0x01d6af (0x3dc0 bytes) 000635 1784341908.686571 read 0x007a33 thru 0x015006 (0xd5d4 bytes) 000637 1784341908.690394 mapread 0x00b774 thru 0x012339 (0x6bc6 bytes) 000638 1784341908.691232 write 0x00ffc7 thru 0x01e0a4 (0xe0de bytes) 000639 1784341908.692749 read 0x003173 thru 0x00d546 (0xa3d4 bytes) 000640 1784341908.693431 read 0x006530 thru 0x0075b7 (0x1088 bytes) 000642 1784341908.694608 mapread 0x001059 thru 0x00858a (0x7532 bytes) 000643 1784341908.695262 mapread 0x01b4b9 thru 0x01e0a4 (0x2bec bytes) 000644 1784341908.695904 trunc from 0x00c825 to 0x018e99 (0xc675 bytes) 000645 1784341908.700856 mapread 0x003afa thru 0x00908f (0x5596 bytes) 000647 1784341908.702301 read 0x017e5b thru 0x019916 (0x1abc bytes) 000648 1784341908.706011 read 0x00057c thru 0x006681 (0x6106 bytes) 000649 1784341908.706595 mapwrite 0x00f23f thru 0x010911 (0x16d3 bytes) 000650 1784341908.712078 trunc from 0x0009bb to 0x0024b9 (0x1aff bytes) 000651 1784341908.715388 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e0a5): Mirror 2: 0x1541c326 (stale) Mirror 3: 0x1541c326 (stale) Mirror 6: 0x1541c326 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e0a5): Mirror 2: 0x1541c326 (stale) Mirror 3: 0x1541c326 (stale) Mirror 6: 0x1541c326 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e0a5: skipped 000652 1784341908.826053 mapread 0x00e7ad thru 0x013c45 (0x5499 bytes) 000653 1784341908.833786 punch from 0x00618c to 0x013670 (0xd4e5 bytes) 000654 1784341908.838352 mapwrite 0x01feb3 thru 0x02e5be (0xe70c bytes) 000655 1784341908.864444 trunc from 0x01be70 to 0x02b4df (0xf670 bytes) 000656 1784341908.866594 mapread 0x02c8e9 thru 0x02e5be (0x1cd6 bytes) 000657 1784341908.867365 trunc from 0x02e5bf to 0x0027e9 (0x2bdd5 bytes) 000658 1784341908.873132 mapread 0x001db9 thru 0x0027e9 (0xa31 bytes) 000659 1784341908.875906 trunc from 0x001dac to 0x0027e9 (0xa3e bytes) 000660 1784341908.877977 read 0x000121 thru 0x0027e9 (0x26c9 bytes) 000661 1784341908.880288 punch from 0x001026 to 0x0027e9 (0x17c4 bytes) 000662 1784341908.881950 read 0x0020ad thru 0x0027e9 (0x73d bytes) 000663 1784341908.883603 mapread 0x0012a4 thru 0x0027e9 (0x1546 bytes) 000664 1784341908.884330 mapread 0x00085c thru 0x0027e9 (0x1f8e bytes) 000665 1784341908.884971 write 0x015d9d thru 0x01d2f6 (0x755a bytes) 000666 1784341908.887379 MIRROR_RESYNC 4 mirrors 000667 1784341909.131201 punch from 0x01cb17 to 0x01d2f6 (0x7e0 bytes) 000668 1784341909.142428 punch from 0x018d07 to 0x01d2f6 (0x45f0 bytes) 000669 1784341909.144284 trunc from 0x01d2f7 to 0x022459 (0x5163 bytes) 000670 1784341909.151788 trunc from 0x02245a to 0x02c96f (0xa516 bytes) 000671 1784341909.159597 mapread 0x024d7c thru 0x02c96f (0x7bf4 bytes) 000672 1784341909.167769 mapwrite 0x037e09 thru 0x03cda6 (0x4f9e bytes) 000673 1784341909.184846 trunc from 0x023650 to 0x02b7ee (0x819f bytes) 000675 1784341909.187974 write 0x0288f9 thru 0x037417 (0xeb1f bytes) 000676 1784341909.190875 trunc from 0x03cda7 to 0x03b730 (0x1676 bytes) 000677 1784341909.197770 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b731): Mirror 2: 0x235e38cc (stale) Mirror 6: 0x235e38cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b731): Mirror 2: 0x235e38cc (stale) Mirror 6: 0x235e38cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b731: skipped 000678 1784341909.330227 MIRROR_RESYNC 3 mirrors 000679 1784341909.617217 write 0x02f409 thru 0x03479a (0x5392 bytes) 000680 1784341909.629635 trunc from 0x03b731 to 0x03f435 (0x3d05 bytes) 000681 1784341909.638680 read 0x00055a thru 0x004604 (0x40ab bytes) 000682 1784341909.642974 trunc from 0x03f436 to 0x024de9 (0x1a64c bytes) 000683 1784341909.649494 mapwrite 0x01888e thru 0x01ef73 (0x66e6 bytes) 000684 1784341909.663279 write 0x030f2f thru 0x03f1d4 (0xe2a6 bytes) 000685 1784341909.664717 mapread 0x00af7e thru 0x00daca (0x2b4d bytes) 000686 1784341909.668170 punch from 0x0044dd to 0x00dd93 (0x98b7 bytes) 000687 1784341909.670691 mapwrite 0x01dc63 thru 0x02a9db (0xcd79 bytes) 000688 1784341909.683152 mapwrite 0x01e263 thru 0x026c8f (0x8a2d bytes) 000689 1784341909.691320 write 0x036e3a thru 0x03ffff (0x91c6 bytes) 000690 1784341909.692363 fallocate 0x00ed5c thru 0x0126b1 (0x3956 bytes) 000691 1784341909.694776 trunc from 0x004eda to 0x01381f (0xe946 bytes) 000692 1784341909.697040 punch from 0x03821c to 0x03ffff (0x7de4 bytes) 000693 1784341909.701287 trunc from 0x040000 to 0x01b148 (0x24eb7 bytes) 000694 1784341909.706154 mapread 0x00fc9e thru 0x01b148 (0xb4ab bytes) 000695 1784341909.709720 fallocate 0x0095ed thru 0x00ef30 (0x5944 bytes) 000697 1784341909.712317 punch from 0x01341a to 0x019d0a (0x68f1 bytes) 000698 1784341909.716106 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1b149): Mirror 2: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b149): Mirror 2: 0x4b8a03bf (stale) Mirror 6: 0x4b8a03bf (stale) CRC-32 checksum value for chunk [0, 0x1b149): Mirror 1: 0x55f591cd Mirror 7: 0x55f591cd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b149: skipped 000699 1784341909.943731 trunc from 0x0022f8 to 0x00e0c0 (0xbdc9 bytes) 000700 1784341909.957874 punch from 0x0091c5 to 0x00a82e (0x166a bytes) 000701 1784341909.960076 trunc from 0x01b149 to 0x03ca58 (0x21910 bytes) 000702 1784341909.973326 read 0x016f3c thru 0x017904 (0x9c9 bytes) 000703 1784341909.975837 read 0x0172b2 thru 0x0243b5 (0xd104 bytes) 000704 1784341909.980019 fallocate 0x03287f thru 0x03b07e (0x8800 bytes) 000705 1784341909.982685 read 0x008418 thru 0x00a355 (0x1f3e bytes) 000706 1784341909.985401 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3ca59): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ca59): Mirror 2: 0xca414683 (stale) Mirror 6: 0xca414683 (stale) Mirror 7: 0xedbf7f5a (stale) CRC-32 checksum value for chunk [0, 0x3ca59): Mirror 1: 0xedbf7f5a Mirror 8: 0xedbf7f5a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ca59: skipped 000707 1784341910.238087 punch from 0x01f655 to 0x021c08 (0x25b4 bytes) 000708 1784341910.248922 mapread 0x02af69 thru 0x03015b (0x51f3 bytes) 000709 1784341910.255247 mapwrite 0x0005be thru 0x00de1f (0xd862 bytes) 000710 1784341910.266058 mapread 0x0113bc thru 0x01a950 (0x9595 bytes) 000711 1784341910.272273 mapwrite 0x011e46 thru 0x0213b0 (0xf56b bytes) 000712 1784341910.283581 mapread 0x0309af thru 0x0384aa (0x7afc bytes) 000713 1784341910.287451 trunc from 0x038036 to 0x03ca58 (0x4a23 bytes) 000714 1784341910.289444 read 0x00e092 thru 0x0174bb (0x942a bytes) 000715 1784341910.291650 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ca59): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ca59): Mirror 2: 0xca414683 (stale) Mirror 6: 0xca414683 (stale) Mirror 7: 0xedbf7f5a (stale) Mirror 8: 0xedbf7f5a (stale) CRC-32 checksum value for chunk [0, 0x3ca59): Mirror 1: 0xe21c4bd1 Mirror 9: 0xe21c4bd1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ca59: skipped 000716 1784341910.553255 trunc from 0x02bc14 to 0x02f0da (0x34c7 bytes) 000717 1784341910.564127 read 0x01d290 thru 0x029f09 (0xcc7a bytes) 000718 1784341910.567066 trunc from 0x03ca59 to 0x009957 (0x33101 bytes) 000719 1784341910.577541 write 0x0119e8 thru 0x02152b (0xfb44 bytes) 000720 1784341910.578764 punch from 0x003a03 to 0x00abb0 (0x71ae bytes) 000721 1784341910.580413 trunc from 0x02152c to 0x0188ef (0x8c3c bytes) 000722 1784341910.585302 mapread 0x016c9d thru 0x0188ef (0x1c53 bytes) 000723 1784341910.586295 trunc from 0x00b62a to 0x01409e (0x8a75 bytes) 000724 1784341910.590352 mapwrite 0x0222f1 thru 0x031413 (0xf123 bytes) 000725 1784341910.610127 read 0x00736b thru 0x016478 (0xf10e bytes) 000726 1784341910.613665 fallocate 0x0293c3 thru 0x03347f (0xa0bd bytes) 000727 1784341910.616056 trunc from 0x033480 to 0x013236 (0x20249 bytes) 000728 1784341910.621071 mapread 0x007103 thru 0x0075f3 (0x4f1 bytes) 000730 1784341910.622067 write 0x011140 thru 0x01122a (0xeb bytes) 000731 1784341910.623040 mapwrite 0x01a829 thru 0x02006f (0x5847 bytes) 000732 1784341910.646235 trunc from 0x020070 to 0x030d3b (0x10ccc bytes) 000733 1784341910.654070 MIRROR_RESYNC 6 mirrors 000734 1784341911.040169 trunc from 0x011b75 to 0x011fb3 (0x43f bytes) 000735 1784341911.050319 write 0x014679 thru 0x01a207 (0x5b8f bytes) 000736 1784341911.053710 trunc from 0x030d3c to 0x03f0ed (0xe3b2 bytes) 000737 1784341911.065424 punch from 0x03571f to 0x03f0ed (0x99cf bytes) 000738 1784341911.067306 mapwrite 0x03362a thru 0x03ffff (0xc9d6 bytes) 000739 1784341911.088594 mapwrite 0x014816 thru 0x02414f (0xf93a bytes) 000741 1784341911.103507 fallocate 0x009ee5 thru 0x00f588 (0x56a4 bytes) 000742 1784341911.105592 fallocate 0x037943 thru 0x03ed27 (0x73e5 bytes) 000743 1784341911.107591 punch from 0x01b752 to 0x01e716 (0x2fc5 bytes) 000744 1784341911.109521 mapread 0x03dc69 thru 0x03ffff (0x2397 bytes) 000745 1784341911.110250 mapwrite 0x029a30 thru 0x0327c4 (0x8d95 bytes) 000746 1784341911.120594 punch from 0x00ac62 to 0x015bbd (0xaf5c bytes) 000747 1784341911.122979 trunc from 0x034f75 to 0x0372eb (0x2377 bytes) 000748 1784341911.125057 fallocate 0x037850 thru 0x03ffff (0x87b0 bytes) 000749 1784341911.127083 trunc from 0x040000 to 0x005514 (0x3aaeb bytes) 000750 1784341911.132281 trunc from 0x00327d to 0x005514 (0x2298 bytes) 000751 1784341911.134179 mapwrite 0x01706f thru 0x018831 (0x17c3 bytes) 000752 1784341911.148369 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18832): Mirror 2: 0xed7f358 (stale) Mirror 6: 0xed7f358 (stale) Mirror 8: 0xed7f358 (stale) Mirror 9: 0xed7f358 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18832): Mirror 2: 0xed7f358 (stale) Mirror 6: 0xed7f358 (stale) Mirror 8: 0xed7f358 (stale) Mirror 9: 0xed7f358 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18832: skipped 000753 1784341911.261310 fallocate 0x00bc40 thru 0x00c2d6 (0x697 bytes) 000754 1784341911.265196 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18832): Mirror 2: 0xed7f358 (stale) Mirror 6: 0xed7f358 (stale) Mirror 9: 0xed7f358 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18832): Mirror 2: 0xed7f358 (stale) Mirror 6: 0xed7f358 (stale) Mirror 9: 0xed7f358 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18832: skipped 000755 1784341911.362397 trunc from 0x018832 to 0x000fe1 (0x17850 bytes) 000757 1784341911.368894 mapread 0x000b62 thru 0x000fe1 (0x480 bytes) 000758 1784341911.371255 punch from 0x00090c to 0x000fe1 (0x6d6 bytes) 000759 1784341911.372963 write 0x02fe10 thru 0x036ad0 (0x6cc1 bytes) 000760 1784341911.374329 write 0x0387d1 thru 0x03ffff (0x782f bytes) 000761 1784341911.375556 fallocate 0x007b7d thru 0x008483 (0x907 bytes) 000763 1784341911.378092 punch from 0x03d76a to 0x03ffff (0x2896 bytes) 000764 1784341911.382315 punch from 0x01c7d0 to 0x01da17 (0x1248 bytes) 000765 1784341911.384034 mapread 0x00c324 thru 0x015e86 (0x9b63 bytes) 000766 1784341911.390089 mapread 0x033754 thru 0x03de02 (0xa6af bytes) 000768 1784341911.393453 mapwrite 0x02e767 thru 0x0383ac (0x9c46 bytes) 000770 1784341911.404552 trunc from 0x040000 to 0x00fe3a (0x301c5 bytes) 000771 1784341911.409811 mapwrite 0x0001dc thru 0x0001ef (0x14 bytes) 000773 1784341911.417303 trunc from 0x003341 to 0x00dfdd (0xac9d bytes) 000774 1784341911.419461 trunc from 0x00fe3b to 0x00799f (0x849b bytes) 000775 1784341911.424140 trunc from 0x0079a0 to 0x01f66d (0x17cce bytes) 000776 1784341911.428346 trunc from 0x0199fd to 0x01ea04 (0x5008 bytes) 000777 1784341911.430183 trunc from 0x011ac1 to 0x015c3e (0x417e bytes) 000778 1784341911.431923 trunc from 0x01f66e to 0x02850f (0x8ea2 bytes) 000779 1784341911.435911 trunc from 0x01985c to 0x024bb7 (0xb35c bytes) 000780 1784341911.437600 trunc from 0x0013ba to 0x00e299 (0xcee0 bytes) 000781 1784341911.439290 trunc from 0x028510 to 0x027893 (0xc7c bytes) 000782 1784341911.443667 trunc from 0x027894 to 0x029e1d (0x258a bytes) 000783 1784341911.447760 trunc from 0x029e1e to 0x03656f (0xc752 bytes) 000784 1784341911.452401 punch from 0x019e4e to 0x01cc94 (0x2e47 bytes) 000785 1784341911.454263 mapread 0x001e73 thru 0x00c72a (0xa8b8 bytes) 000786 1784341911.459211 trunc from 0x036570 to 0x0338cb (0x2ca4 bytes) 000787 1784341911.463630 trunc from 0x00297d to 0x00f5ff (0xcc83 bytes) 000789 1784341911.466019 mapwrite 0x02070c thru 0x02c850 (0xc145 bytes) 000791 1784341911.479685 trunc from 0x020120 to 0x0248d2 (0x47b3 bytes) 000792 1784341911.481621 read 0x003670 thru 0x011b42 (0xe4d3 bytes) 000793 1784341911.486653 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x338cc): Mirror 2: 0x2a975cc9 (stale) Mirror 6: 0x2a975cc9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x338cc): Mirror 2: 0x2a975cc9 (stale) Mirror 6: 0x2a975cc9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x338cc: skipped 000795 1784341911.572508 mapwrite 0x0016cf thru 0x00c4f1 (0xae23 bytes) 000797 1784341911.585997 write 0x0246f7 thru 0x028a55 (0x435f bytes) 000798 1784341911.590433 write 0x00f28f thru 0x015764 (0x64d6 bytes) 000799 1784341911.593024 write 0x00e85b thru 0x013386 (0x4b2c bytes) 000801 1784341911.596669 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x338cc): Mirror 2: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x338cc): Mirror 2: 0x2a975cc9 (stale) Mirror 6: 0x2a975cc9 (stale) CRC-32 checksum value for chunk [0, 0x338cc): Mirror 1: 0x14b9a1f1 Mirror 7: 0x14b9a1f1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x338cc: skipped 000802 1784341911.838136 fallocate 0x016d5b thru 0x01ed5d (0x8003 bytes) 000804 1784341911.851674 fallocate 0x02c01d thru 0x02d1a5 (0x1189 bytes) 000805 1784341911.855320 MIRROR_RESYNC 4 mirrors 000806 1784341912.146921 read 0x02dd13 thru 0x0338cb (0x5bb9 bytes) 000807 1784341912.149537 mapwrite 0x032934 thru 0x03e36c (0xba39 bytes) 000808 1784341912.174100 mapread 0x0136b6 thru 0x01b17e (0x7ac9 bytes) 000809 1784341912.177692 read 0x02943c thru 0x02add5 (0x199a bytes) 000810 1784341912.181376 trunc from 0x006d56 to 0x0140be (0xd369 bytes) 000811 1784341912.183529 mapwrite 0x002016 thru 0x002309 (0x2f4 bytes) 000813 1784341912.188259 write 0x015499 thru 0x01c4d1 (0x7039 bytes) 000814 1784341912.189262 write 0x023d93 thru 0x02544e (0x16bc bytes) 000815 1784341912.190064 mapwrite 0x039d8b thru 0x03ffff (0x6275 bytes) 000816 1784341912.205677 mapread 0x03c78e thru 0x03ffff (0x3872 bytes) 000817 1784341912.206609 fallocate 0x00bf8c thru 0x0135d1 (0x7646 bytes) 000818 1784341912.209035 write 0x0191ca thru 0x0289bb (0xf7f2 bytes) 000819 1784341912.210225 fallocate 0x01a6f0 thru 0x0296bf (0xefd0 bytes) 000820 1784341912.214451 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5cbab945 (stale) Mirror 6: 0x5cbab945 (stale) Mirror 7: 0x5cbab945 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa7c4a45a Mirror 8: 0xa7c4a45a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000821 1784341912.465057 mapread 0x0131fd thru 0x018d11 (0x5b15 bytes) 000822 1784341912.470764 read 0x016b2f thru 0x01e92e (0x7e00 bytes) 000823 1784341912.472579 punch from 0x0231a3 to 0x02bef8 (0x8d56 bytes) 000824 1784341912.483934 trunc from 0x03f30c to 0x03ffff (0xcf4 bytes) 000825 1784341912.485775 fallocate 0x0380b5 thru 0x0398e3 (0x182f bytes) 000826 1784341912.489505 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5cbab945 (stale) Mirror 7: 0x5cbab945 (stale) Mirror 8: 0xa7c4a45a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5cbab945 (stale) Mirror 7: 0x5cbab945 (stale) Mirror 8: 0xa7c4a45a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000827 1784341912.591944 trunc from 0x0113e5 to 0x0116a2 (0x2be bytes) 000828 1784341912.593716 trunc from 0x040000 to 0x02b0fc (0x14f03 bytes) 000829 1784341912.605057 read 0x018a00 thru 0x018ac4 (0xc5 bytes) 000831 1784341912.609784 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2b0fd): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b0fd): Mirror 6: 0x5aaf39ec (stale) Mirror 7: 0x5aaf39ec (stale) Mirror 8: 0xf13e3530 (stale) CRC-32 checksum value for chunk [0, 0x2b0fd): Mirror 1: 0xdf697bc2 Mirror 9: 0xdf697bc2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b0fd: skipped 000832 1784341912.843406 punch from 0x02275c to 0x022e6e (0x713 bytes) 000833 1784341912.853682 read 0x016ebb thru 0x01a8e1 (0x3a27 bytes) 000834 1784341912.856320 trunc from 0x02b0fd to 0x00e829 (0x1c8d3 bytes) 000835 1784341912.869012 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe82a): Mirror 6: 0xea7b5e6d (stale) Mirror 7: 0xea7b5e6d (stale) Mirror 9: 0x219a6482 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe82a): Mirror 6: 0xea7b5e6d (stale) Mirror 7: 0xea7b5e6d (stale) Mirror 9: 0x219a6482 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe82a: skipped 000836 1784341912.962943 fallocate 0x02a272 thru 0x02b5f4 (0x1383 bytes) 000837 1784341912.964985 punch from 0x00491b to 0x005aac (0x1192 bytes) 000838 1784341912.966670 mapread 0x00dc28 thru 0x00e829 (0xc02 bytes) 000839 1784341912.970146 trunc from 0x002c14 to 0x00bc58 (0x9045 bytes) 000840 1784341912.971848 mapread 0x005b03 thru 0x00daf4 (0x7ff2 bytes) 000841 1784341912.976485 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe82a): Mirror 7: 0xea7b5e6d (stale) Mirror 9: 0x219a6482 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe82a): Mirror 7: 0xea7b5e6d (stale) Mirror 9: 0x219a6482 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe82a: skipped 000842 1784341913.060286 write 0x03a5b2 thru 0x03ffff (0x5a4e bytes) 000843 1784341913.062459 mapwrite 0x02dd3f thru 0x033011 (0x52d3 bytes) 000844 1784341913.073839 write 0x025ac6 thru 0x02e5ea (0x8b25 bytes) 000845 1784341913.076475 fallocate 0x022669 thru 0x02da4c (0xb3e4 bytes) 000846 1784341913.078685 write 0x00670a thru 0x0140d2 (0xd9c9 bytes) 000847 1784341913.082856 mapread 0x02bc42 thru 0x034c72 (0x9031 bytes) 000848 1784341913.083769 read 0x026144 thru 0x02af98 (0x4e55 bytes) 000849 1784341913.085861 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x55cdf662 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x55cdf662 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000850 1784341913.167734 write 0x000ea3 thru 0x004dd9 (0x3f37 bytes) 000851 1784341913.172130 fallocate 0x034d6f thru 0x038ebb (0x414d bytes) 000852 1784341913.174339 mapwrite 0x013c01 thru 0x01ae80 (0x7280 bytes) 000853 1784341913.186301 trunc from 0x040000 to 0x035bed (0xa412 bytes) 000854 1784341913.191736 fallocate 0x02f9e1 thru 0x034e6d (0x548d bytes) 000855 1784341913.194071 write 0x03457f thru 0x03935c (0x4dde bytes) 000856 1784341913.196493 read 0x002506 thru 0x00f8e8 (0xd3e3 bytes) 000857 1784341913.199672 read 0x032fb8 thru 0x038e41 (0x5e8a bytes) 000858 1784341913.203316 punch from 0x0177d1 to 0x01ce08 (0x5638 bytes) 000859 1784341913.205631 punch from 0x027800 to 0x02dcae (0x64af bytes) 000860 1784341913.209235 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3935d): Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3935d): Mirror 9: 0x6b67475f (stale) CRC-32 checksum value for chunk [0, 0x3935d): Mirror 1: 0x798bff64 Mirror 10: 0x798bff64 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3935d: skipped 000861 1784341913.442968 read 0x00b179 thru 0x0181f7 (0xd07f bytes) 000862 1784341913.448237 read 0x01c897 thru 0x028c03 (0xc36d bytes) 000863 1784341913.455001 MIRROR_RESYNC 3 mirrors 000865 1784341913.627501 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) 000866 1784341913.710610 mapread 0x01304d thru 0x020038 (0xcfec bytes) 000867 1784341913.718197 mapwrite 0x003565 thru 0x012d07 (0xf7a3 bytes) 000868 1784341913.757418 read 0x028cb2 thru 0x032897 (0x9be6 bytes) 000869 1784341913.761349 write 0x00bd60 thru 0x00f708 (0x39a9 bytes) 000870 1784341913.763754 read 0x024781 thru 0x02884a (0x40ca bytes) 000871 1784341913.767206 mapwrite 0x00284c thru 0x00f26b (0xca20 bytes) 000873 1784341913.777769 mapwrite 0x0348ba thru 0x03ffff (0xb746 bytes) 000874 1784341913.802371 trunc from 0x008292 to 0x00d426 (0x5195 bytes) 000875 1784341913.804664 mapwrite 0x021ddb thru 0x0296d2 (0x78f8 bytes) 000876 1784341913.813024 punch from 0x036c86 to 0x03ffff (0x937a bytes) 000877 1784341913.815322 trunc from 0x030671 to 0x03ae67 (0xa7f7 bytes) 000878 1784341913.817589 fallocate 0x0094af thru 0x017020 (0xdb72 bytes) 000879 1784341913.819866 mapwrite 0x0390f2 thru 0x039ad3 (0x9e2 bytes) 000880 1784341913.827182 punch from 0x0283ee to 0x037128 (0xed3b bytes) 000881 1784341913.829837 mapread 0x009e0e thru 0x0103b4 (0x65a7 bytes) 000882 1784341913.838245 fallocate 0x0117f0 thru 0x01aac1 (0x92d2 bytes) 000883 1784341913.840656 punch from 0x02f146 to 0x03174e (0x2609 bytes) 000884 1784341913.842381 write 0x02030c thru 0x028190 (0x7e85 bytes) 000885 1784341913.846679 MIRROR_RESYNC 2 mirrors 000886 1784341914.041691 mapread 0x032559 thru 0x037d6f (0x5817 bytes) 000887 1784341914.047872 write 0x004143 thru 0x0136d4 (0xf592 bytes) 000888 1784341914.061424 trunc from 0x012b1c to 0x01cf2b (0xa410 bytes) 000889 1784341914.066544 trunc from 0x00789e to 0x01618d (0xe8f0 bytes) 000890 1784341914.068670 trunc from 0x040000 to 0x02a6e5 (0x1591a bytes) 000891 1784341914.084519 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) 000894 1784341914.124448 fallocate 0x00c39a thru 0x011320 (0x4f87 bytes) 000895 1784341914.126785 write 0x003a0a thru 0x004867 (0xe5e bytes) 000896 1784341914.131640 write 0x011113 thru 0x0167f8 (0x56e6 bytes) 000897 1784341914.135032 trunc from 0x0122e7 to 0x01ad26 (0x8a40 bytes) 000900 1784341914.141698 trunc from 0x02a6e6 to 0x03622b (0xbb46 bytes) 000901 1784341914.146992 trunc from 0x03622c to 0x027ed8 (0xe353 bytes) 000902 1784341914.152247 read 0x014d8e thru 0x01599c (0xc0f bytes) 000903 1784341914.154989 read 0x0121b4 thru 0x01e837 (0xc684 bytes) 000904 1784341914.158845 trunc from 0x027ed9 to 0x0127d2 (0x15706 bytes) 000905 1784341914.166611 write 0x003b6c thru 0x007600 (0x3a95 bytes) 000906 1784341914.167871 trunc from 0x0127d3 to 0x002115 (0x106bd bytes) 000907 1784341914.174503 punch from 0x001016 to 0x001b2e (0xb19 bytes) 000908 1784341914.176461 mapread 0x0014dd thru 0x002115 (0xc39 bytes) 000909 1784341914.178779 mapwrite 0x01ba4c thru 0x02882b (0xcde0 bytes) 000910 1784341914.214087 MIRROR_EXTEND to 2 mirrors 000911 1784341914.370859 fallocate 0x02f9be thru 0x039a90 (0xa0d3 bytes) 000912 1784341914.381381 write 0x01f893 thru 0x0273bd (0x7b2b bytes) 000913 1784341914.385729 fallocate 0x019c9a thru 0x021c00 (0x7f67 bytes) 000914 1784341914.387608 mapread 0x027f4c thru 0x02882b (0x8e0 bytes) 000915 1784341914.389761 write 0x016005 thru 0x018b73 (0x2b6f bytes) 000916 1784341914.393040 read 0x00ea59 thru 0x0161fa (0x77a2 bytes) 000917 1784341914.396279 fallocate 0x01f241 thru 0x0222ec (0x30ac bytes) 000918 1784341914.398345 write 0x036461 thru 0x03e43f (0x7fdf bytes) 000920 1784341914.401340 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e440): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e440): Mirror 2: 0xa5002d7 (stale) CRC-32 checksum value for chunk [0, 0x3e440): Mirror 1: 0xdee4bfea Mirror 3: 0xdee4bfea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e440: skipped 000921 1784341914.640709 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e440): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e440): Mirror 2: 0xa5002d7 (stale) CRC-32 checksum value for chunk [0, 0x3e440): Mirror 1: 0xdee4bfea Mirror 3: 0xdee4bfea Mirror 4: 0xdee4bfea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e440: skipped 000922 1784341914.869358 write 0x02c8e3 thru 0x032686 (0x5da4 bytes) 000923 1784341914.883731 mapread 0x0009c7 thru 0x000a0c (0x46 bytes) 000924 1784341914.886277 trunc from 0x01bd88 to 0x01f21b (0x3494 bytes) 000925 1784341914.888390 trunc from 0x03e440 to 0x0079c4 (0x36a7b bytes) 000926 1784341914.902234 mapread 0x005a8f thru 0x0070e7 (0x1659 bytes) 000927 1784341914.908604 trunc from 0x0079c5 to 0x01fcca (0x18306 bytes) 000928 1784341914.913751 mapwrite 0x020e57 thru 0x02b8c2 (0xaa6c bytes) 000929 1784341914.932886 mapwrite 0x012261 thru 0x02157c (0xf31c bytes) 000930 1784341914.945790 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b8c3): Mirror 2: 0xfbca61d8 (stale) Mirror 4: 0x4fe061de (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b8c3): Mirror 2: 0xfbca61d8 (stale) Mirror 4: 0x4fe061de (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b8c3: skipped 000931 1784341915.030520 read 0x023f79 thru 0x0294d5 (0x555d bytes) 000932 1784341915.033378 trunc from 0x005d0d to 0x015807 (0xfafb bytes) 000933 1784341915.035610 mapread 0x028fe2 thru 0x02b8c2 (0x28e1 bytes) 000934 1784341915.039573 mapwrite 0x00edc0 thru 0x019384 (0xa5c5 bytes) 000935 1784341915.051189 read 0x011369 thru 0x019b7d (0x8815 bytes) 000936 1784341915.051614 punch from 0x0222e2 to 0x029999 (0x76b8 bytes) 000937 1784341915.053598 fallocate 0x00f1d7 thru 0x01cc51 (0xda7b bytes) 000938 1784341915.055726 trunc from 0x010adf to 0x014784 (0x3ca6 bytes) 000939 1784341915.057548 mapwrite 0x03cc23 thru 0x03ffff (0x33dd bytes) 000940 1784341915.070919 write 0x0077c0 thru 0x016385 (0xebc6 bytes) 000941 1784341915.073612 MIRROR_RESYNC 3 mirrors 000942 1784341915.304171 write 0x014978 thru 0x018dde (0x4467 bytes) 000943 1784341915.315570 write 0x02e42f thru 0x038414 (0x9fe6 bytes) 000944 1784341915.319192 fallocate 0x0134c2 thru 0x0228b0 (0xf3ef bytes) 000945 1784341915.321209 fallocate 0x03af8d thru 0x03f576 (0x45ea bytes) 000947 1784341915.325234 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x489b6dd2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x489b6dd2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000948 1784341915.410057 read 0x03a1cb thru 0x03c940 (0x2776 bytes) 000949 1784341915.412846 trunc from 0x040000 to 0x018407 (0x27bf8 bytes) 000950 1784341915.423688 trunc from 0x018408 to 0x000128 (0x182df bytes) 000951 1784341915.429579 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x765:0x0]: Invalid argument (22) 000952 1784341915.464041 trunc from 0x000129 to 0x0287cf (0x286a7 bytes) 000953 1784341915.469464 read 0x022a1a thru 0x0243e0 (0x19c7 bytes) 000954 1784341915.471767 fallocate 0x02b382 thru 0x032983 (0x7602 bytes) 000955 1784341915.473862 punch from 0x028380 to 0x0287cf (0x450 bytes) 000957 1784341915.476069 trunc from 0x0194d6 to 0x0287cf (0xf2fa bytes) 000958 1784341915.478244 mapread 0x020191 thru 0x0287cf (0x863f bytes) 000959 1784341915.483953 trunc from 0x0287d0 to 0x018631 (0x1019e bytes) 000960 1784341915.488653 punch from 0x0076ed to 0x00c3e1 (0x4cf5 bytes) 000961 1784341915.490317 read 00000000 thru 0x00f3ad (0xf3ae bytes) 000962 1784341915.493462 mapread 0x014435 thru 0x018631 (0x41fd bytes) 000963 1784341915.494369 read 0x012e87 thru 0x014ab8 (0x1c32 bytes) 000964 1784341915.494992 write 0x02f960 thru 0x0346f2 (0x4d93 bytes) 000965 1784341915.495934 trunc from 0x02628f to 0x0346f2 (0xe464 bytes) 000966 1784341915.500292 punch from 0x02b0d8 to 0x02d160 (0x2089 bytes) 000967 1784341915.502097 mapread 0x02de1c thru 0x0346f2 (0x68d7 bytes) 000968 1784341915.505743 fallocate 0x0101ab thru 0x01e5d8 (0xe42e bytes) 000969 1784341915.508372 fallocate 0x0015b4 thru 0x009ed4 (0x8921 bytes) 000970 1784341915.510512 read 0x020032 thru 0x02804d (0x801c bytes) 000971 1784341915.511030 mapread 0x00fc09 thru 0x0101c7 (0x5bf bytes) 000972 1784341915.511626 mapwrite 0x009928 thru 0x016b4e (0xd227 bytes) 000974 1784341915.519970 mapread 0x01a006 thru 0x01fa48 (0x5a43 bytes) 000975 1784341915.520905 punch from 0x0343e5 to 0x0346f2 (0x30e bytes) 000976 1784341915.522930 trunc from 0x0346f3 to 0x01dff4 (0x166fe bytes) 000977 1784341915.528001 write 0x03072a thru 0x039197 (0x8a6e bytes) 000978 1784341915.529009 mapwrite 0x017e55 thru 0x01c066 (0x4212 bytes) 000981 1784341915.537592 MIRROR_EXTEND to 2 mirrors 000982 1784341915.703051 fallocate 0x00ca10 thru 0x018576 (0xbb67 bytes) 000984 1784341915.715752 write 0x038e95 thru 0x03ffff (0x716b bytes) 000987 1784341915.722238 punch from 0x038bf0 to 0x03a866 (0x1c77 bytes) 000988 1784341915.727391 write 0x034669 thru 0x03ffff (0xb997 bytes) 000990 1784341915.730393 mapwrite 0x012e3f thru 0x01a336 (0x74f8 bytes) 000991 1784341915.743941 mapwrite 0x001892 thru 0x0060f7 (0x4866 bytes) 000993 1784341915.753151 fallocate 0x00b21d thru 0x012f28 (0x7d0c bytes) 000994 1784341915.755207 mapread 0x0010a8 thru 0x00a5cc (0x9525 bytes) 000995 1784341915.756307 trunc from 0x038d6b to 0x03ee95 (0x612b bytes) 000996 1784341915.758256 write 0x0205c6 thru 0x029db6 (0x97f1 bytes) 000997 1784341915.761760 read 0x03f475 thru 0x03ffff (0xb8b bytes) 000998 1784341915.762267 mapread 0x018dfc thru 0x0195b8 (0x7bd bytes) 000999 1784341915.762964 read 0x03ed83 thru 0x03ffff (0x127d bytes) 001000 1784341915.766218 read 0x00bc87 thru 0x0170a6 (0xb420 bytes) All operations completed A-OK!