== sanity-flr test 70a: flr mode fsx test ================ 01:31:30 (1788845490) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 5492 skipping zero size read skipping zero length punch hole skipping zero size read skipping zero length punch hole skipping zero length zero range skipping zero length zero range skipping zero size read 000008 1788845492.317541 write 0x02eff4 thru 0x034eb6 (0x5ec3 bytes) 000009 1788845492.319419 punch from 0x02dd24 to 0x034eb6 (0x7193 bytes) 000010 1788845492.339732 write 0x0316a7 thru 0x03b3b1 (0x9d0b bytes) truncating to largest ever: 0x27b21 000011 1788845492.354513 trunc from 0x03b3b2 to 0x027b20 (0x13891 bytes) 000012 1788845492.387354 trunc from 0x027b21 to 0x0030b5 (0x24a6b bytes) 000013 1788845492.430489 MIRROR_EXTEND to 2 mirrors 000014 1788845492.992781 write 0x01901f thru 0x019435 (0x417 bytes) 000015 1788845493.024123 trunc from 0x009bb1 to 0x010bdc (0x702c bytes) 000016 1788845493.031103 write 0x01a3ce thru 0x027453 (0xd086 bytes) truncating to largest ever: 0x3740a 000017 1788845493.036266 trunc from 0x027454 to 0x037409 (0xffb6 bytes) 000018 1788845493.057206 punch from 0x0248eb to 0x02eaac (0xa1c2 bytes) 000019 1788845493.074480 fallocate 0x025e72 thru 0x02c955 (0x6ae4 bytes) 000021 1788845493.079383 trunc from 0x03740a to 0x00e593 (0x28e76 bytes) 000022 1788845493.096328 trunc from 0x00e594 to 0x012cd9 (0x4746 bytes) fallocating to largest ever: 0x3ac7e 000023 1788845493.120247 fallocate 0x036ede thru 0x03ac7d (0x3da0 bytes) 000024 1788845493.126107 trunc from 0x012cda to 0x00cc47 (0x6092 bytes) 000025 1788845493.145516 trunc from 0x00764b to 0x00cc47 (0x55fd bytes) 000026 1788845493.156324 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) 000027 1788845493.301914 write 0x023e1f thru 0x03126a (0xd44c bytes) 000028 1788845493.307790 fallocate 0x02251d thru 0x026f82 (0x4a66 bytes) 000029 1788845493.312344 mapread 0x01e417 thru 0x029ae0 (0xb6ca bytes) 000031 1788845493.332218 write 0x00671e thru 0x01452d (0xde10 bytes) 000034 1788845493.344711 fallocate 0x030b40 thru 0x039681 (0x8b42 bytes) 000035 1788845493.355199 mapread 0x02b164 thru 0x03084e (0x56eb bytes) 000036 1788845493.357178 write 0x0324fc thru 0x037770 (0x5275 bytes) 000037 1788845493.384048 mapread 0x019b64 thru 0x025d4c (0xc1e9 bytes) 000038 1788845493.385010 write 0x02e5f6 thru 0x0336b8 (0x50c3 bytes) 000039 1788845493.389316 trunc from 0x026bcd to 0x02bdeb (0x521f bytes) 000040 1788845493.412230 mapread 0x013ef6 thru 0x0217d4 (0xd8df bytes) 000041 1788845493.420102 trunc from 0x039682 to 0x030ceb (0x8996 bytes) 000042 1788845493.439021 punch from 0x0090d4 to 0x0178c0 (0xe7ed bytes) 000043 1788845493.444666 trunc from 0x030cec to 0x024261 (0xca8a bytes) 000044 1788845493.483166 write 0x01c7ca thru 0x01fb04 (0x333b bytes) 000045 1788845493.485372 trunc from 0x005950 to 0x011ee5 (0xc596 bytes) 000047 1788845493.492361 trunc from 0x00711b to 0x011d98 (0xac7e bytes) 000048 1788845493.499562 read 0x00650b thru 0x0120c5 (0xbbbb bytes) 000051 1788845493.519588 mapread 0x00001f thru 0x00be56 (0xbe38 bytes) 000052 1788845493.531096 write 0x03763b thru 0x03fd0e (0x86d4 bytes) 000053 1788845493.532499 punch from 0x0119b6 to 0x013203 (0x184e bytes) truncating to largest ever: 0x3f10a 000054 1788845493.538355 trunc from 0x03fd0f to 0x03f109 (0xc05 bytes) 000055 1788845493.571016 punch from 0x03b54e to 0x03f109 (0x3bbc bytes) 000058 1788845493.603874 trunc from 0x00b32f to 0x00f7b4 (0x4486 bytes) 000059 1788845493.613261 trunc from 0x035e22 to 0x03e066 (0x8245 bytes) 000060 1788845493.623499 trunc from 0x03f10a to 0x02f238 (0xfed1 bytes) 000061 1788845493.649558 mapwrite 0x03a8b9 thru 0x03ffff (0x5747 bytes) 000062 1788845493.709734 mapwrite 0x01af59 thru 0x024013 (0x90bb bytes) 000064 1788845493.727399 write 0x01e1c4 thru 0x01e776 (0x5b3 bytes) 000065 1788845493.732714 MIRROR_EXTEND to 2 mirrors 000066 1788845494.360592 punch from 0x0187e1 to 0x019c06 (0x1426 bytes) 000067 1788845494.410749 mapwrite 0x030847 thru 0x03dbc9 (0xd383 bytes) 000068 1788845494.463406 mapwrite 0x008d24 thru 0x009044 (0x321 bytes) 000069 1788845494.481226 read 0x021efc thru 0x03088b (0xe990 bytes) 000070 1788845494.490931 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8eafbefb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xac9bb5d3 Mirror 3: 0xac9bb5d3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000071 1788845495.380145 trunc from 0x000e98 to 0x00eee3 (0xe04c bytes) 000072 1788845495.433447 MIRROR_RESYNC 3 mirrors 000073 1788845496.391258 read 0x0114c1 thru 0x01c338 (0xae78 bytes) 000074 1788845496.402493 mapread 0x0392f2 thru 0x03ffff (0x6d0e bytes) 000075 1788845496.432247 read 0x0137aa thru 0x01b73e (0x7f95 bytes) 000076 1788845496.432587 write 0x007d91 thru 0x0095d9 (0x1849 bytes) 000077 1788845496.506299 mapread 0x03f174 thru 0x03ffff (0xe8c bytes) 000079 1788845496.508806 mapread 0x006034 thru 0x00846a (0x2437 bytes) 000080 1788845496.514357 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9461f797 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9461f797 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000082 1788845496.852261 mapwrite 0x01ef9d thru 0x02254b (0x35af bytes) 000083 1788845496.893154 write 0x0107f4 thru 0x011e5d (0x166a bytes) 000084 1788845496.907829 read 0x032e7e thru 0x038a11 (0x5b94 bytes) 000086 1788845496.918145 punch from 0x00ecba to 0x018adb (0x9e22 bytes) 000087 1788845496.930434 mapread 0x00f5e7 thru 0x016bd1 (0x75eb bytes) 000088 1788845496.943039 fallocate 0x01d0d1 thru 0x027656 (0xa586 bytes) 000089 1788845496.949507 trunc from 0x00bfe4 to 0x01811b (0xc138 bytes) 000090 1788845496.955123 fallocate 0x006983 thru 0x00b9fd (0x507b bytes) 000091 1788845496.961451 punch from 0x039bc5 to 0x03ec46 (0x5082 bytes) 000092 1788845496.967389 trunc from 0x0156f7 to 0x016438 (0xd42 bytes) 000093 1788845496.978427 read 0x02edae thru 0x0345ec (0x583f bytes) 000094 1788845496.994666 mapwrite 0x0355f3 thru 0x03f334 (0x9d42 bytes) 000095 1788845497.022371 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9461f797 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbd670b04 Mirror 4: 0xbd670b04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000096 1788845497.899685 write 0x00b688 thru 0x01648d (0xae06 bytes) 000098 1788845497.944714 fallocate 0x000198 thru 0x00dc0f (0xda78 bytes) 000099 1788845497.953151 MIRROR_RESYNC 3 mirrors 000100 1788845499.223977 mapwrite 0x0103c2 thru 0x0111bf (0xdfe bytes) 000101 1788845499.344925 mapread 0x004b58 thru 0x00a107 (0x55b0 bytes) 000102 1788845499.360141 mapwrite 0x03b248 thru 0x03ffff (0x4db8 bytes) 000103 1788845499.415630 write 0x025b1c thru 0x026f1c (0x1401 bytes) 000105 1788845499.431611 mapread 0x00ac09 thru 0x012f58 (0x8350 bytes) 000106 1788845499.437805 MIRROR_RESYNC 3 mirrors 000107 1788845500.497651 punch from 0x00c3c2 to 0x01b663 (0xf2a2 bytes) 000108 1788845500.553630 mapwrite 0x01e8fa thru 0x025d78 (0x747f bytes) 000109 1788845500.599235 mapread 0x026ff7 thru 0x033bd6 (0xcbe0 bytes) 000110 1788845500.616548 read 0x02ee02 thru 0x03083e (0x1a3d bytes) 000111 1788845500.617899 mapwrite 0x013394 thru 0x01574d (0x23ba bytes) 000112 1788845500.636647 read 0x038cc4 thru 0x03ffff (0x733c bytes) 000113 1788845500.644797 write 0x004da4 thru 0x00979f (0x49fc bytes) 000114 1788845500.646028 fallocate 0x02c74b thru 0x02f28c (0x2b42 bytes) 000116 1788845500.654130 fallocate 0x024b0d thru 0x02cb45 (0x8039 bytes) 000118 1788845500.662498 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x16fdaaa5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x16fdaaa5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000119 1788845500.970013 write 0x0169dc thru 0x01c057 (0x567c bytes) 000120 1788845500.988277 fallocate 0x02a929 thru 0x038283 (0xd95b bytes) 000121 1788845500.994788 mapread 0x0291cd thru 0x037f3a (0xed6e bytes) 000122 1788845501.031932 mapread 0x036dad thru 0x03faab (0x8cff bytes) 000123 1788845501.041342 trunc from 0x040000 to 0x019840 (0x267bf bytes) 000124 1788845501.068785 trunc from 0x019841 to 0x02d019 (0x137d9 bytes) 000125 1788845501.096356 read 0x016e21 thru 0x02535c (0xe53c bytes) 000127 1788845501.107927 fallocate 0x00fbfb thru 0x01c9a7 (0xcdad bytes) 000128 1788845501.117379 punch from 0x017f77 to 0x0198d9 (0x1963 bytes) 000129 1788845501.138508 mapwrite 0x03cbfe thru 0x03ffff (0x3402 bytes) 000130 1788845501.200600 write 0x008063 thru 0x011c0f (0x9bad bytes) 000131 1788845501.226456 read 0x00c9d7 thru 0x01a5f2 (0xdc1c bytes) 000133 1788845501.257080 punch from 0x03bce8 to 0x03ffff (0x4318 bytes) 000134 1788845501.261458 trunc from 0x040000 to 0x035516 (0xaae9 bytes) 000135 1788845501.275995 mapread 0x009b91 thru 0x00f5c5 (0x5a35 bytes) 000136 1788845501.276927 read 0x01328e thru 0x0209e8 (0xd75b bytes) 000138 1788845501.278378 punch from 0x0161d1 to 0x01dc76 (0x7aa6 bytes) 000140 1788845501.292188 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35517): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35517): Mirror 3: 0x4c5f25b8 (stale) CRC-32 checksum value for chunk [0, 0x35517): Mirror 1: 0x6dcb7a45 Mirror 4: 0x6dcb7a45 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35517: skipped 000141 1788845502.126189 write 0x017ad5 thru 0x025072 (0xd59e bytes) 000142 1788845502.193730 trunc from 0x035517 to 0x00b331 (0x2a1e5 bytes) 000143 1788845502.264615 trunc from 0x001a6a to 0x0022ef (0x886 bytes) 000144 1788845502.275137 MIRROR_RESYNC 3 mirrors 000145 1788845502.915402 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) 000146 1788845503.243537 mapread 0x006a1d thru 0x00b331 (0x4915 bytes) 000147 1788845503.266299 read 0x0006de thru 0x00b331 (0xac54 bytes) 000148 1788845503.278975 trunc from 0x006078 to 0x00b331 (0x52ba bytes) 000149 1788845503.346012 mapwrite 0x01ccff thru 0x02301b (0x631d bytes) 000150 1788845503.438165 fallocate 0x0331bd thru 0x03a4c8 (0x730c bytes) 000151 1788845503.450758 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2301c): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2301c): Mirror 3: 0x3229db19 (stale) CRC-32 checksum value for chunk [0, 0x2301c): Mirror 1: 0x30b2ba24 Mirror 4: 0x30b2ba24 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2301c: skipped 000153 1788845504.308573 mapwrite 0x0353c7 thru 0x03d88f (0x84c9 bytes) 000154 1788845504.417302 trunc from 0x028b63 to 0x033150 (0xa5ee bytes) 000155 1788845504.426095 mapread 0x0029fd thru 0x00be28 (0x942c bytes) 000156 1788845504.436555 write 0x00a5f3 thru 0x011b4b (0x7559 bytes) 000157 1788845504.445372 mapread 0x00ba27 thru 0x01b1d1 (0xf7ab bytes) 000159 1788845504.478847 mapwrite 0x00a26f thru 0x0126ea (0x847c bytes) 000160 1788845504.517199 write 0x02123b thru 0x02c452 (0xb218 bytes) 000162 1788845504.536494 mapwrite 0x012622 thru 0x02095a (0xe339 bytes) 000163 1788845504.572111 trunc from 0x03d890 to 0x030d74 (0xcb1b bytes) 000164 1788845504.600772 trunc from 0x030d75 to 0x038975 (0x7c01 bytes) 000166 1788845504.635427 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x38976): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38976): Mirror 3: 0xcd971df3 (stale) Mirror 4: 0xffc02a69 (stale) CRC-32 checksum value for chunk [0, 0x38976): Mirror 1: 0x44e57fd4 Mirror 5: 0x44e57fd4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38976: skipped 000167 1788845505.707183 trunc from 0x038976 to 0x00c6be (0x2c2b7 bytes) 000168 1788845505.772315 mapwrite 0x012a96 thru 0x02032e (0xd899 bytes) 000169 1788845505.867973 trunc from 0x02032f to 0x00e8dc (0x11a52 bytes) 000170 1788845505.899540 trunc from 0x00b18c to 0x00e8dc (0x3751 bytes) 000171 1788845505.918986 mapread 0x009f2d thru 0x00e8dc (0x49b0 bytes) 000172 1788845505.945610 fallocate 0x03061d thru 0x03b1a2 (0xab86 bytes) 000173 1788845505.956322 write 0x033385 thru 0x03893e (0x55ba bytes) 000174 1788845505.959440 trunc from 0x0095a9 to 0x00f708 (0x6160 bytes) 000176 1788845505.974619 read 0x022948 thru 0x02f676 (0xcd2f bytes) 000177 1788845505.987420 punch from 0x02a62b to 0x02ef7f (0x4955 bytes) 000179 1788845505.998636 mapwrite 0x03fb8f thru 0x03ffff (0x471 bytes) 000180 1788845506.054186 trunc from 0x040000 to 0x009384 (0x36c7b bytes) 000181 1788845506.071026 trunc from 0x009385 to 0x01a58f (0x1120b bytes) 000185 1788845506.090998 trunc from 0x01a590 to 0x02567c (0xb0ed bytes) 000186 1788845506.106229 trunc from 0x01557b to 0x018bd3 (0x3659 bytes) 000187 1788845506.111578 write 0x01ad89 thru 0x01c4b1 (0x1729 bytes) 000188 1788845506.123646 fallocate 0x001d63 thru 0x00952a (0x77c8 bytes) 000189 1788845506.132136 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2567d): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2567d): Mirror 3: 0xc621b179 (stale) Mirror 4: 0x8feaa57b (stale) Mirror 5: 0x2f274f8 (stale) CRC-32 checksum value for chunk [0, 0x2567d): Mirror 1: 0x40e1d626 Mirror 6: 0x40e1d626 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2567d: skipped 000190 1788845507.158631 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2567d): Mirror 4: 0x8feaa57b (stale) Mirror 5: 0x2f274f8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2567d): Mirror 4: 0x8feaa57b (stale) Mirror 5: 0x2f274f8 (stale) CRC-32 checksum value for chunk [0, 0x2567d): Mirror 1: 0x40e1d626 Mirror 6: 0x40e1d626 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2567d: skipped 000191 1788845507.840111 trunc from 0x00dfe4 to 0x01bb48 (0xdb65 bytes) 000193 1788845507.880028 trunc from 0x02567d to 0x01a4ee (0xb18e bytes) 000194 1788845507.924399 punch from 0x000c28 to 0x00a8c6 (0x9c9f bytes) 000195 1788845507.929380 mapread 0x008f21 thru 0x00dd5a (0x4e3a bytes) 000196 1788845507.952757 punch from 0x00582b to 0x00f830 (0xa006 bytes) 000197 1788845507.958561 write 0x03900e thru 0x03ffff (0x6ff2 bytes) 000198 1788845507.968593 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x449f2d70 (stale) Mirror 6: 0x18d063fa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x449f2d70 (stale) Mirror 6: 0x18d063fa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000199 1788845508.327251 punch from 0x01d394 to 0x026027 (0x8c94 bytes) 000200 1788845508.331168 fallocate 0x03a91e thru 0x03c2c7 (0x19aa bytes) fallocating to largest ever: 0x40000 000202 1788845508.336339 fallocate 0x03d90f thru 0x03ffff (0x26f1 bytes) 000203 1788845508.343370 mapwrite 0x00028b thru 0x00fc6a (0xf9e0 bytes) 000205 1788845508.390250 trunc from 0x040000 to 0x024919 (0x1b6e6 bytes) 000206 1788845508.418641 mapread 0x019328 thru 0x02133c (0x8015 bytes) 000207 1788845508.434453 MIRROR_RESYNC 3 mirrors 000208 1788845509.152657 read 0x0109d8 thru 0x013af6 (0x311f bytes) 000209 1788845509.160261 fallocate 0x02a378 thru 0x02b04b (0xcd4 bytes) 000210 1788845509.197226 mapwrite 0x01173d thru 0x01cd85 (0xb649 bytes) 000211 1788845509.252091 write 0x030d37 thru 0x03b89f (0xab69 bytes) 000213 1788845509.260058 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3b8a0): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b8a0): Mirror 5: 0xfeb01ef3 (stale) Mirror 6: 0xfeb01ef3 (stale) CRC-32 checksum value for chunk [0, 0x3b8a0): Mirror 1: 0x9d347eb3 Mirror 7: 0x9d347eb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b8a0: skipped 000214 1788845510.213311 mapread 0x0015f0 thru 0x004f64 (0x3975 bytes) 000215 1788845510.247287 mapread 0x0172f5 thru 0x01974e (0x245a bytes) 000216 1788845510.277007 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b8a0): Mirror 5: 0xfeb01ef3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b8a0): Mirror 5: 0xfeb01ef3 (stale) CRC-32 checksum value for chunk [0, 0x3b8a0): Mirror 1: 0x9d347eb3 Mirror 7: 0x9d347eb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b8a0: skipped 000217 1788845510.800077 mapread 0x00f5e0 thru 0x0153d0 (0x5df1 bytes) 000218 1788845510.836076 read 0x03ab3c thru 0x03b4b3 (0x978 bytes) 000219 1788845510.858915 punch from 0x020867 to 0x02c0bf (0xb859 bytes) 000220 1788845510.919141 trunc from 0x03b8a0 to 0x036260 (0x563f bytes) 000221 1788845510.986381 punch from 0x001bc0 to 0x006ecd (0x530e bytes) 000222 1788845510.998660 mapwrite 0x03cbcf thru 0x03ffff (0x3431 bytes) 000223 1788845511.085938 fallocate 0x010b62 thru 0x01b8fc (0xad9b bytes) 000224 1788845511.097029 punch from 0x013f5e to 0x01f4d2 (0xb575 bytes) 000225 1788845511.103474 trunc from 0x03f586 to 0x03ffff (0xa7a bytes) 000226 1788845511.108014 mapread 0x00de2c thru 0x015b7b (0x7d50 bytes) 000227 1788845511.129144 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf29c3af9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf29c3af9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000229 1788845511.437353 mapread 0x021c23 thru 0x021f98 (0x376 bytes) 000230 1788845511.447453 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) 000231 1788845511.569191 trunc from 0x040000 to 0x0364a9 (0x9b56 bytes) 000232 1788845511.596720 punch from 0x0319b8 to 0x0364a9 (0x4af2 bytes) 000233 1788845511.616075 MIRROR_EXTEND to 2 mirrors 000234 1788845512.365452 punch from 0x00f897 to 0x0179c7 (0x8131 bytes) 000237 1788845512.414572 mapwrite 0x03b10a thru 0x03ffff (0x4ef6 bytes) 000238 1788845512.502634 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfd8dd6b2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x54c04644 Mirror 3: 0x54c04644 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000239 1788845513.275819 trunc from 0x0198a4 to 0x027bd4 (0xe331 bytes) 000241 1788845513.342355 mapread 0x002638 thru 0x00aabc (0x8485 bytes) 000243 1788845513.380960 trunc from 0x040000 to 0x0317cb (0xe834 bytes) 000244 1788845513.427304 mapread 0x011a3b thru 0x01a16d (0x8733 bytes) 000245 1788845513.448229 MIRROR_RESYNC 3 mirrors 000246 1788845514.212368 mapwrite 0x00278d thru 0x00ab90 (0x8404 bytes) 000247 1788845514.336616 trunc from 0x0317cc to 0x03af2d (0x9762 bytes) 000248 1788845514.413072 trunc from 0x013343 to 0x0155c6 (0x2284 bytes) 000250 1788845514.421335 trunc from 0x02df04 to 0x03ae6d (0xcf6a bytes) 000251 1788845514.426170 punch from 0x0132ba to 0x0199f2 (0x6739 bytes) 000252 1788845514.435210 trunc from 0x00b0bf to 0x012ae4 (0x7a26 bytes) 000253 1788845514.451469 read 0x010170 thru 0x01e596 (0xe427 bytes) 000254 1788845514.465835 punch from 0x036287 to 0x037d20 (0x1a9a bytes) 000256 1788845514.473079 punch from 0x015551 to 0x02215a (0xcc0a bytes) 000258 1788845514.478288 fallocate 0x003335 thru 0x007715 (0x43e1 bytes) 000259 1788845514.483966 fallocate 0x02bfb5 thru 0x02d03c (0x1088 bytes) 000260 1788845514.490139 write 0x021099 thru 0x02ef7f (0xdee7 bytes) 000261 1788845514.507572 read 0x02c2a8 thru 0x034f97 (0x8cf0 bytes) 000262 1788845514.521045 write 0x034ec7 thru 0x0380e5 (0x321f bytes) 000263 1788845514.522155 trunc from 0x03af2e to 0x0307a1 (0xa78c bytes) 000264 1788845514.562781 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x307a2): Mirror 2: 0xaab03501 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x307a2): Mirror 2: 0xaab03501 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x307a2: skipped 000265 1788845514.887939 mapwrite 0x033871 thru 0x03a73f (0x6ecf bytes) 000266 1788845515.023524 mapwrite 0x023f08 thru 0x02760b (0x3704 bytes) 000267 1788845515.075691 write 0x009528 thru 0x00ce02 (0x38db bytes) 000268 1788845515.088446 write 0x022aaa thru 0x024aff (0x2056 bytes) 000269 1788845515.097027 MIRROR_RESYNC 2 mirrors 000270 1788845515.728440 mapwrite 0x029880 thru 0x02e465 (0x4be6 bytes) 000271 1788845515.825086 read 0x00c0bb thru 0x01221a (0x6160 bytes) 000273 1788845515.838287 punch from 0x00dba1 to 0x01834b (0xa7ab bytes) 000274 1788845515.845797 trunc from 0x03a740 to 0x02850a (0x12235 bytes) 000275 1788845515.894361 mapread 0x012e47 thru 0x020110 (0xd2ca bytes) 000276 1788845515.928731 trunc from 0x02850b to 0x031ffe (0x9af4 bytes) 000277 1788845515.955897 write 0x00863e thru 0x01127d (0x8c40 bytes) 000278 1788845515.966803 MIRROR_RESYNC 2 mirrors 000279 1788845516.615103 trunc from 0x031fff to 0x001e2d (0x301d1 bytes) 000280 1788845516.683979 fallocate 0x01ebd6 thru 0x02cf12 (0xe33d bytes) 000281 1788845516.696541 write 0x02da30 thru 0x0346ab (0x6c7c bytes) 000282 1788845516.698785 trunc from 0x0346ac to 0x01d587 (0x17124 bytes) 000283 1788845516.726237 trunc from 0x004354 to 0x00d873 (0x9520 bytes) 000284 1788845516.731350 trunc from 0x00dfde to 0x013c99 (0x5cbc bytes) 000285 1788845516.736123 mapwrite 0x01cfe1 thru 0x021c57 (0x4c77 bytes) 000286 1788845516.810881 mapwrite 0x02c49f thru 0x03c11d (0xfc7f bytes) 000287 1788845516.885699 mapread 0x0039d2 thru 0x00f6c1 (0xbcf0 bytes) 000288 1788845516.897565 trunc from 0x000aee to 0x001346 (0x859 bytes) 000289 1788845516.903897 punch from 0x039406 to 0x03c11d (0x2d18 bytes) 000290 1788845516.909197 trunc from 0x03c11e to 0x03ac16 (0x1507 bytes) 000291 1788845516.923227 mapread 0x0294b0 thru 0x0311fb (0x7d4c bytes) 000292 1788845516.925243 mapread 0x00ce49 thru 0x012cc0 (0x5e78 bytes) 000293 1788845516.933442 read 0x002123 thru 0x007ff2 (0x5ed0 bytes) 000294 1788845516.934292 trunc from 0x01e28c to 0x023444 (0x51b9 bytes) 000295 1788845516.939284 write 0x027b0d thru 0x02cbb7 (0x50ab bytes) 000296 1788845516.941438 read 0x01ab56 thru 0x02aa30 (0xfedb bytes) 000297 1788845516.951088 mapwrite 0x0288cb thru 0x031ef1 (0x9627 bytes) 000298 1788845516.965756 write 0x0028fb thru 0x00b9f4 (0x90fa bytes) 000299 1788845516.967137 write 0x01044b thru 0x01665c (0x6212 bytes) 000300 1788845516.969135 write 0x020fa1 thru 0x02c41b (0xb47b bytes) 000301 1788845516.971133 write 0x019cc9 thru 0x01a4a9 (0x7e1 bytes) 000302 1788845516.972588 trunc from 0x03ac17 to 0x03f878 (0x4c62 bytes) 000303 1788845516.988575 read 0x021db7 thru 0x028994 (0x6bde bytes) 000304 1788845516.989275 write 0x01ef1f thru 0x02b8c1 (0xc9a3 bytes) 000305 1788845516.991612 mapread 0x011d95 thru 0x01dcf1 (0xbf5d bytes) 000306 1788845516.993054 trunc from 0x03f879 to 0x03be98 (0x39e0 bytes) 000307 1788845517.006302 trunc from 0x0179e7 to 0x01a839 (0x2e53 bytes) 000308 1788845517.022019 punch from 0x02a521 to 0x0345e9 (0xa0c9 bytes) 000309 1788845517.027425 read 0x008687 thru 0x012ba2 (0xa51c bytes) 000310 1788845517.028256 mapwrite 0x01ffda thru 0x02f37a (0xf3a1 bytes) 000311 1788845517.059674 trunc from 0x013aec to 0x021862 (0xdd77 bytes) 000312 1788845517.065299 trunc from 0x03be99 to 0x0173cd (0x24acb bytes) 000313 1788845517.079777 mapread 0x017087 thru 0x0173cd (0x347 bytes) 000314 1788845517.085222 trunc from 0x0173ce to 0x025765 (0xe398 bytes) 000316 1788845517.100007 mapwrite 0x027778 thru 0x02c7e3 (0x506c bytes) 000318 1788845517.156779 mapread 0x018ea7 thru 0x01b170 (0x22ca bytes) 000319 1788845517.186679 MIRROR_RESYNC 2 mirrors 000320 1788845517.761575 punch from 0x0128ec to 0x01e7b4 (0xbec9 bytes) 000321 1788845517.808211 write 0x018d33 thru 0x01e8e6 (0x5bb4 bytes) 000322 1788845517.818910 mapwrite 0x0221a8 thru 0x02edc3 (0xcc1c bytes) 000323 1788845517.938196 punch from 0x00e670 to 0x01211f (0x3ab0 bytes) 000324 1788845517.946187 fallocate 0x028fac thru 0x0310a9 (0x80fe bytes) 000325 1788845517.950576 trunc from 0x00e4d0 to 0x01e041 (0xfb72 bytes) 000326 1788845517.955194 trunc from 0x018b43 to 0x0278ac (0xed6a bytes) 000327 1788845517.960811 write 0x021854 thru 0x02d461 (0xbc0e bytes) 000328 1788845517.967412 mapwrite 0x02cd40 thru 0x0379ee (0xacaf bytes) 000329 1788845518.020179 mapread 0x02876c thru 0x02b6a5 (0x2f3a bytes) 000330 1788845518.023082 write 0x01853c thru 0x020720 (0x81e5 bytes) 000331 1788845518.033900 read 0x025d6c thru 0x02cf4b (0x71e0 bytes) 000332 1788845518.034505 fallocate 0x0341f9 thru 0x03a613 (0x641b bytes) 000333 1788845518.052821 punch from 0x01d24d to 0x029511 (0xc2c5 bytes) 000334 1788845518.079274 punch from 0x00b9bb to 0x013074 (0x76ba bytes) 000335 1788845518.084537 mapwrite 0x02523c thru 0x02df43 (0x8d08 bytes) 000336 1788845518.131758 trunc from 0x0379ef to 0x0105c6 (0x27428 bytes) 000337 1788845518.175674 punch from 0x00ae3b to 0x0105c6 (0x578c bytes) 000338 1788845518.184093 read 0x00a573 thru 0x0105c6 (0x6054 bytes) 000339 1788845518.198454 punch from 0x0060b2 to 0x008abd (0x2a0c bytes) 000340 1788845518.211761 punch from 0x00ff6e to 0x0105c6 (0x659 bytes) 000341 1788845518.217204 mapread 0x00715e thru 0x009217 (0x20ba bytes) 000342 1788845518.230811 mapread 0x00699a thru 0x00dc31 (0x7298 bytes) 000343 1788845518.237160 punch from 0x006de8 to 0x00f4bd (0x86d6 bytes) 000344 1788845518.243031 trunc from 0x00e09e to 0x0105c6 (0x2529 bytes) 000345 1788845518.248067 trunc from 0x00e841 to 0x00f8c9 (0x1089 bytes) 000346 1788845518.254370 write 0x00bb66 thru 0x0190f8 (0xd593 bytes) 000347 1788845518.267021 trunc from 0x0074b3 to 0x00c90d (0x545b bytes) 000348 1788845518.284266 mapwrite 0x037d8d thru 0x03ded1 (0x6145 bytes) 000349 1788845518.329421 trunc from 0x03b64e to 0x03ded1 (0x2884 bytes) 000350 1788845518.336124 mapwrite 0x0234b2 thru 0x02f10d (0xbc5c bytes) 000351 1788845518.359030 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) 000352 1788845518.490077 write 0x028498 thru 0x037ae2 (0xf64b bytes) 000353 1788845518.504237 mapwrite 0x02f448 thru 0x03cd9a (0xd953 bytes) 000355 1788845518.544380 write 0x0101dc thru 0x012e04 (0x2c29 bytes) 000356 1788845518.560725 trunc from 0x03ded2 to 0x00c3e4 (0x31aed bytes) 000357 1788845518.582479 punch from 0x006685 to 0x00c3e4 (0x5d60 bytes) 000358 1788845518.586388 trunc from 0x003085 to 0x00c30b (0x9287 bytes) 000359 1788845518.596057 write 0x024595 thru 0x02abd1 (0x663d bytes) 000360 1788845518.598177 fallocate 0x007a9c thru 0x0141cf (0xc734 bytes) 000362 1788845518.605094 trunc from 0x02abd2 to 0x035628 (0xaa57 bytes) 000364 1788845518.624348 read 0x02f137 thru 0x03362a (0x44f4 bytes) 000365 1788845518.634605 trunc from 0x009a4a to 0x00ad7e (0x1335 bytes) 000366 1788845518.637992 write 0x037398 thru 0x03c105 (0x4d6e bytes) 000367 1788845518.639718 trunc from 0x0228e9 to 0x02c879 (0x9f91 bytes) 000368 1788845518.652662 mapwrite 0x031f80 thru 0x03ed94 (0xce15 bytes) 000369 1788845518.719233 punch from 0x028438 to 0x030681 (0x824a bytes) 000370 1788845518.728430 write 0x00987c thru 0x013755 (0x9eda bytes) 000371 1788845518.740136 punch from 0x035a99 to 0x03dfc2 (0x852a bytes) 000373 1788845518.746349 fallocate 0x00da69 thru 0x00e00c (0x5a4 bytes) 000375 1788845518.752041 write 0x00a643 thru 0x015b77 (0xb535 bytes) 000376 1788845518.760616 mapwrite 0x019f15 thru 0x01ae52 (0xf3e bytes) 000377 1788845518.797653 punch from 0x034cb0 to 0x03ed94 (0xa0e5 bytes) 000378 1788845518.804746 punch from 0x009695 to 0x01068e (0x6ffa bytes) 000379 1788845518.813789 trunc from 0x03ed95 to 0x001dc3 (0x3cfd1 bytes) 000380 1788845518.836356 fallocate 0x015be5 thru 0x01f1c5 (0x95e1 bytes) 000381 1788845518.845680 read 0x01a690 thru 0x01f1c5 (0x4b36 bytes) 000382 1788845518.859522 trunc from 0x00b16f to 0x012d44 (0x7bd6 bytes) 000383 1788845518.864828 fallocate 0x02853d thru 0x035ba8 (0xd66c bytes) 000384 1788845518.869819 write 0x00001a thru 0x00d433 (0xd41a bytes) 000385 1788845518.880040 trunc from 0x035ba9 to 0x02df21 (0x7c87 bytes) 000386 1788845518.893714 punch from 0x01e87f to 0x01fbec (0x136e bytes) 000387 1788845518.899572 punch from 0x0183ec to 0x01af5a (0x2b6f bytes) 000388 1788845518.906665 write 0x036e3e thru 0x037198 (0x35b bytes) 000389 1788845518.909137 trunc from 0x037199 to 0x03792d (0x795 bytes) 000390 1788845518.929718 write 0x01dd69 thru 0x02b1ae (0xd446 bytes) 000393 1788845518.940003 mapread 0x00eb56 thru 0x0175d3 (0x8a7e bytes) 000394 1788845518.984696 write 0x029b42 thru 0x034eff (0xb3be bytes) 000395 1788845518.995472 punch from 0x02e227 to 0x032c72 (0x4a4c bytes) 000396 1788845519.022831 punch from 0x02edf5 to 0x035cf5 (0x6f01 bytes) 000397 1788845519.032035 mapread 0x007135 thru 0x009cf7 (0x2bc3 bytes) 000398 1788845519.034092 punch from 0x025f74 to 0x03550c (0xf599 bytes) 000399 1788845519.044014 mapwrite 0x0362b6 thru 0x03ffff (0x9d4a bytes) 000400 1788845519.148700 trunc from 0x040000 to 0x027620 (0x189df bytes) 000402 1788845519.183583 MIRROR_EXTEND to 2 mirrors 000403 1788845519.892574 write 0x03eeb1 thru 0x03ffff (0x114f bytes) 000404 1788845519.951274 write 0x030629 thru 0x032d13 (0x26eb bytes) 000405 1788845519.966663 read 0x02e485 thru 0x032d60 (0x48dc bytes) 000406 1788845519.979278 punch from 0x021173 to 0x02861f (0x74ad bytes) 000407 1788845519.996105 fallocate 0x00bfd1 thru 0x018f78 (0xcfa8 bytes) 000409 1788845520.018343 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xdf11cef8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc4d9b446 Mirror 3: 0xc4d9b446 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000410 1788845521.026844 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) 000411 1788845521.361215 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) 000412 1788845521.476873 write 0x01b96f thru 0x01f2bd (0x394f bytes) 000413 1788845521.504731 trunc from 0x040000 to 0x021c2a (0x1e3d5 bytes) 000414 1788845521.523548 trunc from 0x021c2b to 0x0142bf (0xd96b bytes) 000415 1788845521.543142 mapread 0x00369f thru 0x011a4f (0xe3b1 bytes) 000416 1788845521.583702 trunc from 0x00e3f1 to 0x0142bf (0x5ecf bytes) 000417 1788845521.589463 mapread 0x00b743 thru 0x00d746 (0x2004 bytes) 000418 1788845521.590821 trunc from 0x00b2d2 to 0x0142bf (0x8fee bytes) 000419 1788845521.604111 punch from 0x0130fd to 0x0142bf (0x11c3 bytes) 000420 1788845521.610803 fallocate 0x024deb thru 0x032263 (0xd479 bytes) 000421 1788845521.617134 fallocate 0x015ea0 thru 0x01a2a0 (0x4401 bytes) 000422 1788845521.625065 write 0x010fc0 thru 0x020233 (0xf274 bytes) 000423 1788845521.643778 fallocate 0x000cde thru 0x00d1b8 (0xc4db bytes) 000424 1788845521.649258 trunc from 0x00357c to 0x00f3d7 (0xbe5c bytes) 000425 1788845521.655564 mapwrite 0x0333bd thru 0x033f8b (0xbcf bytes) 000426 1788845521.701894 mapwrite 0x018ea4 thru 0x01ba50 (0x2bad bytes) 000427 1788845521.719944 trunc from 0x003093 to 0x012cbd (0xfc2b bytes) 000428 1788845521.725053 read 0x030881 thru 0x033f8b (0x370b bytes) 000430 1788845521.726582 trunc from 0x0211fa to 0x0231e7 (0x1fee bytes) 000432 1788845521.732004 mapwrite 0x02670c thru 0x032c52 (0xc547 bytes) 000433 1788845521.774749 trunc from 0x033f8c to 0x019a57 (0x1a534 bytes) 000434 1788845521.803390 punch from 0x0154c1 to 0x017095 (0x1bd5 bytes) 000435 1788845521.817292 punch from 0x00e819 to 0x013bdf (0x53c7 bytes) 000436 1788845521.835543 MIRROR_EXTEND to 2 mirrors 000437 1788845522.600348 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) 000438 1788845522.739298 trunc from 0x012e8e to 0x018a0d (0x5b80 bytes) 000439 1788845522.760048 trunc from 0x002d8e to 0x011bc1 (0xee34 bytes) 000440 1788845522.767980 MIRROR_EXTEND to 2 mirrors 000441 1788845523.510117 fallocate 0x005a5a thru 0x00f5f1 (0x9b98 bytes) 000442 1788845523.547429 write 0x00da0c thru 0x00e06a (0x65f bytes) 000443 1788845523.565183 write 0x01ee71 thru 0x01ef11 (0xa1 bytes) 000444 1788845523.573257 fallocate 0x007be0 thru 0x00ab41 (0x2f62 bytes) 000445 1788845523.582351 MIRROR_RESYNC 2 mirrors 000446 1788845524.321039 trunc from 0x01ef12 to 0x030bfb (0x11cea bytes) 000447 1788845524.382730 write 0x02b819 thru 0x0338d9 (0x80c1 bytes) 000449 1788845524.391483 trunc from 0x0338da to 0x006d34 (0x2cba5 bytes) 000450 1788845524.445998 fallocate 0x01adb4 thru 0x0265f1 (0xb83e bytes) 000451 1788845524.457314 mapread 0x01fbbb thru 0x020e29 (0x126f bytes) 000452 1788845524.476814 read 0x016aa9 thru 0x02273a (0xbc92 bytes) 000453 1788845524.486408 punch from 0x009eb1 to 0x00d891 (0x39e1 bytes) 000456 1788845524.493788 write 0x005527 thru 0x00eabd (0x9597 bytes) 000457 1788845524.509345 read 0x00f0db thru 0x00ff94 (0xeba bytes) 000458 1788845524.523273 mapread 0x01aacd thru 0x0265f1 (0xbb25 bytes) 000459 1788845524.524686 trunc from 0x012106 to 0x0210f3 (0xefee bytes) 000461 1788845524.529586 trunc from 0x0265f2 to 0x037eeb (0x118fa bytes) 000462 1788845524.542186 mapwrite 0x01d2d2 thru 0x028155 (0xae84 bytes) 000463 1788845524.588742 read 0x0172bf thru 0x01e7dc (0x751e bytes) 000464 1788845524.613208 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x37eec): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37eec): Mirror 2: 0xa3bf453 (stale) CRC-32 checksum value for chunk [0, 0x37eec): Mirror 1: 0x680570a2 Mirror 3: 0x680570a2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37eec: skipped 000465 1788845525.568450 mapread 0x024044 thru 0x033447 (0xf404 bytes) 000466 1788845525.607714 trunc from 0x03330f to 0x037eeb (0x4bdd bytes) 000467 1788845525.646763 trunc from 0x037eec to 0x01089f (0x2764c bytes) 000468 1788845525.671557 read 0x002f7c thru 0x00e97f (0xba04 bytes) 000469 1788845525.683023 fallocate 0x003f7d thru 0x005eca (0x1f4e bytes) 000470 1788845525.688172 read 0x00ae5d thru 0x00d060 (0x2204 bytes) 000471 1788845525.692070 mapwrite 0x030790 thru 0x038f3e (0x87af bytes) 000472 1788845525.737017 write 0x0234ca thru 0x02d16b (0x9ca2 bytes) 000474 1788845525.740113 write 0x0181c2 thru 0x019c4a (0x1a89 bytes) 000475 1788845525.741119 punch from 0x01aa64 to 0x0260ec (0xb689 bytes) 000476 1788845525.756369 trunc from 0x00a05c to 0x00bd3b (0x1ce0 bytes) 000477 1788845525.761290 trunc from 0x038f3f to 0x00d4fa (0x2ba44 bytes) 000478 1788845525.777802 read 0x008358 thru 0x00c54c (0x41f5 bytes) 000479 1788845525.786276 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xd4fb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd4fb): Mirror 2: 0x208a1627 (stale) Mirror 3: 0x62607596 (stale) CRC-32 checksum value for chunk [0, 0xd4fb): Mirror 1: 0x80c34e5f Mirror 4: 0x80c34e5f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd4fb: skipped 000480 1788845526.764182 trunc from 0x00aea1 to 0x00d4fa (0x265a bytes) 000481 1788845526.829314 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xd4fb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd4fb): Mirror 2: 0x208a1627 (stale) Mirror 3: 0x62607596 (stale) Mirror 4: 0x80c34e5f (stale) CRC-32 checksum value for chunk [0, 0xd4fb): Mirror 1: 0x5db319d2 Mirror 5: 0x5db319d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd4fb: skipped 000482 1788845528.035828 read 0x0094b0 thru 0x009eac (0x9fd bytes) 000483 1788845528.050272 punch from 0x0099db to 0x00d4fa (0x3b20 bytes) 000484 1788845528.131989 trunc from 0x004b87 to 0x00b6e9 (0x6b63 bytes) 000485 1788845528.145382 trunc from 0x00d4fb to 0x01fe7c (0x12982 bytes) 000486 1788845528.203258 mapwrite 0x030e85 thru 0x0351f1 (0x436d bytes) 000487 1788845528.310797 MIRROR_RESYNC 5 mirrors 000488 1788845529.580600 read 0x01a752 thru 0x026ba5 (0xc454 bytes) 000489 1788845529.606494 trunc from 0x00565e to 0x00ea24 (0x93c7 bytes) 000490 1788845529.698222 trunc from 0x0351f2 to 0x016ab6 (0x1e73b bytes) 000492 1788845529.735589 mapread 0x00b4a2 thru 0x016ab6 (0xb615 bytes) 000494 1788845529.765469 trunc from 0x016ab7 to 0x00d626 (0x9490 bytes) 000495 1788845529.795971 write 0x01ef17 thru 0x02a7ea (0xb8d4 bytes) 000496 1788845529.800544 mapread 0x00fdc2 thru 0x01dc0f (0xde4e bytes) 000497 1788845529.816809 read 0x01cd5b thru 0x02a7ea (0xda90 bytes) 000498 1788845529.830495 MIRROR_RESYNC 5 mirrors 000499 1788845530.949188 mapread 0x0115c4 thru 0x0127e1 (0x121e bytes) 000500 1788845530.957714 mapwrite 0x01d4ee thru 0x01d58b (0x9e bytes) 000501 1788845531.085075 mapwrite 0x01a412 thru 0x01ad4e (0x93d bytes) 000502 1788845531.103037 punch from 0x016661 to 0x022e0a (0xc7aa bytes) 000503 1788845531.112122 trunc from 0x018ae7 to 0x01f589 (0x6aa3 bytes) 000504 1788845531.120992 mapread 0x00cc32 thru 0x018a3a (0xbe09 bytes) 000505 1788845531.157279 mapwrite 0x023e57 thru 0x02a448 (0x65f2 bytes) 000506 1788845531.207071 mapwrite 0x01f847 thru 0x02c928 (0xd0e2 bytes) 000507 1788845531.281943 punch from 0x0207f2 to 0x0232ec (0x2afb bytes) 000508 1788845531.290978 mapread 0x0251a0 thru 0x026fed (0x1e4e bytes) 000509 1788845531.294225 mapwrite 0x005f30 thru 0x008036 (0x2107 bytes) 000511 1788845531.330702 read 0x012f8d thru 0x01a70d (0x7781 bytes) 000512 1788845531.340001 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2c929): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c929): Mirror 2: 0xbaed60f3 (stale) Mirror 3: 0xbaed60f3 (stale) Mirror 4: 0xbaed60f3 (stale) Mirror 5: 0xbaed60f3 (stale) CRC-32 checksum value for chunk [0, 0x2c929): Mirror 1: 0x1ce9652f Mirror 6: 0x1ce9652f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c929: skipped 000513 1788845532.326670 write 0x01fef4 thru 0x02a1dd (0xa2ea bytes) 000514 1788845532.373448 write 0x036378 thru 0x036a9b (0x724 bytes) 000515 1788845532.374539 trunc from 0x0094ba to 0x00aafc (0x1643 bytes) 000517 1788845532.380166 mapwrite 0x03ed56 thru 0x03ffff (0x12aa bytes) 000518 1788845532.464123 fallocate 0x00b0ef thru 0x01612f (0xb041 bytes) 000519 1788845532.473324 punch from 0x03a72f to 0x03d96c (0x323e bytes) 000520 1788845532.477020 read 0x00b5f8 thru 0x0177f3 (0xc1fc bytes) 000521 1788845532.501211 punch from 0x01df0e to 0x029d35 (0xbe28 bytes) 000522 1788845532.507650 trunc from 0x040000 to 0x03a5e3 (0x5a1c bytes) 000523 1788845532.527724 mapread 0x00f72c thru 0x019529 (0x9dfe bytes) 000524 1788845532.559023 mapwrite 0x01015b thru 0x01dd08 (0xdbae bytes) 000526 1788845532.599774 trunc from 0x038c64 to 0x03a5e3 (0x1980 bytes) 000527 1788845532.617053 trunc from 0x03a5e4 to 0x02f64b (0xaf98 bytes) 000528 1788845532.664711 MIRROR_RESYNC 6 mirrors 000529 1788845534.700770 trunc from 0x02f64c to 0x03c7de (0xd193 bytes) 000531 1788845534.770242 write 0x013325 thru 0x013586 (0x262 bytes) 000532 1788845534.784676 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c7df): Mirror 2: 0x86041269 (stale) Mirror 3: 0x86041269 (stale) Mirror 4: 0x86041269 (stale) Mirror 5: 0x86041269 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c7df): Mirror 2: 0x86041269 (stale) Mirror 3: 0x86041269 (stale) Mirror 4: 0x86041269 (stale) Mirror 5: 0x86041269 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c7df: skipped 000533 1788845535.215211 mapwrite 0x017939 thru 0x0218f3 (0x9fbb bytes) 000535 1788845535.256151 write 0x0386d6 thru 0x03ffff (0x792a bytes) 000536 1788845535.265125 write 0x01066f thru 0x018d77 (0x8709 bytes) 000537 1788845535.271075 mapwrite 0x00cc78 thru 0x0151c4 (0x854d bytes) 000538 1788845535.295509 trunc from 0x0220ab to 0x02883d (0x6793 bytes) 000539 1788845535.300230 read 0x02a74c thru 0x030f05 (0x67ba bytes) 000541 1788845535.308926 trunc from 0x040000 to 0x00130e (0x3ecf1 bytes) 000542 1788845535.324510 trunc from 0x000614 to 0x00130e (0xcfb bytes) 000543 1788845535.329192 write 0x0065d0 thru 0x00cf21 (0x6952 bytes) 000544 1788845535.331785 write 0x0223d7 thru 0x0313c0 (0xefea bytes) 000545 1788845535.336208 write 0x025368 thru 0x0277b3 (0x244c bytes) 000546 1788845535.337191 trunc from 0x02cf2e to 0x0313c0 (0x4493 bytes) 000547 1788845535.351968 read 0x02c603 thru 0x02c9de (0x3dc bytes) 000548 1788845535.361265 fallocate 0x03150d thru 0x03cbce (0xb6c2 bytes) 000549 1788845535.365566 write 0x0237bd thru 0x02ee91 (0xb6d5 bytes) 000550 1788845535.368680 read 0x01f52f thru 0x0287b9 (0x928b bytes) 000551 1788845535.369448 trunc from 0x00e360 to 0x012749 (0x43ea bytes) 000552 1788845535.374680 read 0x00bc7f thru 0x0120ac (0x642e bytes) 000553 1788845535.393517 punch from 0x01db3e to 0x023671 (0x5b34 bytes) 000554 1788845535.417265 trunc from 0x00a26c to 0x00dda6 (0x3b3b bytes) 000555 1788845535.427261 MIRROR_RESYNC 5 mirrors 000556 1788845537.015457 mapwrite 0x00d552 thru 0x019cbd (0xc76c bytes) 000557 1788845537.107660 write 0x008469 thru 0x011277 (0x8e0f bytes) 000558 1788845537.109029 mapwrite 0x03c4c5 thru 0x03ffff (0x3b3b bytes) 000559 1788845537.155210 trunc from 0x040000 to 0x00bb9b (0x34464 bytes) 000560 1788845537.170734 write 0x030b4a thru 0x03a902 (0x9db9 bytes) 000561 1788845537.173036 write 0x020273 thru 0x02b067 (0xadf5 bytes) 000562 1788845537.183804 trunc from 0x03a903 to 0x03e2c5 (0x39c3 bytes) 000563 1788845537.198339 mapwrite 0x01fe8b thru 0x0252ad (0x5423 bytes) 000564 1788845537.224086 read 0x02122d thru 0x02a8d8 (0x96ac bytes) 000565 1788845537.224673 mapread 0x0351b5 thru 0x03e2c5 (0x9111 bytes) 000566 1788845537.232039 punch from 0x02320b to 0x02c1ab (0x8fa1 bytes) 000567 1788845537.237931 fallocate 0x00882a thru 0x00ea88 (0x625f bytes) 000568 1788845537.242518 punch from 0x015967 to 0x01a87e (0x4f18 bytes) 000569 1788845537.247171 mapwrite 0x00a5da thru 0x012505 (0x7f2c bytes) 000571 1788845537.286580 mapwrite 0x016a15 thru 0x01b396 (0x4982 bytes) 000572 1788845537.352921 read 0x0358e4 thru 0x03b81f (0x5f3c bytes) 000573 1788845537.354035 mapwrite 0x019a38 thru 0x01d4e8 (0x3ab1 bytes) 000574 1788845537.394688 trunc from 0x005337 to 0x00644c (0x1116 bytes) 000575 1788845537.400636 punch from 0x00c18c to 0x014cd3 (0x8b48 bytes) 000576 1788845537.411734 punch from 0x02a1a0 to 0x036982 (0xc7e3 bytes) 000577 1788845537.418735 mapwrite 0x024084 thru 0x02598e (0x190b bytes) 000578 1788845537.440411 fallocate 0x026b95 thru 0x02ad10 (0x417c bytes) 000579 1788845537.446105 trunc from 0x03ac24 to 0x03e2c5 (0x36a2 bytes) 000581 1788845537.459497 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3e2c6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e2c6): Mirror 2: 0x3a023b27 (stale) Mirror 3: 0x3a023b27 (stale) Mirror 4: 0x3a023b27 (stale) Mirror 5: 0x3a023b27 (stale) CRC-32 checksum value for chunk [0, 0x3e2c6): Mirror 1: 0x45135728 Mirror 6: 0x45135728 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e2c6: skipped 000582 1788845538.848836 mapwrite 0x0166ae thru 0x01bda3 (0x56f6 bytes) 000583 1788845538.972942 mapread 0x01aa5c thru 0x0216a2 (0x6c47 bytes) 000584 1788845538.984765 write 0x01872d thru 0x018d18 (0x5ec bytes) 000585 1788845538.990598 mapwrite 0x020a56 thru 0x02fdcf (0xf37a bytes) 000586 1788845539.022496 punch from 0x00c9c7 to 0x017fdf (0xb619 bytes) 000587 1788845539.027226 mapread 0x00b9ab thru 0x0153b2 (0x9a08 bytes) 000588 1788845539.046164 mapread 0x0019b1 thru 0x0037bf (0x1e0f bytes) 000589 1788845539.053633 punch from 0x00d03c to 0x01514b (0x8110 bytes) 000590 1788845539.062324 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e2c6): Mirror 2: 0x3a023b27 (stale) Mirror 3: 0x3a023b27 (stale) Mirror 5: 0x3a023b27 (stale) Mirror 6: 0x45135728 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e2c6): Mirror 2: 0x3a023b27 (stale) Mirror 3: 0x3a023b27 (stale) Mirror 5: 0x3a023b27 (stale) Mirror 6: 0x45135728 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e2c6: skipped 000591 1788845539.479186 read 0x01f208 thru 0x01f808 (0x601 bytes) 000592 1788845539.485165 mapread 0x01a496 thru 0x021b02 (0x766d bytes) 000593 1788845539.516356 read 0x026583 thru 0x028e2a (0x28a8 bytes) 000594 1788845539.534622 read 0x007a72 thru 0x01574e (0xdcdd bytes) 000595 1788845539.536185 mapread 0x018218 thru 0x01d498 (0x5281 bytes) 000596 1788845539.538006 mapread 0x01b9ff thru 0x026d47 (0xb349 bytes) 000597 1788845539.539611 fallocate 0x0184a5 thru 0x0230cb (0xac27 bytes) 000598 1788845539.545525 trunc from 0x03b314 to 0x03e2c5 (0x2fb2 bytes) 000599 1788845539.550173 mapread 0x004c58 thru 0x006c08 (0x1fb1 bytes) 000600 1788845539.551066 write 0x019665 thru 0x01d386 (0x3d22 bytes) 000601 1788845539.556422 fallocate 0x037b62 thru 0x03fef6 (0x8395 bytes) 000602 1788845539.562371 mapwrite 0x028c63 thru 0x028e01 (0x19f bytes) 000603 1788845539.579710 trunc from 0x03fef7 to 0x01f552 (0x209a4 bytes) 000604 1788845539.595696 mapwrite 0x0283ed thru 0x031124 (0x8d38 bytes) 000605 1788845539.660825 punch from 0x003fe0 to 0x0090c3 (0x50e4 bytes) 000606 1788845539.669647 read 0x015b2c thru 0x019a27 (0x3efc bytes) 000607 1788845539.671153 fallocate 0x00dc02 thru 0x00ecb9 (0x10b8 bytes) 000608 1788845539.678099 trunc from 0x031125 to 0x00bfa2 (0x25182 bytes) 000609 1788845539.706807 fallocate 0x01e608 thru 0x020439 (0x1e32 bytes) 000610 1788845539.716965 read 0x008186 thru 0x0086b0 (0x52b bytes) 000611 1788845539.748424 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xbfa3): Mirror 3: 0x8ecd0fb8 (stale) Mirror 5: 0x8ecd0fb8 (stale) Mirror 6: 0x9a92ef38 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbfa3): Mirror 3: 0x8ecd0fb8 (stale) Mirror 5: 0x8ecd0fb8 (stale) Mirror 6: 0x9a92ef38 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbfa3: skipped 000612 1788845540.188144 trunc from 0x001c62 to 0x00bfa2 (0xa341 bytes) 000613 1788845540.194676 trunc from 0x001077 to 0x004f46 (0x3ed0 bytes) 000614 1788845540.201725 mapread 0x00b429 thru 0x00bfa2 (0xb7a bytes) 000615 1788845540.207717 trunc from 0x00ba45 to 0x00bfa2 (0x55e bytes) 000616 1788845540.216613 read 0x008b62 thru 0x00bfa2 (0x3441 bytes) 000618 1788845540.224019 mapwrite 0x00e608 thru 0x0160bb (0x7ab4 bytes) 000620 1788845540.280251 write 0x01b0d7 thru 0x024193 (0x90bd bytes) 000621 1788845540.282905 fallocate 0x030b92 thru 0x03475a (0x3bc9 bytes) 000622 1788845540.291912 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3475b): Mirror 5: 0xec410ef0 (stale) Mirror 6: 0xfb951f75 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3475b): Mirror 5: 0xec410ef0 (stale) Mirror 6: 0xfb951f75 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3475b: skipped 000623 1788845540.735305 trunc from 0x02bdc4 to 0x03475a (0x8997 bytes) 000625 1788845540.745117 write 0x003295 thru 0x003e8d (0xbf9 bytes) 000627 1788845540.762763 read 0x0017b1 thru 0x006c22 (0x5472 bytes) 000628 1788845540.778340 write 0x0230b4 thru 0x028dc4 (0x5d11 bytes) 000629 1788845540.802460 trunc from 0x0271c9 to 0x03475a (0xd592 bytes) 000630 1788845540.818802 mapread 0x029698 thru 0x030c81 (0x75ea bytes) 000631 1788845540.846217 trunc from 0x031efb to 0x032f4a (0x1050 bytes) 000632 1788845540.850298 mapwrite 0x00972a thru 0x017b3b (0xe412 bytes) 000633 1788845540.883663 mapwrite 0x03d4c8 thru 0x03e4fb (0x1034 bytes) 000634 1788845540.941461 fallocate 0x011542 thru 0x01830e (0x6dcd bytes) 000635 1788845540.956765 MIRROR_RESYNC 3 mirrors 000636 1788845541.991513 MIRROR_RESYNC 3 mirrors 000637 1788845542.423936 trunc from 0x01a22b to 0x020dd0 (0x6ba6 bytes) 000638 1788845542.463771 trunc from 0x03e4fc to 0x00caff (0x319fc bytes) 000640 1788845542.488957 write 0x019bbc thru 0x019e6a (0x2af bytes) 000641 1788845542.489898 punch from 0x016551 to 0x019e6a (0x391a bytes) 000642 1788845542.503808 write 0x03e903 thru 0x03ffff (0x16fd bytes) 000643 1788845542.505277 punch from 0x03e2ee to 0x03ffff (0x1d12 bytes) 000644 1788845542.516999 fallocate 0x0152ab thru 0x01eff7 (0x9d4d bytes) 000645 1788845542.521480 read 0x03f67c thru 0x03ffff (0x984 bytes) 000646 1788845542.526100 punch from 0x0203a1 to 0x020406 (0x66 bytes) 000647 1788845542.530209 write 0x006a3a thru 0x00baf1 (0x50b8 bytes) 000648 1788845542.539146 read 0x01a375 thru 0x01b964 (0x15f0 bytes) 000651 1788845542.552589 mapread 0x03258b thru 0x03674b (0x41c1 bytes) 000652 1788845542.557236 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x7e879191 (stale) Mirror 6: 0x7e879191 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc52db87a Mirror 7: 0xc52db87a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000653 1788845543.487606 trunc from 0x0326f4 to 0x03a971 (0x827e bytes) 000654 1788845543.546632 trunc from 0x02e5b6 to 0x038bae (0xa5f9 bytes) 000655 1788845543.566189 trunc from 0x040000 to 0x0139fd (0x2c602 bytes) 000656 1788845543.643894 fallocate 0x01760d thru 0x01ad2e (0x3722 bytes) 000657 1788845543.658938 trunc from 0x006cdf to 0x014a1b (0xdd3d bytes) 000659 1788845543.667839 fallocate 0x011dcc thru 0x021386 (0xf5bb bytes) 000660 1788845543.678563 mapwrite 0x00fcd5 thru 0x01ca18 (0xcd44 bytes) 000661 1788845543.783967 fallocate 0x017221 thru 0x01a353 (0x3133 bytes) 000663 1788845543.789600 trunc from 0x001899 to 0x00c60e (0xad76 bytes) 000664 1788845543.794453 punch from 0x008049 to 0x00acd8 (0x2c90 bytes) 000665 1788845543.801655 fallocate 0x019bb2 thru 0x0271de (0xd62d bytes) 000666 1788845543.806341 fallocate 0x038317 thru 0x03ffff (0x7ce9 bytes) 000667 1788845543.811560 read 0x02216e thru 0x02c6c4 (0xa557 bytes) 000668 1788845543.825740 write 0x0371b9 thru 0x03983e (0x2686 bytes) 000669 1788845543.839090 mapread 0x01dceb thru 0x020073 (0x2389 bytes) 000671 1788845543.849233 mapwrite 0x01bd31 thru 0x024124 (0x83f4 bytes) 000672 1788845543.896148 MIRROR_RESYNC 4 mirrors 000673 1788845545.245259 mapwrite 0x029025 thru 0x02f585 (0x6561 bytes) 000674 1788845545.359301 mapwrite 0x017915 thru 0x0252ec (0xd9d8 bytes) 000675 1788845545.417383 mapread 0x028f28 thru 0x02e481 (0x555a bytes) 000677 1788845545.419170 mapread 0x03a932 thru 0x03b78d (0xe5c bytes) 000679 1788845545.441619 mapwrite 0x039cfa thru 0x03e6f0 (0x49f7 bytes) 000680 1788845545.465463 trunc from 0x024343 to 0x029fb7 (0x5c75 bytes) 000681 1788845545.474999 trunc from 0x040000 to 0x00daa9 (0x32556 bytes) 000682 1788845545.508701 punch from 0x009aed to 0x00daa9 (0x3fbd bytes) 000683 1788845545.515037 read 0x00d672 thru 0x00daa9 (0x438 bytes) 000684 1788845545.521154 read 0x004c2a thru 0x004d9c (0x173 bytes) 000685 1788845545.536667 mapread 0x00bf8a thru 0x00daa9 (0x1b20 bytes) 000686 1788845545.537560 mapread 0x00ca8e thru 0x00daa9 (0x101c bytes) 000687 1788845545.538318 fallocate 0x024f71 thru 0x0335a6 (0xe636 bytes) 000689 1788845545.554754 mapread 0x00586b thru 0x010e61 (0xb5f7 bytes) 000690 1788845545.571686 trunc from 0x026384 to 0x02adf8 (0x4a75 bytes) 000692 1788845545.577123 read 0x011d26 thru 0x01fb41 (0xde1c bytes) 000693 1788845545.577899 trunc from 0x0335a7 to 0x00e113 (0x25493 bytes) 000695 1788845545.593637 trunc from 0x006dfd to 0x00ba66 (0x4c6a bytes) 000696 1788845545.604504 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xe114): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe114): Mirror 5: 0xb15b86bc (stale) Mirror 6: 0xb15b86bc (stale) Mirror 7: 0xb15b86bc (stale) CRC-32 checksum value for chunk [0, 0xe114): Mirror 1: 0xb15b86bc Mirror 8: 0xb15b86bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe114: skipped 000697 1788845546.375226 mapread 0x0059f8 thru 0x00d400 (0x7a09 bytes) 000698 1788845546.406593 fallocate 0x00c17f thru 0x00ff4e (0x3dd0 bytes) 000700 1788845546.449629 write 0x0338c3 thru 0x03d80d (0x9f4b bytes) 000701 1788845546.454774 trunc from 0x03d80e to 0x01d8b4 (0x1ff59 bytes) 000702 1788845546.507879 write 0x01052c thru 0x01fc6b (0xf740 bytes) 000703 1788845546.515687 read 0x009326 thru 0x015f75 (0xcc50 bytes) 000704 1788845546.532692 mapread 0x002788 thru 0x00c944 (0xa1bd bytes) 000705 1788845546.540405 read 0x00f183 thru 0x01d69d (0xe51b bytes) 000706 1788845546.545604 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1fc6c): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fc6c): Mirror 5: 0xb5b10bb5 (stale) Mirror 6: 0xb5b10bb5 (stale) Mirror 7: 0xb5b10bb5 (stale) Mirror 8: 0x7934465d (stale) CRC-32 checksum value for chunk [0, 0x1fc6c): Mirror 1: 0x78383f5 Mirror 9: 0x78383f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fc6c: skipped 000707 1788845547.409402 read 0x001fad thru 0x00b13e (0x9192 bytes) 000708 1788845547.424688 read 0x01484c thru 0x01de09 (0x95be bytes) 000709 1788845547.440550 mapread 0x01893d thru 0x01fc6b (0x732f bytes) 000711 1788845547.468073 trunc from 0x01fc6c to 0x014bb3 (0xb0b8 bytes) 000712 1788845547.562137 read 0x01463b thru 0x014bb3 (0x579 bytes) 000713 1788845547.571274 write 0x0023cd thru 0x00b482 (0x90b6 bytes) 000714 1788845547.573095 punch from 0x009547 to 0x00fadf (0x6599 bytes) 000715 1788845547.605066 MIRROR_RESYNC 6 mirrors 000716 1788845548.873931 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) 000717 1788845549.228615 write 0x01a24f thru 0x0275a2 (0xd354 bytes) 000718 1788845549.264000 mapwrite 0x03a4c9 thru 0x03ffff (0x5b37 bytes) 000719 1788845549.331357 write 0x0056ae thru 0x00759d (0x1ef0 bytes) 000720 1788845549.342896 mapread 0x038e12 thru 0x0397da (0x9c9 bytes) 000721 1788845549.344552 read 0x0375e9 thru 0x03eb75 (0x758d bytes) 000723 1788845549.350038 MIRROR_RESYNC 5 mirrors 000724 1788845550.819313 MIRROR_RESYNC 5 mirrors 000725 1788845551.308668 punch from 0x03700a to 0x03ef93 (0x7f8a bytes) 000726 1788845551.344398 trunc from 0x01a5d4 to 0x01cff8 (0x2a25 bytes) 000727 1788845551.349295 mapread 0x00e659 thru 0x01a5da (0xbf82 bytes) 000728 1788845551.399382 trunc from 0x01a751 to 0x025193 (0xaa43 bytes) 000729 1788845551.409137 write 0x00c31f thru 0x014abd (0x879f bytes) 000730 1788845551.410688 mapwrite 0x008e10 thru 0x00a198 (0x1389 bytes) 000731 1788845551.454789 mapwrite 0x00bb6a thru 0x016409 (0xa8a0 bytes) 000732 1788845551.479660 mapread 0x03b5f9 thru 0x03ffff (0x4a07 bytes) 000733 1788845551.488742 punch from 0x016791 to 0x017147 (0x9b7 bytes) 000734 1788845551.494404 mapwrite 0x03d56a thru 0x03ffff (0x2a96 bytes) 000735 1788845551.507667 mapwrite 0x01fa45 thru 0x02951f (0x9adb bytes) 000736 1788845551.545214 mapwrite 0x00ff2f thru 0x01336a (0x343c bytes) 000737 1788845551.559674 write 0x002960 thru 0x003408 (0xaa9 bytes) 000738 1788845551.560968 mapwrite 0x011fbd thru 0x014746 (0x278a bytes) 000739 1788845551.574076 punch from 0x02fe73 to 0x03d385 (0xd513 bytes) 000740 1788845551.578239 fallocate 0x02c664 thru 0x034e65 (0x8802 bytes) 000741 1788845551.582774 write 0x02cbe3 thru 0x03068d (0x3aab bytes) 000742 1788845551.587717 write 0x02aef0 thru 0x03442c (0x953d bytes) 000744 1788845551.594341 trunc from 0x040000 to 0x02bf6f (0x14090 bytes) 000746 1788845551.613974 mapwrite 0x03e087 thru 0x03ffff (0x1f79 bytes) 000747 1788845551.651394 mapread 0x017dae thru 0x01c28b (0x44de bytes) 000748 1788845551.661489 write 0x012fb4 thru 0x014b58 (0x1ba5 bytes) 000749 1788845551.662629 read 0x0114d8 thru 0x01b04d (0x9b76 bytes) 000750 1788845551.664534 punch from 0x03f3c0 to 0x03ffff (0xc40 bytes) 000751 1788845551.670052 mapread 0x018237 thru 0x01bad1 (0x389b bytes) 000752 1788845551.671337 mapread 0x01b304 thru 0x02abcc (0xf8c9 bytes) 000753 1788845551.674029 read 0x03144e thru 0x033554 (0x2107 bytes) 000754 1788845551.687301 write 0x028ada thru 0x029da4 (0x12cb bytes) 000755 1788845551.691619 mapwrite 0x016c90 thru 0x019ad1 (0x2e42 bytes) 000756 1788845551.724345 punch from 0x01ade5 to 0x0242e2 (0x94fe bytes) 000757 1788845551.739351 read 0x011013 thru 0x01e82a (0xd818 bytes) 000758 1788845551.766502 trunc from 0x01f20c to 0x028656 (0x944b bytes) 000759 1788845551.776708 mapread 0x02e23b thru 0x036071 (0x7e37 bytes) 000760 1788845551.782259 punch from 0x02e974 to 0x039517 (0xaba4 bytes) 000761 1788845551.792394 trunc from 0x014a7c to 0x0236dc (0xec61 bytes) 000762 1788845551.807066 fallocate 0x00dcb9 thru 0x0158d2 (0x7c1a bytes) 000763 1788845551.815411 mapwrite 0x01a7d1 thru 0x02572c (0xaf5c bytes) 000764 1788845551.914991 write 0x02acb3 thru 0x02b364 (0x6b2 bytes) 000765 1788845551.917459 trunc from 0x036fd6 to 0x03b500 (0x452b bytes) 000766 1788845551.923895 mapread 0x023eb8 thru 0x02d9f2 (0x9b3b bytes) 000767 1788845551.946809 trunc from 0x0100cd to 0x014594 (0x44c8 bytes) 000768 1788845551.953567 fallocate 0x0063d1 thru 0x00a510 (0x4140 bytes) 000769 1788845551.965554 MIRROR_RESYNC 5 mirrors 000771 1788845553.223153 MIRROR_RESYNC 5 mirrors 000772 1788845553.886550 mapwrite 0x029347 thru 0x03778b (0xe445 bytes) 000773 1788845554.002611 mapread 0x014103 thru 0x01b4b4 (0x73b2 bytes) 000774 1788845554.010062 trunc from 0x0162c9 to 0x021a54 (0xb78c bytes) 000775 1788845554.018281 read 0x01db42 thru 0x027019 (0x94d8 bytes) 000776 1788845554.042512 write 0x00ca1e thru 0x0130dd (0x66c0 bytes) 000777 1788845554.056696 trunc from 0x010f21 to 0x01bddd (0xaebd bytes) 000778 1788845554.100262 punch from 0x00b97d to 0x0101bc (0x4840 bytes) 000779 1788845554.115405 trunc from 0x0246eb to 0x033134 (0xea4a bytes) 000780 1788845554.128604 punch from 0x0116c0 to 0x01c178 (0xaab9 bytes) 000781 1788845554.137030 punch from 0x00a44a to 0x0189cf (0xe586 bytes) 000782 1788845554.143560 fallocate 0x022fc8 thru 0x029f56 (0x6f8f bytes) 000783 1788845554.150764 fallocate 0x015412 thru 0x01ed55 (0x9944 bytes) 000784 1788845554.162776 write 0x015353 thru 0x0165da (0x1288 bytes) 000785 1788845554.183225 trunc from 0x017de8 to 0x025b42 (0xdd5b bytes) 000786 1788845554.193823 mapread 0x01328b thru 0x0176f9 (0x446f bytes) 000787 1788845554.223574 mapread 0x01fddb thru 0x02b6ee (0xb914 bytes) 000788 1788845554.255714 trunc from 0x040000 to 0x00bfed (0x34012 bytes) 000789 1788845554.290577 trunc from 0x004cd7 to 0x00a92e (0x5c58 bytes) 000790 1788845554.299039 mapread 0x000d32 thru 0x00805e (0x732d bytes) 000791 1788845554.317842 trunc from 0x00bfee to 0x0138d3 (0x78e6 bytes) 000793 1788845554.338637 read 0x005a63 thru 0x0071fb (0x1799 bytes) 000794 1788845554.340194 write 0x0211b0 thru 0x02882b (0x767c bytes) 000795 1788845554.343067 mapread 0x000e4b thru 0x0093b2 (0x8568 bytes) 000797 1788845554.344571 trunc from 0x02882c to 0x00fe5f (0x189cc bytes) 000798 1788845554.368622 trunc from 0x00fe60 to 0x02b8af (0x1ba50 bytes) 000799 1788845554.384157 trunc from 0x02b8b0 to 0x01be95 (0xfa1a bytes) 000800 1788845554.403746 trunc from 0x002ecb to 0x011e9d (0xefd3 bytes) 000801 1788845554.421114 MIRROR_RESYNC 5 mirrors 000803 1788845555.264357 mapwrite 0x01516c thru 0x01776c (0x2601 bytes) 000804 1788845555.381115 mapwrite 0x03e73b thru 0x03ffff (0x18c5 bytes) 000807 1788845555.504410 fallocate 0x0048bf thru 0x0139cb (0xf10d bytes) 000808 1788845555.511764 mapwrite 0x01f511 thru 0x021c4d (0x273d bytes) 000809 1788845555.541091 trunc from 0x040000 to 0x011259 (0x2eda6 bytes) 000810 1788845555.580620 trunc from 0x0076e7 to 0x011259 (0x9b73 bytes) 000811 1788845555.586138 fallocate 0x0212e3 thru 0x021758 (0x476 bytes) 000812 1788845555.591616 punch from 0x00d0b1 to 0x011259 (0x41a9 bytes) 000813 1788845555.599124 fallocate 0x034356 thru 0x03ffff (0xbcaa bytes) 000814 1788845555.606703 mapwrite 0x000a24 thru 0x00b58d (0xab6a bytes) 000816 1788845555.632935 mapwrite 0x03589f thru 0x03ffff (0xa761 bytes) 000817 1788845555.661095 trunc from 0x023733 to 0x023a14 (0x2e2 bytes) 000818 1788845555.665655 mapread 0x02669d thru 0x02fa32 (0x9396 bytes) 000819 1788845555.673702 mapwrite 0x018807 thru 0x021a28 (0x9222 bytes) 000820 1788845555.698551 MIRROR_RESYNC 5 mirrors 000822 1788845556.906721 write 0x03aa2a thru 0x03ffff (0x55d6 bytes) 000823 1788845556.934669 write 0x03c3ae thru 0x03ffff (0x3c52 bytes) 000824 1788845556.935833 trunc from 0x040000 to 0x02d7fc (0x12803 bytes) 000825 1788845556.954649 read 0x0219a3 thru 0x02a0e0 (0x873e bytes) 000826 1788845556.965739 mapread 0x0214ab thru 0x022c08 (0x175e bytes) 000827 1788845556.967643 fallocate 0x00581b thru 0x008d42 (0x3528 bytes) 000828 1788845556.971681 trunc from 0x025974 to 0x025d4e (0x3db bytes) 000829 1788845556.975138 read 0x02108c thru 0x0264dd (0x5452 bytes) 000830 1788845556.984394 trunc from 0x0184d5 to 0x01a348 (0x1e74 bytes) 000831 1788845556.988909 fallocate 0x039e8c thru 0x03ffff (0x6174 bytes) 000832 1788845556.994060 fallocate 0x0390c3 thru 0x03ffff (0x6f3d bytes) 000833 1788845556.998944 mapread 0x0347e0 thru 0x03f838 (0xb059 bytes) 000834 1788845557.008635 mapwrite 0x016448 thru 0x021b0e (0xb6c7 bytes) 000835 1788845557.044728 mapread 0x016ab5 thru 0x01c535 (0x5a81 bytes) 000837 1788845557.047080 fallocate 0x0282c9 thru 0x02a64b (0x2383 bytes) 000839 1788845557.057039 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x13b5b2c0 (stale) Mirror 6: 0x13b5b2c0 (stale) Mirror 9: 0x13b5b2c0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x13b5b2c0 (stale) Mirror 6: 0x13b5b2c0 (stale) Mirror 9: 0x13b5b2c0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000840 1788845557.524565 trunc from 0x040000 to 0x019cb2 (0x2634d bytes) 000841 1788845557.570345 mapwrite 0x00e90b thru 0x01b4e8 (0xcbde bytes) 000842 1788845557.675673 punch from 0x01288a to 0x017f26 (0x569d bytes) 000843 1788845557.686494 mapwrite 0x03ce83 thru 0x03ffff (0x317d bytes) 000844 1788845557.748067 punch from 0x000e1a to 0x00f656 (0xe83d bytes) 000845 1788845557.754069 punch from 0x00b911 to 0x010a54 (0x5144 bytes) 000846 1788845557.758683 read 0x016dc4 thru 0x0213ee (0xa62b bytes) 000847 1788845557.778132 mapwrite 0x02f7ad thru 0x02fe61 (0x6b5 bytes) 000849 1788845557.800836 punch from 0x035ded to 0x03ae79 (0x508d bytes) 000851 1788845557.811071 write 0x02d45c thru 0x03ce4a (0xf9ef bytes) 000852 1788845557.815329 punch from 0x00e3f9 to 0x00e420 (0x28 bytes) 000853 1788845557.823530 read 0x01730f thru 0x022d40 (0xba32 bytes) 000854 1788845557.837988 fallocate 0x0307d2 thru 0x0352b6 (0x4ae5 bytes) 000855 1788845557.843397 write 0x027333 thru 0x02a838 (0x3506 bytes) 000856 1788845557.845487 mapwrite 0x00a436 thru 0x017f0e (0xdad9 bytes) 000857 1788845557.870838 trunc from 0x040000 to 0x01676a (0x29895 bytes) 000859 1788845557.887756 punch from 0x01092a to 0x01676a (0x5e41 bytes) 000860 1788845557.893582 write 0x03fe67 thru 0x03ffff (0x199 bytes) 000861 1788845557.895105 punch from 0x01ee47 to 0x029346 (0xa500 bytes) 000862 1788845557.899511 mapwrite 0x00448a thru 0x00fe46 (0xb9bd bytes) 000863 1788845557.917722 mapread 0x019043 thru 0x027cb4 (0xec72 bytes) 000864 1788845558.002780 mapread 0x00afd0 thru 0x016341 (0xb372 bytes) 000866 1788845558.036549 mapread 0x017763 thru 0x023383 (0xbc21 bytes) 000867 1788845558.046755 trunc from 0x02d68e to 0x0365bf (0x8f32 bytes) 000868 1788845558.051775 mapwrite 0x0043a6 thru 0x0063a0 (0x1ffb bytes) 000869 1788845558.064126 read 0x029471 thru 0x0339b9 (0xa549 bytes) 000870 1788845558.078305 fallocate 0x01b464 thru 0x022961 (0x74fe bytes) 000871 1788845558.083845 trunc from 0x01650d to 0x022a72 (0xc566 bytes) 000872 1788845558.089201 mapread 0x01c9ac thru 0x02c54d (0xfba2 bytes) 000874 1788845558.127115 trunc from 0x005f63 to 0x012abb (0xcb59 bytes) 000875 1788845558.132976 punch from 0x0318d5 to 0x039c10 (0x833c bytes) 000876 1788845558.143096 fallocate 0x0090cf thru 0x017895 (0xe7c7 bytes) 000877 1788845558.151126 trunc from 0x040000 to 0x000c14 (0x3f3eb bytes) 000878 1788845558.172982 mapwrite 0x00fffd thru 0x01f7b2 (0xf7b6 bytes) 000879 1788845558.354479 mapread 0x0009ee thru 0x00cc82 (0xc295 bytes) 000880 1788845558.409759 mapread 0x0155c0 thru 0x01f7b2 (0xa1f3 bytes) 000881 1788845558.410919 mapwrite 0x01a813 thru 0x0262d9 (0xbac7 bytes) 000882 1788845558.512937 read 0x013b93 thru 0x01e7e5 (0xac53 bytes) 000884 1788845558.526048 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x262da): Mirror 5: 0xbd6562fc (stale) Mirror 6: 0xbd6562fc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x262da): Mirror 5: 0xbd6562fc (stale) Mirror 6: 0xbd6562fc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x262da: skipped 000885 1788845558.900822 punch from 0x0114d9 to 0x01e9f5 (0xd51d bytes) 000886 1788845558.907204 trunc from 0x01114c to 0x0117e8 (0x69d bytes) 000887 1788845558.912979 fallocate 0x031f45 thru 0x035cf2 (0x3dae bytes) 000888 1788845558.918671 mapwrite 0x011c6a thru 0x01e174 (0xc50b bytes) 000889 1788845558.966678 trunc from 0x035cf3 to 0x008062 (0x2dc90 bytes) 000891 1788845558.995302 trunc from 0x001ee0 to 0x008062 (0x6183 bytes) 000892 1788845559.000992 mapread 0x005230 thru 0x007ac2 (0x2893 bytes) 000894 1788845559.020661 trunc from 0x0078d2 to 0x008062 (0x791 bytes) 000896 1788845559.031179 MIRROR_RESYNC 3 mirrors 000897 1788845559.827398 write 0x0259db thru 0x029a83 (0x40a9 bytes) 000898 1788845559.869035 mapwrite 0x01091d thru 0x016920 (0x6004 bytes) 000899 1788845559.924803 mapread 0x01ca88 thru 0x0263a9 (0x9922 bytes) 000900 1788845559.958265 trunc from 0x00a26f to 0x018157 (0xdee9 bytes) 000901 1788845559.965366 mapwrite 0x00e116 thru 0x01abf9 (0xcae4 bytes) 000902 1788845560.046779 trunc from 0x01a23d to 0x01c41b (0x21df bytes) 000903 1788845560.058391 trunc from 0x029188 to 0x029a83 (0x8fc bytes) 000904 1788845560.067349 read 0x0290fc thru 0x029a83 (0x988 bytes) 000905 1788845560.078059 mapwrite 0x0032ee thru 0x005eee (0x2c01 bytes) 000906 1788845560.130563 MIRROR_RESYNC 3 mirrors 000907 1788845561.554665 punch from 0x01fc1c to 0x020f25 (0x130a bytes) 000908 1788845561.618064 trunc from 0x029a84 to 0x0075d4 (0x224af bytes) 000910 1788845561.679679 write 0x012c25 thru 0x01bcc0 (0x909c bytes) 000911 1788845561.695406 trunc from 0x00ad76 to 0x0151b3 (0xa43e bytes) 000912 1788845561.737004 punch from 0x018dfa to 0x0190a6 (0x2ad bytes) 000913 1788845561.746629 read 0x01700f thru 0x01bcc0 (0x4cb2 bytes) 000914 1788845561.764376 write 0x039e7e thru 0x03ecce (0x4e51 bytes) 000916 1788845561.776526 fallocate 0x01437f thru 0x01d1d9 (0x8e5b bytes) 000917 1788845561.802816 mapread 0x00e503 thru 0x013ba6 (0x56a4 bytes) 000918 1788845561.832354 fallocate 0x01da9b thru 0x02365f (0x5bc5 bytes) 000919 1788845561.839680 trunc from 0x010272 to 0x010a48 (0x7d7 bytes) 000920 1788845561.847453 trunc from 0x03eccf to 0x02bb35 (0x13199 bytes) 000921 1788845561.884590 trunc from 0x02bb36 to 0x00530e (0x26827 bytes) 000922 1788845561.901547 punch from 0x0030b0 to 0x00530e (0x225f bytes) 000923 1788845561.907065 mapread 0x0009d3 thru 0x00530e (0x493c bytes) 000924 1788845561.918692 mapwrite 0x02dfde thru 0x032c44 (0x4c67 bytes) 000925 1788845561.982740 mapread 0x00c530 thru 0x00e16a (0x1c3b bytes) 000926 1788845562.011186 mapwrite 0x005f75 thru 0x012fd2 (0xd05e bytes) 000927 1788845562.046628 fallocate 0x0394a7 thru 0x03ffff (0x6b59 bytes) 000928 1788845562.061078 trunc from 0x040000 to 0x035fec (0xa013 bytes) 000929 1788845562.081649 punch from 0x02308d to 0x027fd1 (0x4f45 bytes) 000930 1788845562.086963 read 0x01895a thru 0x020623 (0x7cca bytes) 000931 1788845562.098615 write 0x005927 thru 0x013a67 (0xe141 bytes) 000932 1788845562.100921 read 0x0059fa thru 0x00744e (0x1a55 bytes) 000933 1788845562.101768 mapwrite 0x008c90 thru 0x01809d (0xf40e bytes) 000934 1788845562.119678 punch from 0x01da86 to 0x01e07b (0x5f6 bytes) 000935 1788845562.123900 trunc from 0x0292b0 to 0x03064a (0x739b bytes) 000936 1788845562.130134 punch from 0x02ad2b to 0x035fec (0xb2c2 bytes) 000937 1788845562.137634 trunc from 0x035fed to 0x009967 (0x2c685 bytes) 000938 1788845562.175647 punch from 0x005231 to 0x009967 (0x4737 bytes) 000939 1788845562.187819 fallocate 0x039f4b thru 0x03ffff (0x60b5 bytes) 000940 1788845562.213140 MIRROR_RESYNC 3 mirrors 000941 1788845563.441305 fallocate 0x01beb7 thru 0x02b1cd (0xf317 bytes) 000942 1788845563.512453 fallocate 0x010868 thru 0x018479 (0x7c12 bytes) 000943 1788845563.531640 read 0x0069a8 thru 0x01056d (0x9bc6 bytes) 000944 1788845563.568453 trunc from 0x00336c to 0x0056dc (0x2371 bytes) 000945 1788845563.581136 mapread 0x03325d thru 0x03ffff (0xcda3 bytes) 000946 1788845563.655490 write 0x018eea thru 0x02598d (0xcaa4 bytes) 000948 1788845563.676952 punch from 0x007814 to 0x00bbfd (0x43ea bytes) 000949 1788845563.682680 punch from 0x0388df to 0x03b6f8 (0x2e1a bytes) 000950 1788845563.694186 punch from 0x031ab4 to 0x03ffff (0xe54c bytes) 000951 1788845563.700536 mapread 0x03d689 thru 0x03ffff (0x2977 bytes) 000952 1788845563.712191 mapread 0x008b39 thru 0x0090f2 (0x5ba bytes) 000953 1788845563.722292 trunc from 0x040000 to 0x02a4ab (0x15b54 bytes) 000954 1788845563.757195 mapwrite 0x020041 thru 0x023bba (0x3b7a bytes) 000955 1788845563.794153 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2a4ac): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a4ac): Mirror 5: 0x9a082090 (stale) Mirror 6: 0x9a082090 (stale) CRC-32 checksum value for chunk [0, 0x2a4ac): Mirror 1: 0xdf18e3b1 Mirror 7: 0xdf18e3b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a4ac: skipped 000956 1788845564.807655 mapwrite 0x02c4f5 thru 0x03a9c4 (0xe4d0 bytes) 000957 1788845564.925354 MIRROR_RESYNC 4 mirrors 000958 1788845566.317830 write 0x00c599 thru 0x010591 (0x3ff9 bytes) 000959 1788845566.350647 write 0x00364c thru 0x00954e (0x5f03 bytes) 000960 1788845566.361704 read 0x01bde2 thru 0x0267c2 (0xa9e1 bytes) 000961 1788845566.369051 write 0x03b22a thru 0x03ffff (0x4dd6 bytes) 000962 1788845566.370944 mapwrite 0x015f29 thru 0x01ffec (0xa0c4 bytes) 000963 1788845566.420751 trunc from 0x00f5ca to 0x00f7db (0x212 bytes) 000964 1788845566.426672 mapread 0x00e38d thru 0x0139d7 (0x564b bytes) 000966 1788845566.443001 mapwrite 0x00e709 thru 0x013c62 (0x555a bytes) 000967 1788845566.472423 MIRROR_RESYNC 4 mirrors 000968 1788845567.522704 mapwrite 0x039a72 thru 0x03ffff (0x658e bytes) 000969 1788845567.651833 punch from 0x008686 to 0x010730 (0x80ab bytes) 000970 1788845567.666341 trunc from 0x040000 to 0x02cfa8 (0x13057 bytes) 000971 1788845567.704600 punch from 0x02b32c to 0x02cfa8 (0x1c7d bytes) 000972 1788845567.713827 fallocate 0x0199a7 thru 0x0241dc (0xa836 bytes) 000973 1788845567.720111 read 0x0133f3 thru 0x015c62 (0x2870 bytes) 000975 1788845567.730223 trunc from 0x004b5c to 0x006a78 (0x1f1d bytes) 000976 1788845567.734957 read 0x011bdf thru 0x020488 (0xe8aa bytes) 000977 1788845567.750989 read 0x014d10 thru 0x01952e (0x481f bytes) 000978 1788845567.751997 trunc from 0x02a513 to 0x02cfa8 (0x2a96 bytes) 000979 1788845567.757145 mapread 0x003554 thru 0x0125d0 (0xf07d bytes) 000980 1788845567.758915 mapread 0x00ad4f thru 0x0177d4 (0xca86 bytes) 000981 1788845567.760597 mapwrite 0x01d0be thru 0x027142 (0xa085 bytes) 000982 1788845567.809608 MIRROR_RESYNC 4 mirrors 000983 1788845569.097676 mapread 0x022c33 thru 0x02caf1 (0x9ebf bytes) 000984 1788845569.123059 mapwrite 0x039501 thru 0x03e223 (0x4d23 bytes) 000985 1788845569.183199 trunc from 0x030876 to 0x03854f (0x7cda bytes) 000986 1788845569.189568 mapwrite 0x01b857 thru 0x022b26 (0x72d0 bytes) 000988 1788845569.236123 trunc from 0x00873f to 0x0137a7 (0xb069 bytes) 000989 1788845569.241886 read 0x012768 thru 0x018e07 (0x66a0 bytes) 000990 1788845569.247386 fallocate 0x00670f thru 0x00a7bb (0x40ad bytes) 000991 1788845569.258247 mapread 0x014d2a thru 0x01590c (0xbe3 bytes) 000992 1788845569.262141 punch from 0x02865f to 0x0292c3 (0xc65 bytes) 000993 1788845569.269583 read 0x01995d thru 0x01e956 (0x4ffa bytes) 000994 1788845569.270682 mapread 0x01f1d3 thru 0x027bfa (0x8a28 bytes) 000995 1788845569.285637 trunc from 0x03e224 to 0x00e62c (0x2fbf7 bytes) 000996 1788845569.311613 trunc from 0x0032bb to 0x00e62c (0xb372 bytes) 000998 1788845569.332527 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xe62d): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe62d): Mirror 5: 0xeca9898e (stale) Mirror 6: 0xeca9898e (stale) Mirror 7: 0xeca9898e (stale) CRC-32 checksum value for chunk [0, 0xe62d): Mirror 1: 0x859663ff Mirror 8: 0x859663ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe62d: skipped 000999 1788845570.217559 fallocate 0x02ae57 thru 0x0386c4 (0xd86e bytes) 001000 1788845570.251907 read 0x00faf7 thru 0x01db59 (0xe063 bytes) All operations completed A-OK!