== sanity-flr test 70a: flr mode fsx test ================ 00:30:44 (1789446644) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 6646 fallocating to largest ever: 0x338ae 000001 1789446647.011095 fallocate 0x02d218 thru 0x0338ad (0x6696 bytes) fallocating to largest ever: 0x40000 000002 1789446647.022026 fallocate 0x03838c thru 0x03ffff (0x7c74 bytes) 000005 1789446647.031473 punch from 0x031dcc to 0x033dd2 (0x2007 bytes) 000006 1789446647.036636 trunc from 0x040000 to 0x022771 (0x1d88e bytes) 000007 1789446647.059601 trunc from 0x022772 to 0x034c4c (0x124db bytes) 000009 1789446647.085078 trunc from 0x013b13 to 0x014e8d (0x137b bytes) 000010 1789446647.098294 read 0x027ed9 thru 0x02c0ed (0x4215 bytes) 000011 1789446647.109535 mapwrite 0x00c64d thru 0x0158a7 (0x925b bytes) 000012 1789446647.182048 write 0x02c8d1 thru 0x02cd83 (0x4b3 bytes) 000014 1789446647.183596 write 0x0056e7 thru 0x012fb0 (0xd8ca bytes) 000015 1789446647.193796 fallocate 0x031a64 thru 0x034ef1 (0x348e bytes) 000016 1789446647.206493 MIRROR_EXTEND to 2 mirrors 000017 1789446648.002759 MIRROR_EXTEND to 3 mirrors 000018 1789446648.751467 mapread 0x009245 thru 0x015977 (0xc733 bytes) 000020 1789446648.807466 punch from 0x02b41b to 0x0331bf (0x7da5 bytes) 000021 1789446648.857906 write 0x02a562 thru 0x032f78 (0x8a17 bytes) 000022 1789446648.876647 trunc from 0x003af7 to 0x00774b (0x3c55 bytes) 000023 1789446648.881966 read 0x01eb37 thru 0x027224 (0x86ee bytes) 000024 1789446648.892119 write 0x023338 thru 0x029006 (0x5ccf bytes) 000025 1789446648.899442 trunc from 0x027d31 to 0x02850b (0x7db bytes) 000026 1789446648.918606 write 0x015c54 thru 0x01c84c (0x6bf9 bytes) 000028 1789446648.929405 mapread 0x003d52 thru 0x004905 (0xbb4 bytes) 000029 1789446648.945438 mapread 0x0164a3 thru 0x022eb2 (0xca10 bytes) 000030 1789446648.958910 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34c4d): Mirror 3: 0x9b4537d2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34c4d): Mirror 3: 0x9b4537d2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34c4d: skipped 000031 1789446649.288736 trunc from 0x034c4d to 0x02134e (0x138fe bytes) 000032 1789446649.330346 punch from 0x01a551 to 0x02134e (0x6dfe bytes) 000033 1789446649.340527 write 0x01c00a thru 0x029487 (0xd47e bytes) 000034 1789446649.357323 MIRROR_RESYNC 2 mirrors 000035 1789446650.286566 trunc from 0x029488 to 0x0196fa (0xfd8d bytes) 000036 1789446650.364683 read 0x013677 thru 0x0196fa (0x6084 bytes) 000037 1789446650.384429 mapread 0x00c314 thru 0x0161f5 (0x9ee2 bytes) 000038 1789446650.429431 read 0x006ada thru 0x006e97 (0x3be bytes) 000039 1789446650.447865 punch from 0x002646 to 0x00acde (0x8699 bytes) 000040 1789446650.457052 trunc from 0x01057c to 0x0196fa (0x917f bytes) 000041 1789446650.465933 trunc from 0x0196fb to 0x014e8a (0x4870 bytes) 000042 1789446650.503795 punch from 0x00cb1c to 0x00ceb3 (0x398 bytes) 000043 1789446650.511122 trunc from 0x014e8b to 0x0099f4 (0xb496 bytes) 000044 1789446650.545667 mapwrite 0x02f506 thru 0x03dde9 (0xe8e4 bytes) 000045 1789446650.651587 read 0x03a3cc thru 0x03dde9 (0x3a1e bytes) 000046 1789446650.657872 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) 000047 1789446650.910529 read 0x03983f thru 0x03b6c0 (0x1e82 bytes) 000049 1789446650.918095 mapread 0x034aa2 thru 0x03501f (0x57e bytes) 000050 1789446650.955133 punch from 0x013c07 to 0x015bde (0x1fd8 bytes) 000051 1789446650.963806 fallocate 0x03d512 thru 0x03ffff (0x2aee bytes) 000052 1789446651.000574 MIRROR_EXTEND to 2 mirrors 000053 1789446651.783695 trunc from 0x03ddea to 0x01160c (0x2c7dd bytes) 000054 1789446651.838071 fallocate 0x010325 thru 0x01312c (0x2e08 bytes) 000055 1789446651.845541 trunc from 0x00002c to 0x003c96 (0x3c6b bytes) 000056 1789446651.853819 write 0x01240b thru 0x01d7a4 (0xb39a bytes) 000058 1789446651.857661 punch from 0x009df4 to 0x010812 (0x6a1f bytes) 000059 1789446651.863933 mapread 0x004c95 thru 0x009910 (0x4c7c bytes) 000060 1789446651.890775 trunc from 0x00108f to 0x0053bc (0x432e bytes) 000061 1789446651.896967 read 0x005ad7 thru 0x015705 (0xfc2f bytes) 000062 1789446651.908401 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1d7a5): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d7a5): Mirror 2: 0x3092de21 (stale) CRC-32 checksum value for chunk [0, 0x1d7a5): Mirror 1: 0x254117af Mirror 3: 0x254117af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d7a5: skipped 000063 1789446653.029583 mapread 0x006d85 thru 0x00d4b4 (0x6730 bytes) 000064 1789446653.071869 fallocate 0x00d9f9 thru 0x010898 (0x2ea0 bytes) 000065 1789446653.115927 mapwrite 0x01794e thru 0x023a59 (0xc10c bytes) 000066 1789446653.191111 punch from 0x0216e8 to 0x023a59 (0x2372 bytes) 000069 1789446653.202948 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23a5a): Mirror 2: 0x65d6503c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23a5a): Mirror 2: 0x65d6503c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23a5a: skipped 000072 1789446653.506767 read 0x01bbc2 thru 0x023a59 (0x7e98 bytes) 000073 1789446653.519503 trunc from 0x023a5a to 0x00b6ab (0x183ae bytes) 000074 1789446653.548850 fallocate 0x00fd05 thru 0x0120b5 (0x23b1 bytes) 000075 1789446653.565449 MIRROR_RESYNC 2 mirrors 000077 1789446654.076524 punch from 0x00aec4 to 0x0120b5 (0x71f2 bytes) 000081 1789446654.127735 mapwrite 0x01c128 thru 0x02a8bb (0xe794 bytes) 000083 1789446654.273474 mapwrite 0x00493a thru 0x00e254 (0x991b bytes) 000084 1789446654.327272 fallocate 0x03a933 thru 0x03ffff (0x56cd bytes) 000085 1789446654.334666 mapread 0x00cd35 thru 0x010023 (0x32ef bytes) 000086 1789446654.337541 mapwrite 0x03e1af thru 0x03ffff (0x1e51 bytes) 000087 1789446654.367543 mapwrite 0x0219e3 thru 0x02b8c4 (0x9ee2 bytes) 000088 1789446654.397868 punch from 0x01d7eb to 0x0231d3 (0x59e9 bytes) 000089 1789446654.402936 read 0x00caf1 thru 0x015083 (0x8593 bytes) 000090 1789446654.416489 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x74619eb3 Mirror 3: 0x74619eb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000091 1789446655.643056 fallocate 0x017a44 thru 0x024152 (0xc70f bytes) 000092 1789446655.727676 fallocate 0x004d98 thru 0x00c083 (0x72ec bytes) 000094 1789446655.738910 trunc from 0x03a55a to 0x03ffff (0x5aa6 bytes) 000095 1789446655.749452 mapread 0x02028d thru 0x0248e6 (0x465a bytes) 000096 1789446655.777882 trunc from 0x031fcb to 0x034ffa (0x3030 bytes) 000097 1789446655.796228 mapwrite 0x027890 thru 0x0365d6 (0xed47 bytes) 000098 1789446655.872042 trunc from 0x040000 to 0x02cc33 (0x133cc bytes) 000099 1789446655.950720 mapwrite 0x02eb38 thru 0x036da9 (0x8272 bytes) 000100 1789446655.999518 write 0x00800b thru 0x008e10 (0xe06 bytes) 000101 1789446656.019380 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36daa): Mirror 2: 0x48202364 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36daa): Mirror 2: 0x48202364 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36daa: skipped 000102 1789446656.282695 read 0x0193fd thru 0x02539d (0xbfa1 bytes) 000103 1789446656.293426 write 0x015261 thru 0x016e88 (0x1c28 bytes) 000104 1789446656.310656 read 0x01a977 thru 0x02204e (0x76d8 bytes) 000106 1789446656.311995 read 0x02e50b thru 0x035a47 (0x753d bytes) 000107 1789446656.321376 mapwrite 0x0327fd thru 0x03e220 (0xba24 bytes) 000108 1789446656.361228 punch from 0x017622 to 0x01b733 (0x4112 bytes) 000110 1789446656.367544 fallocate 0x036641 thru 0x03d626 (0x6fe6 bytes) 000111 1789446656.372746 read 0x00fd43 thru 0x01a3d0 (0xa68e bytes) 000113 1789446656.386578 MIRROR_RESYNC 2 mirrors 000114 1789446657.555485 write 0x003120 thru 0x01101d (0xdefe bytes) 000115 1789446657.601395 write 0x00b800 thru 0x01b6bf (0xfec0 bytes) 000116 1789446657.614719 MIRROR_RESYNC 2 mirrors 000117 1789446658.346109 mapread 0x01446b thru 0x0152d5 (0xe6b bytes) 000118 1789446658.358375 trunc from 0x03e221 to 0x00ac1d (0x33603 bytes) 000119 1789446658.394524 mapwrite 0x02c2ce thru 0x02cd97 (0xaca bytes) 000120 1789446658.440731 trunc from 0x01d54a to 0x0255b3 (0x806a bytes) 000121 1789446658.450037 trunc from 0x02cd98 to 0x00e8e6 (0x1e4b1 bytes) 000122 1789446658.464327 trunc from 0x00e8e7 to 0x0061b9 (0x872d bytes) 000123 1789446658.477598 write 0x03fbc4 thru 0x03ffff (0x43c bytes) 000124 1789446658.478913 fallocate 0x036464 thru 0x03ffff (0x9b9c bytes) 000125 1789446658.484827 mapread 0x0197e3 thru 0x01f2e7 (0x5b05 bytes) 000128 1789446658.497888 trunc from 0x035ec4 to 0x03ffff (0xa13c bytes) 000129 1789446658.507968 write 0x006da7 thru 0x012e14 (0xc06e bytes) 000130 1789446658.514586 mapread 0x015aa0 thru 0x01f947 (0x9ea8 bytes) 000131 1789446658.516633 write 0x020c48 thru 0x023a9a (0x2e53 bytes) 000132 1789446658.536583 fallocate 0x02e6b4 thru 0x03a41e (0xbd6b bytes) 000133 1789446658.542132 mapread 0x00cb5b thru 0x011c8d (0x5133 bytes) 000134 1789446658.543232 read 0x03bcbb thru 0x03c1a2 (0x4e8 bytes) 000135 1789446658.549236 punch from 0x03325e to 0x03ffff (0xcda2 bytes) 000136 1789446658.555038 read 0x037a58 thru 0x03d0d8 (0x5681 bytes) 000137 1789446658.579818 mapwrite 0x0044fd thru 0x00fd5b (0xb85f bytes) 000138 1789446658.599556 write 0x01f6ad thru 0x01f715 (0x69 bytes) 000139 1789446658.600778 read 0x02965c thru 0x02ba77 (0x241c bytes) 000140 1789446658.602551 punch from 0x03341d to 0x03fb28 (0xc70c bytes) 000141 1789446658.607934 trunc from 0x040000 to 0x029460 (0x16b9f bytes) 000142 1789446658.630114 write 0x00bc4f thru 0x017a8a (0xbe3c bytes) 000143 1789446658.631800 mapwrite 0x009dc8 thru 0x0141b7 (0xa3f0 bytes) 000144 1789446658.650501 mapwrite 0x02aa26 thru 0x0334e4 (0x8abf bytes) 000145 1789446658.698740 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) 000146 1789446658.845698 trunc from 0x0334e5 to 0x007c25 (0x2b8bf bytes) 000147 1789446658.863934 mapread 0x001a58 thru 0x007c25 (0x61ce bytes) 000148 1789446658.882920 trunc from 0x003698 to 0x003c98 (0x601 bytes) 000149 1789446658.892690 MIRROR_EXTEND to 2 mirrors 000150 1789446659.472692 trunc from 0x007c26 to 0x03b59f (0x3397a bytes) 000151 1789446659.519449 mapwrite 0x02114e thru 0x023c04 (0x2ab7 bytes) 000152 1789446659.551640 trunc from 0x03b5a0 to 0x003841 (0x37d5e bytes) 000153 1789446659.574871 mapwrite 0x03729b thru 0x03f9d5 (0x873b bytes) 000154 1789446659.620541 fallocate 0x02f1e7 thru 0x0323ff (0x3219 bytes) 000155 1789446659.626363 fallocate 0x03a28a thru 0x03ffff (0x5d76 bytes) 000156 1789446659.631802 punch from 0x000359 to 0x007b5c (0x7804 bytes) 000158 1789446659.638596 trunc from 0x0183d1 to 0x01ae34 (0x2a64 bytes) 000160 1789446659.643850 mapwrite 0x036138 thru 0x03ffff (0x9ec8 bytes) 000161 1789446659.663874 mapwrite 0x030bea thru 0x03744c (0x6863 bytes) 000162 1789446659.682643 punch from 0x00bf4e to 0x013d2a (0x7ddd bytes) 000164 1789446659.689079 write 0x0153cf thru 0x016923 (0x1555 bytes) 000165 1789446659.700913 mapread 0x0224cb thru 0x029e2b (0x7961 bytes) 000166 1789446659.715713 fallocate 0x0134fd thru 0x0173f8 (0x3efc bytes) 000167 1789446659.728805 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8ffcff66 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1c483ef9 Mirror 3: 0x1c483ef9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000168 1789446660.744517 read 0x026f70 thru 0x02ffd0 (0x9061 bytes) 000169 1789446660.761899 mapread 0x037fcc thru 0x038c14 (0xc49 bytes) 000170 1789446660.809567 fallocate 0x0211a1 thru 0x025deb (0x4c4b bytes) 000171 1789446660.893451 punch from 0x017498 to 0x01ff40 (0x8aa9 bytes) 000172 1789446660.907190 trunc from 0x040000 to 0x003027 (0x3cfd8 bytes) 000174 1789446660.932580 punch from 0x0002b8 to 0x003027 (0x2d70 bytes) 000175 1789446660.946412 punch from 0x001804 to 0x003027 (0x1824 bytes) 000176 1789446660.950959 fallocate 0x02bd52 thru 0x02d5ad (0x185c bytes) 000178 1789446660.956490 trunc from 0x003028 to 0x03798d (0x34966 bytes) 000180 1789446660.974768 read 0x00d01e thru 0x017b31 (0xab14 bytes) 000181 1789446660.987501 write 0x0011d0 thru 0x009564 (0x8395 bytes) 000182 1789446660.988958 trunc from 0x00c927 to 0x010cf3 (0x43cd bytes) 000183 1789446660.993924 trunc from 0x03798e to 0x023255 (0x14738 bytes) 000184 1789446661.009191 trunc from 0x020ac5 to 0x023255 (0x2791 bytes) 000185 1789446661.014787 trunc from 0x003070 to 0x00af24 (0x7eb5 bytes) 000186 1789446661.032326 read 0x018b41 thru 0x019a54 (0xf14 bytes) 000187 1789446661.037576 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23256): Mirror 3: 0xc2bb3c31 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23256): Mirror 3: 0xc2bb3c31 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23256: skipped 000188 1789446661.357369 MIRROR_RESYNC 2 mirrors 000189 1789446662.036001 read 0x00094e thru 0x008e17 (0x84ca bytes) 000190 1789446662.045635 read 0x014ccb thru 0x01794c (0x2c82 bytes) 000191 1789446662.054738 mapwrite 0x03f031 thru 0x03ffff (0xfcf bytes) 000192 1789446662.102280 read 0x02c658 thru 0x037fe1 (0xb98a bytes) 000193 1789446662.103083 write 0x03474b thru 0x03b0ae (0x6964 bytes) 000195 1789446662.104951 trunc from 0x032d82 to 0x03ffff (0xd27e bytes) 000196 1789446662.118812 read 0x0224e3 thru 0x02b274 (0x8d92 bytes) 000197 1789446662.129924 fallocate 0x014ddd thru 0x01db4d (0x8d71 bytes) 000198 1789446662.139795 punch from 0x025076 to 0x03447a (0xf405 bytes) 000199 1789446662.144668 mapwrite 0x03d5e5 thru 0x03ffff (0x2a1b bytes) 000201 1789446662.156998 mapread 0x03deb7 thru 0x03f422 (0x156c bytes) 000202 1789446662.158744 trunc from 0x008380 to 0x016e04 (0xea85 bytes) 000203 1789446662.169034 mapwrite 0x015d4a thru 0x01ebc6 (0x8e7d bytes) 000204 1789446662.202688 fallocate 0x038380 thru 0x03ffff (0x7c80 bytes) 000205 1789446662.209577 read 0x00ce63 thru 0x01a195 (0xd333 bytes) 000206 1789446662.239732 MIRROR_RESYNC 2 mirrors 000207 1789446662.953679 write 0x000213 thru 0x000743 (0x531 bytes) 000208 1789446662.995579 trunc from 0x040000 to 0x0333f6 (0xcc09 bytes) 000209 1789446663.050511 fallocate 0x03d716 thru 0x03ffff (0x28ea bytes) 000210 1789446663.058215 trunc from 0x0333f7 to 0x03e5c3 (0xb1cd bytes) 000211 1789446663.081425 trunc from 0x02f959 to 0x033fbd (0x4665 bytes) 000212 1789446663.087555 mapread 0x02ed70 thru 0x03d956 (0xebe7 bytes) 000213 1789446663.120101 trunc from 0x03e5c4 to 0x010ff3 (0x2d5d0 bytes) 000214 1789446663.143391 punch from 0x00305b to 0x00c206 (0x91ac bytes) 000215 1789446663.149690 read 0x004e89 thru 0x010c3a (0xbdb2 bytes) 000216 1789446663.173274 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x10ff4): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10ff4): Mirror 3: 0x8910b270 (stale) CRC-32 checksum value for chunk [0, 0x10ff4): Mirror 1: 0x89752c64 Mirror 4: 0x89752c64 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10ff4: skipped 000218 1789446664.008447 MIRROR_RESYNC 3 mirrors 000219 1789446664.933401 mapwrite 0x036b17 thru 0x03cafe (0x5fe8 bytes) 000220 1789446665.120757 trunc from 0x026718 to 0x034f51 (0xe83a bytes) 000221 1789446665.135764 read 0x02a535 thru 0x02f45e (0x4f2a bytes) 000222 1789446665.167969 fallocate 0x00211a thru 0x00a358 (0x823f bytes) 000223 1789446665.180020 trunc from 0x03caff to 0x019cd0 (0x22e2e bytes) 000224 1789446665.242128 write 0x0080d9 thru 0x01236e (0xa296 bytes) 000225 1789446665.261413 write 0x01ecf8 thru 0x021752 (0x2a5b bytes) 000226 1789446665.267854 mapread 0x00e429 thru 0x0198d8 (0xb4b0 bytes) 000228 1789446665.293678 write 0x00c54b thru 0x014ee2 (0x8998 bytes) 000229 1789446665.300872 fallocate 0x00a127 thru 0x00c19a (0x2074 bytes) 000231 1789446665.314984 read 0x00cf67 thru 0x017dcb (0xae65 bytes) 000232 1789446665.317723 trunc from 0x021753 to 0x022c35 (0x14e3 bytes) 000234 1789446665.365213 read 0x000495 thru 0x00e3b7 (0xdf23 bytes) 000235 1789446665.392754 read 0x017aaf thru 0x0226b6 (0xac08 bytes) 000236 1789446665.393751 trunc from 0x007601 to 0x00dedb (0x68db bytes) 000237 1789446665.449494 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22c36): Mirror 4: 0x26ef75d5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22c36): Mirror 4: 0x26ef75d5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22c36: skipped 000238 1789446665.946868 mapwrite 0x022f8e thru 0x02d611 (0xa684 bytes) 000240 1789446666.106708 trunc from 0x02d612 to 0x037c24 (0xa613 bytes) 000242 1789446666.136243 write 0x028e93 thru 0x036be7 (0xdd55 bytes) 000243 1789446666.150914 fallocate 0x018354 thru 0x025bf4 (0xd8a1 bytes) 000244 1789446666.160363 punch from 0x014bdd to 0x018a34 (0x3e58 bytes) 000245 1789446666.166775 trunc from 0x037c25 to 0x0398fa (0x1cd6 bytes) 000246 1789446666.208314 MIRROR_RESYNC 2 mirrors 000247 1789446667.455715 trunc from 0x00efbd to 0x01da76 (0xeaba bytes) 000248 1789446667.488821 trunc from 0x0398fb to 0x0313c6 (0x8534 bytes) 000249 1789446667.530856 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) 000250 1789446667.715557 write 0x0140db thru 0x01db6f (0x9a95 bytes) 000251 1789446667.739531 punch from 0x00b2b0 to 0x010ac8 (0x5819 bytes) 000252 1789446667.754592 fallocate 0x0161de thru 0x01e74f (0x8572 bytes) 000253 1789446667.765953 read 0x001788 thru 0x0029a5 (0x121e bytes) 000254 1789446667.777816 write 0x02f590 thru 0x0341e1 (0x4c52 bytes) 000255 1789446667.796484 read 0x00f2e9 thru 0x01b661 (0xc379 bytes) 000256 1789446667.812550 mapwrite 0x000a22 thru 0x00cb17 (0xc0f6 bytes) 000257 1789446667.851041 fallocate 0x000dc1 thru 0x010ba3 (0xfde3 bytes) 000258 1789446667.857789 punch from 0x0171bd to 0x01d69e (0x64e2 bytes) 000259 1789446667.868481 fallocate 0x02f94d thru 0x032b2d (0x31e1 bytes) 000260 1789446667.878693 mapwrite 0x03ecb1 thru 0x03ffff (0x134f bytes) 000261 1789446667.942939 mapread 0x02a18c thru 0x030672 (0x64e7 bytes) 000262 1789446667.945635 trunc from 0x040000 to 0x00cb92 (0x3346d bytes) 000263 1789446667.965443 trunc from 0x000e24 to 0x001584 (0x761 bytes) 000265 1789446667.972124 fallocate 0x03b67e thru 0x03b6e6 (0x69 bytes) 000266 1789446667.989590 fallocate 0x015f6a thru 0x01601a (0xb1 bytes) 000267 1789446667.998648 fallocate 0x00995f thru 0x017e16 (0xe4b8 bytes) 000268 1789446668.005743 mapwrite 0x00b8aa thru 0x018648 (0xcd9f bytes) 000269 1789446668.100806 trunc from 0x03b6e7 to 0x00a849 (0x30e9d bytes) 000270 1789446668.116903 punch from 0x00562b to 0x00a849 (0x521f bytes) 000271 1789446668.122863 mapread 0x003315 thru 0x00a849 (0x7535 bytes) 000272 1789446668.150788 trunc from 0x00a84a to 0x00d637 (0x2dee bytes) 000273 1789446668.169819 mapwrite 0x027837 thru 0x0351c2 (0xd98c bytes) 000274 1789446668.333700 mapwrite 0x02358c thru 0x023a2e (0x4a3 bytes) 000275 1789446668.354228 trunc from 0x0351c3 to 0x004a6e (0x30754 bytes) 000276 1789446668.370205 trunc from 0x000388 to 0x004a6e (0x46e7 bytes) 000277 1789446668.375534 mapwrite 0x032ea9 thru 0x03ffff (0xd157 bytes) 000278 1789446668.493127 fallocate 0x03cbd3 thru 0x03d85b (0xc89 bytes) 000279 1789446668.498529 mapread 0x00a678 thru 0x017220 (0xcba9 bytes) 000280 1789446668.574460 trunc from 0x030940 to 0x033a01 (0x30c2 bytes) 000281 1789446668.579431 trunc from 0x00a655 to 0x014c87 (0xa633 bytes) 000282 1789446668.584840 fallocate 0x035e95 thru 0x03ffff (0xa16b bytes) 000283 1789446668.590550 read 0x030890 thru 0x031142 (0x8b3 bytes) 000284 1789446668.609694 punch from 0x02efc0 to 0x0349a8 (0x59e9 bytes) 000285 1789446668.615350 read 0x0161b7 thru 0x019587 (0x33d1 bytes) 000286 1789446668.616074 trunc from 0x040000 to 0x03d07d (0x2f82 bytes) 000287 1789446668.635413 trunc from 0x03d07e to 0x036478 (0x6c05 bytes) 000289 1789446668.650678 fallocate 0x008518 thru 0x01708b (0xeb74 bytes) 000290 1789446668.656105 trunc from 0x031135 to 0x036478 (0x5344 bytes) 000291 1789446668.660971 mapwrite 0x016996 thru 0x01f7c3 (0x8e2e bytes) 000292 1789446668.678531 trunc from 0x001486 to 0x003273 (0x1dee bytes) 000293 1789446668.684840 fallocate 0x001703 thru 0x010e95 (0xf793 bytes) 000294 1789446668.688091 mapwrite 0x000bc0 thru 0x000c04 (0x45 bytes) 000296 1789446668.700765 read 0x0109d8 thru 0x0187dc (0x7e05 bytes) 000297 1789446668.702475 read 0x035c2f thru 0x036400 (0x7d2 bytes) 000298 1789446668.717137 mapwrite 0x035372 thru 0x03f122 (0x9db1 bytes) 000299 1789446668.764336 trunc from 0x03f123 to 0x00e548 (0x30bda bytes) 000300 1789446668.777716 trunc from 0x00e549 to 0x02963a (0x1b0f2 bytes) 000302 1789446668.797327 trunc from 0x015dc9 to 0x01a268 (0x44a0 bytes) 000303 1789446668.802804 mapread 0x028b49 thru 0x0293af (0x867 bytes) 000304 1789446668.816939 fallocate 0x018281 thru 0x01e4e8 (0x6268 bytes) 000305 1789446668.823338 mapwrite 0x00a227 thru 0x01819a (0xdf74 bytes) 000306 1789446668.902396 MIRROR_EXTEND to 2 mirrors 000308 1789446669.856041 mapwrite 0x03b90a thru 0x03ffff (0x46f6 bytes) 000309 1789446670.004154 fallocate 0x01a3ab thru 0x01de4a (0x3aa0 bytes) 000310 1789446670.020550 read 0x01e6a0 thru 0x02d480 (0xede1 bytes) 000311 1789446670.033586 trunc from 0x02cd2d to 0x02f43a (0x270e bytes) 000312 1789446670.050250 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4850790b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc6ec45da Mirror 3: 0xc6ec45da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000313 1789446671.200599 mapread 0x01cad6 thru 0x025670 (0x8b9b bytes) 000314 1789446671.235758 mapwrite 0x03c2e1 thru 0x03ffff (0x3d1f bytes) 000315 1789446671.376281 trunc from 0x040000 to 0x02066f (0x1f990 bytes) 000316 1789446671.404487 fallocate 0x01a413 thru 0x01d2bd (0x2eab bytes) 000317 1789446671.412485 write 0x01da14 thru 0x02750f (0x9afc bytes) 000318 1789446671.419729 read 0x004efe thru 0x011927 (0xca2a bytes) 000319 1789446671.433085 fallocate 0x03341f thru 0x03fea5 (0xca87 bytes) 000320 1789446671.438446 write 0x03f059 thru 0x03f2dd (0x285 bytes) 000321 1789446671.448451 MIRROR_RESYNC 3 mirrors 000322 1789446672.906532 trunc from 0x03fea6 to 0x0034ac (0x3c9f9 bytes) 000323 1789446672.948374 punch from 0x0029bf to 0x0034ac (0xaee bytes) 000324 1789446672.953838 trunc from 0x002255 to 0x0034ac (0x1258 bytes) 000325 1789446672.962324 mapread 0x00299f thru 0x0034ac (0xb0e bytes) 000327 1789446672.978367 mapwrite 0x02291c thru 0x02f7c2 (0xcea7 bytes) 000329 1789446673.056877 mapwrite 0x01b464 thru 0x01d870 (0x240d bytes) 000330 1789446673.071045 mapwrite 0x01cc15 thru 0x024d6a (0x8156 bytes) 000331 1789446673.095308 mapread 0x009f2b thru 0x0104ba (0x6590 bytes) 000332 1789446673.111799 mapread 0x01c696 thru 0x02c289 (0xfbf4 bytes) 000333 1789446673.112783 mapwrite 0x03df48 thru 0x03ffff (0x20b8 bytes) 000334 1789446673.153455 mapread 0x02746f thru 0x037310 (0xfea2 bytes) 000335 1789446673.180739 fallocate 0x02c56d thru 0x03c025 (0xfab9 bytes) 000336 1789446673.192535 write 0x02c178 thru 0x030218 (0x40a1 bytes) 000337 1789446673.196633 write 0x03fe25 thru 0x03ffff (0x1db bytes) 000338 1789446673.204573 MIRROR_RESYNC 3 mirrors 000339 1789446674.116027 MIRROR_EXTEND to 4 mirrors 000340 1789446674.953240 MIRROR_RESYNC 4 mirrors 000341 1789446675.464820 read 0x01a163 thru 0x01f9cc (0x586a bytes) 000342 1789446675.477402 mapwrite 0x030818 thru 0x03aa91 (0xa27a bytes) 000343 1789446675.623124 MIRROR_RESYNC 4 mirrors 000344 1789446676.913132 read 0x017b00 thru 0x01aeaf (0x33b0 bytes) 000345 1789446676.932613 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) 000347 1789446677.573717 mapwrite 0x03efaa thru 0x03ffff (0x1056 bytes) 000348 1789446677.723556 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x6796882e (stale) Mirror 4: 0x6796882e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7df613eb Mirror 5: 0x7df613eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000349 1789446679.044594 mapwrite 0x00a42b thru 0x011f24 (0x7afa bytes) 000350 1789446679.244572 punch from 0x03335c to 0x038d5d (0x5a02 bytes) 000351 1789446679.253554 punch from 0x03af3b to 0x03ffff (0x50c5 bytes) 000352 1789446679.261144 fallocate 0x03aa01 thru 0x03ffff (0x55ff bytes) 000353 1789446679.269970 read 0x03c705 thru 0x03e91d (0x2219 bytes) 000354 1789446679.279829 fallocate 0x030678 thru 0x0374a2 (0x6e2b bytes) 000355 1789446679.291663 mapread 0x01bc8e thru 0x01c062 (0x3d5 bytes) 000356 1789446679.317569 mapwrite 0x0211ac thru 0x02900d (0x7e62 bytes) 000357 1789446679.360871 punch from 0x0353e4 to 0x03b473 (0x6090 bytes) 000358 1789446679.367635 write 0x02c1af thru 0x035de3 (0x9c35 bytes) 000359 1789446679.380559 punch from 0x014fe8 to 0x01d9c8 (0x89e1 bytes) 000360 1789446679.388891 trunc from 0x040000 to 0x00d80c (0x327f3 bytes) 000361 1789446679.433142 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xd80d): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd80d): Mirror 3: 0x1f1c0ebe (stale) Mirror 4: 0x1f1c0ebe (stale) Mirror 5: 0x1f1c0ebe (stale) CRC-32 checksum value for chunk [0, 0xd80d): Mirror 1: 0x69d963c Mirror 6: 0x69d963c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd80d: skipped 000362 1789446680.696836 read 0x0093a7 thru 0x00d80c (0x4466 bytes) 000363 1789446680.734882 read 0x008b45 thru 0x00d80c (0x4cc8 bytes) 000364 1789446680.766286 mapwrite 0x00a291 thru 0x00a321 (0x91 bytes) 000365 1789446680.872902 mapread 0x00ab9c thru 0x00d80c (0x2c71 bytes) 000367 1789446680.901243 fallocate 0x005068 thru 0x006e60 (0x1df9 bytes) 000368 1789446680.907518 trunc from 0x00d80d to 0x022d57 (0x1554b bytes) 000370 1789446680.983472 trunc from 0x022d58 to 0x00a09a (0x18cbd bytes) 000371 1789446681.006539 read 0x007f9d thru 0x00a09a (0x20fe bytes) 000372 1789446681.030402 trunc from 0x00a09b to 0x032c2a (0x28b90 bytes) 000373 1789446681.060775 trunc from 0x007696 to 0x00a44c (0x2db7 bytes) 000374 1789446681.073026 read 0x01476b thru 0x01d52f (0x8dc5 bytes) 000375 1789446681.091929 trunc from 0x00726e to 0x00c5dd (0x5370 bytes) 000376 1789446681.114456 read 0x01e70b thru 0x02362b (0x4f21 bytes) 000378 1789446681.115609 mapread 0x0095a7 thru 0x00d54e (0x3fa8 bytes) 000379 1789446681.183617 trunc from 0x01586e to 0x01b80b (0x5f9e bytes) 000380 1789446681.205467 trunc from 0x00b770 to 0x018272 (0xcb03 bytes) 000381 1789446681.216637 write 0x019297 thru 0x02565c (0xc3c6 bytes) 000382 1789446681.235208 write 0x01b387 thru 0x020828 (0x54a2 bytes) 000383 1789446681.236519 write 0x02c163 thru 0x037b86 (0xba24 bytes) 000384 1789446681.242712 mapwrite 0x0085f8 thru 0x017de7 (0xf7f0 bytes) 000385 1789446681.423874 punch from 0x011ebc to 0x012fce (0x1113 bytes) 000386 1789446681.431970 write 0x013c3c thru 0x021c8d (0xe052 bytes) 000387 1789446681.435857 mapwrite 0x00d425 thru 0x019e13 (0xc9ef bytes) 000388 1789446681.487731 MIRROR_RESYNC 5 mirrors 000389 1789446683.351864 read 0x003aa7 thru 0x00c675 (0x8bcf bytes) 000391 1789446683.368585 trunc from 0x02eef4 to 0x037b86 (0x8c93 bytes) 000392 1789446683.467631 read 0x01a9b6 thru 0x022889 (0x7ed4 bytes) 000393 1789446683.482709 mapwrite 0x01a811 thru 0x0263f3 (0xbbe3 bytes) 000394 1789446683.520485 fallocate 0x006596 thru 0x014a14 (0xe47f bytes) 000395 1789446683.527864 mapread 0x027cd9 thru 0x02f31b (0x7643 bytes) 000396 1789446683.530841 mapwrite 0x03784f thru 0x03d730 (0x5ee2 bytes) 000398 1789446683.586657 fallocate 0x023452 thru 0x02b62f (0x81de bytes) 000399 1789446683.596652 read 0x035217 thru 0x037326 (0x2110 bytes) 000400 1789446683.597801 mapread 0x023fb4 thru 0x026303 (0x2350 bytes) 000401 1789446683.603099 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3d731): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d731): Mirror 3: 0x66a890ae (stale) Mirror 4: 0x66a890ae (stale) Mirror 5: 0x66a890ae (stale) Mirror 6: 0x66a890ae (stale) CRC-32 checksum value for chunk [0, 0x3d731): Mirror 1: 0x735daf39 Mirror 7: 0x735daf39 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d731: skipped 000402 1789446684.953990 trunc from 0x01c16b to 0x023e7b (0x7d11 bytes) 000403 1789446685.040139 trunc from 0x02c17e to 0x03b01b (0xee9e bytes) 000404 1789446685.047377 read 0x018c4f thru 0x0216ad (0x8a5f bytes) 000405 1789446685.064269 mapread 0x01fc87 thru 0x026c95 (0x700f bytes) 000406 1789446685.099687 mapread 0x03a1f2 thru 0x03d054 (0x2e63 bytes) 000407 1789446685.113431 trunc from 0x03d731 to 0x00bb5f (0x31bd1 bytes) 000408 1789446685.145398 punch from 0x002d88 to 0x008ad5 (0x5d4e bytes) 000409 1789446685.151435 write 0x022207 thru 0x023ed6 (0x1cd0 bytes) 000410 1789446685.154680 mapwrite 0x0276e8 thru 0x02f860 (0x8179 bytes) 000412 1789446685.221684 write 0x017641 thru 0x01842e (0xdee bytes) 000413 1789446685.234753 write 0x0277e6 thru 0x030bdb (0x93f6 bytes) 000414 1789446685.236357 read 0x023e4b thru 0x029abd (0x5c73 bytes) 000416 1789446685.239258 mapwrite 0x02a2c5 thru 0x02ca5f (0x279b bytes) 000417 1789446685.261014 punch from 0x0092ef to 0x016666 (0xd378 bytes) 000418 1789446685.270216 mapwrite 0x01f9d9 thru 0x0297a0 (0x9dc8 bytes) 000420 1789446685.332606 mapread 0x01ca2e thru 0x01ce94 (0x467 bytes) 000421 1789446685.333686 mapwrite 0x017b0d thru 0x01c50c (0x4a00 bytes) 000422 1789446685.351102 mapwrite 0x035bb1 thru 0x03bc50 (0x60a0 bytes) 000423 1789446685.426730 mapread 0x006761 thru 0x012e44 (0xc6e4 bytes) 000424 1789446685.431713 trunc from 0x01cb1b to 0x029423 (0xc909 bytes) 000425 1789446685.474515 MIRROR_RESYNC 6 mirrors 000426 1789446688.786559 mapwrite 0x0316fd thru 0x037d91 (0x6695 bytes) 000427 1789446688.947597 punch from 0x039e02 to 0x03bc50 (0x1e4f bytes) 000428 1789446688.961477 read 0x011073 thru 0x01530a (0x4298 bytes) 000430 1789446688.985852 mapwrite 0x019f16 thru 0x026dbc (0xcea7 bytes) 000431 1789446689.115451 mapwrite 0x00ac45 thru 0x0174d4 (0xc890 bytes) 000432 1789446689.195495 mapread 0x027a11 thru 0x0292d0 (0x18c0 bytes) 000433 1789446689.203522 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bc51): Mirror 3: 0xbd0cf9e4 (stale) Mirror 4: 0xbd0cf9e4 (stale) Mirror 5: 0xbd0cf9e4 (stale) Mirror 7: 0xbd0cf9e4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc51): Mirror 3: 0xbd0cf9e4 (stale) Mirror 4: 0xbd0cf9e4 (stale) Mirror 5: 0xbd0cf9e4 (stale) Mirror 7: 0xbd0cf9e4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc51: skipped 000434 1789446689.979071 trunc from 0x0161f4 to 0x0237e5 (0xd5f2 bytes) 000435 1789446689.985720 fallocate 0x02547c thru 0x02cc60 (0x77e5 bytes) 000436 1789446689.991736 trunc from 0x00bc8e to 0x01a83b (0xebae bytes) 000437 1789446690.006444 MIRROR_RESYNC 5 mirrors 000438 1789446692.186368 write 0x023eab thru 0x028675 (0x47cb bytes) 000439 1789446692.250356 trunc from 0x03bc51 to 0x02b325 (0x1092b bytes) 000440 1789446692.303075 mapwrite 0x03ab3f thru 0x03c719 (0x1bdb bytes) 000441 1789446692.359215 trunc from 0x03c71a to 0x03ec3d (0x2524 bytes) 000442 1789446692.375422 read 0x03588b thru 0x03c4fc (0x6c72 bytes) 000443 1789446692.376559 read 0x015bae thru 0x0245a9 (0xe9fc bytes) 000444 1789446692.385994 read 0x0395fc thru 0x03ec3d (0x5642 bytes) 000445 1789446692.387026 trunc from 0x00a5b3 to 0x010d3b (0x6789 bytes) 000446 1789446692.392571 punch from 0x011884 to 0x017f46 (0x66c3 bytes) 000447 1789446692.406463 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ec3e): Mirror 3: 0xc7593dc6 (stale) Mirror 5: 0xc7593dc6 (stale) Mirror 7: 0xc7593dc6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec3e): Mirror 3: 0xc7593dc6 (stale) Mirror 5: 0xc7593dc6 (stale) Mirror 7: 0xc7593dc6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec3e: skipped 000448 1789446692.790724 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ec3e): Mirror 5: 0xc7593dc6 (stale) Mirror 7: 0xc7593dc6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec3e): Mirror 5: 0xc7593dc6 (stale) Mirror 7: 0xc7593dc6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec3e: skipped 000449 1789446693.296646 trunc from 0x03dac5 to 0x03eb49 (0x1085 bytes) 000450 1789446693.315539 MIRROR_RESYNC 3 mirrors 000451 1789446694.848761 trunc from 0x02b14d to 0x03ab17 (0xf9cb bytes) 000452 1789446694.900620 write 0x02d376 thru 0x02fa0c (0x2697 bytes) 000453 1789446694.916800 mapwrite 0x020c3a thru 0x022116 (0x14dd bytes) 000454 1789446695.003508 fallocate 0x03a7e2 thru 0x03ffff (0x581e bytes) 000455 1789446695.008786 read 0x010765 thru 0x01ce82 (0xc71e bytes) 000456 1789446695.018802 trunc from 0x03ec3e to 0x00517b (0x39ac2 bytes) 000457 1789446695.062574 mapread 0x0012c8 thru 0x00517b (0x3eb4 bytes) 000458 1789446695.096511 write 0x03a463 thru 0x03ffff (0x5b9d bytes) 000459 1789446695.097777 mapread 0x012bcc thru 0x01e95d (0xbd92 bytes) 000460 1789446695.128031 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x957a7696 (stale) Mirror 7: 0x957a7696 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x25611a52 Mirror 8: 0x25611a52 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000461 1789446696.159745 write 0x02c8f7 thru 0x03350a (0x6c14 bytes) 000462 1789446696.235840 trunc from 0x040000 to 0x002242 (0x3ddbd bytes) 000463 1789446696.296495 trunc from 0x002173 to 0x002242 (0xd0 bytes) 000464 1789446696.313807 trunc from 0x002243 to 0x00f613 (0xd3d1 bytes) 000465 1789446696.341000 punch from 0x00a0e3 to 0x00f613 (0x5531 bytes) 000466 1789446696.348697 trunc from 0x002cf4 to 0x006470 (0x377d bytes) 000468 1789446696.361210 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf614): Mirror 5: 0x156b5f0d (stale) Mirror 7: 0x156b5f0d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf614): Mirror 5: 0x156b5f0d (stale) Mirror 7: 0x156b5f0d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf614: skipped 000469 1789446696.772570 trunc from 0x00f614 to 0x003e6c (0xb7a7 bytes) 000470 1789446696.800659 write 0x034733 thru 0x03ffff (0xb8cd bytes) 000471 1789446696.805381 punch from 0x004643 to 0x011ed8 (0xd896 bytes) 000472 1789446696.810535 read 0x03ded6 thru 0x03ffff (0x212a bytes) 000473 1789446696.812339 punch from 0x02687b to 0x02ff10 (0x9696 bytes) 000474 1789446696.819666 mapwrite 0x026646 thru 0x026702 (0xbd bytes) 000475 1789446696.850668 trunc from 0x01bb6a to 0x028fbf (0xd456 bytes) 000476 1789446696.856489 trunc from 0x040000 to 0x0257d0 (0x1a82f bytes) 000477 1789446696.876883 trunc from 0x009fed to 0x017338 (0xd34c bytes) 000478 1789446696.884475 mapwrite 0x027d4f thru 0x0348f9 (0xcbab bytes) 000479 1789446696.976331 trunc from 0x00939d to 0x015bb4 (0xc818 bytes) 000480 1789446696.984840 mapread 0x014645 thru 0x01544e (0xe0a bytes) 000481 1789446697.003320 MIRROR_RESYNC 3 mirrors 000483 1789446697.833608 MIRROR_RESYNC 3 mirrors 000484 1789446698.515414 write 0x038333 thru 0x03cdbd (0x4a8b bytes) 000485 1789446698.585716 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cdbe): Mirror 7: 0xb6eb5659 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cdbe): Mirror 7: 0xb6eb5659 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cdbe: skipped 000486 1789446699.028579 mapwrite 0x033508 thru 0x03c4fb (0x8ff4 bytes) 000487 1789446699.167005 trunc from 0x03cdbe to 0x012f11 (0x29eac bytes) 000489 1789446699.216960 mapwrite 0x020486 thru 0x02f267 (0xede2 bytes) 000491 1789446699.299502 trunc from 0x002d90 to 0x007ac4 (0x4d35 bytes) 000492 1789446699.312433 trunc from 0x02f268 to 0x00eec3 (0x203a4 bytes) 000493 1789446699.340869 mapread 0x0094b7 thru 0x00d39f (0x3ee9 bytes) 000494 1789446699.370653 fallocate 0x03f63a thru 0x03ffff (0x9c6 bytes) 000495 1789446699.378467 fallocate 0x025106 thru 0x030b0f (0xba0a bytes) 000496 1789446699.392471 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) 000497 1789446699.675463 mapread 0x00c7ba thru 0x019443 (0xcc8a bytes) 000498 1789446699.740353 fallocate 0x03bd5a thru 0x03ffff (0x42a6 bytes) 000502 1789446699.756538 write 0x00d8b3 thru 0x01cd09 (0xf457 bytes) 000503 1789446699.779669 write 0x027409 thru 0x033905 (0xc4fd bytes) 000504 1789446699.800200 fallocate 0x000d24 thru 0x008dba (0x8097 bytes) 000505 1789446699.805574 trunc from 0x006f38 to 0x00f73d (0x8806 bytes) 000506 1789446699.827894 trunc from 0x040000 to 0x02cc92 (0x1336d bytes) 000507 1789446699.878745 write 0x02c38a thru 0x0322a9 (0x5f20 bytes) 000508 1789446699.880691 read 0x016f27 thru 0x01b93f (0x4a19 bytes) 000511 1789446699.888132 fallocate 0x015576 thru 0x024e89 (0xf914 bytes) 000512 1789446699.900445 write 0x01da91 thru 0x0200fb (0x266b bytes) 000513 1789446699.918576 fallocate 0x036bb3 thru 0x03ffff (0x944d bytes) 000514 1789446699.927747 write 0x003a79 thru 0x011b91 (0xe119 bytes) 000515 1789446699.947754 trunc from 0x019d44 to 0x01ddb3 (0x4070 bytes) 000517 1789446700.000592 mapwrite 0x001d55 thru 0x00f973 (0xdc1f bytes) 000518 1789446700.046778 fallocate 0x02624d thru 0x02a0b2 (0x3e66 bytes) 000519 1789446700.060614 mapread 0x00d60a thru 0x013de9 (0x67e0 bytes) 000520 1789446700.061741 mapread 0x01644a thru 0x01c610 (0x61c7 bytes) 000522 1789446700.084368 punch from 0x00e66a to 0x015afe (0x7495 bytes) 000523 1789446700.090098 fallocate 0x023722 thru 0x0266c5 (0x2fa4 bytes) 000524 1789446700.107797 trunc from 0x01644f to 0x023048 (0xcbfa bytes) 000525 1789446700.119350 punch from 0x003572 to 0x00e3d3 (0xae62 bytes) 000526 1789446700.125798 mapread 0x01d8d8 thru 0x022982 (0x50ab bytes) 000527 1789446700.143432 mapwrite 0x013b43 thru 0x0142e5 (0x7a3 bytes) 000530 1789446700.173111 mapread 0x015fe1 thru 0x01ef90 (0x8fb0 bytes) 000531 1789446700.175976 read 0x003f91 thru 0x0137e1 (0xf851 bytes) 000533 1789446700.197112 read 0x0145b3 thru 0x0173e0 (0x2e2e bytes) 000535 1789446700.198264 mapread 0x009bd2 thru 0x00c75f (0x2b8e bytes) 000536 1789446700.204108 trunc from 0x033826 to 0x037533 (0x3d0e bytes) 000537 1789446700.217439 trunc from 0x040000 to 0x019458 (0x26ba7 bytes) 000538 1789446700.243363 write 0x003207 thru 0x00d294 (0xa08e bytes) 000539 1789446700.246693 mapwrite 0x034945 thru 0x0389d7 (0x4093 bytes) 000540 1789446700.334608 write 0x0080a3 thru 0x008f5d (0xebb bytes) 000541 1789446700.335695 trunc from 0x0389d8 to 0x03717d (0x185a bytes) 000542 1789446700.354956 trunc from 0x024961 to 0x026719 (0x1db9 bytes) 000543 1789446700.360291 read 0x02e78f thru 0x03553c (0x6dae bytes) 000544 1789446700.361637 mapwrite 0x0074bc thru 0x00e051 (0x6b96 bytes) 000545 1789446700.380058 read 0x01de36 thru 0x02d975 (0xfb40 bytes) 000546 1789446700.386536 mapread 0x02f65c thru 0x033496 (0x3e3b bytes) 000547 1789446700.387534 fallocate 0x00ce81 thru 0x01665e (0x97de bytes) 000548 1789446700.393099 read 0x029574 thru 0x0352f4 (0xbd81 bytes) 000549 1789446700.393988 fallocate 0x034cc0 thru 0x03ffff (0xb340 bytes) 000550 1789446700.404139 MIRROR_EXTEND to 2 mirrors 000552 1789446701.311523 trunc from 0x040000 to 0x0224ba (0x1db45 bytes) 000553 1789446701.493571 read 0x019b6b thru 0x020de2 (0x7278 bytes) 000554 1789446701.505516 write 0x015494 thru 0x019fda (0x4b47 bytes) 000555 1789446701.510505 read 0x01804d thru 0x021776 (0x972a bytes) 000557 1789446701.524083 mapread 0x013602 thru 0x013a5f (0x45e bytes) 000558 1789446701.526061 trunc from 0x0224bb to 0x01266d (0xfe4d bytes) 000560 1789446701.549907 read 0x0013d7 thru 0x00f203 (0xde2d bytes) 000561 1789446701.551492 mapread 0x00e43a thru 0x00e848 (0x40f bytes) 000562 1789446701.552708 punch from 0x002cba to 0x009d00 (0x7047 bytes) 000563 1789446701.559322 read 0x00ef17 thru 0x01266d (0x3757 bytes) 000564 1789446701.560100 trunc from 0x005582 to 0x00606f (0xaee bytes) 000565 1789446701.568519 mapread 0x00f33c thru 0x01266d (0x3332 bytes) 000566 1789446701.569439 punch from 0x001d9a to 0x0063f0 (0x4657 bytes) 000567 1789446701.575677 mapwrite 0x01a8dd thru 0x021845 (0x6f69 bytes) 000569 1789446701.674354 fallocate 0x02c6d8 thru 0x0375c7 (0xaef0 bytes) 000570 1789446701.699703 write 0x036769 thru 0x03d7f0 (0x7088 bytes) 000571 1789446701.705502 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d7f1): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d7f1): Mirror 2: 0x9cc26848 (stale) CRC-32 checksum value for chunk [0, 0x3d7f1): Mirror 1: 0xfef04df1 Mirror 3: 0xfef04df1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d7f1: skipped 000572 1789446703.141319 trunc from 0x03d7f1 to 0x036ef2 (0x68fe bytes) 000573 1789446703.219528 read 0x035bb6 thru 0x036ef2 (0x133d bytes) 000574 1789446703.226897 trunc from 0x0240c0 to 0x02899d (0x48de bytes) 000575 1789446703.233585 trunc from 0x00e6b2 to 0x01ad4d (0xc69c bytes) 000576 1789446703.241125 read 0x023dae thru 0x027e85 (0x40d8 bytes) 000577 1789446703.260147 mapread 0x01066e thru 0x010a8a (0x41d bytes) 000578 1789446703.262119 punch from 0x034759 to 0x036ef2 (0x279a bytes) 000579 1789446703.268774 read 0x02cbc1 thru 0x02d0be (0x4fe bytes) 000580 1789446703.275399 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36ef3): Mirror 2: 0x976f010c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36ef3): Mirror 2: 0x976f010c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36ef3: skipped 000581 1789446703.569209 read 0x0210f6 thru 0x023b23 (0x2a2e bytes) 000582 1789446703.575313 fallocate 0x00a45b thru 0x015967 (0xb50d bytes) 000583 1789446703.584353 fallocate 0x03b2b5 thru 0x03ffff (0x4d4b bytes) 000584 1789446703.589723 trunc from 0x007031 to 0x00e9dc (0x79ac bytes) 000585 1789446703.595365 read 0x0028a4 thru 0x008855 (0x5fb2 bytes) 000586 1789446703.606883 mapwrite 0x0321a2 thru 0x03ffff (0xde5e bytes) 000587 1789446703.630575 fallocate 0x03b5bb thru 0x03ffff (0x4a45 bytes) 000588 1789446703.636017 trunc from 0x001f65 to 0x00e275 (0xc311 bytes) 000589 1789446703.641504 mapread 0x02cb6c thru 0x03bd90 (0xf225 bytes) 000590 1789446703.644094 punch from 0x03b4a6 to 0x03ffff (0x4b5a bytes) 000591 1789446703.649416 trunc from 0x001568 to 0x00d41b (0xbeb4 bytes) 000592 1789446703.660436 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x31591af3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xade1c2be Mirror 3: 0xade1c2be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000593 1789446704.786633 read 0x03c7c4 thru 0x03ffff (0x383c bytes) 000594 1789446704.812080 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) 000595 1789446705.190057 trunc from 0x040000 to 0x011c6c (0x2e393 bytes) 000596 1789446705.264750 mapwrite 0x01f8fe thru 0x02f018 (0xf71b bytes) 000597 1789446705.402768 trunc from 0x0169ad to 0x02293d (0xbf91 bytes) 000598 1789446705.419308 mapread 0x009722 thru 0x010536 (0x6e15 bytes) 000599 1789446705.431788 mapwrite 0x03209d thru 0x03928d (0x71f1 bytes) 000600 1789446705.510011 trunc from 0x0230a8 to 0x02ddc5 (0xad1e bytes) 000601 1789446705.525068 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3928e): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3928e): Mirror 3: 0xd59d5496 (stale) CRC-32 checksum value for chunk [0, 0x3928e): Mirror 1: 0x6b6cb0cb Mirror 4: 0x6b6cb0cb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3928e: skipped 000602 1789446707.100912 mapread 0x01b3c8 thru 0x0245ec (0x9225 bytes) 000604 1789446707.178793 write 0x029129 thru 0x02e616 (0x54ee bytes) 000605 1789446707.251062 mapwrite 0x010870 thru 0x019c06 (0x9397 bytes) 000606 1789446707.337634 trunc from 0x03928e to 0x013e38 (0x25455 bytes) 000607 1789446707.397095 trunc from 0x013e39 to 0x007e5b (0xbfdd bytes) 000608 1789446707.437049 read 0x00174f thru 0x007e5b (0x670d bytes) 000609 1789446707.473477 fallocate 0x00eb69 thru 0x01e867 (0xfcff bytes) 000610 1789446707.479220 write 0x00c922 thru 0x014a3b (0x811a bytes) 000611 1789446707.491466 trunc from 0x008381 to 0x0095e9 (0x1269 bytes) 000612 1789446707.496715 mapread 0x01c4ae thru 0x01e867 (0x23ba bytes) 000613 1789446707.507113 trunc from 0x01a333 to 0x01e867 (0x4535 bytes) 000614 1789446707.512348 write 0x01f922 thru 0x027407 (0x7ae6 bytes) 000615 1789446707.515122 read 0x02083b thru 0x027407 (0x6bcd bytes) 000616 1789446707.516375 read 0x0259da thru 0x027407 (0x1a2e bytes) 000617 1789446707.517369 fallocate 0x016741 thru 0x018c8e (0x254e bytes) 000618 1789446707.523105 mapwrite 0x03df88 thru 0x03ffff (0x2078 bytes) 000619 1789446707.566122 punch from 0x013909 to 0x018767 (0x4e5f bytes) 000620 1789446707.572718 trunc from 0x040000 to 0x016cbf (0x29340 bytes) 000621 1789446707.601504 punch from 0x0125aa to 0x016cbf (0x4716 bytes) 000622 1789446707.608639 fallocate 0x01333d thru 0x019844 (0x6508 bytes) 000624 1789446707.617625 fallocate 0x021369 thru 0x03017a (0xee12 bytes) 000625 1789446707.623395 read 0x002dcc thru 0x00aea7 (0x80dc bytes) 000626 1789446707.624568 mapread 0x01bb16 thru 0x021946 (0x5e31 bytes) 000627 1789446707.635868 write 0x01b043 thru 0x022fd1 (0x7f8f bytes) 000628 1789446707.642281 trunc from 0x03017b to 0x02cc89 (0x34f1 bytes) 000629 1789446707.672068 mapwrite 0x018b84 thru 0x027519 (0xe996 bytes) 000630 1789446707.728561 trunc from 0x02cc8a to 0x03a839 (0xdbb0 bytes) 000631 1789446707.751312 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a83a): Mirror 4: 0x772d711 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a83a): Mirror 4: 0x772d711 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a83a: skipped 000632 1789446708.108422 fallocate 0x03ec61 thru 0x03ffff (0x139f bytes) 000633 1789446708.126881 write 0x02cb30 thru 0x036006 (0x94d7 bytes) 000635 1789446708.151308 trunc from 0x040000 to 0x011f46 (0x2e0b9 bytes) 000636 1789446708.184873 fallocate 0x024ce1 thru 0x02df77 (0x9297 bytes) 000637 1789446708.198962 read 0x007847 thru 0x00b0a2 (0x385c bytes) 000638 1789446708.216903 punch from 0x011d80 to 0x011f46 (0x1c7 bytes) 000639 1789446708.223891 trunc from 0x011f47 to 0x0123b2 (0x46c bytes) 000640 1789446708.253736 read 0x00db67 thru 0x0123b2 (0x484c bytes) 000641 1789446708.281494 trunc from 0x0123b3 to 0x0084dd (0x9ed5 bytes) 000642 1789446708.359854 fallocate 0x00f71e thru 0x0170c1 (0x79a4 bytes) 000643 1789446708.365657 write 0x03188b thru 0x03a465 (0x8bdb bytes) 000644 1789446708.376333 read 0x00c510 thru 0x013393 (0x6e84 bytes) 000645 1789446708.391817 trunc from 0x03a466 to 0x0151e5 (0x25280 bytes) 000646 1789446708.431143 trunc from 0x005a1f to 0x0116b6 (0xbc98 bytes) 000647 1789446708.455760 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x151e6): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x151e6): Mirror 4: 0x60bd3486 (stale) CRC-32 checksum value for chunk [0, 0x151e6): Mirror 1: 0x60bd3486 Mirror 5: 0x60bd3486 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x151e6: skipped 000648 1789446709.830052 punch from 0x0147a1 to 0x0151e5 (0xa45 bytes) 000649 1789446709.883582 read 0x01041a thru 0x0151e5 (0x4dcc bytes) 000650 1789446709.898146 read 0x00bda9 thru 0x011526 (0x577e bytes) 000651 1789446709.910402 mapwrite 0x0060fa thru 0x007d7d (0x1c84 bytes) 000652 1789446709.927621 fallocate 0x01d25c thru 0x02a786 (0xd52b bytes) 000653 1789446709.932837 punch from 0x013545 to 0x0151e5 (0x1ca1 bytes) 000654 1789446709.938281 write 0x01547a thru 0x01b7e5 (0x636c bytes) 000655 1789446709.949473 trunc from 0x01b7e6 to 0x0082aa (0x1353b bytes) 000657 1789446709.971331 fallocate 0x02b26b thru 0x02f8d1 (0x4667 bytes) 000658 1789446709.977542 trunc from 0x0082ab to 0x032cc1 (0x2aa17 bytes) 000660 1789446710.002352 mapwrite 0x002842 thru 0x00f332 (0xcaf1 bytes) 000661 1789446710.079974 mapread 0x0304a9 thru 0x032cc1 (0x2819 bytes) 000662 1789446710.081230 fallocate 0x033aa6 thru 0x037f72 (0x44cd bytes) 000664 1789446710.088116 read 0x01feb6 thru 0x02eae8 (0xec33 bytes) 000665 1789446710.089008 fallocate 0x030d7f thru 0x033091 (0x2313 bytes) 000666 1789446710.095521 fallocate 0x01fb80 thru 0x02b568 (0xb9e9 bytes) 000667 1789446710.100808 fallocate 0x008c2e thru 0x00c45a (0x382d bytes) 000668 1789446710.106638 trunc from 0x01de65 to 0x01fda0 (0x1f3c bytes) 000669 1789446710.111747 trunc from 0x01aa76 to 0x02595d (0xaee8 bytes) 000670 1789446710.117437 punch from 0x0147f7 to 0x01b679 (0x6e83 bytes) 000671 1789446710.122372 read 0x016b4e thru 0x01fe9e (0x9351 bytes) 000672 1789446710.133513 punch from 0x032ca8 to 0x032cc1 (0x1a bytes) 000674 1789446710.139147 write 0x0080b6 thru 0x00e4fc (0x6447 bytes) 000676 1789446710.141976 mapwrite 0x01f630 thru 0x029c52 (0xa623 bytes) 000677 1789446710.163091 read 0x012c29 thru 0x018927 (0x5cff bytes) 000678 1789446710.164932 punch from 0x010c7e to 0x01b5b2 (0xa935 bytes) 000680 1789446710.183102 trunc from 0x008d42 to 0x01298d (0x9c4c bytes) 000682 1789446710.193494 mapread 0x0091b0 thru 0x017dd0 (0xec21 bytes) 000683 1789446710.217980 trunc from 0x032cc2 to 0x033170 (0x4af bytes) 000684 1789446710.239373 write 0x03a3c9 thru 0x03ffff (0x5c37 bytes) 000685 1789446710.243024 punch from 0x039ac0 to 0x03a324 (0x865 bytes) 000686 1789446710.258352 mapread 0x0074b7 thru 0x010967 (0x94b1 bytes) 000687 1789446710.260106 mapwrite 0x00de0b thru 0x00f14d (0x1343 bytes) 000688 1789446710.275733 trunc from 0x040000 to 0x00363b (0x3c9c4 bytes) 000689 1789446710.299597 read 0x002e9f thru 0x00363b (0x79d bytes) 000690 1789446710.300912 punch from 0x0027e3 to 0x00363b (0xe59 bytes) 000691 1789446710.307513 trunc from 0x00363c to 0x0325e3 (0x2efa8 bytes) 000692 1789446710.335269 trunc from 0x00f05d to 0x0123ce (0x3372 bytes) 000693 1789446710.347047 punch from 0x010e61 to 0x01895d (0x7afd bytes) 000694 1789446710.355237 trunc from 0x0325e4 to 0x000dac (0x31837 bytes) 000695 1789446710.375521 mapwrite 0x011cd1 thru 0x01fb64 (0xde94 bytes) 000696 1789446710.483842 trunc from 0x01fb65 to 0x031cbe (0x1215a bytes) 000697 1789446710.522749 mapwrite 0x0008cc thru 0x009731 (0x8e66 bytes) 000698 1789446710.559215 mapread 0x02923f thru 0x031cbe (0x8a80 bytes) 000699 1789446710.582947 trunc from 0x031cbf to 0x00f239 (0x22a85 bytes) 000700 1789446710.622541 write 0x014db9 thru 0x01a18d (0x53d5 bytes) 000701 1789446710.624018 trunc from 0x008465 to 0x00c87d (0x4419 bytes) 000702 1789446710.647331 fallocate 0x039a2f thru 0x03ffff (0x65d1 bytes) 000703 1789446710.665404 mapwrite 0x02df3b thru 0x03407c (0x6142 bytes) 000704 1789446710.771414 trunc from 0x03407d to 0x004053 (0x30029 bytes) 000705 1789446710.805818 write 0x015859 thru 0x01f113 (0x98bb bytes) 000706 1789446710.833297 MIRROR_RESYNC 3 mirrors 000708 1789446711.973507 mapread 0x009a12 thru 0x00f045 (0x5634 bytes) 000709 1789446711.998858 mapread 0x0196cd thru 0x01f113 (0x5a47 bytes) 000710 1789446712.008950 write 0x0119b4 thru 0x01d82f (0xbe7c bytes) 000711 1789446712.055751 punch from 0x011f38 to 0x01236d (0x436 bytes) 000712 1789446712.079369 trunc from 0x01f114 to 0x01fc45 (0xb32 bytes) 000714 1789446712.109291 read 0x016b62 thru 0x01842b (0x18ca bytes) 000716 1789446712.111860 trunc from 0x008fb5 to 0x00e7ac (0x57f8 bytes) 000717 1789446712.117599 fallocate 0x000f6d thru 0x00d738 (0xc7cc bytes) 000718 1789446712.123102 fallocate 0x020481 thru 0x02ebdd (0xe75d bytes) 000719 1789446712.133123 mapread 0x0046c2 thru 0x0088cc (0x420b bytes) 000720 1789446712.155279 mapwrite 0x036f4a thru 0x03ffff (0x90b6 bytes) 000721 1789446712.295208 write 0x014b57 thru 0x01d418 (0x88c2 bytes) 000722 1789446712.302807 mapwrite 0x02e777 thru 0x03d611 (0xee9b bytes) 000723 1789446712.405244 trunc from 0x021c86 to 0x02454d (0x28c8 bytes) 000724 1789446712.416280 trunc from 0x040000 to 0x00767b (0x38984 bytes) 000725 1789446712.437649 trunc from 0x006626 to 0x00767b (0x1056 bytes) 000726 1789446712.444717 mapwrite 0x0224c7 thru 0x02a8ea (0x8424 bytes) 000727 1789446712.549270 trunc from 0x004d49 to 0x00f676 (0xa92e bytes) 000728 1789446712.568817 mapread 0x011d26 thru 0x015a69 (0x3d44 bytes) 000729 1789446712.612566 write 0x027a1a thru 0x02b36e (0x3955 bytes) 000730 1789446712.618302 write 0x0069e5 thru 0x0161e0 (0xf7fc bytes) 000731 1789446712.632439 punch from 0x00b16f to 0x01ad81 (0xfc13 bytes) 000733 1789446712.655551 fallocate 0x0122e1 thru 0x0186b1 (0x63d1 bytes) 000734 1789446712.668018 punch from 0x012246 to 0x01a8aa (0x8665 bytes) 000735 1789446712.684060 fallocate 0x028e2f thru 0x02fd78 (0x6f4a bytes) 000737 1789446712.704733 MIRROR_RESYNC 3 mirrors 000738 1789446713.705690 mapwrite 0x01fe89 thru 0x02cb5f (0xccd7 bytes) 000739 1789446713.836655 trunc from 0x00ff0f to 0x019524 (0x9616 bytes) 000740 1789446713.842789 mapwrite 0x00ca38 thru 0x01372f (0x6cf8 bytes) 000742 1789446713.887935 mapwrite 0x0179b6 thru 0x01dfd3 (0x661e bytes) 000743 1789446713.921939 read 0x001e03 thru 0x00a6db (0x88d9 bytes) 000744 1789446713.930309 fallocate 0x02b503 thru 0x0340e3 (0x8be1 bytes) 000745 1789446713.939118 mapread 0x02bbc5 thru 0x02cb5f (0xf9b bytes) 000747 1789446713.945284 trunc from 0x02cb60 to 0x02a897 (0x22c8 bytes) 000748 1789446713.973873 write 0x01ed55 thru 0x023801 (0x4aad bytes) 000749 1789446713.977039 write 0x03c87c thru 0x03e5f2 (0x1d77 bytes) 000750 1789446713.983584 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e5f3): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e5f3): Mirror 4: 0x55c5fd33 (stale) Mirror 5: 0x55c5fd33 (stale) CRC-32 checksum value for chunk [0, 0x3e5f3): Mirror 1: 0x3f9bae8 Mirror 6: 0x3f9bae8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e5f3: skipped 000751 1789446715.465985 punch from 0x0270ee to 0x02c03e (0x4f51 bytes) 000752 1789446715.546643 mapread 0x022550 thru 0x02c539 (0x9fea bytes) 000753 1789446715.591555 read 0x01b608 thru 0x022f8d (0x7986 bytes) 000754 1789446715.597306 punch from 0x03e101 to 0x03e5f2 (0x4f2 bytes) 000755 1789446715.602975 mapwrite 0x02db6f thru 0x03bd12 (0xe1a4 bytes) 000756 1789446715.666361 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e5f3): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e5f3): Mirror 4: 0x55c5fd33 (stale) Mirror 5: 0x55c5fd33 (stale) Mirror 6: 0x3f9bae8 (stale) CRC-32 checksum value for chunk [0, 0x3e5f3): Mirror 1: 0xbb28c4b1 Mirror 7: 0xbb28c4b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e5f3: skipped 000757 1789446716.823423 trunc from 0x03e5f3 to 0x00a08e (0x34564 bytes) 000758 1789446716.903302 mapread 0x0092af thru 0x00a08e (0xde0 bytes) 000759 1789446716.917483 punch from 0x001481 to 0x0079fe (0x657e bytes) 000760 1789446716.924329 mapwrite 0x003a0f thru 0x009be7 (0x61d9 bytes) 000762 1789446716.990207 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xa08f): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa08f): Mirror 4: 0xe86ba2f6 (stale) Mirror 5: 0xe86ba2f6 (stale) Mirror 6: 0xe86ba2f6 (stale) Mirror 7: 0xe86ba2f6 (stale) CRC-32 checksum value for chunk [0, 0xa08f): Mirror 1: 0x393cc95e Mirror 8: 0x393cc95e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa08f: skipped 000763 1789446718.116079 read 0x0014be thru 0x00734b (0x5e8e bytes) 000764 1789446718.149837 punch from 0x00187b to 0x00a08e (0x8814 bytes) 000765 1789446718.210207 trunc from 0x00a08f to 0x012450 (0x83c2 bytes) 000766 1789446718.245350 mapwrite 0x03716a thru 0x03cbea (0x5a81 bytes) 000767 1789446718.324511 trunc from 0x03cbeb to 0x02f004 (0xdbe6 bytes) 000768 1789446718.345384 mapread 0x02d755 thru 0x02f004 (0x18b0 bytes) 000769 1789446718.363204 mapwrite 0x03cdff thru 0x03ffff (0x3201 bytes) 000770 1789446718.421899 trunc from 0x040000 to 0x029a3b (0x165c4 bytes) 000771 1789446718.445084 punch from 0x01155c to 0x012fd2 (0x1a77 bytes) 000773 1789446718.456015 trunc from 0x02441e to 0x029a3b (0x561e bytes) 000774 1789446718.462020 trunc from 0x029a3c to 0x0338a1 (0x9e66 bytes) 000775 1789446718.483692 trunc from 0x0338a2 to 0x021cf3 (0x11bae bytes) 000776 1789446718.518742 read 0x0129c9 thru 0x021bdd (0xf215 bytes) 000777 1789446718.538488 read 0x00e21b thru 0x0167f9 (0x85df bytes) 000778 1789446718.539125 read 0x0080fe thru 0x0144af (0xc3b2 bytes) 000780 1789446718.540195 mapwrite 0x013d63 thru 0x0177d3 (0x3a71 bytes) 000781 1789446718.557296 read 0x00ea91 thru 0x0134a8 (0x4a18 bytes) 000782 1789446718.558279 mapread 0x021afb thru 0x021cde (0x1e4 bytes) 000783 1789446718.560298 fallocate 0x01046a thru 0x012321 (0x1eb8 bytes) 000784 1789446718.575225 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x21cf4): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21cf4): Mirror 4: 0x2e7c0a72 (stale) Mirror 5: 0x2e7c0a72 (stale) Mirror 6: 0x27a756d (stale) Mirror 7: 0x27a756d (stale) Mirror 8: 0xf8c04ae9 (stale) CRC-32 checksum value for chunk [0, 0x21cf4): Mirror 1: 0x6283df7f Mirror 9: 0x6283df7f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21cf4: skipped 000785 1789446719.800429 fallocate 0x004813 thru 0x004e6b (0x659 bytes) 000786 1789446719.847477 mapread 0x0084a5 thru 0x00f4fd (0x7059 bytes) 000787 1789446719.874023 trunc from 0x021b7b to 0x021cf3 (0x179 bytes) 000788 1789446719.893053 mapwrite 0x011e31 thru 0x01d113 (0xb2e3 bytes) 000789 1789446720.003138 mapwrite 0x008cbe thru 0x01198e (0x8cd1 bytes) 000790 1789446720.052134 mapread 0x009862 thru 0x018afb (0xf29a bytes) 000791 1789446720.053289 write 0x003dca thru 0x00c701 (0x8938 bytes) 000792 1789446720.060685 trunc from 0x0021af to 0x00bcbb (0x9b0d bytes) 000793 1789446720.079688 write 0x01b25d thru 0x0298e0 (0xe684 bytes) 000794 1789446720.081889 mapread 0x015917 thru 0x01e914 (0x8ffe bytes) 000795 1789446720.084082 trunc from 0x00898f to 0x014c54 (0xc2c6 bytes) 000796 1789446720.089668 trunc from 0x027b13 to 0x0298e0 (0x1dce bytes) 000797 1789446720.113110 read 0x005685 thru 0x00c932 (0x72ae bytes) 000798 1789446720.126956 punch from 0x002c85 to 0x00d220 (0xa59c bytes) 000799 1789446720.131919 write 0x029009 thru 0x02f3d1 (0x63c9 bytes) 000801 1789446720.153579 trunc from 0x02f3d2 to 0x037067 (0x7c96 bytes) 000802 1789446720.196694 punch from 0x032f5d to 0x037067 (0x410b bytes) 000803 1789446720.208353 trunc from 0x037068 to 0x03f398 (0x8331 bytes) 000804 1789446720.239631 mapread 0x00cf2d thru 0x014a95 (0x7b69 bytes) 000805 1789446720.282401 mapwrite 0x009de4 thru 0x00d38b (0x35a8 bytes) 000806 1789446720.331629 read 0x030f7f thru 0x035cec (0x4d6e bytes) 000807 1789446720.356115 fallocate 0x02ba06 thru 0x032ce5 (0x72e0 bytes) 000808 1789446720.370597 punch from 0x02309e to 0x028160 (0x50c3 bytes) 000809 1789446720.392250 fallocate 0x004bcd thru 0x01385b (0xec8f bytes) 000810 1789446720.409682 trunc from 0x03f399 to 0x028add (0x168bb bytes) 000812 1789446720.430908 trunc from 0x028ade to 0x01de8d (0xac50 bytes) 000813 1789446720.459099 MIRROR_RESYNC 7 mirrors 000814 1789446722.560057 mapwrite 0x02e3ba thru 0x02ef4d (0xb94 bytes) 000815 1789446722.633886 write 0x0106e3 thru 0x01dc0d (0xd52b bytes) 000816 1789446722.644384 write 0x03b0bb thru 0x03bfc4 (0xf0a bytes) 000817 1789446722.645283 write 0x008559 thru 0x0107a3 (0x824b bytes) 000818 1789446722.653086 trunc from 0x01fc53 to 0x0271ab (0x7559 bytes) 000819 1789446722.658619 mapread 0x023f35 thru 0x028cc0 (0x4d8c bytes) 000820 1789446722.673810 read 0x009c19 thru 0x018233 (0xe61b bytes) 000822 1789446722.674749 mapwrite 0x03e43a thru 0x03ffff (0x1bc6 bytes) 000824 1789446722.728799 trunc from 0x040000 to 0x01c234 (0x23dcb bytes) 000825 1789446722.749554 read 0x0025c8 thru 0x0097ed (0x7226 bytes) 000827 1789446722.765806 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c235): Mirror 4: 0x93e7a6b5 (stale) Mirror 5: 0x93e7a6b5 (stale) Mirror 7: 0x93e7a6b5 (stale) Mirror 8: 0x93e7a6b5 (stale) Mirror 9: 0x93e7a6b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c235): Mirror 4: 0x93e7a6b5 (stale) Mirror 5: 0x93e7a6b5 (stale) Mirror 7: 0x93e7a6b5 (stale) Mirror 8: 0x93e7a6b5 (stale) Mirror 9: 0x93e7a6b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c235: skipped 000828 1789446723.304722 fallocate 0x0161d7 thru 0x01f373 (0x919d bytes) 000829 1789446723.312414 mapwrite 0x0279c7 thru 0x035ad4 (0xe10e bytes) 000830 1789446723.434434 mapwrite 0x030a91 thru 0x03fa68 (0xefd8 bytes) 000831 1789446723.493750 fallocate 0x01b501 thru 0x01d38d (0x1e8d bytes) 000833 1789446723.502906 mapread 0x03eca1 thru 0x03fa68 (0xdc8 bytes) 000834 1789446723.518862 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fa69): Mirror 5: 0xbf952b72 (stale) Mirror 7: 0xbf952b72 (stale) Mirror 8: 0xbf952b72 (stale) Mirror 9: 0xbf952b72 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa69): Mirror 5: 0xbf952b72 (stale) Mirror 7: 0xbf952b72 (stale) Mirror 8: 0xbf952b72 (stale) Mirror 9: 0xbf952b72 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa69: skipped 000835 1789446723.987966 write 0x029e28 thru 0x03951e (0xf6f7 bytes) 000836 1789446724.011006 mapwrite 0x0153b3 thru 0x019936 (0x4584 bytes) 000837 1789446724.063489 MIRROR_RESYNC 5 mirrors 000838 1789446725.734336 mapread 0x0245ce thru 0x02f154 (0xab87 bytes) 000839 1789446725.803538 mapwrite 0x000595 thru 0x004589 (0x3ff5 bytes) 000840 1789446725.909952 MIRROR_RESYNC 5 mirrors 000842 1789446727.153424 write 0x00f275 thru 0x010296 (0x1022 bytes) 000843 1789446727.195899 fallocate 0x025acb thru 0x02eef2 (0x9428 bytes) 000844 1789446727.200886 punch from 0x018bde to 0x026d7d (0xe1a0 bytes) 000845 1789446727.206244 read 0x0011ae thru 0x0058b1 (0x4704 bytes) 000846 1789446727.215834 fallocate 0x0252a5 thru 0x02cd60 (0x7abc bytes) 000847 1789446727.220852 mapwrite 0x00c0ee thru 0x014188 (0x809b bytes) 000848 1789446727.267838 write 0x032b74 thru 0x03daea (0xaf77 bytes) 000849 1789446727.290938 trunc from 0x034a2a to 0x03fa68 (0xb03f bytes) 000850 1789446727.311140 trunc from 0x00e02e to 0x012dd0 (0x4da3 bytes) 000851 1789446727.318082 mapread 0x0104b1 thru 0x01f283 (0xedd3 bytes) 000852 1789446727.349478 trunc from 0x013ec2 to 0x01bc8f (0x7dce bytes) 000853 1789446727.362062 write 0x004f43 thru 0x00543e (0x4fc bytes) 000854 1789446727.363865 trunc from 0x03fa69 to 0x027e5b (0x17c0d bytes) 000855 1789446727.397253 trunc from 0x027e5c to 0x033172 (0xb317 bytes) 000856 1789446727.410129 mapread 0x0006aa thru 0x005eef (0x5846 bytes) 000857 1789446727.423837 read 0x023b5a thru 0x030f3f (0xd3e6 bytes) 000859 1789446727.438043 punch from 0x01c26c to 0x01cac1 (0x856 bytes) 000860 1789446727.447205 read 0x00ad3f thru 0x014b59 (0x9e1b bytes) 000861 1789446727.448361 fallocate 0x0381f7 thru 0x03ffff (0x7e09 bytes) 000863 1789446727.461146 mapread 0x00fd3b thru 0x019b8d (0x9e53 bytes) 000864 1789446727.462280 punch from 0x008985 to 0x015502 (0xcb7e bytes) 000865 1789446727.470340 read 0x028ade thru 0x033172 (0xa695 bytes) 000866 1789446727.479590 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x33173): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33173): Mirror 5: 0xfbcc1b1e (stale) Mirror 7: 0xfbcc1b1e (stale) Mirror 8: 0xfbcc1b1e (stale) Mirror 9: 0xfbcc1b1e (stale) CRC-32 checksum value for chunk [0, 0x33173): Mirror 1: 0x5e9f0f54 Mirror 10: 0x5e9f0f54 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33173: skipped 000867 1789446728.471902 trunc from 0x0326f7 to 0x033172 (0xa7c bytes) 000868 1789446728.512818 trunc from 0x033173 to 0x037637 (0x44c5 bytes) 000869 1789446728.561128 fallocate 0x025206 thru 0x032118 (0xcf13 bytes) 000871 1789446728.567203 write 0x003c1a thru 0x00b4cc (0x78b3 bytes) 000872 1789446728.577190 fallocate 0x025a53 thru 0x02c724 (0x6cd2 bytes) 000873 1789446728.582134 fallocate 0x034dff thru 0x036790 (0x1992 bytes) 000874 1789446728.587935 fallocate 0x0192cb thru 0x0265d7 (0xd30d bytes) 000875 1789446728.591825 trunc from 0x016357 to 0x02022c (0x9ed6 bytes) 000876 1789446728.596155 trunc from 0x037638 to 0x01e980 (0x18cb7 bytes) 000877 1789446728.614080 trunc from 0x016a2a to 0x0191e3 (0x27ba bytes) 000878 1789446728.619351 punch from 0x013fe3 to 0x014a9f (0xabd bytes) 000879 1789446728.623987 read 0x01c808 thru 0x01e980 (0x2179 bytes) 000881 1789446728.630030 write 0x011bdb thru 0x01b88a (0x9cb0 bytes) 000882 1789446728.644804 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1e981): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e981): Mirror 5: 0x504bb03c (stale) Mirror 7: 0x504bb03c (stale) Mirror 8: 0x504bb03c (stale) Mirror 9: 0x504bb03c (stale) Mirror 10: 0x24e499f0 (stale) CRC-32 checksum value for chunk [0, 0x1e981): Mirror 1: 0xcb32a8ee Mirror 11: 0xcb32a8ee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e981: skipped 000883 1789446729.741793 read 0x00a378 thru 0x015a03 (0xb68c bytes) 000884 1789446729.760141 MIRROR_RESYNC 7 mirrors 000885 1789446731.217945 mapread 0x00ffb9 thru 0x016e13 (0x6e5b bytes) 000887 1789446731.244272 punch from 0x01a4d7 to 0x01e980 (0x44aa bytes) 000889 1789446731.332528 mapread 0x0094e6 thru 0x0189db (0xf4f6 bytes) 000890 1789446731.356542 mapwrite 0x017e5e thru 0x01de5b (0x5ffe bytes) 000891 1789446731.391801 write 0x02eb90 thru 0x0343a3 (0x5814 bytes) 000892 1789446731.393968 write 0x0165df thru 0x024584 (0xdfa6 bytes) 000893 1789446731.413952 read 0x0125ab thru 0x014b09 (0x255f bytes) 000894 1789446731.414668 trunc from 0x02983c to 0x0343a3 (0xab68 bytes) 000895 1789446731.459222 punch from 0x022f0c to 0x02b945 (0x8a3a bytes) 000896 1789446731.484565 write 0x02992a thru 0x02da19 (0x40f0 bytes) 000897 1789446731.505635 punch from 0x015d01 to 0x01a745 (0x4a45 bytes) 000898 1789446731.514925 mapwrite 0x02683c thru 0x02d65a (0x6e1f bytes) 000899 1789446731.582311 trunc from 0x0343a4 to 0x03401e (0x385 bytes) 000900 1789446731.608513 punch from 0x0053cd to 0x011d99 (0xc9cd bytes) 000901 1789446731.616326 mapwrite 0x0339d4 thru 0x03ffff (0xc62c bytes) 000902 1789446731.719289 write 0x0298a8 thru 0x02b8d1 (0x202a bytes) 000903 1789446731.720632 write 0x00e2c7 thru 0x0183cc (0xa106 bytes) 000904 1789446731.732616 trunc from 0x02ecdd to 0x036b64 (0x7e88 bytes) 000905 1789446731.762462 MIRROR_RESYNC 7 mirrors 000906 1789446734.135914 fallocate 0x00a5bc thru 0x0134cd (0x8f12 bytes) 000907 1789446734.177822 read 0x020fb2 thru 0x02cdb1 (0xbe00 bytes) 000908 1789446734.191102 mapwrite 0x00b579 thru 0x01249c (0x6f24 bytes) 000909 1789446734.228930 trunc from 0x021a73 to 0x025088 (0x3616 bytes) 000910 1789446734.234718 trunc from 0x040000 to 0x006810 (0x397ef bytes) 000912 1789446734.256863 fallocate 0x035eab thru 0x03ffff (0xa155 bytes) 000913 1789446734.263472 trunc from 0x005d5d to 0x006810 (0xab4 bytes) 000914 1789446734.269104 trunc from 0x00030c to 0x0062a0 (0x5f95 bytes) 000915 1789446734.275607 trunc from 0x003c10 to 0x006810 (0x2c01 bytes) 000916 1789446734.280792 punch from 0x004a43 to 0x006810 (0x1dce bytes) 000917 1789446734.287099 mapread 0x0013e1 thru 0x006810 (0x5430 bytes) 000918 1789446734.298878 read 0x000e1b thru 0x006810 (0x59f6 bytes) 000919 1789446734.304957 mapwrite 0x025786 thru 0x027f9d (0x2818 bytes) 000920 1789446734.351771 mapwrite 0x0070e3 thru 0x01682f (0xf74d bytes) 000921 1789446734.373333 trunc from 0x027f9e to 0x02bf38 (0x3f9b bytes) 000922 1789446734.387731 punch from 0x00f128 to 0x01775e (0x8637 bytes) 000923 1789446734.394511 trunc from 0x015e15 to 0x01c1ec (0x63d8 bytes) 000924 1789446734.400032 write 0x01ccc3 thru 0x02197d (0x4cbb bytes) 000925 1789446734.409639 fallocate 0x010b61 thru 0x012321 (0x17c1 bytes) 000927 1789446734.415482 mapread 0x01684b thru 0x018c64 (0x241a bytes) 000928 1789446734.430922 read 0x02269c thru 0x024850 (0x21b5 bytes) 000929 1789446734.432275 read 0x0221d0 thru 0x02bf38 (0x9d69 bytes) 000930 1789446734.433092 punch from 0x010169 to 0x018d03 (0x8b9b bytes) 000931 1789446734.439252 trunc from 0x02bf39 to 0x00422b (0x27d0d bytes) 000932 1789446734.456026 fallocate 0x029568 thru 0x037879 (0xe312 bytes) 000933 1789446734.461808 fallocate 0x012226 thru 0x012fb2 (0xd8d bytes) 000934 1789446734.467656 fallocate 0x01c3c3 thru 0x01fea1 (0x3adf bytes) 000935 1789446734.472949 punch from 0x0073f7 to 0x00d324 (0x5f2e bytes) 000936 1789446734.477712 trunc from 0x01fea2 to 0x008406 (0x17a9b bytes) 000937 1789446734.491450 write 0x0391d9 thru 0x03ffff (0x6e27 bytes) 000939 1789446734.495328 trunc from 0x00c91b to 0x017de8 (0xb4ce bytes) 000942 1789446734.503503 trunc from 0x040000 to 0x00d416 (0x32be9 bytes) 000943 1789446734.517480 trunc from 0x00c5be to 0x00d416 (0xe59 bytes) 000944 1789446734.522660 mapwrite 0x0038df thru 0x00f22c (0xb94e bytes) 000945 1789446734.570188 mapwrite 0x0243df thru 0x033f9c (0xfbbe bytes) 000946 1789446734.691979 mapread 0x0034d5 thru 0x012be9 (0xf715 bytes) 000947 1789446734.702096 read 0x022662 thru 0x02b602 (0x8fa1 bytes) 000949 1789446734.707660 trunc from 0x022725 to 0x02af2c (0x8808 bytes) 000950 1789446734.724154 mapwrite 0x038fce thru 0x03ffff (0x7032 bytes) 000951 1789446734.848708 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x87670b1f (stale) Mirror 7: 0x87670b1f (stale) Mirror 8: 0x87670b1f (stale) Mirror 9: 0x87670b1f (stale) Mirror 11: 0x87670b1f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x87670b1f (stale) Mirror 7: 0x87670b1f (stale) Mirror 8: 0x87670b1f (stale) Mirror 9: 0x87670b1f (stale) Mirror 11: 0x87670b1f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000953 1789446735.538867 punch from 0x03d19e to 0x03e984 (0x17e7 bytes) 000954 1789446735.545803 mapread 0x038ac1 thru 0x03ffff (0x753f bytes) 000955 1789446735.576768 write 0x02cb83 thru 0x02e909 (0x1d87 bytes) 000956 1789446735.604384 mapread 0x03558b thru 0x038777 (0x31ed bytes) 000957 1789446735.608738 trunc from 0x040000 to 0x0249e4 (0x1b61b bytes) 000958 1789446735.647836 trunc from 0x0249e5 to 0x02f6e1 (0xacfd bytes) 000959 1789446735.672054 trunc from 0x01d37d to 0x021777 (0x43fb bytes) 000960 1789446735.685369 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2f6e2): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f6e2): Mirror 5: 0xc700e238 (stale) Mirror 7: 0xc700e238 (stale) Mirror 8: 0xc700e238 (stale) Mirror 9: 0xc700e238 (stale) Mirror 11: 0xc700e238 (stale) CRC-32 checksum value for chunk [0, 0x2f6e2): Mirror 1: 0x8f05f20c Mirror 12: 0x8f05f20c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f6e2: skipped 000961 1789446736.912377 mapwrite 0x03f3ae thru 0x03ffff (0xc52 bytes) 000962 1789446737.007623 trunc from 0x03be37 to 0x03ffff (0x41c9 bytes) 000963 1789446737.014070 mapwrite 0x018974 thru 0x022d9b (0xa428 bytes) 000964 1789446737.070657 read 0x03c766 thru 0x03e123 (0x19be bytes) 000965 1789446737.079066 punch from 0x00cd77 to 0x010e47 (0x40d1 bytes) 000967 1789446737.086679 write 0x0257bd thru 0x02f212 (0x9a56 bytes) 000969 1789446737.097001 read 0x0172ac thru 0x01ec7b (0x79d0 bytes) 000970 1789446737.098027 read 0x02eb8e thru 0x033619 (0x4a8c bytes) 000971 1789446737.112316 mapwrite 0x020adc thru 0x02449e (0x39c3 bytes) 000972 1789446737.132521 write 0x01317d thru 0x01bac4 (0x8948 bytes) 000973 1789446737.134104 write 0x0123f3 thru 0x01561e (0x322c bytes) 000974 1789446737.135256 write 0x016686 thru 0x02192b (0xb2a6 bytes) 000975 1789446737.139666 mapwrite 0x034545 thru 0x039936 (0x53f2 bytes) 000976 1789446737.169714 read 0x024287 thru 0x02d05c (0x8dd6 bytes) 000977 1789446737.170952 write 0x02d541 thru 0x037860 (0xa320 bytes) 000978 1789446737.174512 trunc from 0x040000 to 0x009500 (0x36aff bytes) 000979 1789446737.208339 mapread 0x001096 thru 0x009500 (0x846b bytes) 000980 1789446737.212298 write 0x01931e thru 0x019ddf (0xac2 bytes) 000982 1789446737.217879 mapwrite 0x024876 thru 0x031d9d (0xd528 bytes) 000983 1789446737.337882 MIRROR_RESYNC 7 mirrors 000984 1789446739.668907 trunc from 0x015deb to 0x02594f (0xfb65 bytes) 000985 1789446739.713924 write 0x0277e0 thru 0x03083e (0x905f bytes) 000986 1789446739.729723 read 0x00bf17 thru 0x01a516 (0xe600 bytes) 000987 1789446739.740304 trunc from 0x026fe6 to 0x02f7be (0x87d9 bytes) 000988 1789446739.758049 mapwrite 0x01160f thru 0x014b8f (0x3581 bytes) 000989 1789446739.773087 write 0x0199f0 thru 0x019c2d (0x23e bytes) 000993 1789446739.776213 punch from 0x006150 to 0x012534 (0xc3e5 bytes) 000994 1789446739.783326 trunc from 0x023438 to 0x0309ca (0xd593 bytes) 000996 1789446739.790008 trunc from 0x031d9e to 0x033e7d (0x20e0 bytes) 000998 1789446739.819995 mapread 0x016045 thru 0x022c66 (0xcc22 bytes) 001000 1789446739.842019 punch from 0x0189d4 to 0x020734 (0x7d61 bytes) All operations completed A-OK!