== sanity-flr test 70a: flr mode fsx test ================ 16:34:14 (1787603654) Seed set to 3656 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1787603656.563316 write 0x01c7a9 thru 0x01faba (0x3312 bytes) 000003 1787603656.573634 mapwrite 0x00ed4a thru 0x012069 (0x3320 bytes) 000006 1787603656.679093 write 0x02aea5 thru 0x03608c (0xb1e8 bytes) 000007 1787603656.681778 read 0x034e91 thru 0x03608c (0x11fc bytes) truncating to largest ever: 0x13843 000009 1787603656.684069 trunc from 0x03608d to 0x013842 (0x2284a bytes) 000010 1787603656.701496 mapread 0x0044f3 thru 0x010573 (0xc081 bytes) 000011 1787603656.725799 MIRROR_EXTEND to 2 mirrors 000012 1787603657.626522 write 0x0099f9 thru 0x009ae6 (0xee bytes) 000014 1787603657.700208 mapread 0x00b512 thru 0x013842 (0x8331 bytes) 000015 1787603657.719161 read 0x0057a1 thru 0x008b7a (0x33da bytes) 000017 1787603657.728238 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x13843): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13843): Mirror 2: 0x878025b (stale) CRC-32 checksum value for chunk [0, 0x13843): Mirror 1: 0x4a5e28f4 Mirror 3: 0x4a5e28f4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13843: skipped 000019 1787603658.706384 read 0x00c174 thru 0x013842 (0x76cf bytes) 000020 1787603658.750567 write 0x01bcba thru 0x028896 (0xcbdd bytes) 000021 1787603658.870181 mapwrite 0x03b737 thru 0x03ffff (0x48c9 bytes) 000022 1787603659.016107 mapwrite 0x027073 thru 0x035465 (0xe3f3 bytes) 000023 1787603659.120959 mapwrite 0x00e4a1 thru 0x01123c (0x2d9c bytes) 000025 1787603659.156969 write 0x03f8d5 thru 0x03ffff (0x72b bytes) 000026 1787603659.157986 mapread 0x01794f thru 0x01995f (0x2011 bytes) 000028 1787603659.198299 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd4c551e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd4c551e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000029 1787603659.621598 read 0x02b31d thru 0x032958 (0x763c bytes) 000030 1787603659.642549 read 0x02346f thru 0x0260a6 (0x2c38 bytes) 000031 1787603659.675447 write 0x016830 thru 0x01b377 (0x4b48 bytes) truncating to largest ever: 0x37541 000032 1787603659.676575 trunc from 0x040000 to 0x037540 (0x8abf bytes) 000033 1787603659.692917 mapread 0x019026 thru 0x01baf4 (0x2acf bytes) 000034 1787603659.693866 read 0x025b6f thru 0x0357ef (0xfc81 bytes) 000036 1787603659.694953 trunc from 0x037541 to 0x009090 (0x2e4b0 bytes) 000038 1787603659.719841 mapread 0x003752 thru 0x009090 (0x593f bytes) 000041 1787603659.721611 trunc from 0x009091 to 0x0164b0 (0xd420 bytes) 000042 1787603659.734902 mapread 0x009039 thru 0x00b13d (0x2105 bytes) 000044 1787603659.746082 trunc from 0x0164b1 to 0x034ac4 (0x1e614 bytes) 000045 1787603659.762575 write 0x038ebe thru 0x03ffff (0x7142 bytes) 000047 1787603659.770286 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) 000048 1787603659.912429 trunc from 0x040000 to 0x0292c9 (0x16d36 bytes) 000049 1787603659.935239 MIRROR_EXTEND to 2 mirrors 000050 1787603660.800117 mapread 0x00d960 thru 0x01493c (0x6fdd bytes) 000051 1787603660.815962 mapwrite 0x006ff8 thru 0x01393c (0xc945 bytes) 000053 1787603661.100111 trunc from 0x0292ca to 0x00f8b6 (0x19a13 bytes) 000054 1787603661.144620 read 0x008372 thru 0x00f8b6 (0x7545 bytes) 000061 1787603661.148420 read 0x0000ff thru 0x00830c (0x820e bytes) 000062 1787603661.153523 mapwrite 0x00398f thru 0x00511c (0x178e bytes) 000063 1787603661.216718 mapread 0x009b0c thru 0x00f8b6 (0x5dab bytes) 000064 1787603661.224151 MIRROR_RESYNC 2 mirrors 000066 1787603661.744766 trunc from 0x00f8b7 to 0x00b606 (0x42b0 bytes) 000067 1787603661.833991 mapread 0x00552c thru 0x00b606 (0x60db bytes) 000071 1787603661.852076 read 0x004187 thru 0x00aa3a (0x68b4 bytes) 000073 1787603661.854074 read 0x006beb thru 0x007815 (0xc2b bytes) 000074 1787603661.854853 trunc from 0x00b607 to 0x02f976 (0x24370 bytes) 000077 1787603661.877005 mapread 0x016eb3 thru 0x01f61c (0x876a bytes) 000079 1787603661.888636 mapread 0x01608b thru 0x020814 (0xa78a bytes) 000083 1787603661.892686 trunc from 0x02f977 to 0x028e4d (0x6b29 bytes) 000084 1787603661.913253 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x28e4e): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28e4e): Mirror 2: 0x11dc45c (stale) CRC-32 checksum value for chunk [0, 0x28e4e): Mirror 1: 0xc626e00d Mirror 3: 0xc626e00d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28e4e: skipped 000085 1787603663.111237 write 0x029a3f thru 0x031112 (0x76d4 bytes) 000086 1787603663.243525 mapwrite 0x0289b9 thru 0x03521f (0xc867 bytes) 000088 1787603663.381716 mapread 0x006d49 thru 0x00dbc4 (0x6e7c bytes) 000089 1787603663.392155 mapwrite 0x03ef04 thru 0x03ffff (0x10fc bytes) 000090 1787603663.469802 mapwrite 0x030b0d thru 0x03ffff (0xf4f3 bytes) 000091 1787603663.573579 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x14d81656 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x14d81656 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000092 1787603663.902774 read 0x015ffa thru 0x01661e (0x625 bytes) 000093 1787603663.917197 MIRROR_RESYNC 2 mirrors 000094 1787603664.841997 read 0x02817e thru 0x029951 (0x17d4 bytes) 000095 1787603664.851223 MIRROR_EXTEND to 3 mirrors 000096 1787603666.716312 mapread 0x003791 thru 0x00f10f (0xb97f bytes) 000097 1787603666.809592 write 0x023fec thru 0x024307 (0x31c bytes) 000098 1787603666.955582 read 0x010184 thru 0x01ca44 (0xc8c1 bytes) 000099 1787603666.977336 mapwrite 0x00274e thru 0x004137 (0x19ea bytes) 000101 1787603667.120024 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfab2ab79 (stale) Mirror 3: 0xfab2ab79 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd20ada84 Mirror 4: 0xd20ada84 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000103 1787603668.368312 mapwrite 0x024188 thru 0x0284e1 (0x435a bytes) 000105 1787603668.611770 mapwrite 0x01f0f2 thru 0x024a75 (0x5984 bytes) 000107 1787603668.689214 write 0x001a06 thru 0x008b64 (0x715f bytes) 000108 1787603668.700710 read 0x01cc85 thru 0x021e28 (0x51a4 bytes) 000109 1787603668.707971 read 0x01a9e9 thru 0x01f0b6 (0x46ce bytes) 000111 1787603668.728323 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfab2ab79 (stale) Mirror 4: 0xd20ada84 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfab2ab79 (stale) Mirror 4: 0xd20ada84 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000113 1787603669.138676 mapread 0x034601 thru 0x03afc2 (0x69c2 bytes) 000115 1787603669.192953 mapread 0x02e1bf thru 0x03b18e (0xcfd0 bytes) 000116 1787603669.209144 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfab2ab79 (stale) Mirror 4: 0xd20ada84 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5b3d63c3 Mirror 5: 0x5b3d63c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000118 1787603671.143527 mapwrite 0x019db6 thru 0x01f6e3 (0x592e bytes) 000119 1787603671.557617 trunc from 0x040000 to 0x01b6c0 (0x2493f bytes) 000123 1787603671.619667 trunc from 0x01b6c1 to 0x0028e2 (0x18dde bytes) 000125 1787603671.643621 mapwrite 0x013cfe thru 0x0228a1 (0xeba4 bytes) 000127 1787603671.747678 read 0x00d8d0 thru 0x018a9a (0xb1cb bytes) 000128 1787603671.749984 write 0x0161ef thru 0x022744 (0xc556 bytes) 000130 1787603671.758611 trunc from 0x0228a2 to 0x016e57 (0xba4a bytes) 000131 1787603671.822056 read 0x0060aa thru 0x007c77 (0x1bce bytes) 000132 1787603671.839390 read 0x002965 thru 0x0088ae (0x5f4a bytes) 000133 1787603671.840539 mapread 0x00f7e7 thru 0x0138b5 (0x40cf bytes) 000134 1787603671.845652 read 0x002715 thru 0x00ad21 (0x860d bytes) 000136 1787603671.859861 mapread 0x00f7fa thru 0x016e57 (0x765e bytes) 000137 1787603671.867997 trunc from 0x016e58 to 0x00d421 (0x9a36 bytes) 000139 1787603671.960420 mapwrite 0x02d056 thru 0x02e9d4 (0x197f bytes) 000140 1787603672.130489 MIRROR_RESYNC 4 mirrors 000141 1787603673.899424 MIRROR_EXTEND to 5 mirrors 000143 1787603675.075497 mapread 0x001765 thru 0x00fdfb (0xe697 bytes) 000144 1787603675.144297 mapread 0x010ebb thru 0x019513 (0x8659 bytes) 000146 1787603675.161471 mapwrite 0x0230a4 thru 0x02dca3 (0xac00 bytes) 000147 1787603675.713611 trunc from 0x02e9d5 to 0x03079a (0x1dc6 bytes) 000148 1787603675.825682 trunc from 0x03079b to 0x00a4ee (0x262ac bytes) 000149 1787603675.851251 mapwrite 0x0222dc thru 0x0309ee (0xe713 bytes) 000150 1787603676.220575 MIRROR_RESYNC 5 mirrors 000152 1787603678.398203 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) 000153 1787603679.050306 MIRROR_RESYNC 4 mirrors 000154 1787603679.664484 mapread 0x008d0a thru 0x0101fc (0x74f3 bytes) 000155 1787603679.693562 mapwrite 0x02ff68 thru 0x03c16e (0xc207 bytes) 000157 1787603680.024499 mapwrite 0x003120 thru 0x010087 (0xcf68 bytes) 000159 1787603680.103482 mapread 0x00543e thru 0x011504 (0xc0c7 bytes) 000160 1787603680.129634 write 0x00e1ce thru 0x01d029 (0xee5c bytes) 000162 1787603680.140326 write 0x024b96 thru 0x029af3 (0x4f5e bytes) 000163 1787603680.153449 MIRROR_RESYNC 4 mirrors 000167 1787603681.754431 read 0x00a9bc thru 0x00aeb2 (0x4f7 bytes) 000168 1787603681.783041 write 0x01382c thru 0x014fd5 (0x17aa bytes) 000174 1787603681.966572 mapwrite 0x00f7f1 thru 0x01b937 (0xc147 bytes) 000175 1787603682.197949 mapread 0x012683 thru 0x017933 (0x52b1 bytes) 000176 1787603682.205932 MIRROR_RESYNC 4 mirrors 000177 1787603683.679367 MIRROR_RESYNC 4 mirrors 000178 1787603684.232896 write 0x02e5da thru 0x032ef9 (0x4920 bytes) 000179 1787603684.319593 trunc from 0x03c16f to 0x02d579 (0xebf5 bytes) 000180 1787603684.349777 read 0x01269d thru 0x0171e3 (0x4b47 bytes) 000181 1787603684.361632 read 0x027964 thru 0x02977b (0x1e18 bytes) 000183 1787603684.371595 read 0x004cab thru 0x005f63 (0x12b9 bytes) 000184 1787603684.372257 read 0x022ce2 thru 0x028941 (0x5c60 bytes) 000186 1787603684.374075 write 0x0073c2 thru 0x00941d (0x205c bytes) 000187 1787603684.380689 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d57a): Mirror 4: 0xde05fc04 (stale) Mirror 5: 0xde05fc04 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d57a): Mirror 4: 0xde05fc04 (stale) Mirror 5: 0xde05fc04 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d57a: skipped 000189 1787603684.728625 write 0x03ac24 thru 0x03ffff (0x53dc bytes) 000190 1787603684.731495 write 0x0332bc thru 0x035fa0 (0x2ce5 bytes) 000191 1787603684.738912 mapwrite 0x03e0dd thru 0x03ffff (0x1f23 bytes) 000195 1787603684.800575 write 0x039a43 thru 0x03e1cd (0x478b bytes) 000196 1787603684.812427 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xaf8c1fc0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xaf8c1fc0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000197 1787603685.406609 mapwrite 0x0025d0 thru 0x00c544 (0x9f75 bytes) 000199 1787603685.555649 write 0x023f51 thru 0x02d3e8 (0x9498 bytes) 000200 1787603685.582744 read 0x035159 thru 0x0369da (0x1882 bytes) 000202 1787603685.606314 write 0x006481 thru 0x00df77 (0x7af7 bytes) 000204 1787603685.610012 mapwrite 0x02d301 thru 0x037400 (0xa100 bytes) 000205 1787603685.770656 write 0x012a0f thru 0x014c80 (0x2272 bytes) 000207 1787603685.805770 trunc from 0x040000 to 0x02f168 (0x10e97 bytes) 000209 1787603685.838870 write 0x0158fd thru 0x024817 (0xef1b bytes) 000213 1787603685.843565 mapread 0x0012cb thru 0x00c764 (0xb49a bytes) 000214 1787603685.844686 write 0x00839f thru 0x00b8e2 (0x3544 bytes) 000215 1787603685.846409 write 0x0132d2 thru 0x01c049 (0x8d78 bytes) 000216 1787603685.848382 trunc from 0x02f169 to 0x020c23 (0xe545 bytes) 000217 1787603685.870174 write 0x02ea88 thru 0x03bffe (0xd577 bytes) 000218 1787603685.871634 mapread 0x0067c5 thru 0x0111e0 (0xaa1c bytes) 000220 1787603685.879078 write 0x02953b thru 0x0340f9 (0xabbf bytes) 000222 1787603685.890855 MIRROR_RESYNC 2 mirrors 000223 1787603687.025123 write 0x034af7 thru 0x039210 (0x471a bytes) 000227 1787603687.217774 write 0x00cc57 thru 0x00fe65 (0x320f bytes) 000228 1787603687.234630 mapread 0x005248 thru 0x00df5e (0x8d17 bytes) 000229 1787603687.267216 trunc from 0x03bfff to 0x007bc9 (0x34435 bytes) 000230 1787603687.298356 mapread 0x000f0a thru 0x007bc9 (0x6cc0 bytes) 000231 1787603687.318768 trunc from 0x007bca to 0x027baf (0x1ffe6 bytes) 000232 1787603687.363206 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x27bb0): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27bb0): Mirror 4: 0xc661f21 (stale) CRC-32 checksum value for chunk [0, 0x27bb0): Mirror 1: 0xadc7952a Mirror 5: 0xadc7952a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27bb0: skipped 000234 1787603688.789533 mapread 0x022349 thru 0x027baf (0x5867 bytes) 000235 1787603688.844505 mapwrite 0x02fce7 thru 0x03285d (0x2b77 bytes) 000237 1787603689.067549 trunc from 0x03285e to 0x00ae2b (0x27a32 bytes) 000238 1787603689.098109 mapread 0x001442 thru 0x004703 (0x32c2 bytes) 000239 1787603689.109911 read 0x0043c1 thru 0x00ae2b (0x6a6b bytes) 000240 1787603689.115453 MIRROR_RESYNC 3 mirrors 000242 1787603690.001747 mapread 0x009541 thru 0x009f86 (0xa46 bytes) 000243 1787603690.012519 MIRROR_EXTEND to 4 mirrors 000244 1787603690.652161 read 0x00900f thru 0x00ae2b (0x1e1d bytes) 000245 1787603690.657556 write 0x01761e thru 0x02086d (0x9250 bytes) 000247 1787603690.734715 read 0x017337 thru 0x019c6b (0x2935 bytes) 000248 1787603690.737035 write 0x00671a thru 0x006ce8 (0x5cf bytes) 000249 1787603690.751450 MIRROR_RESYNC 4 mirrors 000250 1787603692.147691 mapread 0x01262a thru 0x01bec1 (0x9898 bytes) 000253 1787603692.173214 trunc from 0x02086e to 0x029d20 (0x94b3 bytes) 000255 1787603692.298122 MIRROR_RESYNC 4 mirrors 000258 1787603693.558430 trunc from 0x029d21 to 0x00cc86 (0x1d09a bytes) 000259 1787603693.631534 read 0x002b66 thru 0x00721e (0x46b9 bytes) 000262 1787603693.640194 write 0x01adaf thru 0x0279b0 (0xcc02 bytes) 000263 1787603693.642184 mapwrite 0x024ebe thru 0x02ee45 (0x9f88 bytes) 000264 1787603693.741767 mapread 0x0081c9 thru 0x010d0e (0x8b46 bytes) 000266 1787603693.755263 write 0x03e0e5 thru 0x03ffff (0x1f1b bytes) 000267 1787603693.756716 write 0x00b7d7 thru 0x019f5b (0xe785 bytes) 000268 1787603693.769107 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf4619657 (stale) Mirror 6: 0xf4619657 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf4619657 (stale) Mirror 6: 0xf4619657 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000269 1787603694.201383 trunc from 0x040000 to 0x0011c5 (0x3ee3a bytes) 000272 1787603694.222557 write 0x023392 thru 0x02f532 (0xc1a1 bytes) 000273 1787603694.233563 trunc from 0x02f533 to 0x02954f (0x5fe3 bytes) 000275 1787603694.296288 mapread 0x014a05 thru 0x018798 (0x3d94 bytes) 000276 1787603694.349991 write 0x00ca0c thru 0x01a8ce (0xdec3 bytes) 000277 1787603694.358766 read 0x00d6be thru 0x00edb8 (0x16fb bytes) 000279 1787603694.361132 write 0x025215 thru 0x02600e (0xdfa bytes) 000280 1787603694.370580 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29550): Mirror 6: 0xae78e537 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29550): Mirror 6: 0xae78e537 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29550: skipped 000281 1787603694.721490 mapread 0x008891 thru 0x012863 (0x9fd3 bytes) 000282 1787603694.749964 read 0x02297e thru 0x0288e3 (0x5f66 bytes) 000283 1787603694.756586 write 0x019334 thru 0x01caa3 (0x3770 bytes) 000284 1787603694.766228 mapread 0x0084c1 thru 0x00c7ce (0x430e bytes) 000286 1787603694.767482 read 0x01aafd thru 0x01e0d0 (0x35d4 bytes) 000287 1787603694.778719 mapwrite 0x02ad59 thru 0x036398 (0xb640 bytes) 000288 1787603694.923906 mapwrite 0x0254a2 thru 0x034ff8 (0xfb57 bytes) 000289 1787603695.009470 mapwrite 0x032a74 thru 0x03ffff (0xd58c bytes) 000291 1787603695.130754 read 0x021bdd thru 0x02ef9d (0xd3c1 bytes) 000295 1787603695.137673 mapwrite 0x01069e thru 0x0137f1 (0x3154 bytes) 000298 1787603695.205784 mapwrite 0x034954 thru 0x03ffff (0xb6ac bytes) 000299 1787603695.281299 write 0x019284 thru 0x023101 (0x9e7e bytes) 000300 1787603695.293340 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xf4619657 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8a654df Mirror 7: 0x8a654df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000302 1787603696.386629 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) 000303 1787603696.577220 trunc from 0x040000 to 0x01db41 (0x224be bytes) 000304 1787603696.695124 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1db42): Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1db42): Mirror 7: 0xbd365157 (stale) CRC-32 checksum value for chunk [0, 0x1db42): Mirror 1: 0xbd365157 Mirror 8: 0xbd365157 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1db42: skipped 000306 1787603698.415220 mapwrite 0x02904c thru 0x036390 (0xd345 bytes) 000307 1787603698.696530 write 0x0238cb thru 0x024ecf (0x1605 bytes) 000309 1787603698.709254 trunc from 0x036391 to 0x0126e8 (0x23ca8 bytes) 000310 1787603698.748290 MIRROR_RESYNC 3 mirrors 000311 1787603700.183700 MIRROR_RESYNC 3 mirrors 000314 1787603700.531734 mapwrite 0x02b32d thru 0x02e3ae (0x3082 bytes) 000316 1787603700.821033 mapread 0x0287ea thru 0x02e3ae (0x5bc5 bytes) 000317 1787603700.834225 MIRROR_RESYNC 3 mirrors 000318 1787603702.057437 read 0x0024f2 thru 0x00ed98 (0xc8a7 bytes) 000319 1787603702.070739 write 0x01ea33 thru 0x028bfe (0xa1cc bytes) 000320 1787603702.190476 trunc from 0x02e3af to 0x035731 (0x7383 bytes) 000321 1787603702.228114 trunc from 0x035732 to 0x029860 (0xbed1 bytes) 000323 1787603702.268409 trunc from 0x029861 to 0x03231b (0x8abb bytes) 000324 1787603702.293501 write 0x01e714 thru 0x0295de (0xaecb bytes) 000325 1787603702.307414 write 0x00de1c thru 0x016ebb (0x90a0 bytes) 000326 1787603702.329322 write 0x03d3c4 thru 0x03ffff (0x2c3c bytes) 000328 1787603702.331020 trunc from 0x040000 to 0x00581e (0x3a7e1 bytes) 000329 1787603702.406114 read 0x0031cf thru 0x00581e (0x2650 bytes) 000332 1787603702.422453 write 0x023e74 thru 0x02bb03 (0x7c90 bytes) 000334 1787603702.431920 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bb04): Mirror 8: 0xbbf44fa0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bb04): Mirror 8: 0xbbf44fa0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bb04: skipped 000335 1787603703.023008 mapwrite 0x02b64e thru 0x036b85 (0xb538 bytes) 000336 1787603703.171993 mapwrite 0x03bca5 thru 0x03ffff (0x435b bytes) 000337 1787603703.261490 mapread 0x002aef thru 0x00fcf4 (0xd206 bytes) 000338 1787603703.278260 mapread 0x01ceb7 thru 0x0252e7 (0x8431 bytes) 000339 1787603703.301353 read 0x003ef8 thru 0x005397 (0x14a0 bytes) 000340 1787603703.303845 mapwrite 0x030b0e thru 0x03d473 (0xc966 bytes) 000344 1787603703.403276 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x36ee4d2f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd7d9d23d Mirror 9: 0xd7d9d23d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000345 1787603704.836969 write 0x02badd thru 0x03b043 (0xf567 bytes) 000348 1787603705.078530 trunc from 0x040000 to 0x03342a (0xcbd5 bytes) 000349 1787603705.114544 trunc from 0x03342b to 0x01de42 (0x155e8 bytes) 000350 1787603705.148099 mapwrite 0x029237 thru 0x02ba7d (0x2847 bytes) truncating to largest ever: 0x39d6b 000352 1787603705.320247 trunc from 0x02ba7e to 0x039d6a (0xe2ed bytes) 000353 1787603705.343473 read 0x00d01b thru 0x019805 (0xc7eb bytes) 000354 1787603705.357048 read 0x00c4c5 thru 0x011234 (0x4d70 bytes) 000355 1787603705.367219 write 0x027b59 thru 0x02d47e (0x5926 bytes) 000356 1787603705.368394 mapread 0x01d330 thru 0x023fc8 (0x6c99 bytes) 000357 1787603705.370414 trunc from 0x039d6b to 0x017e23 (0x21f47 bytes) 000358 1787603705.393073 write 0x017559 thru 0x01eea0 (0x7948 bytes) 000361 1787603705.400478 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1eea1): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1eea1): Mirror 8: 0xdeaf2689 (stale) Mirror 9: 0x9270f574 (stale) CRC-32 checksum value for chunk [0, 0x1eea1): Mirror 1: 0x66c95eb7 Mirror 10: 0x66c95eb7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1eea1: skipped 000362 1787603705.990202 mapwrite 0x022365 thru 0x031709 (0xf3a5 bytes) 000364 1787603706.137275 mapwrite 0x02faa5 thru 0x034a89 (0x4fe5 bytes) 000367 1787603706.205975 MIRROR_RESYNC 4 mirrors 000369 1787603707.202099 mapread 0x022292 thru 0x02dc87 (0xb9f6 bytes) 000371 1787603707.346439 trunc from 0x034a8a to 0x02095b (0x1412e bytes) 000374 1787603707.529189 trunc from 0x02095c to 0x026fbe (0x6663 bytes) 000376 1787603707.558532 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26fbf): Mirror 8: 0xbb85e96c (stale) Mirror 10: 0xbb85e96c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26fbf): Mirror 8: 0xbb85e96c (stale) Mirror 10: 0xbb85e96c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26fbf: skipped 000378 1787603707.798248 mapwrite 0x03357b thru 0x03d220 (0x9ca6 bytes) 000380 1787603707.886427 mapwrite 0x01cf68 thru 0x0289cd (0xba66 bytes) 000381 1787603707.942205 mapwrite 0x028f6a thru 0x02d67d (0x4714 bytes) 000382 1787603707.994464 mapwrite 0x00dcf0 thru 0x01b505 (0xd816 bytes) 000383 1787603708.041981 trunc from 0x03d221 to 0x02a7ea (0x12a36 bytes) 000385 1787603708.060981 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2a7eb): Mirror 8: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a7eb): Mirror 8: 0x85c3220f (stale) Mirror 10: 0x85c3220f (stale) CRC-32 checksum value for chunk [0, 0x2a7eb): Mirror 1: 0x387519d1 Mirror 11: 0x387519d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a7eb: skipped 000386 1787603709.261936 mapread 0x000976 thru 0x00a8c2 (0x9f4d bytes) 000387 1787603709.370532 write 0x018591 thru 0x01be50 (0x38c0 bytes) truncating to largest ever: 0x3d551 000391 1787603709.503215 trunc from 0x02a7eb to 0x03d550 (0x12d66 bytes) 000396 1787603709.541456 mapwrite 0x03c234 thru 0x03ffff (0x3dcc bytes) 000397 1787603709.629398 mapread 0x0376c4 thru 0x03ffff (0x893c bytes) 000398 1787603709.630213 mapread 0x030688 thru 0x03ac12 (0xa58b bytes) 000400 1787603709.643780 mapread 0x0077c2 thru 0x0097d4 (0x2013 bytes) 000404 1787603709.660088 mapread 0x001690 thru 0x00cc6a (0xb5db bytes) 000405 1787603709.664750 mapwrite 0x01650c thru 0x022b39 (0xc62e bytes) 000406 1787603709.820949 trunc from 0x040000 to 0x0245c7 (0x1ba38 bytes) 000407 1787603709.844525 mapwrite 0x00cc92 thru 0x01b093 (0xe402 bytes) 000410 1787603709.977212 write 0x01a113 thru 0x01d98e (0x387c bytes) 000412 1787603709.978628 trunc from 0x0245c8 to 0x02ae66 (0x689f bytes) 000414 1787603710.019734 mapread 0x02175b thru 0x02ae66 (0x970c bytes) 000416 1787603710.040283 trunc from 0x02ae67 to 0x01fa53 (0xb413 bytes) 000417 1787603710.064076 read 0x014826 thru 0x015118 (0x8f3 bytes) 000418 1787603710.064627 read 0x009792 thru 0x0131e1 (0x9a50 bytes) 000420 1787603710.065577 read 0x0196dc thru 0x01fa53 (0x6378 bytes) 000422 1787603710.066564 mapread 0x00b4b6 thru 0x00eb78 (0x36c3 bytes) 000423 1787603710.073419 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1fa54): Mirror 8: 0x4d262d9d (stale) Mirror 11: 0xe00f4a10 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fa54): Mirror 8: 0x4d262d9d (stale) Mirror 11: 0xe00f4a10 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fa54: skipped 000425 1787603710.515181 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1fa54): Mirror 11: 0xe00f4a10 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fa54): Mirror 11: 0xe00f4a10 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fa54: skipped 000426 1787603710.790323 mapread 0x012abe thru 0x01d919 (0xae5c bytes) 000429 1787603710.820113 write 0x000dd5 thru 0x0014dd (0x709 bytes) 000431 1787603710.831861 read 0x01d836 thru 0x01fa53 (0x221e bytes) 000432 1787603710.832431 read 0x00a15c thru 0x00f1e5 (0x508a bytes) 000433 1787603710.836144 write 0x00d3d7 thru 0x01ac26 (0xd850 bytes) 000435 1787603710.839514 mapread 0x01791a thru 0x018592 (0xc79 bytes) 000436 1787603710.841565 write 0x0083b9 thru 0x01745a (0xf0a2 bytes) 000438 1787603710.843899 mapread 0x00d15d thru 0x018fbd (0xbe61 bytes) 000439 1787603710.849286 mapwrite 0x01cb7e thru 0x027e5b (0xb2de bytes) 000440 1787603710.936717 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x27e5c): Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27e5c): Mirror 11: 0x8cf0a38a (stale) CRC-32 checksum value for chunk [0, 0x27e5c): Mirror 1: 0xe6f2a177 Mirror 12: 0xe6f2a177 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27e5c: skipped 000441 1787603712.072157 mapwrite 0x00d715 thru 0x014f58 (0x7844 bytes) 000443 1787603712.256231 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27e5c): Mirror 12: 0xe6f2a177 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27e5c): Mirror 12: 0xe6f2a177 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27e5c: skipped 000446 1787603712.734995 read 0x0134c0 thru 0x01c59a (0x90db bytes) 000447 1787603712.751604 write 0x022a07 thru 0x023b09 (0x1103 bytes) 000449 1787603712.767649 MIRROR_RESYNC 2 mirrors 000451 1787603714.318887 mapread 0x00d08c thru 0x01c237 (0xf1ac bytes) 000452 1787603714.372046 MIRROR_RESYNC 2 mirrors 000453 1787603714.801434 write 0x00be97 thru 0x00bf85 (0xef bytes) 000455 1787603714.971187 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) 000456 1787603715.224594 mapwrite 0x029ad5 thru 0x02cc21 (0x314d bytes) 000457 1787603715.391404 trunc from 0x02cc22 to 0x01df36 (0xeceb bytes) 000458 1787603715.424540 read 0x00f7d3 thru 0x01ae62 (0xb690 bytes) 000461 1787603715.443298 trunc from 0x01df37 to 0x02e6b0 (0x1077a bytes) 000462 1787603715.483194 MIRROR_EXTEND to 2 mirrors 000465 1787603716.813786 mapread 0x014f30 thru 0x01fb67 (0xac38 bytes) 000466 1787603716.858706 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) 000468 1787603717.118572 read 0x008cdc thru 0x009ed5 (0x11fa bytes) 000472 1787603717.149510 write 0x017996 thru 0x020837 (0x8ea2 bytes) 000474 1787603717.183721 mapread 0x009f8f thru 0x00ce4a (0x2ebc bytes) 000475 1787603717.228507 mapwrite 0x00996f thru 0x015e0d (0xc49f bytes) 000476 1787603717.392514 mapwrite 0x032be0 thru 0x038d20 (0x6141 bytes) 000477 1787603717.561285 write 0x00cea8 thru 0x00fe7f (0x2fd8 bytes) 000479 1787603717.563444 write 0x02e803 thru 0x033c7e (0x547c bytes) 000483 1787603717.568844 mapread 0x0385af thru 0x038d20 (0x772 bytes) 000488 1787603717.579126 read 0x02e780 thru 0x034df4 (0x6675 bytes) 000489 1787603717.581262 mapread 0x01c1a0 thru 0x01f13b (0x2f9c bytes) 000490 1787603717.586362 mapread 0x03629f thru 0x038d20 (0x2a82 bytes) 000493 1787603717.589240 mapread 0x019d9f thru 0x01bc27 (0x1e89 bytes) 000495 1787603717.601571 mapread 0x0109be thru 0x01bc38 (0xb27b bytes) 000496 1787603717.606163 mapread 0x035561 thru 0x038d20 (0x37c0 bytes) 000497 1787603717.609002 trunc from 0x038d21 to 0x02ab48 (0xe1d8 bytes) 000499 1787603717.629320 trunc from 0x02ab49 to 0x005d01 (0x24e47 bytes) 000501 1787603717.653338 read 0x00392f thru 0x005d01 (0x23d3 bytes) 000503 1787603717.670170 read 0x0058c2 thru 0x005d01 (0x440 bytes) 000504 1787603717.671332 write 0x02e0b4 thru 0x031ba2 (0x3aef bytes) 000505 1787603717.681285 MIRROR_EXTEND to 2 mirrors 000506 1787603719.069561 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) 000508 1787603719.232306 mapwrite 0x018f5d thru 0x0204ac (0x7550 bytes) 000509 1787603719.358150 mapwrite 0x01374b thru 0x014256 (0xb0c bytes) 000510 1787603719.434928 read 0x018025 thru 0x025e79 (0xde55 bytes) 000513 1787603719.453112 read 0x02ac8c thru 0x02c959 (0x1cce bytes) 000517 1787603719.488588 write 0x036c46 thru 0x03ffff (0x93ba bytes) 000519 1787603719.491649 mapread 0x022532 thru 0x0243eb (0x1eba bytes) 000521 1787603719.495167 mapread 0x0346d5 thru 0x03b502 (0x6e2e bytes) 000522 1787603719.513036 read 0x0250e9 thru 0x03020c (0xb124 bytes) 000524 1787603719.516562 read 0x032e14 thru 0x0360df (0x32cc bytes) 000526 1787603719.521253 mapread 0x03c743 thru 0x03ffff (0x38bd bytes) 000529 1787603719.531860 mapwrite 0x02d38f thru 0x033e46 (0x6ab8 bytes) 000530 1787603719.655108 mapwrite 0x030f84 thru 0x0322bf (0x133c bytes) 000531 1787603719.730940 trunc from 0x040000 to 0x02f5b4 (0x10a4b bytes) 000532 1787603719.748724 write 0x02c71b thru 0x035fe4 (0x98ca bytes) 000533 1787603719.750402 mapwrite 0x0145a1 thru 0x020c01 (0xc661 bytes) 000535 1787603719.849245 trunc from 0x035fe5 to 0x00010c (0x35ed8 bytes) 000536 1787603719.885697 MIRROR_EXTEND to 2 mirrors 000537 1787603720.775064 read 0x0000a3 thru 0x00010c (0x6a bytes) 000538 1787603720.784136 MIRROR_RESYNC 2 mirrors 000539 1787603721.079070 trunc from 0x00010d to 0x0115a3 (0x11497 bytes) 000540 1787603721.232427 mapread 0x007fff thru 0x00aa5b (0x2a5d bytes) 000541 1787603721.284769 read 0x008acd thru 0x00f7d8 (0x6d0c bytes) 000542 1787603721.286388 mapread 0x0009e1 thru 0x001542 (0xb62 bytes) 000544 1787603721.302570 trunc from 0x0115a4 to 0x0389fc (0x27459 bytes) 000545 1787603721.360709 mapread 0x005cee thru 0x012bda (0xceed bytes) 000546 1787603721.387761 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) 000547 1787603721.701995 write 0x009a7e thru 0x00a677 (0xbfa bytes) 000548 1787603721.718463 write 0x023458 thru 0x030a8f (0xd638 bytes) 000549 1787603721.728381 read 0x012cbc thru 0x0176c6 (0x4a0b bytes) 000550 1787603721.737538 mapread 0x00298a thru 0x0123a8 (0xfa1f bytes) 000552 1787603721.774542 mapwrite 0x00107a thru 0x00cc6e (0xbbf5 bytes) 000553 1787603721.890971 write 0x01a636 thru 0x029e96 (0xf861 bytes) 000556 1787603721.900365 write 0x02e454 thru 0x0307d6 (0x2383 bytes) 000557 1787603721.903121 trunc from 0x0389fd to 0x019cf0 (0x1ed0c bytes) 000558 1787603721.922459 write 0x023faa thru 0x033b2a (0xfb81 bytes) 000560 1787603721.925786 write 0x006f45 thru 0x0159ce (0xea8a bytes) 000561 1787603721.927413 write 0x038593 thru 0x03a622 (0x2090 bytes) 000563 1787603721.928991 write 0x0198da thru 0x01dcbe (0x43e5 bytes) 000565 1787603721.933115 write 0x0277d7 thru 0x0342c3 (0xcaed bytes) 000566 1787603721.937536 mapread 0x00509b thru 0x0147cf (0xf735 bytes) 000568 1787603721.938511 mapread 0x02a0da thru 0x038dbe (0xece5 bytes) 000569 1787603721.942003 read 0x00b855 thru 0x01034b (0x4af7 bytes) 000571 1787603721.942989 mapread 0x00c767 thru 0x01266c (0x5f06 bytes) 000573 1787603721.943984 mapread 0x0034f1 thru 0x00c18c (0x8c9c bytes) 000578 1787603721.946048 read 0x0239da thru 0x027e7b (0x44a2 bytes) 000579 1787603721.946591 mapread 0x02985b thru 0x02cf33 (0x36d9 bytes) 000580 1787603721.947604 mapread 0x01e165 thru 0x02460a (0x64a6 bytes) 000583 1787603721.952811 trunc from 0x03a623 to 0x03be38 (0x1816 bytes) 000584 1787603721.962261 mapread 0x033630 thru 0x03be38 (0x8809 bytes) 000586 1787603721.966471 read 0x02ae65 thru 0x02c11d (0x12b9 bytes) 000588 1787603721.967447 write 0x0039d7 thru 0x00ef37 (0xb561 bytes) 000589 1787603721.968362 mapread 0x02a370 thru 0x039cf9 (0xf98a bytes) 000591 1787603721.969734 trunc from 0x03be39 to 0x00cce0 (0x2f158 bytes) 000595 1787603721.980797 mapwrite 0x03047e thru 0x035afc (0x567f bytes) 000596 1787603722.028115 write 0x03b400 thru 0x03ee47 (0x3a48 bytes) 000601 1787603722.030423 mapwrite 0x006fcb thru 0x00727c (0x2b2 bytes) 000602 1787603722.057511 trunc from 0x03ee48 to 0x01bad5 (0x23372 bytes) 000604 1787603722.067443 mapwrite 0x01330e thru 0x01c748 (0x943b bytes) 000606 1787603722.162148 mapread 0x00628f thru 0x008b6a (0x28dc bytes) 000608 1787603722.166217 write 0x0375fb thru 0x03ffff (0x8a05 bytes) 000609 1787603722.169265 read 0x01ad42 thru 0x01b9ec (0xcab bytes) 000610 1787603722.171535 read 0x034d90 thru 0x03a23a (0x54ab bytes) 000612 1787603722.183115 trunc from 0x040000 to 0x026cad (0x19352 bytes) 000614 1787603722.216961 mapwrite 0x00c1d1 thru 0x00e506 (0x2336 bytes) 000618 1787603722.279082 mapwrite 0x01f5bb thru 0x0276b3 (0x80f9 bytes) 000619 1787603722.354493 read 0x014f78 thru 0x01e745 (0x97ce bytes) 000620 1787603722.356210 write 0x03df75 thru 0x03ffff (0x208b bytes) 000622 1787603722.365259 mapread 0x008212 thru 0x0125db (0xa3ca bytes) 000625 1787603722.369761 trunc from 0x040000 to 0x02c444 (0x13bbb bytes) 000626 1787603722.393409 mapwrite 0x029768 thru 0x02aeb2 (0x174b bytes) 000632 1787603722.458756 trunc from 0x02c445 to 0x015dbb (0x16689 bytes) 000633 1787603722.474506 write 0x015317 thru 0x0181b4 (0x2e9e bytes) 000634 1787603722.476148 mapwrite 0x00ef1f thru 0x018145 (0x9227 bytes) 000635 1787603722.551078 write 0x030f95 thru 0x03a83a (0x98a6 bytes) 000637 1787603722.553315 mapwrite 0x00f594 thru 0x011a9e (0x250b bytes) 000638 1787603722.606453 read 0x0006d1 thru 0x001c2a (0x155a bytes) 000639 1787603722.608256 read 0x030df9 thru 0x03a83a (0x9a42 bytes) 000645 1787603722.614287 trunc from 0x03a83b to 0x03affa (0x7c0 bytes) 000648 1787603722.638415 read 0x000c68 thru 0x008c58 (0x7ff1 bytes) 000650 1787603722.645090 trunc from 0x03affb to 0x01d9d7 (0x1d623 bytes) 000651 1787603722.662520 mapwrite 0x0345d4 thru 0x03e8d7 (0xa304 bytes) 000652 1787603722.778382 mapwrite 0x0214c4 thru 0x0267f3 (0x5330 bytes) 000653 1787603722.830521 trunc from 0x03e8d8 to 0x0287da (0x160fd bytes) 000655 1787603722.849416 mapwrite 0x000f79 thru 0x008b78 (0x7c00 bytes) 000656 1787603722.894393 trunc from 0x0287db to 0x01cafd (0xbcdd bytes) 000658 1787603722.905389 read 0x01b142 thru 0x01cafd (0x19bc bytes) 000659 1787603722.906075 trunc from 0x01cafe to 0x024f01 (0x8404 bytes) 000660 1787603722.915484 trunc from 0x024f02 to 0x000472 (0x24a8f bytes) 000664 1787603722.927414 mapwrite 0x03be74 thru 0x03ffff (0x418c bytes) 000666 1787603722.991944 read 0x03251f thru 0x039e4e (0x7930 bytes) 000667 1787603722.999073 MIRROR_EXTEND to 2 mirrors 000668 1787603723.740419 trunc from 0x040000 to 0x00cc40 (0x333bf bytes) 000669 1787603723.821367 write 0x029114 thru 0x036f0b (0xddf8 bytes) 000670 1787603723.826509 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x36f0c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36f0c): Mirror 2: 0x3121b228 (stale) CRC-32 checksum value for chunk [0, 0x36f0c): Mirror 1: 0xbccc972c Mirror 3: 0xbccc972c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36f0c: skipped 000672 1787603724.856281 write 0x02712a thru 0x02f2ab (0x8182 bytes) 000673 1787603724.969462 mapwrite 0x02d6f5 thru 0x035e27 (0x8733 bytes) 000677 1787603725.092064 mapread 0x01e23a thru 0x02903a (0xae01 bytes) 000679 1787603725.102846 read 0x023c3b thru 0x02844b (0x4811 bytes) 000681 1787603725.103961 read 0x02884f thru 0x036f0b (0xe6bd bytes) 000682 1787603725.104527 write 0x005b7c thru 0x014991 (0xee16 bytes) 000683 1787603725.119047 mapwrite 0x037ec1 thru 0x03ffff (0x813f bytes) 000684 1787603725.223728 write 0x01bf6c thru 0x024d10 (0x8da5 bytes) 000685 1787603725.226922 write 0x0234d1 thru 0x032905 (0xf435 bytes) 000686 1787603725.230149 write 0x03a76a thru 0x03c19b (0x1a32 bytes) 000687 1787603725.237407 write 0x0017cd thru 0x009641 (0x7e75 bytes) 000689 1787603725.241079 trunc from 0x040000 to 0x0385aa (0x7a55 bytes) 000690 1787603725.281445 mapread 0x02ed0f thru 0x0329c4 (0x3cb6 bytes) 000693 1787603725.292882 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x385ab): Mirror 2: 0xc4eb6009 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x385ab): Mirror 2: 0xc4eb6009 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x385ab: skipped 000697 1787603725.649984 mapread 0x01a09e thru 0x01f24d (0x51b0 bytes) 000698 1787603725.681886 mapread 0x00155d thru 0x00bc95 (0xa739 bytes) 000701 1787603725.693027 read 0x02b6da thru 0x037389 (0xbcb0 bytes) 000702 1787603725.705957 mapwrite 0x037a87 thru 0x03d87c (0x5df6 bytes) 000703 1787603725.786717 mapread 0x01b3a7 thru 0x02719a (0xbdf4 bytes) 000705 1787603725.797077 write 0x01fb7e thru 0x02062a (0xaad bytes) 000706 1787603725.799500 mapwrite 0x038a5e thru 0x03ffff (0x75a2 bytes) 000707 1787603725.881225 mapread 0x011331 thru 0x015dcd (0x4a9d bytes) 000708 1787603725.889924 read 0x0118eb thru 0x01e6e5 (0xcdfb bytes) 000710 1787603725.891010 read 0x0337ad thru 0x03a5b0 (0x6e04 bytes) 000711 1787603725.896709 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5d669be9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1dff4f37 Mirror 3: 0x1dff4f37 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000713 1787603726.966984 write 0x0123f3 thru 0x0223ab (0xffb9 bytes) 000714 1787603727.146157 mapread 0x035fd5 thru 0x03a703 (0x472f bytes) 000716 1787603727.193900 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5d669be9 (stale) Mirror 3: 0x1dff4f37 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf57aa1d4 Mirror 4: 0xf57aa1d4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000718 1787603728.352723 trunc from 0x040000 to 0x00c03b (0x33fc4 bytes) 000721 1787603728.538977 mapwrite 0x015290 thru 0x0187d2 (0x3543 bytes) 000722 1787603728.771994 trunc from 0x0187d3 to 0x01c746 (0x3f74 bytes) 000723 1787603728.797909 mapwrite 0x018a26 thru 0x01c567 (0x3b42 bytes) 000724 1787603728.896687 trunc from 0x01c747 to 0x01235f (0xa3e7 bytes) 000734 1787603728.936881 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x12360): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12360): Mirror 2: 0xf78fa0a4 (stale) Mirror 3: 0xeabc08fa (stale) Mirror 4: 0xeabc08fa (stale) CRC-32 checksum value for chunk [0, 0x12360): Mirror 1: 0x9779fed5 Mirror 5: 0x9779fed5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12360: skipped 000735 1787603729.844921 write 0x00faee thru 0x014968 (0x4e7b bytes) 000737 1787603729.924582 mapwrite 0x00299e thru 0x008abc (0x611f bytes) 000738 1787603729.984890 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14969): Mirror 2: 0x6220ef3c (stale) Mirror 3: 0x3b840897 (stale) Mirror 4: 0x10f66a86 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14969): Mirror 2: 0x6220ef3c (stale) Mirror 3: 0x3b840897 (stale) Mirror 4: 0x10f66a86 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14969: skipped 000741 1787603730.267763 mapread 0x011955 thru 0x014968 (0x3014 bytes) 000742 1787603730.290601 trunc from 0x014969 to 0x01b958 (0x6ff0 bytes) 000744 1787603730.310098 read 0x005461 thru 0x01314c (0xdcec bytes) 000745 1787603730.322927 trunc from 0x01b959 to 0x008377 (0x135e1 bytes) 000748 1787603730.341692 mapread 0x00274d thru 0x004d04 (0x25b8 bytes) 000749 1787603730.351190 trunc from 0x008378 to 0x01cd82 (0x14a0b bytes) 000751 1787603730.373242 read 0x006270 thru 0x006e66 (0xbf7 bytes) 000753 1787603730.375208 read 0x01a7dc thru 0x01cd82 (0x25a7 bytes) 000754 1787603730.383508 trunc from 0x01cd83 to 0x026006 (0x9284 bytes) 000756 1787603730.434031 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x26007): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26007): Mirror 2: 0x2fc17ca6 (stale) Mirror 3: 0xade6bd1a (stale) Mirror 4: 0x37d770b5 (stale) CRC-32 checksum value for chunk [0, 0x26007): Mirror 1: 0x31158204 Mirror 5: 0x31158204 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26007: skipped 000757 1787603731.781014 MIRROR_RESYNC 5 mirrors 000758 1787603732.723109 read 0x0145a6 thru 0x01e8a5 (0xa300 bytes) 000760 1787603732.732155 trunc from 0x026007 to 0x002e45 (0x231c1 bytes) 000761 1787603732.836160 write 0x01dd34 thru 0x026e85 (0x9152 bytes) 000762 1787603732.839289 mapread 0x0264eb thru 0x026e85 (0x99b bytes) 000763 1787603732.840803 mapwrite 0x01cc7d thru 0x02ad24 (0xe0a8 bytes) 000764 1787603732.917000 read 0x023d18 thru 0x02ad24 (0x700d bytes) 000766 1787603732.919344 write 0x029ae8 thru 0x02a8e5 (0xdfe bytes) 000768 1787603732.921978 mapwrite 0x012933 thru 0x021586 (0xec54 bytes) 000769 1787603733.052949 mapread 0x022d01 thru 0x02ad24 (0x8024 bytes) 000771 1787603733.062762 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2ad25): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ad25): Mirror 2: 0x8744734f (stale) Mirror 3: 0x8744734f (stale) Mirror 4: 0x8744734f (stale) Mirror 5: 0x8744734f (stale) CRC-32 checksum value for chunk [0, 0x2ad25): Mirror 1: 0x9bedc819 Mirror 6: 0x9bedc819 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ad25: skipped 000773 1787603734.527206 read 0x01a5bc thru 0x01b448 (0xe8d bytes) 000774 1787603734.545014 read 0x018c82 thru 0x019480 (0x7ff bytes) 000775 1787603734.599161 write 0x03168d thru 0x038907 (0x727b bytes) 000776 1787603734.754222 trunc from 0x038908 to 0x005205 (0x33702 bytes) 000777 1787603734.816536 mapwrite 0x008a3a thru 0x009fb0 (0x1577 bytes) 000779 1787603734.965287 read 0x0059f7 thru 0x009fb0 (0x45ba bytes) 000780 1787603734.982179 MIRROR_RESYNC 6 mirrors 000782 1787603736.917929 mapread 0x00264c thru 0x009fb0 (0x7965 bytes) 000783 1787603736.942473 mapwrite 0x01e5d1 thru 0x02a057 (0xba87 bytes) 000784 1787603737.145108 MIRROR_RESYNC 6 mirrors 000785 1787603739.222216 write 0x024b1c thru 0x02736d (0x2852 bytes) 000789 1787603739.308148 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2a058): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a058): Mirror 2: 0x6d3bb38 (stale) Mirror 3: 0x6d3bb38 (stale) Mirror 4: 0x6d3bb38 (stale) Mirror 5: 0x6d3bb38 (stale) Mirror 6: 0x6d3bb38 (stale) CRC-32 checksum value for chunk [0, 0x2a058): Mirror 1: 0xc5866c69 Mirror 7: 0xc5866c69 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a058: skipped 000790 1787603740.261597 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a058): Mirror 2: 0x6d3bb38 (stale) Mirror 3: 0x6d3bb38 (stale) Mirror 4: 0x6d3bb38 (stale) Mirror 5: 0x6d3bb38 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a058): Mirror 2: 0x6d3bb38 (stale) Mirror 3: 0x6d3bb38 (stale) Mirror 4: 0x6d3bb38 (stale) Mirror 5: 0x6d3bb38 (stale) CRC-32 checksum value for chunk [0, 0x2a058): Mirror 1: 0xc5866c69 Mirror 7: 0xc5866c69 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a058: skipped 000791 1787603740.906655 trunc from 0x02a058 to 0x03cf88 (0x12f31 bytes) 000792 1787603741.015228 mapread 0x0309d9 thru 0x0364b6 (0x5ade bytes) 000794 1787603741.030938 mapread 0x03b593 thru 0x03cf88 (0x19f6 bytes) 000796 1787603741.042393 MIRROR_RESYNC 6 mirrors 000797 1787603743.090736 MIRROR_EXTEND to 7 mirrors 000798 1787603744.024237 mapread 0x0303e1 thru 0x03cf88 (0xcba8 bytes) 000799 1787603744.050127 trunc from 0x03cf89 to 0x029f4c (0x1303c bytes) 000800 1787603744.150761 write 0x00c2f4 thru 0x011453 (0x5160 bytes) 000803 1787603744.162530 mapread 0x001136 thru 0x001812 (0x6dd bytes) 000804 1787603744.171109 read 0x0143eb thru 0x019dca (0x59e0 bytes) 000805 1787603744.182791 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x29f4d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29f4d): Mirror 2: 0xb17beb8c (stale) Mirror 3: 0xb17beb8c (stale) Mirror 4: 0xb17beb8c (stale) Mirror 5: 0xb17beb8c (stale) Mirror 7: 0xb17beb8c (stale) Mirror 8: 0xb17beb8c (stale) CRC-32 checksum value for chunk [0, 0x29f4d): Mirror 1: 0xa58c236 Mirror 9: 0xa58c236 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29f4d: skipped 000807 1787603745.910014 mapwrite 0x004412 thru 0x0060fe (0x1ced bytes) 000808 1787603746.095044 read 0x00da85 thru 0x00ed81 (0x12fd bytes) 000809 1787603746.097223 mapread 0x010872 thru 0x02035e (0xfaed bytes) 000810 1787603746.119212 mapread 0x001f61 thru 0x00a9bd (0x8a5d bytes) 000812 1787603746.120996 write 0x00ce88 thru 0x013cba (0x6e33 bytes) 000813 1787603746.122195 read 0x02379b thru 0x029f4c (0x67b2 bytes) 000814 1787603746.130089 mapwrite 0x03aaf0 thru 0x03ffff (0x5510 bytes) 000815 1787603746.235232 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x6253b16 (stale) Mirror 3: 0x6253b16 (stale) Mirror 4: 0x6253b16 (stale) Mirror 5: 0x6253b16 (stale) Mirror 7: 0x6253b16 (stale) Mirror 8: 0x6253b16 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x6253b16 (stale) Mirror 3: 0x6253b16 (stale) Mirror 4: 0x6253b16 (stale) Mirror 5: 0x6253b16 (stale) Mirror 7: 0x6253b16 (stale) Mirror 8: 0x6253b16 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000816 1787603746.772034 mapread 0x009e1a thru 0x0185e0 (0xe7c7 bytes) 000821 1787603746.815661 write 0x004eb1 thru 0x01015b (0xb2ab bytes) 000822 1787603746.817978 read 0x0304f3 thru 0x03cc31 (0xc73f bytes) 000823 1787603746.827591 trunc from 0x040000 to 0x023fac (0x1c053 bytes) 000824 1787603746.861513 mapread 0x004661 thru 0x013a0f (0xf3af bytes) 000825 1787603746.862297 mapread 0x01e001 thru 0x023fac (0x5fac bytes) 000826 1787603746.869941 trunc from 0x023fad to 0x020b75 (0x3437 bytes) 000828 1787603746.889777 trunc from 0x020b76 to 0x030779 (0xfc04 bytes) 000829 1787603746.916015 read 0x01007a thru 0x01ea27 (0xe9ae bytes) truncating to largest ever: 0x3f344 000830 1787603746.916990 trunc from 0x03077a to 0x03f343 (0xebca bytes) 000833 1787603746.945761 read 0x03982f thru 0x03f343 (0x5b15 bytes) 000834 1787603746.961327 read 0x006d00 thru 0x00ed31 (0x8032 bytes) 000835 1787603746.961904 write 0x00cbb0 thru 0x013655 (0x6aa6 bytes) 000836 1787603746.962962 trunc from 0x03f344 to 0x007ef2 (0x37451 bytes) 000837 1787603746.986305 write 0x01e3fe thru 0x023355 (0x4f58 bytes) 000838 1787603746.992451 read 0x01bead thru 0x023355 (0x74a9 bytes) 000839 1787603747.004786 mapwrite 0x01bbba thru 0x01d15d (0x15a4 bytes) 000842 1787603747.056479 read 0x0163d3 thru 0x01b75c (0x538a bytes) 000844 1787603747.058974 mapread 0x0031f7 thru 0x009fb6 (0x6dc0 bytes) 000847 1787603747.061916 mapwrite 0x007d9d thru 0x00d6f2 (0x5956 bytes) 000849 1787603747.128744 mapread 0x00e99e thru 0x01c75d (0xddc0 bytes) 000850 1787603747.129993 mapread 0x0066b2 thru 0x00ffa6 (0x98f5 bytes) 000852 1787603747.137374 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23356): Mirror 2: 0x9f026291 (stale) Mirror 3: 0x9f026291 (stale) Mirror 4: 0x9f026291 (stale) Mirror 5: 0x9f026291 (stale) Mirror 7: 0x9f026291 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23356): Mirror 2: 0x9f026291 (stale) Mirror 3: 0x9f026291 (stale) Mirror 4: 0x9f026291 (stale) Mirror 5: 0x9f026291 (stale) Mirror 7: 0x9f026291 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23356: skipped 000853 1787603747.595420 mapwrite 0x02505c thru 0x034f72 (0xff17 bytes) 000855 1787603747.754024 mapwrite 0x0141b3 thru 0x02291f (0xe76d bytes) 000856 1787603747.885911 trunc from 0x034f73 to 0x009ff0 (0x2af82 bytes) 000857 1787603747.909367 trunc from 0x009ff1 to 0x00484e (0x57a2 bytes) 000858 1787603747.942676 read 0x001d10 thru 0x00484e (0x2b3f bytes) 000861 1787603747.959716 MIRROR_RESYNC 6 mirrors 000862 1787603748.909014 read 0x002db9 thru 0x003b9b (0xde3 bytes) 000863 1787603748.923877 MIRROR_RESYNC 6 mirrors 000864 1787603749.339150 trunc from 0x00484f to 0x02f228 (0x2a9da bytes) 000865 1787603749.399541 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2f229): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f229): Mirror 2: 0xbfc6a9f2 (stale) Mirror 3: 0xbfc6a9f2 (stale) Mirror 4: 0xbfc6a9f2 (stale) Mirror 5: 0xbfc6a9f2 (stale) Mirror 7: 0xbfc6a9f2 (stale) CRC-32 checksum value for chunk [0, 0x2f229): Mirror 1: 0xbfc6a9f2 Mirror 8: 0xbfc6a9f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f229: skipped 000868 1787603750.260317 trunc from 0x02f229 to 0x01c09b (0x1318d bytes) 000870 1787603750.332601 mapwrite 0x022938 thru 0x02f7f2 (0xcebb bytes) 000871 1787603750.495984 mapread 0x01fcb7 thru 0x025e5a (0x61a4 bytes) 000872 1787603750.503260 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f7f3): Mirror 2: 0x43f9e1ad (stale) Mirror 3: 0x43f9e1ad (stale) Mirror 4: 0x43f9e1ad (stale) Mirror 7: 0x43f9e1ad (stale) Mirror 8: 0x43f9e1ad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f7f3): Mirror 2: 0x43f9e1ad (stale) Mirror 3: 0x43f9e1ad (stale) Mirror 4: 0x43f9e1ad (stale) Mirror 7: 0x43f9e1ad (stale) Mirror 8: 0x43f9e1ad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f7f3: skipped 000874 1787603751.093197 trunc from 0x02f7f3 to 0x027e55 (0x799d bytes) 000875 1787603751.128045 trunc from 0x027e56 to 0x000a7f (0x273d6 bytes) 000879 1787603751.173898 read 0x000763 thru 0x000a7f (0x31d bytes) 000880 1787603751.180618 mapwrite 0x004605 thru 0x007cd8 (0x36d4 bytes) 000883 1787603751.307790 write 0x01101e thru 0x020571 (0xf554 bytes) 000886 1787603751.312864 read 0x011b1c thru 0x0128b6 (0xd9b bytes) 000888 1787603751.316019 write 0x000079 thru 0x0065d1 (0x6559 bytes) 000889 1787603751.317520 mapwrite 0x015fe9 thru 0x018cbf (0x2cd7 bytes) 000891 1787603751.383334 read 0x017397 thru 0x020571 (0x91db bytes) 000892 1787603751.383980 mapread 0x01f421 thru 0x020571 (0x1151 bytes) 000895 1787603751.388419 mapwrite 0x0354bf thru 0x03e67c (0x91be bytes) 000897 1787603751.456201 mapwrite 0x03c9c3 thru 0x03ffff (0x363d bytes) 000900 1787603751.501793 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5369191e (stale) Mirror 3: 0x5369191e (stale) Mirror 4: 0x5369191e (stale) Mirror 7: 0x5369191e (stale) Mirror 8: 0x5369191e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x581c300a Mirror 9: 0x581c300a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000904 1787603752.379089 read 0x027538 thru 0x0335cd (0xc096 bytes) 000905 1787603752.388153 trunc from 0x040000 to 0x03dcc4 (0x233b bytes) 000906 1787603752.524283 trunc from 0x03dcc5 to 0x003e17 (0x39ead bytes) 000909 1787603752.549803 mapwrite 0x011d63 thru 0x01b37b (0x9619 bytes) 000910 1787603752.672563 mapwrite 0x00f451 thru 0x01c7bd (0xd36d bytes) 000914 1787603752.767166 read 0x014307 thru 0x01643a (0x2134 bytes) 000915 1787603752.767967 read 0x01543f thru 0x01a703 (0x52c5 bytes) 000917 1787603752.769744 write 0x019aaa thru 0x01d78c (0x3ce3 bytes) 000918 1787603752.771050 mapwrite 0x037e0a thru 0x03ffff (0x81f6 bytes) 000920 1787603752.876202 trunc from 0x040000 to 0x03b623 (0x49dc bytes) 000921 1787603752.913421 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b624): Mirror 2: 0x522c45f3 (stale) Mirror 3: 0x522c45f3 (stale) Mirror 4: 0x522c45f3 (stale) Mirror 8: 0x522c45f3 (stale) Mirror 9: 0x4a64cfb5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b624): Mirror 2: 0x522c45f3 (stale) Mirror 3: 0x522c45f3 (stale) Mirror 4: 0x522c45f3 (stale) Mirror 8: 0x522c45f3 (stale) Mirror 9: 0x4a64cfb5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b624: skipped 000924 1787603753.431523 read 0x007af4 thru 0x0094c1 (0x19ce bytes) 000925 1787603753.438806 write 0x01dfae thru 0x020394 (0x23e7 bytes) 000926 1787603753.451757 write 0x0249d6 thru 0x02a08e (0x56b9 bytes) 000927 1787603753.490260 trunc from 0x03b624 to 0x034183 (0x74a0 bytes) 000928 1787603753.510242 write 0x0107f0 thru 0x015b2c (0x533d bytes) 000929 1787603753.530990 read 0x007664 thru 0x0102e8 (0x8c85 bytes) 000931 1787603753.557713 trunc from 0x034184 to 0x02c446 (0x7d3d bytes) 000933 1787603753.594439 read 0x00d60f thru 0x0132f4 (0x5ce6 bytes) 000934 1787603753.595291 trunc from 0x02c447 to 0x02620a (0x623c bytes) 000935 1787603753.615463 read 0x00ca2a thru 0x01171f (0x4cf6 bytes) 000936 1787603753.616134 mapread 0x0068d7 thru 0x00a5e1 (0x3d0b bytes) 000939 1787603753.619770 mapwrite 0x02c532 thru 0x036459 (0x9f28 bytes) 000940 1787603753.759897 write 0x022da5 thru 0x024d23 (0x1f7f bytes) 000941 1787603753.765172 read 0x01b4eb thru 0x02902c (0xdb42 bytes) 000942 1787603753.765858 mapread 0x015ea9 thru 0x022369 (0xc4c1 bytes) 000943 1787603753.768230 write 0x00979c thru 0x00dff6 (0x485b bytes) 000944 1787603753.770777 mapread 0x00a580 thru 0x00e291 (0x3d12 bytes) 000945 1787603753.774393 write 0x017b1b thru 0x02044f (0x8935 bytes) 000947 1787603753.780671 read 0x001573 thru 0x00a1db (0x8c69 bytes) 000950 1787603753.788095 read 0x016af3 thru 0x0170a2 (0x5b0 bytes) 000956 1787603753.795839 write 0x029f63 thru 0x037531 (0xd5cf bytes) 000957 1787603753.803954 trunc from 0x037532 to 0x027507 (0x1002a bytes) 000958 1787603753.844099 write 0x0209b7 thru 0x02f51a (0xeb64 bytes) 000959 1787603753.847733 trunc from 0x02f51b to 0x003861 (0x2bcb9 bytes) 000960 1787603753.903038 mapwrite 0x036305 thru 0x03a0a1 (0x3d9d bytes) 000962 1787603754.002975 write 0x03906e thru 0x03ffff (0x6f92 bytes) 000963 1787603754.006971 write 0x030e2e thru 0x034fc1 (0x4194 bytes) 000965 1787603754.010846 trunc from 0x040000 to 0x02fddc (0x10223 bytes) 000966 1787603754.032555 mapwrite 0x011d18 thru 0x017fcb (0x62b4 bytes) 000967 1787603754.133728 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fddd): Mirror 2: 0xd135e075 (stale) Mirror 3: 0xd135e075 (stale) Mirror 8: 0xd135e075 (stale) Mirror 9: 0x6e59c1d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fddd): Mirror 2: 0xd135e075 (stale) Mirror 3: 0xd135e075 (stale) Mirror 8: 0xd135e075 (stale) Mirror 9: 0x6e59c1d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fddd: skipped 000968 1787603754.722124 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2fddd): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fddd): Mirror 2: 0xd135e075 (stale) Mirror 3: 0xd135e075 (stale) Mirror 8: 0xd135e075 (stale) Mirror 9: 0x6e59c1d0 (stale) CRC-32 checksum value for chunk [0, 0x2fddd): Mirror 1: 0xbc387dff Mirror 10: 0xbc387dff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fddd: skipped 000969 1787603755.907383 read 0x0210f8 thru 0x024c68 (0x3b71 bytes) 000971 1787603755.938261 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2fddd): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fddd): Mirror 2: 0xd135e075 (stale) Mirror 3: 0xd135e075 (stale) Mirror 8: 0xd135e075 (stale) Mirror 9: 0x6e59c1d0 (stale) CRC-32 checksum value for chunk [0, 0x2fddd): Mirror 1: 0xbc387dff Mirror 10: 0xbc387dff Mirror 11: 0xbc387dff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fddd: skipped 000972 1787603756.809024 trunc from 0x02fddd to 0x0117ca (0x1e612 bytes) 000974 1787603756.892920 mapwrite 0x034c39 thru 0x03e697 (0x9a5f bytes) 000975 1787603756.975433 mapread 0x030d00 thru 0x03adb4 (0xa0b5 bytes) 000976 1787603756.977352 read 0x03316e thru 0x0342a6 (0x1139 bytes) 000978 1787603756.980042 trunc from 0x03e698 to 0x0000a3 (0x3e5f4 bytes) 000979 1787603757.002774 MIRROR_RESYNC 7 mirrors 000981 1787603758.297341 trunc from 0x0000a4 to 0x003a2c (0x3989 bytes) 000982 1787603758.382042 mapread 0x002293 thru 0x003a2c (0x179a bytes) 000983 1787603758.393114 read 0x0019b8 thru 0x003a2c (0x2075 bytes) 000984 1787603758.398481 mapread 0x000d26 thru 0x003a2c (0x2d07 bytes) 000985 1787603758.409078 MIRROR_RESYNC 7 mirrors 000992 1787603759.819027 MIRROR_EXTEND to 8 mirrors 000993 1787603760.970905 write 0x02d0f1 thru 0x037289 (0xa199 bytes) 000994 1787603761.039155 read 0x023ed0 thru 0x02734e (0x347f bytes) 000997 1787603761.047157 read 0x0294e0 thru 0x030093 (0x6bb4 bytes) 000999 1787603761.063930 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3728a): Mirror 2: 0xeaff10f (stale) Mirror 3: 0xeaff10f (stale) Mirror 9: 0xeaff10f (stale) Mirror 10: 0xeaff10f (stale) Mirror 11: 0xeaff10f (stale) Mirror 12: 0xeaff10f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3728a): Mirror 2: 0xeaff10f (stale) Mirror 3: 0xeaff10f (stale) Mirror 9: 0xeaff10f (stale) Mirror 10: 0xeaff10f (stale) Mirror 11: 0xeaff10f (stale) Mirror 12: 0xeaff10f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3728a: skipped All operations completed A-OK!