== sanity-flr test 70a: flr mode fsx test ================ 10:55:32 (1775832932) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 2933 skipping zero size read skipping zero size read skipping zero length zero range skipping zero size read skipping zero size read skipping zero size read skipping zero size read skipping zero size read 000011 1775832933.478607 write 0x035d91 thru 0x03fdee (0xa05e bytes) zero_range to largest ever: 0x3ee28 000012 1775832933.480827 trunc from 0x03cbe2 to 0x03ee27 (0x2246 bytes) 000013 1775832933.494330 mapwrite 0x0210e4 thru 0x0286fb (0x7618 bytes) 000014 1775832933.533943 mapwrite 0x00856d thru 0x01174d (0x91e1 bytes) 000016 1775832933.559122 read 0x01f0a1 thru 0x0212e4 (0x2244 bytes) 000017 1775832933.559984 trunc from 0x03fdef to 0x01d72b (0x226c3 bytes) 000018 1775832933.573262 read 0x000975 thru 0x009139 (0x87c5 bytes) 000019 1775832933.582227 mapwrite 0x019c56 thru 0x02555c (0xb907 bytes) 000020 1775832933.623891 MIRROR_EXTEND to 2 mirrors 000021 1775832933.999360 mapread 0x00b657 thru 0x014036 (0x89e0 bytes) 000022 1775832934.027760 fallocate 0x006bbc thru 0x0071c6 (0x60b bytes) 000023 1775832934.048519 mapwrite 0x01f6c6 thru 0x02c5ca (0xcf05 bytes) 000024 1775832934.111797 mapwrite 0x0147ff thru 0x01f4b9 (0xacbb bytes) 000025 1775832934.140910 fallocate 0x00746d thru 0x00e133 (0x6cc7 bytes) 000026 1775832934.144537 trunc from 0x01e51e to 0x0298d6 (0xb3b9 bytes) 000029 1775832934.154509 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2c5cb): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c5cb): Mirror 2: 0x4b2e68d7 (stale) CRC-32 checksum value for chunk [0, 0x2c5cb): Mirror 1: 0x28b329d1 Mirror 3: 0x28b329d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c5cb: skipped 000030 1775832934.606545 write 0x012171 thru 0x01243a (0x2ca bytes) 000031 1775832934.625391 mapread 0x02b0c3 thru 0x02c5ca (0x1508 bytes) 000032 1775832934.635606 MIRROR_RESYNC 3 mirrors 000033 1775832935.082968 fallocate 0x00eb61 thru 0x01c2b3 (0xd753 bytes) 000034 1775832935.104975 mapread 0x029d7a thru 0x02c5ca (0x2851 bytes) 000036 1775832935.126930 mapread 0x021b9c thru 0x026073 (0x44d8 bytes) 000037 1775832935.132829 punch from 0x024236 to 0x02c5ca (0x8395 bytes) 000038 1775832935.136183 trunc from 0x02c5cb to 0x0081fd (0x243cd bytes) 000039 1775832935.161744 trunc from 0x0081fe to 0x001bf8 (0x6605 bytes) 000040 1775832935.171768 fallocate 0x03303f thru 0x03c32e (0x92f0 bytes) truncating to largest ever: 0x3f2b6 000041 1775832935.175665 trunc from 0x001bf9 to 0x03f2b5 (0x3d6bd bytes) 000042 1775832935.189728 MIRROR_RESYNC 3 mirrors 000043 1775832935.584499 trunc from 0x03f2b6 to 0x0259db (0x198da bytes) 000044 1775832935.612749 fallocate 0x02441a thru 0x02ad9c (0x6983 bytes) 000045 1775832935.617828 mapread 0x004f1e thru 0x0070d0 (0x21b3 bytes) 000046 1775832935.630861 write 0x0203ea thru 0x0208f3 (0x50a bytes) 000047 1775832935.638640 trunc from 0x0259dc to 0x0202f6 (0x56e5 bytes) 000049 1775832935.663825 write 0x035ff0 thru 0x03ffff (0xa010 bytes) 000050 1775832935.669057 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000051 1775832935.856480 read 0x02b0f5 thru 0x02bd0e (0xc1a bytes) 000052 1775832935.860143 trunc from 0x0284cb to 0x02c396 (0x3ecc bytes) 000053 1775832935.863671 trunc from 0x040000 to 0x02fc84 (0x1037b bytes) 000054 1775832935.877251 read 0x02769c thru 0x02d62c (0x5f91 bytes) 000055 1775832935.883084 read 0x00c4dc thru 0x01645f (0x9f84 bytes) 000056 1775832935.883770 read 0x008a25 thru 0x01312b (0xa707 bytes) 000057 1775832935.884304 mapread 0x01ead7 thru 0x027a73 (0x8f9d bytes) 000059 1775832935.885867 read 0x017195 thru 0x01bd72 (0x4bde bytes) 000060 1775832935.886488 mapwrite 0x005ad2 thru 0x00caff (0x702e bytes) 000061 1775832935.901515 trunc from 0x02fc85 to 0x009500 (0x26784 bytes) 000062 1775832935.918523 punch from 0x004cd7 to 0x008a91 (0x3dbb bytes) 000065 1775832935.926786 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) 000066 1775832936.003640 mapread 0x0012a1 thru 0x009500 (0x8260 bytes) 000067 1775832936.018890 trunc from 0x003d4b to 0x009500 (0x57b6 bytes) 000068 1775832936.023460 fallocate 0x034dbc thru 0x03e96b (0x9bb0 bytes) 000069 1775832936.027303 trunc from 0x009501 to 0x03baa7 (0x325a7 bytes) 000070 1775832936.042685 fallocate 0x01a96e thru 0x026594 (0xbc27 bytes) fallocating to largest ever: 0x40000 000071 1775832936.047693 fallocate 0x0343ad thru 0x03ffff (0xbc53 bytes) 000072 1775832936.051918 read 0x00f396 thru 0x017441 (0x80ac bytes) 000073 1775832936.062675 mapread 0x03220a thru 0x032485 (0x27c bytes) 000074 1775832936.073875 mapwrite 0x014787 thru 0x0166b7 (0x1f31 bytes) 000075 1775832936.088818 fallocate 0x00dbef thru 0x012145 (0x4557 bytes) 000077 1775832936.095352 punch from 0x0052c0 to 0x00e16b (0x8eac bytes) 000078 1775832936.102167 punch from 0x02ab36 to 0x033725 (0x8bf0 bytes) 000079 1775832936.106796 punch from 0x033340 to 0x03f165 (0xbe26 bytes) 000080 1775832936.111675 trunc from 0x040000 to 0x01a80d (0x257f2 bytes) 000081 1775832936.124636 write 0x00ac0f thru 0x018019 (0xd40b bytes) 000082 1775832936.142882 write 0x02ac99 thru 0x034f10 (0xa278 bytes) 000083 1775832936.144293 write 0x02e3a5 thru 0x0345f9 (0x6255 bytes) 000085 1775832936.146382 mapread 0x008c66 thru 0x00fc1b (0x6fb6 bytes) 000086 1775832936.147529 trunc from 0x02fed2 to 0x03085b (0x98a bytes) 000087 1775832936.158700 fallocate 0x03b49f thru 0x03ffff (0x4b61 bytes) 000089 1775832936.163791 read 0x03eb58 thru 0x03ffff (0x14a8 bytes) 000090 1775832936.170450 write 0x02cd85 thru 0x039e95 (0xd111 bytes) 000092 1775832936.172548 write 0x0385f3 thru 0x03c2da (0x3ce8 bytes) 000093 1775832936.173454 write 0x02ac2a thru 0x0330b7 (0x848e bytes) 000094 1775832936.174533 fallocate 0x0379f6 thru 0x03ffff (0x860a bytes) 000095 1775832936.178496 read 0x025d15 thru 0x031320 (0xb60c bytes) 000096 1775832936.179216 read 0x018875 thru 0x0206f1 (0x7e7d bytes) 000097 1775832936.179848 write 0x02736b thru 0x0370d2 (0xfd68 bytes) 000098 1775832936.183841 MIRROR_EXTEND to 2 mirrors 000100 1775832936.512672 trunc from 0x0199cb to 0x025206 (0xb83c bytes) 000101 1775832936.550252 trunc from 0x040000 to 0x01954a (0x26ab5 bytes) 000103 1775832936.582445 mapread 0x0118a3 thru 0x01309a (0x17f8 bytes) 000104 1775832936.601367 MIRROR_RESYNC 2 mirrors 000105 1775832936.905366 trunc from 0x01954b to 0x01d0db (0x3b91 bytes) 000106 1775832936.952650 MIRROR_RESYNC 2 mirrors 000107 1775832937.293445 read 0x014af8 thru 0x015a3a (0xf43 bytes) 000108 1775832937.299169 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) 000110 1775832937.379379 mapread 0x00a9ce thru 0x01083f (0x5e72 bytes) 000111 1775832937.392616 trunc from 0x01d0dc to 0x01e5c1 (0x14e6 bytes) 000114 1775832937.416367 read 0x000b74 thru 0x00ddca (0xd257 bytes) 000115 1775832937.425361 mapread 0x01d1a3 thru 0x01e5c1 (0x141f bytes) 000116 1775832937.434374 write 0x001ce0 thru 0x00b067 (0x9388 bytes) 000117 1775832937.435848 punch from 0x006b9c to 0x011eac (0xb311 bytes) 000118 1775832937.448349 write 0x014794 thru 0x0220da (0xd947 bytes) 000120 1775832937.456082 read 0x000b05 thru 0x00f27a (0xe776 bytes) 000122 1775832937.462432 mapwrite 0x00ac9e thru 0x0108b3 (0x5c16 bytes) 000124 1775832937.478236 fallocate 0x028c9c thru 0x029452 (0x7b7 bytes) 000125 1775832937.482037 punch from 0x00ded8 to 0x014dc9 (0x6ef2 bytes) 000126 1775832937.486297 fallocate 0x026314 thru 0x02bbf5 (0x58e2 bytes) 000128 1775832937.496349 trunc from 0x02bbf6 to 0x007c0f (0x23fe6 bytes) 000129 1775832937.507472 read 0x00539f thru 0x007c0f (0x2871 bytes) 000130 1775832937.508446 mapwrite 0x023da5 thru 0x031f1d (0xe179 bytes) 000131 1775832937.554395 mapread 0x025fef thru 0x02eebf (0x8ed1 bytes) 000132 1775832937.555555 punch from 0x01d232 to 0x02ab27 (0xd8f6 bytes) 000133 1775832937.558855 trunc from 0x031f1e to 0x01d967 (0x145b6 bytes) 000134 1775832937.575035 write 0x0079d4 thru 0x014c0a (0xd237 bytes) 000135 1775832937.579393 trunc from 0x01d968 to 0x02cdb1 (0xf44a bytes) 000136 1775832937.592001 punch from 0x022ebf to 0x02579a (0x28dc bytes) 000137 1775832937.595643 mapwrite 0x017c4e thru 0x022e19 (0xb1cc bytes) 000138 1775832937.638684 mapwrite 0x00b758 thru 0x01b30b (0xfbb4 bytes) 000139 1775832937.663975 read 0x00c64e thru 0x015ab3 (0x9466 bytes) 000140 1775832937.678351 read 0x02a510 thru 0x02cdb1 (0x28a2 bytes) 000141 1775832937.684639 trunc from 0x0296c5 to 0x02cdb1 (0x36ed bytes) 000142 1775832937.688923 trunc from 0x02cdb2 to 0x02f37d (0x25cc bytes) 000143 1775832937.701616 MIRROR_EXTEND to 2 mirrors 000144 1775832938.067025 fallocate 0x002f36 thru 0x009ef1 (0x6fbc bytes) 000145 1775832938.088526 trunc from 0x02f37e to 0x008c19 (0x26764 bytes) 000146 1775832938.124955 punch from 0x002276 to 0x008c19 (0x69a4 bytes) 000147 1775832938.129017 trunc from 0x008c1a to 0x0244d2 (0x1b8b9 bytes) 000148 1775832938.140702 trunc from 0x01ed1d to 0x0244d2 (0x57b6 bytes) 000149 1775832938.144720 trunc from 0x01fcab to 0x0244d2 (0x4828 bytes) 000150 1775832938.148124 mapwrite 0x017db8 thru 0x020581 (0x87ca bytes) 000151 1775832938.175720 punch from 0x003982 to 0x00b689 (0x7d08 bytes) 000152 1775832938.179731 trunc from 0x0205fc to 0x0244d2 (0x3ed7 bytes) 000153 1775832938.184482 trunc from 0x0244d3 to 0x01dd58 (0x677a bytes) 000154 1775832938.201621 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1dd59): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1dd59): Mirror 2: 0xe87f5e82 (stale) CRC-32 checksum value for chunk [0, 0x1dd59): Mirror 1: 0x528c1790 Mirror 3: 0x528c1790 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1dd59: skipped 000155 1775832938.775389 trunc from 0x01dd59 to 0x008d9a (0x14fbe bytes) 000156 1775832938.815513 read 0x007ee8 thru 0x008d9a (0xeb3 bytes) 000157 1775832938.820499 fallocate 0x00d35b thru 0x01aec5 (0xdb6b bytes) 000158 1775832938.824737 punch from 0x005edc to 0x008d9a (0x2ebf bytes) 000159 1775832938.828032 trunc from 0x008d9b to 0x0383c5 (0x2f62b bytes) 000160 1775832938.854341 mapread 0x02f690 thru 0x036476 (0x6de7 bytes) 000161 1775832938.874707 mapwrite 0x005b28 thru 0x00d3ae (0x7887 bytes) 000162 1775832938.901294 trunc from 0x01843b to 0x0278c7 (0xf48d bytes) 000163 1775832938.906310 write 0x0215c9 thru 0x02975f (0x8197 bytes) 000164 1775832938.915243 mapread 0x0092d6 thru 0x013aed (0xa818 bytes) 000165 1775832938.929633 read 0x00f46e thru 0x018c10 (0x97a3 bytes) 000166 1775832938.930290 fallocate 0x03ecc9 thru 0x03ffff (0x1337 bytes) 000167 1775832938.934278 write 0x010ac6 thru 0x01b6d3 (0xac0e bytes) 000168 1775832938.939607 MIRROR_RESYNC 3 mirrors 000169 1775832939.638237 punch from 0x01ef72 to 0x023b99 (0x4c28 bytes) 000170 1775832939.664753 write 0x001455 thru 0x00f3bf (0xdf6b bytes) 000171 1775832939.672359 trunc from 0x040000 to 0x0159f3 (0x2a60c bytes) 000172 1775832939.691951 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x159f4): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x159f4): Mirror 2: 0x406527b7 (stale) Mirror 3: 0x406527b7 (stale) CRC-32 checksum value for chunk [0, 0x159f4): Mirror 1: 0x9c3086c3 Mirror 4: 0x9c3086c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x159f4: skipped 000173 1775832940.159438 trunc from 0x011139 to 0x0159f3 (0x48bb bytes) 000174 1775832940.190157 read 0x013c7e thru 0x0159f3 (0x1d76 bytes) 000175 1775832940.196670 trunc from 0x0159f4 to 0x03a448 (0x24a55 bytes) 000176 1775832940.222745 MIRROR_RESYNC 4 mirrors 000177 1775832940.875069 mapread 0x006c75 thru 0x00c655 (0x59e1 bytes) 000178 1775832940.897182 punch from 0x0074f2 to 0x013493 (0xbfa2 bytes) 000179 1775832940.921868 mapread 0x01be09 thru 0x01f4ac (0x36a4 bytes) 000180 1775832940.931799 trunc from 0x015f49 to 0x01a794 (0x484c bytes) 000181 1775832940.936446 trunc from 0x022a3d to 0x02757b (0x4b3f bytes) 000182 1775832940.940017 mapread 0x027e9f thru 0x03343f (0xb5a1 bytes) 000183 1775832940.954982 punch from 0x00a096 to 0x0145fc (0xa567 bytes) 000184 1775832940.961455 mapwrite 0x01d51a thru 0x028bdf (0xb6c6 bytes) 000185 1775832940.987157 mapwrite 0x00de8e thru 0x01ab7c (0xccef bytes) 000186 1775832941.021808 mapwrite 0x013ba4 thru 0x014c03 (0x1060 bytes) 000187 1775832941.034265 punch from 0x019aaa to 0x01bf88 (0x24df bytes) 000188 1775832941.038399 trunc from 0x021bd4 to 0x023610 (0x1a3d bytes) 000190 1775832941.043976 write 0x0276f1 thru 0x02a966 (0x3276 bytes) 000191 1775832941.045736 write 0x03da98 thru 0x03ffff (0x2568 bytes) 000192 1775832941.047276 write 0x02a3fe thru 0x03527c (0xae7f bytes) 000193 1775832941.048651 trunc from 0x040000 to 0x02765d (0x189a2 bytes) 000194 1775832941.076813 read 0x01e4ee thru 0x02765d (0x9170 bytes) 000195 1775832941.083171 mapread 0x01484d thru 0x019863 (0x5017 bytes) 000196 1775832941.090183 trunc from 0x013c9c to 0x022da8 (0xf10d bytes) 000197 1775832941.095601 write 0x015dcb thru 0x02316e (0xd3a4 bytes) 000198 1775832941.104733 write 0x01d379 thru 0x02447b (0x7103 bytes) 000199 1775832941.106453 punch from 0x026ff3 to 0x02765d (0x66b bytes) 000200 1775832941.122746 trunc from 0x005b4a to 0x00d48c (0x7943 bytes) 000201 1775832941.128515 trunc from 0x002de5 to 0x00a5df (0x77fb bytes) 000202 1775832941.135083 trunc from 0x02765e to 0x025488 (0x21d5 bytes) 000203 1775832941.152662 trunc from 0x0028d1 to 0x00a945 (0x8075 bytes) 000204 1775832941.157290 mapread 0x00a4a4 thru 0x00e639 (0x4196 bytes) 000205 1775832941.165622 read 0x00670d thru 0x00d11d (0x6a11 bytes) 000206 1775832941.167109 trunc from 0x025489 to 0x03a9fc (0x15574 bytes) 000207 1775832941.181816 mapread 0x01672a thru 0x017c52 (0x1529 bytes) 000209 1775832941.184976 read 0x039475 thru 0x03a9fc (0x1588 bytes) 000210 1775832941.193944 fallocate 0x001afa thru 0x0115b6 (0xfabd bytes) 000211 1775832941.204147 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a9fd): Mirror 2: 0xa47c536e (stale) Mirror 4: 0xa47c536e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a9fd): Mirror 2: 0xa47c536e (stale) Mirror 4: 0xa47c536e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a9fd: skipped 000212 1775832941.395887 punch from 0x035122 to 0x03a9fc (0x58db bytes) 000214 1775832941.399224 mapread 0x005541 thru 0x011d86 (0xc846 bytes) 000215 1775832941.414391 punch from 0x025221 to 0x03244b (0xd22b bytes) 000216 1775832941.418682 write 0x031670 thru 0x03904c (0x79dd bytes) 000217 1775832941.425910 fallocate 0x00f2c2 thru 0x01dc17 (0xe956 bytes) 000218 1775832941.429415 trunc from 0x01eea5 to 0x026964 (0x7ac0 bytes) 000219 1775832941.433903 mapwrite 0x02deb0 thru 0x035143 (0x7294 bytes) 000220 1775832941.449834 write 0x019b94 thru 0x01d375 (0x37e2 bytes) 000221 1775832941.455838 write 0x0333f1 thru 0x036129 (0x2d39 bytes) 000222 1775832941.457061 write 0x036ae8 thru 0x037ff9 (0x1512 bytes) 000223 1775832941.458393 mapwrite 0x00f6c4 thru 0x0111b0 (0x1aed bytes) 000224 1775832941.474696 trunc from 0x024603 to 0x024981 (0x37f bytes) 000225 1775832941.478248 read 0x000055 thru 0x00b578 (0xb524 bytes) 000226 1775832941.484023 trunc from 0x03a9fd to 0x0119db (0x29021 bytes) 000227 1775832941.495377 write 0x023cdf thru 0x02e2ac (0xa5ce bytes) 000228 1775832941.497162 mapread 0x0286e1 thru 0x02bf85 (0x38a5 bytes) 000229 1775832941.498603 mapread 0x0134e2 thru 0x01630d (0x2e2c bytes) 000230 1775832941.504869 mapwrite 0x011c5d thru 0x0206f6 (0xea9a bytes) 000231 1775832941.532022 read 0x00db79 thru 0x00f1ea (0x1672 bytes) 000232 1775832941.533260 mapwrite 0x01a858 thru 0x01ce16 (0x25bf bytes) 000233 1775832941.546018 read 0x02c19c thru 0x02e2ac (0x2111 bytes) 000234 1775832941.546879 punch from 0x008014 to 0x016616 (0xe603 bytes) 000235 1775832941.553438 trunc from 0x02e2ad to 0x00d64a (0x20c62 bytes) 000236 1775832941.565388 trunc from 0x00d64b to 0x018040 (0xa9f6 bytes) 000237 1775832941.576295 read 0x002d36 thru 0x00a94f (0x7c1a bytes) 000239 1775832941.585135 trunc from 0x00cebb to 0x018040 (0xb186 bytes) 000240 1775832941.590333 mapread 0x012427 thru 0x018040 (0x5c1a bytes) 000242 1775832941.630167 fallocate 0x00eb6d thru 0x017700 (0x8b94 bytes) 000243 1775832941.636242 mapread 0x00cc1c thru 0x016189 (0x956e bytes) 000244 1775832941.662272 punch from 0x011fb5 to 0x018040 (0x608c bytes) 000245 1775832941.669220 punch from 0x015a88 to 0x018040 (0x25b9 bytes) 000246 1775832941.676405 fallocate 0x00dcf1 thru 0x017695 (0x99a5 bytes) 000247 1775832941.682277 trunc from 0x00624e to 0x00c819 (0x65cc bytes) 000248 1775832941.694470 MIRROR_RESYNC 3 mirrors 000249 1775832942.078008 mapwrite 0x037216 thru 0x039263 (0x204e bytes) 000250 1775832942.156469 punch from 0x00ba82 to 0x018ab6 (0xd035 bytes) 000251 1775832942.160896 trunc from 0x039264 to 0x005370 (0x33ef3 bytes) 000252 1775832942.176189 fallocate 0x020990 thru 0x029351 (0x89c2 bytes) 000253 1775832942.180354 punch from 0x01d946 to 0x021d20 (0x43db bytes) 000255 1775832942.188308 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29352): Mirror 2: 0xca6a220f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29352): Mirror 2: 0xca6a220f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29352: skipped 000256 1775832942.366314 write 0x019f9b thru 0x02739b (0xd401 bytes) 000257 1775832942.378522 write 0x03728f thru 0x038ff5 (0x1d67 bytes) 000258 1775832942.380009 trunc from 0x038ff6 to 0x006ecb (0x3212a bytes) 000259 1775832942.391132 write 0x02b983 thru 0x038768 (0xcde6 bytes) 000260 1775832942.392748 mapread 0x028b81 thru 0x02b8b3 (0x2d33 bytes) 000261 1775832942.399927 write 0x036c1d thru 0x03ffff (0x93e3 bytes) 000262 1775832942.401360 trunc from 0x03dfbd to 0x03ffff (0x2043 bytes) 000263 1775832942.415602 mapwrite 0x0316dd thru 0x039f8d (0x88b1 bytes) 000264 1775832942.436693 read 0x014c7b thru 0x014d80 (0x106 bytes) 000265 1775832942.441091 read 0x01877b thru 0x01d703 (0x4f89 bytes) 000266 1775832942.457548 MIRROR_RESYNC 2 mirrors 000267 1775832942.815412 MIRROR_EXTEND to 3 mirrors 000268 1775832943.191184 mapwrite 0x02cc07 thru 0x039630 (0xca2a bytes) 000269 1775832943.263150 trunc from 0x0015c5 to 0x00b150 (0x9b8c bytes) 000270 1775832943.268954 trunc from 0x01088a to 0x01f505 (0xec7c bytes) 000271 1775832943.273967 fallocate 0x0163ed thru 0x018591 (0x21a5 bytes) 000272 1775832943.278514 mapread 0x017290 thru 0x02362f (0xc3a0 bytes) 000273 1775832943.291503 mapwrite 0x02e445 thru 0x02ff91 (0x1b4d bytes) 000274 1775832943.304165 write 0x03e424 thru 0x03ffff (0x1bdc bytes) 000275 1775832943.308254 read 0x030994 thru 0x034000 (0x366d bytes) 000276 1775832943.308965 write 0x002fbc thru 0x00f197 (0xc1dc bytes) 000277 1775832943.316382 trunc from 0x024445 to 0x02e033 (0x9bef bytes) 000278 1775832943.320453 trunc from 0x024a82 to 0x03119a (0xc719 bytes) 000279 1775832943.326846 write 0x022450 thru 0x025a1f (0x35d0 bytes) 000280 1775832943.330905 mapread 0x02a27e thru 0x02dd2a (0x3aad bytes) 000281 1775832943.338805 write 0x0264fa thru 0x02cf4c (0x6a53 bytes) 000282 1775832943.341103 mapread 0x0080e5 thru 0x01516b (0xd087 bytes) 000283 1775832943.342960 punch from 0x038335 to 0x03ffff (0x7ccb bytes) 000284 1775832943.361986 write 0x0332aa thru 0x033919 (0x670 bytes) 000285 1775832943.363976 read 0x0002dd thru 0x005495 (0x51b9 bytes) 000287 1775832943.373228 trunc from 0x025e76 to 0x031676 (0xb801 bytes) 000288 1775832943.377982 mapread 0x0299f3 thru 0x031a1a (0x8028 bytes) 000289 1775832943.413231 read 0x027f4b thru 0x02d395 (0x544b bytes) 000290 1775832943.418773 trunc from 0x040000 to 0x03529c (0xad63 bytes) 000291 1775832943.455024 mapread 0x028ad9 thru 0x02e5c7 (0x5aef bytes) 000292 1775832943.456177 read 0x0199e7 thru 0x01eb4c (0x5166 bytes) 000293 1775832943.456821 mapread 0x03416d thru 0x03529c (0x1130 bytes) 000294 1775832943.460732 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3529d): Mirror 3: 0x6c2dc0a8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3529d): Mirror 3: 0x6c2dc0a8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3529d: skipped 000295 1775832943.625758 punch from 0x01b8dd to 0x029a4f (0xe173 bytes) 000296 1775832943.629127 read 0x0022de thru 0x009e4b (0x7b6e bytes) 000297 1775832943.634364 write 0x029dca thru 0x034312 (0xa549 bytes) 000298 1775832943.643901 punch from 0x0199a2 to 0x0204a4 (0x6b03 bytes) 000299 1775832943.648707 mapwrite 0x009a10 thru 0x00b86e (0x1e5f bytes) 000300 1775832943.669793 fallocate 0x03763e thru 0x037a17 (0x3da bytes) 000301 1775832943.674499 read 0x0183a6 thru 0x020b2f (0x878a bytes) 000302 1775832943.679535 mapread 0x02ba9c thru 0x030382 (0x48e7 bytes) 000303 1775832943.680673 read 0x008766 thru 0x009287 (0xb22 bytes) 000305 1775832943.681948 mapread 0x00bab7 thru 0x015dde (0xa328 bytes) 000307 1775832943.688736 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3529d): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3529d): Mirror 3: 0x6c2dc0a8 (stale) CRC-32 checksum value for chunk [0, 0x3529d): Mirror 1: 0xa119e864 Mirror 4: 0xa119e864 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3529d: skipped 000308 1775832944.116034 punch from 0x013193 to 0x020c68 (0xdad6 bytes) 000309 1775832944.145659 mapread 0x02d834 thru 0x03529c (0x7a69 bytes) 000311 1775832944.159875 mapread 0x0066c0 thru 0x00efb1 (0x88f2 bytes) 000312 1775832944.167136 mapread 0x00a3db thru 0x01a106 (0xfd2c bytes) 000313 1775832944.177917 punch from 0x01a38d to 0x01ddb9 (0x3a2d bytes) 000314 1775832944.181721 punch from 0x00a888 to 0x00c036 (0x17af bytes) 000315 1775832944.186327 read 0x000f7e thru 0x00fbd0 (0xec53 bytes) 000316 1775832944.195548 mapread 0x0118c0 thru 0x0217d3 (0xff14 bytes) 000317 1775832944.201599 write 0x0175de thru 0x0181b6 (0xbd9 bytes) 000319 1775832944.206749 punch from 0x02a931 to 0x03529c (0xa96c bytes) 000320 1775832944.210963 fallocate 0x01616e thru 0x01c2d9 (0x616c bytes) 000321 1775832944.217712 MIRROR_RESYNC 3 mirrors 000322 1775832944.772777 MIRROR_EXTEND to 4 mirrors 000323 1775832945.141147 write 0x03a667 thru 0x03e4eb (0x3e85 bytes) 000324 1775832945.172065 mapwrite 0x029590 thru 0x037ee9 (0xe95a bytes) 000325 1775832945.207918 punch from 0x002c00 to 0x0072cd (0x46ce bytes) 000326 1775832945.212959 fallocate 0x007b4d thru 0x010e00 (0x92b4 bytes) 000327 1775832945.217092 mapread 0x031fb3 thru 0x0370dc (0x512a bytes) 000328 1775832945.218048 punch from 0x031836 to 0x033cbf (0x248a bytes) 000329 1775832945.221610 trunc from 0x03e4ec to 0x02400f (0x1a4dc bytes) 000330 1775832945.243391 write 0x0064bc thru 0x00688a (0x3cf bytes) 000331 1775832945.253430 read 0x012ab0 thru 0x016010 (0x3561 bytes) 000332 1775832945.260522 punch from 0x014c74 to 0x014e29 (0x1b6 bytes) 000334 1775832945.264769 punch from 0x00dc52 to 0x01600e (0x83bd bytes) 000335 1775832945.271699 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x24010): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24010): Mirror 3: 0xab390a94 (stale) Mirror 4: 0xab390a94 (stale) Mirror 5: 0xab390a94 (stale) CRC-32 checksum value for chunk [0, 0x24010): Mirror 1: 0xfd85ae11 Mirror 6: 0xfd85ae11 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24010: skipped 000336 1775832945.738024 punch from 0x021064 to 0x02400f (0x2fac bytes) 000337 1775832945.759102 write 0x01d21f thru 0x023471 (0x6253 bytes) 000339 1775832945.770808 trunc from 0x024010 to 0x006b26 (0x1d4e9 bytes) 000340 1775832945.800023 punch from 0x001954 to 0x006b26 (0x51d3 bytes) 000341 1775832945.805405 write 0x024a6a thru 0x0272fb (0x2892 bytes) 000343 1775832945.807522 fallocate 0x0354c5 thru 0x03cc11 (0x774d bytes) 000344 1775832945.814233 write 0x036bb2 thru 0x03ffff (0x944e bytes) 000345 1775832945.816140 mapread 0x03bcf5 thru 0x03f1f7 (0x3503 bytes) 000346 1775832945.817284 read 0x026717 thru 0x03285a (0xc144 bytes) 000347 1775832945.825708 trunc from 0x0096e4 to 0x012be5 (0x9502 bytes) 000348 1775832945.832251 trunc from 0x040000 to 0x03c168 (0x3e97 bytes) 000349 1775832945.844295 trunc from 0x027639 to 0x029252 (0x1c1a bytes) 000350 1775832945.856751 read 0x002373 thru 0x003dd8 (0x1a66 bytes) 000351 1775832945.863520 mapwrite 0x02cf6c thru 0x03693f (0x99d4 bytes) 000352 1775832945.878027 trunc from 0x03c169 to 0x00b402 (0x30d66 bytes) 000353 1775832945.891801 mapwrite 0x02d08f thru 0x0316f2 (0x4664 bytes) 000354 1775832945.939389 punch from 0x028111 to 0x0316f2 (0x95e2 bytes) 000355 1775832945.944110 punch from 0x02945c to 0x0316f2 (0x8297 bytes) 000356 1775832945.950029 read 0x00191b thru 0x0108c5 (0xefab bytes) 000357 1775832945.958984 trunc from 0x00cb16 to 0x011bae (0x5099 bytes) 000358 1775832945.963920 write 0x010a68 thru 0x012d4d (0x22e6 bytes) 000359 1775832945.969555 read 0x025d4a thru 0x029534 (0x37eb bytes) 000360 1775832945.970930 trunc from 0x004807 to 0x00d64a (0x8e44 bytes) 000361 1775832945.975178 trunc from 0x02ee2c to 0x0316f2 (0x28c7 bytes) 000362 1775832945.978858 punch from 0x026412 to 0x0316f2 (0xb2e1 bytes) 000363 1775832945.983481 trunc from 0x0316f3 to 0x037885 (0x6193 bytes) 000364 1775832945.994850 trunc from 0x00f93f to 0x010f3e (0x1600 bytes) 000365 1775832946.008377 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x37886): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37886): Mirror 3: 0xecad547c (stale) Mirror 4: 0xecad547c (stale) Mirror 5: 0xecad547c (stale) Mirror 6: 0x6ef313c9 (stale) CRC-32 checksum value for chunk [0, 0x37886): Mirror 1: 0xddfb14fd Mirror 7: 0xddfb14fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37886: skipped 000366 1775832946.504864 mapwrite 0x0100d6 thru 0x018c49 (0x8b74 bytes) 000367 1775832946.582154 fallocate 0x029646 thru 0x031917 (0x82d2 bytes) 000368 1775832946.586296 trunc from 0x01e9aa to 0x02ba2c (0xd083 bytes) 000369 1775832946.589871 fallocate 0x039713 thru 0x03ffff (0x68ed bytes) 000370 1775832946.597065 MIRROR_RESYNC 6 mirrors 000371 1775832947.509488 read 0x005829 thru 0x00ff93 (0xa76b bytes) 000372 1775832947.523163 MIRROR_EXTEND to 7 mirrors 000373 1775832947.959316 mapread 0x01e614 thru 0x0262e9 (0x7cd6 bytes) 000374 1775832947.973774 write 0x035d78 thru 0x039b53 (0x3ddc bytes) 000375 1775832948.010055 trunc from 0x040000 to 0x00e2d8 (0x31d27 bytes) 000377 1775832948.034022 fallocate 0x014894 thru 0x016b3f (0x22ac bytes) 000380 1775832948.041465 MIRROR_RESYNC 7 mirrors 000381 1775832948.673270 mapwrite 0x012949 thru 0x01a3d2 (0x7a8a bytes) 000382 1775832948.740864 write 0x02ae23 thru 0x02e9a7 (0x3b85 bytes) 000383 1775832948.741986 mapread 0x0274de thru 0x02e9a7 (0x74ca bytes) 000385 1775832948.750360 write 0x018a92 thru 0x019771 (0xce0 bytes) 000386 1775832948.751252 mapwrite 0x0217b0 thru 0x030522 (0xed73 bytes) 000387 1775832948.787075 write 0x007df2 thru 0x01124c (0x945b bytes) 000388 1775832948.797912 write 0x00089d thru 0x008e94 (0x85f8 bytes) 000389 1775832948.802083 mapread 0x0302d4 thru 0x030522 (0x24f bytes) 000390 1775832948.803087 punch from 0x01f14e to 0x023503 (0x43b6 bytes) 000391 1775832948.809346 write 0x019bc3 thru 0x02331f (0x975d bytes) 000393 1775832948.817030 trunc from 0x030523 to 0x027e7e (0x86a4 bytes) 000394 1775832948.833859 MIRROR_RESYNC 7 mirrors 000395 1775832949.254288 mapread 0x025041 thru 0x027e7e (0x2e3e bytes) 000396 1775832949.268138 punch from 0x011f76 to 0x019ea8 (0x7f33 bytes) 000397 1775832949.292596 punch from 0x020f91 to 0x021f58 (0xfc8 bytes) 000398 1775832949.297271 trunc from 0x01394f to 0x01e1a5 (0xa857 bytes) 000399 1775832949.307802 trunc from 0x0269e2 to 0x027e7e (0x149d bytes) 000400 1775832949.317329 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27e7f): Mirror 3: 0x4be5b441 (stale) Mirror 5: 0x4be5b441 (stale) Mirror 6: 0x4be5b441 (stale) Mirror 7: 0x4be5b441 (stale) Mirror 8: 0x4be5b441 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27e7f): Mirror 3: 0x4be5b441 (stale) Mirror 5: 0x4be5b441 (stale) Mirror 6: 0x4be5b441 (stale) Mirror 7: 0x4be5b441 (stale) Mirror 8: 0x4be5b441 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27e7f: skipped 000401 1775832949.567181 trunc from 0x01e81b to 0x027e7e (0x9664 bytes) 000402 1775832949.570865 read 0x005b56 thru 0x010f98 (0xb443 bytes) 000403 1775832949.576416 trunc from 0x027e7f to 0x00a6a1 (0x1d7dd bytes) 000404 1775832949.592918 trunc from 0x00a6a2 to 0x00e5e4 (0x3f43 bytes) 000405 1775832949.602223 punch from 0x001996 to 0x008e44 (0x74af bytes) 000406 1775832949.606503 read 0x009ca2 thru 0x00e5e4 (0x4943 bytes) 000408 1775832949.615084 mapread 0x0076a1 thru 0x00e5e4 (0x6f44 bytes) 000409 1775832949.618692 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe5e5): Mirror 3: 0x538904c3 (stale) Mirror 6: 0x538904c3 (stale) Mirror 7: 0x538904c3 (stale) Mirror 8: 0x538904c3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe5e5): Mirror 3: 0x538904c3 (stale) Mirror 6: 0x538904c3 (stale) Mirror 7: 0x538904c3 (stale) Mirror 8: 0x538904c3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe5e5: skipped 000410 1775832949.785853 read 0x00852a thru 0x00e5e4 (0x60bb bytes) 000411 1775832949.792076 mapwrite 0x02d292 thru 0x03363f (0x63ae bytes) 000412 1775832949.832520 mapwrite 0x00e992 thru 0x012473 (0x3ae2 bytes) 000413 1775832949.855903 read 0x001e2c thru 0x007cd2 (0x5ea7 bytes) 000414 1775832949.863741 trunc from 0x033640 to 0x008b68 (0x2aad7 bytes) 000415 1775832949.877042 mapwrite 0x02879c thru 0x02a13b (0x19a0 bytes) 000416 1775832949.908335 trunc from 0x02a13c to 0x021236 (0x8f05 bytes) 000417 1775832949.917094 trunc from 0x021237 to 0x03fa44 (0x1e80e bytes) 000418 1775832949.931134 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3fa45): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa45): Mirror 3: 0xe8e76559 (stale) Mirror 6: 0xe8e76559 (stale) Mirror 7: 0xe8e76559 (stale) Mirror 8: 0xe8e76559 (stale) CRC-32 checksum value for chunk [0, 0x3fa45): Mirror 1: 0x3774443a Mirror 9: 0x3774443a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa45: skipped 000419 1775832950.396090 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3fa45): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa45): Mirror 3: 0xe8e76559 (stale) Mirror 6: 0xe8e76559 (stale) Mirror 7: 0xe8e76559 (stale) Mirror 8: 0xe8e76559 (stale) CRC-32 checksum value for chunk [0, 0x3fa45): Mirror 1: 0x3774443a Mirror 9: 0x3774443a Mirror 10: 0x3774443a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa45: skipped 000420 1775832950.886317 mapread 0x03e311 thru 0x03e529 (0x219 bytes) 000421 1775832950.890995 mapread 0x015e25 thru 0x01ae7c (0x5058 bytes) 000422 1775832950.900874 punch from 0x028cde to 0x02f69c (0x69bf bytes) 000423 1775832950.929823 mapwrite 0x006c28 thru 0x00db3f (0x6f18 bytes) 000424 1775832950.952087 trunc from 0x0139b7 to 0x013eb5 (0x4ff bytes) 000426 1775832950.963149 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3fa45): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa45): Mirror 3: 0xe8e76559 (stale) Mirror 6: 0xe8e76559 (stale) Mirror 7: 0xe8e76559 (stale) Mirror 8: 0xe8e76559 (stale) Mirror 9: 0x3774443a (stale) Mirror 10: 0x3774443a (stale) CRC-32 checksum value for chunk [0, 0x3fa45): Mirror 1: 0x9721bc32 Mirror 11: 0x9721bc32 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa45: skipped 000427 1775832951.560084 trunc from 0x004c36 to 0x0093a6 (0x4771 bytes) 000428 1775832951.586952 mapread 0x0065e9 thru 0x006fd8 (0x9f0 bytes) 000429 1775832951.592218 trunc from 0x02aec2 to 0x02f4f3 (0x4632 bytes) 000430 1775832951.595907 read 0x0079b6 thru 0x0105a2 (0x8bed bytes) 000431 1775832951.605004 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3fa45): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa45): Mirror 3: 0xe8e76559 (stale) Mirror 6: 0xe8e76559 (stale) Mirror 7: 0xe8e76559 (stale) Mirror 8: 0xe8e76559 (stale) Mirror 9: 0x3774443a (stale) Mirror 10: 0x3774443a (stale) Mirror 11: 0x9721bc32 (stale) CRC-32 checksum value for chunk [0, 0x3fa45): Mirror 1: 0x43d6499f Mirror 12: 0x43d6499f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa45: skipped 000432 1775832952.138597 fallocate 0x03457c thru 0x03df25 (0x99aa bytes) 000433 1775832952.165188 punch from 0x025cbb to 0x026336 (0x67c bytes) 000435 1775832952.169194 trunc from 0x03b15e to 0x03fa44 (0x48e7 bytes) 000437 1775832952.172768 trunc from 0x03fa45 to 0x016a55 (0x28fef bytes) 000438 1775832952.193503 punch from 0x0012a1 to 0x010faa (0xfd0a bytes) 000439 1775832952.197285 trunc from 0x016a56 to 0x00d10e (0x9947 bytes) 000440 1775832952.205115 trunc from 0x00c1ea to 0x00d10e (0xf25 bytes) 000441 1775832952.208147 mapwrite 0x03e9be thru 0x03ffff (0x1642 bytes) 000442 1775832952.231231 punch from 0x03aa14 to 0x03ffff (0x55ec bytes) 000443 1775832952.238943 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x938f90dc (stale) Mirror 6: 0x938f90dc (stale) Mirror 7: 0x938f90dc (stale) Mirror 8: 0x938f90dc (stale) Mirror 9: 0x72b7e51 (stale) Mirror 10: 0x72b7e51 (stale) Mirror 11: 0x4ffd1a83 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x938f90dc (stale) Mirror 6: 0x938f90dc (stale) Mirror 7: 0x938f90dc (stale) Mirror 8: 0x938f90dc (stale) Mirror 9: 0x72b7e51 (stale) Mirror 10: 0x72b7e51 (stale) Mirror 11: 0x4ffd1a83 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000444 1775832952.492269 fallocate 0x016289 thru 0x02481e (0xe596 bytes) 000445 1775832952.499415 trunc from 0x00431d to 0x011e3c (0xdb20 bytes) 000446 1775832952.505809 write 0x005170 thru 0x01374e (0xe5df bytes) 000447 1775832952.522323 write 0x0124dc thru 0x014e21 (0x2946 bytes) 000448 1775832952.527691 trunc from 0x010586 to 0x01ddea (0xd865 bytes) 000449 1775832952.537399 fallocate 0x02e9e2 thru 0x037a2b (0x904a bytes) 000450 1775832952.544354 MIRROR_RESYNC 8 mirrors 000451 1775832953.395854 fallocate 0x027ccf thru 0x02b8f2 (0x3c24 bytes) 000452 1775832953.414123 fallocate 0x01849e thru 0x01b9ac (0x350f bytes) 000454 1775832953.418166 read 0x00961d thru 0x0174ab (0xde8f bytes) 000455 1775832953.424800 write 0x037619 thru 0x037d94 (0x77c bytes) 000457 1775832953.428399 read 0x020f71 thru 0x020fb6 (0x46 bytes) 000458 1775832953.438353 fallocate 0x02dead thru 0x035c66 (0x7dba bytes) 000459 1775832953.445131 read 0x022b48 thru 0x02def7 (0xb3b0 bytes) 000460 1775832953.446240 mapread 0x03239b thru 0x033ba7 (0x180d bytes) 000461 1775832953.447371 punch from 0x0386b3 to 0x03a057 (0x19a5 bytes) 000462 1775832953.451553 mapwrite 0x003f33 thru 0x00e0b5 (0xa183 bytes) 000463 1775832953.467346 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x663db779 (stale) Mirror 6: 0x663db779 (stale) Mirror 7: 0x663db779 (stale) Mirror 8: 0x663db779 (stale) Mirror 9: 0x663db779 (stale) Mirror 10: 0x663db779 (stale) Mirror 11: 0x663db779 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x93b9088c Mirror 12: 0x93b9088c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000464 1775832953.937598 trunc from 0x011678 to 0x01aab4 (0x943d bytes) 000465 1775832953.962231 write 0x032d5e thru 0x03ffff (0xd2a2 bytes) 000466 1775832953.970533 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x663db779 (stale) Mirror 6: 0x663db779 (stale) Mirror 7: 0x663db779 (stale) Mirror 8: 0x663db779 (stale) Mirror 9: 0x663db779 (stale) Mirror 10: 0x663db779 (stale) Mirror 11: 0x663db779 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x663db779 (stale) Mirror 6: 0x663db779 (stale) Mirror 7: 0x663db779 (stale) Mirror 8: 0x663db779 (stale) Mirror 9: 0x663db779 (stale) Mirror 10: 0x663db779 (stale) Mirror 11: 0x663db779 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000467 1775832954.247078 fallocate 0x0248a3 thru 0x026ebc (0x261a bytes) 000468 1775832954.250412 read 0x00a3b1 thru 0x0116b8 (0x7308 bytes) 000469 1775832954.255954 write 0x030de4 thru 0x035771 (0x498e bytes) 000470 1775832954.268662 trunc from 0x040000 to 0x02b048 (0x14fb7 bytes) 000471 1775832954.292459 mapwrite 0x033847 thru 0x037649 (0x3e03 bytes) 000472 1775832954.319893 write 0x006f10 thru 0x015a53 (0xeb44 bytes) 000473 1775832954.332803 punch from 0x019032 to 0x0230fc (0xa0cb bytes) 000474 1775832954.336586 mapwrite 0x007ead thru 0x0083c2 (0x516 bytes) 000475 1775832954.350729 read 0x018ee1 thru 0x01b68a (0x27aa bytes) 000476 1775832954.358129 mapread 0x0322f8 thru 0x03734d (0x5056 bytes) 000477 1775832954.359595 trunc from 0x02a56d to 0x032722 (0x81b6 bytes) 000478 1775832954.363034 mapread 0x00524e thru 0x00e3bf (0x9172 bytes) 000479 1775832954.366699 MIRROR_RESYNC 8 mirrors 000480 1775832955.252365 mapread 0x00141b thru 0x001e70 (0xa56 bytes) 000481 1775832955.260174 fallocate 0x029748 thru 0x02fd7d (0x6636 bytes) 000482 1775832955.280170 write 0x03e104 thru 0x03ffff (0x1efc bytes) 000483 1775832955.281431 trunc from 0x031666 to 0x032de3 (0x177e bytes) 000484 1775832955.286100 punch from 0x02e639 to 0x0352bb (0x6c83 bytes) 000485 1775832955.293195 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x98e7d82a (stale) Mirror 6: 0x98e7d82a (stale) Mirror 7: 0x98e7d82a (stale) Mirror 8: 0x98e7d82a (stale) Mirror 9: 0x98e7d82a (stale) Mirror 10: 0x98e7d82a (stale) Mirror 11: 0x98e7d82a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe7725968 Mirror 12: 0xe7725968 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000486 1775832955.937610 read 0x030af7 thru 0x03ffff (0xf509 bytes) 000487 1775832955.949336 trunc from 0x0274cf to 0x0332ff (0xbe31 bytes) 000488 1775832955.978534 mapwrite 0x0179f6 thru 0x019123 (0x172e bytes) 000489 1775832955.998217 mapread 0x0247ab thru 0x02dfee (0x9844 bytes) 000490 1775832956.016855 trunc from 0x023bf7 to 0x02cae6 (0x8ef0 bytes) 000491 1775832956.020894 read 0x022851 thru 0x0285b0 (0x5d60 bytes) 000492 1775832956.030811 write 0x03c10d thru 0x03ffff (0x3ef3 bytes) 000493 1775832956.034662 mapwrite 0x02b48f thru 0x0336ff (0x8271 bytes) 000494 1775832956.052927 fallocate 0x036fc3 thru 0x03ffff (0x903d bytes) 000495 1775832956.060721 trunc from 0x040000 to 0x012f8f (0x2d070 bytes) 000496 1775832956.087099 trunc from 0x011c85 to 0x012f8f (0x130b bytes) 000497 1775832956.091673 punch from 0x0108a6 to 0x012f8f (0x26ea bytes) 000500 1775832956.096242 write 0x01f11f thru 0x020106 (0xfe8 bytes) 000501 1775832956.097876 read 0x001075 thru 0x001b7a (0xb06 bytes) 000502 1775832956.098691 punch from 0x010a27 to 0x020106 (0xf6e0 bytes) 000503 1775832956.115051 MIRROR_RESYNC 9 mirrors 000504 1775832957.122273 trunc from 0x020107 to 0x026ab1 (0x69ab bytes) 000505 1775832957.163089 fallocate 0x03e35c thru 0x03ffff (0x1ca4 bytes) 000506 1775832957.166402 mapwrite 0x012aa4 thru 0x021e46 (0xf3a3 bytes) 000507 1775832957.198494 trunc from 0x00e63f to 0x0198f6 (0xb2b8 bytes) 000508 1775832957.201838 mapread 0x026641 thru 0x0267bc (0x17c bytes) 000509 1775832957.205599 trunc from 0x02536b to 0x026ab1 (0x1747 bytes) 000510 1775832957.208604 punch from 0x00782b to 0x013efa (0xc6d0 bytes) 000511 1775832957.211361 trunc from 0x026ab2 to 0x039b24 (0x13073 bytes) 000512 1775832957.224779 fallocate 0x0103b8 thru 0x01d60f (0xd258 bytes) 000513 1775832957.228512 write 0x008c68 thru 0x014be1 (0xbf7a bytes) 000514 1775832957.239234 mapwrite 0x02c250 thru 0x0355d0 (0x9381 bytes) 000515 1775832957.264524 mapwrite 0x0219c0 thru 0x02cf0b (0xb54c bytes) 000516 1775832957.288446 read 0x0261e3 thru 0x028493 (0x22b1 bytes) 000517 1775832957.289132 trunc from 0x039b25 to 0x00e7a4 (0x2b380 bytes) 000519 1775832957.302854 mapwrite 0x02438e thru 0x029178 (0x4deb bytes) 000520 1775832957.337607 mapread 0x008973 thru 0x00d3dd (0x4a6b bytes) 000521 1775832957.338698 punch from 0x020fff to 0x029178 (0x817a bytes) 000522 1775832957.342395 trunc from 0x0158ad to 0x01b5f5 (0x5d49 bytes) 000523 1775832957.347493 write 0x02a67d thru 0x038723 (0xe0a7 bytes) 000524 1775832957.349175 write 0x01b3fd thru 0x02126d (0x5e71 bytes) 000525 1775832957.355797 fallocate 0x03512f thru 0x039508 (0x43da bytes) 000526 1775832957.360112 read 0x01619d thru 0x0238dc (0xd740 bytes) 000527 1775832957.361096 mapwrite 0x036934 thru 0x03ca05 (0x60d2 bytes) 000529 1775832957.409531 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ca06): Mirror 3: 0x17c96fd8 (stale) Mirror 6: 0x17c96fd8 (stale) Mirror 7: 0x17c96fd8 (stale) Mirror 8: 0x17c96fd8 (stale) Mirror 9: 0x17c96fd8 (stale) Mirror 10: 0x17c96fd8 (stale) Mirror 12: 0x17c96fd8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ca06): Mirror 3: 0x17c96fd8 (stale) Mirror 6: 0x17c96fd8 (stale) Mirror 7: 0x17c96fd8 (stale) Mirror 8: 0x17c96fd8 (stale) Mirror 9: 0x17c96fd8 (stale) Mirror 10: 0x17c96fd8 (stale) Mirror 12: 0x17c96fd8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ca06: skipped 000530 1775832957.719380 mapwrite 0x0336b3 thru 0x03d62c (0x9f7a bytes) 000531 1775832957.782176 write 0x016985 thru 0x01a718 (0x3d94 bytes) 000533 1775832957.801665 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d62d): Mirror 3: 0x1846583b (stale) Mirror 6: 0x1846583b (stale) Mirror 8: 0x1846583b (stale) Mirror 9: 0x1846583b (stale) Mirror 10: 0x1846583b (stale) Mirror 12: 0x1846583b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d62d): Mirror 3: 0x1846583b (stale) Mirror 6: 0x1846583b (stale) Mirror 8: 0x1846583b (stale) Mirror 9: 0x1846583b (stale) Mirror 10: 0x1846583b (stale) Mirror 12: 0x1846583b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d62d: skipped 000534 1775832958.084405 write 0x03a8e5 thru 0x03ffff (0x571b bytes) 000535 1775832958.093323 fallocate 0x01c2bc thru 0x02c0bf (0xfe04 bytes) 000536 1775832958.098696 trunc from 0x040000 to 0x01e5f0 (0x21a0f bytes) 000537 1775832958.111854 punch from 0x01c5ae to 0x01e5f0 (0x2043 bytes) 000538 1775832958.118253 mapread 0x00504e thru 0x00c05f (0x7012 bytes) 000539 1775832958.133629 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1e5f1): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e5f1): Mirror 3: 0x3914939a (stale) Mirror 6: 0x3914939a (stale) Mirror 8: 0x3914939a (stale) Mirror 9: 0x3914939a (stale) Mirror 10: 0x3914939a (stale) Mirror 12: 0x3914939a (stale) CRC-32 checksum value for chunk [0, 0x1e5f1): Mirror 1: 0x8e24f6f6 Mirror 13: 0x8e24f6f6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e5f1: skipped 000540 1775832958.612771 punch from 0x016952 to 0x017282 (0x931 bytes) 000541 1775832958.637681 punch from 0x018b37 to 0x01ba9a (0x2f64 bytes) 000542 1775832958.642374 write 0x02c31c thru 0x02c380 (0x65 bytes) 000543 1775832958.648428 MIRROR_RESYNC 8 mirrors 000544 1775832960.009186 trunc from 0x02c381 to 0x02d4a3 (0x1123 bytes) 000545 1775832960.037168 MIRROR_RESYNC 8 mirrors 000546 1775832961.323855 mapwrite 0x01767f thru 0x0221c6 (0xab48 bytes) 000547 1775832961.380176 mapwrite 0x012c85 thru 0x019f38 (0x72b4 bytes) 000548 1775832961.393060 read 0x016af5 thru 0x01b74f (0x4c5b bytes) 000549 1775832961.393731 mapwrite 0x00a2fe thru 0x01341c (0x911f bytes) 000550 1775832961.413752 trunc from 0x02a773 to 0x02d4a3 (0x2d31 bytes) 000551 1775832961.420061 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2d4a4): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d4a4): Mirror 3: 0x54bd1d57 (stale) Mirror 6: 0x54bd1d57 (stale) Mirror 8: 0x54bd1d57 (stale) Mirror 9: 0x54bd1d57 (stale) Mirror 10: 0x54bd1d57 (stale) Mirror 12: 0x54bd1d57 (stale) Mirror 13: 0x54bd1d57 (stale) CRC-32 checksum value for chunk [0, 0x2d4a4): Mirror 1: 0xd132ad16 Mirror 14: 0xd132ad16 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d4a4: skipped 000552 1775832961.877797 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2d4a4): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d4a4): Mirror 3: 0x54bd1d57 (stale) Mirror 6: 0x54bd1d57 (stale) Mirror 8: 0x54bd1d57 (stale) Mirror 9: 0x54bd1d57 (stale) Mirror 10: 0x54bd1d57 (stale) Mirror 12: 0x54bd1d57 (stale) Mirror 13: 0x54bd1d57 (stale) CRC-32 checksum value for chunk [0, 0x2d4a4): Mirror 1: 0xd132ad16 Mirror 14: 0xd132ad16 Mirror 15: 0xd132ad16 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d4a4: skipped 000554 1775832962.339705 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2d4a4): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d4a4): Mirror 3: 0x54bd1d57 (stale) Mirror 6: 0x54bd1d57 (stale) Mirror 8: 0x54bd1d57 (stale) Mirror 9: 0x54bd1d57 (stale) Mirror 10: 0x54bd1d57 (stale) Mirror 12: 0x54bd1d57 (stale) Mirror 13: 0x54bd1d57 (stale) CRC-32 checksum value for chunk [0, 0x2d4a4): Mirror 1: 0xd132ad16 Mirror 14: 0xd132ad16 Mirror 15: 0xd132ad16 Mirror 16: 0xd132ad16 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d4a4: skipped 000555 1775832962.787192 trunc from 0x01ade7 to 0x023a27 (0x8c41 bytes) 000557 1775832962.808872 read 0x004b40 thru 0x00bbbe (0x707f bytes) 000558 1775832962.814627 fallocate 0x002425 thru 0x007f0e (0x5aea bytes) 000559 1775832962.819501 fallocate 0x037c87 thru 0x03ffff (0x8379 bytes) 000560 1775832962.822585 mapread 0x0021c7 thru 0x00633e (0x4178 bytes) 000562 1775832962.830008 trunc from 0x040000 to 0x00dd8e (0x32271 bytes) 000563 1775832962.851165 trunc from 0x00dd8f to 0x02f34e (0x215c0 bytes) 000564 1775832962.859523 read 0x02d4a3 thru 0x02f34e (0x1eac bytes) 000566 1775832962.865070 punch from 0x027ac1 to 0x02f34e (0x788e bytes) 000567 1775832962.867909 mapwrite 0x0165e2 thru 0x018374 (0x1d93 bytes) 000568 1775832962.875757 mapwrite 0x0272ba thru 0x032ab8 (0xb7ff bytes) 000569 1775832962.923826 trunc from 0x032ab9 to 0x0319ba (0x10fe bytes) 000570 1775832962.933526 mapwrite 0x01fb1f thru 0x02020c (0x6ee bytes) 000571 1775832962.944805 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x319bb): Mirror 3: 0x82880505 (stale) Mirror 6: 0x82880505 (stale) Mirror 8: 0x82880505 (stale) Mirror 9: 0x82880505 (stale) Mirror 10: 0x82880505 (stale) Mirror 12: 0x82880505 (stale) Mirror 13: 0x82880505 (stale) Mirror 14: 0x35be5b66 (stale) Mirror 16: 0x35be5b66 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x319bb): Mirror 3: 0x82880505 (stale) Mirror 6: 0x82880505 (stale) Mirror 8: 0x82880505 (stale) Mirror 9: 0x82880505 (stale) Mirror 10: 0x82880505 (stale) Mirror 12: 0x82880505 (stale) Mirror 13: 0x82880505 (stale) Mirror 14: 0x35be5b66 (stale) Mirror 16: 0x35be5b66 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x319bb: skipped 000572 1775832963.227102 trunc from 0x02ea01 to 0x0319ba (0x2fba bytes) 000573 1775832963.230832 fallocate 0x003b71 thru 0x01301a (0xf4aa bytes) 000574 1775832963.234908 trunc from 0x003168 to 0x005c0f (0x2aa8 bytes) 000575 1775832963.237739 mapread 0x02456a thru 0x02acad (0x6744 bytes) 000576 1775832963.257425 punch from 0x00f36f to 0x01c8b9 (0xd54b bytes) 000577 1775832963.262618 trunc from 0x0319bb to 0x005788 (0x2c232 bytes) 000578 1775832963.280273 MIRROR_RESYNC 10 mirrors 000579 1775832964.240809 mapwrite 0x033cb8 thru 0x037874 (0x3bbd bytes) 000580 1775832964.283909 write 0x00a602 thru 0x00d36a (0x2d69 bytes) 000582 1775832964.296314 read 0x006cf0 thru 0x015e13 (0xf124 bytes) 000583 1775832964.301825 read 0x029cc0 thru 0x02f011 (0x5352 bytes) 000584 1775832964.306503 fallocate 0x0392cf thru 0x03ffff (0x6d31 bytes) 000585 1775832964.309718 trunc from 0x015ba1 to 0x02068f (0xaaef bytes) 000586 1775832964.313909 fallocate 0x023fcb thru 0x027149 (0x317f bytes) 000587 1775832964.317416 mapread 0x02a2c1 thru 0x031b69 (0x78a9 bytes) 000588 1775832964.318382 trunc from 0x013a71 to 0x01c119 (0x86a9 bytes) 000589 1775832964.321248 fallocate 0x024894 thru 0x03275f (0xdecc bytes) 000591 1775832964.324715 trunc from 0x01fdac to 0x02217e (0x23d3 bytes) 000592 1775832964.328481 mapwrite 0x0362f3 thru 0x03ffff (0x9d0d bytes) 000593 1775832964.346949 fallocate 0x03afb1 thru 0x03ffff (0x504f bytes) 000594 1775832964.351537 write 0x008d2c thru 0x0138de (0xabb3 bytes) 000595 1775832964.354894 mapwrite 0x01fc84 thru 0x01fde8 (0x165 bytes) 000596 1775832964.367966 fallocate 0x01c63b thru 0x023753 (0x7119 bytes) 000597 1775832964.371542 trunc from 0x0257f5 to 0x027240 (0x1a4c bytes) 000598 1775832964.375513 punch from 0x023ef9 to 0x02990c (0x5a14 bytes) 000599 1775832964.378987 write 0x00ec66 thru 0x01037d (0x1718 bytes) 000600 1775832964.380717 trunc from 0x013bf0 to 0x0199a2 (0x5db3 bytes) 000601 1775832964.383618 trunc from 0x0154ea to 0x01da63 (0x857a bytes) 000603 1775832964.387174 mapwrite 0x039442 thru 0x03953f (0xfe bytes) 000605 1775832964.399585 punch from 0x02fb4c to 0x031c87 (0x213c bytes) 000606 1775832964.405188 mapwrite 0x0366f5 thru 0x03cb1a (0x6426 bytes) 000607 1775832964.423361 mapread 0x02380b thru 0x024825 (0x101b bytes) 000608 1775832964.431806 write 0x029917 thru 0x0377cd (0xdeb7 bytes) 000609 1775832964.439745 MIRROR_RESYNC 10 mirrors 000610 1775832966.332993 fallocate 0x02815d thru 0x02da88 (0x592c bytes) 000611 1775832966.351599 mapread 0x0079b5 thru 0x00cb0e (0x515a bytes) 000612 1775832966.367768 write 0x026a05 thru 0x035148 (0xe744 bytes) 000613 1775832966.380284 mapwrite 0x01d36e thru 0x022204 (0x4e97 bytes) 000614 1775832966.398269 read 0x03618a thru 0x03bd49 (0x5bc0 bytes) 000615 1775832966.404860 read 0x005843 thru 0x0152b6 (0xfa74 bytes) 000616 1775832966.410578 punch from 0x00d672 to 0x01c246 (0xebd5 bytes) 000617 1775832966.418530 trunc from 0x040000 to 0x0396e2 (0x691d bytes) 000620 1775832966.435850 mapwrite 0x01a75e thru 0x01cc5d (0x2500 bytes) 000621 1775832966.462660 punch from 0x023c1b to 0x024764 (0xb4a bytes) 000622 1775832966.467721 write 0x00fea3 thru 0x010249 (0x3a7 bytes) 000623 1775832966.474094 read 0x0276e8 thru 0x032433 (0xad4c bytes) 000624 1775832966.474886 fallocate 0x011772 thru 0x012f7a (0x1809 bytes) 000625 1775832966.479293 trunc from 0x0396e3 to 0x0062ed (0x333f5 bytes) 000626 1775832966.494880 mapread 0x002244 thru 0x0062ed (0x40aa bytes) 000627 1775832966.496084 read 0x004849 thru 0x0062ed (0x1aa5 bytes) 000628 1775832966.504326 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x62ee): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x62ee): Mirror 3: 0x1caa672d (stale) Mirror 6: 0x1caa672d (stale) Mirror 8: 0x1caa672d (stale) Mirror 9: 0x1caa672d (stale) Mirror 10: 0x1caa672d (stale) Mirror 12: 0x1caa672d (stale) Mirror 13: 0x1caa672d (stale) Mirror 14: 0x1caa672d (stale) Mirror 16: 0x1caa672d (stale) CRC-32 checksum value for chunk [0, 0x62ee): Mirror 1: 0x1caa672d Mirror 17: 0x1caa672d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x62ee: skipped 000629 1775832967.002250 mapread 0x005b57 thru 0x0062ed (0x797 bytes) 000630 1775832967.023978 write 0x001c8c thru 0x00ad95 (0x910a bytes) 000631 1775832967.057412 write 0x01bd59 thru 0x025a5b (0x9d03 bytes) 000632 1775832967.058906 punch from 0x02279a to 0x025a5b (0x32c2 bytes) 000633 1775832967.068716 mapread 0x00f97d thru 0x018cc9 (0x934d bytes) 000634 1775832967.077021 fallocate 0x033d29 thru 0x03fbe4 (0xbebc bytes) 000635 1775832967.086363 MIRROR_RESYNC 11 mirrors 000636 1775832968.629474 fallocate 0x03b7ae thru 0x03ffff (0x4852 bytes) 000637 1775832968.653515 trunc from 0x02ac14 to 0x035a7e (0xae6b bytes) 000638 1775832968.664296 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3fbe5): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fbe5): Mirror 3: 0x8faad0bc (stale) Mirror 6: 0x8faad0bc (stale) Mirror 8: 0x8faad0bc (stale) Mirror 9: 0x8faad0bc (stale) Mirror 10: 0x8faad0bc (stale) Mirror 12: 0x8faad0bc (stale) Mirror 13: 0x8faad0bc (stale) Mirror 14: 0x8faad0bc (stale) Mirror 16: 0x8faad0bc (stale) Mirror 17: 0x8faad0bc (stale) CRC-32 checksum value for chunk [0, 0x3fbe5): Mirror 1: 0x8faad0bc Mirror 18: 0x8faad0bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fbe5: skipped 000639 1775832969.347649 write 0x03a5e3 thru 0x03f45b (0x4e79 bytes) 000640 1775832969.379184 mapread 0x02b5b0 thru 0x038328 (0xcd79 bytes) 000641 1775832969.400456 read 0x024e7f thru 0x028e6d (0x3fef bytes) 000642 1775832969.402018 mapread 0x03ccba thru 0x03fbe4 (0x2f2b bytes) 000644 1775832969.403840 write 0x02aa58 thru 0x0352bf (0xa868 bytes) 000645 1775832969.405897 read 0x00c099 thru 0x0135f9 (0x7561 bytes) 000646 1775832969.413349 write 0x038b24 thru 0x03b818 (0x2cf5 bytes) 000647 1775832969.414509 punch from 0x00159f to 0x009fc8 (0x8a2a bytes) 000648 1775832969.420445 write 0x006911 thru 0x013422 (0xcb12 bytes) 000650 1775832969.428289 trunc from 0x03fbe5 to 0x01135d (0x2e887 bytes) 000651 1775832969.442103 punch from 0x00a934 to 0x00ca63 (0x2130 bytes) 000653 1775832969.454261 fallocate 0x03e8d5 thru 0x03ffff (0x172b bytes) 000654 1775832969.458606 read 0x008578 thru 0x00b72e (0x31b7 bytes) 000655 1775832969.471836 write 0x02afdc thru 0x02ea90 (0x3ab5 bytes) 000656 1775832969.478063 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2ea91): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ea91): Mirror 3: 0x9196bebb (stale) Mirror 6: 0x9196bebb (stale) Mirror 8: 0x9196bebb (stale) Mirror 9: 0x9196bebb (stale) Mirror 10: 0x9196bebb (stale) Mirror 12: 0x9196bebb (stale) Mirror 13: 0x9196bebb (stale) Mirror 14: 0x9196bebb (stale) Mirror 16: 0x9196bebb (stale) Mirror 17: 0x9196bebb (stale) Mirror 18: 0x9196bebb (stale) CRC-32 checksum value for chunk [0, 0x2ea91): Mirror 1: 0x256fa3e5 Mirror 19: 0x256fa3e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ea91: skipped 000657 1775832970.160344 trunc from 0x02ea91 to 0x013d34 (0x1ad5c bytes) 000659 1775832970.237306 mapwrite 0x01bb59 thru 0x01cd43 (0x11eb bytes) 000660 1775832970.268129 write 0x01af82 thru 0x01db54 (0x2bd3 bytes) 000662 1775832970.276246 trunc from 0x01db55 to 0x020916 (0x2dc2 bytes) 000663 1775832970.286913 trunc from 0x019cb9 to 0x020916 (0x6c5e bytes) 000664 1775832970.301597 mapread 0x009d65 thru 0x0113ee (0x768a bytes) 000665 1775832970.312105 fallocate 0x00c819 thru 0x01b65e (0xee46 bytes) 000666 1775832970.317970 read 0x01e4cd thru 0x020916 (0x244a bytes) 000667 1775832970.326018 mapread 0x01a862 thru 0x020916 (0x60b5 bytes) 000668 1775832970.334540 trunc from 0x0161b7 to 0x01fc4d (0x9a97 bytes) 000669 1775832970.339036 mapwrite 0x015381 thru 0x0215e3 (0xc263 bytes) 000670 1775832970.391176 mapread 0x014ae4 thru 0x0193ba (0x48d7 bytes) 000672 1775832970.394528 write 0x002cdc thru 0x00dcab (0xafd0 bytes) 000673 1775832970.401673 MIRROR_RESYNC 13 mirrors 000674 1775832971.567439 read 0x001d5d thru 0x005d6b (0x400f bytes) 000675 1775832971.573947 read 0x00168c thru 0x005f0b (0x4880 bytes) 000676 1775832971.574331 punch from 0x00b797 to 0x017ca9 (0xc513 bytes) 000678 1775832971.602749 punch from 0x007ea9 to 0x0121bb (0xa313 bytes) 000679 1775832971.607265 mapread 0x00fc09 thru 0x0118f6 (0x1cee bytes) 000680 1775832971.616267 fallocate 0x02bbff thru 0x02c396 (0x798 bytes) 000681 1775832971.620339 mapread 0x026e64 thru 0x02c396 (0x5533 bytes) 000682 1775832971.628223 mapread 0x00a19f thru 0x00c824 (0x2686 bytes) 000683 1775832971.629266 fallocate 0x01bd81 thru 0x021b16 (0x5d96 bytes) 000684 1775832971.634197 mapwrite 0x018a92 thru 0x0198f6 (0xe65 bytes) 000686 1775832971.649606 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2c397): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c397): Mirror 3: 0x52c14bc (stale) Mirror 6: 0x52c14bc (stale) Mirror 8: 0x52c14bc (stale) Mirror 9: 0x52c14bc (stale) Mirror 10: 0x52c14bc (stale) Mirror 12: 0x52c14bc (stale) Mirror 13: 0x52c14bc (stale) Mirror 14: 0x52c14bc (stale) Mirror 16: 0x52c14bc (stale) Mirror 17: 0x52c14bc (stale) Mirror 18: 0x52c14bc (stale) Mirror 19: 0x52c14bc (stale) CRC-32 checksum value for chunk [0, 0x2c397): Mirror 1: 0xe5046789 Mirror 20: 0xe5046789 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c397: skipped 000687 1775832972.229619 mapread 0x01980b thru 0x01db11 (0x4307 bytes) 000688 1775832972.259333 trunc from 0x01ce20 to 0x01e3c3 (0x15a4 bytes) 000689 1775832972.289009 mapwrite 0x00d86d thru 0x016d7f (0x9513 bytes) 000690 1775832972.315619 trunc from 0x02b192 to 0x02c396 (0x1205 bytes) 000691 1775832972.318624 punch from 0x025e35 to 0x02c396 (0x6562 bytes) 000692 1775832972.321479 mapwrite 0x031fcb thru 0x035e2b (0x3e61 bytes) 000693 1775832972.361740 mapwrite 0x013254 thru 0x0155b8 (0x2365 bytes) 000694 1775832972.373472 mapread 0x0022e6 thru 0x0043dc (0x20f7 bytes) 000695 1775832972.382403 fallocate 0x00f457 thru 0x014174 (0x4d1e bytes) 000696 1775832972.386506 write 0x028292 thru 0x02ff62 (0x7cd1 bytes) 000697 1775832972.396043 read 0x01054d thru 0x011155 (0xc09 bytes) 000698 1775832972.396971 write 0x00692c thru 0x01095a (0xa02f bytes) 000699 1775832972.398286 fallocate 0x015425 thru 0x01cce0 (0x78bc bytes) 000700 1775832972.402685 trunc from 0x035e2c to 0x029551 (0xc8da bytes) 000701 1775832972.411936 fallocate 0x03a263 thru 0x03ffff (0x5d9d bytes) 000702 1775832972.415513 trunc from 0x016a75 to 0x0209c5 (0x9f51 bytes) 000703 1775832972.419153 trunc from 0x00f229 to 0x0143a7 (0x517f bytes) 000704 1775832972.428084 trunc from 0x040000 to 0x0355f1 (0xaa0e bytes) 000706 1775832972.441145 trunc from 0x0355f2 to 0x01d956 (0x17c9b bytes) 000707 1775832972.449555 fallocate 0x012de6 thru 0x01a2f1 (0x750c bytes) 000708 1775832972.453076 write 0x02d069 thru 0x0379d8 (0xa970 bytes) 000709 1775832972.454320 mapwrite 0x00caf3 thru 0x014ef0 (0x83fe bytes) 000710 1775832972.475501 punch from 0x013f2c to 0x01813b (0x4210 bytes) 000711 1775832972.479057 punch from 0x01b46d to 0x021e0d (0x69a1 bytes) 000712 1775832972.484920 read 0x0210fe thru 0x0284d5 (0x73d8 bytes) 000713 1775832972.493796 trunc from 0x0379d9 to 0x00f895 (0x28143 bytes) 000714 1775832972.505370 punch from 0x007396 to 0x00f895 (0x8500 bytes) 000715 1775832972.509053 mapread 0x00b2e7 thru 0x00f798 (0x44b2 bytes) 000716 1775832972.535831 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0xf896): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf896): Mirror 3: 0xee4614f8 (stale) Mirror 6: 0xee4614f8 (stale) Mirror 8: 0xee4614f8 (stale) Mirror 9: 0xee4614f8 (stale) Mirror 10: 0xee4614f8 (stale) Mirror 12: 0xee4614f8 (stale) Mirror 13: 0xee4614f8 (stale) Mirror 14: 0xee4614f8 (stale) Mirror 16: 0xee4614f8 (stale) Mirror 17: 0xee4614f8 (stale) Mirror 18: 0xee4614f8 (stale) Mirror 19: 0xee4614f8 (stale) Mirror 20: 0x46793ae6 (stale) CRC-32 checksum value for chunk [0, 0xf896): Mirror 1: 0x48c4124e Mirror 21: 0x48c4124e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf896: skipped 000717 1775832973.064383 trunc from 0x00f896 to 0x0245d7 (0x14d42 bytes) 000718 1775832973.108949 fallocate 0x038d7c thru 0x03ffff (0x7284 bytes) 000719 1775832973.114022 trunc from 0x01a31d to 0x024dd3 (0xaab7 bytes) 000720 1775832973.117991 punch from 0x012920 to 0x0194db (0x6bbc bytes) 000721 1775832973.121484 mapwrite 0x02f33d thru 0x0322b5 (0x2f79 bytes) 000722 1775832973.142254 trunc from 0x0349eb to 0x038ceb (0x4301 bytes) 000723 1775832973.149781 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe949466d (stale) Mirror 6: 0xe949466d (stale) Mirror 8: 0xe949466d (stale) Mirror 9: 0xe949466d (stale) Mirror 10: 0xe949466d (stale) Mirror 12: 0xe949466d (stale) Mirror 13: 0xe949466d (stale) Mirror 14: 0xe949466d (stale) Mirror 16: 0xe949466d (stale) Mirror 17: 0xe949466d (stale) Mirror 18: 0xe949466d (stale) Mirror 19: 0xe949466d (stale) Mirror 20: 0x2f2e7c6a (stale) Mirror 21: 0x9b91b93f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8176d4af Mirror 22: 0x8176d4af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000725 1775832973.717067 trunc from 0x040000 to 0x011a75 (0x2e58a bytes) 000726 1775832973.762527 punch from 0x003167 to 0x010c13 (0xdaad bytes) 000727 1775832973.767641 mapwrite 0x0325b2 thru 0x03d077 (0xaac6 bytes) 000728 1775832973.810307 mapread 0x0049d4 thru 0x012680 (0xdcad bytes) 000729 1775832973.824180 mapread 0x025e28 thru 0x030fbd (0xb196 bytes) 000730 1775832973.831855 write 0x0148d3 thru 0x0183fe (0x3b2c bytes) 000731 1775832973.832864 mapwrite 0x0293cc thru 0x038b21 (0xf756 bytes) 000734 1775832973.849351 fallocate 0x0254b2 thru 0x02fa1a (0xa569 bytes) 000735 1775832973.852877 read 0x026598 thru 0x02c567 (0x5fd0 bytes) 000736 1775832973.853545 punch from 0x027212 to 0x034e29 (0xdc18 bytes) 000737 1775832973.856947 trunc from 0x03d078 to 0x01c4c8 (0x20baf bytes) 000738 1775832973.868498 mapwrite 0x0081fe thru 0x00ef8a (0x6d8d bytes) 000739 1775832973.880995 fallocate 0x0322c5 thru 0x035b6a (0x38a6 bytes) 000742 1775832973.890522 mapwrite 0x03098d thru 0x03ebf7 (0xe26b bytes) 000743 1775832973.940712 fallocate 0x01010f thru 0x014cee (0x4be0 bytes) 000744 1775832973.944185 mapread 0x00c51a thru 0x0193ea (0xced1 bytes) 000745 1775832973.945388 punch from 0x01d56a to 0x028c7e (0xb715 bytes) 000747 1775832973.948731 read 0x024ae9 thru 0x03151e (0xca36 bytes) 000748 1775832973.955798 mapwrite 0x027a61 thru 0x02ab58 (0x30f8 bytes) 000749 1775832973.975911 trunc from 0x01d6c4 to 0x02bcd1 (0xe60e bytes) 000750 1775832973.980684 fallocate 0x02739f thru 0x02c781 (0x53e3 bytes) 000751 1775832973.987208 trunc from 0x02db47 to 0x0373a6 (0x9860 bytes) 000752 1775832973.993523 fallocate 0x035f98 thru 0x03c3c1 (0x642a bytes) 000754 1775832973.998813 trunc from 0x032b54 to 0x038ce7 (0x6194 bytes) 000756 1775832974.003992 write 0x02c135 thru 0x02c3b6 (0x282 bytes) 000758 1775832974.006623 write 0x01dea6 thru 0x021891 (0x39ec bytes) 000759 1775832974.018058 MIRROR_RESYNC 16 mirrors 000760 1775832977.076526 MIRROR_RESYNC 16 mirrors 000761 1775832977.523598 fallocate 0x00f5a2 thru 0x019695 (0xa0f4 bytes) 000762 1775832977.561412 punch from 0x01c3fd to 0x01e019 (0x1c1d bytes) 000763 1775832977.567432 write 0x03c4b5 thru 0x03e12d (0x1c79 bytes) 000764 1775832977.582724 fallocate 0x02f815 thru 0x03f340 (0xfb2c bytes) 000765 1775832977.587215 mapread 0x017afd thru 0x020bba (0x90be bytes) 000766 1775832977.601724 write 0x002702 thru 0x005537 (0x2e36 bytes) 000767 1775832977.609487 mapread 0x03cd6b thru 0x03ebf7 (0x1e8d bytes) 000768 1775832977.610516 trunc from 0x03aaa2 to 0x03ebf7 (0x4156 bytes) 000769 1775832977.631742 MIRROR_RESYNC 16 mirrors 000770 1775832981.314088 mapwrite 0x02f328 thru 0x03edb7 (0xfa90 bytes) 000771 1775832981.391617 fallocate 0x01d82f thru 0x025d82 (0x8554 bytes) 000774 1775832981.397471 mapread 0x03cec3 thru 0x03ec4e (0x1d8c bytes) 000775 1775832981.398653 punch from 0x008eb8 to 0x015e7f (0xcfc8 bytes) 000776 1775832981.405437 mapread 0x006fc4 thru 0x00fe73 (0x8eb0 bytes) 000777 1775832981.417201 trunc from 0x0038db to 0x00d348 (0x9a6e bytes) 000778 1775832981.422587 trunc from 0x037ea2 to 0x03edb7 (0x6f16 bytes) 000779 1775832981.426013 write 0x011fce thru 0x015e11 (0x3e44 bytes) 000780 1775832981.436634 mapwrite 0x0077ac thru 0x013533 (0xbd88 bytes) 000782 1775832981.462720 read 0x01b4ce thru 0x01d1b4 (0x1ce7 bytes) 000783 1775832981.469352 trunc from 0x006677 to 0x0076b2 (0x103c bytes) 000784 1775832981.474399 punch from 0x03b1f0 to 0x03edb7 (0x3bc8 bytes) 000786 1775832981.482108 MIRROR_SPLIT mirror 1 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3edb8): Mirror 6: 0x34692882 (stale) Mirror 8: 0x34692882 (stale) Mirror 9: 0x34692882 (stale) Mirror 10: 0x34692882 (stale) Mirror 12: 0x34692882 (stale) Mirror 13: 0x34692882 (stale) Mirror 14: 0x34692882 (stale) Mirror 16: 0x34692882 (stale) Mirror 17: 0x34692882 (stale) Mirror 18: 0x34692882 (stale) Mirror 19: 0x34692882 (stale) Mirror 20: 0x34692882 (stale) Mirror 21: 0x34692882 (stale) Mirror 22: 0x34692882 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3edb8): Mirror 6: 0x34692882 (stale) Mirror 8: 0x34692882 (stale) Mirror 9: 0x34692882 (stale) Mirror 10: 0x34692882 (stale) Mirror 12: 0x34692882 (stale) Mirror 13: 0x34692882 (stale) Mirror 14: 0x34692882 (stale) Mirror 16: 0x34692882 (stale) Mirror 17: 0x34692882 (stale) Mirror 18: 0x34692882 (stale) Mirror 19: 0x34692882 (stale) Mirror 20: 0x34692882 (stale) Mirror 21: 0x34692882 (stale) Mirror 22: 0x34692882 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3edb8: skipped 000787 1775832981.978328 fallocate 0x0001ce thru 0x003b24 (0x3957 bytes) 000788 1775832981.983480 mapread 0x005c0a thru 0x007b20 (0x1f17 bytes) 000789 1775832982.011867 write 0x008502 thru 0x00dcb1 (0x57b0 bytes) 000791 1775832982.021514 mapread 0x004cbc thru 0x009e7c (0x51c1 bytes) 000792 1775832982.024103 read 0x01a8da thru 0x0237c5 (0x8eec bytes) 000793 1775832982.032381 punch from 0x025129 to 0x02c88a (0x7762 bytes) 000794 1775832982.036008 mapwrite 0x0322ef thru 0x037733 (0x5445 bytes) 000795 1775832982.061796 read 0x031731 thru 0x035028 (0x38f8 bytes) 000796 1775832982.065838 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x3edb8): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3edb8): Mirror 6: 0x34692882 (stale) Mirror 8: 0x34692882 (stale) Mirror 9: 0x34692882 (stale) Mirror 10: 0x34692882 (stale) Mirror 12: 0x34692882 (stale) Mirror 13: 0x34692882 (stale) Mirror 14: 0x34692882 (stale) Mirror 16: 0x34692882 (stale) Mirror 17: 0x34692882 (stale) Mirror 18: 0x34692882 (stale) Mirror 19: 0x34692882 (stale) Mirror 20: 0x34692882 (stale) Mirror 21: 0x34692882 (stale) Mirror 22: 0x34692882 (stale) CRC-32 checksum value for chunk [0, 0x3edb8): Mirror 1: 0x306258fe Mirror 23: 0x306258fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3edb8: skipped 000797 1775832982.815586 fallocate 0x026743 thru 0x03552e (0xedec bytes) 000798 1775832982.850009 read 0x009951 thru 0x0179ad (0xe05d bytes) 000799 1775832982.863765 write 0x005ff4 thru 0x010c6b (0xac78 bytes) 000802 1775832982.874589 mapread 0x00ac82 thru 0x01a26c (0xf5eb bytes) 000804 1775832982.891956 read 0x03c1ed thru 0x03edb7 (0x2bcb bytes) 000805 1775832982.903917 MIRROR_RESYNC 16 mirrors 000806 1775832985.476525 fallocate 0x029663 thru 0x02f82a (0x61c8 bytes) 000807 1775832985.506020 punch from 0x02fc42 to 0x03eaad (0xee6c bytes) 000809 1775832985.511355 mapwrite 0x017da3 thru 0x019aba (0x1d18 bytes) 000810 1775832985.537367 trunc from 0x03edb8 to 0x01d999 (0x2141e bytes) 000812 1775832985.556454 write 0x009588 thru 0x014a31 (0xb4aa bytes) 000813 1775832985.565850 trunc from 0x01d99a to 0x01b7bc (0x21dd bytes) 000814 1775832985.575877 trunc from 0x01b7bd to 0x01eef5 (0x3739 bytes) 000816 1775832985.588891 trunc from 0x01eef6 to 0x026d17 (0x7e22 bytes) 000817 1775832985.601306 read 0x0071b6 thru 0x017019 (0xfe64 bytes) 000818 1775832985.602056 trunc from 0x02285d to 0x026d17 (0x44bb bytes) 000819 1775832985.605017 read 0x003098 thru 0x00de6f (0xadd8 bytes) 000820 1775832985.605765 mapread 0x00ed34 thru 0x014f1e (0x61eb bytes) 000821 1775832985.606833 mapwrite 0x039a1d thru 0x03d4ef (0x3ad3 bytes) 000822 1775832985.639133 read 0x02beb2 thru 0x032125 (0x6274 bytes) 000823 1775832985.639767 trunc from 0x03d4f0 to 0x00a6bd (0x32e32 bytes) 000824 1775832985.652291 trunc from 0x00590c to 0x00a0d3 (0x47c8 bytes) 000825 1775832985.659131 write 0x02066c thru 0x021fd1 (0x1966 bytes) 000826 1775832985.665486 MIRROR_RESYNC 16 mirrors 000827 1775832987.487976 mapread 0x00847a thru 0x00c62b (0x41b2 bytes) 000828 1775832987.503463 MIRROR_SPLIT mirror 3 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) 000829 1775832987.817281 mapread 0x012c1c thru 0x0218bc (0xeca1 bytes) 000831 1775832987.840537 write 0x027613 thru 0x03410a (0xcaf8 bytes) 000832 1775832987.871907 read 0x016db6 thru 0x01abf4 (0x3e3f bytes) 000834 1775832987.880780 mapwrite 0x038bd8 thru 0x03ffff (0x7428 bytes) 000835 1775832987.913800 mapread 0x0380be thru 0x03ffff (0x7f42 bytes) 000836 1775832987.914975 trunc from 0x01adbf to 0x022b6c (0x7dae bytes) 000837 1775832987.919765 mapwrite 0x029c00 thru 0x0378fa (0xdcfb bytes) 000838 1775832987.937783 mapwrite 0x0121fc thru 0x01f642 (0xd447 bytes) 000839 1775832987.961986 trunc from 0x040000 to 0x038530 (0x7acf bytes) 000840 1775832987.972117 mapread 0x01697e thru 0x0174f9 (0xb7c bytes) 000841 1775832987.973001 trunc from 0x038531 to 0x006641 (0x31eef bytes) 000842 1775832987.989048 fallocate 0x0224c6 thru 0x025906 (0x3441 bytes) 000843 1775832987.995110 MIRROR_RESYNC 15 mirrors 000844 1775832989.237629 write 0x01b890 thru 0x01ef2b (0x369c bytes) 000845 1775832989.269266 write 0x0228e4 thru 0x025a52 (0x316f bytes) 000846 1775832989.276003 read 0x01c926 thru 0x025a52 (0x912d bytes) 000847 1775832989.276808 trunc from 0x025a53 to 0x036cd6 (0x11284 bytes) 000848 1775832989.286588 mapwrite 0x03125e thru 0x032b2c (0x18cf bytes) 000849 1775832989.300743 punch from 0x00ac61 to 0x00e59b (0x393b bytes) 000850 1775832989.303026 trunc from 0x016130 to 0x0236e1 (0xd5b2 bytes) 000851 1775832989.306036 trunc from 0x006c6e to 0x0117e6 (0xab79 bytes) 000852 1775832989.308753 trunc from 0x036cd7 to 0x022771 (0x14565 bytes) 000853 1775832989.319103 mapwrite 0x02a767 thru 0x032d0c (0x85a6 bytes) 000854 1775832989.350299 fallocate 0x0014d7 thru 0x00c96b (0xb495 bytes) 000856 1775832989.354171 fallocate 0x021a17 thru 0x022205 (0x7ef bytes) 000857 1775832989.362787 MIRROR_SPLIT mirror 7 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32d0d): Mirror 6: 0x7b07d5ef (stale) Mirror 8: 0x7b07d5ef (stale) Mirror 10: 0x7b07d5ef (stale) Mirror 12: 0x7b07d5ef (stale) Mirror 13: 0x7b07d5ef (stale) Mirror 14: 0x7b07d5ef (stale) Mirror 17: 0x7b07d5ef (stale) Mirror 18: 0x7b07d5ef (stale) Mirror 19: 0x7b07d5ef (stale) Mirror 20: 0x7b07d5ef (stale) Mirror 21: 0x7b07d5ef (stale) Mirror 22: 0x7b07d5ef (stale) Mirror 23: 0x7b07d5ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32d0d): Mirror 6: 0x7b07d5ef (stale) Mirror 8: 0x7b07d5ef (stale) Mirror 10: 0x7b07d5ef (stale) Mirror 12: 0x7b07d5ef (stale) Mirror 13: 0x7b07d5ef (stale) Mirror 14: 0x7b07d5ef (stale) Mirror 17: 0x7b07d5ef (stale) Mirror 18: 0x7b07d5ef (stale) Mirror 19: 0x7b07d5ef (stale) Mirror 20: 0x7b07d5ef (stale) Mirror 21: 0x7b07d5ef (stale) Mirror 22: 0x7b07d5ef (stale) Mirror 23: 0x7b07d5ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32d0d: skipped 000858 1775832989.753118 punch from 0x002cce to 0x003894 (0xbc7 bytes) 000859 1775832989.756863 fallocate 0x034bed thru 0x03ffff (0xb413 bytes) 000861 1775832989.761219 fallocate 0x014f6b thru 0x01f6f9 (0xa78f bytes) 000862 1775832989.765294 trunc from 0x024eb7 to 0x02e029 (0x9173 bytes) 000863 1775832989.769784 punch from 0x02aed5 to 0x032d0c (0x7e38 bytes) 000864 1775832989.777010 MIRROR_RESYNC 14 mirrors 000866 1775832990.999890 fallocate 0x037eb5 thru 0x03ffff (0x814b bytes) 000867 1775832991.017346 trunc from 0x000f01 to 0x00a06a (0x916a bytes) 000868 1775832991.020705 mapwrite 0x03c946 thru 0x03ffff (0x36ba bytes) 000869 1775832991.060764 punch from 0x00b26e to 0x0171bf (0xbf52 bytes) 000870 1775832991.064073 trunc from 0x010a0b to 0x02027b (0xf871 bytes) 000871 1775832991.068032 trunc from 0x040000 to 0x03f756 (0x8a9 bytes) 000872 1775832991.082203 fallocate 0x02c0b7 thru 0x02d393 (0x12dd bytes) 000873 1775832991.087323 mapread 0x01f6d1 thru 0x029df1 (0xa721 bytes) 000874 1775832991.100330 write 0x005ef8 thru 0x0065c6 (0x6cf bytes) 000875 1775832991.110467 punch from 0x022515 to 0x028699 (0x6185 bytes) 000876 1775832991.113829 punch from 0x01ad12 to 0x0222a7 (0x7596 bytes) 000877 1775832991.117555 punch from 0x018b01 to 0x01ee04 (0x6304 bytes) 000878 1775832991.120695 mapwrite 0x02b6e0 thru 0x02ccca (0x15eb bytes) 000879 1775832991.131963 punch from 0x023acb to 0x0327c4 (0xecfa bytes) 000880 1775832991.135250 trunc from 0x027400 to 0x033336 (0xbf37 bytes) 000881 1775832991.139360 fallocate 0x03c359 thru 0x03ffff (0x3ca7 bytes) 000882 1775832991.142399 punch from 0x03776b to 0x03f756 (0x7fec bytes) 000883 1775832991.146211 write 0x01d55a thru 0x01daa8 (0x54f bytes) 000884 1775832991.155987 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3f757): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f757): Mirror 6: 0xa63a3152 (stale) Mirror 8: 0xa63a3152 (stale) Mirror 10: 0xa63a3152 (stale) Mirror 12: 0xa63a3152 (stale) Mirror 13: 0xa63a3152 (stale) Mirror 14: 0xa63a3152 (stale) Mirror 17: 0xa63a3152 (stale) Mirror 18: 0xa63a3152 (stale) Mirror 19: 0xa63a3152 (stale) Mirror 20: 0xa63a3152 (stale) Mirror 21: 0xa63a3152 (stale) Mirror 22: 0xa63a3152 (stale) Mirror 23: 0xa63a3152 (stale) CRC-32 checksum value for chunk [0, 0x3f757): Mirror 1: 0xfbf2b87d Mirror 24: 0xfbf2b87d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f757: skipped 000885 1775832991.745926 trunc from 0x03f757 to 0x03d7ab (0x1fab bytes) 000886 1775832991.792783 fallocate 0x02aeba thru 0x02cc6d (0x1db4 bytes) 000887 1775832991.797092 punch from 0x03281b to 0x032ae5 (0x2cb bytes) 000888 1775832991.803231 trunc from 0x01d3a2 to 0x029d4b (0xc9aa bytes) 000889 1775832991.809481 trunc from 0x03d7ac to 0x023d32 (0x19a79 bytes) 000890 1775832991.827866 punch from 0x021d44 to 0x023d32 (0x1fef bytes) 000891 1775832991.831090 fallocate 0x027fa1 thru 0x03411b (0xc17b bytes) 000892 1775832991.834175 punch from 0x007a64 to 0x010550 (0x8aed bytes) 000893 1775832991.840841 trunc from 0x021697 to 0x023d32 (0x269c bytes) 000894 1775832991.848930 MIRROR_RESYNC 15 mirrors 000897 1775832993.533052 mapwrite 0x009f6a thru 0x00cae2 (0x2b79 bytes) 000898 1775832993.597280 MIRROR_RESYNC 15 mirrors 000899 1775832995.733630 write 0x00f720 thru 0x018aba (0x939b bytes) 000900 1775832995.771943 write 0x02ded1 thru 0x036b4a (0x8c7a bytes) 000901 1775832995.781228 MIRROR_RESYNC 15 mirrors 000902 1775832998.237343 punch from 0x00d2a4 to 0x012804 (0x5561 bytes) 000903 1775832998.255911 write 0x02cd41 thru 0x034de3 (0x80a3 bytes) 000904 1775832998.263031 trunc from 0x0021a6 to 0x0029ae (0x809 bytes) 000905 1775832998.266451 trunc from 0x0214ea to 0x024d00 (0x3817 bytes) 000906 1775832998.270064 trunc from 0x0304d8 to 0x036b4a (0x6673 bytes) 000907 1775832998.279632 write 0x03a7d9 thru 0x03ffff (0x5827 bytes) 000908 1775832998.280644 trunc from 0x006d82 to 0x01420f (0xd48e bytes) 000909 1775832998.284128 trunc from 0x007db0 to 0x00c615 (0x4866 bytes) 000910 1775832998.287748 read 0x03802d thru 0x03ffff (0x7fd3 bytes) 000913 1775832998.291463 write 0x022cd4 thru 0x026b2b (0x3e58 bytes) 000914 1775832998.303035 mapwrite 0x011dd6 thru 0x0193e2 (0x760d bytes) 000915 1775832998.328856 mapwrite 0x018e7b thru 0x026311 (0xd497 bytes) 000917 1775832998.351699 punch from 0x01e999 to 0x029f59 (0xb5c1 bytes) 000918 1775832998.355527 mapread 0x00f87a thru 0x014809 (0x4f90 bytes) 000919 1775832998.356748 write 0x016fe6 thru 0x0266c0 (0xf6db bytes) 000920 1775832998.362423 write 0x01c99d thru 0x024841 (0x7ea5 bytes) 000921 1775832998.363675 write 0x03f34b thru 0x03ffff (0xcb5 bytes) 000922 1775832998.364512 read 0x02d638 thru 0x030433 (0x2dfc bytes) 000923 1775832998.369422 trunc from 0x040000 to 0x0144a8 (0x2bb57 bytes) 000924 1775832998.380380 write 0x011d27 thru 0x011e85 (0x15f bytes) 000925 1775832998.381375 read 0x006396 thru 0x00d4eb (0x7156 bytes) 000926 1775832998.381945 mapwrite 0x022f60 thru 0x0308c3 (0xd964 bytes) 000927 1775832998.412519 mapread 0x02f032 thru 0x0308c3 (0x1892 bytes) 000928 1775832998.413537 mapwrite 0x03b81b thru 0x03ffff (0x47e5 bytes) 000929 1775832998.449621 fallocate 0x01ed9c thru 0x024151 (0x53b6 bytes) 000930 1775832998.453223 read 0x019b94 thru 0x02618d (0xc5fa bytes) 000931 1775832998.453932 mapread 0x01b0c6 thru 0x027c75 (0xcbb0 bytes) 000932 1775832998.454942 mapwrite 0x00bea1 thru 0x011740 (0x58a0 bytes) 000933 1775832998.465824 write 0x02aea4 thru 0x034f77 (0xa0d4 bytes) 000934 1775832998.467136 trunc from 0x004a86 to 0x013c41 (0xf1bc bytes) 000935 1775832998.471094 punch from 0x00a611 to 0x01004b (0x5a3b bytes) 000936 1775832998.477200 mapwrite 0x00a336 thru 0x01451b (0xa1e6 bytes) 000937 1775832998.495485 write 0x026606 thru 0x02c261 (0x5c5c bytes) 000938 1775832998.499022 MIRROR_RESYNC 15 mirrors 000939 1775833000.416898 fallocate 0x0091fb thru 0x0156ea (0xc4f0 bytes) 000940 1775833000.439489 trunc from 0x040000 to 0x00cb56 (0x334a9 bytes) 000941 1775833000.452435 mapwrite 0x034e2d thru 0x03ffff (0xb1d3 bytes) 000942 1775833000.504363 trunc from 0x000b26 to 0x001342 (0x81d bytes) 000943 1775833000.509657 trunc from 0x040000 to 0x017365 (0x28c9a bytes) 000944 1775833000.522892 punch from 0x0168ea to 0x017365 (0xa7c bytes) 000945 1775833000.528417 punch from 0x005aa2 to 0x00ba36 (0x5f95 bytes) 000946 1775833000.532486 mapread 0x015af0 thru 0x017365 (0x1876 bytes) 000947 1775833000.542762 fallocate 0x000499 thru 0x00bcbf (0xb827 bytes) 000948 1775833000.547445 punch from 0x00435f to 0x007d4d (0x39ef bytes) 000950 1775833000.555663 trunc from 0x008f69 to 0x012581 (0x9619 bytes) 000951 1775833000.563450 mapwrite 0x0136d0 thru 0x020739 (0xd06a bytes) 000952 1775833000.613606 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x2073a): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2073a): Mirror 6: 0xd9667135 (stale) Mirror 8: 0xd9667135 (stale) Mirror 10: 0xd9667135 (stale) Mirror 12: 0xd9667135 (stale) Mirror 13: 0xd9667135 (stale) Mirror 14: 0xd9667135 (stale) Mirror 17: 0xd9667135 (stale) Mirror 18: 0xd9667135 (stale) Mirror 19: 0xd9667135 (stale) Mirror 20: 0xd9667135 (stale) Mirror 21: 0xd9667135 (stale) Mirror 22: 0xd9667135 (stale) Mirror 23: 0xd9667135 (stale) Mirror 24: 0xd9667135 (stale) CRC-32 checksum value for chunk [0, 0x2073a): Mirror 1: 0x3a3c4abe Mirror 25: 0x3a3c4abe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2073a: skipped 000953 1775833001.304856 trunc from 0x02073a to 0x037b3f (0x17406 bytes) 000954 1775833001.374069 fallocate 0x019576 thru 0x01a1a7 (0xc32 bytes) 000955 1775833001.379214 fallocate 0x02a88c thru 0x03761f (0xcd94 bytes) 000956 1775833001.384258 mapwrite 0x0163f6 thru 0x01ae98 (0x4aa3 bytes) 000957 1775833001.424664 mapwrite 0x01da6a thru 0x01dc74 (0x20b bytes) 000958 1775833001.437303 write 0x004e8b thru 0x0107e9 (0xb95f bytes) 000959 1775833001.448078 trunc from 0x00dc33 to 0x01cc57 (0xf025 bytes) 000961 1775833001.465904 mapread 0x01924a thru 0x01cf84 (0x3d3b bytes) 000962 1775833001.478188 MIRROR_RESYNC 16 mirrors 000963 1775833003.657468 mapread 0x025902 thru 0x0313c8 (0xbac7 bytes) 000964 1775833003.677041 trunc from 0x032d79 to 0x037b3f (0x4dc7 bytes) 000965 1775833003.707844 write 0x00d5fe thru 0x0169e9 (0x93ec bytes) 000966 1775833003.716739 read 0x029f34 thru 0x037b3f (0xdc0c bytes) 000967 1775833003.725675 trunc from 0x020f49 to 0x025566 (0x461e bytes) 000968 1775833003.729491 write 0x0276a2 thru 0x027da9 (0x708 bytes) 000969 1775833003.736173 trunc from 0x003bda to 0x005052 (0x1479 bytes) 000970 1775833003.744696 mapwrite 0x00fd04 thru 0x01d6ea (0xd9e7 bytes) 000971 1775833003.764660 punch from 0x01b8df to 0x02aca9 (0xf3cb bytes) 000972 1775833003.767476 trunc from 0x037b40 to 0x00cb5b (0x2afe4 bytes) 000973 1775833003.777067 mapread 0x0071ee thru 0x00cb5b (0x596e bytes) 000974 1775833003.778204 trunc from 0x00cb5c to 0x0127d6 (0x5c7b bytes) 000976 1775833003.788234 read 0x00f6ac thru 0x0127d6 (0x312b bytes) 000977 1775833003.795075 read 0x00f60c thru 0x0127d6 (0x31cb bytes) 000978 1775833003.795853 write 0x01df21 thru 0x029872 (0xb952 bytes) 000979 1775833003.797273 trunc from 0x029873 to 0x01bd00 (0xdb72 bytes) 000981 1775833003.804382 punch from 0x002498 to 0x00fa56 (0xd5bf bytes) 000982 1775833003.807422 punch from 0x01bca8 to 0x01bd00 (0x59 bytes) 000983 1775833003.810496 write 0x000819 thru 0x007b8a (0x7372 bytes) 000984 1775833003.818458 MIRROR_SPLIT mirror 9 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1bd01): Mirror 6: 0xaf2bf4b (stale) Mirror 8: 0xaf2bf4b (stale) Mirror 10: 0xaf2bf4b (stale) Mirror 12: 0xaf2bf4b (stale) Mirror 13: 0xaf2bf4b (stale) Mirror 14: 0xaf2bf4b (stale) Mirror 17: 0xaf2bf4b (stale) Mirror 18: 0xaf2bf4b (stale) Mirror 20: 0xaf2bf4b (stale) Mirror 21: 0xaf2bf4b (stale) Mirror 22: 0xaf2bf4b (stale) Mirror 23: 0xaf2bf4b (stale) Mirror 24: 0xaf2bf4b (stale) Mirror 25: 0xaf2bf4b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bd01): Mirror 6: 0xaf2bf4b (stale) Mirror 8: 0xaf2bf4b (stale) Mirror 10: 0xaf2bf4b (stale) Mirror 12: 0xaf2bf4b (stale) Mirror 13: 0xaf2bf4b (stale) Mirror 14: 0xaf2bf4b (stale) Mirror 17: 0xaf2bf4b (stale) Mirror 18: 0xaf2bf4b (stale) Mirror 20: 0xaf2bf4b (stale) Mirror 21: 0xaf2bf4b (stale) Mirror 22: 0xaf2bf4b (stale) Mirror 23: 0xaf2bf4b (stale) Mirror 24: 0xaf2bf4b (stale) Mirror 25: 0xaf2bf4b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bd01: skipped 000985 1775833004.151017 mapwrite 0x00c552 thru 0x0148e3 (0x8392 bytes) 000986 1775833004.178148 fallocate 0x008f13 thru 0x00b6b7 (0x27a5 bytes) 000988 1775833004.186656 MIRROR_SPLIT mirror 11 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1bd01): Mirror 6: 0xaf2bf4b (stale) Mirror 8: 0xaf2bf4b (stale) Mirror 10: 0xaf2bf4b (stale) Mirror 12: 0xaf2bf4b (stale) Mirror 13: 0xaf2bf4b (stale) Mirror 14: 0xaf2bf4b (stale) Mirror 17: 0xaf2bf4b (stale) Mirror 18: 0xaf2bf4b (stale) Mirror 20: 0xaf2bf4b (stale) Mirror 21: 0xaf2bf4b (stale) Mirror 23: 0xaf2bf4b (stale) Mirror 24: 0xaf2bf4b (stale) Mirror 25: 0xaf2bf4b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bd01): Mirror 6: 0xaf2bf4b (stale) Mirror 8: 0xaf2bf4b (stale) Mirror 10: 0xaf2bf4b (stale) Mirror 12: 0xaf2bf4b (stale) Mirror 13: 0xaf2bf4b (stale) Mirror 14: 0xaf2bf4b (stale) Mirror 17: 0xaf2bf4b (stale) Mirror 18: 0xaf2bf4b (stale) Mirror 20: 0xaf2bf4b (stale) Mirror 21: 0xaf2bf4b (stale) Mirror 23: 0xaf2bf4b (stale) Mirror 24: 0xaf2bf4b (stale) Mirror 25: 0xaf2bf4b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bd01: skipped 000989 1775833004.547204 trunc from 0x01bd01 to 0x03e0f5 (0x223f5 bytes) 000990 1775833004.557643 mapread 0x019c58 thru 0x029148 (0xf4f1 bytes) 000991 1775833004.577343 fallocate 0x011dd7 thru 0x01e2a3 (0xc4cd bytes) 000992 1775833004.581417 punch from 0x00d39a to 0x01b356 (0xdfbd bytes) 000995 1775833004.587066 trunc from 0x01e800 to 0x02b1eb (0xc9ec bytes) 000996 1775833004.593114 read 0x025269 thru 0x025576 (0x30e bytes) 000997 1775833004.597852 mapwrite 0x012b4c thru 0x022ae6 (0xff9b bytes) 000998 1775833004.635213 MIRROR_RESYNC 14 mirrors 000999 1775833006.213440 read 0x003b7c thru 0x008897 (0x4d1c bytes) 001000 1775833006.218232 trunc from 0x03e0f6 to 0x00052a (0x3dbcb bytes) All operations completed A-OK!