== sanity-flr test 70a: flr mode fsx test ================ 00:08:04 (1788754084) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 4086 000001 1788754086.508067 MIRROR_EXTEND to 2 mirrors 000002 1788754086.850213 write 0x03c473 thru 0x03ffff (0x3b8d bytes) truncating to largest ever: 0x3190a 000003 1788754086.895716 trunc from 0x040000 to 0x031909 (0xe6f6 bytes) truncating to largest ever: 0x39e42 000004 1788754086.950636 trunc from 0x03190a to 0x039e41 (0x8538 bytes) 000005 1788754086.978410 fallocate 0x029c31 thru 0x037195 (0xd565 bytes) 000006 1788754086.988621 punch from 0x00c5f0 to 0x01b247 (0xec58 bytes) 000007 1788754086.994430 mapread 0x02ca94 thru 0x0354c6 (0x8a33 bytes) 000008 1788754087.015273 fallocate 0x028c2c thru 0x038256 (0xf62b bytes) 000010 1788754087.020762 read 0x01ded4 thru 0x0294ed (0xb61a bytes) 000012 1788754087.031351 read 0x001984 thru 0x0045e7 (0x2c64 bytes) 000013 1788754087.043271 read 0x01884f thru 0x0277d4 (0xef86 bytes) 000014 1788754087.048042 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x39e42): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39e42): Mirror 2: 0x5e182eb2 (stale) CRC-32 checksum value for chunk [0, 0x39e42): Mirror 1: 0x5e182eb2 Mirror 3: 0x5e182eb2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39e42: skipped 000015 1788754087.713125 fallocate 0x013253 thru 0x019a40 (0x67ee bytes) 000016 1788754087.754822 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39e42): Mirror 2: 0x5e182eb2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39e42): Mirror 2: 0x5e182eb2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39e42: skipped 000018 1788754088.016120 mapwrite 0x002692 thru 0x006eb4 (0x4823 bytes) 000019 1788754088.046030 trunc from 0x039e42 to 0x002722 (0x3771f bytes) 000020 1788754088.068606 trunc from 0x002723 to 0x030ffe (0x2e8dc bytes) 000021 1788754088.085556 write 0x02ce09 thru 0x037dd6 (0xafce bytes) 000022 1788754088.092402 mapwrite 0x000759 thru 0x00d80e (0xd0b6 bytes) 000023 1788754088.125031 mapwrite 0x02009d thru 0x02710a (0x706e bytes) 000024 1788754088.153322 trunc from 0x00503d to 0x0100b1 (0xb075 bytes) 000025 1788754088.158296 write 0x03fc8f thru 0x03ffff (0x371 bytes) 000026 1788754088.159314 write 0x02cbcc thru 0x0306fa (0x3b2f bytes) 000027 1788754088.160245 punch from 0x013ba1 to 0x021dba (0xe21a bytes) 000029 1788754088.169811 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x95fa03db Mirror 3: 0x95fa03db lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000030 1788754088.915822 mapwrite 0x03ff2b thru 0x03ffff (0xd5 bytes) 000031 1788754089.007395 fallocate 0x01251d thru 0x017904 (0x53e8 bytes) 000032 1788754089.017338 read 0x033366 thru 0x036675 (0x3310 bytes) 000033 1788754089.024788 read 0x01c421 thru 0x02ac42 (0xe822 bytes) 000034 1788754089.042351 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000035 1788754089.305331 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xac5d3c50 Mirror 3: 0xac5d3c50 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000036 1788754090.049460 write 0x00a2fa thru 0x016c41 (0xc948 bytes) 000037 1788754090.104417 read 0x0065b8 thru 0x010681 (0xa0ca bytes) 000038 1788754090.111070 punch from 0x029d01 to 0x0366d4 (0xc9d4 bytes) 000039 1788754090.115446 read 0x030bef thru 0x03cb37 (0xbf49 bytes) 000040 1788754090.125045 write 0x036440 thru 0x03ffff (0x9bc0 bytes) 000041 1788754090.129745 MIRROR_RESYNC 3 mirrors 000042 1788754090.829437 mapread 0x029636 thru 0x0347cf (0xb19a bytes) 000043 1788754090.852184 read 0x01ccfb thru 0x01fbd9 (0x2edf bytes) 000044 1788754090.860748 MIRROR_RESYNC 3 mirrors 000045 1788754091.118303 read 0x00719f thru 0x0156af (0xe511 bytes) 000047 1788754091.133301 fallocate 0x00b3c1 thru 0x01b23d (0xfe7d bytes) 000049 1788754091.188381 read 0x004316 thru 0x006bb9 (0x28a4 bytes) 000050 1788754091.211317 trunc from 0x040000 to 0x011607 (0x2e9f8 bytes) 000051 1788754091.255174 read 0x00f9cd thru 0x011607 (0x1c3b bytes) 000052 1788754091.255896 mapread 0x009a59 thru 0x011607 (0x7baf bytes) 000053 1788754091.257791 trunc from 0x011608 to 0x00f7db (0x1e2c bytes) 000054 1788754091.272813 mapwrite 0x006ff9 thru 0x00dc67 (0x6c6f bytes) fallocating to largest ever: 0x3b5ef 000055 1788754091.288607 fallocate 0x031c9a thru 0x03b5ee (0x9955 bytes) 000056 1788754091.293618 fallocate 0x0037bf thru 0x00fc3b (0xc47d bytes) 000057 1788754091.297837 trunc from 0x00f7dc to 0x0015f4 (0xe1e7 bytes) 000058 1788754091.314319 trunc from 0x00082e to 0x0015f4 (0xdc7 bytes) 000059 1788754091.319716 trunc from 0x000ef2 to 0x0015f4 (0x703 bytes) 000061 1788754091.328440 MIRROR_RESYNC 3 mirrors 000062 1788754091.701716 trunc from 0x000718 to 0x0015f4 (0xedd bytes) 000063 1788754091.746352 trunc from 0x000196 to 0x0015f4 (0x145f bytes) 000064 1788754091.763264 fallocate 0x024377 thru 0x02bfd0 (0x7c5a bytes) 000065 1788754091.778622 trunc from 0x009c51 to 0x00fc48 (0x5ff8 bytes) 000066 1788754091.792949 punch from 0x006b45 to 0x012ac5 (0xbf81 bytes) 000067 1788754091.807575 write 0x02b4d6 thru 0x038605 (0xd130 bytes) 000068 1788754091.842849 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38606): Mirror 3: 0x846bb58c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38606): Mirror 3: 0x846bb58c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38606: skipped 000069 1788754092.236356 write 0x011b95 thru 0x015270 (0x36dc bytes) 000070 1788754092.254768 mapread 0x031772 thru 0x038605 (0x6e94 bytes) 000071 1788754092.278068 mapwrite 0x02eefd thru 0x0355cd (0x66d1 bytes) 000072 1788754092.307529 punch from 0x008b54 to 0x00d40b (0x48b8 bytes) 000073 1788754092.322609 MIRROR_RESYNC 2 mirrors 000074 1788754092.858688 fallocate 0x023a6e thru 0x031f7c (0xe50f bytes) 000076 1788754092.890934 write 0x03ebe5 thru 0x03ffff (0x141b bytes) 000077 1788754092.891915 write 0x0081ae thru 0x016767 (0xe5ba bytes) 000078 1788754092.902039 trunc from 0x040000 to 0x022f59 (0x1d0a6 bytes) 000079 1788754092.939242 trunc from 0x022f5a to 0x00c357 (0x16c02 bytes) 000080 1788754092.955224 fallocate 0x003045 thru 0x012dc7 (0xfd83 bytes) 000082 1788754092.960709 trunc from 0x003280 to 0x00cb74 (0x98f5 bytes) 000083 1788754092.972432 trunc from 0x007f3f to 0x00fa3d (0x7aff bytes) 000084 1788754092.976929 punch from 0x00e73b to 0x00fb38 (0x13fe bytes) 000085 1788754092.981003 mapread 0x00bbbe thru 0x011a46 (0x5e89 bytes) 000086 1788754092.997218 write 0x00bd74 thru 0x013c81 (0x7f0e bytes) 000087 1788754092.998499 trunc from 0x013c82 to 0x032246 (0x1e5c5 bytes) 000088 1788754093.012374 punch from 0x00f328 to 0x017718 (0x83f1 bytes) 000089 1788754093.026664 trunc from 0x032247 to 0x034e83 (0x2c3d bytes) 000090 1788754093.040292 mapread 0x022fa6 thru 0x02bd32 (0x8d8d bytes) 000091 1788754093.056437 mapread 0x02ca62 thru 0x02e5ad (0x1b4c bytes) 000092 1788754093.061163 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) 000093 1788754093.173040 read 0x01d97a thru 0x020c3d (0x32c4 bytes) 000095 1788754093.184160 mapread 0x01240b thru 0x01a793 (0x8389 bytes) 000097 1788754093.201124 read 0x02520f thru 0x031544 (0xc336 bytes) 000098 1788754093.209161 trunc from 0x0276b5 to 0x034e83 (0xd7cf bytes) 000100 1788754093.214196 fallocate 0x0159a4 thru 0x02059d (0xabfa bytes) 000101 1788754093.218268 write 0x034076 thru 0x037c25 (0x3bb0 bytes) 000105 1788754093.231126 trunc from 0x02ad68 to 0x037c25 (0xcebe bytes) 000106 1788754093.240327 mapwrite 0x02014e thru 0x027cb5 (0x7b68 bytes) 000107 1788754093.262822 write 0x03dab7 thru 0x03ffff (0x2549 bytes) 000108 1788754093.264046 read 0x0117f1 thru 0x0134a5 (0x1cb5 bytes) 000109 1788754093.265423 mapwrite 0x00b6bb thru 0x013b41 (0x8487 bytes) 000110 1788754093.281775 mapwrite 0x00e926 thru 0x011a16 (0x30f1 bytes) 000111 1788754093.293624 write 0x0167ee thru 0x025226 (0xea39 bytes) 000112 1788754093.295859 mapwrite 0x038667 thru 0x03ffff (0x7999 bytes) 000113 1788754093.318898 trunc from 0x040000 to 0x00f051 (0x30fae bytes) fallocating to largest ever: 0x40000 000114 1788754093.332358 fallocate 0x03c4d2 thru 0x03ffff (0x3b2e bytes) 000115 1788754093.337566 punch from 0x023deb to 0x024e8c (0x10a2 bytes) 000116 1788754093.343734 trunc from 0x000f74 to 0x01001d (0xf0aa bytes) 000117 1788754093.349160 mapread 0x03901b thru 0x03ffff (0x6fe5 bytes) 000118 1788754093.377836 trunc from 0x00d15b to 0x0114d9 (0x437f bytes) 000119 1788754093.382151 mapwrite 0x02f4ff thru 0x0363db (0x6edd bytes) 000121 1788754093.428173 mapread 0x0357bc thru 0x03ffff (0xa844 bytes) 000122 1788754093.439405 read 0x02fd0c thru 0x03e5f8 (0xe8ed bytes) 000123 1788754093.449513 trunc from 0x03a82b to 0x03b481 (0xc57 bytes) 000125 1788754093.455325 mapwrite 0x028116 thru 0x028b01 (0x9ec bytes) 000126 1788754093.473669 mapread 0x034581 thru 0x03531a (0xd9a bytes) 000127 1788754093.474512 mapwrite 0x02a4e1 thru 0x02e917 (0x4437 bytes) 000132 1788754093.494098 trunc from 0x040000 to 0x026fd0 (0x1902f bytes) 000133 1788754093.507416 mapwrite 0x0296e1 thru 0x02be84 (0x27a4 bytes) 000135 1788754093.549017 mapwrite 0x020a02 thru 0x020a96 (0x95 bytes) 000137 1788754093.560080 trunc from 0x00b332 to 0x017837 (0xc506 bytes) 000138 1788754093.564384 punch from 0x017782 to 0x018a87 (0x1306 bytes) 000139 1788754093.568520 trunc from 0x0256d1 to 0x026ed1 (0x1801 bytes) 000140 1788754093.574334 trunc from 0x000ac6 to 0x010249 (0xf784 bytes) 000141 1788754093.579391 trunc from 0x02be85 to 0x022a7e (0x9406 bytes) 000142 1788754093.594882 fallocate 0x02e58d thru 0x03ad98 (0xc80c bytes) 000143 1788754093.600519 trunc from 0x016675 to 0x0231de (0xcb6a bytes) 000144 1788754093.605671 mapwrite 0x02119c thru 0x03015c (0xefc1 bytes) 000145 1788754093.685498 mapread 0x00b5ce thru 0x011425 (0x5e58 bytes) 000147 1788754093.713406 read 0x02e9cc thru 0x038255 (0x988a bytes) 000148 1788754093.722822 punch from 0x010f29 to 0x01b208 (0xa2e0 bytes) 000149 1788754093.727866 trunc from 0x007af1 to 0x00cac9 (0x4fd9 bytes) 000150 1788754093.732319 trunc from 0x03ad99 to 0x0136a7 (0x276f1 bytes) 000151 1788754093.761364 fallocate 0x029f98 thru 0x036909 (0xc972 bytes) 000152 1788754093.765334 trunc from 0x0349b5 to 0x036909 (0x1f55 bytes) 000153 1788754093.769834 read 0x01efeb thru 0x02a98d (0xb9a3 bytes) 000154 1788754093.780389 trunc from 0x03690a to 0x008d40 (0x2dbc9 bytes) 000155 1788754093.795648 trunc from 0x00123e to 0x001557 (0x31a bytes) 000156 1788754093.799446 read 0x005dd3 thru 0x008d40 (0x2f6e bytes) 000157 1788754093.801206 punch from 0x000124 to 0x008d40 (0x8c1d bytes) 000158 1788754093.806099 punch from 0x003414 to 0x00848a (0x5077 bytes) 000159 1788754093.809981 fallocate 0x023d0c thru 0x02a7f3 (0x6ae8 bytes) 000161 1788754093.815773 fallocate 0x003a48 thru 0x007c5c (0x4215 bytes) 000162 1788754093.819943 trunc from 0x02a7f4 to 0x0046fb (0x260f8 bytes) 000163 1788754093.832288 punch from 0x0044b1 to 0x0046fb (0x24b bytes) 000164 1788754093.836831 punch from 0x003416 to 0x0046fb (0x12e6 bytes) 000165 1788754093.841232 read 0x001230 thru 0x001cf9 (0xaca bytes) 000166 1788754093.848671 fallocate 0x01a4a5 thru 0x020245 (0x5da1 bytes) 000167 1788754093.852664 mapread 0x000a00 thru 0x0046fb (0x3cfc bytes) 000168 1788754093.853498 trunc from 0x000bfa to 0x003878 (0x2c7f bytes) 000169 1788754093.858258 write 0x02e0cb thru 0x030621 (0x2557 bytes) 000170 1788754093.859428 write 0x001816 thru 0x005e33 (0x461e bytes) 000171 1788754093.867489 punch from 0x027d92 to 0x030621 (0x8890 bytes) 000172 1788754093.880543 mapread 0x030416 thru 0x030621 (0x20c bytes) 000173 1788754093.886268 punch from 0x0100f7 to 0x018521 (0x842b bytes) 000174 1788754093.890891 mapwrite 0x00be18 thru 0x00c5de (0x7c7 bytes) 000175 1788754093.902084 write 0x00adc0 thru 0x01942c (0xe66d bytes) 000178 1788754093.904660 trunc from 0x0132d1 to 0x01ee72 (0xbba2 bytes) 000180 1788754093.918324 trunc from 0x01a74b to 0x01e31c (0x3bd2 bytes) 000181 1788754093.922509 read 0x0255f9 thru 0x030621 (0xb029 bytes) 000182 1788754093.933077 trunc from 0x0302bb to 0x030621 (0x367 bytes) 000183 1788754093.937619 mapwrite 0x0014c1 thru 0x00b694 (0xa1d4 bytes) 000184 1788754093.954704 trunc from 0x017bc3 to 0x024f3a (0xd378 bytes) 000185 1788754093.959247 mapread 0x029c9d thru 0x02af42 (0x12a6 bytes) 000186 1788754093.960281 trunc from 0x030622 to 0x01acbb (0x15966 bytes) 000187 1788754093.978227 trunc from 0x01acbc to 0x008ad1 (0x121ea bytes) 000189 1788754093.995172 trunc from 0x006361 to 0x008ad1 (0x2771 bytes) 000192 1788754094.015415 punch from 0x0084e9 to 0x008ad1 (0x5e9 bytes) 000193 1788754094.023286 trunc from 0x008ad2 to 0x004a5c (0x4075 bytes) 000195 1788754094.060543 read 0x001dac thru 0x004a5c (0x2cb1 bytes) 000196 1788754094.064705 read 0x00347f thru 0x004a5c (0x15de bytes) 000197 1788754094.065431 read 0x0002e8 thru 0x004a5c (0x4775 bytes) 000198 1788754094.070816 mapwrite 0x03586d thru 0x03ffff (0xa793 bytes) 000199 1788754094.140390 punch from 0x027859 to 0x030a0f (0x91b7 bytes) 000200 1788754094.156749 MIRROR_EXTEND to 2 mirrors 000202 1788754094.657406 write 0x029fea thru 0x033844 (0x985b bytes) 000203 1788754094.701834 fallocate 0x013e3a thru 0x020187 (0xc34e bytes) 000205 1788754094.712133 MIRROR_RESYNC 2 mirrors 000206 1788754095.242677 read 0x01659f thru 0x01c378 (0x5dda bytes) 000207 1788754095.249138 write 0x000f33 thru 0x00c2e7 (0xb3b5 bytes) 000208 1788754095.279340 trunc from 0x01377c to 0x0204eb (0xcd70 bytes) 000209 1788754095.286798 MIRROR_RESYNC 2 mirrors 000210 1788754095.840903 trunc from 0x001171 to 0x001e14 (0xca4 bytes) 000211 1788754095.867383 mapread 0x01b17e thru 0x026ce8 (0xbb6b bytes) 000212 1788754095.896127 read 0x009728 thru 0x014f47 (0xb820 bytes) 000213 1788754095.903852 trunc from 0x039619 to 0x03df4d (0x4935 bytes) 000214 1788754095.911637 MIRROR_RESYNC 2 mirrors 000217 1788754096.735383 read 0x03e472 thru 0x03ffff (0x1b8e bytes) 000218 1788754096.749345 write 0x030a25 thru 0x03a87b (0x9e57 bytes) 000220 1788754096.809899 write 0x037455 thru 0x03ffff (0x8bab bytes) 000222 1788754096.811960 punch from 0x02b715 to 0x03af43 (0xf82f bytes) 000223 1788754096.827346 write 0x02e199 thru 0x03d49e (0xf306 bytes) 000224 1788754096.835626 fallocate 0x00cfda thru 0x010947 (0x396e bytes) 000225 1788754096.841064 fallocate 0x008446 thru 0x012e0e (0xa9c9 bytes) 000227 1788754096.846061 mapwrite 0x00221b thru 0x00ca11 (0xa7f7 bytes) 000228 1788754096.881414 punch from 0x01ad2e to 0x020c2e (0x5f01 bytes) 000229 1788754096.886255 read 0x024b33 thru 0x028cf0 (0x41be bytes) 000230 1788754096.895060 mapwrite 0x03dd13 thru 0x03ffff (0x22ed bytes) 000231 1788754096.905893 fallocate 0x023684 thru 0x0297c3 (0x6140 bytes) 000233 1788754096.910870 trunc from 0x040000 to 0x0035f2 (0x3ca0d bytes) 000234 1788754096.927453 punch from 0x001fd7 to 0x0035f2 (0x161c bytes) 000235 1788754096.933428 trunc from 0x0030b6 to 0x0035f2 (0x53d bytes) 000236 1788754096.946636 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35f3): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35f3): Mirror 2: 0x1d75366b (stale) CRC-32 checksum value for chunk [0, 0x35f3): Mirror 1: 0xa25f629c Mirror 3: 0xa25f629c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35f3: skipped 000237 1788754097.705146 write 0x01e544 thru 0x025418 (0x6ed5 bytes) 000238 1788754097.759989 trunc from 0x025419 to 0x014213 (0x11205 bytes) 000239 1788754097.787401 fallocate 0x01c58f thru 0x020b38 (0x45aa bytes) 000240 1788754097.801763 MIRROR_RESYNC 3 mirrors 000241 1788754098.687878 trunc from 0x01f997 to 0x020b38 (0x11a2 bytes) 000242 1788754098.740936 mapwrite 0x034444 thru 0x036681 (0x223e bytes) 000243 1788754098.864432 fallocate 0x000bd8 thru 0x00b5f0 (0xaa19 bytes) 000244 1788754098.874893 write 0x00cf89 thru 0x01548a (0x8502 bytes) 000245 1788754098.913860 trunc from 0x00e2f6 to 0x018955 (0xa660 bytes) 000246 1788754098.936495 fallocate 0x02f99b thru 0x0343e6 (0x4a4c bytes) 000247 1788754098.941501 read 0x00ebb7 thru 0x01134d (0x2797 bytes) 000248 1788754098.951220 trunc from 0x015ba1 to 0x017c5b (0x20bb bytes) 000249 1788754098.958232 read 0x0249a0 thru 0x02d113 (0x8774 bytes) 000250 1788754098.974120 write 0x00b28f thru 0x0104c5 (0x5237 bytes) 000251 1788754098.975804 trunc from 0x0289b3 to 0x02cf76 (0x45c4 bytes) 000252 1788754098.990914 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x36682): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36682): Mirror 2: 0x843b8cc1 (stale) Mirror 3: 0x843b8cc1 (stale) CRC-32 checksum value for chunk [0, 0x36682): Mirror 1: 0x5ebe990c Mirror 4: 0x5ebe990c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36682: skipped 000253 1788754099.930069 mapread 0x0348fd thru 0x036681 (0x1d85 bytes) 000254 1788754099.972564 mapread 0x019cda thru 0x020c9c (0x6fc3 bytes) 000255 1788754099.997029 trunc from 0x004a25 to 0x00d698 (0x8c74 bytes) 000256 1788754100.060336 trunc from 0x036682 to 0x01c77d (0x19f04 bytes) 000257 1788754100.110280 punch from 0x0025a0 to 0x0099e6 (0x7447 bytes) 000258 1788754100.120260 fallocate 0x02b5de thru 0x03accf (0xf6f2 bytes) 000259 1788754100.124881 mapwrite 0x014a32 thru 0x022be9 (0xe1b8 bytes) 000260 1788754100.222765 trunc from 0x022bea to 0x02ccb5 (0xa0cc bytes) 000261 1788754100.267307 mapread 0x017124 thru 0x018b86 (0x1a63 bytes) 000262 1788754100.271364 mapread 0x01c789 thru 0x0290c7 (0xc93f bytes) 000263 1788754100.294890 punch from 0x010270 to 0x01cb72 (0xc903 bytes) 000264 1788754100.307667 trunc from 0x02ccb6 to 0x02c958 (0x35d bytes) 000265 1788754100.342317 write 0x00ba96 thru 0x01a62b (0xeb96 bytes) 000267 1788754100.354658 trunc from 0x013096 to 0x01c807 (0x9772 bytes) 000268 1788754100.367258 trunc from 0x02c959 to 0x00e6a4 (0x1e2b4 bytes) 000269 1788754100.380379 write 0x01cc08 thru 0x023281 (0x667a bytes) 000270 1788754100.381721 trunc from 0x009088 to 0x00f9d1 (0x694a bytes) 000271 1788754100.387292 fallocate 0x00ca85 thru 0x015e96 (0x9412 bytes) 000272 1788754100.400369 MIRROR_RESYNC 4 mirrors 000273 1788754101.379550 trunc from 0x023282 to 0x03d10e (0x19e8d bytes) 000274 1788754101.422939 read 0x024d79 thru 0x030f80 (0xc208 bytes) 000275 1788754101.437177 mapread 0x02e21d thru 0x037fce (0x9db2 bytes) 000276 1788754101.463586 MIRROR_RESYNC 4 mirrors 000277 1788754102.329450 trunc from 0x00676f to 0x006e51 (0x6e3 bytes) 000278 1788754102.378507 MIRROR_RESYNC 4 mirrors 000279 1788754103.220926 trunc from 0x03d10f to 0x0313ed (0xbd21 bytes) 000280 1788754103.259915 fallocate 0x0384af thru 0x03d7a1 (0x52f3 bytes) 000281 1788754103.264939 mapwrite 0x00ef99 thru 0x01b0f0 (0xc158 bytes) 000282 1788754103.309153 mapread 0x0206b1 thru 0x023ab9 (0x3409 bytes) 000283 1788754103.320754 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x313ee): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x313ee): Mirror 2: 0xad67d73d (stale) Mirror 3: 0xad67d73d (stale) Mirror 4: 0xad67d73d (stale) CRC-32 checksum value for chunk [0, 0x313ee): Mirror 1: 0xccff48b Mirror 5: 0xccff48b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x313ee: skipped 000284 1788754104.062164 mapread 0x01abcf thru 0x02645a (0xb88c bytes) 000285 1788754104.109369 trunc from 0x00043b to 0x00ab18 (0xa6de bytes) 000287 1788754104.157370 fallocate 0x037e36 thru 0x03ffff (0x81ca bytes) 000288 1788754104.168242 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x762cef (stale) Mirror 3: 0x762cef (stale) Mirror 4: 0x762cef (stale) Mirror 5: 0x69e72823 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7fa6a32c Mirror 6: 0x7fa6a32c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000289 1788754105.199651 fallocate 0x02c318 thru 0x03074b (0x4434 bytes) 000290 1788754105.236922 punch from 0x032108 to 0x03db99 (0xba92 bytes) 000291 1788754105.245876 mapread 0x01c6aa thru 0x024d05 (0x865c bytes) 000292 1788754105.268559 trunc from 0x00e7c9 to 0x0179e3 (0x921b bytes) 000293 1788754105.273167 trunc from 0x040000 to 0x014f78 (0x2b087 bytes) 000294 1788754105.296270 trunc from 0x009d06 to 0x013c28 (0x9f23 bytes) 000296 1788754105.301371 punch from 0x005b89 to 0x014668 (0xeae0 bytes) 000297 1788754105.305955 mapwrite 0x029302 thru 0x02dde8 (0x4ae7 bytes) 000298 1788754105.343759 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2dde9): Mirror 2: 0xc1cbe465 (stale) Mirror 4: 0xc1cbe465 (stale) Mirror 5: 0x2c17862c (stale) Mirror 6: 0xe01c9d28 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dde9): Mirror 2: 0xc1cbe465 (stale) Mirror 4: 0xc1cbe465 (stale) Mirror 5: 0x2c17862c (stale) Mirror 6: 0xe01c9d28 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dde9: skipped 000299 1788754105.669816 fallocate 0x01cdbe thru 0x027acf (0xad12 bytes) 000300 1788754105.673728 fallocate 0x016412 thru 0x020a31 (0xa620 bytes) 000301 1788754105.676878 fallocate 0x022e3b thru 0x03020b (0xd3d1 bytes) 000302 1788754105.681905 trunc from 0x02a1c8 to 0x02dde8 (0x3c21 bytes) 000303 1788754105.688980 trunc from 0x02dde9 to 0x013c9f (0x1a149 bytes) 000304 1788754105.702213 fallocate 0x03f36e thru 0x03ffff (0xc92 bytes) 000305 1788754105.708206 trunc from 0x0123d2 to 0x013a9e (0x16cd bytes) 000306 1788754105.713883 fallocate 0x00d490 thru 0x010013 (0x2b84 bytes) 000307 1788754105.719866 trunc from 0x00ef5c to 0x013c9f (0x4d44 bytes) 000308 1788754105.724576 trunc from 0x0051c6 to 0x013c9f (0xeada bytes) 000309 1788754105.729404 mapwrite 0x01d2c7 thru 0x02c203 (0xef3d bytes) 000310 1788754105.785317 read 0x00e22f thru 0x0189aa (0xa77c bytes) 000311 1788754105.796347 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c204): Mirror 2: 0xba423216 (stale) Mirror 4: 0xba423216 (stale) Mirror 5: 0x5706ab25 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c204): Mirror 2: 0xba423216 (stale) Mirror 4: 0xba423216 (stale) Mirror 5: 0x5706ab25 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c204: skipped 000312 1788754106.057327 mapwrite 0x03ff6d thru 0x03ffff (0x93 bytes) 000313 1788754106.089260 trunc from 0x03ec30 to 0x03ffff (0x13d0 bytes) 000314 1788754106.094215 write 0x03a9f3 thru 0x03ffff (0x560d bytes) 000315 1788754106.102921 MIRROR_RESYNC 4 mirrors 000316 1788754106.975571 mapread 0x032c66 thru 0x03bc9b (0x9036 bytes) 000317 1788754107.009732 mapread 0x032df9 thru 0x0344da (0x16e2 bytes) 000318 1788754107.011000 mapread 0x00812e thru 0x00da6b (0x593e bytes) 000319 1788754107.023991 mapread 0x02556f thru 0x02a4db (0x4f6d bytes) 000320 1788754107.033643 fallocate 0x00ec3f thru 0x018b7e (0x9f40 bytes) 000321 1788754107.102950 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5aa8a225 (stale) Mirror 4: 0x5aa8a225 (stale) Mirror 5: 0x5aa8a225 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5aa8a225 Mirror 6: 0x5aa8a225 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000322 1788754108.031682 read 0x0116ff thru 0x016d49 (0x564b bytes) 000323 1788754108.061769 punch from 0x0229cf to 0x029c12 (0x7244 bytes) 000324 1788754108.156616 mapwrite 0x02a415 thru 0x0366c7 (0xc2b3 bytes) 000325 1788754108.253903 read 0x00a245 thru 0x017804 (0xd5c0 bytes) 000326 1788754108.275773 read 0x032b79 thru 0x033435 (0x8bd bytes) 000327 1788754108.276364 fallocate 0x02ccb1 thru 0x0369f6 (0x9d46 bytes) 000328 1788754108.289818 fallocate 0x0288a2 thru 0x032048 (0x97a7 bytes) 000330 1788754108.304314 read 0x02c58f thru 0x0395ed (0xd05f bytes) 000331 1788754108.307410 mapread 0x0216e0 thru 0x028c22 (0x7543 bytes) 000332 1788754108.312606 mapwrite 0x02a8b1 thru 0x038de0 (0xe530 bytes) 000333 1788754108.348232 punch from 0x0373ba to 0x03785b (0x4a2 bytes) 000334 1788754108.358443 read 0x02f3d2 thru 0x031755 (0x2384 bytes) 000335 1788754108.361334 mapread 0x019f78 thru 0x029f30 (0xffb9 bytes) 000336 1788754108.367489 punch from 0x037617 to 0x03c60d (0x4ff7 bytes) 000337 1788754108.377171 mapwrite 0x01630c thru 0x01c647 (0x633c bytes) 000338 1788754108.404847 fallocate 0x03fbbe thru 0x03ffff (0x442 bytes) 000339 1788754108.415811 punch from 0x01fe4b to 0x02a032 (0xa1e8 bytes) 000340 1788754108.423668 mapwrite 0x0270b9 thru 0x02f6ac (0x85f4 bytes) 000341 1788754108.480827 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5aa8a225 (stale) Mirror 4: 0x5aa8a225 (stale) Mirror 5: 0x5aa8a225 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5aa8a225 (stale) Mirror 4: 0x5aa8a225 (stale) Mirror 5: 0x5aa8a225 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000342 1788754108.871431 trunc from 0x016ddf to 0x01c4a2 (0x56c4 bytes) 000344 1788754108.882412 mapwrite 0x0360e2 thru 0x038dff (0x2d1e bytes) 000345 1788754108.922395 mapread 0x029dd5 thru 0x032f1d (0x9149 bytes) 000346 1788754108.935755 write 0x027922 thru 0x02ec5e (0x733d bytes) 000347 1788754108.941507 read 0x006e72 thru 0x011203 (0xa392 bytes) 000348 1788754108.959140 trunc from 0x040000 to 0x00a1c1 (0x35e3e bytes) 000349 1788754108.980140 MIRROR_RESYNC 4 mirrors 000351 1788754109.571581 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) 000352 1788754109.841879 mapread 0x0075dd thru 0x00a1c1 (0x2be5 bytes) 000353 1788754109.856779 mapread 0x00778f thru 0x00a1c1 (0x2a33 bytes) 000354 1788754109.860963 MIRROR_RESYNC 3 mirrors 000355 1788754110.178255 mapwrite 0x018e59 thru 0x01941f (0x5c7 bytes) 000356 1788754110.241268 fallocate 0x017743 thru 0x01cf17 (0x57d5 bytes) 000357 1788754110.246885 punch from 0x0014b1 to 0x008e79 (0x79c9 bytes) 000358 1788754110.251670 mapread 0x00d71b thru 0x01c047 (0xe92d bytes) 000359 1788754110.271389 mapwrite 0x00ffb9 thru 0x018a1d (0x8a65 bytes) 000361 1788754110.288132 trunc from 0x00e2b2 to 0x013cf6 (0x5a45 bytes) 000362 1788754110.293371 mapwrite 0x00fe50 thru 0x01aa49 (0xabfa bytes) 000363 1788754110.322303 write 0x00be12 thru 0x018278 (0xc467 bytes) 000364 1788754110.323820 mapread 0x006ef4 thru 0x008886 (0x1993 bytes) 000365 1788754110.324662 mapwrite 0x026fb5 thru 0x02a12a (0x3176 bytes) 000366 1788754110.364636 punch from 0x021cf8 to 0x026eb7 (0x51c0 bytes) 000367 1788754110.371972 fallocate 0x002c14 thru 0x009d99 (0x7186 bytes) 000368 1788754110.378407 write 0x005968 thru 0x011c24 (0xc2bd bytes) 000369 1788754110.385853 trunc from 0x01df0d to 0x027d39 (0x9e2d bytes) 000370 1788754110.393611 fallocate 0x0046ef thru 0x012338 (0xdc4a bytes) 000372 1788754110.399614 read 0x000560 thru 0x002562 (0x2003 bytes) 000373 1788754110.412464 MIRROR_RESYNC 3 mirrors 000374 1788754111.181907 read 0x020487 thru 0x027b92 (0x770c bytes) 000375 1788754111.193712 write 0x037a01 thru 0x03ffff (0x85ff bytes) 000376 1788754111.235603 mapwrite 0x00b1fb thru 0x00e496 (0x329c bytes) 000377 1788754111.278931 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xa799f91 (stale) Mirror 5: 0xa799f91 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3af91f43 Mirror 6: 0x3af91f43 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000378 1788754112.063006 fallocate 0x00adfc thru 0x00c3b8 (0x15bd bytes) 000379 1788754112.125686 write 0x008db5 thru 0x00b2b4 (0x2500 bytes) 000380 1788754112.142593 trunc from 0x00eecb to 0x014537 (0x566d bytes) 000381 1788754112.147628 mapwrite 0x01e952 thru 0x02c616 (0xdcc5 bytes) 000383 1788754112.214641 trunc from 0x040000 to 0x01823b (0x27dc4 bytes) 000384 1788754112.266127 trunc from 0x01823c to 0x035a05 (0x1d7ca bytes) 000385 1788754112.288316 write 0x032de3 thru 0x03f595 (0xc7b3 bytes) 000386 1788754112.295559 punch from 0x010547 to 0x01e4db (0xdf95 bytes) 000387 1788754112.300380 trunc from 0x03f596 to 0x017ce5 (0x278b0 bytes) 000388 1788754112.324429 mapwrite 0x00f8a4 thru 0x01190d (0x206a bytes) 000389 1788754112.343202 trunc from 0x017ce6 to 0x0093c7 (0xe91e bytes) 000391 1788754112.358847 write 0x01ad64 thru 0x021c91 (0x6f2e bytes) 000392 1788754112.360108 read 0x021707 thru 0x021c91 (0x58b bytes) 000393 1788754112.361396 punch from 0x00fbe6 to 0x01688e (0x6ca9 bytes) 000394 1788754112.365931 write 0x003ef8 thru 0x00ee92 (0xaf9b bytes) 000396 1788754112.375873 mapread 0x01bb9b thru 0x020a85 (0x4eeb bytes) 000397 1788754112.385681 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21c92): Mirror 5: 0xb61e4928 (stale) Mirror 6: 0xb0e8382a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21c92): Mirror 5: 0xb61e4928 (stale) Mirror 6: 0xb0e8382a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21c92: skipped 000398 1788754112.849889 fallocate 0x01b7a2 thru 0x028164 (0xc9c3 bytes) 000399 1788754112.856580 mapwrite 0x01b46b thru 0x0231bb (0x7d51 bytes) 000400 1788754112.913676 mapwrite 0x02d144 thru 0x0311ff (0x40bc bytes) 000401 1788754112.955973 mapwrite 0x035001 thru 0x03fdba (0xadba bytes) 000402 1788754113.051733 write 0x001362 thru 0x00460e (0x32ad bytes) 000403 1788754113.063535 mapread 0x002b4a thru 0x0128d9 (0xfd90 bytes) 000404 1788754113.111880 trunc from 0x03fdbb to 0x02b73a (0x14680 bytes) 000405 1788754113.135005 trunc from 0x02aef6 to 0x02b73a (0x845 bytes) 000406 1788754113.154389 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b73b): Mirror 6: 0xae8a6539 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b73b): Mirror 6: 0xae8a6539 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b73b: skipped 000407 1788754113.563271 MIRROR_RESYNC 2 mirrors 000409 1788754114.211323 read 0x026529 thru 0x02b73a (0x5212 bytes) 000410 1788754114.230218 fallocate 0x015cbb thru 0x01d765 (0x7aab bytes) 000411 1788754114.293730 mapwrite 0x02c7f0 thru 0x02e56d (0x1d7e bytes) 000412 1788754114.402398 fallocate 0x0223f5 thru 0x02e3a6 (0xbfb2 bytes) 000414 1788754114.407695 fallocate 0x03378d thru 0x03bda0 (0x8614 bytes) 000415 1788754114.412197 trunc from 0x03bda1 to 0x0091a9 (0x32bf7 bytes) 000416 1788754114.434647 MIRROR_RESYNC 2 mirrors 000418 1788754114.947944 trunc from 0x0091aa to 0x001a40 (0x7769 bytes) 000419 1788754115.009602 trunc from 0x0008d2 to 0x001a40 (0x116f bytes) 000420 1788754115.016588 write 0x03aea3 thru 0x03ffff (0x515d bytes) 000421 1788754115.018087 write 0x00f9d7 thru 0x015180 (0x57aa bytes) 000422 1788754115.030525 punch from 0x03060c to 0x03071b (0x110 bytes) 000423 1788754115.035043 mapread 0x03cd6d thru 0x03ffff (0x3293 bytes) 000424 1788754115.035916 mapread 0x0238e3 thru 0x02af6e (0x768c bytes) 000425 1788754115.075016 punch from 0x0195a7 to 0x01fc2c (0x6686 bytes) 000427 1788754115.082403 trunc from 0x040000 to 0x003121 (0x3cede bytes) 000428 1788754115.111456 trunc from 0x003122 to 0x00eb0d (0xb9ec bytes) 000429 1788754115.128924 mapwrite 0x0395cc thru 0x03ffff (0x6a34 bytes) 000431 1788754115.192943 punch from 0x010468 to 0x01c348 (0xbee1 bytes) 000432 1788754115.198808 write 0x02ea15 thru 0x03364a (0x4c36 bytes) 000433 1788754115.205019 write 0x003eff thru 0x0128c8 (0xe9ca bytes) 000434 1788754115.216589 mapread 0x01e2f3 thru 0x020b18 (0x2826 bytes) 000435 1788754115.226058 trunc from 0x01254c to 0x01507b (0x2b30 bytes) 000436 1788754115.243298 mapread 0x02de19 thru 0x03843b (0xa623 bytes) 000437 1788754115.254317 trunc from 0x040000 to 0x0370d6 (0x8f29 bytes) 000438 1788754115.269974 mapwrite 0x028d76 thru 0x02fd0a (0x6f95 bytes) 000439 1788754115.285919 trunc from 0x0370d7 to 0x013eba (0x2321c bytes) 000440 1788754115.304000 trunc from 0x013ebb to 0x003a8f (0x1042b bytes) 000441 1788754115.322832 trunc from 0x002951 to 0x003a8f (0x113f bytes) 000442 1788754115.331067 fallocate 0x02a21c thru 0x02c86b (0x2650 bytes) 000443 1788754115.339042 trunc from 0x003a90 to 0x006550 (0x2ac1 bytes) 000444 1788754115.352877 mapwrite 0x017f86 thru 0x01a270 (0x22eb bytes) 000445 1788754115.390566 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1a271): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a271): Mirror 6: 0x9770ae7d (stale) CRC-32 checksum value for chunk [0, 0x1a271): Mirror 1: 0x8983528b Mirror 7: 0x8983528b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a271: skipped 000446 1788754116.023080 write 0x03ef48 thru 0x03ffff (0x10b8 bytes) 000448 1788754116.063066 punch from 0x039fdf to 0x03a104 (0x126 bytes) 000449 1788754116.069378 write 0x03a3c1 thru 0x03f8ee (0x552e bytes) 000451 1788754116.077523 write 0x01006a thru 0x01f47e (0xf415 bytes) 000452 1788754116.085946 write 0x01458c thru 0x023108 (0xeb7d bytes) 000453 1788754116.092717 read 0x004ed3 thru 0x005884 (0x9b2 bytes) 000455 1788754116.098129 mapread 0x0375bc thru 0x03ffff (0x8a44 bytes) 000456 1788754116.120733 trunc from 0x01458c to 0x01a39b (0x5e10 bytes) 000457 1788754116.141950 mapwrite 0x015fa3 thru 0x01e848 (0x88a6 bytes) 000458 1788754116.183851 trunc from 0x01ea89 to 0x02e473 (0xf9eb bytes) 000459 1788754116.188778 fallocate 0x015903 thru 0x01a1d4 (0x48d2 bytes) 000460 1788754116.194032 write 0x00d407 thru 0x01b64f (0xe249 bytes) 000461 1788754116.199501 write 0x03fd0d thru 0x03ffff (0x2f3 bytes) 000462 1788754116.200344 fallocate 0x00153b thru 0x00e398 (0xce5e bytes) 000463 1788754116.205931 trunc from 0x01e476 to 0x01fff2 (0x1b7d bytes) 000464 1788754116.211775 punch from 0x01fe95 to 0x020fcd (0x1139 bytes) 000466 1788754116.223036 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x68974b3e (stale) Mirror 7: 0x5387540d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7848613c Mirror 8: 0x7848613c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000467 1788754117.206214 write 0x03dd94 thru 0x03ffff (0x226c bytes) 000468 1788754117.251253 punch from 0x037997 to 0x038d6f (0x13d9 bytes) 000469 1788754117.259717 read 0x0106d2 thru 0x01a53b (0x9e6a bytes) 000470 1788754117.281267 punch from 0x025772 to 0x02e031 (0x88c0 bytes) 000471 1788754117.288326 trunc from 0x0109cd to 0x010c20 (0x254 bytes) 000472 1788754117.293836 trunc from 0x036812 to 0x03ffff (0x97ee bytes) 000473 1788754117.314338 write 0x035a5d thru 0x03e850 (0x8df4 bytes) 000474 1788754117.333445 punch from 0x03a591 to 0x03ffff (0x5a6f bytes) 000475 1788754117.353911 mapread 0x01e2ff thru 0x021d7c (0x3a7e bytes) 000476 1788754117.386995 mapwrite 0x021883 thru 0x027a84 (0x6202 bytes) 000477 1788754117.419235 write 0x0386c2 thru 0x03ffff (0x793e bytes) 000478 1788754117.427393 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x68974b3e (stale) Mirror 8: 0x7848613c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x68974b3e (stale) Mirror 8: 0x7848613c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000479 1788754117.772756 mapwrite 0x00b6ff thru 0x0170e5 (0xb9e7 bytes) 000480 1788754117.838946 trunc from 0x00481c to 0x0134e6 (0xeccb bytes) 000481 1788754117.845105 trunc from 0x02ed61 to 0x039784 (0xaa24 bytes) 000482 1788754117.850451 write 0x03ff25 thru 0x03ffff (0xdb bytes) 000483 1788754117.866788 trunc from 0x00beea to 0x00c9e5 (0xafc bytes) 000484 1788754117.871426 trunc from 0x033c08 to 0x03eb5f (0xaf58 bytes) 000485 1788754117.877999 trunc from 0x02edd5 to 0x0369c3 (0x7bef bytes) 000486 1788754117.889815 read 0x02747a thru 0x02d666 (0x61ed bytes) 000487 1788754117.904748 write 0x029b6f thru 0x032ec8 (0x935a bytes) 000488 1788754117.915902 punch from 0x004340 to 0x0111f0 (0xceb1 bytes) 000489 1788754117.922402 write 0x00a82a thru 0x0176a3 (0xce7a bytes) 000490 1788754117.934364 mapwrite 0x00738a thru 0x013bff (0xc876 bytes) 000491 1788754117.979788 mapwrite 0x03246f thru 0x03ffff (0xdb91 bytes) 000492 1788754118.031734 fallocate 0x011de5 thru 0x013bf8 (0x1e14 bytes) 000493 1788754118.036906 mapwrite 0x0056b3 thru 0x012d43 (0xd691 bytes) 000494 1788754118.070068 fallocate 0x00fd3a thru 0x01083b (0xb02 bytes) 000495 1788754118.083700 trunc from 0x016cf1 to 0x023fce (0xd2de bytes) 000496 1788754118.098433 write 0x036aa5 thru 0x03ffff (0x955b bytes) 000497 1788754118.101789 read 0x026d59 thru 0x0332a2 (0xc54a bytes) 000498 1788754118.118553 punch from 0x034545 to 0x039e43 (0x58ff bytes) 000499 1788754118.130743 write 0x018f00 thru 0x0225d8 (0x96d9 bytes) 000500 1788754118.132041 fallocate 0x02bc75 thru 0x0306c3 (0x4a4f bytes) 000501 1788754118.138255 write 0x004176 thru 0x005d28 (0x1bb3 bytes) 000502 1788754118.140300 fallocate 0x03406c thru 0x03a533 (0x64c8 bytes) 000503 1788754118.144614 mapwrite 0x027d8d thru 0x02a172 (0x23e6 bytes) 000504 1788754118.192569 fallocate 0x033698 thru 0x03de97 (0xa800 bytes) 000505 1788754118.196568 mapread 0x02966a thru 0x036bcf (0xd566 bytes) 000506 1788754118.221602 mapwrite 0x015cb3 thru 0x024436 (0xe784 bytes) 000508 1788754118.253098 mapwrite 0x00412b thru 0x013e80 (0xfd56 bytes) 000509 1788754118.305967 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x68974b3e (stale) Mirror 8: 0x7848613c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x23026f99 Mirror 9: 0x23026f99 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000510 1788754119.220102 mapwrite 0x0204f3 thru 0x0232ac (0x2dba bytes) 000511 1788754119.377785 mapread 0x039526 thru 0x03ffff (0x6ada bytes) 000512 1788754119.391452 trunc from 0x006b1e to 0x0109ac (0x9e8f bytes) 000513 1788754119.398998 read 0x01a36e thru 0x0254c6 (0xb159 bytes) 000515 1788754119.404064 mapread 0x03758e thru 0x03ffff (0x8a72 bytes) 000516 1788754119.410744 fallocate 0x01fc41 thru 0x02f338 (0xf6f8 bytes) 000518 1788754119.423124 trunc from 0x03a977 to 0x03c54e (0x1bd8 bytes) 000519 1788754119.435831 MIRROR_RESYNC 4 mirrors 000520 1788754120.843115 MIRROR_RESYNC 4 mirrors 000521 1788754121.283683 mapread 0x01e468 thru 0x01fc70 (0x1809 bytes) 000522 1788754121.305664 trunc from 0x040000 to 0x022682 (0x1d97d bytes) 000523 1788754121.345940 read 0x005c5a thru 0x009887 (0x3c2e bytes) 000524 1788754121.357033 MIRROR_RESYNC 4 mirrors 000525 1788754122.523353 write 0x03214b thru 0x0338bb (0x1771 bytes) 000527 1788754122.550707 write 0x03cd80 thru 0x03ffff (0x3280 bytes) 000528 1788754122.553041 trunc from 0x040000 to 0x00ca31 (0x335ce bytes) 000529 1788754122.572502 trunc from 0x00ae77 to 0x00bb4b (0xcd5 bytes) 000530 1788754122.577008 trunc from 0x004db8 to 0x008d20 (0x3f69 bytes) 000531 1788754122.582557 write 0x0067e3 thru 0x0085e6 (0x1e04 bytes) 000532 1788754122.594971 mapwrite 0x032591 thru 0x03f382 (0xcdf2 bytes) 000533 1788754122.648632 fallocate 0x03f0f7 thru 0x03ffff (0xf09 bytes) 000534 1788754122.653359 mapread 0x004c29 thru 0x00c131 (0x7509 bytes) 000535 1788754122.666077 trunc from 0x040000 to 0x025933 (0x1a6cc bytes) 000536 1788754122.690824 fallocate 0x006712 thru 0x00bb3a (0x5429 bytes) 000537 1788754122.695961 punch from 0x01412d to 0x01e014 (0x9ee8 bytes) 000538 1788754122.704804 MIRROR_RESYNC 4 mirrors 000539 1788754124.095845 mapread 0x006874 thru 0x01412d (0xd8ba bytes) 000540 1788754124.141456 punch from 0x01315c to 0x01aa4e (0x78f3 bytes) 000541 1788754124.177427 read 0x0227d2 thru 0x025933 (0x3162 bytes) 000542 1788754124.196988 mapread 0x00820d thru 0x015c3f (0xda33 bytes) 000543 1788754124.290789 punch from 0x01ee56 to 0x025933 (0x6ade bytes) 000544 1788754124.296122 write 0x023135 thru 0x025d08 (0x2bd4 bytes) 000545 1788754124.307897 mapwrite 0x0359cd thru 0x03d759 (0x7d8d bytes) 000546 1788754124.357905 trunc from 0x0251fd to 0x0312ab (0xc0af bytes) 000547 1788754124.364059 fallocate 0x023faa thru 0x025cfd (0x1d54 bytes) 000548 1788754124.379211 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d75a): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d75a): Mirror 6: 0xa024763b (stale) Mirror 8: 0xa024763b (stale) Mirror 9: 0xa024763b (stale) CRC-32 checksum value for chunk [0, 0x3d75a): Mirror 1: 0x24ffbb19 Mirror 10: 0x24ffbb19 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d75a: skipped 000549 1788754125.287974 read 0x02ce0f thru 0x033310 (0x6502 bytes) 000550 1788754125.304094 trunc from 0x03d75a to 0x00900f (0x3474a bytes) 000551 1788754125.370062 trunc from 0x0068aa to 0x00900f (0x2766 bytes) 000552 1788754125.378196 trunc from 0x000097 to 0x00900f (0x8f79 bytes) 000553 1788754125.382792 write 0x02e3df thru 0x038f61 (0xab83 bytes) 000554 1788754125.385017 write 0x037e7d thru 0x03ffff (0x8183 bytes) 000556 1788754125.387427 mapread 0x008868 thru 0x00b672 (0x2e0b bytes) 000557 1788754125.405759 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xc8c4f9c9 (stale) Mirror 8: 0xc8c4f9c9 (stale) Mirror 9: 0xc8c4f9c9 (stale) Mirror 10: 0xb5a4d07d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1769305a Mirror 11: 0x1769305a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000558 1788754126.189664 read 0x0068d9 thru 0x01276a (0xbe92 bytes) 000559 1788754126.213115 trunc from 0x02c114 to 0x03968c (0xd579 bytes) 000560 1788754126.279116 trunc from 0x040000 to 0x01086f (0x2f790 bytes) 000562 1788754126.351007 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x10870): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10870): Mirror 6: 0xbe19ab41 (stale) Mirror 8: 0xbe19ab41 (stale) Mirror 9: 0xbe19ab41 (stale) Mirror 10: 0xbe19ab41 (stale) Mirror 11: 0xca92a024 (stale) CRC-32 checksum value for chunk [0, 0x10870): Mirror 1: 0xca92a024 Mirror 12: 0xca92a024 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10870: skipped 000563 1788754127.277007 punch from 0x00bedc to 0x01015f (0x4284 bytes) 000564 1788754127.322073 read 0x007a68 thru 0x00eefd (0x7496 bytes) 000565 1788754127.330701 fallocate 0x0240b1 thru 0x026e1f (0x2d6f bytes) 000566 1788754127.338299 fallocate 0x032347 thru 0x03f7d3 (0xd48d bytes) 000567 1788754127.343095 mapwrite 0x014020 thru 0x02123c (0xd21d bytes) 000568 1788754127.393620 trunc from 0x026e20 to 0x01f74b (0x76d4 bytes) 000569 1788754127.420136 mapwrite 0x0354b7 thru 0x03ffff (0xab49 bytes) 000570 1788754127.476062 mapread 0x017580 thru 0x023a88 (0xc509 bytes) 000571 1788754127.485416 mapread 0x024e25 thru 0x02ba2e (0x6c0a bytes) 000572 1788754127.492874 punch from 0x0290a7 to 0x037d13 (0xec6d bytes) 000573 1788754127.498057 mapwrite 0x037084 thru 0x03ffff (0x8f7c bytes) 000574 1788754127.523417 trunc from 0x040000 to 0x02d6b3 (0x1294c bytes) 000575 1788754127.536500 trunc from 0x0109ca to 0x01c2bf (0xb8f6 bytes) 000576 1788754127.545889 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2d6b4): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d6b4): Mirror 6: 0xda585c9a (stale) Mirror 8: 0xda585c9a (stale) Mirror 9: 0xda585c9a (stale) Mirror 10: 0xfb65264a (stale) Mirror 11: 0xc06a9ab3 (stale) Mirror 12: 0xc06a9ab3 (stale) CRC-32 checksum value for chunk [0, 0x2d6b4): Mirror 1: 0xfbac5060 Mirror 13: 0xfbac5060 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d6b4: skipped 000577 1788754128.275639 mapwrite 0x017084 thru 0x026f9b (0xff18 bytes) 000578 1788754128.391704 mapwrite 0x022265 thru 0x0291b2 (0x6f4e bytes) 000579 1788754128.412240 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d6b4): Mirror 6: 0xda585c9a (stale) Mirror 9: 0xda585c9a (stale) Mirror 10: 0xfb65264a (stale) Mirror 11: 0xc06a9ab3 (stale) Mirror 12: 0xc06a9ab3 (stale) Mirror 13: 0xfbac5060 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d6b4): Mirror 6: 0xda585c9a (stale) Mirror 9: 0xda585c9a (stale) Mirror 10: 0xfb65264a (stale) Mirror 11: 0xc06a9ab3 (stale) Mirror 12: 0xc06a9ab3 (stale) Mirror 13: 0xfbac5060 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d6b4: skipped 000580 1788754128.824858 write 0x038d91 thru 0x03e11b (0x538b bytes) 000581 1788754128.830419 punch from 0x029b80 to 0x037879 (0xdcfa bytes) 000582 1788754128.840850 trunc from 0x03e11c to 0x001f07 (0x3c214 bytes) 000583 1788754128.881528 mapread 0x0012f1 thru 0x001f07 (0xc17 bytes) 000584 1788754128.887184 read 0x0012ea thru 0x001f07 (0xc1e bytes) 000585 1788754128.887995 mapwrite 0x01f502 thru 0x020125 (0xc24 bytes) 000586 1788754128.924039 write 0x0079d7 thru 0x00e8fb (0x6f25 bytes) 000587 1788754128.932601 write 0x011661 thru 0x01b9eb (0xa38b bytes) 000588 1788754128.940435 mapread 0x0130d6 thru 0x01d4bc (0xa3e7 bytes) 000589 1788754128.941938 punch from 0x00a2b8 to 0x01756c (0xd2b5 bytes) 000590 1788754128.956092 fallocate 0x003e76 thru 0x0088c6 (0x4a51 bytes) 000591 1788754128.961205 read 0x0002b2 thru 0x002caf (0x29fe bytes) 000593 1788754128.971594 mapread 0x01b074 thru 0x020125 (0x50b2 bytes) 000594 1788754128.973044 write 0x02a150 thru 0x038c0b (0xeabc bytes) 000596 1788754128.975414 punch from 0x013c6a to 0x01b0e1 (0x7478 bytes) 000597 1788754128.980899 trunc from 0x038c0c to 0x01eb2c (0x1a0df bytes) 000598 1788754128.995951 write 0x0369fc thru 0x03ffff (0x9604 bytes) 000599 1788754128.997983 write 0x02b59e thru 0x037a69 (0xc4cc bytes) 000600 1788754129.006773 punch from 0x026565 to 0x031286 (0xad22 bytes) 000602 1788754129.021889 mapwrite 0x01d95d thru 0x01e733 (0xdd7 bytes) 000603 1788754129.033051 mapread 0x03abee thru 0x03ffff (0x5412 bytes) 000604 1788754129.034124 trunc from 0x040000 to 0x02e772 (0x1188d bytes) 000605 1788754129.048163 read 0x01f0e6 thru 0x026554 (0x746f bytes) 000606 1788754129.057025 punch from 0x014a1c to 0x017248 (0x282d bytes) 000607 1788754129.060832 trunc from 0x02500f to 0x02d5b4 (0x85a6 bytes) 000608 1788754129.067676 trunc from 0x014383 to 0x01f76a (0xb3e8 bytes) 000609 1788754129.073401 read 0x02de6c thru 0x02e772 (0x907 bytes) 000610 1788754129.082599 write 0x03e034 thru 0x03ffff (0x1fcc bytes) 000611 1788754129.083740 trunc from 0x040000 to 0x034275 (0xbd8a bytes) 000613 1788754129.101023 trunc from 0x034276 to 0x01ae76 (0x193ff bytes) 000614 1788754129.117726 write 0x018804 thru 0x0198e0 (0x10dd bytes) 000615 1788754129.119102 read 0x000d87 thru 0x0014e2 (0x75c bytes) 000616 1788754129.120091 fallocate 0x007347 thru 0x007a2d (0x6e7 bytes) 000617 1788754129.125408 read 0x0180f4 thru 0x01a0d3 (0x1fe0 bytes) 000618 1788754129.126142 trunc from 0x00891c to 0x00ad88 (0x246d bytes) 000619 1788754129.131228 trunc from 0x00f50f to 0x01a3b9 (0xaeab bytes) 000620 1788754129.141136 mapwrite 0x0334f0 thru 0x03d0a1 (0x9bb2 bytes) 000621 1788754129.183070 punch from 0x01010a to 0x015d17 (0x5c0e bytes) 000622 1788754129.188405 trunc from 0x0206b5 to 0x02f2df (0xec2b bytes) 000623 1788754129.197001 MIRROR_RESYNC 7 mirrors 000624 1788754130.737867 read 0x03cad2 thru 0x03d0a1 (0x5d0 bytes) 000625 1788754130.742966 trunc from 0x03d0a2 to 0x025a23 (0x1767e bytes) 000626 1788754130.776921 trunc from 0x019712 to 0x025a23 (0xc312 bytes) 000627 1788754130.781325 fallocate 0x01c74a thru 0x020053 (0x390a bytes) 000628 1788754130.786032 mapwrite 0x02d975 thru 0x031c46 (0x42d2 bytes) 000629 1788754130.840983 punch from 0x000b6c to 0x010749 (0xfbde bytes) 000631 1788754130.847372 trunc from 0x019cb9 to 0x0263a2 (0xc6ea bytes) 000632 1788754130.856364 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x31c47): Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31c47): Mirror 6: 0x849a2c97 (stale) Mirror 9: 0x849a2c97 (stale) Mirror 10: 0x849a2c97 (stale) Mirror 11: 0x849a2c97 (stale) Mirror 12: 0x849a2c97 (stale) Mirror 13: 0x849a2c97 (stale) CRC-32 checksum value for chunk [0, 0x31c47): Mirror 1: 0x66b91223 Mirror 14: 0x66b91223 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31c47: skipped 000633 1788754131.559360 write 0x02bb56 thru 0x0314df (0x598a bytes) 000634 1788754131.607095 punch from 0x013a72 to 0x01e124 (0xa6b3 bytes) 000635 1788754131.611886 mapwrite 0x01f13d thru 0x01fe7f (0xd43 bytes) 000636 1788754131.632204 write 0x02f086 thru 0x02f0be (0x39 bytes) 000637 1788754131.637642 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x31c47): Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31c47): Mirror 6: 0x849a2c97 (stale) Mirror 9: 0x849a2c97 (stale) Mirror 10: 0x849a2c97 (stale) Mirror 11: 0x849a2c97 (stale) Mirror 12: 0x849a2c97 (stale) Mirror 13: 0x849a2c97 (stale) Mirror 14: 0x66b91223 (stale) CRC-32 checksum value for chunk [0, 0x31c47): Mirror 1: 0x1a45fd31 Mirror 15: 0x1a45fd31 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31c47: skipped 000638 1788754132.271000 mapread 0x0297b8 thru 0x02ec9c (0x54e5 bytes) 000639 1788754132.304829 trunc from 0x031c47 to 0x010265 (0x219e1 bytes) 000640 1788754132.376570 write 0x028c66 thru 0x036473 (0xd80e bytes) 000641 1788754132.379012 fallocate 0x02d845 thru 0x02f6aa (0x1e66 bytes) 000642 1788754132.384765 mapwrite 0x029104 thru 0x02b134 (0x2031 bytes) 000643 1788754132.402069 write 0x024cdf thru 0x031aca (0xcdec bytes) 000644 1788754132.407190 trunc from 0x002598 to 0x00a846 (0x82af bytes) 000645 1788754132.412154 punch from 0x02c7d1 to 0x02eaf3 (0x2323 bytes) 000646 1788754132.426760 trunc from 0x036474 to 0x026d9d (0xf6d6 bytes) 000647 1788754132.444857 fallocate 0x019bd9 thru 0x0200fb (0x6523 bytes) 000648 1788754132.452862 fallocate 0x0213e3 thru 0x022ced (0x190b bytes) 000649 1788754132.458105 trunc from 0x026d9e to 0x03f577 (0x187da bytes) 000650 1788754132.481197 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f578): Mirror 6: 0x6f55095a (stale) Mirror 9: 0x6f55095a (stale) Mirror 11: 0x6f55095a (stale) Mirror 12: 0x6f55095a (stale) Mirror 13: 0x6f55095a (stale) Mirror 14: 0xb6610b6a (stale) Mirror 15: 0x3e11cd28 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f578): Mirror 6: 0x6f55095a (stale) Mirror 9: 0x6f55095a (stale) Mirror 11: 0x6f55095a (stale) Mirror 12: 0x6f55095a (stale) Mirror 13: 0x6f55095a (stale) Mirror 14: 0xb6610b6a (stale) Mirror 15: 0x3e11cd28 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f578: skipped 000651 1788754132.941923 fallocate 0x014d42 thru 0x0169df (0x1c9e bytes) 000652 1788754132.947164 trunc from 0x03f578 to 0x02aab9 (0x14abe bytes) 000653 1788754132.966816 mapread 0x002eec thru 0x007e7d (0x4f92 bytes) 000654 1788754132.983094 punch from 0x01d82e to 0x025d68 (0x853b bytes) 000655 1788754132.987900 mapread 0x01b6df thru 0x026476 (0xad98 bytes) 000656 1788754133.006073 MIRROR_RESYNC 8 mirrors 000657 1788754134.268886 trunc from 0x020674 to 0x02aab9 (0xa446 bytes) 000658 1788754134.299552 mapwrite 0x03d02c thru 0x03ffff (0x2fd4 bytes) 000659 1788754134.346903 mapwrite 0x012c4e thru 0x01c494 (0x9847 bytes) 000660 1788754134.384327 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x90b36cf5 (stale) Mirror 9: 0x90b36cf5 (stale) Mirror 11: 0x90b36cf5 (stale) Mirror 12: 0x90b36cf5 (stale) Mirror 13: 0x90b36cf5 (stale) Mirror 14: 0x90b36cf5 (stale) Mirror 15: 0x90b36cf5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe1af28ae Mirror 16: 0xe1af28ae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000661 1788754135.162055 punch from 0x0268c2 to 0x02b76c (0x4eab bytes) 000662 1788754135.211939 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x90b36cf5 (stale) Mirror 11: 0x90b36cf5 (stale) Mirror 12: 0x90b36cf5 (stale) Mirror 13: 0x90b36cf5 (stale) Mirror 14: 0x90b36cf5 (stale) Mirror 15: 0x90b36cf5 (stale) Mirror 16: 0xe1af28ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x90b36cf5 (stale) Mirror 11: 0x90b36cf5 (stale) Mirror 12: 0x90b36cf5 (stale) Mirror 13: 0x90b36cf5 (stale) Mirror 14: 0x90b36cf5 (stale) Mirror 15: 0x90b36cf5 (stale) Mirror 16: 0xe1af28ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000663 1788754135.656240 read 0x0166e0 thru 0x01ec62 (0x8583 bytes) 000664 1788754135.668195 read 0x02b76b thru 0x02e51d (0x2db3 bytes) 000665 1788754135.679746 mapwrite 0x00e274 thru 0x01c0e1 (0xde6e bytes) 000666 1788754135.700783 mapread 0x00b59b thru 0x017349 (0xbdaf bytes) 000667 1788754135.705867 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x90b36cf5 (stale) Mirror 11: 0x90b36cf5 (stale) Mirror 12: 0x90b36cf5 (stale) Mirror 13: 0x90b36cf5 (stale) Mirror 14: 0x90b36cf5 (stale) Mirror 15: 0x90b36cf5 (stale) Mirror 16: 0xe1af28ae (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb28fead5 Mirror 17: 0xb28fead5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000668 1788754136.530326 write 0x02a7c4 thru 0x02fd7a (0x55b7 bytes) 000670 1788754136.585122 mapwrite 0x00e604 thru 0x01189a (0x3297 bytes) 000671 1788754136.615972 write 0x024e4f thru 0x02df27 (0x90d9 bytes) 000672 1788754136.622120 trunc from 0x00d8cc to 0x00fc1c (0x2351 bytes) 000673 1788754136.626458 trunc from 0x01fffd to 0x0270a1 (0x70a5 bytes) 000676 1788754136.643816 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x90b36cf5 (stale) Mirror 11: 0x90b36cf5 (stale) Mirror 12: 0x90b36cf5 (stale) Mirror 13: 0x90b36cf5 (stale) Mirror 14: 0x90b36cf5 (stale) Mirror 15: 0x90b36cf5 (stale) Mirror 16: 0xe1af28ae (stale) Mirror 17: 0xb28fead5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd718f72c Mirror 18: 0xd718f72c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000678 1788754137.434722 mapwrite 0x01cc05 thru 0x02b77c (0xeb78 bytes) 000679 1788754137.574251 mapread 0x024d89 thru 0x033a49 (0xecc1 bytes) 000680 1788754137.583170 fallocate 0x01bbad thru 0x02b27b (0xf6cf bytes) 000681 1788754137.588873 mapread 0x0026bf thru 0x003737 (0x1079 bytes) 000682 1788754137.600066 read 0x0092ae thru 0x014e67 (0xbbba bytes) 000683 1788754137.607678 fallocate 0x02e99f thru 0x03790c (0x8f6e bytes) 000684 1788754137.612794 write 0x032a92 thru 0x032cb1 (0x220 bytes) 000685 1788754137.624938 read 0x011de7 thru 0x01caf3 (0xad0d bytes) 000686 1788754137.632989 mapread 0x01dabb thru 0x02aa6b (0xcfb1 bytes) 000687 1788754137.634050 punch from 0x02a77e to 0x0376c3 (0xcf46 bytes) 000688 1788754137.645954 trunc from 0x040000 to 0x009f5b (0x360a4 bytes) 000689 1788754137.687125 fallocate 0x0053f1 thru 0x012c34 (0xd844 bytes) 000690 1788754137.691843 trunc from 0x00c492 to 0x00fadc (0x364b bytes) 000691 1788754137.695673 mapread 0x007d34 thru 0x00f64a (0x7917 bytes) 000692 1788754137.719963 trunc from 0x00bc92 to 0x012c34 (0x6fa3 bytes) 000693 1788754137.730849 read 0x0051dd thru 0x00d0f7 (0x7f1b bytes) 000694 1788754137.745073 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12c35): Mirror 9: 0x563c454 (stale) Mirror 11: 0x563c454 (stale) Mirror 12: 0x563c454 (stale) Mirror 13: 0x563c454 (stale) Mirror 14: 0x563c454 (stale) Mirror 15: 0x563c454 (stale) Mirror 17: 0xd11184f5 (stale) Mirror 18: 0xc027495 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12c35): Mirror 9: 0x563c454 (stale) Mirror 11: 0x563c454 (stale) Mirror 12: 0x563c454 (stale) Mirror 13: 0x563c454 (stale) Mirror 14: 0x563c454 (stale) Mirror 15: 0x563c454 (stale) Mirror 17: 0xd11184f5 (stale) Mirror 18: 0xc027495 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12c35: skipped 000695 1788754138.104198 mapwrite 0x01e9b5 thru 0x025a64 (0x70b0 bytes) 000696 1788754138.155839 MIRROR_RESYNC 9 mirrors 000697 1788754139.135881 punch from 0x00e096 to 0x010b4d (0x2ab8 bytes) 000698 1788754139.170028 mapwrite 0x03a67f thru 0x03ffff (0x5981 bytes) 000699 1788754139.230896 fallocate 0x03e044 thru 0x03ffff (0x1fbc bytes) 000700 1788754139.238148 MIRROR_RESYNC 9 mirrors 000701 1788754140.699959 fallocate 0x0279b2 thru 0x02ce26 (0x5475 bytes) 000703 1788754140.730313 mapwrite 0x03c594 thru 0x03fd22 (0x378f bytes) 000704 1788754140.758816 mapwrite 0x014b3d thru 0x0203f1 (0xb8b5 bytes) 000705 1788754140.797061 MIRROR_RESYNC 9 mirrors 000706 1788754142.768357 mapread 0x038db0 thru 0x03ffff (0x7250 bytes) 000707 1788754142.788226 mapread 0x014b53 thru 0x022e5c (0xe30a bytes) 000709 1788754142.807997 mapwrite 0x0207f5 thru 0x028b41 (0x834d bytes) 000711 1788754142.925459 mapread 0x0025be thru 0x00a09d (0x7ae0 bytes) 000712 1788754142.957267 read 0x02a213 thru 0x030aa1 (0x688f bytes) 000713 1788754142.973844 punch from 0x0209e8 to 0x02bc1a (0xb233 bytes) 000714 1788754142.980707 mapwrite 0x008a04 thru 0x00ad16 (0x2313 bytes) 000715 1788754143.000827 fallocate 0x010f4a thru 0x01e613 (0xd6ca bytes) 000717 1788754143.008940 mapwrite 0x03ca3c thru 0x03ffff (0x35c4 bytes) 000718 1788754143.042814 punch from 0x007b8b to 0x00cec1 (0x5337 bytes) 000719 1788754143.065233 read 0x009013 thru 0x014719 (0xb707 bytes) 000720 1788754143.102140 mapwrite 0x006d36 thru 0x00a929 (0x3bf4 bytes) 000721 1788754143.124257 fallocate 0x01ae98 thru 0x01de3a (0x2fa3 bytes) 000723 1788754143.130901 read 0x01855a thru 0x023a65 (0xb50c bytes) 000724 1788754143.137707 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x156f76fb (stale) Mirror 11: 0x156f76fb (stale) Mirror 12: 0x156f76fb (stale) Mirror 13: 0x156f76fb (stale) Mirror 14: 0x156f76fb (stale) Mirror 15: 0x156f76fb (stale) Mirror 17: 0x156f76fb (stale) Mirror 18: 0x156f76fb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x41bca731 Mirror 19: 0x41bca731 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000725 1788754144.192375 write 0x039237 thru 0x03ffff (0x6dc9 bytes) 000726 1788754144.244715 punch from 0x019772 to 0x020dbd (0x764c bytes) 000727 1788754144.250292 trunc from 0x040000 to 0x010d8f (0x2f270 bytes) 000728 1788754144.302069 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x10d90): Mirror 9: 0x9b8a24d6 (stale) Mirror 11: 0x9b8a24d6 (stale) Mirror 13: 0x9b8a24d6 (stale) Mirror 14: 0x9b8a24d6 (stale) Mirror 15: 0x9b8a24d6 (stale) Mirror 17: 0x9b8a24d6 (stale) Mirror 18: 0x9b8a24d6 (stale) Mirror 19: 0x7dcf8ace (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10d90): Mirror 9: 0x9b8a24d6 (stale) Mirror 11: 0x9b8a24d6 (stale) Mirror 13: 0x9b8a24d6 (stale) Mirror 14: 0x9b8a24d6 (stale) Mirror 15: 0x9b8a24d6 (stale) Mirror 17: 0x9b8a24d6 (stale) Mirror 18: 0x9b8a24d6 (stale) Mirror 19: 0x7dcf8ace (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10d90: skipped 000729 1788754144.835002 write 0x01a541 thru 0x01cddb (0x289b bytes) 000730 1788754144.847363 fallocate 0x02109f thru 0x030538 (0xf49a bytes) 000731 1788754144.851224 fallocate 0x03728e thru 0x03ffff (0x8d72 bytes) 000732 1788754144.858635 trunc from 0x040000 to 0x033c15 (0xc3ea bytes) 000733 1788754144.872185 trunc from 0x000a90 to 0x00711b (0x668c bytes) 000735 1788754144.877837 punch from 0x02f53f to 0x030955 (0x1417 bytes) 000736 1788754144.886452 punch from 0x02a95e to 0x033c15 (0x92b8 bytes) 000737 1788754144.893429 punch from 0x011da7 to 0x0216d5 (0xf92f bytes) 000738 1788754144.906306 mapread 0x00c92e thru 0x00f453 (0x2b26 bytes) 000739 1788754144.935304 read 0x014e48 thru 0x01c819 (0x79d2 bytes) 000740 1788754144.951325 punch from 0x0329dc to 0x033c15 (0x123a bytes) 000741 1788754144.958055 read 0x02bb88 thru 0x033c15 (0x808e bytes) 000742 1788754144.983189 mapwrite 0x0041a9 thru 0x010bc0 (0xca18 bytes) 000743 1788754145.027301 write 0x030fa1 thru 0x0396ae (0x870e bytes) 000744 1788754145.034735 trunc from 0x015ce3 to 0x0259be (0xfcdc bytes) 000745 1788754145.049226 mapwrite 0x01554b thru 0x01afa1 (0x5a57 bytes) 000746 1788754145.131538 fallocate 0x03084b thru 0x03c8a7 (0xc05d bytes) 000747 1788754145.139839 fallocate 0x03ac5b thru 0x03ffff (0x53a5 bytes) 000748 1788754145.164789 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x156f76fb (stale) Mirror 13: 0x156f76fb (stale) Mirror 14: 0x156f76fb (stale) Mirror 15: 0x156f76fb (stale) Mirror 17: 0x156f76fb (stale) Mirror 18: 0x156f76fb (stale) Mirror 19: 0x41bca731 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x156f76fb (stale) Mirror 13: 0x156f76fb (stale) Mirror 14: 0x156f76fb (stale) Mirror 15: 0x156f76fb (stale) Mirror 17: 0x156f76fb (stale) Mirror 18: 0x156f76fb (stale) Mirror 19: 0x41bca731 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000749 1788754145.717230 fallocate 0x002252 thru 0x00554e (0x32fd bytes) 000750 1788754145.722374 trunc from 0x032013 to 0x03559b (0x3589 bytes) 000751 1788754145.727828 fallocate 0x03ef45 thru 0x03ffff (0x10bb bytes) 000752 1788754145.732870 mapread 0x00e008 thru 0x01a147 (0xc140 bytes) 000753 1788754145.762720 write 0x00095b thru 0x00ea71 (0xe117 bytes) 000754 1788754145.780321 fallocate 0x00b633 thru 0x01667d (0xb04b bytes) 000755 1788754145.785294 trunc from 0x032cf2 to 0x03b5ea (0x88f9 bytes) 000756 1788754145.802547 read 0x0123fa thru 0x01aa93 (0x869a bytes) 000757 1788754145.803302 mapread 0x02111b thru 0x029ee0 (0x8dc6 bytes) 000758 1788754145.821692 mapread 0x02c52f thru 0x03bcd4 (0xf7a6 bytes) 000760 1788754145.854780 write 0x00ca7b thru 0x01b004 (0xe58a bytes) 000761 1788754145.856246 mapwrite 0x0105d1 thru 0x01ed1e (0xe74e bytes) 000762 1788754145.891252 MIRROR_RESYNC 8 mirrors 000763 1788754147.446891 fallocate 0x01da32 thru 0x023a1b (0x5fea bytes) 000765 1788754147.487973 mapwrite 0x021c4b thru 0x024e1b (0x31d1 bytes) 000766 1788754147.526731 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x699ded32 (stale) Mirror 13: 0x699ded32 (stale) Mirror 14: 0x699ded32 (stale) Mirror 15: 0x699ded32 (stale) Mirror 17: 0x699ded32 (stale) Mirror 18: 0x699ded32 (stale) Mirror 19: 0x699ded32 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x32989515 Mirror 20: 0x32989515 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000767 1788754148.406694 mapwrite 0x004c54 thru 0x009ebd (0x526a bytes) 000768 1788754148.511376 write 0x02827c thru 0x03069b (0x8420 bytes) 000769 1788754148.529820 fallocate 0x0073ed thru 0x00d223 (0x5e37 bytes) 000770 1788754148.535126 fallocate 0x0177d0 thru 0x017e32 (0x663 bytes) 000771 1788754148.547444 mapread 0x031766 thru 0x03ffff (0xe89a bytes) 000772 1788754148.572762 mapread 0x02fdb5 thru 0x03fd49 (0xff95 bytes) 000773 1788754148.575819 trunc from 0x019bdb to 0x01ff86 (0x63ac bytes) 000774 1788754148.587275 fallocate 0x026050 thru 0x0327a2 (0xc753 bytes) 000775 1788754148.594370 mapread 0x036828 thru 0x03ffff (0x97d8 bytes) 000776 1788754148.596927 read 0x02cbe2 thru 0x039eb7 (0xd2d6 bytes) 000778 1788754148.598066 write 0x0253f1 thru 0x026312 (0xf22 bytes) 000779 1788754148.614929 mapread 0x036ae0 thru 0x03f9d8 (0x8ef9 bytes) 000780 1788754148.616042 fallocate 0x020e8c thru 0x023106 (0x227b bytes) 000781 1788754148.625591 mapwrite 0x00b5c6 thru 0x016795 (0xb1d0 bytes) 000782 1788754148.667650 read 0x01bbdb thru 0x024972 (0x8d98 bytes) 000783 1788754148.682764 punch from 0x02a30d to 0x032cfc (0x89f0 bytes) 000784 1788754148.690102 write 0x00f32b thru 0x01edc2 (0xfa98 bytes) 000785 1788754148.691702 mapwrite 0x02e109 thru 0x032e8a (0x4d82 bytes) 000786 1788754148.766218 trunc from 0x040000 to 0x03116c (0xee93 bytes) 000787 1788754148.843095 punch from 0x0260a4 to 0x029eaa (0x3e07 bytes) 000788 1788754148.847824 trunc from 0x02fc89 to 0x03116c (0x14e4 bytes) 000789 1788754148.852431 write 0x031346 thru 0x033177 (0x1e32 bytes) 000790 1788754148.857259 punch from 0x030ca4 to 0x033177 (0x24d4 bytes) 000791 1788754148.869984 trunc from 0x0100c8 to 0x018874 (0x87ad bytes) 000792 1788754148.874302 trunc from 0x033178 to 0x007a01 (0x2b776 bytes) 000793 1788754148.893428 mapwrite 0x0096c5 thru 0x00cde4 (0x3720 bytes) 000795 1788754148.940942 mapread 0x004d2f thru 0x00cde4 (0x80b6 bytes) 000797 1788754148.947712 mapread 0x000dfa thru 0x009df7 (0x8ffe bytes) 000798 1788754148.949197 mapread 0x0086cf thru 0x00b2de (0x2c10 bytes) 000799 1788754148.950357 punch from 0x008d09 to 0x00cde4 (0x40dc bytes) 000800 1788754148.956449 mapwrite 0x03e4b3 thru 0x03ffff (0x1b4d bytes) 000801 1788754148.996762 write 0x035b52 thru 0x03ffff (0xa4ae bytes) 000802 1788754149.003192 mapread 0x039730 thru 0x03ffff (0x68d0 bytes) 000803 1788754149.007985 MIRROR_RESYNC 9 mirrors 000804 1788754150.666019 write 0x03900c thru 0x03f06e (0x6063 bytes) 000805 1788754150.720115 write 0x037907 thru 0x03ffff (0x86f9 bytes) 000806 1788754150.729999 trunc from 0x0383af to 0x03ddc3 (0x5a15 bytes) 000807 1788754150.749251 read 0x005f51 thru 0x00a948 (0x49f8 bytes) 000808 1788754150.766272 mapwrite 0x00d53b thru 0x010e50 (0x3916 bytes) 000809 1788754150.833228 read 0x0012aa thru 0x00de55 (0xcbac bytes) 000810 1788754150.851194 mapwrite 0x02be1d thru 0x03aafb (0xecdf bytes) 000811 1788754150.876806 fallocate 0x014b82 thru 0x024493 (0xf912 bytes) 000812 1788754150.882542 fallocate 0x02bd92 thru 0x03b190 (0xf3ff bytes) 000813 1788754150.897627 trunc from 0x040000 to 0x035f2f (0xa0d0 bytes) 000814 1788754150.920939 write 0x026c31 thru 0x029999 (0x2d69 bytes) 000815 1788754150.923000 mapread 0x0341f2 thru 0x035f2f (0x1d3e bytes) 000816 1788754150.929024 fallocate 0x00df84 thru 0x012be8 (0x4c65 bytes) 000817 1788754150.941179 punch from 0x028b64 to 0x0325c8 (0x9a65 bytes) 000818 1788754150.962099 MIRROR_RESYNC 9 mirrors 000819 1788754152.774216 trunc from 0x035f30 to 0x02675b (0xf7d4 bytes) 000820 1788754152.825186 trunc from 0x02675c to 0x033de2 (0xd687 bytes) 000821 1788754152.842858 read 0x0165e4 thru 0x01ed1b (0x8738 bytes) 000822 1788754152.851522 trunc from 0x033de3 to 0x02d5e4 (0x67fe bytes) 000823 1788754152.867248 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d5e5): Mirror 11: 0x8bc67a13 (stale) Mirror 13: 0x8bc67a13 (stale) Mirror 14: 0x8bc67a13 (stale) Mirror 15: 0x8bc67a13 (stale) Mirror 17: 0x8bc67a13 (stale) Mirror 19: 0x8bc67a13 (stale) Mirror 20: 0x8bc67a13 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d5e5): Mirror 11: 0x8bc67a13 (stale) Mirror 13: 0x8bc67a13 (stale) Mirror 14: 0x8bc67a13 (stale) Mirror 15: 0x8bc67a13 (stale) Mirror 17: 0x8bc67a13 (stale) Mirror 19: 0x8bc67a13 (stale) Mirror 20: 0x8bc67a13 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d5e5: skipped 000824 1788754153.397028 fallocate 0x03bf1d thru 0x03ffff (0x40e3 bytes) 000825 1788754153.407013 mapwrite 0x00779e thru 0x00a249 (0x2aac bytes) 000826 1788754153.442719 read 0x014180 thru 0x01653d (0x23be bytes) 000827 1788754153.451629 write 0x03bf24 thru 0x03ffff (0x40dc bytes) 000828 1788754153.464014 fallocate 0x026ef4 thru 0x0303f2 (0x94ff bytes) 000829 1788754153.471045 read 0x022dfd thru 0x02b3d0 (0x85d4 bytes) 000830 1788754153.517782 trunc from 0x01912f to 0x01ae3e (0x1d10 bytes) 000831 1788754153.523372 read 0x0077ce thru 0x00ccee (0x5521 bytes) 000832 1788754153.525208 punch from 0x038b37 to 0x03ffff (0x74c9 bytes) 000833 1788754153.545517 read 0x02055d thru 0x02e927 (0xe3cb bytes) 000834 1788754153.550653 MIRROR_RESYNC 8 mirrors 000835 1788754155.101337 read 0x006df3 thru 0x00a539 (0x3747 bytes) 000836 1788754155.109995 punch from 0x03201b to 0x035c00 (0x3be6 bytes) 000837 1788754155.146716 mapread 0x01421e thru 0x022826 (0xe609 bytes) 000838 1788754155.187116 read 0x025f20 thru 0x0325e0 (0xc6c1 bytes) 000839 1788754155.197072 trunc from 0x0283a4 to 0x029d2d (0x198a bytes) 000840 1788754155.200995 write 0x02aff8 thru 0x02b71f (0x728 bytes) 000841 1788754155.201814 fallocate 0x02bf71 thru 0x032cd6 (0x6d66 bytes) 000842 1788754155.206338 mapwrite 0x001b8a thru 0x00bfbc (0xa433 bytes) 000843 1788754155.226205 punch from 0x006015 to 0x00eb55 (0x8b41 bytes) 000844 1788754155.231244 trunc from 0x040000 to 0x02ccf9 (0x13306 bytes) 000846 1788754155.249757 mapwrite 0x01433d thru 0x01eda0 (0xaa64 bytes) 000847 1788754155.271690 read 0x025302 thru 0x026e9a (0x1b99 bytes) 000848 1788754155.272308 trunc from 0x02965c to 0x02ccf9 (0x369e bytes) 000849 1788754155.282192 trunc from 0x02ccfa to 0x000e71 (0x2be88 bytes) 000850 1788754155.309093 mapread 0x0004c6 thru 0x000e71 (0x9ac bytes) 000851 1788754155.311046 write 0x009388 thru 0x00ffbe (0x6c37 bytes) 000852 1788754155.313893 trunc from 0x00521a to 0x00e9be (0x97a5 bytes) 000853 1788754155.329737 fallocate 0x03648c thru 0x03e90a (0x847f bytes) 000854 1788754155.335301 trunc from 0x00ffbf to 0x015bd7 (0x5c19 bytes) 000855 1788754155.347047 trunc from 0x015bd8 to 0x00d0d4 (0x8b03 bytes) 000856 1788754155.360218 mapwrite 0x01e579 thru 0x027284 (0x8d0c bytes) 000858 1788754155.402504 fallocate 0x027a44 thru 0x03532f (0xd8ec bytes) 000859 1788754155.407273 fallocate 0x0357f4 thru 0x03ffff (0xa80c bytes) 000860 1788754155.410908 mapread 0x001904 thru 0x00ef2d (0xd62a bytes) 000861 1788754155.412306 punch from 0x024322 to 0x026dff (0x2ade bytes) 000862 1788754155.417542 fallocate 0x00eb3d thru 0x01e0d4 (0xf598 bytes) 000863 1788754155.421805 write 0x038ee0 thru 0x03ffff (0x7120 bytes) 000865 1788754155.424846 trunc from 0x040000 to 0x0374d9 (0x8b26 bytes) 000866 1788754155.435982 read 0x01ea88 thru 0x02b7de (0xcd57 bytes) 000867 1788754155.443879 mapread 0x028f58 thru 0x02cf69 (0x4012 bytes) 000868 1788754155.448786 MIRROR_RESYNC 8 mirrors 000869 1788754157.199345 mapwrite 0x03e284 thru 0x03ffff (0x1d7c bytes) 000870 1788754157.311642 mapwrite 0x02a7c4 thru 0x03845e (0xdc9b bytes) 000871 1788754157.389210 mapread 0x00dbe1 thru 0x00fe11 (0x2231 bytes) 000872 1788754157.404308 trunc from 0x040000 to 0x03d0a0 (0x2f5f bytes) 000873 1788754157.444153 mapread 0x02971f thru 0x037557 (0xde39 bytes) 000874 1788754157.445229 trunc from 0x03d0a1 to 0x013e82 (0x2921e bytes) 000876 1788754157.480703 trunc from 0x007c65 to 0x00fc67 (0x8003 bytes) 000877 1788754157.502509 MIRROR_RESYNC 8 mirrors 000878 1788754158.649305 mapwrite 0x0381f4 thru 0x03fa15 (0x7822 bytes) 000879 1788754158.737911 MIRROR_RESYNC 8 mirrors 000880 1788754160.035907 read 0x012bdf thru 0x01737e (0x47a0 bytes) 000881 1788754160.052077 trunc from 0x03fa16 to 0x035944 (0xa0d1 bytes) 000882 1788754160.125216 read 0x0115e1 thru 0x01c6a2 (0xb0c2 bytes) 000883 1788754160.137869 punch from 0x01c920 to 0x026469 (0x9b4a bytes) 000884 1788754160.142558 punch from 0x0021dc to 0x008281 (0x60a6 bytes) 000885 1788754160.151095 MIRROR_RESYNC 8 mirrors 000886 1788754161.212031 punch from 0x02f284 to 0x035944 (0x66c1 bytes) 000888 1788754161.285157 punch from 0x01a22f to 0x01b1cc (0xf9e bytes) 000889 1788754161.297991 read 0x004703 thru 0x012149 (0xda47 bytes) 000890 1788754161.337571 fallocate 0x03447a thru 0x035e73 (0x19fa bytes) 000891 1788754161.342901 write 0x0188a8 thru 0x01d95f (0x50b8 bytes) 000892 1788754161.352007 trunc from 0x035e74 to 0x016d53 (0x1f120 bytes) 000893 1788754161.389301 read 0x00f6dd thru 0x015a6b (0x638f bytes) 000894 1788754161.397058 fallocate 0x01dab0 thru 0x0245f0 (0x6b41 bytes) 000895 1788754161.401579 trunc from 0x0245f1 to 0x00323c (0x213b4 bytes) 000896 1788754161.422100 fallocate 0x015012 thru 0x0234d9 (0xe4c8 bytes) 000897 1788754161.433012 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x234da): Mirror 13: 0x4803e98f (stale) Mirror 14: 0x4803e98f (stale) Mirror 15: 0x4803e98f (stale) Mirror 17: 0x4803e98f (stale) Mirror 19: 0x4803e98f (stale) Mirror 20: 0x4803e98f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x234da): Mirror 13: 0x4803e98f (stale) Mirror 14: 0x4803e98f (stale) Mirror 15: 0x4803e98f (stale) Mirror 17: 0x4803e98f (stale) Mirror 19: 0x4803e98f (stale) Mirror 20: 0x4803e98f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x234da: skipped 000898 1788754161.863543 trunc from 0x011f2a to 0x01268b (0x762 bytes) 000899 1788754161.871057 trunc from 0x0234da to 0x01852a (0xafaf bytes) 000901 1788754161.887900 mapread 0x007128 thru 0x013c51 (0xcb2a bytes) 000902 1788754161.938060 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1852b): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1852b): Mirror 13: 0xed66f529 (stale) Mirror 14: 0xed66f529 (stale) Mirror 15: 0xed66f529 (stale) Mirror 17: 0xed66f529 (stale) Mirror 19: 0xed66f529 (stale) Mirror 20: 0xed66f529 (stale) CRC-32 checksum value for chunk [0, 0x1852b): Mirror 1: 0xed66f529 Mirror 21: 0xed66f529 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1852b: skipped 000903 1788754163.061271 read 0x00b04a thru 0x00c4ed (0x14a4 bytes) 000904 1788754163.078356 trunc from 0x01852b to 0x00cc58 (0xb8d2 bytes) 000905 1788754163.148205 mapwrite 0x03f9ea thru 0x03ffff (0x616 bytes) 000906 1788754163.180820 write 0x026336 thru 0x02ed6b (0x8a36 bytes) 000907 1788754163.194664 trunc from 0x040000 to 0x01939e (0x26c61 bytes) 000908 1788754163.208541 trunc from 0x01939f to 0x00ecb7 (0xa6e7 bytes) 000909 1788754163.229030 trunc from 0x00ecb8 to 0x01fea1 (0x111ea bytes) 000910 1788754163.246442 read 0x00a862 thru 0x01a0a1 (0xf840 bytes) 000911 1788754163.256039 write 0x00831d thru 0x00d8a1 (0x5585 bytes) 000912 1788754163.257367 fallocate 0x011539 thru 0x0128c3 (0x138b bytes) 000913 1788754163.262573 fallocate 0x0290cf thru 0x037098 (0xdfca bytes) 000914 1788754163.267626 read 0x0087ad thru 0x01752e (0xed82 bytes) 000915 1788754163.269048 fallocate 0x012301 thru 0x02030a (0xe00a bytes) 000916 1788754163.273046 trunc from 0x014526 to 0x01c9eb (0x84c6 bytes) 000917 1788754163.277109 write 0x03c574 thru 0x03de85 (0x1912 bytes) 000918 1788754163.278252 write 0x027dd2 thru 0x02dfb2 (0x61e1 bytes) 000919 1788754163.288761 fallocate 0x02c2c8 thru 0x036afa (0xa833 bytes) 000920 1788754163.293774 trunc from 0x03880b to 0x03de85 (0x567b bytes) 000921 1788754163.310657 trunc from 0x03de86 to 0x02c5c8 (0x118bd bytes) 000922 1788754163.333272 trunc from 0x02bcf1 to 0x02c5c8 (0x8d8 bytes) 000923 1788754163.342193 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c5c9): Mirror 13: 0xf36b4330 (stale) Mirror 14: 0xf36b4330 (stale) Mirror 15: 0xf36b4330 (stale) Mirror 19: 0xf36b4330 (stale) Mirror 20: 0xf36b4330 (stale) Mirror 21: 0xf36b4330 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c5c9): Mirror 13: 0xf36b4330 (stale) Mirror 14: 0xf36b4330 (stale) Mirror 15: 0xf36b4330 (stale) Mirror 19: 0xf36b4330 (stale) Mirror 20: 0xf36b4330 (stale) Mirror 21: 0xf36b4330 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c5c9: skipped 000924 1788754163.849304 write 0x03b4f0 thru 0x03ffff (0x4b10 bytes) 000925 1788754163.855800 mapread 0x032e9b thru 0x037f0e (0x5074 bytes) 000926 1788754163.870267 fallocate 0x015cfb thru 0x019e06 (0x410c bytes) 000927 1788754163.875238 mapwrite 0x011c59 thru 0x015bdd (0x3f85 bytes) 000928 1788754163.900914 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x93691f1 (stale) Mirror 14: 0x93691f1 (stale) Mirror 15: 0x93691f1 (stale) Mirror 19: 0x93691f1 (stale) Mirror 20: 0x93691f1 (stale) Mirror 21: 0x93691f1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x584c2c40 Mirror 22: 0x584c2c40 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000929 1788754165.669936 write 0x00855e thru 0x010c93 (0x8736 bytes) 000930 1788754165.786912 mapwrite 0x00abf9 thru 0x00c005 (0x140d bytes) 000931 1788754165.838186 fallocate 0x0058db thru 0x008559 (0x2c7f bytes) 000932 1788754165.862744 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x93691f1 (stale) Mirror 14: 0x93691f1 (stale) Mirror 15: 0x93691f1 (stale) Mirror 19: 0x93691f1 (stale) Mirror 20: 0x93691f1 (stale) Mirror 21: 0x93691f1 (stale) Mirror 22: 0x584c2c40 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x845736a7 Mirror 23: 0x845736a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000933 1788754167.049144 mapread 0x019ec0 thru 0x026bdf (0xcd20 bytes) 000934 1788754167.152596 mapread 0x0309e8 thru 0x035407 (0x4a20 bytes) 000935 1788754167.190945 fallocate 0x026298 thru 0x02740b (0x1174 bytes) 000936 1788754167.241665 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x93691f1 (stale) Mirror 14: 0x93691f1 (stale) Mirror 15: 0x93691f1 (stale) Mirror 19: 0x93691f1 (stale) Mirror 20: 0x93691f1 (stale) Mirror 21: 0x93691f1 (stale) Mirror 22: 0x584c2c40 (stale) Mirror 23: 0x845736a7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x845736a7 Mirror 24: 0x845736a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000937 1788754168.636851 trunc from 0x0280d1 to 0x02afed (0x2f1d bytes) 000938 1788754168.689254 trunc from 0x040000 to 0x0310e7 (0xef18 bytes) 000939 1788754168.715135 read 0x005da1 thru 0x00771d (0x197d bytes) 000941 1788754168.721892 fallocate 0x02106e thru 0x030282 (0xf215 bytes) 000942 1788754168.726093 mapread 0x01b8a1 thru 0x02300d (0x776d bytes) 000943 1788754168.743301 fallocate 0x031fc6 thru 0x03adbc (0x8df7 bytes) 000944 1788754168.748038 trunc from 0x016024 to 0x01c645 (0x6622 bytes) 000945 1788754168.752111 trunc from 0x0310e8 to 0x03a2a4 (0x91bd bytes) 000946 1788754168.765217 mapwrite 0x00b8d9 thru 0x01927b (0xd9a3 bytes) 000947 1788754168.810747 trunc from 0x03a2a5 to 0x00719f (0x33105 bytes) 000948 1788754168.825045 read 0x000d11 thru 0x00719f (0x648f bytes) 000949 1788754168.831249 trunc from 0x006d88 to 0x00719f (0x418 bytes) 000950 1788754168.836687 punch from 0x00421e to 0x00719f (0x2f82 bytes) 000951 1788754168.840583 trunc from 0x0071a0 to 0x03c352 (0x351b3 bytes) 000952 1788754168.857063 punch from 0x016025 to 0x01bfca (0x5fa6 bytes) 000954 1788754168.862651 write 0x0282d4 thru 0x02ff46 (0x7c73 bytes) 000955 1788754168.877830 mapread 0x003884 thru 0x00c009 (0x8786 bytes) 000956 1788754168.894654 read 0x02a0d6 thru 0x03851c (0xe447 bytes) 000958 1788754168.896824 read 0x002c41 thru 0x008ac6 (0x5e86 bytes) 000959 1788754168.897637 mapread 0x022b14 thru 0x02e0f9 (0xb5e6 bytes) 000960 1788754168.898948 trunc from 0x03c353 to 0x017963 (0x249ef bytes) 000961 1788754168.918380 mapwrite 0x015406 thru 0x018a09 (0x3604 bytes) 000962 1788754168.945325 trunc from 0x014f0c to 0x018a09 (0x3afe bytes) 000963 1788754168.953786 MIRROR_RESYNC 10 mirrors 000964 1788754170.432655 mapread 0x016e63 thru 0x018a09 (0x1ba7 bytes) 000965 1788754170.453908 trunc from 0x018a0a to 0x009978 (0xf091 bytes) 000966 1788754170.505134 fallocate 0x02f470 thru 0x0331a4 (0x3d35 bytes) 000967 1788754170.516320 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x331a5): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x331a5): Mirror 13: 0x4ba78a8c (stale) Mirror 14: 0x4ba78a8c (stale) Mirror 15: 0x4ba78a8c (stale) Mirror 19: 0x4ba78a8c (stale) Mirror 20: 0x4ba78a8c (stale) Mirror 21: 0x4ba78a8c (stale) Mirror 22: 0x4ba78a8c (stale) Mirror 23: 0x4ba78a8c (stale) Mirror 24: 0x4ba78a8c (stale) CRC-32 checksum value for chunk [0, 0x331a5): Mirror 1: 0x4ba78a8c Mirror 25: 0x4ba78a8c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x331a5: skipped 000968 1788754171.517514 read 0x0299a4 thru 0x029db4 (0x411 bytes) 000969 1788754171.534185 read 0x018dca thru 0x0246e4 (0xb91b bytes) 000971 1788754171.571104 trunc from 0x0331a5 to 0x02f3e2 (0x3dc2 bytes) 000973 1788754171.644171 punch from 0x00ac7e to 0x017c36 (0xcfb9 bytes) 000974 1788754171.650160 mapwrite 0x01e8dc thru 0x02950a (0xac2f bytes) 000975 1788754171.733153 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f3e3): Mirror 13: 0xcf3bd0dd (stale) Mirror 14: 0xcf3bd0dd (stale) Mirror 15: 0xcf3bd0dd (stale) Mirror 19: 0xcf3bd0dd (stale) Mirror 20: 0xcf3bd0dd (stale) Mirror 21: 0xcf3bd0dd (stale) Mirror 22: 0xcf3bd0dd (stale) Mirror 23: 0xcf3bd0dd (stale) Mirror 25: 0xcf3bd0dd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f3e3): Mirror 13: 0xcf3bd0dd (stale) Mirror 14: 0xcf3bd0dd (stale) Mirror 15: 0xcf3bd0dd (stale) Mirror 19: 0xcf3bd0dd (stale) Mirror 20: 0xcf3bd0dd (stale) Mirror 21: 0xcf3bd0dd (stale) Mirror 22: 0xcf3bd0dd (stale) Mirror 23: 0xcf3bd0dd (stale) Mirror 25: 0xcf3bd0dd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f3e3: skipped 000976 1788754172.266021 write 0x03ba93 thru 0x03ffff (0x456d bytes) 000977 1788754172.273895 write 0x00d86e thru 0x014d01 (0x7494 bytes) 000978 1788754172.288913 trunc from 0x036bfe to 0x03742e (0x831 bytes) 000979 1788754172.294124 read 0x00e123 thru 0x01dbd5 (0xfab3 bytes) 000980 1788754172.306921 mapread 0x029656 thru 0x02e5d1 (0x4f7c bytes) 000981 1788754172.324747 mapread 0x02cd3d thru 0x038122 (0xb3e6 bytes) 000982 1788754172.333136 trunc from 0x040000 to 0x01cdb6 (0x23249 bytes) 000984 1788754172.353227 trunc from 0x01cdb7 to 0x03c766 (0x1f9b0 bytes) 000985 1788754172.368990 write 0x0241ef thru 0x0334ab (0xf2bd bytes) 000986 1788754172.382112 punch from 0x01d928 to 0x029b12 (0xc1eb bytes) 000987 1788754172.404004 punch from 0x00059a to 0x00e056 (0xdabd bytes) 000988 1788754172.410997 mapwrite 0x002dc2 thru 0x011daa (0xefe9 bytes) 000989 1788754172.451925 fallocate 0x0300f0 thru 0x03f432 (0xf343 bytes) 000990 1788754172.457909 trunc from 0x008270 to 0x010fc8 (0x8d59 bytes) 000992 1788754172.467889 write 0x01007b thru 0x010c7a (0xc00 bytes) 000993 1788754172.477543 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f433): Mirror 13: 0x342894d (stale) Mirror 14: 0x342894d (stale) Mirror 15: 0x342894d (stale) Mirror 19: 0x342894d (stale) Mirror 20: 0x342894d (stale) Mirror 21: 0x342894d (stale) Mirror 22: 0x342894d (stale) Mirror 25: 0x342894d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f433): Mirror 13: 0x342894d (stale) Mirror 14: 0x342894d (stale) Mirror 15: 0x342894d (stale) Mirror 19: 0x342894d (stale) Mirror 20: 0x342894d (stale) Mirror 21: 0x342894d (stale) Mirror 22: 0x342894d (stale) Mirror 25: 0x342894d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f433: skipped 000994 1788754172.863969 write 0x020bdc thru 0x02b26d (0xa692 bytes) 000995 1788754172.881840 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f433): Mirror 14: 0x342894d (stale) Mirror 15: 0x342894d (stale) Mirror 19: 0x342894d (stale) Mirror 20: 0x342894d (stale) Mirror 21: 0x342894d (stale) Mirror 22: 0x342894d (stale) Mirror 25: 0x342894d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f433): Mirror 14: 0x342894d (stale) Mirror 15: 0x342894d (stale) Mirror 19: 0x342894d (stale) Mirror 20: 0x342894d (stale) Mirror 21: 0x342894d (stale) Mirror 22: 0x342894d (stale) Mirror 25: 0x342894d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f433: skipped 000996 1788754173.279355 write 0x01e316 thru 0x02adf3 (0xcade bytes) 000997 1788754173.294564 mapwrite 0x018c2c thru 0x01cf0c (0x42e1 bytes) 000998 1788754173.335681 trunc from 0x02b9f5 to 0x035578 (0x9b84 bytes) 000999 1788754173.340976 fallocate 0x0391a6 thru 0x03ffff (0x6e5a bytes) 001000 1788754173.345795 write 0x012365 thru 0x01c6db (0xa377 bytes) All operations completed A-OK!