== sanity-flr test 70a: flr mode fsx test ================ 19:56:14 (1787788574) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 8577 skipping zero length zero range truncating to largest ever: 0xe11f 000004 1787788577.397909 trunc from 00000000 to 0x00e11e (0xe11f bytes) 000005 1787788577.433012 punch from 0x00ce0a to 0x00d2ea (0x4e1 bytes) 000006 1787788577.447528 punch from 0x0071a6 to 0x009f7e (0x2dd9 bytes) 000007 1787788577.459400 mapwrite 0x0388c2 thru 0x03ffff (0x773e bytes) 000008 1787788577.566190 mapread 0x02d088 thru 0x02fc7e (0x2bf7 bytes) 000012 1787788577.605131 mapwrite 0x026883 thru 0x02d8ed (0x706b bytes) 000013 1787788577.638823 write 0x026424 thru 0x02e94d (0x852a bytes) fallocating to largest ever: 0x40000 000014 1787788577.643211 fallocate 0x03ecb8 thru 0x03ffff (0x1348 bytes) 000015 1787788577.668261 fallocate 0x01db73 thru 0x028fb3 (0xb441 bytes) 000016 1787788577.680402 write 0x03fcdd thru 0x03ffff (0x323 bytes) 000018 1787788577.686582 read 0x024dc9 thru 0x0286fd (0x3935 bytes) 000019 1787788577.695236 read 0x01c82d thru 0x0271ec (0xa9c0 bytes) 000020 1787788577.710435 write 0x023a60 thru 0x030b5b (0xd0fc bytes) 000021 1787788577.714608 mapread 0x01818e thru 0x01a06b (0x1ede bytes) 000022 1787788577.716596 read 0x0277e3 thru 0x0315ea (0x9e08 bytes) 000023 1787788577.717732 fallocate 0x01388a thru 0x01d6f1 (0x9e68 bytes) 000024 1787788577.724994 read 0x03d729 thru 0x03f68a (0x1f62 bytes) 000025 1787788577.726723 write 0x03a1be thru 0x03ffff (0x5e42 bytes) 000026 1787788577.728057 read 0x01fab2 thru 0x02b056 (0xb5a5 bytes) 000027 1787788577.729755 mapwrite 0x025247 thru 0x02e87a (0x9634 bytes) 000028 1787788577.764883 punch from 0x016d17 to 0x01afd4 (0x42be bytes) 000029 1787788577.771765 mapwrite 0x00b994 thru 0x01088c (0x4ef9 bytes) 000030 1787788577.795384 read 0x03b13c thru 0x03c91d (0x17e2 bytes) 000031 1787788577.796233 mapread 0x0320fe thru 0x03e0de (0xbfe1 bytes) 000033 1787788577.800763 trunc from 0x040000 to 0x02db32 (0x124cd bytes) 000034 1787788577.841148 MIRROR_EXTEND to 2 mirrors 000035 1787788578.515989 read 0x023dbc thru 0x02a121 (0x6366 bytes) 000036 1787788578.526005 punch from 0x020467 to 0x02b9d4 (0xb56e bytes) 000037 1787788578.569112 trunc from 0x013a49 to 0x01ffe6 (0xc59e bytes) 000038 1787788578.574851 trunc from 0x019852 to 0x027096 (0xd845 bytes) 000039 1787788578.580712 fallocate 0x026ae6 thru 0x02e20c (0x7727 bytes) 000040 1787788578.586070 mapwrite 0x037d31 thru 0x03e8e4 (0x6bb4 bytes) 000041 1787788578.656209 mapread 0x02e88a thru 0x03753e (0x8cb5 bytes) 000042 1787788578.669147 read 0x0341e1 thru 0x036aef (0x290f bytes) 000043 1787788578.674429 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) 000044 1787788578.861113 read 0x00fa5d thru 0x0175f4 (0x7b98 bytes) 000045 1787788578.869084 mapread 0x02a20b thru 0x0387f2 (0xe5e8 bytes) 000047 1787788578.914559 punch from 0x012cdc to 0x01e212 (0xb537 bytes) 000048 1787788578.941825 MIRROR_EXTEND to 2 mirrors 000049 1787788579.684055 mapread 0x0289c4 thru 0x02a5fd (0x1c3a bytes) 000050 1787788579.710550 trunc from 0x03e8e5 to 0x01d82c (0x210b8 bytes) 000051 1787788579.779354 mapread 0x01433c thru 0x01b366 (0x702b bytes) 000052 1787788579.789293 read 0x00d89e thru 0x011f4a (0x46ad bytes) 000053 1787788579.789892 read 0x009744 thru 0x012504 (0x8dc1 bytes) 000054 1787788579.803038 trunc from 0x006559 to 0x00a103 (0x3bab bytes) 000055 1787788579.808549 write 0x02853a thru 0x0366fa (0xe1c1 bytes) 000056 1787788579.810385 fallocate 0x01c0c2 thru 0x02a94f (0xe88e bytes) 000057 1787788579.816064 trunc from 0x0366fb to 0x015e9f (0x2085b bytes) 000058 1787788579.838344 write 0x019898 thru 0x01b673 (0x1ddc bytes) 000059 1787788579.839468 read 0x00a700 thru 0x00e464 (0x3d65 bytes) 000060 1787788579.849395 read 0x00e56b thru 0x0134d5 (0x4f6b bytes) 000061 1787788579.850843 trunc from 0x01b674 to 0x00b9e2 (0xfc91 bytes) 000062 1787788579.872258 write 0x020352 thru 0x022779 (0x2428 bytes) 000063 1787788579.873397 mapwrite 0x001e3a thru 0x00541b (0x35e2 bytes) 000064 1787788579.916385 trunc from 0x01fe9a to 0x022779 (0x28e0 bytes) 000065 1787788579.922414 fallocate 0x011af8 thru 0x01e58a (0xca93 bytes) 000066 1787788579.927744 trunc from 0x02277a to 0x021435 (0x1344 bytes) 000067 1787788579.958218 mapwrite 0x03387a thru 0x035607 (0x1d8e bytes) 000068 1787788580.000110 trunc from 0x035608 to 0x0255f5 (0x10012 bytes) 000069 1787788580.025138 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x255f6): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x255f6): Mirror 2: 0x5765a1d3 (stale) CRC-32 checksum value for chunk [0, 0x255f6): Mirror 1: 0x8c3e3137 Mirror 3: 0x8c3e3137 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x255f6: skipped 000070 1787788581.290876 mapread 0x00248c thru 0x00ef23 (0xca98 bytes) 000071 1787788581.318941 punch from 0x005fd8 to 0x00bf5b (0x5f84 bytes) 000072 1787788581.365392 mapread 0x01f1ef thru 0x0255f5 (0x6407 bytes) 000073 1787788581.378870 read 0x019aa8 thru 0x019f92 (0x4eb bytes) 000074 1787788581.380603 read 0x00bc71 thru 0x01b232 (0xf5c2 bytes) 000075 1787788581.401333 fallocate 0x019370 thru 0x028f32 (0xfbc3 bytes) 000076 1787788581.408811 write 0x019476 thru 0x02036b (0x6ef6 bytes) 000077 1787788581.416868 mapread 0x022801 thru 0x0255f5 (0x2df5 bytes) 000078 1787788581.419780 trunc from 0x0255f6 to 0x0153e0 (0x10215 bytes) 000079 1787788581.454170 write 0x03d778 thru 0x03ffff (0x2888 bytes) 000080 1787788581.456620 mapread 0x024ee5 thru 0x02ca7a (0x7b96 bytes) 000081 1787788581.474620 mapwrite 0x02bbfc thru 0x036b35 (0xaf3a bytes) 000082 1787788581.506098 trunc from 0x040000 to 0x018855 (0x277aa bytes) 000083 1787788581.529808 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x18856): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18856): Mirror 2: 0xb8503ac8 (stale) Mirror 3: 0xf8dd2fdf (stale) CRC-32 checksum value for chunk [0, 0x18856): Mirror 1: 0xb56ed7e3 Mirror 4: 0xb56ed7e3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18856: skipped 000084 1787788582.626922 write 0x03d1f9 thru 0x03f1bb (0x1fc3 bytes) 000085 1787788582.687860 read 0x012b7f thru 0x01cbf4 (0xa076 bytes) 000086 1787788582.712869 mapwrite 0x011353 thru 0x015512 (0x41c0 bytes) 000087 1787788582.755072 read 0x002ed3 thru 0x0074ec (0x461a bytes) 000088 1787788582.770055 mapread 0x01aa06 thru 0x022028 (0x7623 bytes) 000089 1787788582.771842 mapread 0x03dc49 thru 0x03f1bb (0x1573 bytes) 000090 1787788582.773581 write 0x03f4c1 thru 0x03ffff (0xb3f bytes) 000091 1787788582.775700 read 0x018a53 thru 0x01dab1 (0x505f bytes) 000092 1787788582.777212 trunc from 0x00ccb3 to 0x017752 (0xaaa0 bytes) 000093 1787788582.783143 mapread 0x025ec0 thru 0x02c01a (0x615b bytes) 000094 1787788582.800508 MIRROR_RESYNC 4 mirrors 000095 1787788584.272842 punch from 0x03ad97 to 0x03ffff (0x5269 bytes) 000096 1787788584.332628 fallocate 0x020b61 thru 0x02a988 (0x9e28 bytes) 000097 1787788584.366822 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd9e9fffb (stale) Mirror 4: 0xd9e9fffb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd9e9fffb (stale) Mirror 4: 0xd9e9fffb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000098 1787788584.736076 mapwrite 0x025d49 thru 0x0324a0 (0xc758 bytes) 000099 1787788584.788985 trunc from 0x040000 to 0x02101c (0x1efe3 bytes) 000100 1787788584.819101 MIRROR_RESYNC 3 mirrors 000101 1787788585.896108 mapwrite 0x02d7bc thru 0x02f5b4 (0x1df9 bytes) 000102 1787788586.002588 trunc from 0x02b73c to 0x02f5b4 (0x3e79 bytes) 000103 1787788586.016107 read 0x011ba1 thru 0x01b90c (0x9d6c bytes) 000104 1787788586.030515 trunc from 0x02f5b5 to 0x0359e0 (0x642c bytes) 000105 1787788586.065774 mapread 0x008d4e thru 0x016aa1 (0xdd54 bytes) 000107 1787788586.083571 write 0x02ee11 thru 0x03097e (0x1b6e bytes) 000108 1787788586.125616 trunc from 0x0359e1 to 0x006293 (0x2f74d bytes) 000109 1787788586.189848 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6294): Mirror 4: 0xeea6b737 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6294): Mirror 4: 0xeea6b737 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6294: skipped 000110 1787788586.668401 mapread 0x001cdc thru 0x006293 (0x45b8 bytes) 000111 1787788586.706245 punch from 0x0014dd to 0x006293 (0x4db7 bytes) 000112 1787788586.715047 write 0x01067f thru 0x014177 (0x3af9 bytes) 000113 1787788586.721425 fallocate 0x016de6 thru 0x023799 (0xc9b4 bytes) 000114 1787788586.737885 write 0x01cb75 thru 0x027271 (0xa6fd bytes) 000115 1787788586.767246 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) 000116 1787788587.047686 mapwrite 0x000806 thru 0x00ea37 (0xe232 bytes) 000117 1787788587.210399 trunc from 0x027272 to 0x0042b0 (0x22fc1 bytes) 000118 1787788587.265572 mapread 0x000e1b thru 0x001101 (0x2e7 bytes) 000119 1787788587.305811 trunc from 0x00322c to 0x0042b0 (0x1085 bytes) 000120 1787788587.325365 punch from 0x001eba to 0x0042b0 (0x23f7 bytes) 000122 1787788587.341107 write 0x00569c thru 0x012722 (0xd087 bytes) 000123 1787788587.344417 fallocate 0x01406b thru 0x01b846 (0x77dc bytes) 000125 1787788587.351408 trunc from 0x01250c to 0x012722 (0x217 bytes) 000127 1787788587.392114 mapread 0x010408 thru 0x012722 (0x231b bytes) 000128 1787788587.422098 fallocate 0x014a3a thru 0x017557 (0x2b1e bytes) 000129 1787788587.441515 mapwrite 0x029416 thru 0x037cf4 (0xe8df bytes) 000130 1787788587.541520 trunc from 0x02576c to 0x033306 (0xdb9b bytes) 000131 1787788587.557517 write 0x031f74 thru 0x03404e (0x20db bytes) 000132 1787788587.580385 punch from 0x005c1e to 0x00d781 (0x7b64 bytes) 000133 1787788587.591232 write 0x00481f thru 0x0106ac (0xbe8e bytes) 000134 1787788587.600490 mapread 0x01feaa thru 0x027bf5 (0x7d4c bytes) 000135 1787788587.610776 trunc from 0x035806 to 0x037cf4 (0x24ef bytes) 000136 1787788587.615871 trunc from 0x037cf5 to 0x028261 (0xfa93 bytes) 000137 1787788587.633365 write 0x025ed1 thru 0x032448 (0xc578 bytes) 000138 1787788587.639399 MIRROR_EXTEND to 2 mirrors 000139 1787788588.417499 trunc from 0x032449 to 0x0150d8 (0x1d370 bytes) 000140 1787788588.502593 read 0x00491e thru 0x008320 (0x3a03 bytes) 000141 1787788588.509243 trunc from 0x00cea4 to 0x013653 (0x67b0 bytes) 000142 1787788588.520162 trunc from 0x0150d9 to 0x018d24 (0x3c4c bytes) 000143 1787788588.544066 fallocate 0x00a9d7 thru 0x0149aa (0x9fd4 bytes) 000144 1787788588.548883 mapread 0x000e43 thru 0x00f2f4 (0xe4b2 bytes) 000145 1787788588.574423 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x18d25): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18d25): Mirror 2: 0x550351df (stale) CRC-32 checksum value for chunk [0, 0x18d25): Mirror 1: 0x33dc722 Mirror 3: 0x33dc722 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18d25: skipped 000146 1787788589.273391 read 0x00954e thru 0x0179a5 (0xe458 bytes) 000147 1787788589.293333 mapread 0x00e5f0 thru 0x014134 (0x5b45 bytes) 000148 1787788589.294039 mapwrite 0x012240 thru 0x021b51 (0xf912 bytes) 000149 1787788589.423241 write 0x0386fb thru 0x03baa7 (0x33ad bytes) 000150 1787788589.425491 read 0x024266 thru 0x031d56 (0xdaf1 bytes) 000151 1787788589.440895 write 0x025ca5 thru 0x029f96 (0x42f2 bytes) 000152 1787788589.443042 punch from 0x02ea5e to 0x0381e2 (0x9785 bytes) 000153 1787788589.461569 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3baa8): Mirror 3: 0x2361cc93 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3baa8): Mirror 3: 0x2361cc93 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3baa8: skipped 000155 1787788589.742004 read 0x01ca21 thru 0x0204de (0x3abe bytes) 000156 1787788589.750085 fallocate 0x03044e thru 0x032a8c (0x263f bytes) 000159 1787788589.757443 mapwrite 0x00132a thru 0x007794 (0x646b bytes) 000160 1787788589.800768 trunc from 0x01804c to 0x01ecbd (0x6c72 bytes) 000161 1787788589.806564 fallocate 0x019f49 thru 0x025780 (0xb838 bytes) 000163 1787788589.812903 mapread 0x0101df thru 0x01fba4 (0xf9c6 bytes) 000164 1787788589.830359 punch from 0x02116d to 0x02f936 (0xe7ca bytes) 000165 1787788589.837458 punch from 0x02d59a to 0x033ab6 (0x651d bytes) 000166 1787788589.842485 trunc from 0x0372bc to 0x03baa7 (0x47ec bytes) 000167 1787788589.852051 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) 000168 1787788589.981056 read 0x00978a thru 0x0184fe (0xed75 bytes) 000171 1787788589.993211 fallocate 0x00c688 thru 0x00f8ec (0x3265 bytes) 000172 1787788590.003349 write 0x0000c7 thru 0x005fe8 (0x5f22 bytes) 000173 1787788590.016596 mapread 0x03672a thru 0x037066 (0x93d bytes) 000174 1787788590.029867 punch from 0x02b67c to 0x036d60 (0xb6e5 bytes) 000175 1787788590.035460 trunc from 0x03baa8 to 0x0319d5 (0xa0d2 bytes) 000176 1787788590.054299 mapread 0x02933e thru 0x0319d5 (0x8698 bytes) 000177 1787788590.068342 fallocate 0x032ed9 thru 0x03c8dd (0x9a05 bytes) 000179 1787788590.073117 mapwrite 0x0076f0 thru 0x011da8 (0xa6b9 bytes) 000181 1787788590.096956 trunc from 0x0082f8 to 0x00deca (0x5bd3 bytes) 000182 1787788590.103431 mapread 0x020ef2 thru 0x0270f3 (0x6202 bytes) 000183 1787788590.113165 mapread 0x005370 thru 0x00e251 (0x8ee2 bytes) 000184 1787788590.121605 trunc from 0x03c8de to 0x02e8b3 (0xe02a bytes) 000185 1787788590.135423 trunc from 0x01eba2 to 0x02d601 (0xea60 bytes) 000186 1787788590.140940 write 0x0292ff thru 0x03920f (0xff11 bytes) 000187 1787788590.146517 trunc from 0x039210 to 0x007be7 (0x31628 bytes) 000188 1787788590.161555 trunc from 0x007be8 to 0x030464 (0x2887d bytes) 000189 1787788590.181856 mapread 0x017946 thru 0x01b8b5 (0x3f70 bytes) 000190 1787788590.195385 fallocate 0x030a7d thru 0x03d814 (0xcd98 bytes) 000191 1787788590.203624 mapwrite 0x012ac4 thru 0x01381e (0xd5b bytes) 000192 1787788590.215932 write 0x039479 thru 0x03ffff (0x6b87 bytes) 000193 1787788590.217200 write 0x02425f thru 0x02f70a (0xb4ac bytes) 000194 1787788590.228741 trunc from 0x03ff4f to 0x03ffff (0xb1 bytes) 000195 1787788590.249902 fallocate 0x034a4c thru 0x03a8fa (0x5eaf bytes) 000196 1787788590.254175 mapread 0x03290a thru 0x038cdd (0x63d4 bytes) 000198 1787788590.263426 mapwrite 0x032b77 thru 0x03b362 (0x87ec bytes) 000199 1787788590.280911 mapwrite 0x0094d9 thru 0x0098a9 (0x3d1 bytes) 000200 1787788590.298994 mapwrite 0x02a383 thru 0x033d5d (0x99db bytes) 000203 1787788590.316532 trunc from 0x03cfe1 to 0x03ffff (0x301f bytes) 000204 1787788590.322620 read 0x004780 thru 0x006c78 (0x24f9 bytes) 000205 1787788590.323599 write 0x00d06e thru 0x018147 (0xb0da bytes) 000206 1787788590.325520 read 0x026752 thru 0x03134d (0xabfc bytes) 000207 1787788590.326513 mapwrite 0x01cae1 thru 0x027134 (0xa654 bytes) 000209 1787788590.359212 write 0x03f72b thru 0x03ffff (0x8d5 bytes) 000210 1787788590.359988 punch from 0x00c29f to 0x00e779 (0x24db bytes) 000212 1787788590.371941 mapwrite 0x000bf8 thru 0x010625 (0xfa2e bytes) 000214 1787788590.454227 write 0x01ddbf thru 0x02cabb (0xecfd bytes) 000216 1787788590.457154 fallocate 0x01d96d thru 0x02d73c (0xfdd0 bytes) 000218 1787788590.463310 mapwrite 0x02d3cf thru 0x0338b3 (0x64e5 bytes) 000219 1787788590.487786 write 0x03b400 thru 0x03ffff (0x4c00 bytes) 000220 1787788590.490262 write 0x034349 thru 0x03ffff (0xbcb7 bytes) 000221 1787788590.492453 trunc from 0x040000 to 0x0019dc (0x3e623 bytes) 000222 1787788590.510255 read 0x00061b thru 0x0019dc (0x13c2 bytes) 000223 1787788590.510902 read 0x001486 thru 0x0019dc (0x557 bytes) 000225 1787788590.512237 mapread 0x001160 thru 0x0019dc (0x87d bytes) 000226 1787788590.515062 fallocate 0x038f29 thru 0x03ab65 (0x1c3d bytes) 000227 1787788590.522060 trunc from 0x03ab66 to 0x00e83d (0x2c328 bytes) 000228 1787788590.540160 trunc from 0x00785f to 0x00e83d (0x6fdf bytes) 000229 1787788590.546400 mapwrite 0x023dde thru 0x030fc7 (0xd1ea bytes) 000230 1787788590.640068 punch from 0x03079c to 0x030fc7 (0x82c bytes) 000231 1787788590.649220 fallocate 0x032828 thru 0x034964 (0x213d bytes) 000232 1787788590.663815 mapwrite 0x0238da thru 0x030bd4 (0xd2fb bytes) 000233 1787788590.731569 trunc from 0x030fc8 to 0x01410a (0x1cebd bytes) 000235 1787788590.748872 write 0x0232a1 thru 0x02fb58 (0xc8b8 bytes) 000238 1787788590.752957 trunc from 0x020ce7 to 0x024576 (0x3890 bytes) 000239 1787788590.769082 mapread 0x02c1fb thru 0x02c76f (0x575 bytes) 000240 1787788590.770507 write 0x00df31 thru 0x0100f4 (0x21c4 bytes) 000241 1787788590.772724 mapwrite 0x029c83 thru 0x036b58 (0xced6 bytes) 000242 1787788590.845997 mapwrite 0x0243c4 thru 0x02ce86 (0x8ac3 bytes) 000243 1787788590.886408 trunc from 0x036b59 to 0x025837 (0x11321 bytes) 000244 1787788590.910341 trunc from 0x006a2b to 0x00dfd0 (0x75a6 bytes) 000245 1787788590.920521 mapwrite 0x01bfc5 thru 0x025189 (0x91c5 bytes) 000246 1787788590.984237 fallocate 0x00fd17 thru 0x01dcf6 (0xdfe0 bytes) 000247 1787788590.993505 MIRROR_EXTEND to 2 mirrors 000248 1787788591.751320 write 0x00f55b thru 0x00f6ae (0x154 bytes) 000249 1787788591.861159 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x25838): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25838): Mirror 2: 0xed73da9e (stale) CRC-32 checksum value for chunk [0, 0x25838): Mirror 1: 0x7acac7f Mirror 3: 0x7acac7f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25838: skipped 000250 1787788593.336475 mapwrite 0x02c46e thru 0x030334 (0x3ec7 bytes) 000252 1787788593.526104 trunc from 0x02caa8 to 0x02da30 (0xf89 bytes) 000253 1787788593.556267 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x30335): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30335): Mirror 2: 0x19f7f3d2 (stale) Mirror 3: 0x4f80105c (stale) CRC-32 checksum value for chunk [0, 0x30335): Mirror 1: 0x54217846 Mirror 4: 0x54217846 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30335: skipped 000254 1787788595.007932 write 0x006031 thru 0x00704a (0x101a bytes) 000255 1787788595.096427 trunc from 0x030335 to 0x030d66 (0xa32 bytes) 000256 1787788595.142363 trunc from 0x030d67 to 0x030f6f (0x209 bytes) 000257 1787788595.189952 punch from 0x013080 to 0x0143b7 (0x1338 bytes) 000258 1787788595.197570 punch from 0x02d1c5 to 0x030f6f (0x3dab bytes) 000259 1787788595.210456 trunc from 0x030f70 to 0x0315e1 (0x672 bytes) 000260 1787788595.239429 mapread 0x000080 thru 0x00c5f1 (0xc572 bytes) 000261 1787788595.283984 trunc from 0x0315e2 to 0x034277 (0x2c96 bytes) 000262 1787788595.302990 punch from 0x004f9f to 0x0073d8 (0x243a bytes) 000263 1787788595.315421 punch from 0x019853 to 0x01fddf (0x658d bytes) 000264 1787788595.323541 fallocate 0x019151 thru 0x01c20b (0x30bb bytes) 000265 1787788595.330415 read 0x00f1dd thru 0x010990 (0x17b4 bytes) 000267 1787788595.331519 trunc from 0x034278 to 0x00a660 (0x29c17 bytes) 000268 1787788595.370840 fallocate 0x01c86c thru 0x0229e2 (0x6177 bytes) 000270 1787788595.385537 mapread 0x01016c thru 0x017eb1 (0x7d46 bytes) 000271 1787788595.400835 punch from 0x01d2ea to 0x01e7c9 (0x14e0 bytes) 000272 1787788595.412273 MIRROR_RESYNC 4 mirrors 000273 1787788596.796856 trunc from 0x0229e3 to 0x0182d1 (0xa711 bytes) 000274 1787788596.844772 mapwrite 0x0186fd thru 0x01fb84 (0x7488 bytes) 000275 1787788596.922622 read 0x003213 thru 0x0065e3 (0x33d1 bytes) 000276 1787788596.928930 fallocate 0x037686 thru 0x037ba3 (0x51e bytes) 000277 1787788596.933618 fallocate 0x025c59 thru 0x0316e9 (0xba91 bytes) 000278 1787788596.938978 mapwrite 0x00c497 thru 0x013561 (0x70cb bytes) 000279 1787788596.972950 read 0x03516e thru 0x0368e6 (0x1779 bytes) 000280 1787788596.986583 read 0x01f224 thru 0x02a946 (0xb723 bytes) 000281 1787788596.987529 trunc from 0x0020b2 to 0x0060bd (0x400c bytes) 000283 1787788596.994457 write 0x00e1b8 thru 0x017bde (0x9a27 bytes) 000284 1787788596.996764 write 0x0344a7 thru 0x03ffff (0xbb59 bytes) 000285 1787788596.999465 trunc from 0x000122 to 0x00ac68 (0xab47 bytes) 000286 1787788597.004966 fallocate 0x03a813 thru 0x03c855 (0x2043 bytes) 000287 1787788597.011189 trunc from 0x027614 to 0x032bda (0xb5c7 bytes) 000288 1787788597.016794 read 0x007d9c thru 0x00d070 (0x52d5 bytes) 000289 1787788597.037609 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x755c223d (stale) Mirror 3: 0x755c223d (stale) Mirror 4: 0x755c223d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x920de9c9 Mirror 5: 0x920de9c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000290 1787788598.414457 punch from 0x0123b6 to 0x020e6e (0xeab9 bytes) 000291 1787788598.469286 read 0x00964a thru 0x0159b0 (0xc367 bytes) 000292 1787788598.481996 write 0x02fe92 thru 0x0366d5 (0x6844 bytes) 000293 1787788598.498895 write 0x03d46b thru 0x03ffff (0x2b95 bytes) 000294 1787788598.511373 mapwrite 0x019e60 thru 0x02755a (0xd6fb bytes) 000295 1787788598.613960 punch from 0x00c747 to 0x00d23d (0xaf7 bytes) 000296 1787788598.621814 trunc from 0x0202f7 to 0x02c478 (0xc182 bytes) 000297 1787788598.634736 fallocate 0x03528f thru 0x03ffff (0xad71 bytes) 000298 1787788598.638617 trunc from 0x004146 to 0x00c9cc (0x8887 bytes) 000299 1787788598.643300 write 0x02d88e thru 0x031028 (0x379b bytes) 000300 1787788598.664084 MIRROR_RESYNC 5 mirrors 000301 1787788600.786605 mapwrite 0x03225e thru 0x03e63c (0xc3df bytes) 000303 1787788600.911073 mapwrite 0x0070a5 thru 0x016db0 (0xfd0c bytes) 000304 1787788600.980550 fallocate 0x0286ca thru 0x02e108 (0x5a3f bytes) 000305 1787788600.987376 trunc from 0x01557f to 0x01cb55 (0x75d7 bytes) 000306 1787788601.002170 write 0x03a3a6 thru 0x03ffff (0x5c5a bytes) 000307 1787788601.004014 write 0x0046aa thru 0x00a4f5 (0x5e4c bytes) 000308 1787788601.008390 trunc from 0x040000 to 0x02d044 (0x12fbb bytes) 000309 1787788601.038902 punch from 0x01cbc8 to 0x02c36c (0xf7a5 bytes) 000310 1787788601.048291 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2d045): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d045): Mirror 2: 0xfb141a12 (stale) Mirror 3: 0xfb141a12 (stale) Mirror 4: 0xfb141a12 (stale) Mirror 5: 0xfb141a12 (stale) CRC-32 checksum value for chunk [0, 0x2d045): Mirror 1: 0xd6780e2b Mirror 6: 0xd6780e2b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d045: skipped 000311 1787788602.355310 write 0x028e94 thru 0x02a970 (0x1add bytes) 000312 1787788602.444548 punch from 0x006974 to 0x0079b7 (0x1044 bytes) 000313 1787788602.450542 read 0x027163 thru 0x02b548 (0x43e6 bytes) 000315 1787788602.461225 punch from 0x01ce7c to 0x02205c (0x51e1 bytes) 000316 1787788602.466469 trunc from 0x011e53 to 0x012de3 (0xf91 bytes) 000317 1787788602.476424 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d045): Mirror 3: 0xfb141a12 (stale) Mirror 4: 0xfb141a12 (stale) Mirror 5: 0xfb141a12 (stale) Mirror 6: 0xd6780e2b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d045): Mirror 3: 0xfb141a12 (stale) Mirror 4: 0xfb141a12 (stale) Mirror 5: 0xfb141a12 (stale) Mirror 6: 0xd6780e2b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d045: skipped 000319 1787788603.114731 punch from 0x0070e1 to 0x0124cb (0xb3eb bytes) 000320 1787788603.127922 trunc from 0x00cad0 to 0x016e54 (0xa385 bytes) 000321 1787788603.138585 trunc from 0x002969 to 0x009cde (0x7376 bytes) 000322 1787788603.151429 trunc from 0x02d045 to 0x00d79c (0x1f8a8 bytes) 000326 1787788603.190575 trunc from 0x00d79d to 0x039c8f (0x2c4f3 bytes) 000327 1787788603.236195 trunc from 0x039c90 to 0x02a536 (0xf759 bytes) 000328 1787788603.253931 punch from 0x020e45 to 0x024a1e (0x3bda bytes) 000329 1787788603.268413 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a537): Mirror 3: 0x6f17b1db (stale) Mirror 4: 0x6f17b1db (stale) Mirror 6: 0xe7267e38 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a537): Mirror 3: 0x6f17b1db (stale) Mirror 4: 0x6f17b1db (stale) Mirror 6: 0xe7267e38 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a537: skipped 000330 1787788603.663402 trunc from 0x02a537 to 0x02c008 (0x1ad2 bytes) 000331 1787788603.706493 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2c009): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c009): Mirror 3: 0x8e2ce98a (stale) Mirror 4: 0x8e2ce98a (stale) Mirror 6: 0x4c8634fc (stale) CRC-32 checksum value for chunk [0, 0x2c009): Mirror 1: 0x79466164 Mirror 7: 0x79466164 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c009: skipped 000332 1787788604.735070 write 0x0044f2 thru 0x00fb91 (0xb6a0 bytes) 000333 1787788604.796734 read 0x01e363 thru 0x01e3fe (0x9c bytes) 000335 1787788604.804544 trunc from 0x00a16a to 0x0146c7 (0xa55e bytes) 000336 1787788604.824331 read 0x01bbe4 thru 0x024fce (0x93eb bytes) 000338 1787788604.842753 trunc from 0x02c009 to 0x02999b (0x266d bytes) 000339 1787788604.863587 write 0x038d4f thru 0x03ffff (0x72b1 bytes) 000340 1787788604.866877 trunc from 0x040000 to 0x00e647 (0x319b8 bytes) 000341 1787788604.911541 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xe648): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe648): Mirror 3: 0xb9debd21 (stale) Mirror 4: 0xb9debd21 (stale) Mirror 6: 0x25ec60a1 (stale) Mirror 7: 0xd4ecda96 (stale) CRC-32 checksum value for chunk [0, 0xe648): Mirror 1: 0x15f11d89 Mirror 8: 0x15f11d89 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe648: skipped 000342 1787788606.245741 write 0x007a09 thru 0x0130ee (0xb6e6 bytes) 000343 1787788606.298797 write 0x03b48d thru 0x03ffff (0x4b73 bytes) 000344 1787788606.301291 trunc from 0x040000 to 0x018416 (0x27be9 bytes) 000345 1787788606.330323 MIRROR_RESYNC 6 mirrors 000346 1787788607.913473 MIRROR_EXTEND to 7 mirrors 000347 1787788609.067824 trunc from 0x009300 to 0x0151dd (0xbede bytes) 000348 1787788609.123993 punch from 0x014484 to 0x018416 (0x3f93 bytes) 000349 1787788609.142670 mapwrite 0x030332 thru 0x03b393 (0xb062 bytes) 000350 1787788609.351730 mapwrite 0x012aa3 thru 0x017b6a (0x50c8 bytes) 000352 1787788609.470836 trunc from 0x03b394 to 0x02abbd (0x107d6 bytes) 000354 1787788609.521108 mapwrite 0x038105 thru 0x03fa43 (0x793f bytes) 000355 1787788609.581293 punch from 0x037416 to 0x03fa43 (0x862e bytes) 000356 1787788609.592415 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fa44): Mirror 4: 0x3fe052db (stale) Mirror 6: 0x3fe052db (stale) Mirror 7: 0x3fe052db (stale) Mirror 8: 0x3fe052db (stale) Mirror 9: 0x3fe052db (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa44): Mirror 4: 0x3fe052db (stale) Mirror 6: 0x3fe052db (stale) Mirror 7: 0x3fe052db (stale) Mirror 8: 0x3fe052db (stale) Mirror 9: 0x3fe052db (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa44: skipped 000357 1787788610.039890 fallocate 0x03abb0 thru 0x03b353 (0x7a4 bytes) 000358 1787788610.046962 mapwrite 0x011c44 thru 0x02066e (0xea2b bytes) 000359 1787788610.108545 fallocate 0x00c7e8 thru 0x012071 (0x588a bytes) 000360 1787788610.115742 read 0x035317 thru 0x03fa43 (0xa72d bytes) 000361 1787788610.128979 trunc from 0x016efe to 0x02414e (0xd251 bytes) 000363 1787788610.138403 fallocate 0x03fa25 thru 0x03ffff (0x5db bytes) 000364 1787788610.144183 read 0x027128 thru 0x02f0ce (0x7fa7 bytes) 000365 1787788610.158938 fallocate 0x01cf83 thru 0x0252c7 (0x8345 bytes) 000366 1787788610.167244 fallocate 0x029619 thru 0x032db0 (0x9798 bytes) 000367 1787788610.176672 write 0x035cb3 thru 0x03ffff (0xa34d bytes) 000368 1787788610.189448 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x64bce68a (stale) Mirror 6: 0x64bce68a (stale) Mirror 8: 0x64bce68a (stale) Mirror 9: 0x64bce68a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x64bce68a (stale) Mirror 6: 0x64bce68a (stale) Mirror 8: 0x64bce68a (stale) Mirror 9: 0x64bce68a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000369 1787788610.606859 fallocate 0x00d37f thru 0x01ca81 (0xf703 bytes) 000370 1787788610.615480 read 0x001bd4 thru 0x0110b8 (0xf4e5 bytes) 000371 1787788610.627195 fallocate 0x01655c thru 0x020ce4 (0xa789 bytes) 000372 1787788610.632484 write 0x01a895 thru 0x020e49 (0x65b5 bytes) 000373 1787788610.648399 punch from 0x002eda to 0x003332 (0x459 bytes) 000374 1787788610.654165 trunc from 0x040000 to 0x02e80a (0x117f5 bytes) 000375 1787788610.672491 fallocate 0x01eafa thru 0x0277a6 (0x8cad bytes) 000376 1787788610.679480 fallocate 0x0236a7 thru 0x02f1a3 (0xbafd bytes) 000377 1787788610.685997 read 0x008cf6 thru 0x0128bd (0x9bc8 bytes) 000378 1787788610.694982 trunc from 0x00aaa2 to 0x018ea3 (0xe402 bytes) 000379 1787788610.699117 fallocate 0x005ad4 thru 0x005e9b (0x3c8 bytes) 000380 1787788610.702223 read 0x01b601 thru 0x01de15 (0x2815 bytes) 000381 1787788610.702876 punch from 0x0160f4 to 0x0247c1 (0xe6ce bytes) 000382 1787788610.713328 trunc from 0x01b498 to 0x020b7c (0x56e5 bytes) 000383 1787788610.717328 trunc from 0x02f1a4 to 0x02ee9e (0x305 bytes) 000384 1787788610.733456 fallocate 0x015711 thru 0x01ec08 (0x94f8 bytes) 000386 1787788610.739594 trunc from 0x00aa45 to 0x013c9a (0x9256 bytes) 000387 1787788610.745096 fallocate 0x025fa5 thru 0x031578 (0xb5d4 bytes) 000388 1787788610.750495 write 0x002288 thru 0x003baa (0x1923 bytes) 000389 1787788610.752421 trunc from 0x02ee9f to 0x02d844 (0x165a bytes) 000391 1787788610.768367 trunc from 0x018344 to 0x01f116 (0x6dd3 bytes) 000392 1787788610.773591 mapread 0x02cd39 thru 0x02d844 (0xb0c bytes) 000393 1787788610.775090 mapread 0x01fe68 thru 0x022e6e (0x3007 bytes) 000394 1787788610.794827 trunc from 0x02d845 to 0x02a5fb (0x3249 bytes) 000395 1787788610.810401 punch from 0x02a05c to 0x02a5fb (0x5a0 bytes) 000396 1787788610.816128 punch from 0x0000a5 to 0x003bf1 (0x3b4d bytes) 000397 1787788610.834011 punch from 0x00485a to 0x00b223 (0x69ca bytes) 000398 1787788610.840070 mapread 0x00d782 thru 0x016560 (0x8ddf bytes) 000399 1787788610.846680 fallocate 0x005f1c thru 0x00815e (0x2243 bytes) 000400 1787788610.855534 punch from 0x00063f to 0x00af32 (0xa8f4 bytes) 000401 1787788610.867226 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a5fc): Mirror 6: 0x76e0585c (stale) Mirror 8: 0x76e0585c (stale) Mirror 9: 0x76e0585c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a5fc): Mirror 6: 0x76e0585c (stale) Mirror 8: 0x76e0585c (stale) Mirror 9: 0x76e0585c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a5fc: skipped 000402 1787788611.175442 fallocate 0x02a5bc thru 0x02fd09 (0x574e bytes) 000403 1787788611.187019 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a5fc): Mirror 8: 0x76e0585c (stale) Mirror 9: 0x76e0585c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a5fc): Mirror 8: 0x76e0585c (stale) Mirror 9: 0x76e0585c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a5fc: skipped 000404 1787788611.499522 mapwrite 0x01fcce thru 0x0226e8 (0x2a1b bytes) 000405 1787788611.542850 write 0x03c77c thru 0x03ffff (0x3884 bytes) 000406 1787788611.549418 trunc from 0x040000 to 0x00b874 (0x3478b bytes) 000407 1787788611.570499 trunc from 0x00b875 to 0x0043d6 (0x749e bytes) 000408 1787788611.599353 trunc from 0x0043d7 to 0x008bb2 (0x47dc bytes) 000410 1787788611.624347 mapread 0x003d5f thru 0x008bb2 (0x4e54 bytes) 000411 1787788611.637477 punch from 0x0008b4 to 0x008bb2 (0x82ff bytes) 000413 1787788611.645717 punch from 0x0018ec to 0x007454 (0x5b69 bytes) 000414 1787788611.651315 fallocate 0x032bde thru 0x03e885 (0xbca8 bytes) 000415 1787788611.657019 read 0x036575 thru 0x03e885 (0x8311 bytes) 000416 1787788611.668410 mapwrite 0x03be4f thru 0x03ffff (0x41b1 bytes) 000417 1787788611.711034 mapwrite 0x038601 thru 0x03ffff (0x79ff bytes) 000418 1787788611.729510 mapwrite 0x0019e8 thru 0x007ec4 (0x64dd bytes) 000419 1787788611.754577 trunc from 0x040000 to 0x017db2 (0x2824d bytes) 000420 1787788611.770186 mapwrite 0x031d7b thru 0x0373d8 (0x565e bytes) 000421 1787788611.814406 punch from 0x0133a1 to 0x0201e1 (0xce41 bytes) 000422 1787788611.820205 fallocate 0x01cefe thru 0x01e604 (0x1707 bytes) 000423 1787788611.826080 write 0x025ed5 thru 0x02df72 (0x809e bytes) 000424 1787788611.835457 read 0x01ce32 thru 0x02ae98 (0xe067 bytes) 000425 1787788611.844430 read 0x007ef9 thru 0x0127b8 (0xa8c0 bytes) 000426 1787788611.846326 mapread 0x003028 thru 0x0121ad (0xf186 bytes) 000427 1787788611.847592 punch from 0x0017cd to 0x00db3f (0xc373 bytes) 000428 1787788611.853185 trunc from 0x0373d9 to 0x030e8a (0x654e bytes) 000429 1787788611.872278 read 0x01f2aa thru 0x022abc (0x3813 bytes) 000431 1787788611.875447 trunc from 0x006089 to 0x006165 (0xdd bytes) 000432 1787788611.887446 MIRROR_RESYNC 3 mirrors 000433 1787788613.395682 mapwrite 0x03247d thru 0x03ffff (0xdb83 bytes) 000434 1787788613.526431 MIRROR_RESYNC 3 mirrors 000435 1787788614.616194 fallocate 0x01a292 thru 0x022665 (0x83d4 bytes) 000437 1787788614.665022 trunc from 0x015632 to 0x02073c (0xb10b bytes) 000438 1787788614.675504 write 0x005872 thru 0x010e46 (0xb5d5 bytes) 000439 1787788614.703487 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x437820eb (stale) Mirror 9: 0x437820eb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x99fc2d01 Mirror 10: 0x99fc2d01 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000440 1787788615.999612 punch from 0x024a9a to 0x03189a (0xce01 bytes) 000441 1787788616.082465 trunc from 0x0174cf to 0x01d9f3 (0x6525 bytes) 000442 1787788616.088862 trunc from 0x031d1b to 0x032986 (0xc6c bytes) 000443 1787788616.102073 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x437820eb (stale) Mirror 9: 0x437820eb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x437820eb (stale) Mirror 9: 0x437820eb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000444 1787788616.577085 read 0x017cdc thru 0x02013e (0x8463 bytes) 000445 1787788616.596359 mapread 0x005e0e thru 0x00a963 (0x4b56 bytes) 000447 1787788616.615405 trunc from 0x01ac8b to 0x01b199 (0x50f bytes) 000448 1787788616.620481 mapread 0x0339ac thru 0x037973 (0x3fc8 bytes) 000449 1787788616.636051 write 0x03d224 thru 0x03d35c (0x139 bytes) 000450 1787788616.655277 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x437820eb (stale) Mirror 9: 0x437820eb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa4616f65 Mirror 10: 0xa4616f65 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000451 1787788617.646241 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x437820eb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x437820eb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa4616f65 Mirror 10: 0xa4616f65 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000452 1787788618.265257 trunc from 0x0249c0 to 0x030a7a (0xc0bb bytes) 000453 1787788618.399439 read 0x031898 thru 0x03328b (0x19f4 bytes) 000454 1787788618.414385 punch from 0x0280d3 to 0x02f058 (0x6f86 bytes) 000455 1787788618.422428 mapwrite 0x00a13e thru 0x00a18f (0x52 bytes) 000456 1787788618.454709 write 0x01fbb1 thru 0x021213 (0x1663 bytes) 000457 1787788618.479552 write 0x026d10 thru 0x035101 (0xe3f2 bytes) 000458 1787788618.508256 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x437820eb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x437820eb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000459 1787788619.035904 trunc from 0x040000 to 0x03cbd9 (0x3426 bytes) 000460 1787788619.092132 read 0x00a1b5 thru 0x0168bc (0xc708 bytes) 000461 1787788619.112398 fallocate 0x01b97a thru 0x01e07f (0x2706 bytes) 000462 1787788619.120888 write 0x01149d thru 0x01a4b8 (0x901c bytes) 000463 1787788619.136388 fallocate 0x027844 thru 0x0376db (0xfe98 bytes) 000465 1787788619.150766 trunc from 0x005d58 to 0x00edef (0x9098 bytes) 000466 1787788619.163422 fallocate 0x024465 thru 0x032b61 (0xe6fd bytes) 000467 1787788619.176505 write 0x033320 thru 0x035e08 (0x2ae9 bytes) 000468 1787788619.193315 read 0x00f29e thru 0x01131a (0x207d bytes) 000469 1787788619.194816 trunc from 0x03cbda to 0x02a741 (0x12498 bytes) 000470 1787788619.220477 fallocate 0x01567f thru 0x022efc (0xd87e bytes) 000471 1787788619.228353 punch from 0x01df99 to 0x02897e (0xa9e6 bytes) 000472 1787788619.234578 read 0x013dcb thru 0x013fe9 (0x21f bytes) 000474 1787788619.235838 mapread 0x020c6e thru 0x02a741 (0x9ad4 bytes) 000475 1787788619.253248 trunc from 0x00bf63 to 0x01540e (0x94ac bytes) 000476 1787788619.274675 mapwrite 0x01e8ef thru 0x022287 (0x3999 bytes) 000477 1787788619.292365 punch from 0x028e12 to 0x02a741 (0x1930 bytes) 000478 1787788619.298328 trunc from 0x02a742 to 0x012526 (0x1821b bytes) 000479 1787788619.324439 trunc from 0x012527 to 0x01f151 (0xcc2b bytes) 000480 1787788619.343160 mapread 0x010379 thru 0x0178ce (0x7556 bytes) 000481 1787788619.386269 punch from 0x000b7b to 0x001c1b (0x10a1 bytes) 000482 1787788619.392495 read 0x01e2d2 thru 0x01f151 (0xe80 bytes) 000483 1787788619.401552 read 0x018926 thru 0x01f151 (0x682c bytes) 000484 1787788619.402364 write 0x0091e8 thru 0x00d14d (0x3f66 bytes) 000486 1787788619.405525 read 0x00b85d thru 0x012060 (0x6804 bytes) 000487 1787788619.406370 read 0x00c931 thru 0x00e2c1 (0x1991 bytes) 000488 1787788619.407395 mapwrite 0x01d2ae thru 0x02282a (0x557d bytes) 000489 1787788619.474530 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2282b): Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2282b): Mirror 9: 0xce9f2ff0 (stale) CRC-32 checksum value for chunk [0, 0x2282b): Mirror 1: 0xc3fcea5d Mirror 10: 0xc3fcea5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2282b: skipped 000490 1787788620.497280 punch from 0x017fd9 to 0x020923 (0x894b bytes) 000491 1787788620.549496 punch from 0x000782 to 0x0036c8 (0x2f47 bytes) 000492 1787788620.555215 mapread 0x018ba0 thru 0x02282a (0x9c8b bytes) 000493 1787788620.583032 trunc from 0x0005c9 to 0x00f6d3 (0xf10b bytes) 000494 1787788620.592219 write 0x004024 thru 0x0062f6 (0x22d3 bytes) 000496 1787788620.620929 trunc from 0x008092 to 0x017381 (0xf2f0 bytes) 000497 1787788620.636335 trunc from 0x02282b to 0x025b1b (0x32f1 bytes) 000498 1787788620.737291 trunc from 0x025b1c to 0x003c20 (0x21efb bytes) 000499 1787788620.762208 fallocate 0x036df7 thru 0x039adf (0x2ce9 bytes) 000501 1787788620.771477 write 0x007c83 thru 0x00cea7 (0x5225 bytes) 000502 1787788620.794177 read 0x02d638 thru 0x033f62 (0x692b bytes) 000503 1787788620.808188 fallocate 0x0355c1 thru 0x03a418 (0x4e58 bytes) 000504 1787788620.824089 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a419): Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a419): Mirror 9: 0x7edf4bef (stale) Mirror 10: 0xc2d63439 (stale) CRC-32 checksum value for chunk [0, 0x3a419): Mirror 1: 0x19cfa612 Mirror 11: 0x19cfa612 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a419: skipped 000505 1787788621.902407 punch from 0x014cee to 0x0182e0 (0x35f3 bytes) 000506 1787788621.968960 mapwrite 0x0076be thru 0x00845b (0xd9e bytes) 000507 1787788622.016553 punch from 0x012bf8 to 0x016509 (0x3912 bytes) 000508 1787788622.028811 trunc from 0x03a419 to 0x0365a6 (0x3e72 bytes) 000509 1787788622.072576 trunc from 0x0365a7 to 0x00a67d (0x2bf29 bytes) 000510 1787788622.098150 trunc from 0x00a67e to 0x018b60 (0xe4e3 bytes) 000511 1787788622.127583 MIRROR_RESYNC 4 mirrors 000513 1787788623.068234 fallocate 0x02d193 thru 0x031beb (0x4a59 bytes) 000514 1787788623.091850 trunc from 0x018b61 to 0x03280f (0x19caf bytes) 000515 1787788623.110110 mapread 0x00589d thru 0x014cdd (0xf441 bytes) 000516 1787788623.159874 fallocate 0x01e0a6 thru 0x02d5f7 (0xf552 bytes) 000517 1787788623.176983 fallocate 0x03fe6e thru 0x03ffff (0x192 bytes) 000518 1787788623.185049 mapread 0x0158df thru 0x01a47f (0x4ba1 bytes) 000519 1787788623.213158 fallocate 0x01c149 thru 0x02ac31 (0xeae9 bytes) 000520 1787788623.234551 punch from 0x026a5d to 0x02f671 (0x8c15 bytes) 000522 1787788623.242103 fallocate 0x03646b thru 0x03ffff (0x9b95 bytes) 000523 1787788623.247702 fallocate 0x026f92 thru 0x031ee6 (0xaf55 bytes) 000524 1787788623.255319 punch from 0x018eb9 to 0x020bfe (0x7d46 bytes) 000525 1787788623.266631 mapwrite 0x027eeb thru 0x0295d7 (0x16ed bytes) 000526 1787788623.303056 fallocate 0x01b12c thru 0x01c25c (0x1131 bytes) 000529 1787788623.315029 trunc from 0x040000 to 0x02f2a9 (0x10d56 bytes) 000530 1787788623.350202 trunc from 0x02f2aa to 0x007384 (0x27f25 bytes) 000531 1787788623.376014 read 0x001ab3 thru 0x007384 (0x58d2 bytes) 000532 1787788623.381144 MIRROR_RESYNC 4 mirrors 000534 1787788624.473458 punch from 0x007271 to 0x007384 (0x114 bytes) 000535 1787788624.525989 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x7385): Mirror 10: 0xb4726d0d (stale) Mirror 11: 0xb4726d0d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7385): Mirror 10: 0xb4726d0d (stale) Mirror 11: 0xb4726d0d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7385: skipped 000536 1787788625.024292 read 0x001264 thru 0x007384 (0x6121 bytes) 000537 1787788625.041295 punch from 0x0010d2 to 0x007384 (0x62b3 bytes) 000538 1787788625.050886 read 0x002c5c thru 0x007384 (0x4729 bytes) 000539 1787788625.070104 MIRROR_RESYNC 3 mirrors 000540 1787788625.736899 punch from 0x006340 to 0x007384 (0x1045 bytes) 000541 1787788625.786472 write 0x00c8a8 thru 0x019d43 (0xd49c bytes) 000542 1787788625.791064 trunc from 0x019d44 to 0x036230 (0x1c4ed bytes) 000543 1787788625.819124 punch from 0x02caac to 0x036230 (0x9785 bytes) 000544 1787788625.828194 write 0x026842 thru 0x0360b8 (0xf877 bytes) 000545 1787788625.846351 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36231): Mirror 11: 0x5813b42e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36231): Mirror 11: 0x5813b42e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36231: skipped 000546 1787788626.204886 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x36231): Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36231): Mirror 11: 0x5813b42e (stale) CRC-32 checksum value for chunk [0, 0x36231): Mirror 1: 0x32c1e632 Mirror 12: 0x32c1e632 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36231: skipped 000547 1787788627.517910 write 0x03cbf9 thru 0x03ffff (0x3407 bytes) 000548 1787788627.572165 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x7505eaff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x7505eaff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000549 1787788627.971390 read 0x024ad8 thru 0x026dac (0x22d5 bytes) 000550 1787788627.978440 trunc from 0x040000 to 0x03b353 (0x4cac bytes) 000551 1787788628.009333 read 0x01e750 thru 0x0207f6 (0x20a7 bytes) 000552 1787788628.048408 read 0x025479 thru 0x02f3e8 (0x9f70 bytes) 000553 1787788628.058057 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b354): Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b354): Mirror 12: 0x63f9064a (stale) CRC-32 checksum value for chunk [0, 0x3b354): Mirror 1: 0x63f9064a Mirror 13: 0x63f9064a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b354: skipped 000554 1787788629.204274 fallocate 0x03d700 thru 0x03ffff (0x2900 bytes) 000555 1787788629.249166 trunc from 0x040000 to 0x03611c (0x9ee3 bytes) 000556 1787788629.290165 read 0x032cd3 thru 0x03611c (0x344a bytes) 000557 1787788629.298718 write 0x00b5b6 thru 0x01833c (0xcd87 bytes) 000558 1787788629.316412 trunc from 0x03611d to 0x03a8dd (0x47c1 bytes) 000559 1787788629.335196 trunc from 0x03a8de to 0x030018 (0xa8c5 bytes) 000560 1787788629.372780 mapread 0x000393 thru 0x003306 (0x2f74 bytes) 000561 1787788629.417167 fallocate 0x0151f2 thru 0x01a49e (0x52ad bytes) 000564 1787788629.435250 mapwrite 0x00bd56 thru 0x017ca0 (0xbf4b bytes) 000565 1787788629.494172 mapread 0x0278a3 thru 0x02a10b (0x2869 bytes) 000566 1787788629.513199 mapwrite 0x00d8ba thru 0x018bb2 (0xb2f9 bytes) 000567 1787788629.546690 punch from 0x024137 to 0x026ae2 (0x29ac bytes) 000568 1787788629.556335 read 0x02f7d2 thru 0x030018 (0x847 bytes) 000569 1787788629.572539 punch from 0x00f3db to 0x00f746 (0x36c bytes) 000570 1787788629.582361 mapread 0x0160dd thru 0x0222d3 (0xc1f7 bytes) 000571 1787788629.585865 read 0x01c684 thru 0x02a0d3 (0xda50 bytes) 000572 1787788629.586989 write 0x0009eb thru 0x001bb4 (0x11ca bytes) 000573 1787788629.588144 mapread 0x007167 thru 0x00d79c (0x6636 bytes) 000574 1787788629.590102 mapwrite 0x024b29 thru 0x024edf (0x3b7 bytes) 000575 1787788629.623667 MIRROR_RESYNC 3 mirrors 000576 1787788630.986074 mapwrite 0x03e549 thru 0x03ffff (0x1ab7 bytes) 000578 1787788631.066557 punch from 0x0381bc to 0x039f2a (0x1d6f bytes) 000579 1787788631.073373 punch from 0x014677 to 0x024320 (0xfcaa bytes) 000581 1787788631.080109 trunc from 0x021fe4 to 0x02739e (0x53bb bytes) 000582 1787788631.085999 write 0x0100f5 thru 0x01c60d (0xc519 bytes) 000583 1787788631.098611 trunc from 0x040000 to 0x001082 (0x3ef7d bytes) 000584 1787788631.120806 write 0x00fc27 thru 0x01c854 (0xcc2e bytes) 000585 1787788631.122746 write 0x033fcf thru 0x036da4 (0x2dd6 bytes) 000586 1787788631.127020 trunc from 0x036da5 to 0x023000 (0x13da4 bytes) 000587 1787788631.153755 mapwrite 0x02c8cb thru 0x02cff5 (0x72b bytes) 000588 1787788631.236862 punch from 0x02bad6 to 0x02cff5 (0x1520 bytes) 000589 1787788631.243341 mapread 0x002732 thru 0x002823 (0xf2 bytes) 000590 1787788631.257201 read 0x00972b thru 0x00f418 (0x5cee bytes) 000591 1787788631.258004 trunc from 0x0092cb to 0x00f116 (0x5e4c bytes) 000592 1787788631.272179 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2cff6): Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cff6): Mirror 12: 0x9663ab26 (stale) Mirror 13: 0x9663ab26 (stale) CRC-32 checksum value for chunk [0, 0x2cff6): Mirror 1: 0x4424cd88 Mirror 14: 0x4424cd88 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cff6: skipped 000594 1787788632.340563 write 0x019b97 thru 0x026c95 (0xd0ff bytes) 000595 1787788632.400029 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2cff6): Mirror 13: 0x9663ab26 (stale) Mirror 14: 0x4424cd88 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cff6): Mirror 13: 0x9663ab26 (stale) Mirror 14: 0x4424cd88 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cff6: skipped 000596 1787788632.891584 mapread 0x021f95 thru 0x022cf8 (0xd64 bytes) 000597 1787788632.909094 fallocate 0x03d90f thru 0x03ffff (0x26f1 bytes) 000598 1787788632.918244 punch from 0x025f41 to 0x02cff5 (0x70b5 bytes) 000599 1787788632.925116 trunc from 0x00caf3 to 0x00f4af (0x29bd bytes) 000601 1787788632.932246 read 0x017d83 thru 0x020b2f (0x8dad bytes) 000602 1787788632.948532 trunc from 0x02cff6 to 0x02b913 (0x16e2 bytes) 000603 1787788633.009462 MIRROR_RESYNC 3 mirrors 000604 1787788633.995257 fallocate 0x038f96 thru 0x03ffff (0x706a bytes) 000605 1787788634.042887 trunc from 0x01c3c2 to 0x02710d (0xad4c bytes) 000606 1787788634.050461 read 0x03ded2 thru 0x03ffff (0x212e bytes) 000607 1787788634.057211 trunc from 0x02b976 to 0x03075a (0x4de5 bytes) 000608 1787788634.068423 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x2ae6bd49 (stale) Mirror 14: 0x2ae6bd49 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x80e6a4e Mirror 15: 0x80e6a4e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000609 1787788635.060836 mapread 0x0121b9 thru 0x0204f9 (0xe341 bytes) 000610 1787788635.099869 read 0x0368e1 thru 0x03d611 (0x6d31 bytes) 000611 1787788635.111420 MIRROR_RESYNC 4 mirrors 000612 1787788635.993588 trunc from 0x03fab8 to 0x03ffff (0x548 bytes) 000613 1787788636.053397 trunc from 0x002ceb to 0x012a41 (0xfd57 bytes) 000614 1787788636.063248 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x80e6a4e (stale) Mirror 14: 0x80e6a4e (stale) Mirror 15: 0x80e6a4e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfc87ea0c Mirror 16: 0xfc87ea0c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000615 1787788637.159328 trunc from 0x034881 to 0x03ffff (0xb77f bytes) 000616 1787788637.202782 trunc from 0x040000 to 0x0094b1 (0x36b4e bytes) 000617 1787788637.229257 trunc from 0x007986 to 0x0094b1 (0x1b2c bytes) 000619 1787788637.239347 trunc from 0x001816 to 0x0094b1 (0x7c9c bytes) 000620 1787788637.245058 fallocate 0x03a5cd thru 0x03ffff (0x5a33 bytes) 000621 1787788637.250116 read 0x0372cd thru 0x03fcd2 (0x8a06 bytes) 000622 1787788637.261421 punch from 0x008f5f to 0x00f660 (0x6702 bytes) 000623 1787788637.266259 mapread 0x02d90a thru 0x037b0c (0xa203 bytes) 000624 1787788637.295799 fallocate 0x02a902 thru 0x02fe84 (0x5583 bytes) 000625 1787788637.304109 punch from 0x017127 to 0x017c8b (0xb65 bytes) 000626 1787788637.311070 trunc from 0x040000 to 0x028357 (0x17ca8 bytes) 000627 1787788637.337785 MIRROR_RESYNC 5 mirrors 000628 1787788638.133217 fallocate 0x01b000 thru 0x026a49 (0xba4a bytes) 000629 1787788638.180356 read 0x00ecf3 thru 0x01d3ea (0xe6f8 bytes) 000631 1787788638.194889 fallocate 0x0262a6 thru 0x027e06 (0x1b61 bytes) 000632 1787788638.204887 trunc from 0x028358 to 0x03425d (0xbf06 bytes) 000633 1787788638.247547 fallocate 0x02dd5f thru 0x02e7fc (0xa9e bytes) 000634 1787788638.259685 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3425e): Mirror 14: 0x2c436c4e (stale) Mirror 15: 0x2c436c4e (stale) Mirror 16: 0x2c436c4e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3425e): Mirror 14: 0x2c436c4e (stale) Mirror 15: 0x2c436c4e (stale) Mirror 16: 0x2c436c4e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3425e: skipped 000635 1787788638.653427 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3425e): Mirror 14: 0x2c436c4e (stale) Mirror 16: 0x2c436c4e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3425e): Mirror 14: 0x2c436c4e (stale) Mirror 16: 0x2c436c4e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3425e: skipped 000636 1787788639.002017 punch from 0x028543 to 0x029ce9 (0x17a7 bytes) 000637 1787788639.010264 punch from 0x034057 to 0x03425d (0x207 bytes) 000638 1787788639.015943 trunc from 0x02795b to 0x03323f (0xb8e5 bytes) 000639 1787788639.021002 trunc from 0x02f9c4 to 0x03425d (0x489a bytes) 000640 1787788639.026159 read 0x009b3d thru 0x00eb7b (0x503f bytes) 000641 1787788639.035058 fallocate 0x0380cd thru 0x03f3d6 (0x730a bytes) 000642 1787788639.040943 trunc from 0x022ecd to 0x030ba4 (0xdcd8 bytes) 000643 1787788639.046349 punch from 0x013cec to 0x01d935 (0x9c4a bytes) 000644 1787788639.056086 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3f3d7): Mirror 14: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f3d7): Mirror 14: 0xbe459c7c (stale) Mirror 16: 0xbe459c7c (stale) CRC-32 checksum value for chunk [0, 0x3f3d7): Mirror 1: 0xbe459c7c Mirror 17: 0xbe459c7c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f3d7: skipped 000645 1787788640.017451 mapread 0x034fd4 thru 0x0372be (0x22eb bytes) 000646 1787788640.056031 mapread 0x003471 thru 0x008143 (0x4cd3 bytes) 000647 1787788640.076035 read 0x03e8e6 thru 0x03f3d6 (0xaf1 bytes) 000648 1787788640.082408 fallocate 0x028972 thru 0x034382 (0xba11 bytes) 000649 1787788640.152328 MIRROR_RESYNC 4 mirrors 000650 1787788641.325751 mapread 0x02637b thru 0x02aa4e (0x46d4 bytes) 000651 1787788641.372823 trunc from 0x03d8d0 to 0x03f3d6 (0x1b07 bytes) 000652 1787788641.457119 write 0x030f09 thru 0x035581 (0x4679 bytes) 000653 1787788641.482456 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f3d7): Mirror 14: 0xbe459c7c (stale) Mirror 17: 0xbe459c7c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f3d7): Mirror 14: 0xbe459c7c (stale) Mirror 17: 0xbe459c7c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f3d7: skipped 000654 1787788641.865168 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f3d7): Mirror 14: 0xbe459c7c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f3d7): Mirror 14: 0xbe459c7c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f3d7: skipped 000655 1787788642.206682 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) 000656 1787788642.372091 write 0x011dc6 thru 0x01d63e (0xb879 bytes) 000657 1787788642.393946 trunc from 0x03f3d7 to 0x013889 (0x2bb4d bytes) 000658 1787788642.421937 mapread 0x006564 thru 0x007391 (0xe2e bytes) 000659 1787788642.437158 fallocate 0x018091 thru 0x02512f (0xd09f bytes) 000660 1787788642.444988 trunc from 0x025130 to 0x001007 (0x24128 bytes) 000661 1787788642.470980 trunc from 0x001008 to 0x01afa6 (0x19f9f bytes) 000662 1787788642.499945 mapread 0x003cf7 thru 0x005a95 (0x1d9f bytes) 000663 1787788642.513184 mapread 0x00c098 thru 0x00e804 (0x276d bytes) 000664 1787788642.516562 mapwrite 0x03c0f2 thru 0x03ffff (0x3f0e bytes) 000665 1787788642.578514 MIRROR_EXTEND to 2 mirrors 000666 1787788643.366132 fallocate 0x005068 thru 0x00ea81 (0x9a1a bytes) 000667 1787788643.409440 trunc from 0x040000 to 0x03fe32 (0x1cd bytes) 000668 1787788643.433924 write 0x01fece thru 0x024f6c (0x509f bytes) 000669 1787788643.443756 write 0x006516 thru 0x009cb4 (0x379f bytes) 000670 1787788643.453295 read 0x028df1 thru 0x02994f (0xb5f bytes) 000671 1787788643.459480 write 0x028c08 thru 0x037a3f (0xee38 bytes) 000672 1787788643.464868 punch from 0x0311ee to 0x03d3fb (0xc20e bytes) 000674 1787788643.495488 read 0x010214 thru 0x01dfd3 (0xddc0 bytes) 000675 1787788643.523847 write 0x03d9fd thru 0x03f014 (0x1618 bytes) 000676 1787788643.524817 mapread 0x02eb56 thru 0x03c5d1 (0xda7c bytes) 000677 1787788643.525751 trunc from 0x03fe33 to 0x021382 (0x1eab0 bytes) 000679 1787788643.545800 write 0x02cbd7 thru 0x03b659 (0xea83 bytes) 000680 1787788643.547628 punch from 0x037926 to 0x03b659 (0x3d34 bytes) 000681 1787788643.567870 trunc from 0x01095d to 0x01e7bf (0xde63 bytes) 000682 1787788643.573103 write 0x010579 thru 0x01df46 (0xd9ce bytes) 000683 1787788643.584123 fallocate 0x00a665 thru 0x019f30 (0xf8cc bytes) 000685 1787788643.590540 write 0x03819d thru 0x03ffff (0x7e63 bytes) 000687 1787788643.601566 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x7ad0be0a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4b813efa Mirror 3: 0x4b813efa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000688 1787788644.462826 trunc from 0x02632c to 0x030317 (0x9fec bytes) 000689 1787788644.513001 trunc from 0x040000 to 0x02beee (0x14111 bytes) 000690 1787788644.539564 read 0x002285 thru 0x005d60 (0x3adc bytes) 000692 1787788644.556483 punch from 0x00a4de to 0x00d41c (0x2f3f bytes) 000693 1787788644.563375 punch from 0x026d18 to 0x02beee (0x51d7 bytes) 000694 1787788644.568409 fallocate 0x017a96 thru 0x022aa6 (0xb011 bytes) 000697 1787788644.583480 trunc from 0x004e49 to 0x0055ee (0x7a6 bytes) 000698 1787788644.588916 punch from 0x00d6d0 to 0x01862f (0xaf60 bytes) 000699 1787788644.594497 punch from 0x002700 to 0x0112f3 (0xebf4 bytes) 000700 1787788644.599356 mapread 0x018c19 thru 0x01b61b (0x2a03 bytes) 000701 1787788644.630700 punch from 0x01ca35 to 0x025d8c (0x9358 bytes) 000702 1787788644.637813 punch from 0x024869 to 0x027ff8 (0x3790 bytes) 000703 1787788644.645549 fallocate 0x0198fb thru 0x02528b (0xb991 bytes) 000704 1787788644.652249 write 0x02a10c thru 0x02e4ea (0x43df bytes) 000705 1787788644.659909 trunc from 0x02d074 to 0x02e4ea (0x1477 bytes) 000706 1787788644.680073 punch from 0x015ef1 to 0x0176ce (0x17de bytes) 000707 1787788644.685614 punch from 0x0078b3 to 0x009c29 (0x2377 bytes) 000708 1787788644.697823 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e4eb): Mirror 3: 0xfe719c66 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e4eb): Mirror 3: 0xfe719c66 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e4eb: skipped 000709 1787788645.006000 mapwrite 0x01acf2 thru 0x01bd75 (0x1084 bytes) 000710 1787788645.032009 fallocate 0x03945d thru 0x03b3f6 (0x1f9a bytes) 000711 1787788645.043045 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b3f7): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b3f7): Mirror 3: 0x45165c4b (stale) CRC-32 checksum value for chunk [0, 0x3b3f7): Mirror 1: 0x3f1370c9 Mirror 4: 0x3f1370c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b3f7: skipped 000712 1787788646.054204 trunc from 0x03b3f7 to 0x016b59 (0x2489d bytes) 000713 1787788646.133595 write 0x00894e thru 0x017d5b (0xf40e bytes) 000714 1787788646.141782 trunc from 0x00e8c1 to 0x017d5b (0x949b bytes) 000715 1787788646.159115 write 0x027cc5 thru 0x03014e (0x848a bytes) 000716 1787788646.161918 trunc from 0x02fd3c to 0x03014e (0x413 bytes) 000717 1787788646.184181 write 0x02c1cb thru 0x03677b (0xa5b1 bytes) 000718 1787788646.187977 fallocate 0x039db3 thru 0x03ffff (0x624d bytes) 000719 1787788646.193464 write 0x03aac0 thru 0x03b0c4 (0x605 bytes) 000720 1787788646.195039 mapread 0x00e803 thru 0x012a4d (0x424b bytes) 000721 1787788646.217261 punch from 0x006a3a to 0x00ac9a (0x4261 bytes) 000722 1787788646.222873 write 0x016caf thru 0x01cde3 (0x6135 bytes) 000723 1787788646.233549 MIRROR_RESYNC 3 mirrors 000724 1787788647.321322 mapwrite 0x03e3df thru 0x03ffff (0x1c21 bytes) 000725 1787788647.403944 punch from 0x01ce03 to 0x02b6c7 (0xe8c5 bytes) 000726 1787788647.411469 read 0x007862 thru 0x00d484 (0x5c23 bytes) 000727 1787788647.427494 MIRROR_RESYNC 3 mirrors 000728 1787788649.222169 read 0x031cf7 thru 0x037290 (0x559a bytes) 000730 1787788649.247986 MIRROR_RESYNC 3 mirrors 000731 1787788649.763139 MIRROR_RESYNC 3 mirrors 000732 1787788650.412458 mapread 0x02f1ef thru 0x03ad2e (0xbb40 bytes) 000733 1787788650.432333 trunc from 0x019831 to 0x026af4 (0xd2c4 bytes) 000734 1787788650.468620 write 0x037ce4 thru 0x03ffff (0x831c bytes) 000735 1787788650.475666 fallocate 0x0146ef thru 0x015288 (0xb9a bytes) 000736 1787788650.483160 write 0x026324 thru 0x032af9 (0xc7d6 bytes) 000737 1787788650.501887 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x21ef0578 (stale) Mirror 4: 0x21ef0578 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5b2e66eb Mirror 5: 0x5b2e66eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000738 1787788651.652729 MIRROR_RESYNC 4 mirrors 000739 1787788652.930541 fallocate 0x001742 thru 0x00eb14 (0xd3d3 bytes) 000740 1787788653.009312 write 0x020946 thru 0x027f1e (0x75d9 bytes) 000741 1787788653.025705 fallocate 0x00e388 thru 0x012d12 (0x498b bytes) 000742 1787788653.032568 mapwrite 0x03c559 thru 0x03ffff (0x3aa7 bytes) 000743 1787788653.131763 mapread 0x0320d9 thru 0x036302 (0x422a bytes) 000745 1787788653.152947 mapwrite 0x024263 thru 0x02cc8d (0x8a2b bytes) 000747 1787788653.189307 mapwrite 0x0266a8 thru 0x03225f (0xbbb8 bytes) 000748 1787788653.244307 write 0x0179e9 thru 0x01f423 (0x7a3b bytes) 000749 1787788653.260941 punch from 0x028faa to 0x02d1fc (0x4253 bytes) 000750 1787788653.272329 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5b2e66eb (stale) Mirror 4: 0x5b2e66eb (stale) Mirror 5: 0x5b2e66eb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x286475b Mirror 6: 0x286475b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000751 1787788654.422311 read 0x020fdc thru 0x029779 (0x879e bytes) 000752 1787788654.436341 fallocate 0x0026c4 thru 0x00e429 (0xbd66 bytes) 000753 1787788654.497126 mapread 0x0339c2 thru 0x03ffff (0xc63e bytes) 000754 1787788654.553862 MIRROR_RESYNC 5 mirrors 000755 1787788656.325221 write 0x033c0d thru 0x03ffff (0xc3f3 bytes) 000756 1787788656.374470 fallocate 0x011e15 thru 0x012f20 (0x110c bytes) 000758 1787788656.385897 fallocate 0x01b18d thru 0x026e7f (0xbcf3 bytes) 000760 1787788656.394081 punch from 0x0109d7 to 0x01a543 (0x9b6d bytes) 000762 1787788656.402078 trunc from 0x040000 to 0x00d8ea (0x32715 bytes) 000763 1787788656.437780 MIRROR_RESYNC 5 mirrors 000765 1787788657.393918 mapread 0x00d582 thru 0x00d8ea (0x369 bytes) 000766 1787788657.401741 trunc from 0x004195 to 0x00c73a (0x85a6 bytes) 000767 1787788657.448297 punch from 0x000f07 to 0x00d8ea (0xc9e4 bytes) 000768 1787788657.454540 fallocate 0x0011c1 thru 0x002cd4 (0x1b14 bytes) 000769 1787788657.459519 punch from 0x006a96 to 0x00b3c3 (0x492e bytes) 000770 1787788657.464282 mapwrite 0x0088f8 thru 0x00de98 (0x55a1 bytes) 000771 1787788657.553706 fallocate 0x009c37 thru 0x015a04 (0xbdce bytes) 000772 1787788657.569408 punch from 0x002e72 to 0x007ea3 (0x5032 bytes) 000773 1787788657.595321 punch from 0x00ecbd to 0x011684 (0x29c8 bytes) 000775 1787788657.627346 trunc from 0x009322 to 0x015543 (0xc222 bytes) 000776 1787788657.636984 mapread 0x003469 thru 0x0085b2 (0x514a bytes) 000777 1787788657.663391 trunc from 0x0110cb to 0x015a04 (0x493a bytes) 000779 1787788657.676230 fallocate 0x033295 thru 0x036fab (0x3d17 bytes) 000780 1787788657.684499 trunc from 0x00b79b to 0x012a0c (0x7272 bytes) 000781 1787788657.702287 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x36fac): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36fac): Mirror 3: 0x20f7db8a (stale) Mirror 4: 0x20f7db8a (stale) Mirror 5: 0x20f7db8a (stale) Mirror 6: 0x20f7db8a (stale) CRC-32 checksum value for chunk [0, 0x36fac): Mirror 1: 0xd6830f05 Mirror 7: 0xd6830f05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36fac: skipped 000782 1787788658.858031 punch from 0x00ae3c to 0x012137 (0x72fc bytes) 000783 1787788658.901320 fallocate 0x0322db thru 0x0356e1 (0x3407 bytes) 000784 1787788658.907287 read 0x0020f8 thru 0x006ddf (0x4ce8 bytes) 000785 1787788658.915585 mapread 0x02f852 thru 0x030767 (0xf16 bytes) 000786 1787788658.924157 mapwrite 0x027beb thru 0x02cdd4 (0x51ea bytes) 000787 1787788658.951274 mapwrite 0x00247e thru 0x006d0f (0x4892 bytes) 000789 1787788658.966403 trunc from 0x007f84 to 0x0113ba (0x9437 bytes) 000790 1787788658.973047 mapwrite 0x006c6f thru 0x00dd4e (0x70e0 bytes) 000791 1787788658.997765 fallocate 0x017c6c thru 0x023d5e (0xc0f3 bytes) 000792 1787788659.002010 trunc from 0x01ece0 to 0x02348d (0x47ae bytes) 000793 1787788659.005733 punch from 0x02c383 to 0x02c5e1 (0x25f bytes) 000794 1787788659.010468 trunc from 0x00f932 to 0x0124b5 (0x2b84 bytes) 000795 1787788659.015064 mapread 0x0128b3 thru 0x0221c6 (0xf914 bytes) 000796 1787788659.038274 MIRROR_RESYNC 6 mirrors 000797 1787788660.725093 read 0x00f2b1 thru 0x01c9cf (0xd71f bytes) 000798 1787788660.733057 mapwrite 0x024ec2 thru 0x02f964 (0xaaa3 bytes) 000799 1787788660.879982 read 0x034d30 thru 0x036fab (0x227c bytes) 000800 1787788660.882129 write 0x01466e thru 0x021d32 (0xd6c5 bytes) 000801 1787788660.900001 trunc from 0x02cf89 to 0x036fab (0xa023 bytes) 000802 1787788660.907173 write 0x008cc1 thru 0x00d9e2 (0x4d22 bytes) 000803 1787788660.910932 trunc from 0x033e04 to 0x036fab (0x31a8 bytes) 000804 1787788660.916061 write 0x0199a6 thru 0x019f1b (0x576 bytes) 000805 1787788660.917193 read 0x01a652 thru 0x01ff87 (0x5936 bytes) 000806 1787788660.918672 punch from 0x02e90c to 0x036fab (0x86a0 bytes) 000807 1787788660.924162 punch from 0x006932 to 0x00e916 (0x7fe5 bytes) 000808 1787788660.943731 fallocate 0x02c52b thru 0x02cd94 (0x86a bytes) 000809 1787788660.947204 trunc from 0x036fac to 0x035b5d (0x144e bytes) 000810 1787788660.960130 fallocate 0x031c20 thru 0x03f824 (0xdc05 bytes) 000811 1787788660.963743 mapread 0x016c6b thru 0x0185a4 (0x193a bytes) 000812 1787788660.965142 read 0x02d695 thru 0x030414 (0x2d80 bytes) 000813 1787788660.971835 mapwrite 0x019a15 thru 0x01e3de (0x49ca bytes) 000814 1787788660.987029 trunc from 0x035b5e to 0x009c15 (0x2bf48 bytes) 000816 1787788661.001832 trunc from 0x009c16 to 0x010cda (0x70c5 bytes) 000817 1787788661.023690 write 0x020c82 thru 0x02371d (0x2a9c bytes) 000818 1787788661.026742 read 0x0024df thru 0x003146 (0xc68 bytes) 000819 1787788661.028008 mapwrite 0x0177e3 thru 0x01e6f3 (0x6f11 bytes) 000821 1787788661.082849 mapread 0x01af27 thru 0x01d4ce (0x25a8 bytes) 000823 1787788661.086225 mapread 0x00b319 thru 0x00cc93 (0x197b bytes) 000824 1787788661.088145 write 0x03aa5b thru 0x03ffff (0x55a5 bytes) 000825 1787788661.093324 mapread 0x02f860 thru 0x03a23e (0xa9df bytes) 000826 1787788661.104055 mapread 0x01954c thru 0x0287bb (0xf270 bytes) 000827 1787788661.105101 mapread 0x009ca2 thru 0x00a557 (0x8b6 bytes) 000828 1787788661.105946 write 0x006304 thru 0x00825e (0x1f5b bytes) 000829 1787788661.108776 fallocate 0x0313a5 thru 0x034df9 (0x3a55 bytes) 000830 1787788661.120956 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x40128682 (stale) Mirror 4: 0x40128682 (stale) Mirror 5: 0x40128682 (stale) Mirror 7: 0x40128682 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x40128682 (stale) Mirror 4: 0x40128682 (stale) Mirror 5: 0x40128682 (stale) Mirror 7: 0x40128682 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000831 1787788661.566507 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x40128682 (stale) Mirror 4: 0x40128682 (stale) Mirror 5: 0x40128682 (stale) Mirror 7: 0x40128682 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbd9935c9 Mirror 8: 0xbd9935c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000832 1787788662.967630 fallocate 0x012557 thru 0x019fde (0x7a88 bytes) 000833 1787788663.046850 punch from 0x01768b to 0x0180fa (0xa70 bytes) 000834 1787788663.069355 punch from 0x0072d0 to 0x01634f (0xf080 bytes) 000835 1787788663.080441 mapread 0x032d13 thru 0x03ffff (0xd2ed bytes) 000836 1787788663.129741 mapread 0x02cecd thru 0x03555f (0x8693 bytes) 000837 1787788663.167405 trunc from 0x03d177 to 0x03ffff (0x2e89 bytes) 000838 1787788663.176428 trunc from 0x040000 to 0x017399 (0x28c66 bytes) 000839 1787788663.257610 MIRROR_RESYNC 6 mirrors 000840 1787788665.538160 trunc from 0x01739a to 0x01fed5 (0x8b3c bytes) 000841 1787788665.610596 trunc from 0x01fed6 to 0x00426d (0x1bc68 bytes) 000842 1787788665.639211 punch from 0x002622 to 0x00426d (0x1c4c bytes) 000843 1787788665.645486 mapread 0x002b14 thru 0x003209 (0x6f6 bytes) 000844 1787788665.655351 mapwrite 0x01e662 thru 0x027035 (0x89d4 bytes) 000845 1787788665.743907 read 0x0143ed thru 0x015afe (0x1712 bytes) 000847 1787788665.756196 mapwrite 0x02f8b8 thru 0x03ceab (0xd5f4 bytes) 000848 1787788665.859508 mapread 0x009591 thru 0x00f383 (0x5df3 bytes) 000849 1787788665.871425 fallocate 0x007c3f thru 0x00b729 (0x3aeb bytes) 000850 1787788665.877215 mapread 0x0050a3 thru 0x007f57 (0x2eb5 bytes) 000851 1787788665.879251 trunc from 0x03c102 to 0x03ceab (0xdaa bytes) 000852 1787788665.884367 mapwrite 0x03a2f7 thru 0x03c4f8 (0x2202 bytes) 000853 1787788665.922858 trunc from 0x03ceac to 0x01713d (0x25d6e bytes) 000854 1787788665.965398 fallocate 0x034ac4 thru 0x03ffff (0xb53c bytes) 000855 1787788665.972229 read 0x0011b0 thru 0x010e37 (0xfc88 bytes) 000856 1787788665.987384 fallocate 0x02b3c5 thru 0x0318d2 (0x650e bytes) 000857 1787788666.002839 fallocate 0x0268b2 thru 0x02c86b (0x5fba bytes) 000858 1787788666.014043 trunc from 0x005c47 to 0x0154df (0xf899 bytes) 000859 1787788666.025218 fallocate 0x018c90 thru 0x01d668 (0x49d9 bytes) 000860 1787788666.034099 read 0x018306 thru 0x0256ae (0xd3a9 bytes) 000861 1787788666.107260 read 0x011dea thru 0x01e031 (0xc248 bytes) 000862 1787788666.107910 punch from 0x023f15 to 0x02c4e3 (0x85cf bytes) 000863 1787788666.113965 read 0x022aba thru 0x02bd8c (0x92d3 bytes) 000864 1787788666.132686 punch from 0x013765 to 0x01c3b0 (0x8c4c bytes) 000866 1787788666.141062 trunc from 0x008de1 to 0x00a3af (0x15cf bytes) 000867 1787788666.151134 mapwrite 0x022380 thru 0x0242c8 (0x1f49 bytes) 000868 1787788666.167976 read 0x0070a3 thru 0x00d766 (0x66c4 bytes) 000869 1787788666.186148 punch from 0x005b82 to 0x00aa67 (0x4ee6 bytes) 000870 1787788666.194357 read 0x004002 thru 0x00b967 (0x7966 bytes) 000871 1787788666.205004 mapwrite 0x03b97b thru 0x03ffff (0x4685 bytes) 000872 1787788666.272039 mapread 0x0319b0 thru 0x036371 (0x49c2 bytes) 000873 1787788666.273325 punch from 0x03ad46 to 0x03ffff (0x52ba bytes) 000874 1787788666.284370 punch from 0x02e543 to 0x03831b (0x9dd9 bytes) 000875 1787788666.290884 mapwrite 0x03a991 thru 0x03ffff (0x566f bytes) 000876 1787788666.387266 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1da05dca (stale) Mirror 4: 0x1da05dca (stale) Mirror 5: 0x1da05dca (stale) Mirror 7: 0x1da05dca (stale) Mirror 8: 0x1da05dca (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc2879628 Mirror 9: 0xc2879628 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000877 1787788667.406237 MIRROR_RESYNC 7 mirrors 000878 1787788669.548032 trunc from 0x040000 to 0x028c90 (0x1736f bytes) 000879 1787788669.600138 fallocate 0x01af16 thru 0x022e82 (0x7f6d bytes) 000880 1787788669.607387 read 0x024edc thru 0x028c90 (0x3db5 bytes) 000882 1787788669.617672 read 0x005726 thru 0x00732f (0x1c0a bytes) 000883 1787788669.638495 punch from 0x00240a to 0x008835 (0x642c bytes) 000884 1787788669.643350 mapread 0x00b298 thru 0x019666 (0xe3cf bytes) 000886 1787788669.649282 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x28c91): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28c91): Mirror 3: 0xd7e409b2 (stale) Mirror 4: 0xd7e409b2 (stale) Mirror 5: 0xd7e409b2 (stale) Mirror 7: 0xd7e409b2 (stale) Mirror 8: 0xd7e409b2 (stale) Mirror 9: 0xd7e409b2 (stale) CRC-32 checksum value for chunk [0, 0x28c91): Mirror 1: 0x83c20e27 Mirror 10: 0x83c20e27 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28c91: skipped 000887 1787788670.827483 mapread 0x0227d7 thru 0x028c90 (0x64ba bytes) 000888 1787788670.853582 fallocate 0x026d18 thru 0x0336a1 (0xc98a bytes) 000889 1787788670.902807 mapread 0x0092a6 thru 0x016de9 (0xdb44 bytes) 000890 1787788670.921174 fallocate 0x01d1ce thru 0x0262ba (0x90ed bytes) 000891 1787788670.928774 read 0x00b480 thru 0x00cdf6 (0x1977 bytes) 000892 1787788670.931180 punch from 0x006066 to 0x00b2b4 (0x524f bytes) 000893 1787788670.937691 trunc from 0x0323d6 to 0x0336a1 (0x12cc bytes) 000894 1787788670.945788 write 0x03bb85 thru 0x03ffff (0x447b bytes) 000895 1787788670.954278 fallocate 0x002952 thru 0x00e261 (0xb910 bytes) 000897 1787788670.967267 read 0x039d6f thru 0x03ffff (0x6291 bytes) 000898 1787788670.979334 fallocate 0x01c554 thru 0x022686 (0x6133 bytes) 000899 1787788670.984322 mapwrite 0x006e6c thru 0x00fc96 (0x8e2b bytes) 000900 1787788671.014739 write 0x036db4 thru 0x03ffff (0x924c bytes) 000901 1787788671.016922 read 0x00c03a thru 0x014076 (0x803d bytes) 000902 1787788671.017609 write 0x00b0a6 thru 0x019cab (0xec06 bytes) 000903 1787788671.020391 mapread 0x012cd8 thru 0x014fe4 (0x230d bytes) 000904 1787788671.022026 punch from 0x00ae47 to 0x016077 (0xb231 bytes) 000905 1787788671.039937 mapread 0x02371f thru 0x02d4f6 (0x9dd8 bytes) 000906 1787788671.040974 write 0x027dc7 thru 0x030bb9 (0x8df3 bytes) 000907 1787788671.043193 mapwrite 0x007af9 thru 0x00f50f (0x7a17 bytes) 000908 1787788671.073325 fallocate 0x03984d thru 0x03b131 (0x18e5 bytes) 000909 1787788671.078089 trunc from 0x040000 to 0x00137e (0x3ec81 bytes) 000910 1787788671.096928 mapread 0x0007ac thru 0x00137e (0xbd3 bytes) 000911 1787788671.097959 fallocate 0x01a8a0 thru 0x021ccd (0x742e bytes) 000912 1787788671.104617 trunc from 0x021cce to 0x015650 (0xc67d bytes) 000913 1787788671.123352 trunc from 0x002875 to 0x00dbc1 (0xb34d bytes) 000914 1787788671.134270 MIRROR_RESYNC 8 mirrors 000915 1787788672.200776 read 0x00bd2e thru 0x015650 (0x9923 bytes) 000916 1787788672.212243 mapwrite 0x03e599 thru 0x03ffff (0x1a67 bytes) 000917 1787788672.290862 fallocate 0x013add thru 0x018066 (0x458a bytes) 000918 1787788672.301507 read 0x01377e thru 0x01ff00 (0xc783 bytes) 000919 1787788672.363598 mapwrite 0x029c64 thru 0x036a30 (0xcdcd bytes) 000920 1787788672.397930 trunc from 0x03d6c6 to 0x03ffff (0x293a bytes) 000921 1787788672.406784 read 0x01b16f thru 0x02225b (0x70ed bytes) 000922 1787788672.407824 trunc from 0x00cb1d to 0x00cefb (0x3df bytes) 000923 1787788672.414994 mapwrite 0x037406 thru 0x039b43 (0x273e bytes) 000924 1787788672.434373 punch from 0x020b5c to 0x02b9e4 (0xae89 bytes) 000925 1787788672.443601 trunc from 0x007b84 to 0x00afed (0x346a bytes) 000927 1787788672.450606 trunc from 0x01dafe to 0x02d96d (0xfe70 bytes) 000928 1787788672.463763 MIRROR_RESYNC 8 mirrors 000929 1787788674.537417 mapread 0x02c600 thru 0x0359e6 (0x93e7 bytes) 000930 1787788674.586980 write 0x03d62b thru 0x03ffff (0x29d5 bytes) 000931 1787788674.664004 write 0x023676 thru 0x0330c3 (0xfa4e bytes) 000932 1787788674.692167 mapread 0x008322 thru 0x015806 (0xd4e5 bytes) 000933 1787788674.745152 read 0x011f71 thru 0x016ce9 (0x4d79 bytes) 000934 1787788674.746382 mapread 0x0258d3 thru 0x02cbca (0x72f8 bytes) 000935 1787788674.753038 write 0x02182f thru 0x02fad7 (0xe2a9 bytes) 000936 1787788674.767902 write 0x01100e thru 0x013f65 (0x2f58 bytes) 000937 1787788674.770094 mapwrite 0x01e09f thru 0x02cad9 (0xea3b bytes) 000938 1787788674.839354 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7785d062 (stale) Mirror 4: 0x7785d062 (stale) Mirror 5: 0x7785d062 (stale) Mirror 7: 0x7785d062 (stale) Mirror 8: 0x7785d062 (stale) Mirror 9: 0x7785d062 (stale) Mirror 10: 0x7785d062 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6435202f Mirror 11: 0x6435202f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000939 1787788676.368104 read 0x006816 thru 0x014936 (0xe121 bytes) 000940 1787788676.385170 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7785d062 (stale) Mirror 4: 0x7785d062 (stale) Mirror 5: 0x7785d062 (stale) Mirror 7: 0x7785d062 (stale) Mirror 8: 0x7785d062 (stale) Mirror 9: 0x7785d062 (stale) Mirror 10: 0x7785d062 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6435202f Mirror 11: 0x6435202f Mirror 12: 0x6435202f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000941 1787788677.656202 mapwrite 0x01ae50 thru 0x026d32 (0xbee3 bytes) 000942 1787788677.762267 punch from 0x039b13 to 0x03ffff (0x64ed bytes) 000944 1787788677.775716 trunc from 0x040000 to 0x000de7 (0x3f218 bytes) 000946 1787788677.828744 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0xde8): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xde8): Mirror 3: 0x1ccf8278 (stale) Mirror 4: 0x1ccf8278 (stale) Mirror 5: 0x1ccf8278 (stale) Mirror 7: 0x1ccf8278 (stale) Mirror 8: 0x1ccf8278 (stale) Mirror 9: 0x1ccf8278 (stale) Mirror 10: 0x1ccf8278 (stale) Mirror 11: 0x1ccf8278 (stale) Mirror 12: 0x1ccf8278 (stale) CRC-32 checksum value for chunk [0, 0xde8): Mirror 1: 0x1ccf8278 Mirror 13: 0x1ccf8278 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xde8: skipped 000947 1787788679.179219 trunc from 0x000061 to 0x000de7 (0xd87 bytes) 000948 1787788679.245771 trunc from 0x000de8 to 0x01fef3 (0x1f10c bytes) 000949 1787788679.279147 fallocate 0x03884f thru 0x03ffff (0x77b1 bytes) 000950 1787788679.290276 write 0x03a541 thru 0x03c040 (0x1b00 bytes) 000951 1787788679.309038 trunc from 0x040000 to 0x017488 (0x28b77 bytes) 000952 1787788679.326176 fallocate 0x01f14b thru 0x02e5ad (0xf463 bytes) 000953 1787788679.334277 mapread 0x01e4ff thru 0x02b65d (0xd15f bytes) 000954 1787788679.362840 trunc from 0x02e5ae to 0x01ded3 (0x106da bytes) 000955 1787788679.377201 mapwrite 0x02d791 thru 0x0390d0 (0xb940 bytes) 000956 1787788679.453902 mapread 0x008309 thru 0x017aaa (0xf7a2 bytes) 000957 1787788679.489467 trunc from 0x0390d1 to 0x01cc20 (0x1c4b0 bytes) 000958 1787788679.508503 trunc from 0x00741a to 0x00974c (0x2333 bytes) 000959 1787788679.519240 mapread 0x003428 thru 0x009c43 (0x681c bytes) 000961 1787788679.525128 read 0x01122b thru 0x01c925 (0xb6fb bytes) 000962 1787788679.526001 write 0x01f903 thru 0x029750 (0x9e4e bytes) 000963 1787788679.528493 mapread 0x005cc0 thru 0x0102cf (0xa610 bytes) 000964 1787788679.530316 punch from 0x0266b5 to 0x029750 (0x309c bytes) 000965 1787788679.545560 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29751): Mirror 3: 0xd48123aa (stale) Mirror 4: 0xd48123aa (stale) Mirror 5: 0xd48123aa (stale) Mirror 7: 0xd48123aa (stale) Mirror 8: 0xd48123aa (stale) Mirror 9: 0xd48123aa (stale) Mirror 10: 0xd48123aa (stale) Mirror 11: 0xfbee9a58 (stale) Mirror 13: 0x88a7c6ac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29751): Mirror 3: 0xd48123aa (stale) Mirror 4: 0xd48123aa (stale) Mirror 5: 0xd48123aa (stale) Mirror 7: 0xd48123aa (stale) Mirror 8: 0xd48123aa (stale) Mirror 9: 0xd48123aa (stale) Mirror 10: 0xd48123aa (stale) Mirror 11: 0xfbee9a58 (stale) Mirror 13: 0x88a7c6ac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29751: skipped 000966 1787788680.139150 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29751): Mirror 3: 0xd48123aa (stale) Mirror 4: 0xd48123aa (stale) Mirror 5: 0xd48123aa (stale) Mirror 7: 0xd48123aa (stale) Mirror 8: 0xd48123aa (stale) Mirror 9: 0xd48123aa (stale) Mirror 10: 0xd48123aa (stale) Mirror 11: 0xfbee9a58 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29751): Mirror 3: 0xd48123aa (stale) Mirror 4: 0xd48123aa (stale) Mirror 5: 0xd48123aa (stale) Mirror 7: 0xd48123aa (stale) Mirror 8: 0xd48123aa (stale) Mirror 9: 0xd48123aa (stale) Mirror 10: 0xd48123aa (stale) Mirror 11: 0xfbee9a58 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29751: skipped 000967 1787788680.941258 read 0x01ece2 thru 0x029750 (0xaa6f bytes) 000968 1787788680.958311 mapwrite 0x00094c thru 0x003938 (0x2fed bytes) 000969 1787788681.054106 mapread 0x010752 thru 0x02004a (0xf8f9 bytes) 000970 1787788681.071424 read 0x0250a1 thru 0x029750 (0x46b0 bytes) 000971 1787788681.072805 read 0x00f522 thru 0x0165bf (0x709e bytes) 000972 1787788681.073556 trunc from 0x029751 to 0x02e7c2 (0x5072 bytes) 000973 1787788681.099877 fallocate 0x0036cb thru 0x00c6ea (0x9020 bytes) 000975 1787788681.107621 mapwrite 0x00fd6b thru 0x013a6e (0x3d04 bytes) 000976 1787788681.133439 mapwrite 0x02809c thru 0x02e41f (0x6384 bytes) 000977 1787788681.176205 mapwrite 0x026307 thru 0x02c41d (0x6117 bytes) 000978 1787788681.223569 mapread 0x0177ff thru 0x0268a5 (0xf0a7 bytes) 000979 1787788681.234344 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1bb:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e7c3): Mirror 3: 0x7b965a28 (stale) Mirror 4: 0x7b965a28 (stale) Mirror 5: 0x7b965a28 (stale) Mirror 7: 0x7b965a28 (stale) Mirror 8: 0x7b965a28 (stale) Mirror 10: 0x7b965a28 (stale) Mirror 11: 0x49d03c15 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e7c3): Mirror 3: 0x7b965a28 (stale) Mirror 4: 0x7b965a28 (stale) Mirror 5: 0x7b965a28 (stale) Mirror 7: 0x7b965a28 (stale) Mirror 8: 0x7b965a28 (stale) Mirror 10: 0x7b965a28 (stale) Mirror 11: 0x49d03c15 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e7c3: skipped 000980 1787788682.076460 trunc from 0x02e7c3 to 0x00dbcd (0x20bf5 bytes) 000981 1787788682.096889 read 0x0075e4 thru 0x0089d9 (0x13f6 bytes) 000982 1787788682.111972 fallocate 0x038d19 thru 0x03ffff (0x72e7 bytes) 000983 1787788682.119812 trunc from 0x006199 to 0x007b7a (0x19e2 bytes) 000984 1787788682.139294 mapwrite 0x02d375 thru 0x03334f (0x5fdb bytes) 000985 1787788682.266587 trunc from 0x033350 to 0x0116c1 (0x21c8e bytes) 000986 1787788682.306569 mapread 0x0050ef thru 0x008ec8 (0x3dda bytes) 000987 1787788682.328884 trunc from 0x0074e1 to 0x008986 (0x14a6 bytes) 000988 1787788682.342434 trunc from 0x009690 to 0x0116c1 (0x8032 bytes) 000989 1787788682.353529 punch from 0x004453 to 0x0116c1 (0xd26f bytes) 000991 1787788682.367289 read 0x0104ab thru 0x0116c1 (0x1217 bytes) 000992 1787788682.379532 mapread 0x001252 thru 0x0025cb (0x137a bytes) 000993 1787788682.380579 mapread 0x003f94 thru 0x0116c1 (0xd72e bytes) 000994 1787788682.381686 fallocate 0x013fec thru 0x01ad24 (0x6d39 bytes) 000995 1787788682.388467 trunc from 0x0116c2 to 0x03ae8c (0x297cb bytes) 000996 1787788682.406285 punch from 0x01952a to 0x026101 (0xcbd8 bytes) 000997 1787788682.415798 mapread 0x0192ee thru 0x019ae0 (0x7f3 bytes) 000998 1787788682.431901 trunc from 0x03ae8d to 0x001132 (0x39d5a bytes) 000999 1787788682.451221 fallocate 0x0322d3 thru 0x03c4ca (0xa1f8 bytes) 001000 1787788682.458292 mapwrite 0x03f28e thru 0x03ffff (0xd72 bytes) All operations completed A-OK!