== sanity-flr test 70a: flr mode fsx test ================ 07:26:26 (1775042786) Seed set to 2787 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read skipping zero size read skipping zero size read 000010 1775042787.574919 MIRROR_EXTEND to 2 mirrors 000011 1775042787.888688 MIRROR_EXTEND to 3 mirrors skipping zero size read skipping zero size read 000015 1775042788.232913 mapwrite 0x004fa9 thru 0x008f1c (0x3f74 bytes) 000016 1775042788.395178 MIRROR_RESYNC 3 mirrors 000020 1775042789.024688 read 0x0008ff thru 0x008f1c (0x861e bytes) 000021 1775042789.033330 mapwrite 0x0318e7 thru 0x032e28 (0x1542 bytes) truncating to largest ever: 0x8faf 000024 1775042789.186773 trunc from 0x032e29 to 0x008fae (0x29e7a bytes) 000025 1775042789.211334 write 0x006ec6 thru 0x00e827 (0x7962 bytes) 000026 1775042789.226546 read 0x00a74c thru 0x00e827 (0x40dc bytes) 000030 1775042789.229633 mapwrite 0x001692 thru 0x0028e5 (0x1254 bytes) 000031 1775042789.289246 read 0x006f19 thru 0x00e827 (0x790f bytes) 000032 1775042789.291436 mapread 0x00db20 thru 0x00e827 (0xd08 bytes) 000033 1775042789.292494 mapwrite 0x02f011 thru 0x0323be (0x33ae bytes) truncating to largest ever: 0x2a5e9 000037 1775042789.370428 trunc from 0x0323bf to 0x02a5e8 (0x7dd6 bytes) 000039 1775042789.390748 write 0x03daeb thru 0x03ffff (0x2515 bytes) 000040 1775042789.392655 read 0x03df1a thru 0x03ffff (0x20e6 bytes) 000041 1775042789.400850 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd7ab58a1 (stale) Mirror 3: 0xd7ab58a1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd4e56238 Mirror 4: 0xd4e56238 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000044 1775042790.088802 read 0x035783 thru 0x03dcff (0x857d bytes) 000045 1775042790.105251 trunc from 0x040000 to 0x01c863 (0x2379c bytes) 000046 1775042790.219648 mapread 0x013104 thru 0x016110 (0x300d bytes) 000048 1775042790.240155 read 0x00bcd6 thru 0x01a11b (0xe446 bytes) 000051 1775042790.253255 write 0x014dce thru 0x0187ec (0x3a1f bytes) truncating to largest ever: 0x2fa2f 000052 1775042790.255275 trunc from 0x01c864 to 0x02fa2e (0x131cb bytes) 000053 1775042790.275334 mapread 0x028aa3 thru 0x02fa2e (0x6f8c bytes) 000054 1775042790.290473 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2fa2f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fa2f): Mirror 2: 0xa2a3cd40 (stale) Mirror 3: 0xa2a3cd40 (stale) Mirror 4: 0xdec5839d (stale) CRC-32 checksum value for chunk [0, 0x2fa2f): Mirror 1: 0x647cf24f Mirror 5: 0x647cf24f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fa2f: skipped 000056 1775042791.034477 trunc from 0x02fa2f to 0x0187dc (0x17252 bytes) 000059 1775042791.161574 mapread 0x012f4f thru 0x01773f (0x47f1 bytes) 000060 1775042791.185830 write 0x00416c thru 0x009915 (0x57aa bytes) 000062 1775042791.196815 mapwrite 0x006386 thru 0x013a89 (0xd704 bytes) 000063 1775042791.248030 read 0x00e70c thru 0x0187dc (0xa0d1 bytes) 000067 1775042791.250600 read 0x0062be thru 0x00d8bf (0x7602 bytes) 000068 1775042791.251411 trunc from 0x0187dd to 0x010903 (0x7ed9 bytes) 000070 1775042791.278222 mapwrite 0x012242 thru 0x020e75 (0xec34 bytes) 000071 1775042791.366839 mapwrite 0x00f243 thru 0x011556 (0x2314 bytes) 000073 1775042791.413242 mapread 0x01ea16 thru 0x020e75 (0x2460 bytes) 000075 1775042791.415067 write 0x01d549 thru 0x020a65 (0x351d bytes) truncating to largest ever: 0x3d842 000077 1775042791.417903 trunc from 0x020e76 to 0x03d841 (0x1c9cc bytes) 000079 1775042791.439024 read 0x0167a9 thru 0x020b77 (0xa3cf bytes) 000080 1775042791.439991 mapread 0x0250e7 thru 0x029470 (0x438a bytes) 000085 1775042791.457399 trunc from 0x03d842 to 0x029faf (0x13892 bytes) 000086 1775042791.477738 read 0x008edd thru 0x00b1af (0x22d3 bytes) 000087 1775042791.478440 trunc from 0x029fb0 to 0x020499 (0x9b16 bytes) 000089 1775042791.496896 write 0x0148fe thru 0x01bf63 (0x7666 bytes) 000090 1775042791.497833 mapread 0x0025fe thru 0x0082c0 (0x5cc3 bytes) 000092 1775042791.500419 mapwrite 0x00c988 thru 0x00d5f7 (0xc70 bytes) 000093 1775042791.550320 mapread 0x00f8dc thru 0x017ac4 (0x81e9 bytes) 000094 1775042791.551560 mapread 0x014136 thru 0x01e907 (0xa7d2 bytes) 000095 1775042791.552953 read 0x001645 thru 0x008408 (0x6dc4 bytes) 000097 1775042791.554415 mapread 0x015446 thru 0x020499 (0xb054 bytes) 000100 1775042791.556743 write 0x02a2f7 thru 0x039a39 (0xf743 bytes) 000102 1775042791.559185 mapread 0x0163b4 thru 0x01be8f (0x5adc bytes) 000104 1775042791.560727 write 0x029ba7 thru 0x036d09 (0xd163 bytes) 000106 1775042791.569194 trunc from 0x039a3a to 0x01031d (0x2971c bytes) 000107 1775042791.583851 mapwrite 0x0156f9 thru 0x015de0 (0x6e8 bytes) 000108 1775042791.645816 read 0x005440 thru 0x012608 (0xd1c9 bytes) 000113 1775042791.659292 mapwrite 0x0395c1 thru 0x03ffff (0x6a3f bytes) 000114 1775042791.739796 mapwrite 0x00e477 thru 0x0180e1 (0x9c6b bytes) 000116 1775042791.788348 read 0x00051f thru 0x00fbbd (0xf69f bytes) 000118 1775042791.789578 mapwrite 0x01e6a9 thru 0x0298d3 (0xb22b bytes) 000121 1775042791.851341 mapread 0x026b58 thru 0x034866 (0xdd0f bytes) 000124 1775042791.858232 MIRROR_RESYNC 5 mirrors 000128 1775042792.818076 write 0x0111a5 thru 0x02078a (0xf5e6 bytes) 000130 1775042792.896311 write 0x022671 thru 0x028b7d (0x650d bytes) 000133 1775042792.913654 write 0x020067 thru 0x024bc9 (0x4b63 bytes) 000135 1775042792.917611 read 0x03affb thru 0x03ffff (0x5005 bytes) 000136 1775042792.936356 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4634f901 (stale) Mirror 3: 0x4634f901 (stale) Mirror 4: 0x4634f901 (stale) Mirror 5: 0x4634f901 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3700071b Mirror 6: 0x3700071b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000137 1775042793.621328 read 0x019f3e thru 0x01cf4e (0x3011 bytes) 000139 1775042793.629268 write 0x0386fe thru 0x03ffff (0x7902 bytes) 000140 1775042793.707480 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4634f901 (stale) Mirror 3: 0x4634f901 (stale) Mirror 4: 0x4634f901 (stale) Mirror 5: 0x4634f901 (stale) Mirror 6: 0x3700071b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd780b881 Mirror 7: 0xd780b881 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000142 1775042794.460486 trunc from 0x040000 to 0x013c8e (0x2c371 bytes) 000143 1775042794.535562 read 0x00c228 thru 0x013c8e (0x7a67 bytes) 000144 1775042794.546072 mapread 0x0099d2 thru 0x013c8e (0xa2bd bytes) 000146 1775042794.564934 write 0x03ac2b thru 0x03c7c4 (0x1b9a bytes) 000147 1775042794.566150 mapread 0x03c192 thru 0x03c7c4 (0x633 bytes) 000151 1775042794.570062 mapread 0x017e0b thru 0x01926c (0x1462 bytes) 000154 1775042794.582433 read 0x00e820 thru 0x0124ac (0x3c8d bytes) 000158 1775042794.587878 mapread 0x00a448 thru 0x00a551 (0x10a bytes) 000160 1775042794.590033 mapread 0x025012 thru 0x031748 (0xc737 bytes) 000161 1775042794.599308 write 0x036ed5 thru 0x03bac0 (0x4bec bytes) 000164 1775042794.604293 mapread 0x036cc8 thru 0x03c7c4 (0x5afd bytes) 000166 1775042794.607812 write 0x033d07 thru 0x03c12d (0x8427 bytes) 000170 1775042794.612220 write 0x01c50d thru 0x024e35 (0x8929 bytes) 000172 1775042794.613998 mapwrite 0x02c40d thru 0x034795 (0x8389 bytes) 000178 1775042794.686281 trunc from 0x03c7c5 to 0x00a43d (0x32387 bytes) 000179 1775042794.708341 trunc from 0x00a43e to 0x00bd07 (0x18ca bytes) 000180 1775042794.726066 write 0x00f203 thru 0x01ba2d (0xc82b bytes) 000182 1775042794.729634 mapread 0x004878 thru 0x00c248 (0x79d1 bytes) 000183 1775042794.744270 mapwrite 0x03ca3a thru 0x03d377 (0x93e bytes) 000184 1775042794.812333 read 0x0225cd thru 0x0284ed (0x5f21 bytes) 000185 1775042794.825498 mapread 0x02a079 thru 0x02e3aa (0x4332 bytes) 000189 1775042794.829576 mapread 0x001937 thru 0x00dec6 (0xc590 bytes) 000190 1775042794.832329 read 0x00e44d thru 0x010773 (0x2327 bytes) 000191 1775042794.834199 write 0x02b306 thru 0x0301a4 (0x4e9f bytes) 000195 1775042794.838986 write 0x014d76 thru 0x0204e5 (0xb770 bytes) 000197 1775042794.843082 read 0x00f3e7 thru 0x010c50 (0x186a bytes) 000199 1775042794.844599 trunc from 0x03d378 to 0x016058 (0x2731f bytes) 000205 1775042794.868031 read 0x0107e8 thru 0x016058 (0x5871 bytes) 000206 1775042794.869221 read 0x00f19a thru 0x016058 (0x6ebf bytes) 000208 1775042794.871058 mapread 0x015eb5 thru 0x016058 (0x1a4 bytes) 000209 1775042794.872860 read 0x00dc5b thru 0x015ac6 (0x7e6c bytes) 000211 1775042794.874717 read 0x005d73 thru 0x0068bc (0xb4a bytes) 000213 1775042794.877056 mapread 0x00796b thru 0x00b8f8 (0x3f8e bytes) 000215 1775042794.880062 trunc from 0x016059 to 0x033a9e (0x1da46 bytes) 000216 1775042794.898222 mapread 0x032fbb thru 0x033a9e (0xae4 bytes) 000217 1775042794.912083 mapread 0x0077f6 thru 0x008459 (0xc64 bytes) 000218 1775042794.927038 read 0x00b71d thru 0x0199bb (0xe29f bytes) 000219 1775042794.927912 trunc from 0x033a9f to 0x00e8cf (0x251cf bytes) 000221 1775042794.944062 trunc from 0x00e8d0 to 0x01947a (0xabab bytes) 000225 1775042794.965270 mapwrite 0x017838 thru 0x01c57d (0x4d46 bytes) 000226 1775042795.044470 trunc from 0x01c57e to 0x0372c6 (0x1ad49 bytes) 000228 1775042795.063609 read 0x00bf8f thru 0x011d18 (0x5d8a bytes) 000230 1775042795.064880 mapwrite 0x029243 thru 0x02f567 (0x6325 bytes) 000232 1775042795.118490 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x372c7): Mirror 2: 0x74a3dbae (stale) Mirror 3: 0x74a3dbae (stale) Mirror 4: 0x74a3dbae (stale) Mirror 5: 0x74a3dbae (stale) Mirror 6: 0x5e58fdc4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x372c7): Mirror 2: 0x74a3dbae (stale) Mirror 3: 0x74a3dbae (stale) Mirror 4: 0x74a3dbae (stale) Mirror 5: 0x74a3dbae (stale) Mirror 6: 0x5e58fdc4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x372c7: skipped 000234 1775042795.520641 write 0x022e1c thru 0x024854 (0x1a39 bytes) 000236 1775042795.531637 mapread 0x00cd83 thru 0x01c3f9 (0xf677 bytes) 000237 1775042795.554172 trunc from 0x0372c7 to 0x027203 (0x100c3 bytes) 000239 1775042795.578638 mapread 0x020615 thru 0x027203 (0x6bef bytes) 000241 1775042795.594343 trunc from 0x027204 to 0x031a99 (0xa896 bytes) 000243 1775042795.611368 trunc from 0x031a9a to 0x0184de (0x195bb bytes) 000244 1775042795.630580 mapread 0x015ad6 thru 0x0184de (0x2a09 bytes) 000245 1775042795.631698 mapwrite 0x03e42c thru 0x03ebe9 (0x7be bytes) 000247 1775042795.700852 write 0x021825 thru 0x02d77c (0xbf58 bytes) 000248 1775042795.720648 read 0x03c235 thru 0x03ebe9 (0x29b5 bytes) 000249 1775042795.721591 read 0x0043b5 thru 0x007edf (0x3b2b bytes) 000250 1775042795.733480 mapread 0x00b9da thru 0x00e7b2 (0x2dd9 bytes) 000252 1775042795.736299 mapread 0x03bd46 thru 0x03ebe9 (0x2ea4 bytes) 000254 1775042795.738943 read 0x0129ba thru 0x0201eb (0xd832 bytes) 000257 1775042795.746783 MIRROR_RESYNC 6 mirrors 000258 1775042796.801700 read 0x019186 thru 0x01c4e1 (0x335c bytes) 000259 1775042796.809921 read 0x01aad7 thru 0x029c2f (0xf159 bytes) 000260 1775042796.825550 trunc from 0x03ebea to 0x02e5b9 (0x10630 bytes) 000262 1775042796.927611 write 0x01b048 thru 0x01c3a5 (0x135e bytes) 000266 1775042796.946283 read 0x006208 thru 0x0143ab (0xe1a4 bytes) 000269 1775042796.962799 mapread 0x029e42 thru 0x02e5b9 (0x4778 bytes) 000270 1775042796.970915 MIRROR_RESYNC 6 mirrors 000273 1775042798.051347 read 0x007ddd thru 0x01165c (0x9880 bytes) 000280 1775042798.062677 write 0x021b0d thru 0x02d4b6 (0xb9aa bytes) 000281 1775042798.146642 mapread 0x021dfc thru 0x02798b (0x5b90 bytes) 000282 1775042798.148306 mapread 0x01e039 thru 0x021817 (0x37df bytes) 000283 1775042798.161721 mapwrite 0x002e98 thru 0x00d039 (0xa1a2 bytes) 000285 1775042798.267145 MIRROR_RESYNC 6 mirrors 000288 1775042799.171536 write 0x028242 thru 0x02bd08 (0x3ac7 bytes) 000291 1775042799.258080 read 0x02329e thru 0x02add4 (0x7b37 bytes) 000292 1775042799.267851 trunc from 0x02e5ba to 0x0185c5 (0x15ff4 bytes) 000293 1775042799.323526 write 0x009235 thru 0x00eb51 (0x591d bytes) 000295 1775042799.341215 MIRROR_RESYNC 6 mirrors 000296 1775042800.331872 MIRROR_EXTEND to 7 mirrors 000297 1775042801.136877 trunc from 0x0185c6 to 0x013be7 (0x49de bytes) 000298 1775042801.207823 read 0x0073b8 thru 0x012f30 (0xbb79 bytes) 000299 1775042801.222902 MIRROR_RESYNC 7 mirrors 000300 1775042802.231924 MIRROR_RESYNC 7 mirrors 000301 1775042802.689892 read 0x008bb8 thru 0x011b74 (0x8fbd bytes) 000302 1775042802.706553 MIRROR_EXTEND to 8 mirrors 000304 1775042803.382881 mapread 0x00f530 thru 0x013be7 (0x46b8 bytes) 000305 1775042803.414817 MIRROR_RESYNC 8 mirrors 000306 1775042803.843522 write 0x02cbe4 thru 0x030160 (0x357d bytes) 000307 1775042803.911603 mapwrite 0x03e2fe thru 0x03ffff (0x1d02 bytes) 000308 1775042804.028305 trunc from 0x040000 to 0x01db0b (0x224f4 bytes) 000310 1775042804.051552 mapwrite 0x02b873 thru 0x02d7f4 (0x1f82 bytes) 000312 1775042804.131299 read 0x016878 thru 0x01ce42 (0x65cb bytes) 000313 1775042804.143527 mapwrite 0x03f955 thru 0x03ffff (0x6ab bytes) 000314 1775042804.225813 read 0x014db5 thru 0x014eff (0x14b bytes) 000315 1775042804.247248 mapread 0x037464 thru 0x03ffff (0x8b9c bytes) 000316 1775042804.253184 MIRROR_RESYNC 8 mirrors 000320 1775042805.373008 MIRROR_RESYNC 8 mirrors 000323 1775042805.878814 read 0x03e6ee thru 0x03ffff (0x1912 bytes) 000324 1775042805.884939 mapwrite 0x03e98b thru 0x03ffff (0x1675 bytes) 000325 1775042806.027767 mapread 0x0008db thru 0x00e8af (0xdfd5 bytes) 000328 1775042806.045566 mapwrite 0x01fe2b thru 0x02850f (0x86e5 bytes) 000329 1775042806.122005 read 0x0304ac thru 0x03b328 (0xae7d bytes) 000331 1775042806.132526 mapwrite 0x01dfbb thru 0x0204f7 (0x253d bytes) 000332 1775042806.181457 write 0x03c654 thru 0x03ffff (0x39ac bytes) 000335 1775042806.189487 trunc from 0x040000 to 0x01d120 (0x22edf bytes) 000336 1775042806.234832 MIRROR_RESYNC 8 mirrors 000337 1775042807.167519 mapread 0x01cc7a thru 0x01d120 (0x4a7 bytes) 000338 1775042807.181740 mapread 0x006d01 thru 0x0135c5 (0xc8c5 bytes) 000339 1775042807.199482 mapwrite 0x01fe30 thru 0x02bb23 (0xbcf4 bytes) 000340 1775042807.368164 read 0x01c21b thru 0x021591 (0x5377 bytes) 000341 1775042807.368930 write 0x00dc52 thru 0x016ae7 (0x8e96 bytes) 000345 1775042807.387119 mapwrite 0x00a473 thru 0x00dec8 (0x3a56 bytes) 000346 1775042807.429868 trunc from 0x02bb24 to 0x025542 (0x65e1 bytes) 000348 1775042807.451563 read 0x021369 thru 0x025542 (0x41da bytes) 000351 1775042807.455278 write 0x021df2 thru 0x025cae (0x3ebd bytes) 000353 1775042807.456796 read 0x011ce4 thru 0x016e42 (0x515f bytes) 000357 1775042807.460847 trunc from 0x025caf to 0x0373f4 (0x11746 bytes) 000358 1775042807.477381 mapwrite 0x031c10 thru 0x03640e (0x47ff bytes) 000361 1775042807.546376 mapwrite 0x03f482 thru 0x03ffff (0xb7e bytes) 000362 1775042807.608273 trunc from 0x040000 to 0x0076d4 (0x3892b bytes) 000363 1775042807.629266 write 0x024e3b thru 0x02cc74 (0x7e3a bytes) 000364 1775042807.631614 read 0x0286e1 thru 0x02cc74 (0x4594 bytes) 000366 1775042807.633530 trunc from 0x02cc75 to 0x0210fe (0xbb76 bytes) 000367 1775042807.657145 mapread 0x003b88 thru 0x00e97b (0xadf4 bytes) 000368 1775042807.674031 mapwrite 0x011088 thru 0x013b06 (0x2a7f bytes) 000371 1775042807.719664 read 0x01ff67 thru 0x0210fe (0x1198 bytes) 000372 1775042807.720996 write 0x0314c6 thru 0x03ea2f (0xd56a bytes) 000373 1775042807.722770 write 0x011507 thru 0x013d23 (0x281d bytes) 000374 1775042807.731428 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3ea30): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ea30): Mirror 2: 0x14d5ca20 (stale) Mirror 3: 0x14d5ca20 (stale) Mirror 4: 0x14d5ca20 (stale) Mirror 5: 0x14d5ca20 (stale) Mirror 6: 0x14d5ca20 (stale) Mirror 7: 0x14d5ca20 (stale) Mirror 8: 0x14d5ca20 (stale) CRC-32 checksum value for chunk [0, 0x3ea30): Mirror 1: 0xf301f3db Mirror 9: 0xf301f3db lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ea30: skipped 000375 1775042808.604667 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3ea30): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ea30): Mirror 2: 0x14d5ca20 (stale) Mirror 3: 0x14d5ca20 (stale) Mirror 4: 0x14d5ca20 (stale) Mirror 5: 0x14d5ca20 (stale) Mirror 6: 0x14d5ca20 (stale) Mirror 7: 0x14d5ca20 (stale) Mirror 8: 0x14d5ca20 (stale) CRC-32 checksum value for chunk [0, 0x3ea30): Mirror 1: 0xf301f3db Mirror 9: 0xf301f3db Mirror 10: 0xf301f3db lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ea30: skipped 000377 1775042809.458895 mapwrite 0x01d08a thru 0x01ea7a (0x19f1 bytes) 000380 1775042809.639590 mapwrite 0x025b51 thru 0x025b5f (0xf bytes) 000381 1775042809.684707 read 0x019c5f thru 0x029086 (0xf428 bytes) 000382 1775042809.691986 mapread 0x003fd0 thru 0x013797 (0xf7c8 bytes) 000383 1775042809.730659 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ea30): Mirror 2: 0x14d5ca20 (stale) Mirror 3: 0x14d5ca20 (stale) Mirror 4: 0x14d5ca20 (stale) Mirror 5: 0x14d5ca20 (stale) Mirror 6: 0x14d5ca20 (stale) Mirror 7: 0x14d5ca20 (stale) Mirror 9: 0xf301f3db (stale) Mirror 10: 0xf301f3db (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ea30): Mirror 2: 0x14d5ca20 (stale) Mirror 3: 0x14d5ca20 (stale) Mirror 4: 0x14d5ca20 (stale) Mirror 5: 0x14d5ca20 (stale) Mirror 6: 0x14d5ca20 (stale) Mirror 7: 0x14d5ca20 (stale) Mirror 9: 0xf301f3db (stale) Mirror 10: 0xf301f3db (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ea30: skipped 000384 1775042810.285820 read 0x03a9d0 thru 0x03ea2f (0x4060 bytes) 000387 1775042810.303704 mapwrite 0x02052a thru 0x0211c7 (0xc9e bytes) 000388 1775042810.397677 trunc from 0x03ea30 to 0x0181ce (0x26861 bytes) 000389 1775042810.420478 mapread 0x010cba thru 0x0181ce (0x7515 bytes) 000390 1775042810.434850 mapread 0x00216b thru 0x00fe95 (0xdd2b bytes) 000391 1775042810.445870 mapread 0x010fe6 thru 0x016e60 (0x5e7b bytes) 000395 1775042810.448962 read 0x013208 thru 0x0181ce (0x4fc7 bytes) 000398 1775042810.451281 write 0x02955a thru 0x02f269 (0x5d10 bytes) 000399 1775042810.452663 mapwrite 0x03dd63 thru 0x03ffff (0x229d bytes) 000401 1775042810.542257 read 0x0131f9 thru 0x01b163 (0x7f6b bytes) 000402 1775042810.543198 mapread 0x01c5be thru 0x02b4ee (0xef31 bytes) 000403 1775042810.545519 write 0x010291 thru 0x012a79 (0x27e9 bytes) 000404 1775042810.551186 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5546dd99 (stale) Mirror 3: 0x5546dd99 (stale) Mirror 4: 0x5546dd99 (stale) Mirror 5: 0x5546dd99 (stale) Mirror 6: 0x5546dd99 (stale) Mirror 7: 0x5546dd99 (stale) Mirror 9: 0xcb10e1b1 (stale) Mirror 10: 0xcb10e1b1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbb713499 Mirror 11: 0xbb713499 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000407 1775042811.397876 mapread 0x0333bd thru 0x03ffff (0xcc43 bytes) 000408 1775042811.450477 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5546dd99 (stale) Mirror 3: 0x5546dd99 (stale) Mirror 4: 0x5546dd99 (stale) Mirror 5: 0x5546dd99 (stale) Mirror 6: 0x5546dd99 (stale) Mirror 7: 0x5546dd99 (stale) Mirror 9: 0xcb10e1b1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5546dd99 (stale) Mirror 3: 0x5546dd99 (stale) Mirror 4: 0x5546dd99 (stale) Mirror 5: 0x5546dd99 (stale) Mirror 6: 0x5546dd99 (stale) Mirror 7: 0x5546dd99 (stale) Mirror 9: 0xcb10e1b1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbb713499 Mirror 11: 0xbb713499 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000409 1775042812.205060 mapread 0x00b94c thru 0x011fb4 (0x6669 bytes) 000410 1775042812.241877 mapwrite 0x008f69 thru 0x00d004 (0x409c bytes) 000411 1775042812.439324 trunc from 0x040000 to 0x01ec29 (0x213d6 bytes) 000412 1775042812.507160 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ec2a): Mirror 2: 0x6df5c041 (stale) Mirror 3: 0x6df5c041 (stale) Mirror 5: 0x6df5c041 (stale) Mirror 6: 0x6df5c041 (stale) Mirror 7: 0x6df5c041 (stale) Mirror 9: 0xb1443b64 (stale) Mirror 11: 0xd695d8cf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ec2a): Mirror 2: 0x6df5c041 (stale) Mirror 3: 0x6df5c041 (stale) Mirror 5: 0x6df5c041 (stale) Mirror 6: 0x6df5c041 (stale) Mirror 7: 0x6df5c041 (stale) Mirror 9: 0xb1443b64 (stale) Mirror 11: 0xd695d8cf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ec2a: skipped truncating to largest ever: 0x3dcc6 000413 1775042813.031688 trunc from 0x01ec2a to 0x03dcc5 (0x1f09c bytes) 000417 1775042813.064303 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3dcc6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dcc6): Mirror 2: 0xf5d83ab0 (stale) Mirror 3: 0xf5d83ab0 (stale) Mirror 5: 0xf5d83ab0 (stale) Mirror 6: 0xf5d83ab0 (stale) Mirror 7: 0xf5d83ab0 (stale) Mirror 9: 0xf35a93c5 (stale) Mirror 11: 0x75bb8d0a (stale) CRC-32 checksum value for chunk [0, 0x3dcc6): Mirror 1: 0x86a6fe1 Mirror 12: 0x86a6fe1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dcc6: skipped 000418 1775042814.011223 read 0x01bf2a thru 0x027559 (0xb630 bytes) 000419 1775042814.033666 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3dcc6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dcc6): Mirror 2: 0xf5d83ab0 (stale) Mirror 3: 0xf5d83ab0 (stale) Mirror 5: 0xf5d83ab0 (stale) Mirror 6: 0xf5d83ab0 (stale) Mirror 7: 0xf5d83ab0 (stale) Mirror 9: 0xf35a93c5 (stale) Mirror 11: 0x75bb8d0a (stale) CRC-32 checksum value for chunk [0, 0x3dcc6): Mirror 1: 0x86a6fe1 Mirror 12: 0x86a6fe1 Mirror 13: 0x86a6fe1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dcc6: skipped 000420 1775042814.982066 mapread 0x020ed9 thru 0x02d394 (0xc4bc bytes) 000422 1775042815.045825 read 0x025fad thru 0x027543 (0x1597 bytes) 000423 1775042815.057172 write 0x0297d4 thru 0x02cff3 (0x3820 bytes) 000425 1775042815.144624 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dcc6): Mirror 2: 0xf5d83ab0 (stale) Mirror 3: 0xf5d83ab0 (stale) Mirror 5: 0xf5d83ab0 (stale) Mirror 6: 0xf5d83ab0 (stale) Mirror 7: 0xf5d83ab0 (stale) Mirror 9: 0xf35a93c5 (stale) Mirror 11: 0x75bb8d0a (stale) Mirror 12: 0x86a6fe1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dcc6): Mirror 2: 0xf5d83ab0 (stale) Mirror 3: 0xf5d83ab0 (stale) Mirror 5: 0xf5d83ab0 (stale) Mirror 6: 0xf5d83ab0 (stale) Mirror 7: 0xf5d83ab0 (stale) Mirror 9: 0xf35a93c5 (stale) Mirror 11: 0x75bb8d0a (stale) Mirror 12: 0x86a6fe1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dcc6: skipped 000427 1775042815.638305 write 0x0222b2 thru 0x02d491 (0xb1e0 bytes) 000428 1775042815.648085 mapread 0x0089db thru 0x00a8c9 (0x1eef bytes) 000430 1775042815.658900 mapwrite 0x00d0cf thru 0x00ef89 (0x1ebb bytes) 000432 1775042815.701650 write 0x02228f thru 0x02d320 (0xb092 bytes) 000433 1775042815.705045 trunc from 0x03dcc6 to 0x000d8b (0x3cf3a bytes) 000434 1775042815.724990 read 0x00042c thru 0x000d8b (0x960 bytes) 000435 1775042815.732131 mapwrite 0x00a0e2 thru 0x019bb9 (0xfad8 bytes) 000437 1775042815.812765 trunc from 0x019bba to 0x039ee6 (0x2032d bytes) 000439 1775042815.834295 mapread 0x02f495 thru 0x039418 (0x9f84 bytes) 000440 1775042815.849772 write 0x02b428 thru 0x02e91d (0x34f6 bytes) 000442 1775042815.851548 mapwrite 0x036b0b thru 0x03f6d7 (0x8bcd bytes) 000444 1775042815.933843 mapwrite 0x039625 thru 0x03c942 (0x331e bytes) 000445 1775042815.969935 read 0x030d25 thru 0x039eb1 (0x918d bytes) 000446 1775042815.970653 mapread 0x030f3c thru 0x036aa2 (0x5b67 bytes) 000448 1775042815.972552 trunc from 0x03f6d8 to 0x00e91e (0x30db9 bytes) 000449 1775042815.991056 read 0x00c143 thru 0x00e91e (0x27dc bytes) 000450 1775042815.991839 mapread 0x00bb5c thru 0x00e91e (0x2dc3 bytes) 000451 1775042815.993432 read 0x0039f5 thru 0x00b78c (0x7d98 bytes) 000452 1775042815.995800 trunc from 0x00e91f to 0x023cd9 (0x153bb bytes) 000456 1775042816.023155 mapread 0x00f80d thru 0x01ed75 (0xf569 bytes) 000457 1775042816.046835 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x23cda): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23cda): Mirror 2: 0xb2a7b4cb (stale) Mirror 3: 0xb2a7b4cb (stale) Mirror 5: 0xb2a7b4cb (stale) Mirror 6: 0xb2a7b4cb (stale) Mirror 7: 0xb2a7b4cb (stale) Mirror 9: 0x938a8813 (stale) Mirror 11: 0xdea62f90 (stale) Mirror 12: 0xc8ffe7a5 (stale) CRC-32 checksum value for chunk [0, 0x23cda): Mirror 1: 0xe64532ba Mirror 13: 0xe64532ba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23cda: skipped 000459 1775042816.885774 mapread 0x015474 thru 0x017449 (0x1fd6 bytes) 000460 1775042816.923412 trunc from 0x023cda to 0x00b3f0 (0x188e9 bytes) 000461 1775042816.994683 read 0x00096d thru 0x0088bf (0x7f53 bytes) 000462 1775042817.008732 read 0x0053a7 thru 0x00b3f0 (0x604a bytes) 000463 1775042817.019256 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0xb3f1): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb3f1): Mirror 2: 0x4f25fd3 (stale) Mirror 3: 0x4f25fd3 (stale) Mirror 5: 0x4f25fd3 (stale) Mirror 6: 0x4f25fd3 (stale) Mirror 7: 0x4f25fd3 (stale) Mirror 9: 0xaec2832 (stale) Mirror 11: 0xaec2832 (stale) Mirror 12: 0x5ca519bd (stale) Mirror 13: 0x103889ea (stale) CRC-32 checksum value for chunk [0, 0xb3f1): Mirror 1: 0x103889ea Mirror 14: 0x103889ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb3f1: skipped 000464 1775042818.005756 write 0x039b30 thru 0x03eb3c (0x500d bytes) 000465 1775042818.073419 mapread 0x02658e thru 0x0364a4 (0xff17 bytes) 000466 1775042818.113578 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3eb3d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb3d): Mirror 2: 0xd91e81aa (stale) Mirror 3: 0xd91e81aa (stale) Mirror 5: 0xd91e81aa (stale) Mirror 6: 0xd91e81aa (stale) Mirror 7: 0xd91e81aa (stale) Mirror 9: 0x5cd66061 (stale) Mirror 11: 0x13f3614f (stale) Mirror 12: 0x5854115f (stale) Mirror 13: 0x2d32e72b (stale) Mirror 14: 0xf7755fb7 (stale) CRC-32 checksum value for chunk [0, 0x3eb3d): Mirror 1: 0x3421a0f7 Mirror 15: 0x3421a0f7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb3d: skipped 000468 1775042819.072390 mapread 0x00dbab thru 0x01c427 (0xe87d bytes) 000469 1775042819.124496 trunc from 0x03eb3d to 0x033e18 (0xad24 bytes) 000472 1775042819.225058 mapread 0x007716 thru 0x0096bb (0x1fa6 bytes) 000473 1775042819.247301 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x33e19): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33e19): Mirror 2: 0xafd5d697 (stale) Mirror 3: 0xafd5d697 (stale) Mirror 5: 0xafd5d697 (stale) Mirror 6: 0xafd5d697 (stale) Mirror 7: 0xafd5d697 (stale) Mirror 9: 0xf810030 (stale) Mirror 11: 0xdfead925 (stale) Mirror 12: 0xec3ef8c (stale) Mirror 13: 0x28e428e6 (stale) Mirror 14: 0xeb02fda9 (stale) Mirror 15: 0xeb02fda9 (stale) CRC-32 checksum value for chunk [0, 0x33e19): Mirror 1: 0xeb02fda9 Mirror 16: 0xeb02fda9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33e19: skipped 000474 1775042820.093357 trunc from 0x033e19 to 0x010bc9 (0x2324f bytes) 000478 1775042820.203884 mapwrite 0x014adf thru 0x019e06 (0x5328 bytes) 000479 1775042820.323936 MIRROR_RESYNC 13 mirrors 000480 1775042821.881187 trunc from 0x019e07 to 0x030ad9 (0x16cd3 bytes) 000481 1775042821.969854 mapwrite 0x01cf69 thru 0x027972 (0xaa0a bytes) 000482 1775042822.065577 mapwrite 0x03f950 thru 0x03ffff (0x6b0 bytes) 000483 1775042822.142669 trunc from 0x040000 to 0x03ccf4 (0x330b bytes) 000485 1775042822.160520 mapread 0x03a693 thru 0x03a764 (0xd2 bytes) 000486 1775042822.161920 read 0x0051be thru 0x00f6a4 (0xa4e7 bytes) 000488 1775042822.174992 trunc from 0x03ccf5 to 0x031562 (0xb792 bytes) 000489 1775042822.190904 write 0x0306df thru 0x0392fb (0x8c1d bytes) 000490 1775042822.204283 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x392fc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x392fc): Mirror 2: 0x9417a0ea (stale) Mirror 3: 0x9417a0ea (stale) Mirror 5: 0x9417a0ea (stale) Mirror 6: 0x9417a0ea (stale) Mirror 7: 0x9417a0ea (stale) Mirror 9: 0x9417a0ea (stale) Mirror 11: 0x9417a0ea (stale) Mirror 12: 0x9417a0ea (stale) Mirror 13: 0x9417a0ea (stale) Mirror 14: 0x9417a0ea (stale) Mirror 15: 0x9417a0ea (stale) Mirror 16: 0x9417a0ea (stale) CRC-32 checksum value for chunk [0, 0x392fc): Mirror 1: 0x5153734c Mirror 17: 0x5153734c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x392fc: skipped 000491 1775042823.103278 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x392fc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x392fc): Mirror 2: 0x9417a0ea (stale) Mirror 3: 0x9417a0ea (stale) Mirror 5: 0x9417a0ea (stale) Mirror 6: 0x9417a0ea (stale) Mirror 7: 0x9417a0ea (stale) Mirror 9: 0x9417a0ea (stale) Mirror 11: 0x9417a0ea (stale) Mirror 12: 0x9417a0ea (stale) Mirror 13: 0x9417a0ea (stale) Mirror 14: 0x9417a0ea (stale) Mirror 15: 0x9417a0ea (stale) Mirror 16: 0x9417a0ea (stale) CRC-32 checksum value for chunk [0, 0x392fc): Mirror 1: 0x5153734c Mirror 17: 0x5153734c Mirror 18: 0x5153734c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x392fc: skipped truncating to largest ever: 0x3ea46 000492 1775042823.953327 trunc from 0x0392fc to 0x03ea45 (0x574a bytes) 000496 1775042824.044630 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x3ea46): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ea46): Mirror 2: 0xf7959fe3 (stale) Mirror 3: 0xf7959fe3 (stale) Mirror 5: 0xf7959fe3 (stale) Mirror 6: 0xf7959fe3 (stale) Mirror 7: 0xf7959fe3 (stale) Mirror 9: 0xf7959fe3 (stale) Mirror 11: 0xf7959fe3 (stale) Mirror 12: 0xf7959fe3 (stale) Mirror 13: 0xf7959fe3 (stale) Mirror 14: 0xf7959fe3 (stale) Mirror 15: 0xf7959fe3 (stale) Mirror 16: 0xf7959fe3 (stale) Mirror 17: 0xe67cb1fa (stale) Mirror 18: 0xe67cb1fa (stale) CRC-32 checksum value for chunk [0, 0x3ea46): Mirror 1: 0xe67cb1fa Mirror 19: 0xe67cb1fa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ea46: skipped 000497 1775042824.890867 write 0x03f067 thru 0x03ffff (0xf99 bytes) 000498 1775042824.973517 read 0x010ed2 thru 0x01f63a (0xe769 bytes) 000499 1775042824.991851 MIRROR_SPLIT mirror 5 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9259ab76 (stale) Mirror 3: 0x9259ab76 (stale) Mirror 5: 0x9259ab76 (stale) Mirror 6: 0x9259ab76 (stale) Mirror 9: 0x9259ab76 (stale) Mirror 11: 0x9259ab76 (stale) Mirror 12: 0x9259ab76 (stale) Mirror 13: 0x9259ab76 (stale) Mirror 14: 0x9259ab76 (stale) Mirror 15: 0x9259ab76 (stale) Mirror 16: 0x9259ab76 (stale) Mirror 17: 0x2fb85119 (stale) Mirror 18: 0x2fb85119 (stale) Mirror 19: 0x2fb85119 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9259ab76 (stale) Mirror 3: 0x9259ab76 (stale) Mirror 5: 0x9259ab76 (stale) Mirror 6: 0x9259ab76 (stale) Mirror 9: 0x9259ab76 (stale) Mirror 11: 0x9259ab76 (stale) Mirror 12: 0x9259ab76 (stale) Mirror 13: 0x9259ab76 (stale) Mirror 14: 0x9259ab76 (stale) Mirror 15: 0x9259ab76 (stale) Mirror 16: 0x9259ab76 (stale) Mirror 17: 0x2fb85119 (stale) Mirror 18: 0x2fb85119 (stale) Mirror 19: 0x2fb85119 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000500 1775042825.647464 write 0x016c49 thru 0x01c274 (0x562c bytes) 000501 1775042825.663540 trunc from 0x040000 to 0x0063d4 (0x39c2b bytes) 000503 1775042825.684832 MIRROR_SPLIT mirror 9 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x63d5): Mirror 2: 0x27535ec2 (stale) Mirror 3: 0x27535ec2 (stale) Mirror 5: 0x27535ec2 (stale) Mirror 6: 0x27535ec2 (stale) Mirror 9: 0x27535ec2 (stale) Mirror 11: 0x27535ec2 (stale) Mirror 12: 0x27535ec2 (stale) Mirror 13: 0x27535ec2 (stale) Mirror 15: 0x27535ec2 (stale) Mirror 16: 0x27535ec2 (stale) Mirror 17: 0x27535ec2 (stale) Mirror 18: 0x27535ec2 (stale) Mirror 19: 0x27535ec2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x63d5): Mirror 2: 0x27535ec2 (stale) Mirror 3: 0x27535ec2 (stale) Mirror 5: 0x27535ec2 (stale) Mirror 6: 0x27535ec2 (stale) Mirror 9: 0x27535ec2 (stale) Mirror 11: 0x27535ec2 (stale) Mirror 12: 0x27535ec2 (stale) Mirror 13: 0x27535ec2 (stale) Mirror 15: 0x27535ec2 (stale) Mirror 16: 0x27535ec2 (stale) Mirror 17: 0x27535ec2 (stale) Mirror 18: 0x27535ec2 (stale) Mirror 19: 0x27535ec2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x63d5: skipped 000507 1775042826.241414 write 0x01422c thru 0x0204d3 (0xc2a8 bytes) 000509 1775042826.243847 mapread 0x006385 thru 0x00fb10 (0x978c bytes) 000510 1775042826.263213 read 0x0187ce thru 0x01b5ca (0x2dfd bytes) 000511 1775042826.270645 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x204d4): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x204d4): Mirror 2: 0xe6adc2be (stale) Mirror 3: 0xe6adc2be (stale) Mirror 5: 0xe6adc2be (stale) Mirror 6: 0xe6adc2be (stale) Mirror 9: 0xe6adc2be (stale) Mirror 11: 0xe6adc2be (stale) Mirror 12: 0xe6adc2be (stale) Mirror 13: 0xe6adc2be (stale) Mirror 15: 0xe6adc2be (stale) Mirror 16: 0xe6adc2be (stale) Mirror 17: 0x9e1fc21 (stale) Mirror 18: 0x9e1fc21 (stale) Mirror 19: 0x9e1fc21 (stale) CRC-32 checksum value for chunk [0, 0x204d4): Mirror 1: 0x1adce1ba Mirror 20: 0x1adce1ba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x204d4: skipped 000512 1775042827.163649 mapread 0x008b55 thru 0x00af5b (0x2407 bytes) 000515 1775042827.209466 trunc from 0x0204d4 to 0x035f29 (0x15a56 bytes) 000516 1775042827.305611 write 0x037584 thru 0x03f79c (0x8219 bytes) 000517 1775042827.307421 trunc from 0x03f79d to 0x023ef0 (0x1b8ac bytes) 000519 1775042827.332016 read 0x009db9 thru 0x012c95 (0x8edd bytes) 000522 1775042827.351650 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x23ef1): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23ef1): Mirror 2: 0x67432191 (stale) Mirror 3: 0x67432191 (stale) Mirror 5: 0x67432191 (stale) Mirror 6: 0x67432191 (stale) Mirror 9: 0x67432191 (stale) Mirror 11: 0x67432191 (stale) Mirror 12: 0x67432191 (stale) Mirror 13: 0x67432191 (stale) Mirror 15: 0x67432191 (stale) Mirror 16: 0x67432191 (stale) Mirror 17: 0xa3aea1b0 (stale) Mirror 18: 0xa3aea1b0 (stale) Mirror 19: 0xa3aea1b0 (stale) Mirror 20: 0x278efa76 (stale) CRC-32 checksum value for chunk [0, 0x23ef1): Mirror 1: 0x278efa76 Mirror 21: 0x278efa76 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23ef1: skipped 000524 1775042828.225782 MIRROR_RESYNC 16 mirrors 000526 1775042830.089773 mapwrite 0x003ba6 thru 0x008d2a (0x5185 bytes) 000527 1775042830.281549 mapread 0x01e8f9 thru 0x023ef0 (0x55f8 bytes) 000528 1775042830.290733 read 0x01d09a thru 0x023ef0 (0x6e57 bytes) 000529 1775042830.291656 mapread 0x007a1b thru 0x00d55b (0x5b41 bytes) 000532 1775042830.294143 mapread 0x007649 thru 0x011363 (0x9d1b bytes) 000533 1775042830.307617 write 0x0289a2 thru 0x0341c4 (0xb823 bytes) 000537 1775042830.315316 write 0x004be6 thru 0x011eba (0xd2d5 bytes) 000539 1775042830.317882 mapwrite 0x00fab7 thru 0x01b5e2 (0xbb2c bytes) 000541 1775042830.396277 trunc from 0x0341c5 to 0x014a87 (0x1f73d bytes) 000542 1775042830.446696 write 0x02358d thru 0x02c86c (0x92e0 bytes) 000544 1775042830.451217 write 0x03618c thru 0x03ffff (0x9e74 bytes) 000545 1775042830.453968 write 0x03503d thru 0x03e6e7 (0x96ab bytes) 000546 1775042830.470314 MIRROR_RESYNC 16 mirrors 000549 1775042832.205231 write 0x025517 thru 0x033d15 (0xe7ff bytes) 000550 1775042832.294634 write 0x000f1b thru 0x005e1d (0x4f03 bytes) 000552 1775042832.314985 mapwrite 0x0022f0 thru 0x005d52 (0x3a63 bytes) 000555 1775042832.369291 MIRROR_SPLIT mirror 9 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x639d2f56 (stale) Mirror 3: 0x639d2f56 (stale) Mirror 5: 0x639d2f56 (stale) Mirror 6: 0x639d2f56 (stale) Mirror 9: 0x639d2f56 (stale) Mirror 11: 0x639d2f56 (stale) Mirror 12: 0x639d2f56 (stale) Mirror 13: 0x639d2f56 (stale) Mirror 16: 0x639d2f56 (stale) Mirror 17: 0x639d2f56 (stale) Mirror 18: 0x639d2f56 (stale) Mirror 19: 0x639d2f56 (stale) Mirror 20: 0x639d2f56 (stale) Mirror 21: 0x639d2f56 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x639d2f56 (stale) Mirror 3: 0x639d2f56 (stale) Mirror 5: 0x639d2f56 (stale) Mirror 6: 0x639d2f56 (stale) Mirror 9: 0x639d2f56 (stale) Mirror 11: 0x639d2f56 (stale) Mirror 12: 0x639d2f56 (stale) Mirror 13: 0x639d2f56 (stale) Mirror 16: 0x639d2f56 (stale) Mirror 17: 0x639d2f56 (stale) Mirror 18: 0x639d2f56 (stale) Mirror 19: 0x639d2f56 (stale) Mirror 20: 0x639d2f56 (stale) Mirror 21: 0x639d2f56 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000556 1775042833.135052 mapwrite 0x009885 thru 0x010d99 (0x7515 bytes) 000557 1775042833.224271 mapread 0x00ac13 thru 0x00ca9c (0x1e8a bytes) 000559 1775042833.225972 trunc from 0x040000 to 0x02be35 (0x141ca bytes) 000561 1775042833.261751 MIRROR_RESYNC 15 mirrors 000563 1775042835.243984 MIRROR_EXTEND to 16 mirrors 000566 1775042836.132822 mapwrite 0x003308 thru 0x007697 (0x4390 bytes) 000567 1775042836.369303 read 0x01f388 thru 0x027109 (0x7d82 bytes) 000568 1775042836.381001 mapwrite 0x01995b thru 0x0230aa (0x9750 bytes) 000574 1775042836.483077 mapwrite 0x032e41 thru 0x034f1c (0x20dc bytes) 000577 1775042836.583496 mapwrite 0x01f0aa thru 0x020909 (0x1860 bytes) 000579 1775042836.624082 mapwrite 0x033e2d thru 0x03ffff (0xc1d3 bytes) 000581 1775042836.696227 write 0x003428 thru 0x00c9a5 (0x957e bytes) 000582 1775042836.697902 write 0x003f59 thru 0x00e4a0 (0xa548 bytes) 000583 1775042836.699737 write 0x03a0ad thru 0x03ffff (0x5f53 bytes) 000585 1775042836.701939 read 0x0155d0 thru 0x0179e7 (0x2418 bytes) 000587 1775042836.708511 read 0x029d51 thru 0x036fef (0xd29f bytes) 000589 1775042836.723036 trunc from 0x040000 to 0x00107d (0x3ef82 bytes) 000593 1775042836.744248 read 0x000cff thru 0x00107d (0x37f bytes) 000594 1775042836.745131 trunc from 0x00107e to 0x03a2fb (0x3927e bytes) 000595 1775042836.766342 MIRROR_RESYNC 16 mirrors 000597 1775042838.652115 mapread 0x030815 thru 0x0391a6 (0x8992 bytes) 000598 1775042838.676373 mapwrite 0x02cc56 thru 0x03ca3d (0xfde8 bytes) 000599 1775042838.869339 trunc from 0x03ca3e to 0x01313b (0x29902 bytes) 000600 1775042838.895004 write 0x00e345 thru 0x01b75b (0xd417 bytes) 000601 1775042838.906849 read 0x011bc3 thru 0x01b75b (0x9b99 bytes) 000602 1775042838.908070 trunc from 0x01b75c to 0x008550 (0x1320b bytes) 000603 1775042838.922971 write 0x015c83 thru 0x01e741 (0x8abf bytes) 000610 1775042838.929440 read 0x010c58 thru 0x014e79 (0x4222 bytes) 000612 1775042838.938600 read 0x013690 thru 0x01875b (0x50cc bytes) 000613 1775042838.944669 MIRROR_RESYNC 16 mirrors 000615 1775042840.682677 mapread 0x01c660 thru 0x01e741 (0x20e2 bytes) 000618 1775042840.710063 read 0x012710 thru 0x01a3be (0x7caf bytes) 000620 1775042840.721139 mapwrite 0x03f212 thru 0x03ffff (0xdee bytes) 000621 1775042840.853794 mapread 0x005ec2 thru 0x014e27 (0xef66 bytes) 000624 1775042840.878432 read 0x004d42 thru 0x0147c3 (0xfa82 bytes) 000626 1775042840.885523 MIRROR_SPLIT mirror 14 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5b37b0b5 (stale) Mirror 3: 0x5b37b0b5 (stale) Mirror 5: 0x5b37b0b5 (stale) Mirror 6: 0x5b37b0b5 (stale) Mirror 9: 0x5b37b0b5 (stale) Mirror 11: 0x5b37b0b5 (stale) Mirror 12: 0x5b37b0b5 (stale) Mirror 13: 0x5b37b0b5 (stale) Mirror 16: 0x5b37b0b5 (stale) Mirror 17: 0x5b37b0b5 (stale) Mirror 18: 0x5b37b0b5 (stale) Mirror 19: 0x5b37b0b5 (stale) Mirror 20: 0x5b37b0b5 (stale) Mirror 22: 0x5b37b0b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5b37b0b5 (stale) Mirror 3: 0x5b37b0b5 (stale) Mirror 5: 0x5b37b0b5 (stale) Mirror 6: 0x5b37b0b5 (stale) Mirror 9: 0x5b37b0b5 (stale) Mirror 11: 0x5b37b0b5 (stale) Mirror 12: 0x5b37b0b5 (stale) Mirror 13: 0x5b37b0b5 (stale) Mirror 16: 0x5b37b0b5 (stale) Mirror 17: 0x5b37b0b5 (stale) Mirror 18: 0x5b37b0b5 (stale) Mirror 19: 0x5b37b0b5 (stale) Mirror 20: 0x5b37b0b5 (stale) Mirror 22: 0x5b37b0b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000627 1775042841.627831 mapread 0x006cfa thru 0x00ca20 (0x5d27 bytes) 000630 1775042841.652870 trunc from 0x040000 to 0x00dbc6 (0x32439 bytes) 000631 1775042841.669045 read 0x00a696 thru 0x00dbc6 (0x3531 bytes) 000632 1775042841.669730 read 0x0089c7 thru 0x00dbc6 (0x5200 bytes) 000633 1775042841.670390 write 0x0245f1 thru 0x0292c7 (0x4cd7 bytes) 000634 1775042841.673966 mapwrite 0x018bff thru 0x01db9b (0x4f9d bytes) 000635 1775042841.726483 write 0x03bb21 thru 0x03ed5e (0x323e bytes) 000636 1775042841.727962 mapwrite 0x0389e3 thru 0x03ffff (0x761d bytes) 000638 1775042841.818022 trunc from 0x040000 to 0x024a3d (0x1b5c2 bytes) 000639 1775042841.847086 read 0x01c3c8 thru 0x024a3d (0x8676 bytes) 000641 1775042841.857303 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x24a3e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24a3e): Mirror 2: 0xf309a2b9 (stale) Mirror 3: 0xf309a2b9 (stale) Mirror 5: 0xf309a2b9 (stale) Mirror 6: 0xf309a2b9 (stale) Mirror 9: 0xf309a2b9 (stale) Mirror 11: 0xf309a2b9 (stale) Mirror 12: 0xf309a2b9 (stale) Mirror 13: 0xf309a2b9 (stale) Mirror 16: 0xf309a2b9 (stale) Mirror 17: 0xf309a2b9 (stale) Mirror 18: 0xf309a2b9 (stale) Mirror 19: 0xf309a2b9 (stale) Mirror 20: 0xf309a2b9 (stale) Mirror 22: 0xf309a2b9 (stale) CRC-32 checksum value for chunk [0, 0x24a3e): Mirror 1: 0x57f6191e Mirror 23: 0x57f6191e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24a3e: skipped 000642 1775042843.019734 mapread 0x017bab thru 0x02061f (0x8a75 bytes) 000643 1775042843.071960 mapwrite 0x01a8ad thru 0x024533 (0x9c87 bytes) 000644 1775042843.316281 read 0x01dc99 thru 0x024a3d (0x6da5 bytes) 000645 1775042843.317441 trunc from 0x024a3e to 0x01152a (0x13513 bytes) 000647 1775042843.344757 mapread 0x006499 thru 0x01152a (0xb092 bytes) 000648 1775042843.362853 trunc from 0x01152b to 0x00042f (0x110fb bytes) 000649 1775042843.385341 trunc from 0x000430 to 0x01d39b (0x1cf6c bytes) 000651 1775042843.412955 read 0x00a11f thru 0x00b21c (0x10fe bytes) 000653 1775042843.434431 MIRROR_SPLIT mirror 2 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d39c): Mirror 2: 0xcb4ca6d8 (stale) Mirror 5: 0xcb4ca6d8 (stale) Mirror 6: 0xcb4ca6d8 (stale) Mirror 9: 0xcb4ca6d8 (stale) Mirror 11: 0xcb4ca6d8 (stale) Mirror 12: 0xcb4ca6d8 (stale) Mirror 13: 0xcb4ca6d8 (stale) Mirror 16: 0xcb4ca6d8 (stale) Mirror 17: 0xcb4ca6d8 (stale) Mirror 18: 0xcb4ca6d8 (stale) Mirror 19: 0xcb4ca6d8 (stale) Mirror 20: 0xcb4ca6d8 (stale) Mirror 22: 0xcb4ca6d8 (stale) Mirror 23: 0xb5c2f135 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d39c): Mirror 2: 0xcb4ca6d8 (stale) Mirror 5: 0xcb4ca6d8 (stale) Mirror 6: 0xcb4ca6d8 (stale) Mirror 9: 0xcb4ca6d8 (stale) Mirror 11: 0xcb4ca6d8 (stale) Mirror 12: 0xcb4ca6d8 (stale) Mirror 13: 0xcb4ca6d8 (stale) Mirror 16: 0xcb4ca6d8 (stale) Mirror 17: 0xcb4ca6d8 (stale) Mirror 18: 0xcb4ca6d8 (stale) Mirror 19: 0xcb4ca6d8 (stale) Mirror 20: 0xcb4ca6d8 (stale) Mirror 22: 0xcb4ca6d8 (stale) Mirror 23: 0xb5c2f135 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d39c: skipped 000654 1775042844.166652 mapwrite 0x0201ee thru 0x02fdee (0xfc01 bytes) 000655 1775042844.271962 MIRROR_RESYNC 15 mirrors 000656 1775042846.317889 mapwrite 0x00bbdf thru 0x01ad04 (0xf126 bytes) 000657 1775042846.520872 MIRROR_SPLIT mirror 14 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fdef): Mirror 2: 0x9455282b (stale) Mirror 5: 0x9455282b (stale) Mirror 6: 0x9455282b (stale) Mirror 9: 0x9455282b (stale) Mirror 11: 0x9455282b (stale) Mirror 12: 0x9455282b (stale) Mirror 13: 0x9455282b (stale) Mirror 16: 0x9455282b (stale) Mirror 17: 0x9455282b (stale) Mirror 18: 0x9455282b (stale) Mirror 19: 0x9455282b (stale) Mirror 20: 0x9455282b (stale) Mirror 22: 0x9455282b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fdef): Mirror 2: 0x9455282b (stale) Mirror 5: 0x9455282b (stale) Mirror 6: 0x9455282b (stale) Mirror 9: 0x9455282b (stale) Mirror 11: 0x9455282b (stale) Mirror 12: 0x9455282b (stale) Mirror 13: 0x9455282b (stale) Mirror 16: 0x9455282b (stale) Mirror 17: 0x9455282b (stale) Mirror 18: 0x9455282b (stale) Mirror 19: 0x9455282b (stale) Mirror 20: 0x9455282b (stale) Mirror 22: 0x9455282b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fdef: skipped 000659 1775042847.346914 write 0x034898 thru 0x0399db (0x5144 bytes) 000660 1775042847.351817 mapread 0x01da1d thru 0x0221fc (0x47e0 bytes) 000661 1775042847.376609 read 0x02bdf5 thru 0x02fe00 (0x400c bytes) 000664 1775042847.388221 mapread 0x0371d0 thru 0x0399db (0x280c bytes) 000666 1775042847.398585 MIRROR_RESYNC 14 mirrors 000667 1775042849.271021 trunc from 0x0399dc to 0x02a466 (0xf575 bytes) 000668 1775042849.379838 MIRROR_SPLIT mirror 4 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a467): Mirror 2: 0x3a70a955 (stale) Mirror 5: 0x3a70a955 (stale) Mirror 6: 0x3a70a955 (stale) Mirror 11: 0x3a70a955 (stale) Mirror 12: 0x3a70a955 (stale) Mirror 13: 0x3a70a955 (stale) Mirror 16: 0x3a70a955 (stale) Mirror 17: 0x3a70a955 (stale) Mirror 18: 0x3a70a955 (stale) Mirror 19: 0x3a70a955 (stale) Mirror 20: 0x3a70a955 (stale) Mirror 22: 0x3a70a955 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a467): Mirror 2: 0x3a70a955 (stale) Mirror 5: 0x3a70a955 (stale) Mirror 6: 0x3a70a955 (stale) Mirror 11: 0x3a70a955 (stale) Mirror 12: 0x3a70a955 (stale) Mirror 13: 0x3a70a955 (stale) Mirror 16: 0x3a70a955 (stale) Mirror 17: 0x3a70a955 (stale) Mirror 18: 0x3a70a955 (stale) Mirror 19: 0x3a70a955 (stale) Mirror 20: 0x3a70a955 (stale) Mirror 22: 0x3a70a955 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a467: skipped 000669 1775042850.158236 MIRROR_SPLIT mirror 9 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a467): Mirror 2: 0x3a70a955 (stale) Mirror 5: 0x3a70a955 (stale) Mirror 6: 0x3a70a955 (stale) Mirror 11: 0x3a70a955 (stale) Mirror 12: 0x3a70a955 (stale) Mirror 13: 0x3a70a955 (stale) Mirror 16: 0x3a70a955 (stale) Mirror 17: 0x3a70a955 (stale) Mirror 19: 0x3a70a955 (stale) Mirror 20: 0x3a70a955 (stale) Mirror 22: 0x3a70a955 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a467): Mirror 2: 0x3a70a955 (stale) Mirror 5: 0x3a70a955 (stale) Mirror 6: 0x3a70a955 (stale) Mirror 11: 0x3a70a955 (stale) Mirror 12: 0x3a70a955 (stale) Mirror 13: 0x3a70a955 (stale) Mirror 16: 0x3a70a955 (stale) Mirror 17: 0x3a70a955 (stale) Mirror 19: 0x3a70a955 (stale) Mirror 20: 0x3a70a955 (stale) Mirror 22: 0x3a70a955 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a467: skipped 000670 1775042850.847360 read 0x00e370 thru 0x01b8b7 (0xd548 bytes) 000671 1775042850.874895 MIRROR_SPLIT mirror 7 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a467): Mirror 2: 0x3a70a955 (stale) Mirror 5: 0x3a70a955 (stale) Mirror 6: 0x3a70a955 (stale) Mirror 11: 0x3a70a955 (stale) Mirror 12: 0x3a70a955 (stale) Mirror 13: 0x3a70a955 (stale) Mirror 17: 0x3a70a955 (stale) Mirror 19: 0x3a70a955 (stale) Mirror 20: 0x3a70a955 (stale) Mirror 22: 0x3a70a955 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a467): Mirror 2: 0x3a70a955 (stale) Mirror 5: 0x3a70a955 (stale) Mirror 6: 0x3a70a955 (stale) Mirror 11: 0x3a70a955 (stale) Mirror 12: 0x3a70a955 (stale) Mirror 13: 0x3a70a955 (stale) Mirror 17: 0x3a70a955 (stale) Mirror 19: 0x3a70a955 (stale) Mirror 20: 0x3a70a955 (stale) Mirror 22: 0x3a70a955 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a467: skipped 000673 1775042851.542942 read 0x01ff0a thru 0x02a466 (0xa55d bytes) 000675 1775042851.562148 write 0x0027d8 thru 0x0046b4 (0x1edd bytes) 000676 1775042851.592468 read 0x0185f0 thru 0x0243d1 (0xbde2 bytes) 000678 1775042851.668613 mapwrite 0x03e7c1 thru 0x03ffff (0x183f bytes) 000679 1775042851.802576 trunc from 0x040000 to 0x0399f2 (0x660d bytes) 000680 1775042851.840556 read 0x00d47f thru 0x01aef6 (0xda78 bytes) 000681 1775042851.841642 mapread 0x0156bd thru 0x01bd7b (0x66bf bytes) 000682 1775042851.843843 trunc from 0x0399f3 to 0x004a10 (0x34fe2 bytes) 000684 1775042851.873774 trunc from 0x004a11 to 0x02a3b7 (0x259a7 bytes) 000685 1775042851.905628 trunc from 0x02a3b8 to 0x0380dd (0xdd26 bytes) 000687 1775042851.933366 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x380de): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x380de): Mirror 2: 0x78bd021c (stale) Mirror 5: 0x78bd021c (stale) Mirror 6: 0x78bd021c (stale) Mirror 11: 0x78bd021c (stale) Mirror 12: 0x78bd021c (stale) Mirror 13: 0x78bd021c (stale) Mirror 17: 0x78bd021c (stale) Mirror 19: 0x78bd021c (stale) Mirror 20: 0x78bd021c (stale) Mirror 22: 0x78bd021c (stale) CRC-32 checksum value for chunk [0, 0x380de): Mirror 1: 0xf9f8d64b Mirror 23: 0xf9f8d64b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x380de: skipped 000690 1775042853.169999 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x380de): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x380de): Mirror 2: 0x78bd021c (stale) Mirror 5: 0x78bd021c (stale) Mirror 6: 0x78bd021c (stale) Mirror 11: 0x78bd021c (stale) Mirror 12: 0x78bd021c (stale) Mirror 13: 0x78bd021c (stale) Mirror 17: 0x78bd021c (stale) Mirror 19: 0x78bd021c (stale) Mirror 20: 0x78bd021c (stale) Mirror 22: 0x78bd021c (stale) CRC-32 checksum value for chunk [0, 0x380de): Mirror 1: 0xf9f8d64b Mirror 23: 0xf9f8d64b Mirror 24: 0xf9f8d64b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x380de: skipped 000691 1775042854.173477 read 0x01b426 thru 0x0276f0 (0xc2cb bytes) 000692 1775042854.183524 trunc from 0x0380de to 0x029c26 (0xe4b7 bytes) 000693 1775042854.271989 write 0x03d821 thru 0x03ffff (0x27df bytes) 000695 1775042854.280589 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfc4b8d3f (stale) Mirror 5: 0xfc4b8d3f (stale) Mirror 6: 0xfc4b8d3f (stale) Mirror 11: 0xfc4b8d3f (stale) Mirror 12: 0xfc4b8d3f (stale) Mirror 13: 0xfc4b8d3f (stale) Mirror 17: 0xfc4b8d3f (stale) Mirror 19: 0xfc4b8d3f (stale) Mirror 20: 0xfc4b8d3f (stale) Mirror 22: 0xfc4b8d3f (stale) Mirror 23: 0x68729abf (stale) Mirror 24: 0x68729abf (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2ccb4ae5 Mirror 25: 0x2ccb4ae5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000696 1775042855.230693 mapread 0x01a059 thru 0x022481 (0x8429 bytes) 000697 1775042855.264740 write 0x015277 thru 0x01e5dd (0x9367 bytes) 000699 1775042855.383635 mapwrite 0x0204f0 thru 0x0283e2 (0x7ef3 bytes) 000700 1775042855.464658 MIRROR_RESYNC 14 mirrors 000701 1775042857.472389 mapwrite 0x01d759 thru 0x029690 (0xbf38 bytes) 000702 1775042857.704905 mapwrite 0x003713 thru 0x012925 (0xf213 bytes) 000707 1775042857.801804 read 0x030e91 thru 0x037a97 (0x6c07 bytes) 000709 1775042857.814984 mapwrite 0x000ce9 thru 0x009faa (0x92c2 bytes) 000711 1775042857.882156 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd262e2cb (stale) Mirror 5: 0xd262e2cb (stale) Mirror 6: 0xd262e2cb (stale) Mirror 11: 0xd262e2cb (stale) Mirror 12: 0xd262e2cb (stale) Mirror 13: 0xd262e2cb (stale) Mirror 17: 0xd262e2cb (stale) Mirror 19: 0xd262e2cb (stale) Mirror 20: 0xd262e2cb (stale) Mirror 22: 0xd262e2cb (stale) Mirror 23: 0xd262e2cb (stale) Mirror 24: 0xd262e2cb (stale) Mirror 25: 0xd262e2cb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb936c26d Mirror 26: 0xb936c26d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000712 1775042859.034521 mapwrite 0x02a27e thru 0x03877e (0xe501 bytes) 000718 1775042859.278909 read 0x013d11 thru 0x0176b3 (0x39a3 bytes) 000719 1775042859.294559 read 0x02c87d thru 0x032de5 (0x6569 bytes) 000720 1775042859.295339 mapwrite 0x02b74c thru 0x02dfbb (0x2870 bytes) 000722 1775042859.347785 mapread 0x010ce7 thru 0x0179c7 (0x6ce1 bytes) 000725 1775042859.368037 write 0x01caab thru 0x0218e7 (0x4e3d bytes) 000726 1775042859.369483 mapread 0x028e52 thru 0x0353a3 (0xc552 bytes) 000730 1775042859.372682 mapread 0x0268c9 thru 0x02acaf (0x43e7 bytes) 000731 1775042859.373840 mapread 0x02aa21 thru 0x02e43a (0x3a1a bytes) 000732 1775042859.375539 write 0x023a4b thru 0x030ada (0xd090 bytes) 000734 1775042859.377580 read 0x033314 thru 0x03ea0d (0xb6fa bytes) 000736 1775042859.378830 write 0x031ff5 thru 0x03ffff (0xe00b bytes) 000738 1775042859.380870 read 0x01a8f0 thru 0x01ffc0 (0x56d1 bytes) 000739 1775042859.381753 trunc from 0x040000 to 0x03d1f6 (0x2e09 bytes) 000741 1775042859.414362 read 0x00bbb1 thru 0x00bc64 (0xb4 bytes) 000743 1775042859.416157 trunc from 0x03d1f7 to 0x032b43 (0xa6b3 bytes) 000744 1775042859.435477 read 0x022430 thru 0x028243 (0x5e14 bytes) 000748 1775042859.439347 read 0x0247c0 thru 0x02bf66 (0x77a7 bytes) 000749 1775042859.440570 mapread 0x02b6fe thru 0x030dbd (0x56c0 bytes) 000754 1775042859.446535 mapwrite 0x029a51 thru 0x03002c (0x65dc bytes) 000756 1775042859.524181 mapwrite 0x034dea thru 0x03504e (0x265 bytes) 000757 1775042859.600196 write 0x00e360 thru 0x011bc4 (0x3865 bytes) 000758 1775042859.614019 MIRROR_SPLIT mirror 10 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3504f): Mirror 2: 0x3aa56580 (stale) Mirror 5: 0x3aa56580 (stale) Mirror 6: 0x3aa56580 (stale) Mirror 11: 0x3aa56580 (stale) Mirror 12: 0x3aa56580 (stale) Mirror 13: 0x3aa56580 (stale) Mirror 17: 0x3aa56580 (stale) Mirror 19: 0x3aa56580 (stale) Mirror 20: 0x3aa56580 (stale) Mirror 23: 0x3aa56580 (stale) Mirror 24: 0x3aa56580 (stale) Mirror 25: 0x3aa56580 (stale) Mirror 26: 0xdda7b16b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3504f): Mirror 2: 0x3aa56580 (stale) Mirror 5: 0x3aa56580 (stale) Mirror 6: 0x3aa56580 (stale) Mirror 11: 0x3aa56580 (stale) Mirror 12: 0x3aa56580 (stale) Mirror 13: 0x3aa56580 (stale) Mirror 17: 0x3aa56580 (stale) Mirror 19: 0x3aa56580 (stale) Mirror 20: 0x3aa56580 (stale) Mirror 23: 0x3aa56580 (stale) Mirror 24: 0x3aa56580 (stale) Mirror 25: 0x3aa56580 (stale) Mirror 26: 0xdda7b16b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3504f: skipped 000759 1775042860.281967 mapwrite 0x00dceb thru 0x0146b4 (0x69ca bytes) 000760 1775042860.361821 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3504f): Mirror 5: 0x3aa56580 (stale) Mirror 6: 0x3aa56580 (stale) Mirror 11: 0x3aa56580 (stale) Mirror 12: 0x3aa56580 (stale) Mirror 13: 0x3aa56580 (stale) Mirror 17: 0x3aa56580 (stale) Mirror 19: 0x3aa56580 (stale) Mirror 20: 0x3aa56580 (stale) Mirror 23: 0x3aa56580 (stale) Mirror 24: 0x3aa56580 (stale) Mirror 25: 0x3aa56580 (stale) Mirror 26: 0xdda7b16b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3504f): Mirror 5: 0x3aa56580 (stale) Mirror 6: 0x3aa56580 (stale) Mirror 11: 0x3aa56580 (stale) Mirror 12: 0x3aa56580 (stale) Mirror 13: 0x3aa56580 (stale) Mirror 17: 0x3aa56580 (stale) Mirror 19: 0x3aa56580 (stale) Mirror 20: 0x3aa56580 (stale) Mirror 23: 0x3aa56580 (stale) Mirror 24: 0x3aa56580 (stale) Mirror 25: 0x3aa56580 (stale) Mirror 26: 0xdda7b16b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3504f: skipped 000764 1775042861.006392 mapread 0x006e73 thru 0x015090 (0xe21e bytes) 000765 1775042861.045295 read 0x0291a0 thru 0x03504e (0xbeaf bytes) 000766 1775042861.054570 mapread 0x019d12 thru 0x0204b2 (0x67a1 bytes) 000767 1775042861.066778 mapread 0x018168 thru 0x0254a9 (0xd342 bytes) 000768 1775042861.078935 write 0x009cd0 thru 0x014d0c (0xb03d bytes) 000772 1775042861.083760 write 0x03543e thru 0x03fcc8 (0xa88b bytes) 000773 1775042861.086993 read 0x007b01 thru 0x00b48a (0x398a bytes) 000775 1775042861.089429 write 0x004a92 thru 0x009e94 (0x5403 bytes) 000776 1775042861.092814 write 0x0264e4 thru 0x032795 (0xc2b2 bytes) 000777 1775042861.096673 mapread 0x037fcd thru 0x03c959 (0x498d bytes) 000778 1775042861.098483 read 0x0337b2 thru 0x03da68 (0xa2b7 bytes) 000779 1775042861.099629 read 0x02089a thru 0x020dff (0x566 bytes) 000780 1775042861.100633 write 0x003fd0 thru 0x01203a (0xe06b bytes) 000781 1775042861.102842 write 0x025c30 thru 0x02673f (0xb10 bytes) 000783 1775042861.104991 write 0x0076d0 thru 0x011c79 (0xa5aa bytes) 000784 1775042861.106375 mapwrite 0x000bd0 thru 0x007c5f (0x7090 bytes) 000785 1775042861.164328 trunc from 0x03fcc9 to 0x012c24 (0x2d0a4 bytes) 000786 1775042861.182392 mapwrite 0x0111cb thru 0x012a35 (0x186b bytes) 000788 1775042861.233590 trunc from 0x012c25 to 0x025249 (0x12625 bytes) 000789 1775042861.262029 MIRROR_SPLIT mirror 6 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2524a): Mirror 5: 0x9be1a687 (stale) Mirror 6: 0x9be1a687 (stale) Mirror 11: 0x9be1a687 (stale) Mirror 12: 0x9be1a687 (stale) Mirror 13: 0x9be1a687 (stale) Mirror 19: 0x9be1a687 (stale) Mirror 20: 0x9be1a687 (stale) Mirror 23: 0x9be1a687 (stale) Mirror 24: 0x9be1a687 (stale) Mirror 25: 0x9be1a687 (stale) Mirror 26: 0x5e723cd9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2524a): Mirror 5: 0x9be1a687 (stale) Mirror 6: 0x9be1a687 (stale) Mirror 11: 0x9be1a687 (stale) Mirror 12: 0x9be1a687 (stale) Mirror 13: 0x9be1a687 (stale) Mirror 19: 0x9be1a687 (stale) Mirror 20: 0x9be1a687 (stale) Mirror 23: 0x9be1a687 (stale) Mirror 24: 0x9be1a687 (stale) Mirror 25: 0x9be1a687 (stale) Mirror 26: 0x5e723cd9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2524a: skipped 000790 1775042861.887518 read 0x003237 thru 0x012707 (0xf4d1 bytes) 000791 1775042861.908275 MIRROR_RESYNC 12 mirrors 000792 1775042863.665708 write 0x01c77d thru 0x0283dc (0xbc60 bytes) 000795 1775042863.756804 MIRROR_RESYNC 12 mirrors 000797 1775042865.468245 trunc from 0x0283dd to 0x018b65 (0xf877 bytes) 000798 1775042865.551305 mapwrite 0x013da8 thru 0x02035b (0xc5b4 bytes) 000800 1775042865.688319 mapwrite 0x028607 thru 0x029609 (0x1003 bytes) 000801 1775042865.781801 trunc from 0x02960a to 0x028c2e (0x9db bytes) 000802 1775042865.810155 mapwrite 0x00b3b1 thru 0x014299 (0x8ee9 bytes) 000804 1775042865.882572 MIRROR_RESYNC 12 mirrors 000806 1775042867.675787 write 0x031763 thru 0x03e4da (0xcd78 bytes) 000808 1775042867.749966 MIRROR_RESYNC 12 mirrors 000809 1775042869.389183 MIRROR_EXTEND to 13 mirrors 000811 1775042870.137436 write 0x015f92 thru 0x025006 (0xf075 bytes) 000814 1775042870.226960 write 0x016687 thru 0x01c7a9 (0x6123 bytes) 000815 1775042870.229703 mapwrite 0x036d73 thru 0x03ffff (0x928d bytes) 000816 1775042870.320726 read 0x02b4a4 thru 0x031440 (0x5f9d bytes) 000817 1775042870.329192 write 0x027cf0 thru 0x0371be (0xf4cf bytes) 000818 1775042870.346700 MIRROR_RESYNC 13 mirrors 000819 1775042871.929473 MIRROR_RESYNC 13 mirrors 000825 1775042872.638838 mapread 0x00d59c thru 0x016bb6 (0x961b bytes) 000826 1775042872.674311 MIRROR_EXTEND to 14 mirrors 000828 1775042873.476987 mapwrite 0x0377ce thru 0x03ffff (0x8832 bytes) 000830 1775042873.659846 mapread 0x013af1 thru 0x018877 (0x4d87 bytes) 000834 1775042873.672479 read 0x0072a1 thru 0x009efc (0x2c5c bytes) 000836 1775042873.679828 trunc from 0x040000 to 0x027b1a (0x184e5 bytes) 000837 1775042873.713570 MIRROR_SPLIT mirror 10 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27b1b): Mirror 5: 0xa598480d (stale) Mirror 6: 0xa598480d (stale) Mirror 11: 0xa598480d (stale) Mirror 12: 0xa598480d (stale) Mirror 13: 0xa598480d (stale) Mirror 19: 0xa598480d (stale) Mirror 20: 0xa598480d (stale) Mirror 23: 0xa598480d (stale) Mirror 24: 0xa598480d (stale) Mirror 26: 0xa598480d (stale) Mirror 27: 0xa598480d (stale) Mirror 28: 0xa598480d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27b1b): Mirror 5: 0xa598480d (stale) Mirror 6: 0xa598480d (stale) Mirror 11: 0xa598480d (stale) Mirror 12: 0xa598480d (stale) Mirror 13: 0xa598480d (stale) Mirror 19: 0xa598480d (stale) Mirror 20: 0xa598480d (stale) Mirror 23: 0xa598480d (stale) Mirror 24: 0xa598480d (stale) Mirror 26: 0xa598480d (stale) Mirror 27: 0xa598480d (stale) Mirror 28: 0xa598480d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27b1b: skipped 000838 1775042874.333462 MIRROR_SPLIT mirror 3 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27b1b): Mirror 5: 0xa598480d (stale) Mirror 6: 0xa598480d (stale) Mirror 12: 0xa598480d (stale) Mirror 13: 0xa598480d (stale) Mirror 19: 0xa598480d (stale) Mirror 20: 0xa598480d (stale) Mirror 23: 0xa598480d (stale) Mirror 24: 0xa598480d (stale) Mirror 26: 0xa598480d (stale) Mirror 27: 0xa598480d (stale) Mirror 28: 0xa598480d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27b1b): Mirror 5: 0xa598480d (stale) Mirror 6: 0xa598480d (stale) Mirror 12: 0xa598480d (stale) Mirror 13: 0xa598480d (stale) Mirror 19: 0xa598480d (stale) Mirror 20: 0xa598480d (stale) Mirror 23: 0xa598480d (stale) Mirror 24: 0xa598480d (stale) Mirror 26: 0xa598480d (stale) Mirror 27: 0xa598480d (stale) Mirror 28: 0xa598480d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27b1b: skipped 000840 1775042874.979880 write 0x02d600 thru 0x039a81 (0xc482 bytes) 000841 1775042874.982393 read 0x004279 thru 0x008a94 (0x481c bytes) 000844 1775042874.995585 MIRROR_RESYNC 12 mirrors 000848 1775042876.581454 read 0x01e2b9 thru 0x028c2e (0xa976 bytes) 000849 1775042876.593632 mapread 0x01e167 thru 0x026d9f (0x8c39 bytes) 000851 1775042876.600851 write 0x02ad2e thru 0x03365c (0x892f bytes) 000852 1775042876.696840 mapread 0x02e67d thru 0x033b77 (0x54fb bytes) 000853 1775042876.697914 read 0x032645 thru 0x0353ee (0x2daa bytes) 000855 1775042876.716647 mapwrite 0x00548b thru 0x012d16 (0xd88c bytes) 000857 1775042876.793825 MIRROR_RESYNC 12 mirrors 000859 1775042878.260860 read 0x00e5c9 thru 0x0126e8 (0x4120 bytes) 000860 1775042878.268664 mapread 0x019bab thru 0x023510 (0x9966 bytes) 000863 1775042878.290131 mapwrite 0x02816a thru 0x0291c3 (0x105a bytes) 000864 1775042878.470776 mapread 0x013914 thru 0x018c27 (0x5314 bytes) 000866 1775042878.493661 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x39a82): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a82): Mirror 5: 0x1dfe5133 (stale) Mirror 6: 0x1dfe5133 (stale) Mirror 12: 0x1dfe5133 (stale) Mirror 13: 0x1dfe5133 (stale) Mirror 19: 0x1dfe5133 (stale) Mirror 20: 0x1dfe5133 (stale) Mirror 23: 0x1dfe5133 (stale) Mirror 24: 0x1dfe5133 (stale) Mirror 26: 0x1dfe5133 (stale) Mirror 27: 0x1dfe5133 (stale) Mirror 28: 0x1dfe5133 (stale) CRC-32 checksum value for chunk [0, 0x39a82): Mirror 1: 0x90a46b7e Mirror 29: 0x90a46b7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a82: skipped 000867 1775042879.435503 read 0x00ecb4 thru 0x01029e (0x15eb bytes) 000868 1775042879.444960 write 0x03a5d5 thru 0x03ffff (0x5a2b bytes) 000869 1775042879.537305 trunc from 0x040000 to 0x014b62 (0x2b49d bytes) 000871 1775042879.591619 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x14b63): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14b63): Mirror 5: 0x25f46099 (stale) Mirror 6: 0x25f46099 (stale) Mirror 12: 0x25f46099 (stale) Mirror 13: 0x25f46099 (stale) Mirror 19: 0x25f46099 (stale) Mirror 20: 0x25f46099 (stale) Mirror 23: 0x25f46099 (stale) Mirror 24: 0x25f46099 (stale) Mirror 26: 0x25f46099 (stale) Mirror 27: 0x25f46099 (stale) Mirror 28: 0x25f46099 (stale) Mirror 29: 0x25f46099 (stale) CRC-32 checksum value for chunk [0, 0x14b63): Mirror 1: 0x25f46099 Mirror 30: 0x25f46099 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14b63: skipped 000872 1775042880.472470 mapread 0x01464c thru 0x014b62 (0x517 bytes) 000874 1775042880.515921 mapread 0x0119a7 thru 0x013a80 (0x20da bytes) 000875 1775042880.574667 mapread 0x01273f thru 0x014b62 (0x2424 bytes) 000876 1775042880.590260 mapread 0x00388d thru 0x012067 (0xe7db bytes) 000877 1775042880.635870 mapwrite 0x001403 thru 0x0038b4 (0x24b2 bytes) 000878 1775042880.859324 mapread 0x004161 thru 0x0063cd (0x226d bytes) 000879 1775042880.860622 mapwrite 0x02cdd4 thru 0x02ddb8 (0xfe5 bytes) 000880 1775042880.942211 mapwrite 0x01cfff thru 0x01f711 (0x2713 bytes) 000881 1775042881.003284 mapwrite 0x019771 thru 0x01bb38 (0x23c8 bytes) 000882 1775042881.047010 mapwrite 0x02257d thru 0x02f34f (0xcdd3 bytes) 000883 1775042881.117458 write 0x00c727 thru 0x01bd13 (0xf5ed bytes) 000884 1775042881.119007 mapwrite 0x03b9af thru 0x03def9 (0x254b bytes) 000885 1775042881.219166 write 0x005706 thru 0x015460 (0xfd5b bytes) 000887 1775042881.223245 mapread 0x03db1e thru 0x03def9 (0x3dc bytes) 000888 1775042881.225981 mapread 0x03db7b thru 0x03def9 (0x37f bytes) 000890 1775042881.234851 MIRROR_SPLIT mirror 11 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3defa): Mirror 5: 0x63dee427 (stale) Mirror 6: 0x63dee427 (stale) Mirror 12: 0x63dee427 (stale) Mirror 13: 0x63dee427 (stale) Mirror 19: 0x63dee427 (stale) Mirror 20: 0x63dee427 (stale) Mirror 23: 0x63dee427 (stale) Mirror 24: 0x63dee427 (stale) Mirror 26: 0x63dee427 (stale) Mirror 27: 0x63dee427 (stale) Mirror 29: 0xd0ea8272 (stale) Mirror 30: 0x2451150f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3defa): Mirror 5: 0x63dee427 (stale) Mirror 6: 0x63dee427 (stale) Mirror 12: 0x63dee427 (stale) Mirror 13: 0x63dee427 (stale) Mirror 19: 0x63dee427 (stale) Mirror 20: 0x63dee427 (stale) Mirror 23: 0x63dee427 (stale) Mirror 24: 0x63dee427 (stale) Mirror 26: 0x63dee427 (stale) Mirror 27: 0x63dee427 (stale) Mirror 29: 0xd0ea8272 (stale) Mirror 30: 0x2451150f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3defa: skipped 000891 1775042881.943673 trunc from 0x03defa to 0x03d36d (0xb8c bytes) 000892 1775042881.964289 read 0x039a6e thru 0x03d36d (0x3900 bytes) 000895 1775042881.981450 mapread 0x031333 thru 0x039110 (0x7dde bytes) 000896 1775042882.012361 trunc from 0x03d36e to 0x025fd7 (0x17396 bytes) 000898 1775042882.038374 mapwrite 0x01f5b0 thru 0x020154 (0xba5 bytes) 000899 1775042882.093632 MIRROR_SPLIT mirror 7 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25fd8): Mirror 5: 0x50313aac (stale) Mirror 6: 0x50313aac (stale) Mirror 12: 0x50313aac (stale) Mirror 13: 0x50313aac (stale) Mirror 19: 0x50313aac (stale) Mirror 20: 0x50313aac (stale) Mirror 24: 0x50313aac (stale) Mirror 26: 0x50313aac (stale) Mirror 27: 0x50313aac (stale) Mirror 29: 0x50313aac (stale) Mirror 30: 0x7e3df585 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25fd8): Mirror 5: 0x50313aac (stale) Mirror 6: 0x50313aac (stale) Mirror 12: 0x50313aac (stale) Mirror 13: 0x50313aac (stale) Mirror 19: 0x50313aac (stale) Mirror 20: 0x50313aac (stale) Mirror 24: 0x50313aac (stale) Mirror 26: 0x50313aac (stale) Mirror 27: 0x50313aac (stale) Mirror 29: 0x50313aac (stale) Mirror 30: 0x7e3df585 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25fd8: skipped 000900 1775042882.604071 MIRROR_RESYNC 12 mirrors 000902 1775042884.116910 read 0x019e98 thru 0x025fd7 (0xc140 bytes) 000903 1775042884.143053 trunc from 0x025fd8 to 0x016bce (0xf409 bytes) 000904 1775042884.224238 trunc from 0x016bcf to 0x020704 (0x9b36 bytes) 000907 1775042884.249058 write 0x03250f thru 0x038fc5 (0x6ab7 bytes) 000908 1775042884.250756 mapwrite 0x00a1a8 thru 0x018b6b (0xe9c4 bytes) 000911 1775042884.349554 write 0x02b355 thru 0x02d59f (0x224b bytes) 000912 1775042884.367886 read 0x004bd9 thru 0x0143ed (0xf815 bytes) 000915 1775042884.381798 mapwrite 0x0312b1 thru 0x0372a7 (0x5ff7 bytes) 000917 1775042884.430211 trunc from 0x038fc6 to 0x021db1 (0x17214 bytes) 000920 1775042884.445972 trunc from 0x021db2 to 0x01d9aa (0x4407 bytes) 000921 1775042884.477649 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d9ab): Mirror 5: 0x2090c6b7 (stale) Mirror 6: 0x2090c6b7 (stale) Mirror 12: 0x2090c6b7 (stale) Mirror 13: 0x2090c6b7 (stale) Mirror 19: 0x2090c6b7 (stale) Mirror 20: 0x2090c6b7 (stale) Mirror 24: 0x2090c6b7 (stale) Mirror 27: 0x2090c6b7 (stale) Mirror 29: 0x2090c6b7 (stale) Mirror 30: 0x2090c6b7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d9ab): Mirror 5: 0x2090c6b7 (stale) Mirror 6: 0x2090c6b7 (stale) Mirror 12: 0x2090c6b7 (stale) Mirror 13: 0x2090c6b7 (stale) Mirror 19: 0x2090c6b7 (stale) Mirror 20: 0x2090c6b7 (stale) Mirror 24: 0x2090c6b7 (stale) Mirror 27: 0x2090c6b7 (stale) Mirror 29: 0x2090c6b7 (stale) Mirror 30: 0x2090c6b7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d9ab: skipped 000922 1775042885.072395 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x1d9ab): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d9ab): Mirror 5: 0x2090c6b7 (stale) Mirror 6: 0x2090c6b7 (stale) Mirror 12: 0x2090c6b7 (stale) Mirror 13: 0x2090c6b7 (stale) Mirror 19: 0x2090c6b7 (stale) Mirror 20: 0x2090c6b7 (stale) Mirror 24: 0x2090c6b7 (stale) Mirror 27: 0x2090c6b7 (stale) Mirror 29: 0x2090c6b7 (stale) Mirror 30: 0x2090c6b7 (stale) CRC-32 checksum value for chunk [0, 0x1d9ab): Mirror 1: 0x93f246b8 Mirror 31: 0x93f246b8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d9ab: skipped 000923 1775042886.022334 read 0x0079b1 thru 0x007f18 (0x568 bytes) 000924 1775042886.041083 read 0x008192 thru 0x00b450 (0x32bf bytes) 000926 1775042886.074174 read 0x00e11f thru 0x016564 (0x8446 bytes) 000929 1775042886.121998 write 0x00a0bd thru 0x019587 (0xf4cb bytes) 000930 1775042886.223424 mapwrite 0x03ae16 thru 0x03ee2a (0x4015 bytes) 000934 1775042886.355208 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ee2b): Mirror 6: 0xa3865b66 (stale) Mirror 12: 0xa3865b66 (stale) Mirror 13: 0xa3865b66 (stale) Mirror 19: 0xa3865b66 (stale) Mirror 20: 0xa3865b66 (stale) Mirror 24: 0xa3865b66 (stale) Mirror 27: 0xa3865b66 (stale) Mirror 29: 0xa3865b66 (stale) Mirror 30: 0xa3865b66 (stale) Mirror 31: 0x7f510a1c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ee2b): Mirror 6: 0xa3865b66 (stale) Mirror 12: 0xa3865b66 (stale) Mirror 13: 0xa3865b66 (stale) Mirror 19: 0xa3865b66 (stale) Mirror 20: 0xa3865b66 (stale) Mirror 24: 0xa3865b66 (stale) Mirror 27: 0xa3865b66 (stale) Mirror 29: 0xa3865b66 (stale) Mirror 30: 0xa3865b66 (stale) Mirror 31: 0x7f510a1c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ee2b: skipped 000937 1775042886.954122 write 0x03ed05 thru 0x03ffff (0x12fb bytes) 000940 1775042886.986667 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x2ce2086e (stale) Mirror 12: 0x2ce2086e (stale) Mirror 13: 0x2ce2086e (stale) Mirror 19: 0x2ce2086e (stale) Mirror 20: 0x2ce2086e (stale) Mirror 24: 0x2ce2086e (stale) Mirror 27: 0x2ce2086e (stale) Mirror 29: 0x2ce2086e (stale) Mirror 30: 0x2ce2086e (stale) Mirror 31: 0x17064021 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8c549586 Mirror 32: 0x8c549586 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000941 1775042888.032181 write 0x03078b thru 0x037dbd (0x7633 bytes) 000943 1775042888.148284 trunc from 0x040000 to 0x02a33b (0x15cc4 bytes) 000949 1775042888.175802 read 0x00d2df thru 0x01198b (0x46ad bytes) 000952 1775042888.185687 mapwrite 0x013a71 thru 0x01dade (0xa06e bytes) 000954 1775042888.276604 mapwrite 0x038376 thru 0x03ffff (0x7c8a bytes) 000956 1775042888.367607 trunc from 0x040000 to 0x031a6f (0xe590 bytes) 000957 1775042888.387181 write 0x028914 thru 0x034696 (0xbd83 bytes) 000958 1775042888.399075 trunc from 0x034697 to 0x03a148 (0x5ab2 bytes) 000961 1775042888.417389 mapread 0x011f27 thru 0x01fede (0xdfb8 bytes) 000963 1775042888.423371 trunc from 0x03a149 to 0x02e458 (0xbcf0 bytes) 000964 1775042888.460894 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2e459): Mirror 6: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e459): Mirror 6: 0x8b80c687 (stale) Mirror 12: 0x8b80c687 (stale) Mirror 13: 0x8b80c687 (stale) Mirror 19: 0x8b80c687 (stale) Mirror 20: 0x8b80c687 (stale) Mirror 24: 0x8b80c687 (stale) Mirror 27: 0x8b80c687 (stale) Mirror 29: 0x8b80c687 (stale) Mirror 30: 0x8b80c687 (stale) Mirror 31: 0x706216b9 (stale) Mirror 32: 0x28ae94a1 (stale) CRC-32 checksum value for chunk [0, 0x2e459): Mirror 1: 0xab960187 Mirror 33: 0xab960187 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e459: skipped 000965 1775042889.414982 write 0x01a2e9 thru 0x029165 (0xee7d bytes) 000966 1775042889.512383 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e459): Mirror 6: 0x8b80c687 (stale) Mirror 12: 0x8b80c687 (stale) Mirror 13: 0x8b80c687 (stale) Mirror 19: 0x8b80c687 (stale) Mirror 20: 0x8b80c687 (stale) Mirror 24: 0x8b80c687 (stale) Mirror 27: 0x8b80c687 (stale) Mirror 29: 0x8b80c687 (stale) Mirror 30: 0x8b80c687 (stale) Mirror 32: 0x28ae94a1 (stale) Mirror 33: 0xab960187 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e459): Mirror 6: 0x8b80c687 (stale) Mirror 12: 0x8b80c687 (stale) Mirror 13: 0x8b80c687 (stale) Mirror 19: 0x8b80c687 (stale) Mirror 20: 0x8b80c687 (stale) Mirror 24: 0x8b80c687 (stale) Mirror 27: 0x8b80c687 (stale) Mirror 29: 0x8b80c687 (stale) Mirror 30: 0x8b80c687 (stale) Mirror 32: 0x28ae94a1 (stale) Mirror 33: 0xab960187 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e459: skipped 000967 1775042890.227874 MIRROR_RESYNC 12 mirrors 000968 1775042891.954364 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x222:0x0]: Invalid argument (22) 000969 1775042892.466366 mapread 0x020cb3 thru 0x025d8a (0x50d8 bytes) 000970 1775042892.484056 write 0x02596c thru 0x02fa0c (0xa0a1 bytes) 000972 1775042892.573143 MIRROR_RESYNC 11 mirrors 000973 1775042894.163697 mapread 0x02c7f4 thru 0x02fa0c (0x3219 bytes) 000974 1775042894.184740 read 0x0173ce thru 0x01c4a7 (0x50da bytes) 000977 1775042894.197655 write 0x01eed2 thru 0x027526 (0x8655 bytes) 000979 1775042894.310458 trunc from 0x02fa0d to 0x028b88 (0x6e84 bytes) 000980 1775042894.349207 trunc from 0x028b89 to 0x03d2cc (0x14744 bytes) 000984 1775042894.379493 mapread 0x029636 thru 0x030d87 (0x7752 bytes) 000985 1775042894.391663 read 0x03ac71 thru 0x03d2cc (0x265c bytes) 000988 1775042894.407755 mapwrite 0x02fd2c thru 0x03d1fe (0xd4d3 bytes) 000989 1775042894.479960 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3d2cd): Mirror 6: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 30: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d2cd): Mirror 6: 0x8afdb8f (stale) Mirror 12: 0x8afdb8f (stale) Mirror 13: 0x8afdb8f (stale) Mirror 19: 0x8afdb8f (stale) Mirror 20: 0x8afdb8f (stale) Mirror 24: 0x8afdb8f (stale) Mirror 27: 0x8afdb8f (stale) Mirror 30: 0x8afdb8f (stale) Mirror 32: 0x8afdb8f (stale) Mirror 33: 0x8afdb8f (stale) CRC-32 checksum value for chunk [0, 0x3d2cd): Mirror 1: 0xddcd2312 Mirror 34: 0xddcd2312 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d2cd: skipped 000990 1775042895.385555 mapwrite 0x011987 thru 0x014814 (0x2e8e bytes) 000991 1775042895.563273 mapwrite 0x00b95f thru 0x018a48 (0xd0ea bytes) 000993 1775042895.623500 mapwrite 0x00151a thru 0x003ffe (0x2ae5 bytes) 000994 1775042895.682394 mapread 0x003b17 thru 0x00e006 (0xa4f0 bytes) 000995 1775042895.683802 mapread 0x022933 thru 0x029db9 (0x7487 bytes) 000996 1775042895.692452 mapread 0x010af6 thru 0x017281 (0x678c bytes) 000997 1775042895.694543 read 0x01a355 thru 0x01b3e0 (0x108c bytes) 000998 1775042895.696056 write 0x01a506 thru 0x01d1b4 (0x2caf bytes) 001000 1775042895.697835 write 0x01c9fd thru 0x01d46a (0xa6e bytes) All operations completed A-OK!