== sanity-flr test 70a: flr mode fsx test ================ 14:09:11 (1779991751) Seed set to 1753 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1779991753.872740 mapwrite 0x00cbbd thru 0x012eb8 (0x62fc bytes) 000007 1779991754.075027 write 0x03e5bb thru 0x03ffff (0x1a45 bytes) 000008 1779991754.076245 mapread 0x031013 thru 0x03fe78 (0xee66 bytes) truncating to largest ever: 0x279d4 000009 1779991754.105141 trunc from 0x040000 to 0x0279d3 (0x1862c bytes) 000010 1779991754.145102 read 0x0059c3 thru 0x00e182 (0x87c0 bytes) 000011 1779991754.152255 trunc from 0x0279d4 to 0x01d080 (0xa953 bytes) 000012 1779991754.184358 mapwrite 0x012ed0 thru 0x01590a (0x2a3b bytes) 000013 1779991754.297008 MIRROR_EXTEND to 2 mirrors 000016 1779991754.951595 trunc from 0x01d081 to 0x023fb9 (0x6f39 bytes) 000017 1779991755.102037 mapwrite 0x02b39c thru 0x033993 (0x85f8 bytes) 000018 1779991755.200694 trunc from 0x033994 to 0x018bf2 (0x1ada1 bytes) 000022 1779991755.219037 mapread 0x0098e8 thru 0x00b3c8 (0x1ae1 bytes) 000023 1779991755.233717 read 0x000478 thru 0x002b87 (0x2710 bytes) truncating to largest ever: 0x2f922 000024 1779991755.239079 trunc from 0x018bf3 to 0x02f921 (0x16d2f bytes) 000025 1779991755.261268 read 0x0218f0 thru 0x0251ca (0x38db bytes) 000027 1779991755.270659 mapwrite 0x014621 thru 0x0153c5 (0xda5 bytes) 000029 1779991755.311467 write 0x0374f9 thru 0x03ffff (0x8b07 bytes) 000030 1779991755.315146 trunc from 0x040000 to 0x019b94 (0x2646b bytes) 000035 1779991755.344345 mapread 0x01548e thru 0x019b94 (0x4707 bytes) 000038 1779991755.350055 write 0x01db0a thru 0x02bdb0 (0xe2a7 bytes) 000039 1779991755.354170 trunc from 0x02bdb1 to 0x0252cd (0x6ae3 bytes) 000041 1779991755.379912 MIRROR_RESYNC 2 mirrors 000042 1779991756.163541 mapread 0x02262c thru 0x0232a3 (0xc78 bytes) 000043 1779991756.179566 mapread 0x012687 thru 0x01b2c6 (0x8c40 bytes) 000046 1779991756.202127 read 0x011fc3 thru 0x0217d7 (0xf815 bytes) truncating to largest ever: 0x331ec 000047 1779991756.202693 trunc from 0x0252ce to 0x0331eb (0xdf1e bytes) 000048 1779991756.473941 read 0x00e52b thru 0x0143f0 (0x5ec6 bytes) 000049 1779991756.499498 trunc from 0x0331ec to 0x023955 (0xf896 bytes) 000050 1779991756.555185 MIRROR_RESYNC 2 mirrors 000051 1779991757.537220 read 0x01e3be thru 0x01f9c6 (0x1609 bytes) 000052 1779991757.546024 write 0x03e9c9 thru 0x03ffff (0x1637 bytes) 000053 1779991757.644810 write 0x01fbb0 thru 0x026b36 (0x6f87 bytes) 000054 1779991757.655053 mapread 0x037e20 thru 0x03ffff (0x81e0 bytes) 000056 1779991757.666358 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) 000057 1779991757.815285 trunc from 0x040000 to 0x007900 (0x386ff bytes) 000058 1779991757.844256 mapwrite 0x017704 thru 0x025519 (0xde16 bytes) 000059 1779991758.061953 mapwrite 0x038a06 thru 0x03cac6 (0x40c1 bytes) 000060 1779991758.209223 read 0x01ca15 thru 0x022e7d (0x6469 bytes) 000062 1779991758.222207 MIRROR_EXTEND to 2 mirrors 000063 1779991759.116779 mapwrite 0x012f40 thru 0x01bd45 (0x8e06 bytes) 000065 1779991759.405796 write 0x00a8d4 thru 0x00cfd1 (0x26fe bytes) 000066 1779991759.429622 mapread 0x034fb3 thru 0x03cac6 (0x7b14 bytes) 000068 1779991759.475349 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) 000069 1779991759.714586 read 0x02675f thru 0x02a845 (0x40e7 bytes) 000070 1779991759.723835 read 0x008081 thru 0x01243d (0xa3bd bytes) 000071 1779991759.746059 mapwrite 0x01e0e5 thru 0x029cba (0xbbd6 bytes) truncating to largest ever: 0x394bb 000072 1779991759.847090 trunc from 0x03cac7 to 0x0394ba (0x360c bytes) 000076 1779991759.887112 mapwrite 0x03e2e9 thru 0x03ffff (0x1d17 bytes) 000077 1779991759.990172 read 0x002b5a thru 0x007362 (0x4809 bytes) 000079 1779991759.991748 read 0x003af7 thru 0x00b202 (0x770c bytes) 000081 1779991760.000215 write 0x011120 thru 0x01eb62 (0xda43 bytes) 000083 1779991760.007153 mapwrite 0x01f2a3 thru 0x026346 (0x70a4 bytes) 000085 1779991760.126329 trunc from 0x040000 to 0x0166e0 (0x2991f bytes) 000087 1779991760.168926 MIRROR_EXTEND to 2 mirrors 000092 1779991760.722080 mapwrite 0x014f70 thru 0x01d292 (0x8323 bytes) 000093 1779991760.884020 read 0x00feb3 thru 0x018797 (0x88e5 bytes) 000094 1779991760.885941 mapread 0x01a992 thru 0x01d292 (0x2901 bytes) 000095 1779991760.887645 trunc from 0x01d293 to 0x001c98 (0x1b5fa bytes) 000096 1779991760.915304 trunc from 0x001c99 to 0x037c3a (0x35fa2 bytes) 000099 1779991760.942554 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x37c3b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c3b): Mirror 2: 0xbbb37aed (stale) CRC-32 checksum value for chunk [0, 0x37c3b): Mirror 1: 0x14f8d5b0 Mirror 3: 0x14f8d5b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c3b: skipped 000100 1779991761.951660 MIRROR_RESYNC 3 mirrors 000102 1779991762.777354 mapwrite 0x00fcd6 thru 0x017aff (0x7e2a bytes) 000103 1779991763.044158 write 0x02c1e0 thru 0x03bd18 (0xfb39 bytes) 000104 1779991763.071437 write 0x0261fa thru 0x0338b2 (0xd6b9 bytes) 000105 1779991763.080428 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3bd19): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd19): Mirror 2: 0x6f010219 (stale) Mirror 3: 0x6f010219 (stale) CRC-32 checksum value for chunk [0, 0x3bd19): Mirror 1: 0xa05c6d99 Mirror 4: 0xa05c6d99 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd19: skipped 000106 1779991764.655804 write 0x00ae9e thru 0x0159f4 (0xab57 bytes) 000107 1779991764.745361 write 0x01d4e3 thru 0x01e203 (0xd21 bytes) 000109 1779991764.764664 mapwrite 0x00ca35 thru 0x01b9ef (0xefbb bytes) 000110 1779991764.889876 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3bd19): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd19): Mirror 2: 0x6f010219 (stale) Mirror 3: 0x6f010219 (stale) Mirror 4: 0xa05c6d99 (stale) CRC-32 checksum value for chunk [0, 0x3bd19): Mirror 1: 0xf46146eb Mirror 5: 0xf46146eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd19: skipped 000111 1779991766.417905 read 0x00f580 thru 0x012550 (0x2fd1 bytes) 000112 1779991766.429338 trunc from 0x03bd19 to 0x029cfd (0x1201b bytes) 000114 1779991766.698705 MIRROR_RESYNC 5 mirrors 000115 1779991767.890735 read 0x02065c thru 0x024b45 (0x44ea bytes) 000116 1779991767.924116 trunc from 0x029cfe to 0x02298e (0x736f bytes) 000117 1779991768.073236 write 0x01cea7 thru 0x02594c (0x8aa6 bytes) 000118 1779991768.088789 mapread 0x023f24 thru 0x02594c (0x1a29 bytes) 000119 1779991768.089784 write 0x004438 thru 0x00d850 (0x9419 bytes) 000121 1779991768.105864 trunc from 0x02594d to 0x02273a (0x3212 bytes) 000123 1779991768.178006 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2273b): Mirror 3: 0xcacb3d85 (stale) Mirror 4: 0xcacb3d85 (stale) Mirror 5: 0xcacb3d85 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2273b): Mirror 3: 0xcacb3d85 (stale) Mirror 4: 0xcacb3d85 (stale) Mirror 5: 0xcacb3d85 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2273b: skipped 000125 1779991768.664622 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2273b): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2273b): Mirror 3: 0xcacb3d85 (stale) Mirror 4: 0xcacb3d85 (stale) Mirror 5: 0xcacb3d85 (stale) CRC-32 checksum value for chunk [0, 0x2273b): Mirror 1: 0x5017d78e Mirror 6: 0x5017d78e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2273b: skipped 000126 1779991769.548742 write 0x02392d thru 0x02494c (0x1020 bytes) 000127 1779991769.652166 mapwrite 0x00bf02 thru 0x012328 (0x6427 bytes) 000129 1779991769.811894 mapwrite 0x01a008 thru 0x021d6f (0x7d68 bytes) 000130 1779991769.911800 mapwrite 0x03ef87 thru 0x03ffff (0x1079 bytes) 000135 1779991770.020951 read 0x028a9a thru 0x03220b (0x9772 bytes) 000136 1779991770.030801 mapread 0x0078f3 thru 0x00fc62 (0x8370 bytes) 000137 1779991770.036904 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x20644f80 (stale) Mirror 4: 0x20644f80 (stale) Mirror 5: 0x20644f80 (stale) Mirror 6: 0xa6d15cc5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc34a8af2 Mirror 7: 0xc34a8af2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000138 1779991771.115254 write 0x0073c4 thru 0x00f287 (0x7ec4 bytes) 000139 1779991771.200627 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x20644f80 (stale) Mirror 4: 0x20644f80 (stale) Mirror 5: 0x20644f80 (stale) Mirror 6: 0xa6d15cc5 (stale) Mirror 7: 0xc34a8af2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4f0323c6 Mirror 8: 0x4f0323c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000140 1779991772.569845 write 0x00c08b thru 0x01921e (0xd194 bytes) 000141 1779991772.685410 write 0x00a5c6 thru 0x01312e (0x8b69 bytes) 000142 1779991772.694181 mapwrite 0x02f860 thru 0x038bb0 (0x9351 bytes) 000144 1779991772.783484 mapwrite 0x00b836 thru 0x01104b (0x5816 bytes) 000145 1779991772.846762 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x20644f80 (stale) Mirror 4: 0x20644f80 (stale) Mirror 5: 0x20644f80 (stale) Mirror 6: 0xa6d15cc5 (stale) Mirror 8: 0x4f0323c6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x20644f80 (stale) Mirror 4: 0x20644f80 (stale) Mirror 5: 0x20644f80 (stale) Mirror 6: 0xa6d15cc5 (stale) Mirror 8: 0x4f0323c6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000147 1779991773.173230 read 0x029b54 thru 0x034372 (0xa81f bytes) 000153 1779991773.186877 mapwrite 0x00b35e thru 0x01a575 (0xf218 bytes) 000154 1779991773.263771 read 0x018bf3 thru 0x01904c (0x45a bytes) 000156 1779991773.265739 trunc from 0x040000 to 0x026ba3 (0x1945c bytes) 000158 1779991773.284083 mapread 0x025aa6 thru 0x026ba3 (0x10fe bytes) 000159 1779991773.293456 mapwrite 0x005dc4 thru 0x00f1dd (0x941a bytes) 000161 1779991773.346999 write 0x02aa77 thru 0x02fa17 (0x4fa1 bytes) 000162 1779991773.348925 write 0x031098 thru 0x03c5b5 (0xb51e bytes) 000164 1779991773.352100 trunc from 0x03c5b6 to 0x028a59 (0x13b5c bytes) 000167 1779991773.374418 write 0x022429 thru 0x02dfa5 (0xbb7d bytes) 000169 1779991773.378578 mapwrite 0x039b40 thru 0x039bd1 (0x92 bytes) 000170 1779991773.554004 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39bd2): Mirror 4: 0xe364cb6c (stale) Mirror 5: 0xe364cb6c (stale) Mirror 6: 0xd7312be8 (stale) Mirror 8: 0xf976c6fd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39bd2): Mirror 4: 0xe364cb6c (stale) Mirror 5: 0xe364cb6c (stale) Mirror 6: 0xd7312be8 (stale) Mirror 8: 0xf976c6fd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39bd2: skipped 000172 1779991774.380959 mapwrite 0x00bce3 thru 0x01020a (0x4528 bytes) 000173 1779991774.511133 mapwrite 0x0068c1 thru 0x013f79 (0xd6b9 bytes) 000174 1779991774.613876 mapwrite 0x0276a2 thru 0x03141f (0x9d7e bytes) 000177 1779991774.706688 mapwrite 0x01e2b8 thru 0x0249eb (0x6734 bytes) 000180 1779991774.826187 read 0x025a86 thru 0x03319c (0xd717 bytes) 000182 1779991774.830077 mapwrite 0x018da5 thru 0x01b316 (0x2572 bytes) 000186 1779991774.939335 mapwrite 0x02e786 thru 0x030e45 (0x26c0 bytes) 000188 1779991775.070569 trunc from 0x039bd2 to 0x019ecf (0x1fd02 bytes) 000190 1779991775.108161 mapread 0x00110a thru 0x00ebe9 (0xdae0 bytes) 000191 1779991775.118177 write 0x028d86 thru 0x0302ee (0x7569 bytes) 000193 1779991775.143597 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x302ef): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x302ef): Mirror 4: 0x8b304038 (stale) Mirror 5: 0x8b304038 (stale) Mirror 6: 0xa7683abb (stale) Mirror 8: 0x61e5cbb6 (stale) CRC-32 checksum value for chunk [0, 0x302ef): Mirror 1: 0x57dd5b17 Mirror 9: 0x57dd5b17 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x302ef: skipped 000194 1779991776.142704 mapread 0x0043be thru 0x00e408 (0xa04b bytes) 000196 1779991776.162911 write 0x03a76c thru 0x03f57b (0x4e10 bytes) 000197 1779991776.248574 trunc from 0x03f57c to 0x00f6b0 (0x2fecb bytes) 000200 1779991776.295829 write 0x007e17 thru 0x00f36c (0x7556 bytes) 000204 1779991776.310239 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf6b1): Mirror 4: 0x605115be (stale) Mirror 5: 0x605115be (stale) Mirror 6: 0xa8d87383 (stale) Mirror 8: 0x8730c04a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf6b1): Mirror 4: 0x605115be (stale) Mirror 5: 0x605115be (stale) Mirror 6: 0xa8d87383 (stale) Mirror 8: 0x8730c04a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf6b1: skipped 000205 1779991776.674174 read 0x006aca thru 0x00f6b0 (0x8be7 bytes) 000206 1779991776.684965 mapread 0x00905a thru 0x00a5f8 (0x159f bytes) 000208 1779991776.687627 read 0x005f1b thru 0x00f325 (0x940b bytes) 000210 1779991776.698660 write 0x01501b thru 0x02132a (0xc310 bytes) truncating to largest ever: 0x3a10b 000211 1779991776.701286 trunc from 0x02132b to 0x03a10a (0x18de0 bytes) 000212 1779991776.717743 write 0x01baf6 thru 0x01dcf3 (0x21fe bytes) 000214 1779991776.729854 MIRROR_RESYNC 5 mirrors 000215 1779991777.834649 read 0x03482b thru 0x03a10a (0x58e0 bytes) 000217 1779991777.846100 mapread 0x0095b5 thru 0x010478 (0x6ec4 bytes) 000218 1779991777.865586 mapread 0x0005da thru 0x0007f7 (0x21e bytes) 000219 1779991777.876680 MIRROR_RESYNC 5 mirrors 000220 1779991778.417262 mapread 0x0030d4 thru 0x007026 (0x3f53 bytes) 000221 1779991778.427281 MIRROR_RESYNC 5 mirrors 000224 1779991778.924968 read 0x027a2b thru 0x02b0dd (0x36b3 bytes) truncating to largest ever: 0x3c6d9 000226 1779991778.935891 trunc from 0x03a10b to 0x03c6d8 (0x25ce bytes) 000227 1779991779.016335 read 0x031f18 thru 0x0324cd (0x5b6 bytes) 000229 1779991779.032917 MIRROR_RESYNC 5 mirrors 000231 1779991779.986688 write 0x013118 thru 0x01f07b (0xbf64 bytes) 000235 1779991780.078389 trunc from 0x03c6d9 to 0x013c8c (0x28a4c bytes) 000236 1779991780.107130 read 0x00c2bc thru 0x01119b (0x4ee0 bytes) 000238 1779991780.137063 trunc from 0x013c8d to 0x01ac16 (0x6f8a bytes) 000239 1779991780.193745 mapwrite 0x009115 thru 0x00ab6a (0x1a56 bytes) 000241 1779991780.317275 trunc from 0x01ac17 to 0x0111ac (0x9a6a bytes) 000245 1779991780.362026 mapread 0x00f013 thru 0x0111ac (0x219a bytes) 000246 1779991780.363881 mapread 0x00b902 thru 0x00d7d5 (0x1ed4 bytes) 000247 1779991780.365953 read 0x0013ab thru 0x009ecf (0x8b25 bytes) 000248 1779991780.374213 write 0x016beb thru 0x0259e8 (0xedfe bytes) 000249 1779991780.376946 read 0x015864 thru 0x01d1bd (0x795a bytes) 000250 1779991780.382204 mapread 0x00fc61 thru 0x01d861 (0xdc01 bytes) 000251 1779991780.385854 trunc from 0x0259e9 to 0x006ccc (0x1ed1c bytes) 000255 1779991780.424110 trunc from 0x006ccd to 0x00a4ba (0x37ee bytes) 000256 1779991780.455085 MIRROR_RESYNC 5 mirrors 000257 1779991781.427210 mapwrite 0x01f81d thru 0x021011 (0x17f5 bytes) 000258 1779991781.574477 mapwrite 0x00483a thru 0x012d6e (0xe535 bytes) 000260 1779991781.663471 MIRROR_RESYNC 5 mirrors 000262 1779991782.792651 write 0x00e1bc thru 0x01ad71 (0xcbb6 bytes) 000263 1779991782.975564 mapread 0x0038b2 thru 0x0040b1 (0x800 bytes) 000264 1779991783.019036 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21012): Mirror 5: 0xb3f56b9e (stale) Mirror 6: 0xb3f56b9e (stale) Mirror 8: 0xb3f56b9e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21012): Mirror 5: 0xb3f56b9e (stale) Mirror 6: 0xb3f56b9e (stale) Mirror 8: 0xb3f56b9e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21012: skipped 000266 1779991783.660410 mapwrite 0x012036 thru 0x01e9f3 (0xc9be bytes) 000268 1779991783.830281 trunc from 0x021012 to 0x01f3b5 (0x1c5c bytes) 000270 1779991783.860625 write 0x01b0b9 thru 0x01bd04 (0xc4c bytes) 000272 1779991783.863775 write 0x02eb7b thru 0x0387c5 (0x9c4b bytes) 000274 1779991783.867600 mapwrite 0x00aecb thru 0x00c082 (0x11b8 bytes) 000276 1779991783.975247 trunc from 0x0387c6 to 0x01c95a (0x1be6b bytes) 000278 1779991784.002008 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c95b): Mirror 6: 0x60b216f6 (stale) Mirror 8: 0x60b216f6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c95b): Mirror 6: 0x60b216f6 (stale) Mirror 8: 0x60b216f6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c95b: skipped 000279 1779991784.340097 write 0x019d80 thru 0x01cb69 (0x2dea bytes) 000281 1779991784.347938 trunc from 0x01cb6a to 0x03909c (0x1c533 bytes) 000282 1779991784.364632 write 0x013074 thru 0x01a2de (0x726b bytes) 000284 1779991784.375686 read 0x0176f1 thru 0x021409 (0x9d19 bytes) 000285 1779991784.387367 mapwrite 0x02648c thru 0x026efb (0xa70 bytes) 000287 1779991784.450777 trunc from 0x03909d to 0x03014f (0x8f4d bytes) 000290 1779991784.471737 mapwrite 0x00c349 thru 0x011a27 (0x56df bytes) 000294 1779991784.523781 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30150): Mirror 6: 0x7bb46ed5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30150): Mirror 6: 0x7bb46ed5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30150: skipped 000302 1779991784.988153 write 0x0396f6 thru 0x03ffff (0x690a bytes) 000303 1779991784.989752 read 0x039498 thru 0x03ffff (0x6b68 bytes) 000304 1779991784.990992 mapread 0x02ad88 thru 0x034d01 (0x9f7a bytes) 000305 1779991785.066032 trunc from 0x040000 to 0x02d636 (0x129c9 bytes) 000306 1779991785.113172 mapread 0x00c3a1 thru 0x01a211 (0xde71 bytes) 000307 1779991785.156101 read 0x00cfb1 thru 0x018fe9 (0xc039 bytes) 000308 1779991785.157509 write 0x01b9c0 thru 0x025757 (0x9d98 bytes) 000310 1779991785.169195 MIRROR_RESYNC 2 mirrors 000313 1779991786.028153 mapread 0x01f4ea thru 0x029acf (0xa5e6 bytes) 000315 1779991786.065330 trunc from 0x02d637 to 0x0002a1 (0x2d395 bytes) 000316 1779991786.194186 read 0x00003b thru 0x0002a1 (0x267 bytes) 000319 1779991786.203336 write 0x00729a thru 0x010fcd (0x9d34 bytes) 000321 1779991786.208921 trunc from 0x010fce to 0x02e874 (0x1d8a7 bytes) 000323 1779991786.232010 write 0x003eb3 thru 0x00c677 (0x87c5 bytes) 000327 1779991786.244118 write 0x0361ba thru 0x036660 (0x4a7 bytes) 000329 1779991786.246729 trunc from 0x036661 to 0x030041 (0x661f bytes) 000334 1779991786.285663 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x30042): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30042): Mirror 6: 0xcfed1153 (stale) CRC-32 checksum value for chunk [0, 0x30042): Mirror 1: 0x7b6d38b Mirror 7: 0x7b6d38b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30042: skipped 000339 1779991787.147327 MIRROR_RESYNC 3 mirrors 000340 1779991787.963072 mapread 0x012676 thru 0x01716b (0x4af6 bytes) 000343 1779991788.008352 mapwrite 0x00d6f9 thru 0x01421d (0x6b25 bytes) 000347 1779991788.236828 mapwrite 0x02f06b thru 0x02f35a (0x2f0 bytes) 000349 1779991788.324946 MIRROR_RESYNC 3 mirrors 000351 1779991789.073652 mapwrite 0x032c2c thru 0x03eece (0xc2a3 bytes) 000353 1779991789.330678 mapwrite 0x024b1e thru 0x0340f2 (0xf5d5 bytes) 000354 1779991789.395180 trunc from 0x03eecf to 0x00fc7c (0x2f252 bytes) 000357 1779991789.419954 write 0x03de84 thru 0x03f5b4 (0x1731 bytes) 000358 1779991789.423112 read 0x015c57 thru 0x01a609 (0x49b3 bytes) 000359 1779991789.430426 read 0x00ee8b thru 0x01d0c9 (0xe23f bytes) 000360 1779991789.440160 trunc from 0x03f5b5 to 0x02c43c (0x13178 bytes) 000361 1779991789.455210 mapread 0x01ae81 thru 0x022bf6 (0x7d76 bytes) 000362 1779991789.456451 mapwrite 0x0284be thru 0x02ba7b (0x35be bytes) 000364 1779991789.490236 trunc from 0x02c43d to 0x02a19c (0x22a0 bytes) 000365 1779991789.504090 mapwrite 0x008546 thru 0x013a79 (0xb534 bytes) 000366 1779991789.559910 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a19d): Mirror 7: 0x1cb83b8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a19d): Mirror 7: 0x1cb83b8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a19d: skipped 000367 1779991789.800095 mapread 0x00cc31 thru 0x0160bf (0x948f bytes) 000368 1779991789.819922 read 0x02288d thru 0x02a19c (0x7910 bytes) 000370 1779991789.832436 read 0x0007b1 thru 0x0087e4 (0x8034 bytes) 000371 1779991789.840539 write 0x03c9eb thru 0x03ca16 (0x2c bytes) 000372 1779991789.845870 MIRROR_RESYNC 2 mirrors 000375 1779991790.359630 read 0x032458 thru 0x03ca16 (0xa5bf bytes) 000377 1779991790.367904 read 0x0048a8 thru 0x00c5d6 (0x7d2f bytes) 000379 1779991790.381826 read 0x03a9a0 thru 0x03afd1 (0x632 bytes) 000380 1779991790.382508 mapwrite 0x022548 thru 0x0285b1 (0x606a bytes) truncating to largest ever: 0x3f3eb 000383 1779991790.535454 trunc from 0x03ca17 to 0x03f3ea (0x29d4 bytes) 000386 1779991790.566063 MIRROR_RESYNC 2 mirrors 000387 1779991791.067871 mapwrite 0x01d8b7 thru 0x0260d6 (0x8820 bytes) 000392 1779991791.207448 read 0x030942 thru 0x03e536 (0xdbf5 bytes) 000394 1779991791.218029 mapwrite 0x001b9b thru 0x00a004 (0x846a bytes) 000395 1779991791.271443 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) 000396 1779991791.430943 read 0x000ac9 thru 0x00caf8 (0xc030 bytes) 000397 1779991791.441695 write 0x036f21 thru 0x03ffff (0x90df bytes) 000398 1779991791.448570 mapread 0x03fe1a thru 0x03ffff (0x1e6 bytes) 000399 1779991791.451897 write 0x03d0f1 thru 0x03ffff (0x2f0f bytes) 000402 1779991791.458119 write 0x036bcd thru 0x03ffff (0x9433 bytes) 000404 1779991791.460917 read 0x001e62 thru 0x0109c2 (0xeb61 bytes) 000406 1779991791.476478 trunc from 0x040000 to 0x037be5 (0x841a bytes) 000407 1779991791.497244 write 0x02145d thru 0x02a882 (0x9426 bytes) 000408 1779991791.501241 trunc from 0x037be6 to 0x03b011 (0x342c bytes) 000409 1779991791.524869 mapwrite 0x012194 thru 0x020fd2 (0xee3f bytes) 000414 1779991791.615124 mapread 0x0318ef thru 0x03b011 (0x9723 bytes) 000415 1779991791.640097 mapwrite 0x031898 thru 0x032d41 (0x14aa bytes) 000416 1779991791.692512 write 0x03f44c thru 0x03ffff (0xbb4 bytes) 000418 1779991791.696421 mapread 0x01cc20 thru 0x01f507 (0x28e8 bytes) 000420 1779991791.700747 mapread 0x03b42a thru 0x03ffff (0x4bd6 bytes) 000421 1779991791.717551 mapwrite 0x00beb6 thru 0x019adc (0xdc27 bytes) 000422 1779991791.799654 trunc from 0x040000 to 0x00dd0e (0x322f1 bytes) 000426 1779991791.841459 read 0x00a2b0 thru 0x00b4f6 (0x1247 bytes) 000429 1779991791.843444 read 0x00ab80 thru 0x00dd0e (0x318f bytes) 000432 1779991791.847863 trunc from 0x00dd0f to 0x03a0a4 (0x2c396 bytes) 000434 1779991791.876696 mapread 0x035eb8 thru 0x03a0a4 (0x41ed bytes) 000435 1779991791.890623 mapwrite 0x02a23a thru 0x02a4ea (0x2b1 bytes) 000436 1779991791.926315 mapwrite 0x013fd6 thru 0x014f26 (0xf51 bytes) truncating to largest ever: 0x3ffcc 000438 1779991791.965197 trunc from 0x03a0a5 to 0x03ffcb (0x5f27 bytes) 000442 1779991791.990265 read 0x01183b thru 0x01a347 (0x8b0d bytes) 000443 1779991791.991102 write 0x032a05 thru 0x03aadc (0x80d8 bytes) 000444 1779991791.993441 mapread 0x03a1cd thru 0x03f899 (0x56cd bytes) 000445 1779991792.004587 mapread 0x01806d thru 0x02656d (0xe501 bytes) 000446 1779991792.006124 mapread 0x0353b4 thru 0x03ffcb (0xac18 bytes) 000447 1779991792.009202 mapread 0x01f9a5 thru 0x02bc7a (0xc2d6 bytes) 000448 1779991792.011564 mapread 0x017ae2 thru 0x01c8a3 (0x4dc2 bytes) 000450 1779991792.015104 write 0x001f53 thru 0x0030f6 (0x11a4 bytes) 000451 1779991792.017308 mapwrite 0x02f9e9 thru 0x037a6a (0x8082 bytes) 000452 1779991792.071500 write 0x02c65b thru 0x032543 (0x5ee9 bytes) 000455 1779991792.077895 mapread 0x007cc6 thru 0x012aba (0xadf5 bytes) 000459 1779991792.085465 write 0x03080e thru 0x0396c1 (0x8eb4 bytes) 000460 1779991792.088167 mapread 0x039a61 thru 0x03c563 (0x2b03 bytes) 000461 1779991792.090123 write 0x00b994 thru 0x00c080 (0x6ed bytes) 000462 1779991792.092187 write 0x034153 thru 0x03f89f (0xb74d bytes) 000463 1779991792.094646 trunc from 0x03ffcc to 0x027fae (0x1801d bytes) 000465 1779991792.135778 MIRROR_EXTEND to 2 mirrors 000466 1779991792.813683 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) 000467 1779991793.030325 write 0x030a29 thru 0x0371f8 (0x67d0 bytes) 000469 1779991793.045216 mapwrite 0x00691a thru 0x010f3f (0xa626 bytes) 000474 1779991793.121347 mapread 0x0311cf thru 0x0371f8 (0x602a bytes) 000480 1779991793.132522 MIRROR_EXTEND to 2 mirrors 000481 1779991793.918822 read 0x035a00 thru 0x0371f8 (0x17f9 bytes) 000483 1779991793.933607 mapwrite 0x02467f thru 0x0328cb (0xe24d bytes) 000484 1779991794.178077 read 0x01f0da thru 0x020714 (0x163b bytes) 000486 1779991794.179494 mapread 0x0014aa thru 0x006fdc (0x5b33 bytes) 000488 1779991794.191810 read 0x003b5b thru 0x00afdb (0x7481 bytes) 000489 1779991794.193253 mapwrite 0x01128a thru 0x01e900 (0xd677 bytes) 000490 1779991794.265484 mapwrite 0x020bdb thru 0x023377 (0x279d bytes) 000491 1779991794.302570 trunc from 0x0371f9 to 0x014071 (0x23187 bytes) 000493 1779991794.341801 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x14072): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14072): Mirror 2: 0xdfc5ffa8 (stale) CRC-32 checksum value for chunk [0, 0x14072): Mirror 1: 0x4c08138b Mirror 3: 0x4c08138b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14072: skipped 000494 1779991795.337763 mapread 0x001faa thru 0x00c206 (0xa25d bytes) 000497 1779991795.356958 read 0x000f02 thru 0x00e0f7 (0xd1f6 bytes) 000499 1779991795.362195 read 0x008d23 thru 0x010a8d (0x7d6b bytes) 000500 1779991795.362754 write 0x025ad6 thru 0x03154e (0xba79 bytes) 000501 1779991795.443192 mapread 0x01ca81 thru 0x021dfb (0x537b bytes) 000502 1779991795.461191 write 0x016dd6 thru 0x023a2b (0xcc56 bytes) 000503 1779991795.470109 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3154f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3154f): Mirror 2: 0x1a7b9f13 (stale) Mirror 3: 0x1493a7a5 (stale) CRC-32 checksum value for chunk [0, 0x3154f): Mirror 1: 0x319ad28d Mirror 4: 0x319ad28d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3154f: skipped 000504 1779991796.362033 MIRROR_RESYNC 4 mirrors 000505 1779991796.999741 trunc from 0x03154f to 0x023f67 (0xd5e7 bytes) 000508 1779991797.091745 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23f68): Mirror 2: 0x8796be55 (stale) Mirror 3: 0x8796be55 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23f68): Mirror 2: 0x8796be55 (stale) Mirror 3: 0x8796be55 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23f68: skipped 000509 1779991797.374341 trunc from 0x023f68 to 0x00d8ec (0x1667b bytes) 000512 1779991797.402226 read 0x003b5f thru 0x0068fa (0x2d9c bytes) 000514 1779991797.411948 trunc from 0x00d8ed to 0x007e37 (0x5ab5 bytes) 000515 1779991797.436543 write 0x032ea8 thru 0x03fe00 (0xcf59 bytes) 000518 1779991797.441554 trunc from 0x03fe01 to 0x03f795 (0x66b bytes) 000519 1779991797.461970 mapread 0x032b80 thru 0x03a35d (0x77de bytes) 000521 1779991797.463712 mapread 0x038440 thru 0x039019 (0xbda bytes) 000523 1779991797.467185 mapwrite 0x03b0fc thru 0x03ffff (0x4f04 bytes) 000524 1779991797.539849 mapread 0x02a54a thru 0x038189 (0xdc40 bytes) 000527 1779991797.558342 mapread 0x012dcc thru 0x012ea0 (0xd5 bytes) 000528 1779991797.566336 trunc from 0x040000 to 0x035b1b (0xa4e4 bytes) 000529 1779991797.583005 mapwrite 0x00e228 thru 0x017fcb (0x9da4 bytes) 000530 1779991797.637302 mapwrite 0x00b47f thru 0x010d0a (0x588c bytes) 000532 1779991797.679740 write 0x002dc2 thru 0x006b8f (0x3dce bytes) 000533 1779991797.689803 read 0x0151f2 thru 0x018ab4 (0x38c3 bytes) 000536 1779991797.694181 mapread 0x0211ef thru 0x027a32 (0x6844 bytes) 000537 1779991797.703953 read 0x01c7b2 thru 0x0255a5 (0x8df4 bytes) 000539 1779991797.705242 mapwrite 0x0296d3 thru 0x02e412 (0x4d40 bytes) 000541 1779991797.762565 MIRROR_RESYNC 3 mirrors 000544 1779991798.439992 trunc from 0x035b1c to 0x033881 (0x229a bytes) 000545 1779991798.534725 trunc from 0x033882 to 0x0087d6 (0x2b0ab bytes) 000546 1779991798.557433 mapwrite 0x039236 thru 0x03b273 (0x203e bytes) 000547 1779991798.656795 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b274): Mirror 3: 0x656d7f0b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b274): Mirror 3: 0x656d7f0b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b274: skipped 000548 1779991798.933230 write 0x016944 thru 0x025442 (0xeaff bytes) 000549 1779991798.951689 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) 000551 1779991799.111334 mapwrite 0x031016 thru 0x0367ce (0x57b9 bytes) 000552 1779991799.196682 trunc from 0x03b274 to 0x039448 (0x1e2b bytes) 000558 1779991799.234145 MIRROR_EXTEND to 2 mirrors 000560 1779991799.866788 read 0x03465f thru 0x039448 (0x4dea bytes) 000562 1779991799.878278 read 0x0189aa thru 0x025562 (0xcbb9 bytes) 000564 1779991799.891257 write 0x019564 thru 0x01ab14 (0x15b1 bytes) 000565 1779991799.971622 mapwrite 0x00e0fc thru 0x016b40 (0x8a45 bytes) 000567 1779991800.086765 MIRROR_RESYNC 2 mirrors 000569 1779991800.694444 write 0x034966 thru 0x03ffff (0xb69a bytes) 000570 1779991800.771163 read 0x028267 thru 0x02c20a (0x3fa4 bytes) 000572 1779991800.785628 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x42f3cbb4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfbad7460 Mirror 3: 0xfbad7460 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000573 1779991801.908422 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x42f3cbb4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfbad7460 Mirror 3: 0xfbad7460 Mirror 4: 0xfbad7460 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000576 1779991803.084612 mapread 0x00319e thru 0x0052d6 (0x2139 bytes) 000577 1779991803.110427 MIRROR_RESYNC 4 mirrors 000578 1779991803.846341 write 0x03d300 thru 0x03ffff (0x2d00 bytes) 000579 1779991804.048431 read 0x03caf3 thru 0x03ffff (0x350d bytes) 000580 1779991804.067574 MIRROR_RESYNC 4 mirrors 000582 1779991804.999244 mapwrite 0x03211d thru 0x03cefe (0xade2 bytes) 000583 1779991805.244254 write 0x02c780 thru 0x02e22b (0x1aac bytes) 000584 1779991805.248169 read 0x03f1e4 thru 0x03ffff (0xe1c bytes) 000585 1779991805.256971 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x6108b601 (stale) Mirror 3: 0x6108b601 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x6108b601 (stale) Mirror 3: 0x6108b601 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000587 1779991805.585328 trunc from 0x040000 to 0x018b3c (0x274c3 bytes) 000593 1779991805.629307 trunc from 0x018b3d to 0x0065cc (0x12570 bytes) 000594 1779991805.652924 write 0x039cd0 thru 0x03ffff (0x6330 bytes) 000595 1779991805.655602 mapread 0x008087 thru 0x00832d (0x2a7 bytes) 000596 1779991805.661874 read 0x039696 thru 0x03e21b (0x4b86 bytes) 000597 1779991805.663044 mapread 0x03bdf5 thru 0x03ffff (0x420b bytes) 000599 1779991805.665840 mapwrite 0x02ff8c thru 0x038f24 (0x8f99 bytes) 000600 1779991805.754281 mapread 0x006a81 thru 0x00ec64 (0x81e4 bytes) 000602 1779991805.768084 mapread 0x027db0 thru 0x02b70f (0x3960 bytes) 000603 1779991805.783125 MIRROR_RESYNC 3 mirrors 000604 1779991806.692866 read 0x01908f thru 0x022d0d (0x9c7f bytes) 000609 1779991806.711486 trunc from 0x040000 to 0x0393e7 (0x6c18 bytes) 000612 1779991806.792481 read 0x0212ea thru 0x02877c (0x7493 bytes) 000613 1779991806.807137 read 0x0355e1 thru 0x0393e7 (0x3e07 bytes) 000615 1779991806.808459 mapread 0x00ac34 thru 0x0165a3 (0xb970 bytes) 000617 1779991806.817710 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x393e8): Mirror 3: 0x8118871e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x393e8): Mirror 3: 0x8118871e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x393e8: skipped 000619 1779991807.095176 mapread 0x02dff3 thru 0x032c38 (0x4c46 bytes) 000621 1779991807.121504 MIRROR_RESYNC 2 mirrors 000627 1779991807.713113 mapread 0x01060d thru 0x010f8b (0x97f bytes) 000628 1779991807.721133 read 0x03886f thru 0x0393e7 (0xb79 bytes) 000629 1779991807.727903 mapwrite 0x0314e7 thru 0x03815f (0x6c79 bytes) 000632 1779991807.870777 write 0x020df7 thru 0x02a4fe (0x9708 bytes) 000634 1779991807.880705 mapread 0x0319f2 thru 0x037d7e (0x638d bytes) 000636 1779991807.882346 mapread 0x01af35 thru 0x025bfd (0xacc9 bytes) 000637 1779991807.886033 read 0x003eac thru 0x00687f (0x29d4 bytes) 000638 1779991807.895206 write 0x03610d thru 0x03ffff (0x9ef3 bytes) 000639 1779991807.897297 read 0x01912e thru 0x0275af (0xe482 bytes) 000640 1779991807.904248 MIRROR_RESYNC 2 mirrors 000644 1779991808.569121 MIRROR_EXTEND to 3 mirrors 000645 1779991809.288661 write 0x00de7e thru 0x0176ac (0x982f bytes) 000646 1779991809.385028 read 0x039e5a thru 0x03ffff (0x61a6 bytes) 000647 1779991809.396792 MIRROR_RESYNC 3 mirrors 000648 1779991810.063002 mapwrite 0x026f32 thru 0x02ed90 (0x7e5f bytes) 000649 1779991810.218219 trunc from 0x040000 to 0x00bdd9 (0x34226 bytes) 000651 1779991810.268927 trunc from 0x00bdda to 0x01b79c (0xf9c3 bytes) 000652 1779991810.292033 mapread 0x00160b thru 0x003646 (0x203c bytes) 000653 1779991810.301733 mapread 0x0041fb thru 0x0054d1 (0x12d7 bytes) 000655 1779991810.308266 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1b79d): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b79d): Mirror 3: 0xc8eae392 (stale) Mirror 4: 0xc8eae392 (stale) CRC-32 checksum value for chunk [0, 0x1b79d): Mirror 1: 0x9c92e8c8 Mirror 5: 0x9c92e8c8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b79d: skipped 000657 1779991811.068056 trunc from 0x01b79d to 0x03861e (0x1ce82 bytes) 000658 1779991811.170361 trunc from 0x03861f to 0x01e698 (0x19f86 bytes) 000659 1779991811.197499 trunc from 0x01e699 to 0x0360b3 (0x17a1b bytes) 000661 1779991811.210855 trunc from 0x0360b4 to 0x03d337 (0x7284 bytes) 000662 1779991811.230856 write 0x0334b1 thru 0x03ffff (0xcb4f bytes) 000663 1779991811.236695 write 0x02cfc2 thru 0x03789f (0xa8de bytes) 000665 1779991811.244160 read 0x038cff thru 0x03ffff (0x7301 bytes) 000666 1779991811.245073 write 0x016030 thru 0x023c9c (0xdc6d bytes) 000668 1779991811.263235 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xbfbfc628 (stale) Mirror 5: 0x9529bf2e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xbfbfc628 (stale) Mirror 5: 0x9529bf2e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000669 1779991811.659885 trunc from 0x040000 to 0x025352 (0x1acad bytes) 000670 1779991811.695749 mapread 0x008f7e thru 0x00e9b3 (0x5a36 bytes) 000671 1779991811.722035 write 0x018595 thru 0x01cfa1 (0x4a0d bytes) 000672 1779991811.739478 mapread 0x0240c3 thru 0x025352 (0x1290 bytes) 000673 1779991811.749558 mapread 0x0214dd thru 0x0236b3 (0x21d7 bytes) 000676 1779991811.753081 write 0x005928 thru 0x00d75f (0x7e38 bytes) 000678 1779991811.762129 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25353): Mirror 5: 0xe6a850db (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25353): Mirror 5: 0xe6a850db (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25353: skipped 000679 1779991812.087214 read 0x016b04 thru 0x0183c9 (0x18c6 bytes) 000680 1779991812.097120 write 0x015237 thru 0x018f9d (0x3d67 bytes) 000684 1779991812.106728 trunc from 0x025353 to 0x00557f (0x1fdd3 bytes) 000685 1779991812.127617 mapwrite 0x03af74 thru 0x03ffff (0x508c bytes) 000686 1779991812.203180 write 0x035e92 thru 0x03ffff (0xa16e bytes) 000687 1779991812.206282 read 0x0355a8 thru 0x038e10 (0x3869 bytes) 000688 1779991812.207078 mapwrite 0x0386a0 thru 0x03a88d (0x21ee bytes) 000689 1779991812.253945 trunc from 0x040000 to 0x00371b (0x3c8e4 bytes) 000690 1779991812.277224 trunc from 0x00371c to 0x035abb (0x323a0 bytes) 000693 1779991812.316927 read 0x02a4b2 thru 0x030637 (0x6186 bytes) 000694 1779991812.346473 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35abc): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35abc): Mirror 5: 0x325b51ed (stale) CRC-32 checksum value for chunk [0, 0x35abc): Mirror 1: 0x686a2d1e Mirror 6: 0x686a2d1e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35abc: skipped 000696 1779991813.073857 trunc from 0x035abc to 0x01d24a (0x18871 bytes) 000698 1779991813.220111 mapwrite 0x00ce7e thru 0x015a9d (0x8c20 bytes) 000699 1779991813.296013 mapread 0x00b382 thru 0x010088 (0x4d07 bytes) 000701 1779991813.298318 read 0x00bc45 thru 0x01a8cb (0xec87 bytes) 000702 1779991813.304974 trunc from 0x01d24b to 0x037a8d (0x1a843 bytes) 000703 1779991813.343172 write 0x0332f3 thru 0x036a90 (0x379e bytes) 000704 1779991813.369229 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37a8e): Mirror 5: 0xba314bdd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37a8e): Mirror 5: 0xba314bdd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37a8e: skipped 000706 1779991813.842268 write 0x010f2e thru 0x0126c2 (0x1795 bytes) 000707 1779991813.852987 mapwrite 0x004897 thru 0x009b02 (0x526c bytes) 000708 1779991813.901228 mapread 0x00708c thru 0x00f2e6 (0x825b bytes) 000709 1779991813.902447 mapread 0x036bfe thru 0x036d4f (0x152 bytes) 000713 1779991813.912688 write 0x003298 thru 0x00b016 (0x7d7f bytes) 000715 1779991813.915854 trunc from 0x037a8e to 0x0368f3 (0x119a bytes) 000716 1779991813.930916 mapread 0x022048 thru 0x02242a (0x3e3 bytes) 000718 1779991813.941346 write 0x01b9ac thru 0x01bebf (0x514 bytes) 000721 1779991813.943626 trunc from 0x0368f4 to 0x03a6e4 (0x3df1 bytes) 000722 1779991813.958872 mapwrite 0x0200bc thru 0x027890 (0x77d5 bytes) 000723 1779991814.013025 mapread 0x00dd5d thru 0x01c3ac (0xe650 bytes) 000724 1779991814.022438 mapwrite 0x02bc4f thru 0x02da2e (0x1de0 bytes) 000725 1779991814.067592 mapread 0x01e4b6 thru 0x0254c3 (0x700e bytes) 000726 1779991814.069598 mapwrite 0x03f010 thru 0x03ffff (0xff0 bytes) 000727 1779991814.167263 read 0x01881d thru 0x0251a8 (0xc98c bytes) 000728 1779991814.168424 read 0x029915 thru 0x03959a (0xfc86 bytes) 000729 1779991814.192051 trunc from 0x040000 to 0x03bb26 (0x44d9 bytes) 000732 1779991814.223335 trunc from 0x03bb27 to 0x03395b (0x81cb bytes) 000736 1779991814.248619 write 0x00a463 thru 0x00ea70 (0x460e bytes) 000737 1779991814.257903 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3395c): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3395c): Mirror 5: 0xabffc61 (stale) CRC-32 checksum value for chunk [0, 0x3395c): Mirror 1: 0xdff7ba7b Mirror 6: 0xdff7ba7b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3395c: skipped 000738 1779991815.033206 mapwrite 0x027035 thru 0x02dc9d (0x6c69 bytes) 000740 1779991815.225892 read 0x02ea7e thru 0x03270a (0x3c8d bytes) 000741 1779991815.232605 read 0x01a8b2 thru 0x01c7f0 (0x1f3f bytes) 000742 1779991815.240492 mapread 0x02b134 thru 0x02cc07 (0x1ad4 bytes) 000743 1779991815.241960 read 0x012abb thru 0x020bf6 (0xe13c bytes) 000746 1779991815.243988 mapwrite 0x02cdc7 thru 0x032eb1 (0x60eb bytes) 000749 1779991815.313998 write 0x03c2c0 thru 0x03ffff (0x3d40 bytes) 000750 1779991815.317614 mapread 0x024ef3 thru 0x02da43 (0x8b51 bytes) 000751 1779991815.321887 trunc from 0x040000 to 0x038213 (0x7dec bytes) 000752 1779991815.377846 trunc from 0x038214 to 0x006872 (0x319a1 bytes) 000753 1779991815.400881 write 0x01fb21 thru 0x0298c6 (0x9da6 bytes) 000754 1779991815.404867 mapwrite 0x013fd1 thru 0x02137a (0xd3aa bytes) 000756 1779991815.474276 trunc from 0x0298c7 to 0x02e91b (0x5055 bytes) 000759 1779991815.526093 MIRROR_RESYNC 3 mirrors 000761 1779991816.723907 trunc from 0x02e91c to 0x01855b (0x163c0 bytes) 000763 1779991816.853600 MIRROR_RESYNC 3 mirrors 000765 1779991817.850719 trunc from 0x01855c to 0x024910 (0xc3b5 bytes) 000766 1779991817.968799 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x24911): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24911): Mirror 5: 0x840055be (stale) Mirror 6: 0x840055be (stale) CRC-32 checksum value for chunk [0, 0x24911): Mirror 1: 0x840055be Mirror 7: 0x840055be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24911: skipped 000767 1779991819.032215 trunc from 0x024911 to 0x03666f (0x11d5f bytes) 000768 1779991819.137215 read 0x009aa9 thru 0x00c160 (0x26b8 bytes) 000769 1779991819.148043 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36670): Mirror 5: 0xa3d88af4 (stale) Mirror 6: 0xa3d88af4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36670): Mirror 5: 0xa3d88af4 (stale) Mirror 6: 0xa3d88af4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36670: skipped 000770 1779991819.552205 trunc from 0x036670 to 0x007164 (0x2f50b bytes) 000771 1779991819.595984 write 0x036791 thru 0x0396e4 (0x2f54 bytes) 000773 1779991819.597962 mapwrite 0x009fd8 thru 0x012b9d (0x8bc6 bytes) 000775 1779991819.749201 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x396e5): Mirror 5: 0xe1da41a7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x396e5): Mirror 5: 0xe1da41a7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x396e5: skipped 000776 1779991820.025408 mapwrite 0x01a25e thru 0x0238d2 (0x9675 bytes) 000777 1779991820.085081 trunc from 0x0396e5 to 0x00db4d (0x2bb97 bytes) 000779 1779991820.099940 mapwrite 0x020cd3 thru 0x0302ee (0xf61c bytes) 000781 1779991820.178738 read 0x00c57f thru 0x012807 (0x6289 bytes) 000783 1779991820.188838 read 0x0301bb thru 0x0302ee (0x134 bytes) 000785 1779991820.194349 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x302ef): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x302ef): Mirror 5: 0x27e7f9f1 (stale) CRC-32 checksum value for chunk [0, 0x302ef): Mirror 1: 0x79e8dc7e Mirror 6: 0x79e8dc7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x302ef: skipped 000789 1779991820.992113 mapwrite 0x013255 thru 0x023104 (0xfeb0 bytes) 000791 1779991821.289269 read 0x005535 thru 0x0121b9 (0xcc85 bytes) 000792 1779991821.313923 read 0x01e904 thru 0x02960f (0xad0c bytes) 000793 1779991821.341138 write 0x01fd32 thru 0x020fb7 (0x1286 bytes) 000795 1779991821.349931 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x302ef): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x302ef): Mirror 5: 0x27e7f9f1 (stale) Mirror 6: 0x79e8dc7e (stale) CRC-32 checksum value for chunk [0, 0x302ef): Mirror 1: 0x60a992ea Mirror 7: 0x60a992ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x302ef: skipped 000796 1779991822.208123 read 0x019749 thru 0x0256ac (0xbf64 bytes) 000804 1779991822.220840 write 0x004db3 thru 0x00dfa5 (0x91f3 bytes) 000805 1779991822.312070 trunc from 0x0302ef to 0x02f2b6 (0x1038 bytes) 000808 1779991822.369186 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f2b7): Mirror 6: 0x4366d73f (stale) Mirror 7: 0xa80300ea (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f2b7): Mirror 6: 0x4366d73f (stale) Mirror 7: 0xa80300ea (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f2b7: skipped 000810 1779991822.802778 mapread 0x02694a thru 0x02d2c5 (0x697c bytes) 000813 1779991822.840541 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2f2b7): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f2b7): Mirror 6: 0x4366d73f (stale) Mirror 7: 0xa80300ea (stale) CRC-32 checksum value for chunk [0, 0x2f2b7): Mirror 1: 0xba5c6fcd Mirror 8: 0xba5c6fcd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f2b7: skipped 000815 1779991823.649914 read 0x01d259 thru 0x01eb5a (0x1902 bytes) 000817 1779991823.666351 read 0x0121f3 thru 0x017c24 (0x5a32 bytes) 000818 1779991823.682666 trunc from 0x02f2b7 to 0x03f762 (0x104ac bytes) 000819 1779991823.817346 read 0x0314fd thru 0x03be81 (0xa985 bytes) 000820 1779991823.833340 mapread 0x0206a1 thru 0x02acda (0xa63a bytes) 000822 1779991823.835197 trunc from 0x03f763 to 0x0237d6 (0x1bf8c bytes) 000826 1779991823.869259 write 0x039ff5 thru 0x03ffff (0x600b bytes) 000827 1779991823.871839 mapread 0x00a32d thru 0x0148c0 (0xa594 bytes) 000829 1779991823.874950 read 0x0311b6 thru 0x03e891 (0xd6dc bytes) 000830 1779991823.887128 MIRROR_RESYNC 4 mirrors 000831 1779991824.765143 mapread 0x02c3db thru 0x02dea2 (0x1ac8 bytes) 000833 1779991824.779068 trunc from 0x040000 to 0x018869 (0x27796 bytes) 000834 1779991824.905629 mapwrite 0x02eaac thru 0x03383b (0x4d90 bytes) 000835 1779991825.010468 read 0x01b156 thru 0x02629f (0xb14a bytes) 000836 1779991825.020799 mapread 0x017197 thru 0x021003 (0x9e6d bytes) 000837 1779991825.036672 trunc from 0x03383c to 0x016551 (0x1d2ea bytes) 000840 1779991825.079079 mapread 0x0098ce thru 0x00b919 (0x204c bytes) 000841 1779991825.090090 mapwrite 0x03bdb0 thru 0x03ffff (0x4250 bytes) 000842 1779991825.170836 write 0x02cbbc thru 0x036542 (0x9987 bytes) 000843 1779991825.187696 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x98893d7 (stale) Mirror 8: 0x98893d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x98893d7 (stale) Mirror 8: 0x98893d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000844 1779991825.586920 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x98893d7 (stale) Mirror 8: 0x98893d7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb2ba3eed Mirror 9: 0xb2ba3eed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000845 1779991826.269495 write 0x00fbe2 thru 0x018ce0 (0x90ff bytes) 000846 1779991826.376786 mapwrite 0x033da6 thru 0x03ffff (0xc25a bytes) 000847 1779991826.445060 mapwrite 0x032af6 thru 0x03d912 (0xae1d bytes) 000849 1779991826.503543 read 0x013fee thru 0x01ce60 (0x8e73 bytes) 000850 1779991826.510910 read 0x03219d thru 0x03cb6f (0xa9d3 bytes) 000851 1779991826.511790 mapwrite 0x034208 thru 0x03ffff (0xbdf8 bytes) 000853 1779991826.559581 trunc from 0x040000 to 0x03cb75 (0x348a bytes) 000855 1779991826.609930 trunc from 0x03cb76 to 0x03fc52 (0x30dd bytes) 000857 1779991826.630885 mapread 0x00cf04 thru 0x019984 (0xca81 bytes) 000858 1779991826.640187 mapwrite 0x025db1 thru 0x02fe66 (0xa0b6 bytes) 000860 1779991826.702704 mapread 0x029b3e thru 0x02df12 (0x43d5 bytes) 000862 1779991826.705182 mapread 0x03d203 thru 0x03fc52 (0x2a50 bytes) 000863 1779991826.707258 mapwrite 0x02467e thru 0x027683 (0x3006 bytes) 000864 1779991826.754113 mapwrite 0x0025b3 thru 0x00ac4a (0x8698 bytes) 000867 1779991826.801061 read 0x0219b5 thru 0x02ae58 (0x94a4 bytes) 000868 1779991826.802940 read 0x03baf8 thru 0x03fc52 (0x415b bytes) 000870 1779991826.804826 mapwrite 0x00eaa5 thru 0x00f006 (0x562 bytes) 000873 1779991826.845060 mapread 0x01e94e thru 0x01fa9a (0x114d bytes) 000875 1779991826.847932 mapwrite 0x02e002 thru 0x02f520 (0x151f bytes) 000876 1779991826.931813 read 0x01b3a3 thru 0x02516d (0x9dcb bytes) 000877 1779991826.932595 mapwrite 0x00a6a2 thru 0x014fd9 (0xa938 bytes) 000880 1779991827.038280 MIRROR_RESYNC 4 mirrors 000881 1779991827.985847 mapwrite 0x03f1ff thru 0x03ffff (0xe01 bytes) 000882 1779991828.184308 mapwrite 0x03a753 thru 0x03ffff (0x58ad bytes) 000885 1779991828.248248 trunc from 0x040000 to 0x01bf23 (0x240dc bytes) 000886 1779991828.271486 trunc from 0x01bf24 to 0x02f7b2 (0x1388f bytes) 000889 1779991828.293206 read 0x00a557 thru 0x018ea4 (0xe94e bytes) 000892 1779991828.307808 MIRROR_RESYNC 4 mirrors 000894 1779991829.190482 mapread 0x022d85 thru 0x02c8dd (0x9b59 bytes) 000897 1779991829.248083 read 0x004686 thru 0x012808 (0xe183 bytes) 000899 1779991829.269029 mapwrite 0x02fb30 thru 0x036d16 (0x71e7 bytes) 000902 1779991829.616737 write 0x00e588 thru 0x013f26 (0x599f bytes) 000904 1779991829.631829 read 0x01c02c thru 0x02b060 (0xf035 bytes) 000905 1779991829.649954 trunc from 0x036d17 to 0x02389c (0x1347a bytes) 000910 1779991829.696437 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2389d): Mirror 8: 0xfd88d262 (stale) Mirror 9: 0xfd88d262 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2389d): Mirror 8: 0xfd88d262 (stale) Mirror 9: 0xfd88d262 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2389d: skipped 000911 1779991830.238990 write 0x035947 thru 0x03ffff (0xa6b9 bytes) 000912 1779991830.255016 MIRROR_RESYNC 3 mirrors 000913 1779991831.023717 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) 000915 1779991831.305779 mapread 0x020c31 thru 0x02228f (0x165f bytes) 000916 1779991831.337080 mapread 0x0150db thru 0x01a3ce (0x52f4 bytes) 000920 1779991831.357758 trunc from 0x040000 to 0x0360f3 (0x9f0c bytes) 000923 1779991831.450005 mapwrite 0x01a65d thru 0x0205d2 (0x5f76 bytes) 000925 1779991831.507324 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a4:0x0]: Invalid argument (22) 000927 1779991831.663907 mapwrite 0x01f5ac thru 0x023b90 (0x45e5 bytes) 000930 1779991831.733605 trunc from 0x0360f4 to 0x0342cb (0x1e28 bytes) 000931 1779991831.751030 write 0x010a6e thru 0x0196f3 (0x8c86 bytes) 000932 1779991831.766990 write 0x008bb0 thru 0x00fb49 (0x6f9a bytes) 000933 1779991831.776659 mapread 0x014a7b thru 0x021591 (0xcb17 bytes) 000934 1779991831.778075 write 0x02d018 thru 0x0390a8 (0xc091 bytes) 000937 1779991831.790785 mapread 0x014561 thru 0x018ea8 (0x4948 bytes) 000938 1779991831.792901 mapread 0x00b5c6 thru 0x0158be (0xa2f9 bytes) 000940 1779991831.794770 read 0x01f226 thru 0x029c47 (0xaa22 bytes) 000942 1779991831.797057 write 0x009098 thru 0x00a07f (0xfe8 bytes) 000944 1779991831.800112 mapread 0x006780 thru 0x00fe47 (0x96c8 bytes) 000945 1779991831.802078 write 0x03a5ca thru 0x03ffff (0x5a36 bytes) 000948 1779991831.806973 trunc from 0x040000 to 0x01ae0d (0x251f2 bytes) 000950 1779991831.831207 read 0x0060e5 thru 0x015a65 (0xf981 bytes) 000951 1779991831.831966 read 0x01505d thru 0x01ae0d (0x5db1 bytes) 000955 1779991831.836810 mapread 0x0149db thru 0x01ae0d (0x6433 bytes) 000956 1779991831.838946 read 0x010f97 thru 0x01a4bd (0x9527 bytes) 000957 1779991831.839908 write 0x03a667 thru 0x03b3ee (0xd88 bytes) 000958 1779991831.842395 mapwrite 0x007b25 thru 0x009eaa (0x2386 bytes) 000959 1779991831.915117 trunc from 0x03b3ef to 0x00014a (0x3b2a4 bytes) 000960 1779991831.947864 write 0x01779f thru 0x019c3d (0x249f bytes) 000961 1779991831.949236 trunc from 0x019c3e to 0x018399 (0x18a4 bytes) 000962 1779991831.968756 trunc from 0x01839a to 0x022d03 (0xa96a bytes) 000966 1779991831.993850 trunc from 0x022d04 to 0x01254f (0x107b4 bytes) 000968 1779991832.020180 mapwrite 0x017158 thru 0x018ae1 (0x198a bytes) 000970 1779991832.148080 write 0x013c03 thru 0x01f143 (0xb541 bytes) 000971 1779991832.151781 trunc from 0x01f144 to 0x02b4d5 (0xc392 bytes) 000976 1779991832.193142 mapwrite 0x01ca8e thru 0x023a0a (0x6f7d bytes) 000978 1779991832.314703 mapread 0x01bda1 thru 0x023789 (0x79e9 bytes) 000980 1779991832.316571 mapwrite 0x011433 thru 0x01d03a (0xbc08 bytes) 000981 1779991832.470177 read 0x01654b thru 0x01b275 (0x4d2b bytes) 000982 1779991832.471642 trunc from 0x02b4d6 to 0x0218cc (0x9c09 bytes) 000983 1779991832.497828 read 0x009179 thru 0x00d2bb (0x4143 bytes) 000984 1779991832.498788 read 0x006bb3 thru 0x01119e (0xa5ec bytes) 000985 1779991832.501869 trunc from 0x0218cd to 0x00339d (0x1e52f bytes) 000986 1779991832.526748 read 0x00054d thru 0x00339d (0x2e51 bytes) 000989 1779991832.530531 read 0x001389 thru 0x00339d (0x2015 bytes) 000990 1779991832.532013 write 0x0321ca thru 0x03df21 (0xbd58 bytes) 000991 1779991832.534238 mapread 0x001133 thru 0x001212 (0xe0 bytes) 000995 1779991832.541855 mapread 0x03711a thru 0x03df21 (0x6e08 bytes) 000997 1779991832.543629 read 0x006128 thru 0x013489 (0xd362 bytes) 000998 1779991832.555955 trunc from 0x03df22 to 0x000925 (0x3d5fc bytes) 000999 1779991832.582821 write 0x0003a3 thru 0x00ab7d (0xa7db bytes) 001000 1779991832.586717 trunc from 0x00ab7e to 0x001ce0 (0x8e9d bytes) All operations completed A-OK!