== sanity-flr test 70a: flr mode fsx test ================ 21:28:33 (1789608513) Seed set to 8515 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1789608515.534666 write 0x039706 thru 0x03ffff (0x68fa bytes) truncating to largest ever: 0x12cb0 000003 1789608515.542931 trunc from 0x040000 to 0x012caf (0x2d350 bytes) 000004 1789608515.580153 MIRROR_EXTEND to 2 mirrors 000006 1789608516.775400 mapread 0x000049 thru 0x007121 (0x70d9 bytes) 000007 1789608516.841488 punch from 0x00721b to 0x00c7d6 (0x55bc bytes) 000008 1789608517.015753 punch from 0x00a17e to 0x012caf (0x8b32 bytes) 000009 1789608517.023299 punch from 0x01297c to 0x012caf (0x334 bytes) truncating to largest ever: 0x2255b 000010 1789608517.040605 trunc from 0x012cb0 to 0x02255a (0xf8ab bytes) 000015 1789608517.081612 punch from 0x019bb0 to 0x01d833 (0x3c84 bytes) 000017 1789608517.098003 write 0x01f508 thru 0x02122e (0x1d27 bytes) 000019 1789608517.134762 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2255b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2255b): Mirror 2: 0x9e4aea96 (stale) CRC-32 checksum value for chunk [0, 0x2255b): Mirror 1: 0xf94d0f98 Mirror 3: 0xf94d0f98 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2255b: skipped 000020 1789608518.692838 punch from 0x01d8ba to 0x01f316 (0x1a5d bytes) truncating to largest ever: 0x314df 000022 1789608518.764057 trunc from 0x02255b to 0x0314de (0xef84 bytes) truncating to largest ever: 0x336cf 000023 1789608518.787797 trunc from 0x0314df to 0x0336ce (0x21f0 bytes) 000025 1789608518.816769 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x336cf): Mirror 3: 0x739c6f88 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x336cf): Mirror 3: 0x739c6f88 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x336cf: skipped 000026 1789608519.191103 mapread 0x02bf6f thru 0x0336ce (0x7760 bytes) 000027 1789608519.222524 punch from 0x026eed to 0x0336ce (0xc7e2 bytes) truncating to largest ever: 0x3646f 000030 1789608519.249199 trunc from 0x0336cf to 0x03646e (0x2da0 bytes) 000031 1789608519.293547 punch from 0x024dc2 to 0x0269a1 (0x1be0 bytes) 000032 1789608519.312020 punch from 0x02e59f to 0x03525c (0x6cbe bytes) 000033 1789608519.326433 mapread 0x01dfee thru 0x02c8ef (0xe902 bytes) 000034 1789608519.393095 trunc from 0x03646f to 0x00877e (0x2dcf0 bytes) 000035 1789608519.466374 MIRROR_RESYNC 2 mirrors 000037 1789608520.662023 write 0x03aac0 thru 0x03ffff (0x5540 bytes) 000038 1789608520.814620 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) 000039 1789608521.093816 read 0x003635 thru 0x0104f8 (0xcec4 bytes) 000040 1789608521.109342 punch from 0x0301fa to 0x0304a4 (0x2ab bytes) 000041 1789608521.114583 mapwrite 0x01eecd thru 0x025837 (0x696b bytes) 000042 1789608521.247094 mapwrite 0x00b1c2 thru 0x01a159 (0xef98 bytes) 000043 1789608521.335483 mapwrite 0x025152 thru 0x033f4b (0xedfa bytes) 000044 1789608521.464921 write 0x03567c thru 0x03a0eb (0x4a70 bytes) 000046 1789608521.468497 read 0x03f608 thru 0x03ffff (0x9f8 bytes) 000047 1789608521.480806 read 0x030593 thru 0x03ba67 (0xb4d5 bytes) truncating to largest ever: 0x3dd67 000048 1789608521.482058 trunc from 0x040000 to 0x03dd66 (0x2299 bytes) 000050 1789608521.512149 MIRROR_EXTEND to 2 mirrors 000051 1789608522.991127 write 0x024c7d thru 0x0277b8 (0x2b3c bytes) 000053 1789608523.110739 mapwrite 0x03ee30 thru 0x03ffff (0x11d0 bytes) 000056 1789608523.248859 mapwrite 0x0005d5 thru 0x00ded0 (0xd8fc bytes) 000057 1789608523.320609 MIRROR_RESYNC 2 mirrors 000058 1789608524.471064 read 0x00245a thru 0x008a5a (0x6601 bytes) 000059 1789608524.481930 read 0x02787b thru 0x036e73 (0xf5f9 bytes) 000060 1789608524.492710 read 0x016394 thru 0x018c61 (0x28ce bytes) 000061 1789608524.493058 read 0x028a08 thru 0x029713 (0xd0c bytes) 000063 1789608524.493542 punch from 0x01be04 to 0x0290cb (0xd2c8 bytes) 000064 1789608524.621575 write 0x026975 thru 0x02e043 (0x76cf bytes) 000065 1789608524.654949 mapwrite 0x01f763 thru 0x02de11 (0xe6af bytes) 000069 1789608524.775292 mapwrite 0x01038f thru 0x011fee (0x1c60 bytes) 000070 1789608524.846750 mapread 0x03f01f thru 0x03ffff (0xfe1 bytes) 000075 1789608524.858664 read 0x01012e thru 0x01a23e (0xa111 bytes) 000076 1789608524.859808 trunc from 0x040000 to 0x03b95f (0x46a0 bytes) 000078 1789608524.923060 read 0x0238c4 thru 0x0259eb (0x2128 bytes) 000079 1789608524.923670 mapread 0x01ba82 thru 0x01e480 (0x29ff bytes) 000080 1789608524.925001 mapwrite 0x010499 thru 0x010794 (0x2fc bytes) 000082 1789608524.989786 mapwrite 0x01d211 thru 0x027d72 (0xab62 bytes) 000083 1789608525.106003 mapread 0x01df3c thru 0x02d3b1 (0xf476 bytes) 000084 1789608525.112155 MIRROR_RESYNC 2 mirrors 000085 1789608526.412061 mapwrite 0x03cbad thru 0x03ffff (0x3453 bytes) 000086 1789608526.724352 mapread 0x01c954 thru 0x020a35 (0x40e2 bytes) 000087 1789608526.735636 mapwrite 0x029a96 thru 0x0357b9 (0xbd24 bytes) 000088 1789608526.794968 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb2bd7ba0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x152cf7eb Mirror 3: 0x152cf7eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000089 1789608527.841765 trunc from 0x040000 to 0x006c03 (0x393fc bytes) 000090 1789608528.084360 trunc from 0x006c04 to 0x00522c (0x19d7 bytes) 000091 1789608528.112602 MIRROR_RESYNC 3 mirrors 000093 1789608529.178535 punch from 0x00065b to 0x00522c (0x4bd2 bytes) 000094 1789608529.240708 mapread 0x0045a7 thru 0x00522c (0xc86 bytes) 000095 1789608529.256783 MIRROR_RESYNC 3 mirrors 000098 1789608530.096871 mapwrite 0x035bdf thru 0x0389d5 (0x2df7 bytes) 000099 1789608530.288644 punch from 0x006adb to 0x00b42c (0x4952 bytes) 000100 1789608530.300314 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x389d6): Mirror 3: 0xa7bc1f23 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x389d6): Mirror 3: 0xa7bc1f23 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x389d6: skipped 000101 1789608530.644006 trunc from 0x0389d6 to 0x035b20 (0x2eb5 bytes) 000102 1789608530.665615 punch from 0x01b1e9 to 0x023b17 (0x892f bytes) 000104 1789608530.672400 punch from 0x01a8eb to 0x025527 (0xac3d bytes) 000105 1789608530.679860 read 0x010b78 thru 0x01c4fb (0xb984 bytes) 000106 1789608530.694079 mapwrite 0x0276c4 thru 0x02d7ad (0x60ea bytes) 000107 1789608530.795299 read 0x012eda thru 0x01390a (0xa31 bytes) 000108 1789608530.796108 mapread 0x0151c8 thru 0x01f668 (0xa4a1 bytes) 000111 1789608530.816160 write 0x007893 thru 0x009a3c (0x21aa bytes) 000113 1789608530.819138 write 0x028d0e thru 0x02c4d9 (0x37cc bytes) 000115 1789608530.828430 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35b21): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35b21): Mirror 3: 0x3fb4d07 (stale) CRC-32 checksum value for chunk [0, 0x35b21): Mirror 1: 0x9f6f22b3 Mirror 4: 0x9f6f22b3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35b21: skipped 000116 1789608532.266494 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35b21): Mirror 3: 0x3fb4d07 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35b21): Mirror 3: 0x3fb4d07 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35b21: skipped 000118 1789608532.635937 punch from 0x02902c to 0x035b20 (0xcaf5 bytes) 000119 1789608532.665048 punch from 0x032a11 to 0x035b20 (0x3110 bytes) 000120 1789608532.681335 mapwrite 0x01dc32 thru 0x023069 (0x5438 bytes) 000123 1789608532.779321 mapread 0x00bf7e thru 0x016d18 (0xad9b bytes) 000124 1789608532.806841 mapwrite 0x013e4f thru 0x015ed4 (0x2086 bytes) 000125 1789608532.884726 MIRROR_RESYNC 2 mirrors 000128 1789608533.828665 trunc from 0x035b21 to 0x004f6c (0x30bb4 bytes) 000130 1789608533.946703 write 0x03deb2 thru 0x03ffff (0x214e bytes) 000132 1789608533.952477 trunc from 0x040000 to 0x01bceb (0x24314 bytes) 000134 1789608534.022751 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) 000137 1789608534.366465 mapread 0x00794a thru 0x00eff1 (0x76a8 bytes) 000138 1789608534.399775 write 0x00cf89 thru 0x01cad8 (0xfb50 bytes) 000139 1789608534.401398 mapread 0x002ae4 thru 0x004702 (0x1c1f bytes) 000141 1789608534.407535 read 0x019ef0 thru 0x01be58 (0x1f69 bytes) 000142 1789608534.419596 MIRROR_EXTEND to 2 mirrors 000144 1789608535.481304 trunc from 0x01cad9 to 0x01bce9 (0xdef bytes) 000146 1789608535.559096 punch from 0x0058ba to 0x00bb9a (0x62e1 bytes) 000147 1789608535.565644 read 0x012868 thru 0x01af41 (0x86da bytes) 000148 1789608535.573208 mapwrite 0x028782 thru 0x02ecff (0x657e bytes) 000152 1789608535.680813 punch from 0x0100cd to 0x01a82a (0xa75e bytes) 000153 1789608535.686872 write 0x009be6 thru 0x00ffef (0x640a bytes) 000155 1789608535.708771 mapread 0x01b169 thru 0x01b8ad (0x745 bytes) 000156 1789608535.720935 read 0x009ce3 thru 0x00edaf (0x50cd bytes) 000157 1789608535.721740 trunc from 0x02ed00 to 0x0223f6 (0xc909 bytes) 000158 1789608535.739390 trunc from 0x0223f7 to 0x02a98b (0x8595 bytes) 000159 1789608535.753562 write 0x015111 thru 0x0233cf (0xe2bf bytes) 000161 1789608535.761693 mapread 0x01fefb thru 0x024108 (0x420e bytes) 000162 1789608535.779089 mapread 0x01d9a9 thru 0x021cb8 (0x4310 bytes) 000163 1789608535.780279 mapwrite 0x0086be thru 0x00c587 (0x3eca bytes) 000164 1789608535.822900 read 0x024811 thru 0x029efb (0x56eb bytes) 000165 1789608535.823544 mapread 0x0260df thru 0x027319 (0x123b bytes) 000168 1789608535.831914 trunc from 0x02a98c to 0x02937a (0x1611 bytes) 000169 1789608535.850742 write 0x01c6a7 thru 0x01dfb7 (0x1911 bytes) 000170 1789608535.852305 write 0x01cce0 thru 0x0271ca (0xa4eb bytes) 000171 1789608535.855279 punch from 0x0242d1 to 0x028af1 (0x4821 bytes) 000172 1789608535.878775 mapwrite 0x026c28 thru 0x034b0b (0xdee4 bytes) 000173 1789608536.027967 mapwrite 0x003c03 thru 0x00df03 (0xa301 bytes) 000174 1789608536.073869 punch from 0x00d40b to 0x0178a7 (0xa49d bytes) 000175 1789608536.090266 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x34b0c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34b0c): Mirror 2: 0xc0425cff (stale) CRC-32 checksum value for chunk [0, 0x34b0c): Mirror 1: 0x79c1af87 Mirror 3: 0x79c1af87 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34b0c: skipped 000176 1789608537.276820 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x34b0c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34b0c): Mirror 2: 0xc0425cff (stale) CRC-32 checksum value for chunk [0, 0x34b0c): Mirror 1: 0x79c1af87 Mirror 3: 0x79c1af87 Mirror 4: 0x79c1af87 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34b0c: skipped 000178 1789608538.623606 write 0x00d66b thru 0x011337 (0x3ccd bytes) 000179 1789608538.804922 write 0x01e03e thru 0x024879 (0x683c bytes) 000180 1789608538.847606 punch from 0x02c2ab to 0x034b0b (0x8861 bytes) 000181 1789608538.881983 mapwrite 0x027ccd thru 0x035d95 (0xe0c9 bytes) 000182 1789608539.075302 trunc from 0x035d96 to 0x02aa94 (0xb301 bytes) 000183 1789608539.107595 write 0x029a2d thru 0x02d87e (0x3e52 bytes) 000185 1789608539.113052 mapwrite 0x0356e2 thru 0x03ffff (0xa91e bytes) 000186 1789608539.239505 mapwrite 0x03ff42 thru 0x03ffff (0xbe bytes) 000188 1789608539.283919 mapread 0x024086 thru 0x03138f (0xd30a bytes) 000189 1789608539.286802 mapwrite 0x02a532 thru 0x0363f2 (0xbec1 bytes) 000191 1789608539.365799 mapread 0x019713 thru 0x028325 (0xec13 bytes) 000193 1789608539.382659 mapread 0x008ed1 thru 0x00d16e (0x429e bytes) 000196 1789608539.417888 write 0x011626 thru 0x01d19a (0xbb75 bytes) 000197 1789608539.421792 mapread 0x01f868 thru 0x02db7f (0xe318 bytes) 000198 1789608539.437119 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xab19eff6 (stale) Mirror 3: 0x25c90cc7 (stale) Mirror 4: 0x25c90cc7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x12abfd0e Mirror 5: 0x12abfd0e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000201 1789608540.388367 write 0x039c3d thru 0x03b0d4 (0x1498 bytes) 000202 1789608540.457794 read 0x02b4cc thru 0x02c973 (0x14a8 bytes) 000203 1789608540.464160 read 0x02d6d7 thru 0x038d93 (0xb6bd bytes) 000204 1789608540.478269 mapwrite 0x01f6e2 thru 0x02081c (0x113b bytes) 000205 1789608540.537916 trunc from 0x040000 to 0x037789 (0x8876 bytes) 000206 1789608540.589124 mapwrite 0x0061f6 thru 0x0080a2 (0x1ead bytes) 000207 1789608540.635149 mapwrite 0x01eaf3 thru 0x020d1c (0x222a bytes) 000208 1789608540.669870 mapwrite 0x00018c thru 0x00d588 (0xd3fd bytes) 000210 1789608540.744046 trunc from 0x03778a to 0x000c20 (0x36b69 bytes) 000211 1789608540.762574 trunc from 0x000c21 to 0x028185 (0x27565 bytes) 000212 1789608540.778619 trunc from 0x028186 to 0x006be9 (0x2159c bytes) 000213 1789608540.797519 mapread 0x003eca thru 0x006be9 (0x2d20 bytes) 000214 1789608540.816908 punch from 0x003411 to 0x006be9 (0x37d9 bytes) 000216 1789608540.823932 punch from 0x00468e to 0x006be9 (0x255c bytes) 000218 1789608540.834066 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x6bea): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6bea): Mirror 2: 0xe0f32f18 (stale) Mirror 3: 0x82c7713d (stale) Mirror 4: 0x82c7713d (stale) Mirror 5: 0x82c7713d (stale) CRC-32 checksum value for chunk [0, 0x6bea): Mirror 1: 0xd34d604a Mirror 6: 0xd34d604a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6bea: skipped 000219 1789608541.906247 mapwrite 0x000a42 thru 0x007825 (0x6de4 bytes) 000220 1789608542.076434 write 0x02136f thru 0x0296d5 (0x8367 bytes) 000222 1789608542.082759 trunc from 0x0296d6 to 0x01df27 (0xb7ae bytes) 000223 1789608542.104832 mapwrite 0x007862 thru 0x00fc42 (0x83e1 bytes) 000224 1789608542.161067 mapwrite 0x024f43 thru 0x029b2b (0x4be9 bytes) 000226 1789608542.230925 trunc from 0x029b2c to 0x009b44 (0x1ffe7 bytes) 000228 1789608542.253427 mapread 0x006d5e thru 0x007699 (0x93c bytes) 000229 1789608542.254930 read 0x001744 thru 0x009b44 (0x8401 bytes) 000230 1789608542.256538 mapwrite 0x03ad6f thru 0x03ffff (0x5291 bytes) 000231 1789608542.338341 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x25c90cc7 (stale) Mirror 4: 0x25c90cc7 (stale) Mirror 5: 0x12abfd0e (stale) Mirror 6: 0xa5775ca1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x25c90cc7 (stale) Mirror 4: 0x25c90cc7 (stale) Mirror 5: 0x12abfd0e (stale) Mirror 6: 0xa5775ca1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000233 1789608542.831652 mapread 0x01f6e6 thru 0x028415 (0x8d30 bytes) 000235 1789608542.857094 write 0x0334e5 thru 0x03452d (0x1049 bytes) 000236 1789608542.868421 write 0x0230a0 thru 0x02d51e (0xa47f bytes) 000237 1789608542.875156 write 0x034ee9 thru 0x0358b7 (0x9cf bytes) 000242 1789608542.885735 mapwrite 0x00b730 thru 0x011a61 (0x6332 bytes) 000243 1789608542.991374 punch from 0x01903a to 0x01db56 (0x4b1d bytes) 000244 1789608543.005879 mapwrite 0x03ade7 thru 0x03ffff (0x5219 bytes) 000245 1789608543.064269 trunc from 0x040000 to 0x0129c4 (0x2d63b bytes) 000246 1789608543.087765 punch from 0x008ccb to 0x0129c4 (0x9cfa bytes) 000247 1789608543.095213 mapwrite 0x00613a thru 0x013d00 (0xdbc7 bytes) 000248 1789608543.192363 punch from 0x013aff to 0x013d00 (0x202 bytes) 000249 1789608543.201032 mapwrite 0x019e13 thru 0x020a95 (0x6c83 bytes) 000250 1789608543.277406 punch from 0x0041e3 to 0x0117e5 (0xd603 bytes) 000251 1789608543.283999 trunc from 0x020a96 to 0x02533e (0x48a9 bytes) 000252 1789608543.303281 punch from 0x01f4a3 to 0x02533e (0x5e9c bytes) 000253 1789608543.312788 mapwrite 0x031821 thru 0x0322af (0xa8f bytes) 000255 1789608543.382164 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x322b0): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x322b0): Mirror 3: 0x654c6931 (stale) Mirror 4: 0x654c6931 (stale) Mirror 5: 0x7dba25f0 (stale) Mirror 6: 0xee515f67 (stale) CRC-32 checksum value for chunk [0, 0x322b0): Mirror 1: 0x4f204d28 Mirror 7: 0x4f204d28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x322b0: skipped 000256 1789608544.660276 punch from 0x028d48 to 0x02aab8 (0x1d71 bytes) 000257 1789608544.768728 mapwrite 0x005500 thru 0x009a5a (0x455b bytes) 000258 1789608544.869294 mapread 0x019d7b thru 0x026e31 (0xd0b7 bytes) 000259 1789608544.893627 mapwrite 0x010f28 thru 0x01eb9d (0xdc76 bytes) 000260 1789608544.959517 punch from 0x011a76 to 0x01ccfc (0xb287 bytes) 000261 1789608544.967147 write 0x02903f thru 0x029723 (0x6e5 bytes) 000262 1789608544.968743 trunc from 0x0322b0 to 0x03b5de (0x932f bytes) 000263 1789608545.023917 write 0x02a3dc thru 0x032dbf (0x89e4 bytes) 000264 1789608545.030382 trunc from 0x03b5df to 0x032de5 (0x87f9 bytes) 000265 1789608545.055707 punch from 0x0216cd to 0x029f07 (0x883b bytes) 000266 1789608545.070656 write 0x02ebed thru 0x03acde (0xc0f2 bytes) 000268 1789608545.073875 mapwrite 0x01ddc4 thru 0x021f53 (0x4190 bytes) 000270 1789608545.141502 punch from 0x014b7d to 0x016cae (0x2132 bytes) 000271 1789608545.148563 write 0x00dccc thru 0x00ed84 (0x10b9 bytes) 000272 1789608545.153644 read 0x02b937 thru 0x02e7b5 (0x2e7f bytes) 000273 1789608545.170602 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3acdf): Mirror 4: 0x23e56486 (stale) Mirror 5: 0x27c4d1b7 (stale) Mirror 6: 0xa193334f (stale) Mirror 7: 0x45b443e1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3acdf): Mirror 4: 0x23e56486 (stale) Mirror 5: 0x27c4d1b7 (stale) Mirror 6: 0xa193334f (stale) Mirror 7: 0x45b443e1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3acdf: skipped 000279 1789608545.601387 mapwrite 0x03b2c6 thru 0x03c9fa (0x1735 bytes) 000280 1789608545.712699 trunc from 0x03c9fb to 0x0082e3 (0x34717 bytes) 000282 1789608545.737700 mapread 0x004214 thru 0x0082e3 (0x40d0 bytes) 000284 1789608545.746153 trunc from 0x0082e4 to 0x014b1d (0xc83a bytes) 000285 1789608545.765293 mapwrite 0x0064d3 thru 0x0087f1 (0x231f bytes) 000286 1789608545.804867 mapread 0x0058c9 thru 0x00dea6 (0x85de bytes) 000287 1789608545.816637 punch from 0x0039f3 to 0x00b0e7 (0x76f5 bytes) 000288 1789608545.824818 trunc from 0x014b1e to 0x027e08 (0x132eb bytes) 000292 1789608545.858818 trunc from 0x027e09 to 0x028ed7 (0x10cf bytes) 000293 1789608545.882555 mapread 0x01d91f thru 0x023b3a (0x621c bytes) 000299 1789608545.902668 write 0x02a58d thru 0x035c41 (0xb6b5 bytes) 000300 1789608545.908841 trunc from 0x035c42 to 0x01eac3 (0x1717e bytes) 000301 1789608545.979609 read 0x0036bb thru 0x003d43 (0x689 bytes) 000304 1789608545.996498 write 0x002cd9 thru 0x0084a6 (0x57ce bytes) 000305 1789608546.004774 mapread 0x0070bc thru 0x015b6c (0xeab1 bytes) 000306 1789608546.023652 punch from 0x00adf5 to 0x0117af (0x69bb bytes) 000308 1789608546.067799 punch from 0x00756a to 0x00be6c (0x4903 bytes) 000309 1789608546.077738 write 0x01f306 thru 0x029fc6 (0xacc1 bytes) 000310 1789608546.083007 write 0x025bbb thru 0x028168 (0x25ae bytes) 000312 1789608546.085408 mapwrite 0x0200eb thru 0x02024a (0x160 bytes) 000314 1789608546.168946 write 0x00fd6f thru 0x01936f (0x9601 bytes) 000315 1789608546.175487 punch from 0x006227 to 0x012ff8 (0xcdd2 bytes) 000316 1789608546.197494 read 0x000214 thru 0x004676 (0x4463 bytes) 000317 1789608546.210281 trunc from 0x029fc7 to 0x016bf4 (0x133d2 bytes) 000318 1789608546.251744 read 0x01238f thru 0x016bf4 (0x4866 bytes) 000319 1789608546.254745 punch from 0x009c1c to 0x00d991 (0x3d76 bytes) 000320 1789608546.260406 mapwrite 0x03d869 thru 0x03e858 (0xff0 bytes) 000321 1789608546.341827 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e859): Mirror 4: 0x63067844 (stale) Mirror 6: 0xc52bb44f (stale) Mirror 7: 0x3d4b4672 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e859): Mirror 4: 0x63067844 (stale) Mirror 6: 0xc52bb44f (stale) Mirror 7: 0x3d4b4672 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e859: skipped 000323 1789608546.756646 mapread 0x0235d9 thru 0x0326cd (0xf0f5 bytes) 000325 1789608546.809403 write 0x009263 thru 0x00eafa (0x5898 bytes) 000326 1789608546.849429 punch from 0x011d64 to 0x01ca61 (0xacfe bytes) 000327 1789608546.876225 punch from 0x011062 to 0x011c52 (0xbf1 bytes) 000328 1789608546.882794 read 0x02e2af thru 0x0390fe (0xae50 bytes) 000329 1789608546.913119 MIRROR_RESYNC 4 mirrors 000330 1789608548.650338 punch from 0x0372cb to 0x03e858 (0x758e bytes) 000332 1789608548.715827 mapwrite 0x03bf9c thru 0x03ffff (0x4064 bytes) 000333 1789608548.806276 punch from 0x02e772 to 0x03bb94 (0xd423 bytes) 000335 1789608548.811531 mapwrite 0x03dfb7 thru 0x03ffff (0x2049 bytes) 000336 1789608548.841999 punch from 0x020a97 to 0x02716e (0x66d8 bytes) 000337 1789608548.846364 read 0x030c4d thru 0x031fda (0x138e bytes) 000339 1789608548.852101 mapread 0x015553 thru 0x0179ca (0x2478 bytes) 000340 1789608548.863252 mapwrite 0x01c6f8 thru 0x029382 (0xcc8b bytes) 000341 1789608548.942149 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2bef00e7 (stale) Mirror 6: 0x2bef00e7 (stale) Mirror 7: 0x2bef00e7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4514401f Mirror 8: 0x4514401f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000342 1789608550.704651 mapread 0x00361b thru 0x007cd9 (0x46bf bytes) 000343 1789608550.746697 trunc from 0x040000 to 0x025fd0 (0x1a02f bytes) 000344 1789608550.841065 trunc from 0x025fd1 to 0x00c3be (0x19c12 bytes) 000345 1789608550.871671 mapread 0x00a581 thru 0x00c3be (0x1e3e bytes) 000348 1789608550.886139 punch from 0x00a88b to 0x00c3be (0x1b34 bytes) 000350 1789608550.894042 mapwrite 0x03d4de thru 0x03ffff (0x2b22 bytes) 000351 1789608550.977149 read 0x01df83 thru 0x021572 (0x35f0 bytes) 000352 1789608550.992671 trunc from 0x040000 to 0x01bdc9 (0x24236 bytes) 000353 1789608551.022609 read 0x013991 thru 0x01bdc9 (0x8439 bytes) 000356 1789608551.036833 punch from 0x00ce37 to 0x0146ad (0x7877 bytes) 000358 1789608551.044845 mapread 0x01ac25 thru 0x01bdc9 (0x11a5 bytes) 000359 1789608551.047146 write 0x0187a9 thru 0x01edd6 (0x662e bytes) 000360 1789608551.048572 write 0x015144 thru 0x019d76 (0x4c33 bytes) 000361 1789608551.049627 trunc from 0x01edd7 to 0x03cedf (0x1e109 bytes) 000363 1789608551.078516 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cee0): Mirror 6: 0x86ce40af (stale) Mirror 7: 0x86ce40af (stale) Mirror 8: 0x91647a01 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cee0): Mirror 6: 0x86ce40af (stale) Mirror 7: 0x86ce40af (stale) Mirror 8: 0x91647a01 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cee0: skipped 000365 1789608551.505121 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cee0): Mirror 7: 0x86ce40af (stale) Mirror 8: 0x91647a01 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cee0): Mirror 7: 0x86ce40af (stale) Mirror 8: 0x91647a01 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cee0: skipped 000366 1789608551.933765 MIRROR_RESYNC 3 mirrors 000367 1789608553.424977 mapwrite 0x02d775 thru 0x0391ba (0xba46 bytes) 000368 1789608553.756287 read 0x020902 thru 0x024202 (0x3901 bytes) 000369 1789608553.765920 trunc from 0x03cee0 to 0x02f871 (0xd66e bytes) 000371 1789608553.794633 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f872): Mirror 8: 0xfb59a7e4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f872): Mirror 8: 0xfb59a7e4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f872: skipped 000373 1789608554.121262 trunc from 0x02f872 to 0x02a1b8 (0x56b9 bytes) 000376 1789608554.150521 read 0x00553c thru 0x008380 (0x2e45 bytes) 000377 1789608554.157356 punch from 0x01ced4 to 0x01d39a (0x4c7 bytes) 000378 1789608554.183835 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) 000379 1789608554.403157 punch from 0x00a4e8 to 0x016b11 (0xc62a bytes) 000380 1789608554.411815 read 0x0002e9 thru 0x00c1d9 (0xbef1 bytes) 000382 1789608554.424076 trunc from 0x02a1b9 to 0x02adb9 (0xc01 bytes) 000383 1789608554.467222 trunc from 0x02adba to 0x020331 (0xaa88 bytes) 000385 1789608554.533966 punch from 0x000405 to 0x001e87 (0x1a83 bytes) 000386 1789608554.550902 mapwrite 0x01444b thru 0x014e8f (0xa45 bytes) 000388 1789608554.622927 write 0x00c64e thru 0x00caf9 (0x4ac bytes) 000389 1789608554.623933 mapwrite 0x033500 thru 0x03ffff (0xcb00 bytes) 000390 1789608554.717554 read 0x0336ae thru 0x038f3a (0x588d bytes) 000393 1789608554.720254 mapread 0x01b5cd thru 0x01c51a (0xf4e bytes) 000394 1789608554.733100 read 0x022104 thru 0x02c6d0 (0xa5cd bytes) 000395 1789608554.734252 read 0x01420d thru 0x01dd3f (0x9b33 bytes) 000397 1789608554.736717 mapwrite 0x01ccf4 thru 0x02b297 (0xe5a4 bytes) 000398 1789608554.778156 read 0x00a8fc thru 0x01880f (0xdf14 bytes) 000399 1789608554.783581 MIRROR_EXTEND to 2 mirrors 000402 1789608555.777028 write 0x009156 thru 0x00b462 (0x230d bytes) 000403 1789608555.853048 punch from 0x0013e5 to 0x00790d (0x6529 bytes) 000404 1789608555.865105 read 0x011c6a thru 0x016b83 (0x4f1a bytes) 000405 1789608555.875104 write 0x03b9f1 thru 0x03ffff (0x460f bytes) 000407 1789608555.890160 MIRROR_RESYNC 2 mirrors 000408 1789608557.349657 trunc from 0x040000 to 0x035344 (0xacbb bytes) 000409 1789608557.469781 write 0x01b2e4 thru 0x020332 (0x504f bytes) 000411 1789608557.488742 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) 000412 1789608557.690581 punch from 0x0062f6 to 0x013f65 (0xdc70 bytes) 000413 1789608557.699820 mapread 0x00592d thru 0x013a6b (0xe13f bytes) 000416 1789608557.737633 mapwrite 0x0252df thru 0x03214e (0xce70 bytes) 000417 1789608557.818690 trunc from 0x035345 to 0x0132f7 (0x2204d bytes) 000421 1789608557.847539 MIRROR_EXTEND to 2 mirrors 000422 1789608558.882797 trunc from 0x0132f8 to 0x024dea (0x11af3 bytes) 000423 1789608559.002090 mapread 0x01ea64 thru 0x022240 (0x37dd bytes) 000424 1789608559.029207 read 0x01058b thru 0x017752 (0x71c8 bytes) 000425 1789608559.040711 write 0x01b93a thru 0x01cd49 (0x1410 bytes) 000426 1789608559.047615 MIRROR_RESYNC 2 mirrors 000430 1789608560.000703 mapwrite 0x02523a thru 0x0277a6 (0x256d bytes) 000431 1789608560.194393 read 0x00d0f4 thru 0x015007 (0x7f14 bytes) 000432 1789608560.202888 mapwrite 0x01430b thru 0x023ac8 (0xf7be bytes) 000433 1789608560.332234 MIRROR_RESYNC 2 mirrors 000435 1789608561.186956 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) truncating to largest ever: 0x3f0a4 000436 1789608561.351048 trunc from 0x0277a7 to 0x03f0a3 (0x178fd bytes) 000440 1789608561.412935 mapwrite 0x02e15b thru 0x03bd73 (0xdc19 bytes) 000441 1789608561.486907 write 0x0098e6 thru 0x01426f (0xa98a bytes) 000442 1789608561.499149 trunc from 0x03f0a4 to 0x01631f (0x28d84 bytes) 000443 1789608561.521501 trunc from 0x016320 to 0x0311b4 (0x1ae95 bytes) 000444 1789608561.540682 read 0x02a8d5 thru 0x02e225 (0x3951 bytes) 000445 1789608561.550878 mapread 0x0059b7 thru 0x0154ab (0xfaf5 bytes) 000446 1789608561.567023 trunc from 0x0311b5 to 0x02197c (0xf838 bytes) 000448 1789608561.593082 write 0x02ec2f thru 0x0344dd (0x58af bytes) 000451 1789608561.596667 read 0x025232 thru 0x025de7 (0xbb6 bytes) 000452 1789608561.605909 write 0x00d9de thru 0x01cb8f (0xf1b2 bytes) 000453 1789608561.607432 write 0x0268c4 thru 0x033ee4 (0xd621 bytes) 000456 1789608561.611726 mapwrite 0x03a8c3 thru 0x03e63d (0x3d7b bytes) 000457 1789608561.682826 read 0x006001 thru 0x015a60 (0xfa60 bytes) 000460 1789608561.685611 write 0x02a3f0 thru 0x02f648 (0x5259 bytes) 000461 1789608561.687355 mapread 0x03bbff thru 0x03e63d (0x2a3f bytes) 000462 1789608561.691811 MIRROR_EXTEND to 2 mirrors 000465 1789608562.997784 mapread 0x0288b7 thru 0x02aa2d (0x2177 bytes) 000468 1789608563.167034 mapread 0x03a0f6 thru 0x03a72b (0x636 bytes) 000470 1789608563.242782 read 0x02653b thru 0x034d7a (0xe840 bytes) 000472 1789608563.299899 MIRROR_RESYNC 2 mirrors 000473 1789608564.014711 MIRROR_RESYNC 2 mirrors 000474 1789608564.416557 mapwrite 0x00923f thru 0x013aee (0xa8b0 bytes) 000475 1789608564.667110 mapwrite 0x00d7ee thru 0x015073 (0x7886 bytes) 000477 1789608564.740308 write 0x017c54 thru 0x01dabd (0x5e6a bytes) 000479 1789608564.748583 write 0x02886e thru 0x037ff3 (0xf786 bytes) 000483 1789608564.762038 read 0x012225 thru 0x01d13f (0xaf1b bytes) 000484 1789608564.762898 read 0x0179eb thru 0x01ff07 (0x851d bytes) 000485 1789608564.775681 punch from 0x030da4 to 0x03e63d (0xd89a bytes) 000486 1789608564.806663 punch from 0x028a53 to 0x0323cc (0x997a bytes) 000488 1789608564.818981 write 0x0070a5 thru 0x00fad3 (0x8a2f bytes) 000489 1789608564.824259 read 0x03d516 thru 0x03e63d (0x1128 bytes) 000491 1789608564.850877 trunc from 0x03e63e to 0x00038d (0x3e2b0 bytes) 000492 1789608564.910241 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x38e): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38e): Mirror 2: 0x6b07fc5b (stale) CRC-32 checksum value for chunk [0, 0x38e): Mirror 1: 0x6b07fc5b Mirror 3: 0x6b07fc5b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38e: skipped 000493 1789608566.135883 write 0x028a71 thru 0x02ae8a (0x241a bytes) 000494 1789608566.360601 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ae8b): Mirror 2: 0x13ec6ccb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ae8b): Mirror 2: 0x13ec6ccb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ae8b: skipped 000495 1789608566.949115 mapread 0x01612b thru 0x01d06d (0x6f43 bytes) 000496 1789608566.968412 punch from 0x0280e5 to 0x02ae8a (0x2da6 bytes) 000497 1789608566.971852 mapread 0x0091fc thru 0x0141ae (0xafb3 bytes) 000498 1789608566.983398 punch from 0x0058ab to 0x012bd0 (0xd326 bytes) 000499 1789608566.987882 mapread 0x02473f thru 0x02647b (0x1d3d bytes) 000500 1789608566.997626 punch from 0x01446c to 0x01fb90 (0xb725 bytes) 000502 1789608567.004381 mapwrite 0x034546 thru 0x03eefb (0xa9b6 bytes) 000503 1789608567.116618 MIRROR_RESYNC 2 mirrors 000505 1789608568.652503 mapwrite 0x03c575 thru 0x03f605 (0x3091 bytes) 000506 1789608568.809154 read 0x0088ca thru 0x00ead0 (0x6207 bytes) 000507 1789608568.824009 MIRROR_RESYNC 2 mirrors 000510 1789608569.854424 write 0x0235ce thru 0x0321b4 (0xebe7 bytes) 000511 1789608569.938842 mapwrite 0x0277f6 thru 0x030215 (0x8a20 bytes) 000512 1789608570.017143 trunc from 0x03f606 to 0x023540 (0x1c0c5 bytes) 000513 1789608570.048519 MIRROR_RESYNC 2 mirrors 000516 1789608570.779576 MIRROR_EXTEND to 3 mirrors 000517 1789608571.460782 MIRROR_EXTEND to 4 mirrors 000518 1789608572.305101 read 0x017ad6 thru 0x021908 (0x9e33 bytes) 000522 1789608572.318864 mapread 0x00fe8e thru 0x01fc7e (0xfdf1 bytes) 000523 1789608572.338878 mapread 0x020aa0 thru 0x023540 (0x2aa1 bytes) 000526 1789608572.345496 write 0x03244b thru 0x03ffff (0xdbb5 bytes) 000528 1789608572.416552 mapwrite 0x028f11 thru 0x02f790 (0x6880 bytes) 000529 1789608572.480611 mapread 0x015929 thru 0x017ac2 (0x219a bytes) 000530 1789608572.491962 read 0x03886f thru 0x03c266 (0x39f8 bytes) 000532 1789608572.494463 trunc from 0x040000 to 0x03413c (0xbec3 bytes) 000533 1789608572.517894 trunc from 0x03413d to 0x012361 (0x21ddb bytes) 000534 1789608572.536035 trunc from 0x012362 to 0x03a78f (0x2842e bytes) 000535 1789608572.561293 mapwrite 0x022c44 thru 0x029c6a (0x7027 bytes) 000536 1789608572.621032 trunc from 0x03a790 to 0x037615 (0x317a bytes) 000537 1789608572.638934 mapwrite 0x0077a1 thru 0x00c6c5 (0x4f25 bytes) 000538 1789608572.684307 write 0x03d2fc thru 0x03ffff (0x2d04 bytes) 000539 1789608572.686517 mapread 0x022af7 thru 0x0241b1 (0x16bb bytes) 000541 1789608572.688924 trunc from 0x040000 to 0x0132fc (0x2cd03 bytes) 000542 1789608572.711823 punch from 0x012a1a to 0x0132fc (0x8e3 bytes) 000543 1789608572.717398 mapwrite 0x02af96 thru 0x031959 (0x69c4 bytes) 000544 1789608572.824403 mapwrite 0x01d52d thru 0x0238b9 (0x638d bytes) 000545 1789608572.906205 write 0x03f909 thru 0x03ffff (0x6f7 bytes) 000547 1789608572.907818 write 0x0174c4 thru 0x02215d (0xac9a bytes) 000548 1789608572.917897 read 0x00fcca thru 0x01437e (0x46b5 bytes) 000550 1789608572.930128 read 0x004964 thru 0x012e63 (0xe500 bytes) 000551 1789608572.931318 trunc from 0x040000 to 0x01099f (0x2f660 bytes) 000552 1789608572.951567 mapwrite 0x001a43 thru 0x003f05 (0x24c3 bytes) 000556 1789608572.996473 write 0x01ab57 thru 0x0287e7 (0xdc91 bytes) 000557 1789608572.998460 mapread 0x01524d thru 0x01c50c (0x72c0 bytes) 000558 1789608573.008075 write 0x00b3be thru 0x013407 (0x804a bytes) 000559 1789608573.019049 MIRROR_RESYNC 4 mirrors 000560 1789608575.011914 mapwrite 0x007a3a thru 0x011bc9 (0xa190 bytes) 000564 1789608575.283811 punch from 0x0122b0 to 0x01e5cc (0xc31d bytes) 000566 1789608575.296525 write 0x0337a5 thru 0x038e19 (0x5675 bytes) 000567 1789608575.299266 punch from 0x024a89 to 0x032557 (0xdacf bytes) 000568 1789608575.317265 punch from 0x00a7a4 to 0x012491 (0x7cee bytes) 000570 1789608575.325207 read 0x01bc58 thru 0x0200f3 (0x449c bytes) 000571 1789608575.336837 write 0x014d37 thru 0x0248f5 (0xfbbf bytes) 000572 1789608575.353007 read 0x0081e9 thru 0x00f2ce (0x70e6 bytes) 000573 1789608575.366569 read 0x035b69 thru 0x038e19 (0x32b1 bytes) 000575 1789608575.370555 read 0x033b6a thru 0x038e19 (0x52b0 bytes) 000576 1789608575.371832 read 0x0124d0 thru 0x01e413 (0xbf44 bytes) 000579 1789608575.376616 write 0x012c29 thru 0x01540d (0x27e5 bytes) 000580 1789608575.378831 mapwrite 0x014871 thru 0x0185a9 (0x3d39 bytes) 000581 1789608575.435268 write 0x001de7 thru 0x00dd96 (0xbfb0 bytes) 000582 1789608575.436686 punch from 0x0299ee to 0x03457a (0xab8d bytes) 000585 1789608575.469000 mapread 0x00b9d2 thru 0x00f78b (0x3dba bytes) 000587 1789608575.471919 read 0x01f173 thru 0x02833b (0x91c9 bytes) 000589 1789608575.475138 punch from 0x0121a4 to 0x012441 (0x29e bytes) 000590 1789608575.495025 punch from 0x028c8d to 0x03773c (0xeab0 bytes) 000591 1789608575.519758 write 0x02234b thru 0x02539b (0x3051 bytes) 000592 1789608575.522069 mapwrite 0x015662 thru 0x016835 (0x11d4 bytes) 000593 1789608575.609733 read 0x00d13b thru 0x0134ce (0x6394 bytes) 000594 1789608575.638733 trunc from 0x038e1a to 0x027c2f (0x111ea bytes) 000596 1789608575.678429 write 0x03a068 thru 0x03ee5a (0x4df3 bytes) 000597 1789608575.680851 mapwrite 0x037404 thru 0x03b665 (0x4262 bytes) 000598 1789608575.773143 write 0x0063fd thru 0x01035c (0x9f60 bytes) 000600 1789608575.786569 MIRROR_RESYNC 4 mirrors 000603 1789608577.178367 MIRROR_RESYNC 4 mirrors 000606 1789608577.791302 trunc from 0x03ee5b to 0x000272 (0x3ebe8 bytes) 000607 1789608577.873327 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x273): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x273): Mirror 2: 0x670f1c74 (stale) Mirror 3: 0x670f1c74 (stale) Mirror 4: 0x670f1c74 (stale) CRC-32 checksum value for chunk [0, 0x273): Mirror 1: 0x670f1c74 Mirror 5: 0x670f1c74 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x273: skipped 000608 1789608579.241448 mapread 0x000081 thru 0x000272 (0x1f2 bytes) 000609 1789608579.275316 write 0x0330da thru 0x03ffff (0xcf26 bytes) 000610 1789608579.355724 trunc from 0x040000 to 0x02f932 (0x106cd bytes) 000612 1789608579.386917 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2f933): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f933): Mirror 2: 0xdbb8e0dd (stale) Mirror 3: 0xdbb8e0dd (stale) Mirror 4: 0xdbb8e0dd (stale) Mirror 5: 0x601de8b2 (stale) CRC-32 checksum value for chunk [0, 0x2f933): Mirror 1: 0x601de8b2 Mirror 6: 0x601de8b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f933: skipped 000613 1789608581.255052 read 0x0195d3 thru 0x024b2b (0xb559 bytes) 000614 1789608581.277528 mapread 0x02ef31 thru 0x02f932 (0xa02 bytes) 000615 1789608581.349677 mapwrite 0x038657 thru 0x03ffff (0x79a9 bytes) 000618 1789608581.572851 mapwrite 0x013219 thru 0x014f86 (0x1d6e bytes) 000619 1789608581.693387 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa09bf3bc (stale) Mirror 3: 0xa09bf3bc (stale) Mirror 4: 0xa09bf3bc (stale) Mirror 5: 0x6f5ce263 (stale) Mirror 6: 0x6f5ce263 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x399fc1e Mirror 7: 0x399fc1e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000620 1789608583.103895 write 0x01e78a thru 0x02d74e (0xefc5 bytes) 000621 1789608583.225356 punch from 0x013bc6 to 0x018097 (0x44d2 bytes) 000622 1789608583.253546 mapread 0x024ec2 thru 0x0258d0 (0xa0f bytes) 000623 1789608583.254595 punch from 0x02cc61 to 0x02ec1a (0x1fba bytes) 000624 1789608583.264652 trunc from 0x040000 to 0x006b0d (0x394f2 bytes) 000625 1789608583.300101 mapread 0x001cc0 thru 0x006b0d (0x4e4e bytes) 000626 1789608583.325502 write 0x030ada thru 0x03e7ed (0xdd14 bytes) 000627 1789608583.335424 punch from 0x018eb1 to 0x022f7b (0xa0cb bytes) 000628 1789608583.365536 write 0x00f3a1 thru 0x016c34 (0x7894 bytes) 000630 1789608583.398907 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e7ee): Mirror 2: 0x4dc948e4 (stale) Mirror 3: 0x4dc948e4 (stale) Mirror 4: 0x4dc948e4 (stale) Mirror 6: 0x6c63093a (stale) Mirror 7: 0xe175a11c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7ee): Mirror 2: 0x4dc948e4 (stale) Mirror 3: 0x4dc948e4 (stale) Mirror 4: 0x4dc948e4 (stale) Mirror 6: 0x6c63093a (stale) Mirror 7: 0xe175a11c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7ee: skipped 000631 1789608584.137064 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3e7ee): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7ee): Mirror 2: 0x4dc948e4 (stale) Mirror 3: 0x4dc948e4 (stale) Mirror 4: 0x4dc948e4 (stale) Mirror 6: 0x6c63093a (stale) Mirror 7: 0xe175a11c (stale) CRC-32 checksum value for chunk [0, 0x3e7ee): Mirror 1: 0xfd8f2da7 Mirror 8: 0xfd8f2da7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7ee: skipped 000633 1789608585.549511 mapwrite 0x01ea31 thru 0x029f34 (0xb504 bytes) 000634 1789608585.835666 MIRROR_RESYNC 7 mirrors 000635 1789608590.033536 mapwrite 0x03e9d7 thru 0x03ffff (0x1629 bytes) 000636 1789608590.437964 mapwrite 0x007d63 thru 0x010c6d (0x8f0b bytes) 000639 1789608590.545230 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9ce1b2b7 (stale) Mirror 3: 0x9ce1b2b7 (stale) Mirror 4: 0x9ce1b2b7 (stale) Mirror 7: 0x9ce1b2b7 (stale) Mirror 8: 0x9ce1b2b7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9ce1b2b7 (stale) Mirror 3: 0x9ce1b2b7 (stale) Mirror 4: 0x9ce1b2b7 (stale) Mirror 7: 0x9ce1b2b7 (stale) Mirror 8: 0x9ce1b2b7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000642 1789608591.212619 trunc from 0x040000 to 0x03250d (0xdaf2 bytes) 000643 1789608591.230254 mapwrite 0x010789 thru 0x0120af (0x1927 bytes) 000645 1789608591.322952 read 0x01a80f thru 0x01d73e (0x2f30 bytes) 000646 1789608591.337641 read 0x005e81 thru 0x01593f (0xfabf bytes) 000647 1789608591.352892 read 0x0028ff thru 0x00d3b7 (0xaab9 bytes) 000648 1789608591.353880 punch from 0x002edb to 0x0050be (0x21e4 bytes) 000649 1789608591.371734 punch from 0x002b6f to 0x0098d3 (0x6d65 bytes) 000651 1789608591.393396 trunc from 0x03250e to 0x0363a6 (0x3e99 bytes) 000653 1789608591.440666 read 0x01a43f thru 0x020337 (0x5ef9 bytes) 000654 1789608591.446079 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x363a7): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x363a7): Mirror 2: 0xa053b603 (stale) Mirror 3: 0xa053b603 (stale) Mirror 4: 0xa053b603 (stale) Mirror 7: 0xa053b603 (stale) Mirror 8: 0xa053b603 (stale) CRC-32 checksum value for chunk [0, 0x363a7): Mirror 1: 0xebe7730e Mirror 9: 0xebe7730e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x363a7: skipped 000655 1789608592.869457 write 0x027a7c thru 0x034ba4 (0xd129 bytes) 000656 1789608593.026070 read 0x034c03 thru 0x0363a6 (0x17a4 bytes) 000658 1789608593.037537 write 0x024e18 thru 0x02ebda (0x9dc3 bytes) 000659 1789608593.043939 punch from 0x034cd3 to 0x0363a6 (0x16d4 bytes) 000660 1789608593.058891 mapread 0x009184 thru 0x013143 (0x9fc0 bytes) 000661 1789608593.078740 write 0x038dd2 thru 0x03ffff (0x722e bytes) 000663 1789608593.080579 read 0x01c8a5 thru 0x023824 (0x6f80 bytes) 000664 1789608593.101922 read 0x033d74 thru 0x03eaca (0xad57 bytes) 000665 1789608593.102857 read 0x02e1e6 thru 0x038100 (0x9f1b bytes) 000666 1789608593.107871 mapwrite 0x0214ed thru 0x02c523 (0xb037 bytes) 000667 1789608593.186223 mapwrite 0x029eb1 thru 0x02e70d (0x485d bytes) 000668 1789608593.261741 mapread 0x0229b9 thru 0x02e17c (0xb7c4 bytes) 000670 1789608593.265431 write 0x0118fd thru 0x0120f7 (0x7fb bytes) 000671 1789608593.267141 read 0x01d316 thru 0x026a00 (0x96eb bytes) 000672 1789608593.268598 mapread 0x033241 thru 0x03ffff (0xcdbf bytes) 000673 1789608593.276160 MIRROR_RESYNC 7 mirrors 000675 1789608596.202370 mapread 0x00143c thru 0x0062cb (0x4e90 bytes) 000676 1789608596.229613 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) 000677 1789608596.611668 mapwrite 0x0219ee thru 0x029c56 (0x8269 bytes) 000678 1789608596.807851 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x488ae0af (stale) Mirror 4: 0x488ae0af (stale) Mirror 7: 0x488ae0af (stale) Mirror 8: 0x488ae0af (stale) Mirror 9: 0x488ae0af (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xeb5195bc Mirror 10: 0xeb5195bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000679 1789608598.008816 trunc from 0x040000 to 0x02e219 (0x11de6 bytes) 000681 1789608598.107898 trunc from 0x02e21a to 0x01acc9 (0x13550 bytes) 000682 1789608598.132767 mapread 0x01aa84 thru 0x01acc9 (0x246 bytes) 000683 1789608598.140559 trunc from 0x01acca to 0x033bf9 (0x18f30 bytes) 000684 1789608598.157805 trunc from 0x033bfa to 0x02b5b9 (0x8640 bytes) 000685 1789608598.176567 mapwrite 0x010133 thru 0x01373f (0x360d bytes) 000686 1789608598.236669 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b5ba): Mirror 3: 0xd45a2591 (stale) Mirror 4: 0xd45a2591 (stale) Mirror 7: 0xd45a2591 (stale) Mirror 8: 0xd45a2591 (stale) Mirror 9: 0xd45a2591 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b5ba): Mirror 3: 0xd45a2591 (stale) Mirror 4: 0xd45a2591 (stale) Mirror 7: 0xd45a2591 (stale) Mirror 8: 0xd45a2591 (stale) Mirror 9: 0xd45a2591 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b5ba: skipped 000691 1789608598.672832 mapwrite 0x022402 thru 0x02bc80 (0x987f bytes) 000692 1789608598.847387 mapwrite 0x03eb72 thru 0x03ffff (0x148e bytes) 000693 1789608598.972862 mapwrite 0x035177 thru 0x03ffff (0xae89 bytes) 000694 1789608599.088525 mapread 0x01ec19 thru 0x026dcc (0x81b4 bytes) 000695 1789608599.090103 trunc from 0x040000 to 0x03cb3e (0x34c1 bytes) 000698 1789608599.127311 punch from 0x006cfb to 0x010c1e (0x9f24 bytes) 000701 1789608599.149043 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cb3f): Mirror 3: 0x2a492ce5 (stale) Mirror 4: 0x2a492ce5 (stale) Mirror 8: 0x2a492ce5 (stale) Mirror 9: 0x2a492ce5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cb3f): Mirror 3: 0x2a492ce5 (stale) Mirror 4: 0x2a492ce5 (stale) Mirror 8: 0x2a492ce5 (stale) Mirror 9: 0x2a492ce5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cb3f: skipped 000705 1789608599.761358 read 0x0080eb thru 0x00ee57 (0x6d6d bytes) 000706 1789608599.793821 mapwrite 0x022174 thru 0x02b125 (0x8fb2 bytes) 000708 1789608599.933204 trunc from 0x03cb3f to 0x02efdc (0xdb62 bytes) 000711 1789608599.959115 mapread 0x02b5e8 thru 0x02efdc (0x39f5 bytes) 000712 1789608599.966818 mapwrite 0x01ffdb thru 0x0220db (0x2101 bytes) 000714 1789608600.021065 write 0x032448 thru 0x03a646 (0x81ff bytes) 000717 1789608600.025257 write 0x035de9 thru 0x03e46b (0x8683 bytes) 000718 1789608600.027664 punch from 0x00f85f to 0x010278 (0xa1a bytes) 000719 1789608600.043200 trunc from 0x03e46c to 0x001a5c (0x3ca0f bytes) 000720 1789608600.083145 MIRROR_RESYNC 5 mirrors 000721 1789608601.090809 trunc from 0x001a5d to 0x015cb8 (0x1425c bytes) 000722 1789608601.193591 punch from 0x001f91 to 0x0022c8 (0x338 bytes) 000724 1789608601.200149 mapwrite 0x02afff thru 0x02e07c (0x307e bytes) 000726 1789608601.293799 trunc from 0x02e07d to 0x036934 (0x88b8 bytes) 000727 1789608601.316740 write 0x013795 thru 0x01cbff (0x946b bytes) 000729 1789608601.341350 trunc from 0x036935 to 0x03eb73 (0x823f bytes) 000730 1789608601.386722 trunc from 0x03eb74 to 0x033d50 (0xae23 bytes) 000731 1789608601.428755 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x33d51): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33d51): Mirror 3: 0xacbfb3a9 (stale) Mirror 4: 0xacbfb3a9 (stale) Mirror 8: 0xacbfb3a9 (stale) Mirror 9: 0xacbfb3a9 (stale) CRC-32 checksum value for chunk [0, 0x33d51): Mirror 1: 0xd8137bd2 Mirror 10: 0xd8137bd2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33d51: skipped 000732 1789608603.110487 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x33d51): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33d51): Mirror 3: 0xacbfb3a9 (stale) Mirror 4: 0xacbfb3a9 (stale) Mirror 8: 0xacbfb3a9 (stale) Mirror 9: 0xacbfb3a9 (stale) CRC-32 checksum value for chunk [0, 0x33d51): Mirror 1: 0xd8137bd2 Mirror 10: 0xd8137bd2 Mirror 11: 0xd8137bd2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33d51: skipped 000734 1789608604.271810 mapwrite 0x031338 thru 0x03ffff (0xecc8 bytes) 000735 1789608604.378494 read 0x01faaf thru 0x023216 (0x3768 bytes) 000736 1789608604.384220 mapwrite 0x004cc1 thru 0x010bec (0xbf2c bytes) 000737 1789608604.429326 read 0x026e20 thru 0x02c25c (0x543d bytes) 000738 1789608604.441687 MIRROR_RESYNC 7 mirrors 000739 1789608606.521049 trunc from 0x040000 to 0x024f64 (0x1b09b bytes) 000740 1789608606.659043 mapread 0x01af0a thru 0x024f64 (0xa05b bytes) 000741 1789608606.692321 punch from 0x0055c6 to 0x014c77 (0xf6b2 bytes) 000743 1789608606.703675 mapread 0x0148d0 thru 0x017342 (0x2a73 bytes) 000744 1789608606.720251 read 0x0112f1 thru 0x01ac69 (0x9979 bytes) 000746 1789608606.721507 mapread 0x01a973 thru 0x024f64 (0xa5f2 bytes) 000748 1789608606.729441 write 0x024820 thru 0x030382 (0xbb63 bytes) 000750 1789608606.750913 MIRROR_RESYNC 7 mirrors 000751 1789608608.911917 punch from 0x00c87e to 0x015e91 (0x9614 bytes) 000752 1789608608.992763 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x30383): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30383): Mirror 3: 0xe30ec1d7 (stale) Mirror 4: 0xe30ec1d7 (stale) Mirror 8: 0xe30ec1d7 (stale) Mirror 9: 0xe30ec1d7 (stale) Mirror 10: 0xe30ec1d7 (stale) Mirror 11: 0xe30ec1d7 (stale) CRC-32 checksum value for chunk [0, 0x30383): Mirror 1: 0x3d32efd7 Mirror 12: 0x3d32efd7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30383: skipped 000754 1789608610.133042 punch from 0x015cae to 0x01a3cf (0x4722 bytes) 000755 1789608610.244043 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30383): Mirror 4: 0xe30ec1d7 (stale) Mirror 8: 0xe30ec1d7 (stale) Mirror 9: 0xe30ec1d7 (stale) Mirror 10: 0xe30ec1d7 (stale) Mirror 11: 0xe30ec1d7 (stale) Mirror 12: 0x3d32efd7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30383): Mirror 4: 0xe30ec1d7 (stale) Mirror 8: 0xe30ec1d7 (stale) Mirror 9: 0xe30ec1d7 (stale) Mirror 10: 0xe30ec1d7 (stale) Mirror 11: 0xe30ec1d7 (stale) Mirror 12: 0x3d32efd7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30383: skipped 000756 1789608610.677988 trunc from 0x030383 to 0x0367b3 (0x6431 bytes) 000757 1789608610.699652 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x367b4): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x367b4): Mirror 4: 0x88171ba9 (stale) Mirror 8: 0x88171ba9 (stale) Mirror 9: 0x88171ba9 (stale) Mirror 10: 0x88171ba9 (stale) Mirror 11: 0x88171ba9 (stale) Mirror 12: 0xb5bf9688 (stale) CRC-32 checksum value for chunk [0, 0x367b4): Mirror 1: 0x4795680e Mirror 13: 0x4795680e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x367b4: skipped 000759 1789608611.963619 read 0x0296da thru 0x035547 (0xbe6e bytes) 000760 1789608611.983483 mapread 0x02b5da thru 0x0364eb (0xaf12 bytes) 000761 1789608612.014583 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x367b4): Mirror 4: 0x88171ba9 (stale) Mirror 8: 0x88171ba9 (stale) Mirror 9: 0x88171ba9 (stale) Mirror 10: 0x88171ba9 (stale) Mirror 11: 0x88171ba9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x367b4): Mirror 4: 0x88171ba9 (stale) Mirror 8: 0x88171ba9 (stale) Mirror 9: 0x88171ba9 (stale) Mirror 10: 0x88171ba9 (stale) Mirror 11: 0x88171ba9 (stale) CRC-32 checksum value for chunk [0, 0x367b4): Mirror 1: 0x4795680e Mirror 13: 0x4795680e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x367b4: skipped 000762 1789608612.686166 read 0x01655d thru 0x01fea1 (0x9945 bytes) 000764 1789608612.698744 read 0x03234c thru 0x0367b3 (0x4468 bytes) 000765 1789608612.719157 trunc from 0x0367b4 to 0x037f07 (0x1754 bytes) 000766 1789608612.858911 trunc from 0x037f08 to 0x0222e2 (0x15c25 bytes) 000767 1789608612.900030 read 0x00cb08 thru 0x01acb7 (0xe1b0 bytes) 000768 1789608612.920679 read 0x013318 thru 0x01f475 (0xc15e bytes) 000769 1789608612.922727 write 0x02b1b6 thru 0x02d2b0 (0x20fb bytes) 000772 1789608612.936421 punch from 0x00e201 to 0x0131ea (0x4fea bytes) 000773 1789608612.954540 read 0x0016e0 thru 0x00f9c1 (0xe2e2 bytes) 000775 1789608612.976875 mapwrite 0x03e8fe thru 0x03ffff (0x1702 bytes) 000777 1789608613.159904 punch from 0x015baa to 0x023599 (0xd9f0 bytes) 000778 1789608613.170670 write 0x0088c5 thru 0x00ca2e (0x416a bytes) 000779 1789608613.191282 read 0x01c260 thru 0x02adc1 (0xeb62 bytes) 000780 1789608613.204879 mapread 0x018cf0 thru 0x02612c (0xd43d bytes) 000781 1789608613.205975 mapwrite 0x01f805 thru 0x026057 (0x6853 bytes) 000783 1789608613.371283 mapread 0x03d1fc thru 0x03ffff (0x2e04 bytes) 000784 1789608613.372329 write 0x013769 thru 0x01fa93 (0xc32b bytes) 000786 1789608613.402448 mapwrite 0x016716 thru 0x023b94 (0xd47f bytes) 000787 1789608613.546886 punch from 0x020185 to 0x02db69 (0xd9e5 bytes) 000788 1789608613.576297 MIRROR_RESYNC 7 mirrors 000790 1789608616.049387 write 0x01dc3f thru 0x027b8b (0x9f4d bytes) 000791 1789608616.133511 punch from 0x0066a6 to 0x00cb36 (0x6491 bytes) 000792 1789608616.171631 trunc from 0x040000 to 0x0155f4 (0x2aa0b bytes) 000793 1789608616.205494 mapread 0x000afc thru 0x00f00b (0xe510 bytes) 000797 1789608616.257337 punch from 0x00f47a to 0x0155f4 (0x617b bytes) 000798 1789608616.263474 mapread 0x0025e7 thru 0x005ca9 (0x36c3 bytes) 000801 1789608616.267094 mapread 0x012f50 thru 0x0155f4 (0x26a5 bytes) 000803 1789608616.284576 mapread 0x007506 thru 0x00f90f (0x840a bytes) 000804 1789608616.285864 write 0x0332a2 thru 0x036f2c (0x3c8b bytes) 000805 1789608616.288565 read 0x0015b5 thru 0x01071c (0xf168 bytes) 000806 1789608616.289556 mapread 0x00c889 thru 0x01a6b1 (0xde29 bytes) 000807 1789608616.302932 write 0x016521 thru 0x025c55 (0xf735 bytes) 000808 1789608616.310696 mapwrite 0x00707e thru 0x00ec50 (0x7bd3 bytes) 000809 1789608616.372111 trunc from 0x036f2d to 0x00af97 (0x2bf95 bytes) 000810 1789608616.393362 mapwrite 0x031b84 thru 0x03bc12 (0xa08f bytes) 000813 1789608616.488726 mapwrite 0x03f30e thru 0x03ffff (0xcf2 bytes) 000815 1789608616.564616 punch from 0x0208f3 to 0x0293ee (0x8afc bytes) 000816 1789608616.579133 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xc6068d6b (stale) Mirror 8: 0xc6068d6b (stale) Mirror 9: 0xc6068d6b (stale) Mirror 10: 0xc6068d6b (stale) Mirror 11: 0xc6068d6b (stale) Mirror 13: 0xc6068d6b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7182a297 Mirror 14: 0x7182a297 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000818 1789608617.968006 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xc6068d6b (stale) Mirror 8: 0xc6068d6b (stale) Mirror 10: 0xc6068d6b (stale) Mirror 11: 0xc6068d6b (stale) Mirror 13: 0xc6068d6b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xc6068d6b (stale) Mirror 8: 0xc6068d6b (stale) Mirror 10: 0xc6068d6b (stale) Mirror 11: 0xc6068d6b (stale) Mirror 13: 0xc6068d6b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7182a297 Mirror 14: 0x7182a297 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000819 1789608618.644150 read 0x02eb82 thru 0x03e132 (0xf5b1 bytes) 000820 1789608618.656792 mapwrite 0x00e878 thru 0x015c34 (0x73bd bytes) 000822 1789608618.928471 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xc6068d6b (stale) Mirror 8: 0xc6068d6b (stale) Mirror 10: 0xc6068d6b (stale) Mirror 11: 0xc6068d6b (stale) Mirror 13: 0xc6068d6b (stale) Mirror 14: 0x7182a297 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x799cde43 Mirror 15: 0x799cde43 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000824 1789608620.277618 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xc6068d6b (stale) Mirror 8: 0xc6068d6b (stale) Mirror 10: 0xc6068d6b (stale) Mirror 11: 0xc6068d6b (stale) Mirror 13: 0xc6068d6b (stale) Mirror 14: 0x7182a297 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x799cde43 Mirror 15: 0x799cde43 Mirror 16: 0x799cde43 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000825 1789608621.859854 read 0x00ce16 thru 0x01a023 (0xd20e bytes) 000826 1789608621.883771 write 0x0012e8 thru 0x003603 (0x231c bytes) 000827 1789608621.973297 write 0x03751d thru 0x03ffff (0x8ae3 bytes) 000829 1789608622.001071 MIRROR_RESYNC 9 mirrors 000831 1789608624.349101 punch from 0x023cc6 to 0x024456 (0x791 bytes) 000832 1789608624.470050 read 0x01d244 thru 0x0254ba (0x8277 bytes) 000833 1789608624.487726 trunc from 0x040000 to 0x03edf3 (0x120c bytes) 000834 1789608624.525980 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3edf4): Mirror 8: 0x36ced9d8 (stale) Mirror 10: 0x36ced9d8 (stale) Mirror 11: 0x36ced9d8 (stale) Mirror 13: 0x36ced9d8 (stale) Mirror 14: 0x36ced9d8 (stale) Mirror 15: 0x36ced9d8 (stale) Mirror 16: 0x36ced9d8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3edf4): Mirror 8: 0x36ced9d8 (stale) Mirror 10: 0x36ced9d8 (stale) Mirror 11: 0x36ced9d8 (stale) Mirror 13: 0x36ced9d8 (stale) Mirror 14: 0x36ced9d8 (stale) Mirror 15: 0x36ced9d8 (stale) Mirror 16: 0x36ced9d8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3edf4: skipped 000835 1789608625.286163 write 0x023c41 thru 0x02e085 (0xa445 bytes) 000836 1789608625.300087 mapread 0x004c53 thru 0x00ddab (0x9159 bytes) 000838 1789608625.322959 trunc from 0x03edf4 to 0x0095c8 (0x3582b bytes) 000840 1789608625.343905 write 0x00c4b9 thru 0x015b81 (0x96c9 bytes) 000841 1789608625.346557 mapread 0x00fa77 thru 0x014e0a (0x5394 bytes) 000845 1789608625.350056 punch from 0x002665 to 0x005478 (0x2e14 bytes) 000847 1789608625.368515 mapwrite 0x022f3c thru 0x02713a (0x41ff bytes) 000848 1789608625.457628 punch from 0x007e0d to 0x010017 (0x820b bytes) 000850 1789608625.464739 mapwrite 0x0315ba thru 0x039e0c (0x8853 bytes) 000851 1789608625.555373 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39e0d): Mirror 8: 0x99094e13 (stale) Mirror 10: 0x99094e13 (stale) Mirror 11: 0x99094e13 (stale) Mirror 13: 0x99094e13 (stale) Mirror 14: 0x99094e13 (stale) Mirror 15: 0x99094e13 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39e0d): Mirror 8: 0x99094e13 (stale) Mirror 10: 0x99094e13 (stale) Mirror 11: 0x99094e13 (stale) Mirror 13: 0x99094e13 (stale) Mirror 14: 0x99094e13 (stale) Mirror 15: 0x99094e13 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39e0d: skipped 000852 1789608626.154808 mapwrite 0x034dd4 thru 0x03ffff (0xb22c bytes) 000853 1789608626.382905 mapwrite 0x03361a thru 0x03ffff (0xc9e6 bytes) 000854 1789608626.468262 write 0x019e80 thru 0x01b0b1 (0x1232 bytes) 000858 1789608626.496805 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xa403f5a2 (stale) Mirror 11: 0xa403f5a2 (stale) Mirror 13: 0xa403f5a2 (stale) Mirror 14: 0xa403f5a2 (stale) Mirror 15: 0xa403f5a2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xa403f5a2 (stale) Mirror 11: 0xa403f5a2 (stale) Mirror 13: 0xa403f5a2 (stale) Mirror 14: 0xa403f5a2 (stale) Mirror 15: 0xa403f5a2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000859 1789608626.970413 read 0x037820 thru 0x03ffff (0x87e0 bytes) 000861 1789608626.982646 MIRROR_RESYNC 6 mirrors 000862 1789608630.511536 punch from 0x018f3d to 0x01fc18 (0x6cdc bytes) 000863 1789608630.627529 trunc from 0x040000 to 0x017002 (0x28ffd bytes) 000865 1789608630.664248 read 0x00005d thru 0x00ae01 (0xada5 bytes) 000866 1789608630.676023 trunc from 0x017003 to 0x00ade5 (0xc21d bytes) 000868 1789608630.693320 punch from 0x007882 to 0x00ade5 (0x3564 bytes) 000869 1789608630.700099 trunc from 0x00ade6 to 0x033f74 (0x2918f bytes) 000870 1789608630.726438 write 0x014b71 thru 0x01b30d (0x679d bytes) 000872 1789608630.739235 trunc from 0x033f75 to 0x00823c (0x2bd38 bytes) 000873 1789608630.763224 trunc from 0x00823d to 0x005987 (0x28b5 bytes) 000874 1789608630.793609 write 0x01cf14 thru 0x02c9cd (0xfaba bytes) 000875 1789608630.798487 punch from 0x01b4b0 to 0x02b2e2 (0xfe33 bytes) 000877 1789608630.820448 mapwrite 0x02df87 thru 0x02e4a0 (0x51a bytes) 000878 1789608630.902882 trunc from 0x02e4a1 to 0x006d15 (0x2778b bytes) 000879 1789608630.932578 mapread 0x001174 thru 0x006d15 (0x5ba2 bytes) 000880 1789608630.946580 write 0x006b8f thru 0x014d49 (0xe1bb bytes) 000881 1789608630.949687 mapread 0x009a16 thru 0x014d49 (0xb334 bytes) 000882 1789608630.950753 mapwrite 0x03ae16 thru 0x03f61c (0x4807 bytes) 000885 1789608631.040161 write 0x02f5fb thru 0x0319b7 (0x23bd bytes) 000886 1789608631.058796 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3f61d): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f61d): Mirror 8: 0x2a0e589d (stale) Mirror 11: 0x2a0e589d (stale) Mirror 13: 0x2a0e589d (stale) Mirror 14: 0x2a0e589d (stale) Mirror 15: 0x2a0e589d (stale) CRC-32 checksum value for chunk [0, 0x3f61d): Mirror 1: 0x1e835a34 Mirror 16: 0x1e835a34 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f61d: skipped 000887 1789608632.698940 read 0x007239 thru 0x01165b (0xa423 bytes) 000888 1789608632.728379 mapwrite 0x004285 thru 0x007586 (0x3302 bytes) 000889 1789608632.980096 read 0x016cf6 thru 0x023592 (0xc89d bytes) 000891 1789608633.013724 write 0x028ab4 thru 0x03882e (0xfd7b bytes) 000892 1789608633.015894 trunc from 0x03f61d to 0x00cd25 (0x328f7 bytes) 000893 1789608633.072940 mapread 0x006380 thru 0x00cd25 (0x69a6 bytes) 000894 1789608633.077869 write 0x01f083 thru 0x02d265 (0xe1e3 bytes) 000895 1789608633.081912 mapread 0x01a2c6 thru 0x01bfbc (0x1cf7 bytes) 000897 1789608633.096527 punch from 0x0199d5 to 0x01bf54 (0x2580 bytes) 000898 1789608633.116955 mapwrite 0x011479 thru 0x015c03 (0x478b bytes) 000899 1789608633.246449 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d266): Mirror 8: 0xe9ec0d13 (stale) Mirror 11: 0xe9ec0d13 (stale) Mirror 13: 0xe9ec0d13 (stale) Mirror 15: 0xe9ec0d13 (stale) Mirror 16: 0xa4033c6e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d266): Mirror 8: 0xe9ec0d13 (stale) Mirror 11: 0xe9ec0d13 (stale) Mirror 13: 0xe9ec0d13 (stale) Mirror 15: 0xe9ec0d13 (stale) Mirror 16: 0xa4033c6e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d266: skipped 000900 1789608634.059577 read 0x012dd8 thru 0x01bdf7 (0x9020 bytes) 000903 1789608634.077686 punch from 0x0004df to 0x00af5f (0xaa81 bytes) 000904 1789608634.093484 write 0x036643 thru 0x036817 (0x1d5 bytes) 000905 1789608634.094636 mapwrite 0x027770 thru 0x032679 (0xaf0a bytes) 000906 1789608634.208410 read 0x01946a thru 0x019aab (0x642 bytes) 000907 1789608634.209543 punch from 0x011417 to 0x01b4e9 (0xa0d3 bytes) 000908 1789608634.222476 write 0x033724 thru 0x0365ea (0x2ec7 bytes) 000909 1789608634.225376 trunc from 0x036818 to 0x006cd3 (0x2fb44 bytes) 000911 1789608634.248230 write 0x033b85 thru 0x037e74 (0x42f0 bytes) 000912 1789608634.251555 write 0x01478b thru 0x0237df (0xf055 bytes) 000913 1789608634.265909 read 0x0114ed thru 0x01e730 (0xd244 bytes) 000917 1789608634.269742 read 0x006151 thru 0x015817 (0xf6c7 bytes) 000918 1789608634.284033 read 0x015b87 thru 0x019b2e (0x3fa8 bytes) 000919 1789608634.285976 punch from 0x009b72 to 0x01632b (0xc7ba bytes) 000920 1789608634.303082 punch from 0x006998 to 0x014223 (0xd88c bytes) 000921 1789608634.309580 read 0x00e078 thru 0x016764 (0x86ed bytes) 000922 1789608634.321573 mapread 0x005cc3 thru 0x007a42 (0x1d80 bytes) 000924 1789608634.323010 mapread 0x011dfe thru 0x01dde6 (0xbfe9 bytes) 000925 1789608634.326373 punch from 0x0250f8 to 0x0287fd (0x3706 bytes) 000927 1789608634.344482 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x37e75): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37e75): Mirror 8: 0xe632fc49 (stale) Mirror 11: 0xe632fc49 (stale) Mirror 13: 0xe632fc49 (stale) Mirror 15: 0xe632fc49 (stale) Mirror 16: 0x49206294 (stale) CRC-32 checksum value for chunk [0, 0x37e75): Mirror 1: 0x47b87063 Mirror 17: 0x47b87063 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37e75: skipped 000930 1789608636.083813 MIRROR_RESYNC 7 mirrors 000931 1789608638.603634 trunc from 0x037e75 to 0x03e164 (0x62f0 bytes) 000932 1789608638.702954 mapread 0x033c5d thru 0x03e164 (0xa508 bytes) 000933 1789608638.743314 trunc from 0x03e165 to 0x00691a (0x3784a bytes) 000936 1789608638.776306 write 0x01580a thru 0x020baa (0xb3a1 bytes) 000937 1789608638.779342 trunc from 0x020bab to 0x01b0e3 (0x5ac7 bytes) 000938 1789608638.812442 read 0x012904 thru 0x0196ea (0x6de7 bytes) 000939 1789608638.824163 read 0x003316 thru 0x00a266 (0x6f51 bytes) 000941 1789608638.859956 punch from 0x007664 to 0x0100e7 (0x8a84 bytes) 000942 1789608638.917138 trunc from 0x01b0e4 to 0x02b016 (0xff33 bytes) 000943 1789608638.956773 trunc from 0x02b017 to 0x02d103 (0x20ed bytes) 000944 1789608638.990126 mapwrite 0x038fa8 thru 0x03ffff (0x7058 bytes) 000945 1789608639.067705 mapread 0x03723f thru 0x03ffff (0x8dc1 bytes) 000947 1789608639.074328 MIRROR_RESYNC 7 mirrors 000948 1789608641.402887 trunc from 0x040000 to 0x020919 (0x1f6e6 bytes) 000949 1789608641.476942 write 0x01521e thru 0x01b955 (0x6738 bytes) 000950 1789608641.487260 read 0x002534 thru 0x003392 (0xe5f bytes) 000951 1789608641.493692 read 0x01d250 thru 0x020919 (0x36ca bytes) 000952 1789608641.504603 punch from 0x011911 to 0x01fb2b (0xe21b bytes) 000953 1789608641.521972 punch from 0x01975f to 0x020919 (0x71bb bytes) 000955 1789608641.530492 punch from 0x01b053 to 0x020919 (0x58c7 bytes) 000956 1789608641.535471 trunc from 0x02091a to 0x036582 (0x15c69 bytes) 000957 1789608641.562974 punch from 0x01a875 to 0x01edad (0x4539 bytes) 000958 1789608641.569372 mapwrite 0x022ae9 thru 0x02e4c7 (0xb9df bytes) 000959 1789608641.629395 punch from 0x02a6a6 to 0x02d427 (0x2d82 bytes) 000960 1789608641.634782 trunc from 0x036583 to 0x01d3ff (0x19183 bytes) 000962 1789608641.653687 read 0x00308c thru 0x004385 (0x12fa bytes) 000963 1789608641.654661 trunc from 0x01d400 to 0x03562f (0x18230 bytes) 000964 1789608641.670324 trunc from 0x035630 to 0x0098f2 (0x2bd3d bytes) 000965 1789608641.692325 trunc from 0x0098f3 to 0x010288 (0x6996 bytes) 000968 1789608641.721896 write 0x034d7e thru 0x03e8e1 (0x9b64 bytes) 000969 1789608641.723851 mapread 0x02e9fb thru 0x03b878 (0xce7e bytes) 000970 1789608641.737098 punch from 0x01cdfe to 0x01ce70 (0x73 bytes) 000971 1789608641.750898 trunc from 0x03e8e2 to 0x017ba2 (0x26d3f bytes) 000974 1789608641.770362 trunc from 0x017ba3 to 0x009b9e (0xe004 bytes) 000975 1789608641.788457 trunc from 0x009b9f to 0x010206 (0x6668 bytes) 000976 1789608641.803274 mapwrite 0x02a8c4 thru 0x038401 (0xdb3e bytes) 000977 1789608641.957434 punch from 0x02db32 to 0x03823a (0xa709 bytes) 000978 1789608641.964842 read 0x024bdb thru 0x030027 (0xb44d bytes) 000979 1789608641.979092 mapread 0x00fe1c thru 0x01c1d6 (0xc3bb bytes) 000980 1789608641.986819 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38402): Mirror 8: 0xd8ae9cb4 (stale) Mirror 11: 0xd8ae9cb4 (stale) Mirror 13: 0xd8ae9cb4 (stale) Mirror 15: 0xd8ae9cb4 (stale) Mirror 17: 0xd8ae9cb4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38402): Mirror 8: 0xd8ae9cb4 (stale) Mirror 11: 0xd8ae9cb4 (stale) Mirror 13: 0xd8ae9cb4 (stale) Mirror 15: 0xd8ae9cb4 (stale) Mirror 17: 0xd8ae9cb4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38402: skipped 000981 1789608642.515665 read 0x02fcd8 thru 0x038401 (0x872a bytes) 000983 1789608642.534379 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x38402): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38402): Mirror 8: 0xd8ae9cb4 (stale) Mirror 11: 0xd8ae9cb4 (stale) Mirror 13: 0xd8ae9cb4 (stale) Mirror 15: 0xd8ae9cb4 (stale) Mirror 17: 0xd8ae9cb4 (stale) CRC-32 checksum value for chunk [0, 0x38402): Mirror 1: 0x3af85076 Mirror 18: 0x3af85076 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38402: skipped 000986 1789608644.160808 read 0x01edd8 thru 0x02745b (0x8684 bytes) 000992 1789608644.173239 read 0x002c65 thru 0x00fa87 (0xce23 bytes) 000993 1789608644.185878 trunc from 0x038402 to 0x01ffad (0x18454 bytes) 000994 1789608644.281932 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ffae): Mirror 8: 0x6843bd0d (stale) Mirror 11: 0x6843bd0d (stale) Mirror 13: 0x6843bd0d (stale) Mirror 17: 0x6843bd0d (stale) Mirror 18: 0x27b729a9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ffae): Mirror 8: 0x6843bd0d (stale) Mirror 11: 0x6843bd0d (stale) Mirror 13: 0x6843bd0d (stale) Mirror 17: 0x6843bd0d (stale) Mirror 18: 0x27b729a9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ffae: skipped 000997 1789608644.951270 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ffae): Mirror 8: 0x6843bd0d (stale) Mirror 13: 0x6843bd0d (stale) Mirror 17: 0x6843bd0d (stale) Mirror 18: 0x27b729a9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ffae): Mirror 8: 0x6843bd0d (stale) Mirror 13: 0x6843bd0d (stale) Mirror 17: 0x6843bd0d (stale) Mirror 18: 0x27b729a9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ffae: skipped 000999 1789608645.501374 punch from 0x00281b to 0x0123e9 (0xfbcf bytes) All operations completed A-OK!