== sanity-flr test 70a: flr mode fsx test ================ 05:56:50 (1783072610) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 2612 fallocating to largest ever: 0xb51e 000001 1783072612.586452 fallocate 0x0075df thru 0x00b51d (0x3f3f bytes) 000002 1783072612.599247 mapread 0x009371 thru 0x00b51d (0x21ad bytes) 000003 1783072612.634267 read 0x0054c2 thru 0x00b51d (0x605c bytes) truncating to largest ever: 0x1511b 000004 1783072612.636387 trunc from 0x00b51e to 0x01511a (0x9bfd bytes) fallocating to largest ever: 0x196c7 000005 1783072612.659484 fallocate 0x0156fa thru 0x0196c6 (0x3fcd bytes) truncating to largest ever: 0x1f10a 000006 1783072612.667192 trunc from 0x0196c7 to 0x01f109 (0x5a43 bytes) 000009 1783072612.699442 mapwrite 0x0016f9 thru 0x00a424 (0x8d2c bytes) 000011 1783072612.763076 read 0x010908 thru 0x01f109 (0xe802 bytes) 000012 1783072612.778025 read 0x01b690 thru 0x01f109 (0x3a7a bytes) fallocating to largest ever: 0x362da 000013 1783072612.778822 fallocate 0x0280a5 thru 0x0362d9 (0xe235 bytes) 000014 1783072612.793088 mapwrite 0x01c0ae thru 0x01ce18 (0xd6b bytes) 000015 1783072612.816003 trunc from 0x01f10a to 0x028164 (0x905b bytes) 000016 1783072612.841312 read 0x0173fc thru 0x024ff3 (0xdbf8 bytes) 000017 1783072612.857626 mapread 0x00ebbd thru 0x01a847 (0xbc8b bytes) truncating to largest ever: 0x3f8e6 000018 1783072612.861364 trunc from 0x028165 to 0x03f8e5 (0x17781 bytes) 000019 1783072612.884483 mapread 0x030022 thru 0x034048 (0x4027 bytes) 000020 1783072612.905115 mapwrite 0x021818 thru 0x028009 (0x67f2 bytes) 000023 1783072612.953595 mapwrite 0x01eb0a thru 0x02b784 (0xcc7b bytes) 000024 1783072612.989695 write 0x00c988 thru 0x016655 (0x9cce bytes) 000025 1783072613.009321 trunc from 0x016da6 to 0x01e31d (0x7578 bytes) 000026 1783072613.048567 fallocate 0x02ed3a thru 0x03c037 (0xd2fe bytes) 000027 1783072613.060754 trunc from 0x039ec1 to 0x03d685 (0x37c5 bytes) 000028 1783072613.084918 mapwrite 0x01b7a9 thru 0x024510 (0x8d68 bytes) 000029 1783072613.207122 fallocate 0x00824c thru 0x01103f (0x8df4 bytes) 000031 1783072613.236238 write 0x009bc3 thru 0x01730d (0xd74b bytes) 000034 1783072613.261281 MIRROR_EXTEND to 2 mirrors 000035 1783072614.330642 mapread 0x00590b thru 0x006282 (0x978 bytes) 000036 1783072614.388247 mapread 0x03e3f5 thru 0x03f8e5 (0x14f1 bytes) 000037 1783072614.426071 mapwrite 0x028454 thru 0x02c681 (0x422e bytes) 000038 1783072614.640668 mapwrite 0x008182 thru 0x00c595 (0x4414 bytes) 000040 1783072614.683968 write 0x02e39d thru 0x03221a (0x3e7e bytes) 000041 1783072614.697634 read 0x019974 thru 0x021577 (0x7c04 bytes) 000043 1783072614.719012 write 0x03ac6f thru 0x03af97 (0x329 bytes) 000044 1783072614.728967 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) 000045 1783072615.014093 punch from 0x0315b7 to 0x03f8e5 (0xe32f bytes) 000046 1783072615.022284 write 0x0069c0 thru 0x00e1f5 (0x7836 bytes) 000047 1783072615.049416 trunc from 0x03ea4e to 0x03f8e5 (0xe98 bytes) 000049 1783072615.056489 read 0x01558a thru 0x01f4d5 (0x9f4c bytes) 000050 1783072615.072038 mapwrite 0x039d33 thru 0x03a9a0 (0xc6e bytes) 000051 1783072615.106268 trunc from 0x031db3 to 0x03cbb8 (0xae06 bytes) 000052 1783072615.120713 write 0x004f45 thru 0x007c11 (0x2ccd bytes) 000053 1783072615.136470 fallocate 0x00a39b thru 0x00b44f (0x10b5 bytes) 000054 1783072615.151593 punch from 0x017955 to 0x01e33a (0x69e6 bytes) 000057 1783072615.160417 mapwrite 0x025ef0 thru 0x02eb75 (0x8c86 bytes) 000059 1783072615.253503 write 0x00c74c thru 0x0158ea (0x919f bytes) 000060 1783072615.256684 mapread 0x0126fa thru 0x018831 (0x6138 bytes) 000061 1783072615.272097 mapwrite 0x023a97 thru 0x025398 (0x1902 bytes) 000062 1783072615.308145 mapread 0x0158be thru 0x020af0 (0xb233 bytes) 000064 1783072615.326750 mapread 0x037f5a thru 0x039db6 (0x1e5d bytes) 000065 1783072615.367288 fallocate 0x021a1f thru 0x026b0f (0x50f1 bytes) 000066 1783072615.382294 fallocate 0x028ccd thru 0x038780 (0xfab4 bytes) 000069 1783072615.414872 punch from 0x02e914 to 0x03d331 (0xea1e bytes) 000070 1783072615.434229 trunc from 0x03f8e6 to 0x02e888 (0x1105d bytes) 000071 1783072615.531569 trunc from 0x011b45 to 0x01ab48 (0x9004 bytes) 000072 1783072615.550279 trunc from 0x02e889 to 0x017a78 (0x16e10 bytes) 000073 1783072615.598993 mapwrite 0x032e61 thru 0x03e945 (0xbae5 bytes) 000075 1783072615.737211 mapwrite 0x027159 thru 0x031e01 (0xaca9 bytes) 000076 1783072615.787407 write 0x001ad8 thru 0x00bcd8 (0xa201 bytes) 000077 1783072615.795524 fallocate 0x010590 thru 0x012b8c (0x25fd bytes) 000078 1783072615.813545 mapread 0x0311cc thru 0x03ab4b (0x9980 bytes) 000080 1783072615.819364 fallocate 0x02bc85 thru 0x0325cd (0x6949 bytes) 000082 1783072615.843644 read 0x0256a2 thru 0x0261e3 (0xb42 bytes) 000083 1783072615.844625 trunc from 0x03e946 to 0x0233ef (0x1b556 bytes) 000084 1783072615.891190 read 0x019281 thru 0x0233ef (0xa16f bytes) 000085 1783072615.942644 trunc from 0x01bb91 to 0x01ccba (0x112a bytes) 000086 1783072615.954342 write 0x018770 thru 0x0225ce (0x9e5f bytes) 000087 1783072615.962886 punch from 0x0101db to 0x016c0e (0x6a34 bytes) 000088 1783072615.994117 fallocate 0x00fb79 thru 0x018144 (0x85cc bytes) 000090 1783072616.012127 trunc from 0x014723 to 0x01f9c4 (0xb2a2 bytes) 000091 1783072616.047631 trunc from 0x014a8a to 0x01f187 (0xa6fe bytes) 000092 1783072616.092102 trunc from 0x01ec25 to 0x0233ef (0x47cb bytes) 000094 1783072616.109006 mapwrite 0x00e3c4 thru 0x018aee (0xa72b bytes) 000095 1783072616.246153 mapread 0x00f14b thru 0x00f2e8 (0x19e bytes) 000096 1783072616.247292 trunc from 0x0233f0 to 0x021359 (0x2096 bytes) 000097 1783072616.279650 read 0x018d1f thru 0x021359 (0x863b bytes) 000098 1783072616.302298 mapread 0x00add6 thru 0x012bfd (0x7e28 bytes) 000099 1783072616.306299 mapread 0x00d940 thru 0x01a4e1 (0xcba2 bytes) 000100 1783072616.310621 mapwrite 0x021ab1 thru 0x030579 (0xeac9 bytes) 000101 1783072616.402600 read 0x02f6d1 thru 0x030579 (0xea9 bytes) 000102 1783072616.408506 mapread 0x005946 thru 0x00f186 (0x9841 bytes) 000105 1783072616.420903 fallocate 0x012629 thru 0x01f4fc (0xced4 bytes) 000106 1783072616.446341 fallocate 0x005ed5 thru 0x007f39 (0x2065 bytes) 000107 1783072616.463134 MIRROR_EXTEND to 2 mirrors 000108 1783072617.597182 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) 000109 1783072617.820906 mapread 0x01d13e thru 0x02a499 (0xd35c bytes) 000111 1783072617.884851 trunc from 0x03057a to 0x008215 (0x28364 bytes) 000112 1783072617.950864 mapread 0x0047fd thru 0x007582 (0x2d86 bytes) 000113 1783072617.978324 mapread 0x001c34 thru 0x008215 (0x65e2 bytes) 000114 1783072617.980675 mapwrite 0x010139 thru 0x01e086 (0xdf4e bytes) 000115 1783072618.075394 fallocate 0x02ca65 thru 0x02ec6b (0x2207 bytes) 000116 1783072618.081320 punch from 0x025650 to 0x0293e6 (0x3d97 bytes) 000117 1783072618.087391 read 0x02c06e thru 0x02ec6b (0x2bfe bytes) 000118 1783072618.096265 trunc from 0x02ec6c to 0x03762d (0x89c2 bytes) 000119 1783072618.119055 read 0x036b2f thru 0x03762d (0xaff bytes) 000120 1783072618.134374 mapread 0x022a0a thru 0x023dc5 (0x13bc bytes) 000121 1783072618.135650 trunc from 0x03762e to 0x01ba94 (0x1bb99 bytes) 000122 1783072618.169365 mapwrite 0x028629 thru 0x034f1f (0xc8f7 bytes) 000125 1783072618.318201 MIRROR_EXTEND to 2 mirrors 000126 1783072619.297540 MIRROR_RESYNC 2 mirrors 000127 1783072619.819091 MIRROR_EXTEND to 3 mirrors 000128 1783072620.725620 punch from 0x00e4ea to 0x017095 (0x8bac bytes) 000129 1783072620.786529 mapread 0x027313 thru 0x028598 (0x1286 bytes) 000130 1783072620.797983 read 0x0235ef thru 0x023db1 (0x7c3 bytes) 000132 1783072620.809036 mapwrite 0x01f40a thru 0x02863e (0x9235 bytes) 000133 1783072620.848356 fallocate 0x01c0b6 thru 0x02353c (0x7487 bytes) 000134 1783072620.853613 punch from 0x0110bc to 0x015bc1 (0x4b06 bytes) 000135 1783072620.858652 read 0x025c52 thru 0x034a1b (0xedca bytes) 000136 1783072620.876122 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x34f20): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34f20): Mirror 2: 0x4ea0b5cc (stale) Mirror 3: 0x4ea0b5cc (stale) CRC-32 checksum value for chunk [0, 0x34f20): Mirror 1: 0x3c981bd7 Mirror 4: 0x3c981bd7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34f20: skipped 000137 1783072621.897401 mapread 0x029cb9 thru 0x0320bf (0x8407 bytes) 000138 1783072621.965996 mapread 0x002386 thru 0x00c602 (0xa27d bytes) 000140 1783072622.046142 punch from 0x002b37 to 0x00cb65 (0xa02f bytes) 000142 1783072622.131287 trunc from 0x02da38 to 0x02f131 (0x16fa bytes) 000143 1783072622.161191 mapwrite 0x03cfeb thru 0x03ffff (0x3015 bytes) 000144 1783072622.331550 fallocate 0x01b2e0 thru 0x021699 (0x63ba bytes) 000145 1783072622.345626 trunc from 0x040000 to 0x003807 (0x3c7f8 bytes) 000146 1783072622.403848 mapwrite 0x03df77 thru 0x03ffff (0x2089 bytes) 000147 1783072622.509322 fallocate 0x0231f3 thru 0x02a94d (0x775b bytes) 000148 1783072622.534163 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9fa0db8e (stale) Mirror 3: 0x9fa0db8e (stale) Mirror 4: 0xf282ecc0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x355fde53 Mirror 5: 0x355fde53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000149 1783072623.698117 trunc from 0x040000 to 0x01b83f (0x247c0 bytes) 000152 1783072623.795552 punch from 0x004e6a to 0x0050d9 (0x270 bytes) 000154 1783072623.801579 fallocate 0x004776 thru 0x007857 (0x30e2 bytes) 000155 1783072623.807322 punch from 0x011bb4 to 0x019ba7 (0x7ff4 bytes) 000156 1783072623.812072 trunc from 0x01b840 to 0x0086fd (0x13142 bytes) 000157 1783072623.845754 write 0x020461 thru 0x024b0d (0x46ad bytes) 000158 1783072623.847086 mapread 0x02394e thru 0x024b0d (0x11c0 bytes) 000159 1783072623.856214 trunc from 0x01e2cd to 0x022b96 (0x48ca bytes) 000160 1783072623.879150 read 0x0232c6 thru 0x024b0d (0x1848 bytes) 000161 1783072623.880102 fallocate 0x029160 thru 0x02e515 (0x53b6 bytes) 000162 1783072623.885292 punch from 0x010165 to 0x014a9b (0x4937 bytes) 000163 1783072623.890038 mapread 0x00265a thru 0x007493 (0x4e3a bytes) 000165 1783072623.914738 fallocate 0x01e54b thru 0x02078a (0x2240 bytes) 000166 1783072623.924375 trunc from 0x00a127 to 0x00ef89 (0x4e63 bytes) 000167 1783072623.934012 mapwrite 0x0130ae thru 0x0219a7 (0xe8fa bytes) 000168 1783072624.004483 trunc from 0x00b655 to 0x0122b5 (0x6c61 bytes) 000170 1783072624.016183 trunc from 0x024b0e to 0x03ec14 (0x1a107 bytes) 000171 1783072624.060481 mapwrite 0x038199 thru 0x039951 (0x17b9 bytes) 000172 1783072624.100295 read 0x018338 thru 0x02378e (0xb457 bytes) 000173 1783072624.101155 mapwrite 0x0317d9 thru 0x032dc8 (0x15f0 bytes) 000174 1783072624.116655 trunc from 0x017dde to 0x026db3 (0xefd6 bytes) 000175 1783072624.122862 fallocate 0x02645a thru 0x032b3c (0xc6e3 bytes) 000176 1783072624.132297 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ec15): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec15): Mirror 2: 0xd52153f0 (stale) Mirror 3: 0xd52153f0 (stale) Mirror 4: 0x4665783c (stale) Mirror 5: 0x693bace7 (stale) CRC-32 checksum value for chunk [0, 0x3ec15): Mirror 1: 0x7cdde078 Mirror 6: 0x7cdde078 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec15: skipped 000177 1783072625.456110 read 0x0332d7 thru 0x03ded5 (0xabff bytes) 000178 1783072625.476706 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3ec15): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec15): Mirror 2: 0xd52153f0 (stale) Mirror 3: 0xd52153f0 (stale) Mirror 4: 0x4665783c (stale) Mirror 5: 0x693bace7 (stale) CRC-32 checksum value for chunk [0, 0x3ec15): Mirror 1: 0x7cdde078 Mirror 6: 0x7cdde078 Mirror 7: 0x7cdde078 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec15: skipped 000179 1783072627.057761 read 0x01e643 thru 0x02af41 (0xc8ff bytes) 000181 1783072627.074354 trunc from 0x004bab to 0x005f7a (0x13d0 bytes) 000183 1783072627.131176 mapwrite 0x00f247 thru 0x01e655 (0xf40f bytes) 000184 1783072627.226051 write 0x010671 thru 0x012047 (0x19d7 bytes) 000185 1783072627.232351 read 0x03ca6c thru 0x03ec14 (0x21a9 bytes) 000186 1783072627.246653 mapwrite 0x012460 thru 0x015fa7 (0x3b48 bytes) 000187 1783072627.267652 punch from 0x037525 to 0x03a15f (0x2c3b bytes) 000188 1783072627.273696 trunc from 0x02953b to 0x031d6b (0x8831 bytes) 000189 1783072627.279267 punch from 0x00d0cf to 0x018565 (0xb497 bytes) 000190 1783072627.285725 trunc from 0x020d15 to 0x02c78f (0xba7b bytes) 000191 1783072627.291222 read 0x02955b thru 0x03834e (0xedf4 bytes) 000192 1783072627.305027 mapread 0x029b6d thru 0x02e4dc (0x4970 bytes) 000193 1783072627.306486 write 0x03d176 thru 0x03ffff (0x2e8a bytes) 000194 1783072627.309176 punch from 0x031b6e to 0x03c837 (0xacca bytes) 000195 1783072627.315101 mapwrite 0x029e1a thru 0x033b32 (0x9d19 bytes) 000196 1783072627.356421 mapwrite 0x034830 thru 0x03c0bf (0x7890 bytes) 000197 1783072627.447485 fallocate 0x0349d1 thru 0x03e5d3 (0x9c03 bytes) 000198 1783072627.454595 trunc from 0x040000 to 0x038b22 (0x74dd bytes) 000199 1783072627.508234 punch from 0x025fbc to 0x027c49 (0x1c8e bytes) 000200 1783072627.514638 read 0x02b375 thru 0x02e084 (0x2d10 bytes) 000201 1783072627.516404 mapwrite 0x01b92e thru 0x025f19 (0xa5ec bytes) 000202 1783072627.547417 mapwrite 0x0067e5 thru 0x008992 (0x21ae bytes) 000203 1783072627.563259 read 0x01c524 thru 0x023215 (0x6cf2 bytes) 000205 1783072627.565869 read 0x02d3e7 thru 0x038b22 (0xb73c bytes) 000207 1783072627.568493 trunc from 0x038b23 to 0x02f4ce (0x9654 bytes) 000208 1783072627.592524 fallocate 0x02af60 thru 0x0378f4 (0xc995 bytes) 000209 1783072627.604289 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x378f5): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x378f5): Mirror 2: 0x51d4a178 (stale) Mirror 3: 0x51d4a178 (stale) Mirror 4: 0x4d722c0 (stale) Mirror 5: 0x837c8be7 (stale) Mirror 6: 0xe74dbc4e (stale) Mirror 7: 0xe74dbc4e (stale) CRC-32 checksum value for chunk [0, 0x378f5): Mirror 1: 0x823254de Mirror 8: 0x823254de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x378f5: skipped 000210 1783072629.468959 mapread 0x026ac2 thru 0x02c324 (0x5863 bytes) 000211 1783072629.535170 punch from 0x00f020 to 0x0182ff (0x92e0 bytes) 000212 1783072629.592023 mapwrite 0x02f7cb thru 0x038719 (0x8f4f bytes) 000213 1783072629.703632 punch from 0x00ab1c to 0x01a968 (0xfe4d bytes) 000214 1783072629.710508 mapread 0x01160e thru 0x014000 (0x29f3 bytes) 000215 1783072629.731859 read 0x021b4f thru 0x029fec (0x849e bytes) 000216 1783072629.748929 read 0x025e1d thru 0x033ed0 (0xe0b4 bytes) 000219 1783072629.762903 mapread 0x02728e thru 0x02f6b0 (0x8423 bytes) 000220 1783072629.778612 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3871a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3871a): Mirror 2: 0xf05e1716 (stale) Mirror 3: 0xf05e1716 (stale) Mirror 4: 0xed24b15d (stale) Mirror 5: 0x6d5417ba (stale) Mirror 6: 0x4f3087b6 (stale) Mirror 7: 0x4f3087b6 (stale) Mirror 8: 0x698a0cec (stale) CRC-32 checksum value for chunk [0, 0x3871a): Mirror 1: 0x6a7bed85 Mirror 9: 0x6a7bed85 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3871a: skipped 000221 1783072631.331164 fallocate 0x0181fa thru 0x021e89 (0x9c90 bytes) 000222 1783072631.429225 write 0x0003cd thru 0x00b7fc (0xb430 bytes) 000223 1783072631.479025 punch from 0x0085d6 to 0x0136e8 (0xb113 bytes) 000224 1783072631.495027 trunc from 0x03871a to 0x03c427 (0x3d0e bytes) 000225 1783072631.528468 punch from 0x0038d0 to 0x008e0d (0x553e bytes) 000226 1783072631.536019 trunc from 0x03c428 to 0x026d27 (0x15700 bytes) 000227 1783072631.561246 write 0x029c80 thru 0x02f93d (0x5cbe bytes) 000228 1783072631.565420 trunc from 0x01e288 to 0x027f16 (0x9c8f bytes) 000229 1783072631.575907 punch from 0x01d262 to 0x020d62 (0x3b01 bytes) 000230 1783072631.584568 mapwrite 0x013082 thru 0x01ebde (0xbb5d bytes) 000231 1783072631.633695 mapwrite 0x02205d thru 0x0308cc (0xe870 bytes) 000232 1783072631.694680 write 0x018463 thru 0x0240c8 (0xbc66 bytes) 000233 1783072631.700329 mapread 0x022f3a thru 0x02b713 (0x87da bytes) 000234 1783072631.707438 trunc from 0x010d58 to 0x01f779 (0xea22 bytes) 000235 1783072631.747289 read 0x014f09 thru 0x01f499 (0xa591 bytes) 000236 1783072631.784707 write 0x026fb9 thru 0x02bc64 (0x4cac bytes) 000237 1783072631.787727 trunc from 0x0308cd to 0x027edf (0x89ed bytes) fallocating to largest ever: 0x40000 000238 1783072631.833161 fallocate 0x03f180 thru 0x03ffff (0xe80 bytes) 000239 1783072631.842131 mapwrite 0x02e98c thru 0x030351 (0x19c6 bytes) 000240 1783072631.897511 mapwrite 0x0095f6 thru 0x0136d0 (0xa0db bytes) 000241 1783072631.964982 trunc from 0x030352 to 0x016b4e (0x19803 bytes) 000242 1783072631.982477 write 0x017e33 thru 0x02159b (0x9769 bytes) 000243 1783072631.985750 mapread 0x0044bb thru 0x012d59 (0xe89f bytes) 000244 1783072631.987975 trunc from 0x02159c to 0x03ec6b (0x1d6d0 bytes) 000245 1783072632.008359 read 0x00e2b9 thru 0x01788e (0x95d6 bytes) 000246 1783072632.015143 write 0x03646d thru 0x03ffff (0x9b93 bytes) 000249 1783072632.036416 mapread 0x010b34 thru 0x01fdf0 (0xf2bd bytes) 000250 1783072632.047237 MIRROR_RESYNC 9 mirrors 000251 1783072634.731530 read 0x01d261 thru 0x0239d2 (0x6772 bytes) 000252 1783072634.748765 MIRROR_RESYNC 9 mirrors 000253 1783072635.727087 read 0x02ba17 thru 0x034d5e (0x9348 bytes) 000254 1783072635.750098 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) 000255 1783072636.361188 mapwrite 0x03f232 thru 0x03ffff (0xdce bytes) 000256 1783072636.540677 trunc from 0x00ab7a to 0x011e05 (0x728c bytes) 000257 1783072636.565629 read 0x024e3f thru 0x028e1c (0x3fde bytes) 000258 1783072636.588465 trunc from 0x040000 to 0x02301e (0x1cfe1 bytes) 000259 1783072636.651273 mapread 0x020912 thru 0x02301e (0x270d bytes) 000261 1783072636.690903 trunc from 0x0102f7 to 0x0194eb (0x91f5 bytes) 000262 1783072636.710210 fallocate 0x03096b thru 0x039d72 (0x9408 bytes) 000263 1783072636.719175 punch from 0x007868 to 0x009f69 (0x2702 bytes) 000264 1783072636.735093 trunc from 0x02301f to 0x022b3e (0x4e0 bytes) 000265 1783072636.770669 fallocate 0x0084ee thru 0x00b74e (0x3261 bytes) 000266 1783072636.781899 write 0x03cf73 thru 0x03ffff (0x308d bytes) 000267 1783072636.787017 read 0x03bf1e thru 0x03ca03 (0xae6 bytes) 000268 1783072636.810928 write 0x01ac61 thru 0x0269c5 (0xbd65 bytes) 000269 1783072636.816297 fallocate 0x003956 thru 0x011041 (0xd6ec bytes) 000270 1783072636.829001 mapwrite 0x004569 thru 0x0097b0 (0x5248 bytes) 000272 1783072636.876860 trunc from 0x040000 to 0x03cfaa (0x3055 bytes) 000273 1783072636.902046 punch from 0x01556d to 0x022e0c (0xd8a0 bytes) 000274 1783072636.908502 trunc from 0x00e054 to 0x01af94 (0xcf41 bytes) 000275 1783072636.919402 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3cfab): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cfab): Mirror 2: 0xdaffa358 (stale) Mirror 3: 0xdaffa358 (stale) Mirror 4: 0xdaffa358 (stale) Mirror 6: 0xdaffa358 (stale) Mirror 7: 0xdaffa358 (stale) Mirror 8: 0xdaffa358 (stale) Mirror 9: 0xdaffa358 (stale) CRC-32 checksum value for chunk [0, 0x3cfab): Mirror 1: 0xfd3759f3 Mirror 10: 0xfd3759f3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cfab: skipped 000276 1783072638.407450 punch from 0x023b14 to 0x028bcc (0x50b9 bytes) 000277 1783072638.510414 punch from 0x01f0a1 to 0x02d27e (0xe1de bytes) 000279 1783072638.556557 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3cfab): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cfab): Mirror 2: 0xdaffa358 (stale) Mirror 3: 0xdaffa358 (stale) Mirror 4: 0xdaffa358 (stale) Mirror 6: 0xdaffa358 (stale) Mirror 7: 0xdaffa358 (stale) Mirror 8: 0xdaffa358 (stale) Mirror 9: 0xdaffa358 (stale) Mirror 10: 0xfd3759f3 (stale) CRC-32 checksum value for chunk [0, 0x3cfab): Mirror 1: 0xd2d7dc23 Mirror 11: 0xd2d7dc23 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cfab: skipped 000280 1783072640.075318 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3cfab): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cfab): Mirror 2: 0xdaffa358 (stale) Mirror 3: 0xdaffa358 (stale) Mirror 4: 0xdaffa358 (stale) Mirror 6: 0xdaffa358 (stale) Mirror 7: 0xdaffa358 (stale) Mirror 8: 0xdaffa358 (stale) Mirror 9: 0xdaffa358 (stale) Mirror 10: 0xfd3759f3 (stale) CRC-32 checksum value for chunk [0, 0x3cfab): Mirror 1: 0xd2d7dc23 Mirror 11: 0xd2d7dc23 Mirror 12: 0xd2d7dc23 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cfab: skipped 000281 1783072641.381207 write 0x0335f9 thru 0x03da9e (0xa4a6 bytes) 000282 1783072641.447412 mapread 0x016bc8 thru 0x018a7c (0x1eb5 bytes) 000283 1783072641.470306 mapread 0x036899 thru 0x0398e0 (0x3048 bytes) 000284 1783072641.471379 write 0x000783 thru 0x007805 (0x7083 bytes) 000286 1783072641.488965 write 0x03c9f3 thru 0x03ffff (0x360d bytes) 000287 1783072641.490208 mapread 0x00f22b thru 0x01c479 (0xd24f bytes) 000288 1783072641.500031 punch from 0x01ab6d to 0x02088f (0x5d23 bytes) 000289 1783072641.510168 trunc from 0x0359fb to 0x03c1db (0x67e1 bytes) 000291 1783072641.564964 trunc from 0x040000 to 0x02ae1e (0x151e1 bytes) 000292 1783072641.609507 read 0x00f947 thru 0x01b488 (0xbb42 bytes) 000293 1783072641.616398 mapwrite 0x014f24 thru 0x017bf6 (0x2cd3 bytes) 000294 1783072641.640050 fallocate 0x031c0c thru 0x03ffff (0xe3f4 bytes) 000295 1783072641.645331 write 0x00a711 thru 0x00f713 (0x5003 bytes) 000296 1783072641.646504 write 0x02402b thru 0x02f89e (0xb874 bytes) 000297 1783072641.653543 write 0x00d41c thru 0x01a704 (0xd2e9 bytes) 000298 1783072641.655053 trunc from 0x02f89f to 0x016f02 (0x1899c bytes) 000299 1783072641.675129 mapread 0x004276 thru 0x00b5d2 (0x735d bytes) 000300 1783072641.681218 MIRROR_SPLIT mirror 4 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16f03): Mirror 2: 0x56a6a2fa (stale) Mirror 3: 0x56a6a2fa (stale) Mirror 4: 0x56a6a2fa (stale) Mirror 7: 0x56a6a2fa (stale) Mirror 8: 0x56a6a2fa (stale) Mirror 9: 0x56a6a2fa (stale) Mirror 10: 0x9d89bfdf (stale) Mirror 11: 0x9d89bfdf (stale) Mirror 12: 0x9d89bfdf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16f03): Mirror 2: 0x56a6a2fa (stale) Mirror 3: 0x56a6a2fa (stale) Mirror 4: 0x56a6a2fa (stale) Mirror 7: 0x56a6a2fa (stale) Mirror 8: 0x56a6a2fa (stale) Mirror 9: 0x56a6a2fa (stale) Mirror 10: 0x9d89bfdf (stale) Mirror 11: 0x9d89bfdf (stale) Mirror 12: 0x9d89bfdf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16f03: skipped 000301 1783072642.237185 read 0x004579 thru 0x0112c5 (0xcd4d bytes) 000302 1783072642.246329 mapread 0x005a27 thru 0x00e6b2 (0x8c8c bytes) 000303 1783072642.247439 fallocate 0x02b12a thru 0x0399c5 (0xe89c bytes) 000305 1783072642.253497 mapwrite 0x03bc3f thru 0x03ffff (0x43c1 bytes) 000306 1783072642.334130 punch from 0x02ff56 to 0x0334d5 (0x3580 bytes) 000307 1783072642.341716 write 0x01b270 thru 0x02a17b (0xef0c bytes) 000308 1783072642.357544 trunc from 0x040000 to 0x035018 (0xafe7 bytes) 000309 1783072642.385470 write 0x00b903 thru 0x019ceb (0xe3e9 bytes) 000310 1783072642.395370 read 0x029bcf thru 0x02f7bf (0x5bf1 bytes) 000311 1783072642.435855 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x35019): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35019): Mirror 2: 0xaeaed66a (stale) Mirror 3: 0xaeaed66a (stale) Mirror 4: 0xaeaed66a (stale) Mirror 7: 0xaeaed66a (stale) Mirror 8: 0xaeaed66a (stale) Mirror 9: 0xaeaed66a (stale) Mirror 10: 0xcb02a05d (stale) Mirror 11: 0xfb997402 (stale) Mirror 12: 0xfb997402 (stale) CRC-32 checksum value for chunk [0, 0x35019): Mirror 1: 0x78196c8c Mirror 13: 0x78196c8c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35019: skipped 000312 1783072644.164992 mapwrite 0x029377 thru 0x02abf1 (0x187b bytes) 000313 1783072644.271602 trunc from 0x004442 to 0x012a3e (0xe5fd bytes) 000314 1783072644.276827 trunc from 0x020511 to 0x020942 (0x432 bytes) 000315 1783072644.287068 fallocate 0x03c35e thru 0x03ffff (0x3ca2 bytes) 000316 1783072644.301629 mapwrite 0x03ea2c thru 0x03ffff (0x15d4 bytes) 000317 1783072644.404290 fallocate 0x01d410 thru 0x0216fa (0x42eb bytes) 000318 1783072644.413817 trunc from 0x040000 to 0x037760 (0x889f bytes) 000320 1783072644.458906 write 0x014277 thru 0x01e668 (0xa3f2 bytes) 000321 1783072644.491328 mapread 0x02592b thru 0x032ae0 (0xd1b6 bytes) 000322 1783072644.502727 fallocate 0x038662 thru 0x03ffff (0x799e bytes) 000323 1783072644.512724 mapread 0x00c513 thru 0x00f2c8 (0x2db6 bytes) 000324 1783072644.545231 read 0x037790 thru 0x03c807 (0x5078 bytes) 000325 1783072644.578900 mapwrite 0x01052c thru 0x015fb5 (0x5a8a bytes) 000326 1783072644.618660 trunc from 0x040000 to 0x0103e6 (0x2fc19 bytes) 000327 1783072644.664725 punch from 0x004e33 to 0x0103e6 (0xb5b4 bytes) 000328 1783072644.685086 write 0x01e51f thru 0x027a28 (0x950a bytes) 000329 1783072644.694083 mapread 0x0165dc thru 0x021c64 (0xb689 bytes) 000330 1783072644.716172 trunc from 0x01e4b2 to 0x027a28 (0x9577 bytes) 000331 1783072644.763420 fallocate 0x02a260 thru 0x02cd1e (0x2abf bytes) 000332 1783072644.784503 read 0x0296f2 thru 0x02cd1e (0x362d bytes) 000333 1783072644.815417 trunc from 0x02cd1f to 0x03dfd8 (0x112ba bytes) 000334 1783072644.840464 mapwrite 0x015ade thru 0x020cd6 (0xb1f9 bytes) 000336 1783072644.890993 read 0x0117ee thru 0x018a8a (0x729d bytes) 000337 1783072644.893401 fallocate 0x018b4b thru 0x020b25 (0x7fdb bytes) 000338 1783072644.908517 punch from 0x010977 to 0x020569 (0xfbf3 bytes) 000339 1783072644.916352 read 0x01b3ee thru 0x02746b (0xc07e bytes) 000340 1783072644.956244 read 0x019e34 thru 0x023a7f (0x9c4c bytes) 000341 1783072644.957160 read 0x002a51 thru 0x00401b (0x15cb bytes) 000342 1783072644.961572 fallocate 0x017d69 thru 0x01ab86 (0x2e1e bytes) 000343 1783072644.976642 trunc from 0x03db0a to 0x03dfd8 (0x4cf bytes) 000344 1783072644.987955 mapwrite 0x02dabe thru 0x0389c6 (0xaf09 bytes) 000345 1783072645.037090 read 0x0217a7 thru 0x02ba69 (0xa2c3 bytes) 000346 1783072645.040632 trunc from 0x02f628 to 0x034a4b (0x5424 bytes) 000347 1783072645.051925 trunc from 0x03dfd9 to 0x02c9d0 (0x11608 bytes) 000348 1783072645.084484 fallocate 0x023dac thru 0x030fa2 (0xd1f7 bytes) 000349 1783072645.101638 punch from 0x01c418 to 0x02be74 (0xfa5d bytes) 000350 1783072645.109859 write 0x0207fc thru 0x022f9c (0x27a1 bytes) 000351 1783072645.136485 fallocate 0x0141b8 thru 0x014436 (0x27f bytes) 000352 1783072645.146143 read 0x008faf thru 0x0116dd (0x872f bytes) 000353 1783072645.146927 trunc from 0x021582 to 0x02ad96 (0x9815 bytes) 000354 1783072645.187407 mapwrite 0x0282f3 thru 0x03451d (0xc22b bytes) 000355 1783072645.287105 read 0x02311a thru 0x027e42 (0x4d29 bytes) 000356 1783072645.288441 trunc from 0x03451e to 0x02d631 (0x6eec bytes) 000358 1783072645.317056 mapread 0x00a988 thru 0x013fe8 (0x9661 bytes) 000359 1783072645.318608 trunc from 0x0201ea to 0x02760a (0x7421 bytes) 000360 1783072645.328533 write 0x033b9e thru 0x03aa07 (0x6e6a bytes) 000361 1783072645.334715 read 0x010285 thru 0x0200a1 (0xfe1d bytes) 000362 1783072645.345386 trunc from 0x03aa08 to 0x029946 (0x110c1 bytes) 000363 1783072645.377757 write 0x00ab59 thru 0x0110d1 (0x6579 bytes) 000364 1783072645.379057 read 0x00893d thru 0x017d93 (0xf457 bytes) 000365 1783072645.380552 read 0x0161a4 thru 0x0189d9 (0x2836 bytes) 000366 1783072645.381709 read 0x016d05 thru 0x01aff7 (0x42f3 bytes) 000367 1783072645.382566 mapread 0x00ba12 thru 0x01a254 (0xe843 bytes) 000368 1783072645.385493 punch from 0x001f75 to 0x0061f3 (0x427f bytes) 000370 1783072645.392938 mapwrite 0x00253c thru 0x00271e (0x1e3 bytes) 000371 1783072645.420298 trunc from 0x0267ed to 0x029946 (0x315a bytes) 000372 1783072645.430262 trunc from 0x029947 to 0x03ca7a (0x13134 bytes) 000373 1783072645.482352 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3ca7b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ca7b): Mirror 2: 0xa2f5d8a6 (stale) Mirror 3: 0xa2f5d8a6 (stale) Mirror 4: 0xa2f5d8a6 (stale) Mirror 7: 0xa2f5d8a6 (stale) Mirror 8: 0xa2f5d8a6 (stale) Mirror 9: 0xa2f5d8a6 (stale) Mirror 10: 0x7f53d856 (stale) Mirror 11: 0xa4e1d16c (stale) Mirror 12: 0xa4e1d16c (stale) Mirror 13: 0x35f93835 (stale) CRC-32 checksum value for chunk [0, 0x3ca7b): Mirror 1: 0x288006e0 Mirror 14: 0x288006e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ca7b: skipped 000374 1783072647.427864 read 0x01a83a thru 0x01ac85 (0x44c bytes) 000375 1783072647.444206 fallocate 0x013345 thru 0x01ea96 (0xb752 bytes) 000377 1783072647.512933 trunc from 0x01f56e to 0x02d7b5 (0xe248 bytes) 000378 1783072647.521730 write 0x03a9da thru 0x03ffff (0x5626 bytes) 000379 1783072647.538301 read 0x02db23 thru 0x031548 (0x3a26 bytes) 000381 1783072647.557657 punch from 0x0384e7 to 0x03ffff (0x7b19 bytes) 000382 1783072647.589566 mapwrite 0x003f4a thru 0x00bc51 (0x7d08 bytes) 000383 1783072647.651144 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc164120e (stale) Mirror 4: 0xc164120e (stale) Mirror 7: 0xc164120e (stale) Mirror 8: 0xc164120e (stale) Mirror 9: 0xc164120e (stale) Mirror 10: 0x2f05943f (stale) Mirror 11: 0x9a66f269 (stale) Mirror 12: 0x9a66f269 (stale) Mirror 13: 0xc58fc2d9 (stale) Mirror 14: 0x39ff6698 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc164120e (stale) Mirror 4: 0xc164120e (stale) Mirror 7: 0xc164120e (stale) Mirror 8: 0xc164120e (stale) Mirror 9: 0xc164120e (stale) Mirror 10: 0x2f05943f (stale) Mirror 11: 0x9a66f269 (stale) Mirror 12: 0x9a66f269 (stale) Mirror 13: 0xc58fc2d9 (stale) Mirror 14: 0x39ff6698 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000384 1783072648.423603 mapwrite 0x01359c thru 0x016af5 (0x355a bytes) 000385 1783072648.461848 mapwrite 0x03e888 thru 0x03ffff (0x1778 bytes) 000386 1783072648.497301 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc164120e (stale) Mirror 4: 0xc164120e (stale) Mirror 7: 0xc164120e (stale) Mirror 8: 0xc164120e (stale) Mirror 9: 0xc164120e (stale) Mirror 10: 0x2f05943f (stale) Mirror 11: 0x9a66f269 (stale) Mirror 12: 0x9a66f269 (stale) Mirror 13: 0xc58fc2d9 (stale) Mirror 14: 0x39ff6698 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5951ed7c Mirror 15: 0x5951ed7c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000387 1783072649.866006 trunc from 0x0312eb to 0x03214b (0xe61 bytes) 000388 1783072649.916466 write 0x02b804 thru 0x038bcc (0xd3c9 bytes) 000389 1783072649.943566 fallocate 0x01ac66 thru 0x01db86 (0x2f21 bytes) 000390 1783072649.949610 mapwrite 0x02892a thru 0x02fe9d (0x7574 bytes) 000391 1783072650.003433 trunc from 0x040000 to 0x03ab97 (0x5468 bytes) 000392 1783072650.035425 mapwrite 0x014bdf thru 0x023fd0 (0xf3f2 bytes) 000393 1783072650.104568 fallocate 0x00d246 thru 0x019680 (0xc43b bytes) 000394 1783072650.111361 fallocate 0x015b91 thru 0x01d393 (0x7803 bytes) 000395 1783072650.116707 punch from 0x0301fe to 0x03ab97 (0xa99a bytes) 000396 1783072650.122099 trunc from 0x03ab98 to 0x03d0ae (0x2517 bytes) 000397 1783072650.155462 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3d0af): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d0af): Mirror 3: 0x79eb27b0 (stale) Mirror 4: 0x79eb27b0 (stale) Mirror 7: 0x79eb27b0 (stale) Mirror 8: 0x79eb27b0 (stale) Mirror 9: 0x79eb27b0 (stale) Mirror 10: 0xea204845 (stale) Mirror 11: 0x5c1d4eac (stale) Mirror 12: 0x5c1d4eac (stale) Mirror 13: 0xcc08b0d5 (stale) Mirror 14: 0x51a0c190 (stale) Mirror 15: 0x7c72637c (stale) CRC-32 checksum value for chunk [0, 0x3d0af): Mirror 1: 0x73734540 Mirror 16: 0x73734540 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d0af: skipped 000398 1783072651.698687 mapwrite 0x01d007 thru 0x027fdc (0xafd6 bytes) 000400 1783072651.941198 fallocate 0x038885 thru 0x03ffff (0x777b bytes) 000401 1783072651.955656 mapwrite 0x02f95c thru 0x032cbb (0x3360 bytes) 000402 1783072652.008731 mapwrite 0x0158d9 thru 0x01fa12 (0xa13a bytes) 000403 1783072652.057752 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3d0af): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d0af): Mirror 3: 0x79eb27b0 (stale) Mirror 4: 0x79eb27b0 (stale) Mirror 7: 0x79eb27b0 (stale) Mirror 8: 0x79eb27b0 (stale) Mirror 9: 0x79eb27b0 (stale) Mirror 10: 0xea204845 (stale) Mirror 11: 0x5c1d4eac (stale) Mirror 12: 0x5c1d4eac (stale) Mirror 13: 0xcc08b0d5 (stale) Mirror 14: 0x51a0c190 (stale) Mirror 15: 0x7c72637c (stale) Mirror 16: 0x73734540 (stale) CRC-32 checksum value for chunk [0, 0x3d0af): Mirror 1: 0xfb2b3282 Mirror 17: 0xfb2b3282 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d0af: skipped 000404 1783072653.357403 read 0x032bd8 thru 0x03d0ae (0xa4d7 bytes) 000405 1783072653.379885 fallocate 0x006ea4 thru 0x00fd65 (0x8ec2 bytes) 000406 1783072653.444142 trunc from 0x03d0af to 0x00cd2b (0x30383 bytes) 000407 1783072653.524560 write 0x03ddd1 thru 0x03fd31 (0x1f61 bytes) 000408 1783072653.526024 trunc from 0x02b427 to 0x02f8d2 (0x44ac bytes) 000409 1783072653.539884 trunc from 0x03fd32 to 0x004d75 (0x3afbc bytes) 000410 1783072653.584595 MIRROR_RESYNC 14 mirrors 000411 1783072655.597288 trunc from 0x004d76 to 0x033d22 (0x2efad bytes) 000412 1783072655.684095 fallocate 0x01e228 thru 0x02d453 (0xf22c bytes) 000413 1783072655.706054 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x33d23): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33d23): Mirror 3: 0x36d179ac (stale) Mirror 4: 0x36d179ac (stale) Mirror 7: 0x36d179ac (stale) Mirror 8: 0x36d179ac (stale) Mirror 9: 0x36d179ac (stale) Mirror 10: 0x36d179ac (stale) Mirror 11: 0x36d179ac (stale) Mirror 12: 0x36d179ac (stale) Mirror 13: 0x36d179ac (stale) Mirror 14: 0x36d179ac (stale) Mirror 15: 0x36d179ac (stale) Mirror 16: 0x36d179ac (stale) Mirror 17: 0x36d179ac (stale) CRC-32 checksum value for chunk [0, 0x33d23): Mirror 1: 0x36d179ac Mirror 18: 0x36d179ac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33d23: skipped 000414 1783072657.375820 mapwrite 0x0025b5 thru 0x002819 (0x265 bytes) 000415 1783072657.503301 trunc from 0x033d23 to 0x00895c (0x2b3c6 bytes) 000416 1783072657.544548 read 0x005cf8 thru 0x00895c (0x2c65 bytes) 000417 1783072657.551198 mapread 0x0041f2 thru 0x007ae7 (0x38f6 bytes) 000419 1783072657.579463 MIRROR_SPLIT mirror 5 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x895d): Mirror 3: 0x3647f377 (stale) Mirror 4: 0x3647f377 (stale) Mirror 7: 0x3647f377 (stale) Mirror 8: 0x3647f377 (stale) Mirror 10: 0x3647f377 (stale) Mirror 11: 0x3647f377 (stale) Mirror 12: 0x3647f377 (stale) Mirror 13: 0x3647f377 (stale) Mirror 14: 0x3647f377 (stale) Mirror 15: 0x3647f377 (stale) Mirror 16: 0x3647f377 (stale) Mirror 17: 0x3647f377 (stale) Mirror 18: 0x3647f377 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x895d): Mirror 3: 0x3647f377 (stale) Mirror 4: 0x3647f377 (stale) Mirror 7: 0x3647f377 (stale) Mirror 8: 0x3647f377 (stale) Mirror 10: 0x3647f377 (stale) Mirror 11: 0x3647f377 (stale) Mirror 12: 0x3647f377 (stale) Mirror 13: 0x3647f377 (stale) Mirror 14: 0x3647f377 (stale) Mirror 15: 0x3647f377 (stale) Mirror 16: 0x3647f377 (stale) Mirror 17: 0x3647f377 (stale) Mirror 18: 0x3647f377 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x895d: skipped 000420 1783072658.343018 write 0x010c79 thru 0x0158eb (0x4c73 bytes) 000421 1783072658.360691 fallocate 0x00b3c9 thru 0x015319 (0x9f51 bytes) 000422 1783072658.375445 read 0x0065c6 thru 0x014c8e (0xe6c9 bytes) 000423 1783072658.393123 mapread 0x00a775 thru 0x00ca1e (0x22aa bytes) 000424 1783072658.394288 read 0x00bf9b thru 0x01314e (0x71b4 bytes) 000425 1783072658.401567 MIRROR_RESYNC 14 mirrors 000426 1783072661.127458 punch from 0x01534f to 0x0158eb (0x59d bytes) 000427 1783072661.162988 punch from 0x0019e0 to 0x00d12b (0xb74c bytes) 000428 1783072661.169358 read 0x00a7b5 thru 0x013645 (0x8e91 bytes) 000429 1783072661.180125 fallocate 0x000578 thru 0x003062 (0x2aeb bytes) 000430 1783072661.185479 punch from 0x011793 to 0x0158eb (0x4159 bytes) 000432 1783072661.192422 mapread 0x012883 thru 0x0158eb (0x3069 bytes) 000433 1783072661.210684 trunc from 0x0102d8 to 0x0158eb (0x5614 bytes) 000435 1783072661.218110 fallocate 0x002d79 thru 0x00ecdc (0xbf64 bytes) 000436 1783072661.223757 read 0x00ff86 thru 0x0158eb (0x5966 bytes) 000437 1783072661.234815 fallocate 0x01e9f5 thru 0x02dd00 (0xf30c bytes) 000438 1783072661.245240 MIRROR_RESYNC 14 mirrors 000440 1783072664.074961 MIRROR_EXTEND to 15 mirrors 000441 1783072664.922713 mapread 0x014765 thru 0x0158eb (0x1187 bytes) 000442 1783072664.933364 trunc from 0x011db8 to 0x0158eb (0x3b34 bytes) 000443 1783072664.969767 mapread 0x01149b thru 0x013a7e (0x25e4 bytes) 000444 1783072664.985145 trunc from 0x0158ec to 0x03831b (0x22a30 bytes) 000446 1783072665.030276 mapwrite 0x03ad03 thru 0x03ffff (0x52fd bytes) 000447 1783072665.149938 write 0x00bcfa thru 0x0159ff (0x9d06 bytes) 000452 1783072665.160372 trunc from 0x040000 to 0x0115c0 (0x2ea3f bytes) 000453 1783072665.196587 trunc from 0x00718b to 0x0115c0 (0xa436 bytes) 000454 1783072665.233419 punch from 0x009f19 to 0x00c891 (0x2979 bytes) 000455 1783072665.243258 mapwrite 0x00619b thru 0x011a8f (0xb8f5 bytes) 000456 1783072665.320416 fallocate 0x0118d8 thru 0x01de4d (0xc576 bytes) 000458 1783072665.337309 MIRROR_SPLIT mirror 6 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11a90): Mirror 3: 0x33cfe635 (stale) Mirror 4: 0x33cfe635 (stale) Mirror 7: 0x33cfe635 (stale) Mirror 8: 0x33cfe635 (stale) Mirror 10: 0x33cfe635 (stale) Mirror 12: 0x33cfe635 (stale) Mirror 13: 0x33cfe635 (stale) Mirror 14: 0x33cfe635 (stale) Mirror 15: 0x33cfe635 (stale) Mirror 16: 0x33cfe635 (stale) Mirror 17: 0x33cfe635 (stale) Mirror 18: 0x33cfe635 (stale) Mirror 19: 0x33cfe635 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11a90): Mirror 3: 0x33cfe635 (stale) Mirror 4: 0x33cfe635 (stale) Mirror 7: 0x33cfe635 (stale) Mirror 8: 0x33cfe635 (stale) Mirror 10: 0x33cfe635 (stale) Mirror 12: 0x33cfe635 (stale) Mirror 13: 0x33cfe635 (stale) Mirror 14: 0x33cfe635 (stale) Mirror 15: 0x33cfe635 (stale) Mirror 16: 0x33cfe635 (stale) Mirror 17: 0x33cfe635 (stale) Mirror 18: 0x33cfe635 (stale) Mirror 19: 0x33cfe635 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11a90: skipped 000459 1783072666.201570 MIRROR_SPLIT mirror 10 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11a90): Mirror 3: 0x33cfe635 (stale) Mirror 4: 0x33cfe635 (stale) Mirror 7: 0x33cfe635 (stale) Mirror 8: 0x33cfe635 (stale) Mirror 10: 0x33cfe635 (stale) Mirror 12: 0x33cfe635 (stale) Mirror 13: 0x33cfe635 (stale) Mirror 14: 0x33cfe635 (stale) Mirror 15: 0x33cfe635 (stale) Mirror 17: 0x33cfe635 (stale) Mirror 18: 0x33cfe635 (stale) Mirror 19: 0x33cfe635 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11a90): Mirror 3: 0x33cfe635 (stale) Mirror 4: 0x33cfe635 (stale) Mirror 7: 0x33cfe635 (stale) Mirror 8: 0x33cfe635 (stale) Mirror 10: 0x33cfe635 (stale) Mirror 12: 0x33cfe635 (stale) Mirror 13: 0x33cfe635 (stale) Mirror 14: 0x33cfe635 (stale) Mirror 15: 0x33cfe635 (stale) Mirror 17: 0x33cfe635 (stale) Mirror 18: 0x33cfe635 (stale) Mirror 19: 0x33cfe635 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11a90: skipped 000460 1783072666.997466 write 0x016935 thru 0x01ae6d (0x4539 bytes) 000462 1783072667.015948 MIRROR_RESYNC 13 mirrors 000463 1783072670.348723 write 0x02de5d thru 0x0354fd (0x76a1 bytes) 000464 1783072670.421765 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x354fe): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x354fe): Mirror 3: 0x799eea25 (stale) Mirror 4: 0x799eea25 (stale) Mirror 7: 0x799eea25 (stale) Mirror 8: 0x799eea25 (stale) Mirror 10: 0x799eea25 (stale) Mirror 12: 0x799eea25 (stale) Mirror 13: 0x799eea25 (stale) Mirror 14: 0x799eea25 (stale) Mirror 15: 0x799eea25 (stale) Mirror 17: 0x799eea25 (stale) Mirror 18: 0x799eea25 (stale) Mirror 19: 0x799eea25 (stale) CRC-32 checksum value for chunk [0, 0x354fe): Mirror 1: 0x3349c8b8 Mirror 20: 0x3349c8b8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x354fe: skipped 000465 1783072672.100011 punch from 0x029293 to 0x0354fd (0xc26b bytes) 000466 1783072672.144260 trunc from 0x0354fe to 0x0388e5 (0x33e8 bytes) 000467 1783072672.184750 read 0x013691 thru 0x01e449 (0xadb9 bytes) 000468 1783072672.237453 write 0x033afe thru 0x03aa2a (0x6f2d bytes) 000469 1783072672.248018 write 0x00c9ae thru 0x0177f4 (0xae47 bytes) 000470 1783072672.262509 punch from 0x01771c to 0x0193c8 (0x1cad bytes) 000471 1783072672.314661 mapwrite 0x00a39b thru 0x01205d (0x7cc3 bytes) 000472 1783072672.356910 read 0x0120b1 thru 0x014de3 (0x2d33 bytes) 000474 1783072672.358349 mapread 0x02da35 thru 0x03a2a7 (0xc873 bytes) 000475 1783072672.372647 mapwrite 0x0394a4 thru 0x03ffff (0x6b5c bytes) 000476 1783072672.429579 MIRROR_RESYNC 14 mirrors 000477 1783072676.787659 write 0x03b52a thru 0x03ffff (0x4ad6 bytes) 000479 1783072676.878477 write 0x00eb65 thru 0x015b2b (0x6fc7 bytes) 000480 1783072676.919613 read 0x00bf98 thru 0x017a48 (0xbab1 bytes) 000481 1783072676.930692 fallocate 0x0227a7 thru 0x0270f0 (0x494a bytes) 000482 1783072676.962090 MIRROR_RESYNC 14 mirrors 000485 1783072681.474330 fallocate 0x0399f2 thru 0x03ffff (0x660e bytes) 000486 1783072681.549151 write 0x01228f thru 0x016c1e (0x4990 bytes) 000487 1783072681.576410 write 0x02b1bd thru 0x034222 (0x9066 bytes) 000488 1783072681.606396 mapread 0x01ed36 thru 0x022e76 (0x4141 bytes) 000489 1783072681.678302 write 0x0394c8 thru 0x03ffff (0x6b38 bytes) 000490 1783072681.688328 mapread 0x006730 thru 0x00f6c1 (0x8f92 bytes) 000492 1783072681.704282 fallocate 0x0381e6 thru 0x03b5cf (0x33ea bytes) 000493 1783072681.713141 mapwrite 0x01a529 thru 0x01fedc (0x59b4 bytes) 000494 1783072681.741834 punch from 0x033c81 to 0x03e88b (0xac0b bytes) 000495 1783072681.749341 fallocate 0x01eca8 thru 0x02e921 (0xfc7a bytes) 000496 1783072681.759374 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x28afe431 (stale) Mirror 4: 0x28afe431 (stale) Mirror 7: 0x28afe431 (stale) Mirror 8: 0x28afe431 (stale) Mirror 10: 0x28afe431 (stale) Mirror 12: 0x28afe431 (stale) Mirror 13: 0x28afe431 (stale) Mirror 14: 0x28afe431 (stale) Mirror 15: 0x28afe431 (stale) Mirror 17: 0x28afe431 (stale) Mirror 18: 0x28afe431 (stale) Mirror 19: 0x28afe431 (stale) Mirror 20: 0x28afe431 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdc837565 Mirror 21: 0xdc837565 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000497 1783072683.097414 read 0x007cd7 thru 0x00df08 (0x6232 bytes) 000498 1783072683.116415 trunc from 0x040000 to 0x00e329 (0x31cd6 bytes) 000499 1783072683.238628 write 0x0082d6 thru 0x00f592 (0x72bd bytes) 000500 1783072683.257708 read 0x009cb6 thru 0x00f592 (0x58dd bytes) 000502 1783072683.261681 mapwrite 0x01579a thru 0x01f67a (0x9ee1 bytes) 000503 1783072683.355692 trunc from 0x01f67b to 0x03592f (0x162b5 bytes) 000504 1783072683.385483 fallocate 0x02938d thru 0x029b22 (0x796 bytes) 000505 1783072683.391938 fallocate 0x00bc21 thru 0x00cb68 (0xf48 bytes) 000506 1783072683.401413 mapread 0x02ddf4 thru 0x03592f (0x7b3c bytes) 000507 1783072683.418195 punch from 0x031096 to 0x03592f (0x489a bytes) 000508 1783072683.426282 trunc from 0x0089ec to 0x0174b9 (0xeace bytes) 000509 1783072683.434953 mapwrite 0x01bd00 thru 0x01fb68 (0x3e69 bytes) 000510 1783072683.477261 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x35930): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35930): Mirror 3: 0x9a2f7af8 (stale) Mirror 4: 0x9a2f7af8 (stale) Mirror 7: 0x9a2f7af8 (stale) Mirror 8: 0x9a2f7af8 (stale) Mirror 10: 0x9a2f7af8 (stale) Mirror 12: 0x9a2f7af8 (stale) Mirror 13: 0x9a2f7af8 (stale) Mirror 14: 0x9a2f7af8 (stale) Mirror 15: 0x9a2f7af8 (stale) Mirror 17: 0x9a2f7af8 (stale) Mirror 18: 0x9a2f7af8 (stale) Mirror 19: 0x9a2f7af8 (stale) Mirror 20: 0x9a2f7af8 (stale) Mirror 21: 0x14a1bb7e (stale) CRC-32 checksum value for chunk [0, 0x35930): Mirror 1: 0x1dcc4e86 Mirror 22: 0x1dcc4e86 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35930: skipped 000511 1783072685.101196 write 0x0152e4 thru 0x022867 (0xd584 bytes) 000512 1783072685.178275 write 0x02c64b thru 0x02c7b5 (0x16b bytes) 000513 1783072685.188289 read 0x02534e thru 0x02cbfc (0x78af bytes) 000514 1783072685.203750 mapwrite 0x007baa thru 0x016a5a (0xeeb1 bytes) 000516 1783072685.294350 write 0x00d376 thru 0x00fe6c (0x2af7 bytes) 000517 1783072685.298734 read 0x00fb2e thru 0x010b16 (0xfe9 bytes) 000518 1783072685.299555 trunc from 0x00f986 to 0x0122bb (0x2936 bytes) 000521 1783072685.316121 mapwrite 0x024e07 thru 0x0343c0 (0xf5ba bytes) 000522 1783072685.360904 mapwrite 0x0056d2 thru 0x013943 (0xe272 bytes) 000523 1783072685.387080 punch from 0x02d6d7 to 0x03592f (0x8259 bytes) 000524 1783072685.393002 punch from 0x00e1ab to 0x01ba49 (0xd89f bytes) 000525 1783072685.402139 mapwrite 0x0117a8 thru 0x01bb2d (0xa386 bytes) 000526 1783072685.512089 punch from 0x004bd0 to 0x004ef5 (0x326 bytes) 000527 1783072685.523740 write 0x038769 thru 0x03c987 (0x421f bytes) 000528 1783072685.526225 trunc from 0x03c988 to 0x0117dc (0x2b1ab bytes) 000529 1783072685.555272 write 0x004261 thru 0x011996 (0xd736 bytes) 000530 1783072685.561211 trunc from 0x011723 to 0x011996 (0x274 bytes) 000531 1783072685.593130 write 0x03654a thru 0x03bebb (0x5972 bytes) 000532 1783072685.594606 fallocate 0x018f36 thru 0x01eaa5 (0x5b70 bytes) 000533 1783072685.607032 trunc from 0x03bebc to 0x02a01b (0x11ea0 bytes) 000534 1783072685.644210 trunc from 0x02a01c to 0x02ddd0 (0x3db5 bytes) 000536 1783072685.687196 punch from 0x02b759 to 0x02ddd0 (0x2678 bytes) 000537 1783072685.696818 fallocate 0x0137b7 thru 0x0148ba (0x1104 bytes) 000538 1783072685.704261 fallocate 0x00faee thru 0x0155ee (0x5b01 bytes) 000539 1783072685.711355 mapwrite 0x03e2c1 thru 0x03ffff (0x1d3f bytes) 000540 1783072685.768191 mapwrite 0x034f52 thru 0x03e30c (0x93bb bytes) 000541 1783072685.818651 fallocate 0x024303 thru 0x032035 (0xdd33 bytes) 000542 1783072685.830080 write 0x03398d thru 0x03b9af (0x8023 bytes) 000543 1783072685.847396 write 0x02d922 thru 0x037dd8 (0xa4b7 bytes) 000544 1783072685.859290 punch from 0x03e3fa to 0x03ffff (0x1c06 bytes) 000545 1783072685.869553 fallocate 0x01e0ad thru 0x0247e9 (0x673d bytes) 000547 1783072685.881538 fallocate 0x0366e4 thru 0x03d435 (0x6d52 bytes) 000548 1783072685.901724 mapwrite 0x03b955 thru 0x03ffff (0x46ab bytes) 000549 1783072685.978519 trunc from 0x040000 to 0x00dbc1 (0x3243e bytes) 000550 1783072686.007803 trunc from 0x002ae3 to 0x00a89d (0x7dbb bytes) 000551 1783072686.017322 mapwrite 0x01612b thru 0x01dad4 (0x79aa bytes) 000553 1783072686.157652 mapread 0x004ee2 thru 0x0081ae (0x32cd bytes) 000554 1783072686.198572 read 0x016457 thru 0x01dad4 (0x767e bytes) 000555 1783072686.206166 trunc from 0x01dad5 to 0x013c4a (0x9e8a bytes) 000556 1783072686.238263 MIRROR_RESYNC 16 mirrors 000557 1783072689.947628 trunc from 0x01080b to 0x013c4a (0x3440 bytes) 000558 1783072689.989454 fallocate 0x0395de thru 0x03ffff (0x6a22 bytes) 000559 1783072689.996011 fallocate 0x02ca11 thru 0x033fdd (0x75cd bytes) 000561 1783072690.002672 write 0x00a24f thru 0x00d120 (0x2ed2 bytes) 000563 1783072690.017950 mapread 0x028a33 thru 0x036d20 (0xe2ee bytes) 000564 1783072690.049277 fallocate 0x002811 thru 0x009acb (0x72bb bytes) 000565 1783072690.054983 read 0x00ad88 thru 0x019cd9 (0xef52 bytes) 000567 1783072690.068199 trunc from 0x040000 to 0x022020 (0x1dfdf bytes) 000568 1783072690.091376 write 0x02a090 thru 0x034a4f (0xa9c0 bytes) 000569 1783072690.094966 mapread 0x0133f7 thru 0x014231 (0xe3b bytes) 000571 1783072690.099321 write 0x02fa9d thru 0x0320a9 (0x260d bytes) 000572 1783072690.101304 trunc from 0x023acd to 0x02c206 (0x873a bytes) 000573 1783072690.126866 write 0x03f5f1 thru 0x03ffff (0xa0f bytes) 000574 1783072690.133476 MIRROR_SPLIT mirror 7 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcefccc09 (stale) Mirror 4: 0xcefccc09 (stale) Mirror 7: 0xcefccc09 (stale) Mirror 8: 0xcefccc09 (stale) Mirror 10: 0xcefccc09 (stale) Mirror 12: 0xcefccc09 (stale) Mirror 14: 0xcefccc09 (stale) Mirror 15: 0xcefccc09 (stale) Mirror 17: 0xcefccc09 (stale) Mirror 18: 0xcefccc09 (stale) Mirror 19: 0xcefccc09 (stale) Mirror 20: 0xcefccc09 (stale) Mirror 21: 0xcefccc09 (stale) Mirror 22: 0xcefccc09 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcefccc09 (stale) Mirror 4: 0xcefccc09 (stale) Mirror 7: 0xcefccc09 (stale) Mirror 8: 0xcefccc09 (stale) Mirror 10: 0xcefccc09 (stale) Mirror 12: 0xcefccc09 (stale) Mirror 14: 0xcefccc09 (stale) Mirror 15: 0xcefccc09 (stale) Mirror 17: 0xcefccc09 (stale) Mirror 18: 0xcefccc09 (stale) Mirror 19: 0xcefccc09 (stale) Mirror 20: 0xcefccc09 (stale) Mirror 21: 0xcefccc09 (stale) Mirror 22: 0xcefccc09 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000575 1783072691.073308 punch from 0x026517 to 0x02c3c4 (0x5eae bytes) 000576 1783072691.078640 trunc from 0x040000 to 0x0021b7 (0x3de48 bytes) 000577 1783072691.119308 trunc from 0x0021b8 to 0x03e2bc (0x3c105 bytes) 000578 1783072691.142897 fallocate 0x01b8f4 thru 0x01d72b (0x1e38 bytes) 000579 1783072691.153280 mapread 0x037dcc thru 0x03e2bc (0x64f1 bytes) 000580 1783072691.192376 trunc from 0x03e2bd to 0x037daa (0x6512 bytes) 000581 1783072691.213470 mapwrite 0x02b164 thru 0x02eb06 (0x39a3 bytes) 000582 1783072691.264447 trunc from 0x037dab to 0x017cc9 (0x200e1 bytes) 000584 1783072691.296837 write 0x0007e1 thru 0x00c89d (0xc0bd bytes) 000585 1783072691.317119 read 0x0049fd thru 0x008548 (0x3b4c bytes) 000586 1783072691.322554 mapwrite 0x03cbe6 thru 0x03cd69 (0x184 bytes) 000587 1783072691.397068 MIRROR_SPLIT mirror 10 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cd6a): Mirror 3: 0x27cf9b56 (stale) Mirror 4: 0x27cf9b56 (stale) Mirror 7: 0x27cf9b56 (stale) Mirror 8: 0x27cf9b56 (stale) Mirror 10: 0x27cf9b56 (stale) Mirror 12: 0x27cf9b56 (stale) Mirror 14: 0x27cf9b56 (stale) Mirror 15: 0x27cf9b56 (stale) Mirror 17: 0x27cf9b56 (stale) Mirror 19: 0x27cf9b56 (stale) Mirror 20: 0x27cf9b56 (stale) Mirror 21: 0x27cf9b56 (stale) Mirror 22: 0x27cf9b56 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cd6a): Mirror 3: 0x27cf9b56 (stale) Mirror 4: 0x27cf9b56 (stale) Mirror 7: 0x27cf9b56 (stale) Mirror 8: 0x27cf9b56 (stale) Mirror 10: 0x27cf9b56 (stale) Mirror 12: 0x27cf9b56 (stale) Mirror 14: 0x27cf9b56 (stale) Mirror 15: 0x27cf9b56 (stale) Mirror 17: 0x27cf9b56 (stale) Mirror 19: 0x27cf9b56 (stale) Mirror 20: 0x27cf9b56 (stale) Mirror 21: 0x27cf9b56 (stale) Mirror 22: 0x27cf9b56 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cd6a: skipped 000588 1783072692.261845 trunc from 0x0045ad to 0x012708 (0xe15c bytes) 000589 1783072692.268368 read 0x020819 thru 0x020cfd (0x4e5 bytes) 000590 1783072692.275071 trunc from 0x00c430 to 0x015362 (0x8f33 bytes) 000591 1783072692.281138 read 0x02033f thru 0x0262f5 (0x5fb7 bytes) 000592 1783072692.296249 trunc from 0x03cd6a to 0x009df0 (0x32f79 bytes) 000593 1783072692.319839 trunc from 0x009df1 to 0x007ce6 (0x210a bytes) 000594 1783072692.351644 trunc from 0x007ce7 to 0x00c2fe (0x4618 bytes) 000595 1783072692.375945 trunc from 0x00652b to 0x00a003 (0x3ad9 bytes) 000596 1783072692.390109 MIRROR_RESYNC 14 mirrors 000597 1783072694.522382 mapread 0x009127 thru 0x00c2fe (0x31d8 bytes) 000598 1783072694.541725 punch from 0x00122f to 0x001615 (0x3e7 bytes) 000599 1783072694.586617 read 0x009a9f thru 0x00c2fe (0x2860 bytes) 000600 1783072694.598315 write 0x02972a thru 0x0377d6 (0xe0ad bytes) 000601 1783072694.604018 punch from 0x00077d to 0x00e7f6 (0xe07a bytes) 000602 1783072694.620905 MIRROR_RESYNC 14 mirrors 000603 1783072697.132322 mapread 0x0362ce thru 0x0377d6 (0x1509 bytes) 000604 1783072697.151553 fallocate 0x012d13 thru 0x015e5c (0x314a bytes) 000605 1783072697.203914 read 0x0040c3 thru 0x012452 (0xe390 bytes) 000606 1783072697.230606 mapread 0x0217b4 thru 0x02e608 (0xce55 bytes) 000607 1783072697.268032 mapwrite 0x009361 thru 0x00db5d (0x47fd bytes) 000608 1783072697.294530 write 0x0361b7 thru 0x03cc6e (0x6ab8 bytes) 000609 1783072697.301391 write 0x012c13 thru 0x0137a3 (0xb91 bytes) 000610 1783072697.308863 fallocate 0x023a2b thru 0x02aa12 (0x6fe8 bytes) 000611 1783072697.316863 read 0x0280e5 thru 0x02a954 (0x2870 bytes) 000613 1783072697.319485 fallocate 0x038ec1 thru 0x03ffff (0x713f bytes) 000614 1783072697.325432 write 0x001d36 thru 0x0033d0 (0x169b bytes) 000616 1783072697.342105 fallocate 0x019633 thru 0x01b975 (0x2343 bytes) 000617 1783072697.348074 mapread 0x032972 thru 0x034b32 (0x21c1 bytes) 000618 1783072697.349985 mapwrite 0x03c217 thru 0x03d699 (0x1483 bytes) 000619 1783072697.380702 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x68b2ae77 (stale) Mirror 7: 0x68b2ae77 (stale) Mirror 8: 0x68b2ae77 (stale) Mirror 10: 0x68b2ae77 (stale) Mirror 12: 0x68b2ae77 (stale) Mirror 14: 0x68b2ae77 (stale) Mirror 15: 0x68b2ae77 (stale) Mirror 17: 0x68b2ae77 (stale) Mirror 19: 0x68b2ae77 (stale) Mirror 20: 0x68b2ae77 (stale) Mirror 21: 0x68b2ae77 (stale) Mirror 22: 0x68b2ae77 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x68b2ae77 (stale) Mirror 7: 0x68b2ae77 (stale) Mirror 8: 0x68b2ae77 (stale) Mirror 10: 0x68b2ae77 (stale) Mirror 12: 0x68b2ae77 (stale) Mirror 14: 0x68b2ae77 (stale) Mirror 15: 0x68b2ae77 (stale) Mirror 17: 0x68b2ae77 (stale) Mirror 19: 0x68b2ae77 (stale) Mirror 20: 0x68b2ae77 (stale) Mirror 21: 0x68b2ae77 (stale) Mirror 22: 0x68b2ae77 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000621 1783072698.307565 fallocate 0x006304 thru 0x00c587 (0x6284 bytes) 000622 1783072698.318096 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x68b2ae77 (stale) Mirror 7: 0x68b2ae77 (stale) Mirror 8: 0x68b2ae77 (stale) Mirror 10: 0x68b2ae77 (stale) Mirror 12: 0x68b2ae77 (stale) Mirror 14: 0x68b2ae77 (stale) Mirror 15: 0x68b2ae77 (stale) Mirror 17: 0x68b2ae77 (stale) Mirror 19: 0x68b2ae77 (stale) Mirror 20: 0x68b2ae77 (stale) Mirror 21: 0x68b2ae77 (stale) Mirror 22: 0x68b2ae77 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbea66ab1 Mirror 23: 0xbea66ab1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000623 1783072700.000322 read 0x02fcd9 thru 0x039269 (0x9591 bytes) 000624 1783072700.028014 read 0x03b3cf thru 0x03ffff (0x4c31 bytes) 000625 1783072700.047520 punch from 0x008a93 to 0x011814 (0x8d82 bytes) 000628 1783072700.097604 read 0x004721 thru 0x00d498 (0x8d78 bytes) 000629 1783072700.110194 punch from 0x019676 to 0x0262bb (0xcc46 bytes) 000630 1783072700.115746 mapread 0x038aa4 thru 0x03ffff (0x755c bytes) 000632 1783072700.123367 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x68b2ae77 (stale) Mirror 7: 0x68b2ae77 (stale) Mirror 8: 0x68b2ae77 (stale) Mirror 10: 0x68b2ae77 (stale) Mirror 12: 0x68b2ae77 (stale) Mirror 14: 0x68b2ae77 (stale) Mirror 15: 0x68b2ae77 (stale) Mirror 17: 0x68b2ae77 (stale) Mirror 19: 0x68b2ae77 (stale) Mirror 20: 0x68b2ae77 (stale) Mirror 21: 0x68b2ae77 (stale) Mirror 22: 0x68b2ae77 (stale) Mirror 23: 0xbea66ab1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd5d845b6 Mirror 24: 0xd5d845b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000633 1783072701.445299 mapwrite 0x039cf3 thru 0x03ffff (0x630d bytes) 000634 1783072701.584688 fallocate 0x037f8d thru 0x03cb16 (0x4b8a bytes) 000635 1783072701.591087 mapread 0x014aa0 thru 0x01a953 (0x5eb4 bytes) 000637 1783072701.610293 mapwrite 0x000f85 thru 0x008154 (0x71d0 bytes) 000638 1783072701.669229 mapwrite 0x00e99b thru 0x00f832 (0xe98 bytes) 000639 1783072701.685357 mapread 0x008ad4 thru 0x015997 (0xcec4 bytes) 000640 1783072701.688736 punch from 0x03bd81 to 0x03d88c (0x1b0c bytes) 000641 1783072701.697141 trunc from 0x036c23 to 0x03d09c (0x647a bytes) 000642 1783072701.703967 fallocate 0x037e47 thru 0x03ffff (0x81b9 bytes) 000643 1783072701.710979 read 0x025bea thru 0x02e4ce (0x88e5 bytes) 000645 1783072701.727992 mapread 0x01828d thru 0x01d25f (0x4fd3 bytes) 000646 1783072701.750705 MIRROR_RESYNC 15 mirrors 000647 1783072706.980676 punch from 0x030b68 to 0x03e0df (0xd578 bytes) 000649 1783072707.047047 fallocate 0x035e87 thru 0x03ffff (0xa179 bytes) 000650 1783072707.056759 mapread 0x015a46 thru 0x016ca3 (0x125e bytes) 000651 1783072707.068313 punch from 0x02717b to 0x03472c (0xd5b2 bytes) 000652 1783072707.073206 trunc from 0x040000 to 0x005526 (0x3aad9 bytes) 000654 1783072707.116611 punch from 0x00143f to 0x005526 (0x40e8 bytes) 000655 1783072707.124609 read 0x00442d thru 0x005526 (0x10fa bytes) 000656 1783072707.131919 mapwrite 0x009850 thru 0x00d010 (0x37c1 bytes) 000657 1783072707.206702 write 0x031e20 thru 0x03ffff (0xe1e0 bytes) 000659 1783072707.231842 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xc2c73f07 (stale) Mirror 7: 0xc2c73f07 (stale) Mirror 8: 0xc2c73f07 (stale) Mirror 10: 0xc2c73f07 (stale) Mirror 12: 0xc2c73f07 (stale) Mirror 14: 0xc2c73f07 (stale) Mirror 15: 0xc2c73f07 (stale) Mirror 17: 0xc2c73f07 (stale) Mirror 19: 0xc2c73f07 (stale) Mirror 20: 0xc2c73f07 (stale) Mirror 21: 0xc2c73f07 (stale) Mirror 22: 0xc2c73f07 (stale) Mirror 23: 0xc2c73f07 (stale) Mirror 24: 0xc2c73f07 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6a6e3900 Mirror 25: 0x6a6e3900 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000661 1783072708.573367 trunc from 0x03a82a to 0x03ae0f (0x5e6 bytes) 000662 1783072708.640822 mapwrite 0x01d623 thru 0x01ead8 (0x14b6 bytes) 000663 1783072708.688834 MIRROR_RESYNC 16 mirrors 000665 1783072714.455427 MIRROR_RESYNC 16 mirrors 000666 1783072715.594954 read 0x01b6da thru 0x022d8d (0x76b4 bytes) 000667 1783072715.622622 write 0x015aa8 thru 0x01c9d8 (0x6f31 bytes) 000669 1783072715.711131 write 0x015a49 thru 0x01c16b (0x6723 bytes) 000670 1783072715.713687 mapread 0x01a47b thru 0x023d75 (0x98fb bytes) 000672 1783072715.752708 trunc from 0x040000 to 0x01c7bd (0x23842 bytes) 000673 1783072715.787630 MIRROR_RESYNC 16 mirrors 000674 1783072720.486419 read 0x00531b thru 0x007271 (0x1f57 bytes) 000675 1783072720.502393 mapwrite 0x005e30 thru 0x0068e5 (0xab6 bytes) 000676 1783072720.668528 trunc from 0x01a261 to 0x01c7bd (0x255d bytes) 000677 1783072720.676224 trunc from 0x00af5d to 0x00fc62 (0x4d06 bytes) 000679 1783072720.685555 mapread 0x0081b6 thru 0x016796 (0xe5e1 bytes) 000680 1783072720.719642 punch from 0x001edb to 0x0057e5 (0x390b bytes) 000681 1783072720.737368 mapread 0x00d661 thru 0x00f548 (0x1ee8 bytes) 000682 1783072720.745618 mapread 0x005867 thru 0x00607b (0x815 bytes) 000683 1783072720.764099 read 0x00fe01 thru 0x013fcc (0x41cc bytes) 000685 1783072720.768638 write 0x03bd8a thru 0x03f058 (0x32cf bytes) 000686 1783072720.771692 trunc from 0x03c1ed to 0x03f058 (0x2e6c bytes) 000687 1783072720.796052 trunc from 0x03f059 to 0x03a860 (0x47f8 bytes) 000688 1783072720.852397 MIRROR_SPLIT mirror 9 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a861): Mirror 4: 0xa74ca279 (stale) Mirror 7: 0xa74ca279 (stale) Mirror 8: 0xa74ca279 (stale) Mirror 10: 0xa74ca279 (stale) Mirror 12: 0xa74ca279 (stale) Mirror 14: 0xa74ca279 (stale) Mirror 15: 0xa74ca279 (stale) Mirror 17: 0xa74ca279 (stale) Mirror 20: 0xa74ca279 (stale) Mirror 21: 0xa74ca279 (stale) Mirror 22: 0xa74ca279 (stale) Mirror 23: 0xa74ca279 (stale) Mirror 24: 0xa74ca279 (stale) Mirror 25: 0xa74ca279 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a861): Mirror 4: 0xa74ca279 (stale) Mirror 7: 0xa74ca279 (stale) Mirror 8: 0xa74ca279 (stale) Mirror 10: 0xa74ca279 (stale) Mirror 12: 0xa74ca279 (stale) Mirror 14: 0xa74ca279 (stale) Mirror 15: 0xa74ca279 (stale) Mirror 17: 0xa74ca279 (stale) Mirror 20: 0xa74ca279 (stale) Mirror 21: 0xa74ca279 (stale) Mirror 22: 0xa74ca279 (stale) Mirror 23: 0xa74ca279 (stale) Mirror 24: 0xa74ca279 (stale) Mirror 25: 0xa74ca279 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a861: skipped 000689 1783072721.776599 write 0x01a505 thru 0x021b65 (0x7661 bytes) 000690 1783072721.822701 mapwrite 0x03c199 thru 0x03ffff (0x3e67 bytes) 000691 1783072721.957709 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xa6f097fa (stale) Mirror 7: 0xa6f097fa (stale) Mirror 8: 0xa6f097fa (stale) Mirror 10: 0xa6f097fa (stale) Mirror 12: 0xa6f097fa (stale) Mirror 14: 0xa6f097fa (stale) Mirror 15: 0xa6f097fa (stale) Mirror 17: 0xa6f097fa (stale) Mirror 20: 0xa6f097fa (stale) Mirror 21: 0xa6f097fa (stale) Mirror 22: 0xa6f097fa (stale) Mirror 23: 0xa6f097fa (stale) Mirror 24: 0xa6f097fa (stale) Mirror 25: 0xa6f097fa (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdb794768 Mirror 26: 0xdb794768 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000692 1783072723.585753 mapwrite 0x030234 thru 0x034ccd (0x4a9a bytes) 000693 1783072723.765153 MIRROR_RESYNC 16 mirrors 000694 1783072730.372109 write 0x03c3da thru 0x03ffff (0x3c26 bytes) 000695 1783072730.422070 mapread 0x020346 thru 0x02c24c (0xbf07 bytes) 000696 1783072730.454948 fallocate 0x037401 thru 0x03b522 (0x4122 bytes) 000697 1783072730.460279 mapread 0x013758 thru 0x01b385 (0x7c2e bytes) 000698 1783072730.472029 trunc from 0x01e385 to 0x02bdc8 (0xda44 bytes) 000699 1783072730.477664 punch from 0x02678f to 0x0337b2 (0xd024 bytes) 000700 1783072730.483174 mapwrite 0x000f31 thru 0x007fc6 (0x7096 bytes) 000701 1783072730.510209 trunc from 0x040000 to 0x0095b7 (0x36a48 bytes) 000702 1783072730.535137 MIRROR_SPLIT mirror 2 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x95b8): Mirror 4: 0x36a2a497 (stale) Mirror 8: 0x36a2a497 (stale) Mirror 10: 0x36a2a497 (stale) Mirror 12: 0x36a2a497 (stale) Mirror 14: 0x36a2a497 (stale) Mirror 15: 0x36a2a497 (stale) Mirror 17: 0x36a2a497 (stale) Mirror 20: 0x36a2a497 (stale) Mirror 21: 0x36a2a497 (stale) Mirror 22: 0x36a2a497 (stale) Mirror 23: 0x36a2a497 (stale) Mirror 24: 0x36a2a497 (stale) Mirror 25: 0x36a2a497 (stale) Mirror 26: 0x36a2a497 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x95b8): Mirror 4: 0x36a2a497 (stale) Mirror 8: 0x36a2a497 (stale) Mirror 10: 0x36a2a497 (stale) Mirror 12: 0x36a2a497 (stale) Mirror 14: 0x36a2a497 (stale) Mirror 15: 0x36a2a497 (stale) Mirror 17: 0x36a2a497 (stale) Mirror 20: 0x36a2a497 (stale) Mirror 21: 0x36a2a497 (stale) Mirror 22: 0x36a2a497 (stale) Mirror 23: 0x36a2a497 (stale) Mirror 24: 0x36a2a497 (stale) Mirror 25: 0x36a2a497 (stale) Mirror 26: 0x36a2a497 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x95b8: skipped 000703 1783072731.282438 trunc from 0x0095b8 to 0x022101 (0x18b4a bytes) 000704 1783072731.298821 punch from 0x02101e to 0x022101 (0x10e4 bytes) 000705 1783072731.310439 trunc from 0x013d66 to 0x016880 (0x2b1b bytes) 000706 1783072731.323944 mapwrite 0x0059e3 thru 0x009493 (0x3ab1 bytes) 000707 1783072731.376935 read 0x0219d3 thru 0x022101 (0x72f bytes) 000708 1783072731.387218 fallocate 0x02406c thru 0x027ca5 (0x3c3a bytes) 000709 1783072731.397506 fallocate 0x006cda thru 0x01368c (0xc9b3 bytes) 000710 1783072731.413423 MIRROR_RESYNC 15 mirrors 000712 1783072733.680481 punch from 0x00c8e2 to 0x0195e5 (0xcd04 bytes) 000713 1783072733.727210 MIRROR_SPLIT mirror 2 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22102): Mirror 4: 0xc18ccef (stale) Mirror 10: 0xc18ccef (stale) Mirror 12: 0xc18ccef (stale) Mirror 14: 0xc18ccef (stale) Mirror 15: 0xc18ccef (stale) Mirror 17: 0xc18ccef (stale) Mirror 20: 0xc18ccef (stale) Mirror 21: 0xc18ccef (stale) Mirror 22: 0xc18ccef (stale) Mirror 23: 0xc18ccef (stale) Mirror 24: 0xc18ccef (stale) Mirror 25: 0xc18ccef (stale) Mirror 26: 0xc18ccef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22102): Mirror 4: 0xc18ccef (stale) Mirror 10: 0xc18ccef (stale) Mirror 12: 0xc18ccef (stale) Mirror 14: 0xc18ccef (stale) Mirror 15: 0xc18ccef (stale) Mirror 17: 0xc18ccef (stale) Mirror 20: 0xc18ccef (stale) Mirror 21: 0xc18ccef (stale) Mirror 22: 0xc18ccef (stale) Mirror 23: 0xc18ccef (stale) Mirror 24: 0xc18ccef (stale) Mirror 25: 0xc18ccef (stale) Mirror 26: 0xc18ccef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22102: skipped 000714 1783072734.432494 punch from 0x01e152 to 0x01fe2b (0x1cda bytes) 000715 1783072734.441965 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x22102): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22102): Mirror 4: 0xc18ccef (stale) Mirror 10: 0xc18ccef (stale) Mirror 12: 0xc18ccef (stale) Mirror 14: 0xc18ccef (stale) Mirror 15: 0xc18ccef (stale) Mirror 17: 0xc18ccef (stale) Mirror 20: 0xc18ccef (stale) Mirror 21: 0xc18ccef (stale) Mirror 22: 0xc18ccef (stale) Mirror 23: 0xc18ccef (stale) Mirror 24: 0xc18ccef (stale) Mirror 25: 0xc18ccef (stale) Mirror 26: 0xc18ccef (stale) CRC-32 checksum value for chunk [0, 0x22102): Mirror 1: 0xc18ccef Mirror 27: 0xc18ccef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22102: skipped 000716 1783072735.517937 read 0x011022 thru 0x01fb68 (0xeb47 bytes) 000717 1783072735.579467 trunc from 0x022102 to 0x037f72 (0x15e71 bytes) 000718 1783072735.634071 write 0x0364a9 thru 0x03b5be (0x5116 bytes) 000719 1783072735.641176 write 0x000a3a thru 0x00ed30 (0xe2f7 bytes) 000720 1783072735.663205 mapwrite 0x00895d thru 0x01021b (0x78bf bytes) 000721 1783072735.725765 punch from 0x026f3e to 0x032be5 (0xbca8 bytes) 000722 1783072735.732443 fallocate 0x0049c7 thru 0x01292d (0xdf67 bytes) 000723 1783072735.739416 write 0x002910 thru 0x0072b2 (0x49a3 bytes) 000725 1783072735.744762 read 0x018e04 thru 0x01a6da (0x18d7 bytes) 000726 1783072735.761423 trunc from 0x022267 to 0x02acd1 (0x8a6b bytes) 000727 1783072735.771587 MIRROR_SPLIT mirror 8 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b5bf): Mirror 4: 0x5f360b53 (stale) Mirror 10: 0x5f360b53 (stale) Mirror 12: 0x5f360b53 (stale) Mirror 14: 0x5f360b53 (stale) Mirror 15: 0x5f360b53 (stale) Mirror 17: 0x5f360b53 (stale) Mirror 20: 0x5f360b53 (stale) Mirror 22: 0x5f360b53 (stale) Mirror 23: 0x5f360b53 (stale) Mirror 24: 0x5f360b53 (stale) Mirror 25: 0x5f360b53 (stale) Mirror 26: 0x5f360b53 (stale) Mirror 27: 0x5f360b53 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b5bf): Mirror 4: 0x5f360b53 (stale) Mirror 10: 0x5f360b53 (stale) Mirror 12: 0x5f360b53 (stale) Mirror 14: 0x5f360b53 (stale) Mirror 15: 0x5f360b53 (stale) Mirror 17: 0x5f360b53 (stale) Mirror 20: 0x5f360b53 (stale) Mirror 22: 0x5f360b53 (stale) Mirror 23: 0x5f360b53 (stale) Mirror 24: 0x5f360b53 (stale) Mirror 25: 0x5f360b53 (stale) Mirror 26: 0x5f360b53 (stale) Mirror 27: 0x5f360b53 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b5bf: skipped 000728 1783072736.573270 trunc from 0x03b5bf to 0x03d1f4 (0x1c36 bytes) 000729 1783072736.598002 MIRROR_RESYNC 14 mirrors 000730 1783072739.834482 mapread 0x032786 thru 0x03d1f4 (0xaa6f bytes) 000731 1783072739.883285 MIRROR_EXTEND to 15 mirrors 000732 1783072740.975258 write 0x034285 thru 0x037389 (0x3105 bytes) 000733 1783072741.065709 MIRROR_RESYNC 15 mirrors 000734 1783072744.147539 mapread 0x03b72f thru 0x03d1f4 (0x1ac6 bytes) 000735 1783072744.172528 punch from 0x035fa7 to 0x03ab0a (0x4b64 bytes) 000736 1783072744.222724 MIRROR_SPLIT mirror 8 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d1f5): Mirror 4: 0xeff5b65f (stale) Mirror 10: 0xeff5b65f (stale) Mirror 12: 0xeff5b65f (stale) Mirror 14: 0xeff5b65f (stale) Mirror 15: 0xeff5b65f (stale) Mirror 17: 0xeff5b65f (stale) Mirror 20: 0xeff5b65f (stale) Mirror 23: 0xeff5b65f (stale) Mirror 24: 0xeff5b65f (stale) Mirror 25: 0xeff5b65f (stale) Mirror 26: 0xeff5b65f (stale) Mirror 27: 0xeff5b65f (stale) Mirror 28: 0xeff5b65f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d1f5): Mirror 4: 0xeff5b65f (stale) Mirror 10: 0xeff5b65f (stale) Mirror 12: 0xeff5b65f (stale) Mirror 14: 0xeff5b65f (stale) Mirror 15: 0xeff5b65f (stale) Mirror 17: 0xeff5b65f (stale) Mirror 20: 0xeff5b65f (stale) Mirror 23: 0xeff5b65f (stale) Mirror 24: 0xeff5b65f (stale) Mirror 25: 0xeff5b65f (stale) Mirror 26: 0xeff5b65f (stale) Mirror 27: 0xeff5b65f (stale) Mirror 28: 0xeff5b65f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d1f5: skipped 000737 1783072745.264849 fallocate 0x000710 thru 0x0020ed (0x19de bytes) 000738 1783072745.278047 mapwrite 0x03a579 thru 0x03ffff (0x5a87 bytes) 000739 1783072745.364070 punch from 0x009967 to 0x014a34 (0xb0ce bytes) 000740 1783072745.369749 trunc from 0x02d2f2 to 0x030f77 (0x3c86 bytes) 000741 1783072745.374452 trunc from 0x03ef67 to 0x03ffff (0x1099 bytes) 000742 1783072745.383055 write 0x019fbb thru 0x026820 (0xc866 bytes) 000744 1783072745.396494 read 0x00d93d thru 0x01292f (0x4ff3 bytes) 000745 1783072745.407623 write 0x03f410 thru 0x03ffff (0xbf0 bytes) 000747 1783072745.415390 read 0x032da9 thru 0x03b8ec (0x8b44 bytes) 000748 1783072745.430583 read 0x03145e thru 0x034eb3 (0x3a56 bytes) 000749 1783072745.431977 trunc from 0x040000 to 0x02f1c9 (0x10e36 bytes) 000750 1783072745.454825 punch from 0x00a149 to 0x00dfe5 (0x3e9d bytes) 000751 1783072745.463244 mapread 0x021218 thru 0x02dff0 (0xcdd9 bytes) 000752 1783072745.464679 mapread 0x00b092 thru 0x00bc05 (0xb74 bytes) 000754 1783072745.472146 mapwrite 0x002924 thru 0x00d1fb (0xa8d8 bytes) 000755 1783072745.496178 read 0x01632d thru 0x020b2b (0xa7ff bytes) 000756 1783072745.506257 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x2f1ca): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f1ca): Mirror 4: 0x8d259c73 (stale) Mirror 10: 0x8d259c73 (stale) Mirror 12: 0x8d259c73 (stale) Mirror 14: 0x8d259c73 (stale) Mirror 15: 0x8d259c73 (stale) Mirror 17: 0x8d259c73 (stale) Mirror 20: 0x8d259c73 (stale) Mirror 23: 0x8d259c73 (stale) Mirror 24: 0x8d259c73 (stale) Mirror 25: 0x8d259c73 (stale) Mirror 26: 0x8d259c73 (stale) Mirror 27: 0x8d259c73 (stale) Mirror 28: 0x8d259c73 (stale) CRC-32 checksum value for chunk [0, 0x2f1ca): Mirror 1: 0x502817e8 Mirror 29: 0x502817e8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f1ca: skipped 000757 1783072746.738591 MIRROR_SPLIT mirror 14 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f1ca): Mirror 4: 0x8d259c73 (stale) Mirror 10: 0x8d259c73 (stale) Mirror 12: 0x8d259c73 (stale) Mirror 14: 0x8d259c73 (stale) Mirror 15: 0x8d259c73 (stale) Mirror 17: 0x8d259c73 (stale) Mirror 20: 0x8d259c73 (stale) Mirror 23: 0x8d259c73 (stale) Mirror 24: 0x8d259c73 (stale) Mirror 25: 0x8d259c73 (stale) Mirror 26: 0x8d259c73 (stale) Mirror 27: 0x8d259c73 (stale) Mirror 28: 0x8d259c73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f1ca): Mirror 4: 0x8d259c73 (stale) Mirror 10: 0x8d259c73 (stale) Mirror 12: 0x8d259c73 (stale) Mirror 14: 0x8d259c73 (stale) Mirror 15: 0x8d259c73 (stale) Mirror 17: 0x8d259c73 (stale) Mirror 20: 0x8d259c73 (stale) Mirror 23: 0x8d259c73 (stale) Mirror 24: 0x8d259c73 (stale) Mirror 25: 0x8d259c73 (stale) Mirror 26: 0x8d259c73 (stale) Mirror 27: 0x8d259c73 (stale) Mirror 28: 0x8d259c73 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f1ca: skipped 000758 1783072747.510021 trunc from 0x013a06 to 0x023281 (0xf87c bytes) 000759 1783072747.533942 punch from 0x00fa15 to 0x01321a (0x3806 bytes) 000760 1783072747.547170 mapread 0x00f449 thru 0x01781c (0x83d4 bytes) 000761 1783072747.582912 trunc from 0x0253bc to 0x02b9dc (0x6621 bytes) 000762 1783072747.587905 fallocate 0x0061f9 thru 0x00969d (0x34a5 bytes) 000763 1783072747.593518 write 0x00dba3 thru 0x014073 (0x64d1 bytes) 000764 1783072747.599367 mapwrite 0x00bf31 thru 0x00c08b (0x15b bytes) 000765 1783072747.617673 punch from 0x004e59 to 0x00c810 (0x79b8 bytes) 000766 1783072747.626185 write 0x0348e4 thru 0x03599e (0x10bb bytes) 000767 1783072747.637843 MIRROR_SPLIT mirror 5 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3599f): Mirror 4: 0x56755540 (stale) Mirror 10: 0x56755540 (stale) Mirror 12: 0x56755540 (stale) Mirror 14: 0x56755540 (stale) Mirror 17: 0x56755540 (stale) Mirror 20: 0x56755540 (stale) Mirror 23: 0x56755540 (stale) Mirror 24: 0x56755540 (stale) Mirror 25: 0x56755540 (stale) Mirror 26: 0x56755540 (stale) Mirror 27: 0x56755540 (stale) Mirror 28: 0x56755540 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3599f): Mirror 4: 0x56755540 (stale) Mirror 10: 0x56755540 (stale) Mirror 12: 0x56755540 (stale) Mirror 14: 0x56755540 (stale) Mirror 17: 0x56755540 (stale) Mirror 20: 0x56755540 (stale) Mirror 23: 0x56755540 (stale) Mirror 24: 0x56755540 (stale) Mirror 25: 0x56755540 (stale) Mirror 26: 0x56755540 (stale) Mirror 27: 0x56755540 (stale) Mirror 28: 0x56755540 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3599f: skipped 000768 1783072748.320529 MIRROR_RESYNC 13 mirrors 000770 1783072751.758091 mapwrite 0x023e4b thru 0x02af68 (0x711e bytes) 000771 1783072751.924457 mapread 0x0075eb thru 0x015474 (0xde8a bytes) 000772 1783072751.956028 fallocate 0x002673 thru 0x0099b6 (0x7344 bytes) 000773 1783072751.973055 trunc from 0x03599f to 0x02e7cf (0x71cf bytes) 000774 1783072752.007461 trunc from 0x02e7d0 to 0x023c5a (0xab75 bytes) 000775 1783072752.032171 read 0x011105 thru 0x01c710 (0xb60c bytes) 000777 1783072752.066422 MIRROR_RESYNC 13 mirrors 000778 1783072755.310378 fallocate 0x01064c thru 0x01d217 (0xcbcc bytes) 000779 1783072755.367702 trunc from 0x00efd8 to 0x01af1b (0xbf44 bytes) 000780 1783072755.378612 trunc from 0x023c5b to 0x0155f2 (0xe668 bytes) 000781 1783072755.402628 punch from 0x00e2eb to 0x014191 (0x5ea7 bytes) 000782 1783072755.410181 write 0x004fca thru 0x00ef72 (0x9fa9 bytes) 000783 1783072755.428466 trunc from 0x0155f3 to 0x0242a7 (0xecb5 bytes) 000784 1783072755.457291 fallocate 0x01e68c thru 0x0261b6 (0x7b2b bytes) 000785 1783072755.465045 punch from 0x01bccf to 0x0242a7 (0x85d9 bytes) 000786 1783072755.469715 read 0x008933 thru 0x00f8f6 (0x6fc4 bytes) 000787 1783072755.475577 trunc from 0x0242a8 to 0x031313 (0xd06c bytes) 000788 1783072755.496635 mapread 0x030230 thru 0x031313 (0x10e4 bytes) 000790 1783072755.516744 write 0x021c20 thru 0x02eab9 (0xce9a bytes) 000791 1783072755.529060 mapread 0x02f580 thru 0x031313 (0x1d94 bytes) 000792 1783072755.536217 write 0x02eda9 thru 0x03d589 (0xe7e1 bytes) 000793 1783072755.542978 MIRROR_RESYNC 13 mirrors 000794 1783072758.242026 trunc from 0x03d58a to 0x02ff93 (0xd5f6 bytes) 000795 1783072758.296796 trunc from 0x00a090 to 0x00a9f3 (0x964 bytes) 000796 1783072758.302924 mapwrite 0x00cace thru 0x017df2 (0xb325 bytes) 000797 1783072758.384633 write 0x01e9d6 thru 0x024c60 (0x628b bytes) 000798 1783072758.411077 mapread 0x019d80 thru 0x020d4f (0x6fd0 bytes) 000799 1783072758.412254 trunc from 0x02ff94 to 0x00c4b9 (0x23ada bytes) 000800 1783072758.442952 mapwrite 0x020c1f thru 0x020fba (0x39c bytes) 000801 1783072758.490704 write 0x024dfd thru 0x026636 (0x183a bytes) 000802 1783072758.492318 trunc from 0x01a2e4 to 0x023bdb (0x98f8 bytes) 000803 1783072758.504624 mapread 0x01750e thru 0x022047 (0xab3a bytes) 000804 1783072758.533514 trunc from 0x00a329 to 0x00d070 (0x2d48 bytes) 000805 1783072758.542459 fallocate 0x022dff thru 0x02ca75 (0x9c77 bytes) 000806 1783072758.548622 mapwrite 0x002672 thru 0x005586 (0x2f15 bytes) 000808 1783072758.594605 write 0x00b7bd thru 0x016f48 (0xb78c bytes) 000809 1783072758.607992 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2ca76): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ca76): Mirror 4: 0xf65e7432 (stale) Mirror 10: 0xf65e7432 (stale) Mirror 12: 0xf65e7432 (stale) Mirror 14: 0xf65e7432 (stale) Mirror 17: 0xf65e7432 (stale) Mirror 20: 0xf65e7432 (stale) Mirror 23: 0xf65e7432 (stale) Mirror 24: 0xf65e7432 (stale) Mirror 25: 0xf65e7432 (stale) Mirror 26: 0xf65e7432 (stale) Mirror 27: 0xf65e7432 (stale) Mirror 28: 0xf65e7432 (stale) CRC-32 checksum value for chunk [0, 0x2ca76): Mirror 1: 0xbc9c8622 Mirror 29: 0xbc9c8622 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ca76: skipped 000810 1783072760.021642 read 0x02094b thru 0x0294a1 (0x8b57 bytes) 000811 1783072760.043694 mapread 0x018507 thru 0x01933d (0xe37 bytes) 000812 1783072760.082699 write 0x032d65 thru 0x0371a5 (0x4441 bytes) 000813 1783072760.145357 mapread 0x035553 thru 0x0371a5 (0x1c53 bytes) 000814 1783072760.147569 mapread 0x014710 thru 0x021550 (0xce41 bytes) 000815 1783072760.167357 punch from 0x0304ae to 0x0371a5 (0x6cf8 bytes) 000816 1783072760.184612 mapread 0x00c7a9 thru 0x012ecb (0x6723 bytes) 000817 1783072760.200996 MIRROR_SPLIT mirror 5 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x371a6): Mirror 4: 0x6ca4acb (stale) Mirror 10: 0x6ca4acb (stale) Mirror 12: 0x6ca4acb (stale) Mirror 14: 0x6ca4acb (stale) Mirror 20: 0x6ca4acb (stale) Mirror 23: 0x6ca4acb (stale) Mirror 24: 0x6ca4acb (stale) Mirror 25: 0x6ca4acb (stale) Mirror 26: 0x6ca4acb (stale) Mirror 27: 0x6ca4acb (stale) Mirror 28: 0x6ca4acb (stale) Mirror 29: 0xb7352c52 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x371a6): Mirror 4: 0x6ca4acb (stale) Mirror 10: 0x6ca4acb (stale) Mirror 12: 0x6ca4acb (stale) Mirror 14: 0x6ca4acb (stale) Mirror 20: 0x6ca4acb (stale) Mirror 23: 0x6ca4acb (stale) Mirror 24: 0x6ca4acb (stale) Mirror 25: 0x6ca4acb (stale) Mirror 26: 0x6ca4acb (stale) Mirror 27: 0x6ca4acb (stale) Mirror 28: 0x6ca4acb (stale) Mirror 29: 0xb7352c52 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x371a6: skipped 000818 1783072761.219692 trunc from 0x01bb2b to 0x01f772 (0x3c48 bytes) 000819 1783072761.224860 write 0x0180dd thru 0x02216f (0xa093 bytes) 000820 1783072761.246118 trunc from 0x0371a6 to 0x01501f (0x22186 bytes) 000821 1783072761.263884 mapwrite 0x032fe5 thru 0x03ffff (0xd01b bytes) 000822 1783072761.355913 write 0x0033a6 thru 0x00547c (0x20d7 bytes) 000823 1783072761.375808 write 0x014ab5 thru 0x01ef24 (0xa470 bytes) 000826 1783072761.406616 mapread 0x02ce1a thru 0x032101 (0x52e8 bytes) 000827 1783072761.419399 mapwrite 0x01f3c6 thru 0x029036 (0x9c71 bytes) 000828 1783072761.458208 fallocate 0x02a0e0 thru 0x02a6d8 (0x5f9 bytes) 000829 1783072761.463647 mapread 0x0163d7 thru 0x019177 (0x2da1 bytes) 000830 1783072761.466126 trunc from 0x03e521 to 0x03ffff (0x1adf bytes) 000831 1783072761.472273 punch from 0x02bd71 to 0x02ce07 (0x1097 bytes) 000832 1783072761.477678 punch from 0x00be97 to 0x0154ca (0x9634 bytes) 000834 1783072761.486161 mapwrite 0x004eef thru 0x009b48 (0x4c5a bytes) 000835 1783072761.518723 MIRROR_RESYNC 13 mirrors 000836 1783072765.150214 fallocate 0x01146d thru 0x0204fa (0xf08e bytes) 000838 1783072765.192305 trunc from 0x033690 to 0x038bcd (0x553e bytes) 000839 1783072765.207496 punch from 0x00980e to 0x00ad2c (0x151f bytes) 000840 1783072765.217357 mapwrite 0x02cb16 thru 0x03bd6b (0xf256 bytes) 000841 1783072765.312417 mapread 0x039359 thru 0x03ffff (0x6ca7 bytes) 000842 1783072765.314226 punch from 0x01b6fc to 0x029712 (0xe017 bytes) 000843 1783072765.321292 mapread 0x03687c thru 0x03ffff (0x9784 bytes) 000844 1783072765.322686 punch from 0x002e95 to 0x00975e (0x68ca bytes) 000845 1783072765.329507 fallocate 0x011f6b thru 0x01c7d4 (0xa86a bytes) 000847 1783072765.336463 trunc from 0x02c28d to 0x039d51 (0xdac5 bytes) 000849 1783072765.343899 write 0x00066d thru 0x006211 (0x5ba5 bytes) 000850 1783072765.354492 trunc from 0x00007f to 0x008a64 (0x89e6 bytes) 000851 1783072765.375148 fallocate 0x005416 thru 0x005e3b (0xa26 bytes) 000852 1783072765.383617 trunc from 0x040000 to 0x03ce55 (0x31aa bytes) 000853 1783072765.429146 MIRROR_RESYNC 13 mirrors 000854 1783072770.146113 mapwrite 0x02abd2 thru 0x02f0ba (0x44e9 bytes) 000855 1783072770.296652 punch from 0x0188e1 to 0x02452e (0xbc4e bytes) 000856 1783072770.316879 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3ce56): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce56): Mirror 4: 0x8c2a20e0 (stale) Mirror 10: 0x8c2a20e0 (stale) Mirror 12: 0x8c2a20e0 (stale) Mirror 14: 0x8c2a20e0 (stale) Mirror 20: 0x8c2a20e0 (stale) Mirror 23: 0x8c2a20e0 (stale) Mirror 24: 0x8c2a20e0 (stale) Mirror 25: 0x8c2a20e0 (stale) Mirror 26: 0x8c2a20e0 (stale) Mirror 27: 0x8c2a20e0 (stale) Mirror 28: 0x8c2a20e0 (stale) Mirror 29: 0x8c2a20e0 (stale) CRC-32 checksum value for chunk [0, 0x3ce56): Mirror 1: 0xaef3eba1 Mirror 30: 0xaef3eba1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce56: skipped 000857 1783072771.582885 MIRROR_SPLIT mirror 13 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ce56): Mirror 4: 0x8c2a20e0 (stale) Mirror 10: 0x8c2a20e0 (stale) Mirror 12: 0x8c2a20e0 (stale) Mirror 14: 0x8c2a20e0 (stale) Mirror 20: 0x8c2a20e0 (stale) Mirror 23: 0x8c2a20e0 (stale) Mirror 24: 0x8c2a20e0 (stale) Mirror 25: 0x8c2a20e0 (stale) Mirror 26: 0x8c2a20e0 (stale) Mirror 27: 0x8c2a20e0 (stale) Mirror 28: 0x8c2a20e0 (stale) Mirror 29: 0x8c2a20e0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce56): Mirror 4: 0x8c2a20e0 (stale) Mirror 10: 0x8c2a20e0 (stale) Mirror 12: 0x8c2a20e0 (stale) Mirror 14: 0x8c2a20e0 (stale) Mirror 20: 0x8c2a20e0 (stale) Mirror 23: 0x8c2a20e0 (stale) Mirror 24: 0x8c2a20e0 (stale) Mirror 25: 0x8c2a20e0 (stale) Mirror 26: 0x8c2a20e0 (stale) Mirror 27: 0x8c2a20e0 (stale) Mirror 28: 0x8c2a20e0 (stale) Mirror 29: 0x8c2a20e0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce56: skipped 000858 1783072772.239365 read 0x02ed06 thru 0x031500 (0x27fb bytes) 000859 1783072772.249872 mapread 0x034ed5 thru 0x03cb7b (0x7ca7 bytes) 000860 1783072772.271605 fallocate 0x028815 thru 0x02d421 (0x4c0d bytes) 000861 1783072772.286357 mapwrite 0x01f13b thru 0x021b64 (0x2a2a bytes) 000862 1783072772.313581 mapread 0x00ccfb thru 0x01c95a (0xfc60 bytes) 000863 1783072772.333621 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3ce56): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce56): Mirror 4: 0x8c2a20e0 (stale) Mirror 10: 0x8c2a20e0 (stale) Mirror 12: 0x8c2a20e0 (stale) Mirror 14: 0x8c2a20e0 (stale) Mirror 20: 0x8c2a20e0 (stale) Mirror 23: 0x8c2a20e0 (stale) Mirror 24: 0x8c2a20e0 (stale) Mirror 25: 0x8c2a20e0 (stale) Mirror 26: 0x8c2a20e0 (stale) Mirror 27: 0x8c2a20e0 (stale) Mirror 28: 0x8c2a20e0 (stale) Mirror 29: 0x8c2a20e0 (stale) CRC-32 checksum value for chunk [0, 0x3ce56): Mirror 1: 0xe829125b Mirror 30: 0xe829125b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce56: skipped 000864 1783072773.375626 fallocate 0x0356b0 thru 0x039bd9 (0x452a bytes) 000865 1783072773.435348 mapread 0x031496 thru 0x03ce55 (0xb9c0 bytes) 000866 1783072773.466380 trunc from 0x03ce56 to 0x002aed (0x3a368 bytes) 000868 1783072773.516086 punch from 0x001cef to 0x0029a0 (0xcb2 bytes) 000869 1783072773.521361 trunc from 0x002aee to 0x005a18 (0x2f2b bytes) 000870 1783072773.538974 punch from 0x001e89 to 0x005a18 (0x3b90 bytes) 000871 1783072773.546100 punch from 0x0053b3 to 0x005a18 (0x666 bytes) 000873 1783072773.553366 write 0x015d11 thru 0x0247c8 (0xeab8 bytes) 000874 1783072773.556645 mapread 0x007394 thru 0x010f8b (0x9bf8 bytes) 000875 1783072773.571293 mapread 0x01d05f thru 0x01ea78 (0x1a1a bytes) 000876 1783072773.572633 write 0x03238f thru 0x03ffff (0xdc71 bytes) 000877 1783072773.577513 write 0x0359b4 thru 0x03a7c2 (0x4e0f bytes) 000878 1783072773.580105 trunc from 0x040000 to 0x0339c1 (0xc63e bytes) 000879 1783072773.604358 mapread 0x005f23 thru 0x01250b (0xc5e9 bytes) 000880 1783072773.611631 punch from 0x012f99 to 0x0215df (0xe647 bytes) 000881 1783072773.629655 mapread 0x00ea3a thru 0x01c7b1 (0xdd78 bytes) 000882 1783072773.651142 mapread 0x00564a thru 0x0063ba (0xd71 bytes) 000883 1783072773.653563 punch from 0x010f05 to 0x01dcf1 (0xcded bytes) 000884 1783072773.658123 mapread 0x02368e thru 0x02d9a6 (0xa319 bytes) 000885 1783072773.679595 write 0x0061d3 thru 0x00d57c (0x73aa bytes) 000886 1783072773.681652 fallocate 0x03a0e1 thru 0x03ffff (0x5f1f bytes) 000887 1783072773.687963 punch from 0x0337b3 to 0x0339c1 (0x20f bytes) 000888 1783072773.699729 trunc from 0x0339c2 to 0x026d09 (0xccb8 bytes) 000889 1783072773.721418 fallocate 0x00d50e thru 0x0184b0 (0xafa3 bytes) 000890 1783072773.728532 mapread 0x016bec thru 0x01daf0 (0x6f05 bytes) 000891 1783072773.746445 fallocate 0x02df58 thru 0x039e44 (0xbeed bytes) 000892 1783072773.754854 punch from 0x0107aa to 0x01e27e (0xdad5 bytes) 000893 1783072773.774511 punch from 0x0046a8 to 0x00813a (0x3a93 bytes) 000894 1783072773.798396 mapread 0x000c90 thru 0x003d70 (0x30e1 bytes) 000895 1783072773.812587 fallocate 0x032de0 thru 0x034574 (0x1795 bytes) 000896 1783072773.821572 fallocate 0x01d7f5 thru 0x01d902 (0x10e bytes) 000897 1783072773.830928 write 0x02ed53 thru 0x030ecd (0x217b bytes) 000898 1783072773.836459 mapwrite 0x00c4e3 thru 0x013405 (0x6f23 bytes) 000899 1783072773.877014 trunc from 0x01c885 to 0x027dec (0xb568 bytes) 000900 1783072773.888253 punch from 0x02a69c to 0x030ecd (0x6832 bytes) 000902 1783072773.900049 trunc from 0x030ece to 0x03c810 (0xb943 bytes) 000903 1783072773.925043 mapread 0x006a43 thru 0x00c64f (0x5c0d bytes) 000904 1783072773.926406 trunc from 0x025bbb to 0x02ad26 (0x516c bytes) 000905 1783072773.938376 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c811): Mirror 4: 0x440bd460 (stale) Mirror 10: 0x440bd460 (stale) Mirror 12: 0x440bd460 (stale) Mirror 14: 0x440bd460 (stale) Mirror 20: 0x440bd460 (stale) Mirror 23: 0x440bd460 (stale) Mirror 25: 0x440bd460 (stale) Mirror 26: 0x440bd460 (stale) Mirror 27: 0x440bd460 (stale) Mirror 28: 0x440bd460 (stale) Mirror 29: 0x440bd460 (stale) Mirror 30: 0x563b81ec (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c811): Mirror 4: 0x440bd460 (stale) Mirror 10: 0x440bd460 (stale) Mirror 12: 0x440bd460 (stale) Mirror 14: 0x440bd460 (stale) Mirror 20: 0x440bd460 (stale) Mirror 23: 0x440bd460 (stale) Mirror 25: 0x440bd460 (stale) Mirror 26: 0x440bd460 (stale) Mirror 27: 0x440bd460 (stale) Mirror 28: 0x440bd460 (stale) Mirror 29: 0x440bd460 (stale) Mirror 30: 0x563b81ec (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c811: skipped 000906 1783072774.711375 punch from 0x00a06a to 0x018615 (0xe5ac bytes) 000907 1783072774.716515 trunc from 0x03a67f to 0x03c810 (0x2192 bytes) 000908 1783072774.723111 mapwrite 0x022201 thru 0x02de45 (0xbc45 bytes) 000909 1783072774.776236 trunc from 0x0392be to 0x03c810 (0x3553 bytes) 000910 1783072774.783505 mapwrite 0x0370bb thru 0x03df3e (0x6e84 bytes) 000912 1783072774.860587 punch from 0x001d4e to 0x007bbb (0x5e6e bytes) 000914 1783072774.873619 MIRROR_SPLIT mirror 12 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3df3f): Mirror 4: 0x299bc0df (stale) Mirror 10: 0x299bc0df (stale) Mirror 12: 0x299bc0df (stale) Mirror 14: 0x299bc0df (stale) Mirror 20: 0x299bc0df (stale) Mirror 23: 0x299bc0df (stale) Mirror 25: 0x299bc0df (stale) Mirror 26: 0x299bc0df (stale) Mirror 27: 0x299bc0df (stale) Mirror 28: 0x299bc0df (stale) Mirror 29: 0x299bc0df (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3df3f): Mirror 4: 0x299bc0df (stale) Mirror 10: 0x299bc0df (stale) Mirror 12: 0x299bc0df (stale) Mirror 14: 0x299bc0df (stale) Mirror 20: 0x299bc0df (stale) Mirror 23: 0x299bc0df (stale) Mirror 25: 0x299bc0df (stale) Mirror 26: 0x299bc0df (stale) Mirror 27: 0x299bc0df (stale) Mirror 28: 0x299bc0df (stale) Mirror 29: 0x299bc0df (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3df3f: skipped 000915 1783072775.589009 trunc from 0x02dd01 to 0x0380f2 (0xa3f2 bytes) 000916 1783072775.596584 punch from 0x019489 to 0x0205d2 (0x714a bytes) 000917 1783072775.602306 punch from 0x01b779 to 0x01f322 (0x3baa bytes) 000918 1783072775.608322 fallocate 0x00dafb thru 0x01049c (0x29a2 bytes) 000919 1783072775.621942 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3df3f): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3df3f): Mirror 4: 0x299bc0df (stale) Mirror 10: 0x299bc0df (stale) Mirror 12: 0x299bc0df (stale) Mirror 14: 0x299bc0df (stale) Mirror 20: 0x299bc0df (stale) Mirror 23: 0x299bc0df (stale) Mirror 25: 0x299bc0df (stale) Mirror 26: 0x299bc0df (stale) Mirror 27: 0x299bc0df (stale) Mirror 28: 0x299bc0df (stale) Mirror 29: 0x299bc0df (stale) CRC-32 checksum value for chunk [0, 0x3df3f): Mirror 1: 0x99e1c45 Mirror 30: 0x99e1c45 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3df3f: skipped 000920 1783072776.895013 punch from 0x016212 to 0x02037a (0xa169 bytes) 000921 1783072776.970010 trunc from 0x03df3f to 0x03f352 (0x1414 bytes) 000922 1783072777.019122 write 0x00b9bb thru 0x015352 (0x9998 bytes) 000923 1783072777.051854 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f353): Mirror 10: 0xd4a515fc (stale) Mirror 12: 0xd4a515fc (stale) Mirror 14: 0xd4a515fc (stale) Mirror 20: 0xd4a515fc (stale) Mirror 23: 0xd4a515fc (stale) Mirror 25: 0xd4a515fc (stale) Mirror 26: 0xd4a515fc (stale) Mirror 27: 0xd4a515fc (stale) Mirror 28: 0xd4a515fc (stale) Mirror 29: 0xd4a515fc (stale) Mirror 30: 0x19a07e7f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f353): Mirror 10: 0xd4a515fc (stale) Mirror 12: 0xd4a515fc (stale) Mirror 14: 0xd4a515fc (stale) Mirror 20: 0xd4a515fc (stale) Mirror 23: 0xd4a515fc (stale) Mirror 25: 0xd4a515fc (stale) Mirror 26: 0xd4a515fc (stale) Mirror 27: 0xd4a515fc (stale) Mirror 28: 0xd4a515fc (stale) Mirror 29: 0xd4a515fc (stale) Mirror 30: 0x19a07e7f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f353: skipped 000924 1783072777.751388 trunc from 0x02c91e to 0x02eeed (0x25d0 bytes) 000925 1783072777.756187 mapread 0x00591b thru 0x007eee (0x25d4 bytes) 000926 1783072777.795527 trunc from 0x03f353 to 0x031648 (0xdd0a bytes) 000928 1783072777.829683 fallocate 0x00fb33 thru 0x01da4d (0xdf1b bytes) 000929 1783072777.844874 read 0x010dfd thru 0x014834 (0x3a38 bytes) 000930 1783072777.872095 MIRROR_RESYNC 12 mirrors 000931 1783072781.145180 MIRROR_EXTEND to 13 mirrors 000932 1783072782.210596 mapwrite 0x01ad82 thru 0x02aad1 (0xfd50 bytes) 000933 1783072782.373655 mapwrite 0x03c798 thru 0x03ffff (0x3868 bytes) 000934 1783072782.472455 mapread 0x01e5af thru 0x02742a (0x8e7c bytes) 000935 1783072782.477411 mapwrite 0x02c236 thru 0x03063d (0x4408 bytes) 000936 1783072782.517669 mapread 0x01a5e9 thru 0x01c645 (0x205d bytes) 000937 1783072782.522145 mapread 0x0134cf thru 0x01f244 (0xbd76 bytes) 000938 1783072782.534714 trunc from 0x02968a to 0x02efcc (0x5943 bytes) 000939 1783072782.539832 trunc from 0x01b902 to 0x028493 (0xcb92 bytes) 000940 1783072782.546368 mapread 0x01ed97 thru 0x02bccb (0xcf35 bytes) 000941 1783072782.566754 read 0x01bb42 thru 0x02b817 (0xfcd6 bytes) 000942 1783072782.568821 trunc from 0x03f2c8 to 0x03ffff (0xd38 bytes) 000943 1783072782.573841 trunc from 0x040000 to 0x004d40 (0x3b2bf bytes) 000945 1783072782.592557 mapwrite 0x01fbb2 thru 0x02defc (0xe34b bytes) 000946 1783072782.645956 trunc from 0x02defd to 0x02602b (0x7ed1 bytes) 000947 1783072782.667011 punch from 0x000649 to 0x00ce94 (0xc84c bytes) 000949 1783072782.675011 mapread 0x01af45 thru 0x02602b (0xb0e7 bytes) 000950 1783072782.677316 trunc from 0x00f99f to 0x0160e6 (0x6748 bytes) 000951 1783072782.686240 trunc from 0x010c82 to 0x012500 (0x187f bytes) 000952 1783072782.691889 punch from 0x01a0f5 to 0x02602b (0xbf37 bytes) 000953 1783072782.697352 fallocate 0x01f2e3 thru 0x02cff2 (0xdd10 bytes) 000954 1783072782.702639 trunc from 0x0137f3 to 0x021e8e (0xe69c bytes) 000955 1783072782.709944 read 0x01ab00 thru 0x01b38d (0x88e bytes) 000956 1783072782.729647 fallocate 0x03dd63 thru 0x03ffff (0x229d bytes) 000957 1783072782.734764 fallocate 0x01f9ad thru 0x02b94d (0xbfa1 bytes) 000959 1783072782.745378 read 0x012d68 thru 0x019af0 (0x6d89 bytes) 000960 1783072782.748841 trunc from 0x021753 to 0x02485b (0x3109 bytes) 000961 1783072782.762306 trunc from 0x00c477 to 0x0176eb (0xb275 bytes) 000962 1783072782.769202 read 0x00b777 thru 0x01585a (0xa0e4 bytes) 000964 1783072782.789095 mapwrite 0x000afb thru 0x00228d (0x1793 bytes) 000965 1783072782.817752 write 0x023703 thru 0x023821 (0x11f bytes) 000966 1783072782.821167 trunc from 0x02cff3 to 0x02a81f (0x27d3 bytes) 000967 1783072782.855411 fallocate 0x039e78 thru 0x03ffff (0x6188 bytes) 000968 1783072782.873898 MIRROR_RESYNC 13 mirrors 000969 1783072785.509016 mapread 0x016097 thru 0x0200cb (0xa035 bytes) 000970 1783072785.554407 punch from 0x024805 to 0x02b227 (0x6a23 bytes) 000971 1783072785.619523 write 0x0314dc thru 0x03ff14 (0xea39 bytes) 000972 1783072785.639441 mapread 0x01b5f1 thru 0x01ed3f (0x374f bytes) 000973 1783072785.668025 trunc from 0x040000 to 0x01c7bb (0x23844 bytes) 000974 1783072785.705675 punch from 0x000277 to 0x00b6ab (0xb435 bytes) 000975 1783072785.721931 punch from 0x005020 to 0x007ec5 (0x2ea6 bytes) 000976 1783072785.732419 read 0x01a841 thru 0x01c7bb (0x1f7b bytes) 000977 1783072785.736215 trunc from 0x010a9d to 0x015515 (0x4a79 bytes) 000978 1783072785.746490 fallocate 0x003b37 thru 0x0119b9 (0xde83 bytes) 000979 1783072785.759702 trunc from 0x00f97a to 0x0183b1 (0x8a38 bytes) 000980 1783072785.773214 write 0x03d8b2 thru 0x03ffff (0x274e bytes) 000981 1783072785.774857 write 0x018251 thru 0x024fa7 (0xcd57 bytes) 000982 1783072785.815332 punch from 0x016183 to 0x01769b (0x1519 bytes) 000983 1783072785.824338 mapread 0x01c731 thru 0x024e0d (0x86dd bytes) 000984 1783072785.825714 fallocate 0x00d792 thru 0x01bcba (0xe529 bytes) 000985 1783072785.843002 MIRROR_SPLIT mirror 8 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x2231b5fe (stale) Mirror 12: 0x2231b5fe (stale) Mirror 14: 0x2231b5fe (stale) Mirror 20: 0x2231b5fe (stale) Mirror 23: 0x2231b5fe (stale) Mirror 25: 0x2231b5fe (stale) Mirror 26: 0x2231b5fe (stale) Mirror 28: 0x2231b5fe (stale) Mirror 29: 0x2231b5fe (stale) Mirror 30: 0x2231b5fe (stale) Mirror 31: 0x2231b5fe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x2231b5fe (stale) Mirror 12: 0x2231b5fe (stale) Mirror 14: 0x2231b5fe (stale) Mirror 20: 0x2231b5fe (stale) Mirror 23: 0x2231b5fe (stale) Mirror 25: 0x2231b5fe (stale) Mirror 26: 0x2231b5fe (stale) Mirror 28: 0x2231b5fe (stale) Mirror 29: 0x2231b5fe (stale) Mirror 30: 0x2231b5fe (stale) Mirror 31: 0x2231b5fe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000986 1783072786.669523 punch from 0x01f3f9 to 0x02adf8 (0xba00 bytes) 000987 1783072786.676261 trunc from 0x040000 to 0x012582 (0x2da7d bytes) 000989 1783072786.707079 mapwrite 0x01c482 thru 0x028083 (0xbc02 bytes) 000990 1783072786.806596 punch from 0x00de12 to 0x00f3d3 (0x15c2 bytes) 000991 1783072786.821084 MIRROR_RESYNC 12 mirrors 000992 1783072788.986974 trunc from 0x028084 to 0x0021c6 (0x25ebd bytes) 000993 1783072789.081218 mapwrite 0x01c6b1 thru 0x01cb39 (0x489 bytes) 000994 1783072789.150594 read 0x004b95 thru 0x00d3ad (0x8819 bytes) 000995 1783072789.168055 mapread 0x00ec8b thru 0x010347 (0x16bd bytes) 000996 1783072789.182993 fallocate 0x0345be thru 0x03710b (0x2b4e bytes) 000997 1783072789.193328 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1cb3a): Mirror 10: 0x428c1252 (stale) Mirror 12: 0x428c1252 (stale) Mirror 14: 0x428c1252 (stale) Mirror 23: 0x428c1252 (stale) Mirror 25: 0x428c1252 (stale) Mirror 26: 0x428c1252 (stale) Mirror 28: 0x428c1252 (stale) Mirror 29: 0x428c1252 (stale) Mirror 30: 0x428c1252 (stale) Mirror 31: 0x428c1252 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cb3a): Mirror 10: 0x428c1252 (stale) Mirror 12: 0x428c1252 (stale) Mirror 14: 0x428c1252 (stale) Mirror 23: 0x428c1252 (stale) Mirror 25: 0x428c1252 (stale) Mirror 26: 0x428c1252 (stale) Mirror 28: 0x428c1252 (stale) Mirror 29: 0x428c1252 (stale) Mirror 30: 0x428c1252 (stale) Mirror 31: 0x428c1252 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cb3a: skipped 000998 1783072789.877794 write 0x0357f3 thru 0x03ffff (0xa80d bytes) 000999 1783072789.887926 trunc from 0x0147f2 to 0x019149 (0x4958 bytes) 001000 1783072789.896273 fallocate 0x00dd8c thru 0x01062b (0x28a0 bytes) All operations completed A-OK!