== sanity-flr test 70a: flr mode fsx test ================ 17:23:55 (1785878635) Seed set to 8638 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1785878638.806784 mapwrite 0x021c9e thru 0x0245bd (0x2920 bytes) 000008 1785878639.090792 write 0x019702 thru 0x027417 (0xdd16 bytes) 000011 1785878639.105515 read 0x01d96a thru 0x0202fe (0x2995 bytes) 000013 1785878639.122953 read 0x01c25b thru 0x021af8 (0x589e bytes) truncating to largest ever: 0x3c2e 000016 1785878639.128141 trunc from 0x027418 to 0x003c2d (0x237ea bytes) 000018 1785878639.181242 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x28f70 000022 1785878640.590314 trunc from 0x003c2e to 0x028f6f (0x25342 bytes) 000023 1785878640.735673 mapread 0x001d75 thru 0x008ffb (0x7287 bytes) 000024 1785878640.764970 mapwrite 0x031c52 thru 0x034ccf (0x307e bytes) 000027 1785878640.900218 mapread 0x00c4bc thru 0x010284 (0x3dc9 bytes) 000028 1785878640.903131 trunc from 0x034cd0 to 0x00395a (0x31375 bytes) 000029 1785878640.925446 mapread 0x0004d0 thru 0x00395a (0x348b bytes) 000030 1785878640.933041 trunc from 0x00395b to 0x027248 (0x238ee bytes) 000031 1785878640.959658 write 0x024213 thru 0x026906 (0x26f4 bytes) 000032 1785878640.969253 read 0x015b9c thru 0x0237c2 (0xdc27 bytes) 000034 1785878641.004103 mapwrite 0x024980 thru 0x02ea98 (0xa119 bytes) 000037 1785878641.226749 read 0x00da1e thru 0x01ce21 (0xf404 bytes) 000038 1785878641.295188 MIRROR_RESYNC 2 mirrors 000039 1785878642.695461 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) 000040 1785878642.835863 trunc from 0x02ea99 to 0x00ec6f (0x1fe29 bytes) 000043 1785878642.875235 mapwrite 0x032dab thru 0x03fc11 (0xce67 bytes) 000045 1785878642.963676 mapwrite 0x039670 thru 0x03ffff (0x6990 bytes) 000046 1785878643.036329 mapread 0x01a334 thru 0x01dfe2 (0x3caf bytes) 000048 1785878643.048327 write 0x029f05 thru 0x02b7e8 (0x18e4 bytes) truncating to largest ever: 0x2e12e 000050 1785878643.060244 trunc from 0x040000 to 0x02e12d (0x11ed2 bytes) 000052 1785878643.079479 mapread 0x01bbc4 thru 0x02240c (0x6849 bytes) 000053 1785878643.082020 mapread 0x003e25 thru 0x005610 (0x17ec bytes) 000058 1785878643.099145 mapread 0x02c851 thru 0x02e12d (0x18dd bytes) 000059 1785878643.106073 read 0x00c134 thru 0x0140b9 (0x7f86 bytes) 000063 1785878643.117856 MIRROR_EXTEND to 2 mirrors 000064 1785878644.515154 mapread 0x00e406 thru 0x0185f0 (0xa1eb bytes) 000066 1785878644.542480 write 0x0377ec thru 0x03e7df (0x6ff4 bytes) 000067 1785878644.636185 write 0x00d25e thru 0x01b69f (0xe442 bytes) 000068 1785878644.655814 read 0x02dfeb thru 0x03cb3f (0xeb55 bytes) 000069 1785878644.676452 mapread 0x015081 thru 0x0209b0 (0xb930 bytes) 000071 1785878644.695452 read 0x02466b thru 0x02b7e1 (0x7177 bytes) 000072 1785878644.718227 mapwrite 0x014055 thru 0x02296f (0xe91b bytes) 000074 1785878644.800740 mapwrite 0x003a19 thru 0x00dd6f (0xa357 bytes) 000075 1785878644.893878 mapwrite 0x0075f4 thru 0x00e97d (0x738a bytes) 000076 1785878645.026965 read 0x028b4a thru 0x029ab7 (0xf6e bytes) 000081 1785878645.037490 read 0x02b26a thru 0x033bbe (0x8955 bytes) 000082 1785878645.039325 write 0x00c377 thru 0x015c17 (0x98a1 bytes) 000084 1785878645.052618 MIRROR_RESYNC 2 mirrors 000085 1785878647.296581 mapwrite 0x01b507 thru 0x02a086 (0xeb80 bytes) 000086 1785878647.734125 mapwrite 0x0067dc thru 0x014695 (0xdeba bytes) 000089 1785878647.969119 write 0x005c04 thru 0x0095be (0x39bb bytes) 000092 1785878648.019857 MIRROR_RESYNC 2 mirrors 000093 1785878649.878970 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) 000094 1785878650.063116 MIRROR_EXTEND to 2 mirrors 000095 1785878652.063808 trunc from 0x03e7e0 to 0x02cd5c (0x11a83 bytes) 000097 1785878652.248704 mapread 0x0144a1 thru 0x016367 (0x1ec7 bytes) 000098 1785878652.311052 mapread 0x01097b thru 0x01cb39 (0xc1bf bytes) 000099 1785878652.315956 trunc from 0x02cd5d to 0x0194c0 (0x1389c bytes) 000100 1785878652.375913 write 0x034403 thru 0x03ffff (0xbbfd bytes) 000102 1785878652.380798 read 0x03f1bf thru 0x03ffff (0xe41 bytes) 000103 1785878652.381447 write 0x00f805 thru 0x01b9eb (0xc1e7 bytes) truncating to largest ever: 0x3eb36 000104 1785878652.392519 trunc from 0x040000 to 0x03eb35 (0x14ca bytes) 000105 1785878652.411509 trunc from 0x03eb36 to 0x00be52 (0x32ce3 bytes) 000108 1785878652.452966 MIRROR_RESYNC 2 mirrors 000110 1785878653.893473 mapread 0x00ad61 thru 0x00be52 (0x10f2 bytes) 000112 1785878653.914841 mapread 0x0077d7 thru 0x00be52 (0x467c bytes) truncating to largest ever: 0x3f10b 000113 1785878653.924009 trunc from 0x00be53 to 0x03f10a (0x332b8 bytes) 000117 1785878654.222231 write 0x00be44 thru 0x013732 (0x78ef bytes) 000120 1785878654.241280 mapread 0x0228ea thru 0x030a46 (0xe15d bytes) 000122 1785878654.314405 write 0x00d3af thru 0x01c939 (0xf58b bytes) 000125 1785878654.322338 write 0x02bdc1 thru 0x03614d (0xa38d bytes) 000126 1785878654.352141 mapread 0x01b329 thru 0x02a1b9 (0xee91 bytes) 000128 1785878654.370877 MIRROR_RESYNC 2 mirrors 000129 1785878656.031783 write 0x01aa0e thru 0x0239ee (0x8fe1 bytes) 000130 1785878656.226117 mapwrite 0x02fdac thru 0x03f921 (0xfb76 bytes) 000131 1785878656.528112 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) 000132 1785878656.890806 read 0x0088ef thru 0x012e00 (0xa512 bytes) 000134 1785878656.924344 read 0x0162b7 thru 0x01fccf (0x9a19 bytes) 000135 1785878656.980311 read 0x024e8b thru 0x0296b4 (0x482a bytes) 000137 1785878656.983938 mapread 0x03101a thru 0x03d434 (0xc41b bytes) 000138 1785878656.986072 mapwrite 0x035d8c thru 0x03ffff (0xa274 bytes) 000139 1785878657.132386 trunc from 0x040000 to 0x0223a9 (0x1dc56 bytes) 000140 1785878657.208847 write 0x0039df thru 0x00eb49 (0xb16b bytes) 000142 1785878657.213756 mapwrite 0x019ebe thru 0x02366c (0x97af bytes) 000143 1785878657.375220 read 0x0177e0 thru 0x02366c (0xbe8d bytes) 000146 1785878657.377201 mapread 0x0043f8 thru 0x0120f7 (0xdd00 bytes) 000147 1785878657.389791 read 0x01002f thru 0x013244 (0x3216 bytes) 000149 1785878657.399922 read 0x01cbb6 thru 0x01fdf2 (0x323d bytes) 000151 1785878657.407607 mapwrite 0x0123cd thru 0x01c396 (0x9fca bytes) 000152 1785878657.509955 write 0x01a430 thru 0x029a9d (0xf66e bytes) 000153 1785878657.525996 mapwrite 0x036da8 thru 0x03ffff (0x9258 bytes) 000154 1785878657.765115 mapread 0x035ed1 thru 0x03c531 (0x6661 bytes) 000155 1785878657.778627 mapread 0x00ef72 thru 0x00f274 (0x303 bytes) 000156 1785878657.786814 read 0x03d210 thru 0x03ffff (0x2df0 bytes) 000157 1785878657.787729 trunc from 0x040000 to 0x017681 (0x2897e bytes) 000158 1785878657.823284 mapwrite 0x0107ef thru 0x011b8d (0x139f bytes) 000159 1785878657.872258 mapread 0x015baa thru 0x017681 (0x1ad8 bytes) 000160 1785878657.875400 read 0x010449 thru 0x015303 (0x4ebb bytes) 000161 1785878657.877024 mapwrite 0x01e7bd thru 0x027885 (0x90c9 bytes) 000163 1785878658.152688 write 0x00e9f7 thru 0x0159db (0x6fe5 bytes) 000164 1785878658.160768 write 0x02c172 thru 0x0390ce (0xcf5d bytes) 000166 1785878658.170885 read 0x00d6de thru 0x00eef7 (0x181a bytes) 000168 1785878658.182850 read 0x01aa1a thru 0x023627 (0x8c0e bytes) 000169 1785878658.186278 read 0x01355d thru 0x02272d (0xf1d1 bytes) 000170 1785878658.189337 write 0x016c4a thru 0x016ee6 (0x29d bytes) 000173 1785878658.199099 trunc from 0x0390cf to 0x03e183 (0x50b5 bytes) 000175 1785878658.261901 trunc from 0x03e184 to 0x006a2b (0x37758 bytes) 000176 1785878658.301916 trunc from 0x006a2c to 0x03ac00 (0x341d5 bytes) 000178 1785878658.387128 read 0x034f68 thru 0x03ac00 (0x5c99 bytes) 000180 1785878658.437914 mapwrite 0x03e5cf thru 0x03ffff (0x1a31 bytes) 000181 1785878658.687840 mapread 0x02a64b thru 0x0300a0 (0x5a56 bytes) 000182 1785878658.694275 write 0x00bb23 thru 0x013fdc (0x84ba bytes) 000184 1785878658.701153 mapwrite 0x003a33 thru 0x0131eb (0xf7b9 bytes) 000187 1785878658.918645 read 0x036f03 thru 0x03d65d (0x675b bytes) 000189 1785878658.928573 read 0x018c76 thru 0x0198be (0xc49 bytes) 000190 1785878658.939804 MIRROR_EXTEND to 2 mirrors 000193 1785878660.773049 mapwrite 0x039df1 thru 0x03d160 (0x3370 bytes) 000195 1785878661.237131 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) 000197 1785878661.566061 MIRROR_EXTEND to 2 mirrors 000200 1785878663.491576 mapread 0x030997 thru 0x036693 (0x5cfd bytes) 000201 1785878663.536156 read 0x00bb38 thru 0x017d06 (0xc1cf bytes) 000202 1785878663.547972 mapread 0x008b5f thru 0x017309 (0xe7ab bytes) 000203 1785878663.560082 write 0x03ad66 thru 0x03ffff (0x529a bytes) 000204 1785878663.744914 mapread 0x035e2f thru 0x03c8a5 (0x6a77 bytes) 000206 1785878663.757026 trunc from 0x040000 to 0x03ab21 (0x54de bytes) 000211 1785878663.826230 write 0x0204d2 thru 0x02d5da (0xd109 bytes) 000212 1785878663.855158 write 0x039794 thru 0x03a63d (0xeaa bytes) 000213 1785878663.860156 read 0x01cee0 thru 0x020a99 (0x3bba bytes) 000214 1785878663.895556 write 0x0157cb thru 0x01a170 (0x49a6 bytes) 000219 1785878663.907393 write 0x03f252 thru 0x03ffff (0xdae bytes) 000221 1785878663.913055 mapread 0x01c895 thru 0x01ddcc (0x1538 bytes) 000222 1785878663.915350 mapwrite 0x030ff5 thru 0x03d18b (0xc197 bytes) 000223 1785878664.164996 trunc from 0x040000 to 0x0166ad (0x29952 bytes) 000224 1785878664.211480 write 0x019edf thru 0x025c69 (0xbd8b bytes) 000227 1785878664.219822 mapwrite 0x02bb19 thru 0x03aa28 (0xef10 bytes) 000228 1785878664.638449 trunc from 0x03aa29 to 0x023bf1 (0x16e37 bytes) 000230 1785878664.678373 mapread 0x022d82 thru 0x023bf1 (0xe70 bytes) 000231 1785878664.681607 read 0x01b129 thru 0x01c1ff (0x10d7 bytes) 000232 1785878664.688241 mapwrite 0x0296ac thru 0x02b745 (0x209a bytes) 000234 1785878664.809794 mapwrite 0x00fb16 thru 0x011079 (0x1564 bytes) 000235 1785878664.860183 mapwrite 0x0232e9 thru 0x024fc0 (0x1cd8 bytes) 000237 1785878664.912503 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2b746): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b746): Mirror 2: 0xa02c7916 (stale) CRC-32 checksum value for chunk [0, 0x2b746): Mirror 1: 0xca68917f Mirror 3: 0xca68917f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b746: skipped 000238 1785878666.574817 read 0x01d305 thru 0x021bb0 (0x48ac bytes) 000239 1785878666.584386 trunc from 0x02b746 to 0x025994 (0x5db1 bytes) 000242 1785878666.795712 mapread 0x01d49b thru 0x01eadc (0x1642 bytes) 000243 1785878666.820552 write 0x01ea55 thru 0x01fbb1 (0x115d bytes) 000244 1785878666.828627 write 0x005591 thru 0x0153cc (0xfe3c bytes) 000245 1785878666.842279 mapread 0x01787c thru 0x019249 (0x19ce bytes) 000246 1785878666.857092 read 0x024339 thru 0x025994 (0x165c bytes) 000247 1785878666.878380 trunc from 0x025995 to 0x00ddf7 (0x17b9d bytes) 000248 1785878666.918576 read 0x00c759 thru 0x00ddf7 (0x169f bytes) 000250 1785878666.919722 write 0x0045e5 thru 0x00a69c (0x60b8 bytes) 000252 1785878666.925377 read 0x00700d thru 0x00ddf7 (0x6deb bytes) 000253 1785878666.931131 MIRROR_RESYNC 3 mirrors 000256 1785878667.611948 MIRROR_EXTEND to 4 mirrors 000258 1785878668.907253 mapwrite 0x027f56 thru 0x0362bb (0xe366 bytes) 000261 1785878669.072082 read 0x01ddc7 thru 0x027337 (0x9571 bytes) 000262 1785878669.099437 mapread 0x01d658 thru 0x024f3c (0x78e5 bytes) 000265 1785878669.115937 mapwrite 0x00b958 thru 0x018d15 (0xd3be bytes) 000266 1785878669.392886 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x362bc): Mirror 3: 0x1578807d (stale) Mirror 4: 0x1578807d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x362bc): Mirror 3: 0x1578807d (stale) Mirror 4: 0x1578807d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x362bc: skipped 000269 1785878670.028058 trunc from 0x0362bc to 0x037d44 (0x1a89 bytes) 000270 1785878670.046930 trunc from 0x037d45 to 0x0339d3 (0x4371 bytes) 000271 1785878670.062725 trunc from 0x0339d4 to 0x00373d (0x30296 bytes) 000276 1785878670.084980 mapread 0x001027 thru 0x00373d (0x2717 bytes) 000277 1785878670.103361 mapread 0x000edb thru 0x00373d (0x2863 bytes) 000278 1785878670.111255 write 0x03c945 thru 0x03ffff (0x36bb bytes) 000279 1785878670.115113 mapwrite 0x021c2b thru 0x0284d7 (0x68ad bytes) 000280 1785878670.313709 mapread 0x00dea6 thru 0x0175f8 (0x9753 bytes) 000282 1785878670.348015 mapwrite 0x03b2f2 thru 0x03ffff (0x4d0e bytes) 000284 1785878670.514956 mapwrite 0x03b728 thru 0x03ffff (0x48d8 bytes) 000285 1785878670.684090 write 0x01fd3e thru 0x02031a (0x5dd bytes) 000287 1785878670.687838 mapwrite 0x002b97 thru 0x005e89 (0x32f3 bytes) 000290 1785878670.940462 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb9206067 (stale) Mirror 4: 0xb9206067 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf286d2f8 Mirror 5: 0xf286d2f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000292 1785878672.824594 mapread 0x02794e thru 0x037758 (0xfe0b bytes) 000296 1785878672.941794 MIRROR_RESYNC 4 mirrors 000299 1785878675.899786 mapread 0x007228 thru 0x00b5dc (0x43b5 bytes) 000301 1785878675.996313 mapwrite 0x035cb9 thru 0x03bf58 (0x62a0 bytes) 000306 1785878676.401409 write 0x019cc7 thru 0x0228d9 (0x8c13 bytes) 000308 1785878676.445675 MIRROR_RESYNC 4 mirrors 000310 1785878679.853810 trunc from 0x040000 to 0x02c8f7 (0x13708 bytes) 000311 1785878680.006078 mapwrite 0x010e2a thru 0x012b53 (0x1d2a bytes) 000312 1785878680.182637 mapwrite 0x01f231 thru 0x020799 (0x1569 bytes) 000316 1785878680.276057 read 0x0068db thru 0x009989 (0x30af bytes) 000319 1785878680.297045 read 0x01013f thru 0x01f0ea (0xefac bytes) 000320 1785878680.299451 mapread 0x0266c2 thru 0x028e66 (0x27a5 bytes) 000322 1785878680.319457 mapwrite 0x018f04 thru 0x02365c (0xa759 bytes) 000324 1785878680.373214 mapwrite 0x01602e thru 0x01a406 (0x43d9 bytes) 000325 1785878680.410068 mapwrite 0x037a3a thru 0x03f96f (0x7f36 bytes) 000328 1785878680.473449 write 0x030cf2 thru 0x031f81 (0x1290 bytes) 000330 1785878680.476297 mapwrite 0x02aac4 thru 0x03906a (0xe5a7 bytes) 000331 1785878680.525286 write 0x00043c thru 0x005ee5 (0x5aaa bytes) 000332 1785878680.538728 MIRROR_RESYNC 4 mirrors 000333 1785878682.932512 trunc from 0x03f970 to 0x01720e (0x28761 bytes) 000334 1785878683.033681 mapread 0x015e2a thru 0x01720e (0x13e5 bytes) 000336 1785878683.069641 trunc from 0x01720f to 0x012fb0 (0x425e bytes) 000338 1785878683.102970 trunc from 0x012fb1 to 0x027690 (0x146e0 bytes) 000340 1785878683.132114 trunc from 0x027691 to 0x02ea7b (0x73eb bytes) 000341 1785878683.155703 mapwrite 0x00f180 thru 0x0136e9 (0x456a bytes) 000343 1785878683.238505 mapread 0x002f2d thru 0x0088b4 (0x5988 bytes) 000345 1785878683.254004 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ea7c): Mirror 4: 0x32f794c0 (stale) Mirror 5: 0x32f794c0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ea7c): Mirror 4: 0x32f794c0 (stale) Mirror 5: 0x32f794c0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ea7c: skipped 000347 1785878684.029481 write 0x013dc7 thru 0x01f7a7 (0xb9e1 bytes) 000348 1785878684.065805 write 0x012377 thru 0x020e63 (0xeaed bytes) 000350 1785878684.088748 write 0x030d41 thru 0x03e489 (0xd749 bytes) 000351 1785878684.090938 mapread 0x03a45b thru 0x03e489 (0x402f bytes) 000352 1785878684.095669 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e48a): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e48a): Mirror 4: 0x12720f66 (stale) Mirror 5: 0x12720f66 (stale) CRC-32 checksum value for chunk [0, 0x3e48a): Mirror 1: 0x3b663f7d Mirror 6: 0x3b663f7d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e48a: skipped 000353 1785878686.068191 read 0x001d6c thru 0x009784 (0x7a19 bytes) 000354 1785878686.081273 write 0x02c1f8 thru 0x03962c (0xd435 bytes) 000355 1785878686.358932 trunc from 0x03e48a to 0x02e067 (0x10422 bytes) 000356 1785878686.436409 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2e068): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e068): Mirror 4: 0x43939125 (stale) Mirror 5: 0x43939125 (stale) Mirror 6: 0xe28f362 (stale) CRC-32 checksum value for chunk [0, 0x2e068): Mirror 1: 0x4c29050e Mirror 7: 0x4c29050e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e068: skipped 000357 1785878688.622852 write 0x01118c thru 0x0120c2 (0xf37 bytes) 000358 1785878688.782501 read 0x02a4f6 thru 0x02e067 (0x3b72 bytes) 000359 1785878688.790313 read 0x008c42 thru 0x0181c7 (0xf586 bytes) 000360 1785878688.800963 read 0x011869 thru 0x016157 (0x48ef bytes) 000367 1785878688.812829 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e068): Mirror 4: 0x43939125 (stale) Mirror 5: 0x43939125 (stale) Mirror 6: 0xe28f362 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e068): Mirror 4: 0x43939125 (stale) Mirror 5: 0x43939125 (stale) Mirror 6: 0xe28f362 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e068: skipped 000368 1785878689.429920 mapread 0x01becf thru 0x026867 (0xa999 bytes) 000369 1785878689.493219 write 0x0164ec thru 0x01c12d (0x5c42 bytes) 000372 1785878689.495451 mapwrite 0x02791d thru 0x02a40f (0x2af3 bytes) 000375 1785878689.636266 write 0x034108 thru 0x03ea76 (0xa96f bytes) 000376 1785878689.642410 trunc from 0x03ea77 to 0x02651d (0x18559 bytes) 000377 1785878689.720471 trunc from 0x02651e to 0x027890 (0x1373 bytes) 000378 1785878689.740395 mapwrite 0x03ffbf thru 0x03ffff (0x41 bytes) 000380 1785878689.872900 trunc from 0x040000 to 0x02ac4e (0x153b1 bytes) 000383 1785878689.902844 write 0x02bce1 thru 0x032548 (0x6868 bytes) 000384 1785878689.919695 MIRROR_RESYNC 4 mirrors 000385 1785878692.184065 MIRROR_EXTEND to 5 mirrors 000387 1785878694.077992 write 0x0060bc thru 0x010144 (0xa089 bytes) 000389 1785878694.377688 trunc from 0x032549 to 0x03899f (0x6457 bytes) 000390 1785878694.437099 mapwrite 0x014850 thru 0x01b731 (0x6ee2 bytes) 000391 1785878694.657798 mapwrite 0x02a64e thru 0x0373b9 (0xcd6c bytes) 000392 1785878694.837851 trunc from 0x0389a0 to 0x02513f (0x13860 bytes) 000393 1785878694.876989 write 0x002317 thru 0x0094b1 (0x719b bytes) 000394 1785878694.917843 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x25140): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25140): Mirror 4: 0xc7cea7c (stale) Mirror 5: 0xc7cea7c (stale) Mirror 6: 0xc7cea7c (stale) Mirror 7: 0xc7cea7c (stale) CRC-32 checksum value for chunk [0, 0x25140): Mirror 1: 0xa38a102d Mirror 8: 0xa38a102d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25140: skipped 000395 1785878697.221596 trunc from 0x025140 to 0x01fe80 (0x52bf bytes) 000396 1785878697.501410 mapread 0x00edfd thru 0x017fbd (0x91c1 bytes) 000397 1785878697.559408 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1fe81): Mirror 5: 0x1959ebec (stale) Mirror 6: 0x1959ebec (stale) Mirror 7: 0x1959ebec (stale) Mirror 8: 0x3078b01f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fe81): Mirror 5: 0x1959ebec (stale) Mirror 6: 0x1959ebec (stale) Mirror 7: 0x1959ebec (stale) Mirror 8: 0x3078b01f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fe81: skipped 000398 1785878698.317157 mapread 0x0132d7 thru 0x01fe80 (0xcbaa bytes) 000400 1785878698.385089 mapread 0x0115c6 thru 0x01ebb3 (0xd5ee bytes) 000401 1785878698.391147 trunc from 0x01fe81 to 0x015de9 (0xa097 bytes) 000402 1785878698.434633 MIRROR_RESYNC 5 mirrors 000403 1785878700.391096 write 0x026202 thru 0x033361 (0xd160 bytes) 000404 1785878700.515939 read 0x02a8d8 thru 0x02bae8 (0x1211 bytes) 000405 1785878700.517099 mapread 0x01d944 thru 0x026bff (0x92bc bytes) 000409 1785878700.568021 read 0x0230b7 thru 0x02a86f (0x77b9 bytes) 000410 1785878700.572699 mapwrite 0x0332fb thru 0x039bfc (0x6902 bytes) 000411 1785878700.759071 read 0x01a404 thru 0x028ba1 (0xe79e bytes) 000412 1785878700.759905 read 0x02ad61 thru 0x030c4e (0x5eee bytes) 000418 1785878700.772031 write 0x025003 thru 0x0335bb (0xe5b9 bytes) 000419 1785878700.777928 trunc from 0x039bfd to 0x026f4a (0x12cb2 bytes) 000420 1785878700.797214 mapwrite 0x0045a6 thru 0x00f05d (0xaab8 bytes) 000421 1785878700.983494 mapread 0x013cdc thru 0x01de6d (0xa192 bytes) 000423 1785878700.985404 read 0x00d6da thru 0x01c071 (0xe998 bytes) 000425 1785878700.989889 write 0x007766 thru 0x011117 (0x99b2 bytes) 000426 1785878701.005704 MIRROR_RESYNC 5 mirrors 000428 1785878702.498467 mapread 0x01232c thru 0x02229c (0xff71 bytes) 000431 1785878702.527381 MIRROR_RESYNC 5 mirrors 000432 1785878703.033982 mapread 0x00d9ac thru 0x016181 (0x87d6 bytes) 000434 1785878703.046056 MIRROR_RESYNC 5 mirrors 000436 1785878704.078646 MIRROR_RESYNC 5 mirrors 000438 1785878704.833625 write 0x028a3d thru 0x02c6db (0x3c9f bytes) 000439 1785878705.085139 mapread 0x019f53 thru 0x0270ce (0xd17c bytes) 000440 1785878705.186494 mapread 0x0079c3 thru 0x0177f5 (0xfe33 bytes) 000443 1785878705.234230 write 0x0242b2 thru 0x0332d0 (0xf01f bytes) 000445 1785878705.241338 mapread 0x005bba thru 0x0095d1 (0x3a18 bytes) 000446 1785878705.258475 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x332d1): Mirror 5: 0x1efe16fe (stale) Mirror 6: 0x1efe16fe (stale) Mirror 7: 0x1efe16fe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x332d1): Mirror 5: 0x1efe16fe (stale) Mirror 6: 0x1efe16fe (stale) Mirror 7: 0x1efe16fe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x332d1: skipped 000451 1785878706.295263 MIRROR_RESYNC 4 mirrors 000452 1785878708.358491 trunc from 0x0332d1 to 0x023469 (0xfe67 bytes) 000453 1785878708.506872 MIRROR_RESYNC 4 mirrors 000454 1785878711.023167 mapwrite 0x007b00 thru 0x0134ab (0xb9ac bytes) 000456 1785878711.495596 read 0x022b92 thru 0x023469 (0x8d8 bytes) 000457 1785878711.509989 write 0x017d0c thru 0x0261ca (0xe4bf bytes) 000461 1785878711.521566 mapwrite 0x00d11d thru 0x014016 (0x6efa bytes) 000462 1785878711.736208 read 0x01cf5d thru 0x01d271 (0x315 bytes) 000464 1785878711.750649 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x261cb): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x261cb): Mirror 5: 0xd0ca65d0 (stale) Mirror 6: 0xd0ca65d0 (stale) Mirror 7: 0xd0ca65d0 (stale) CRC-32 checksum value for chunk [0, 0x261cb): Mirror 1: 0x468a0506 Mirror 8: 0x468a0506 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x261cb: skipped 000466 1785878713.750249 write 0x008a24 thru 0x00c089 (0x3666 bytes) 000468 1785878713.969124 read 0x0247d5 thru 0x0261ca (0x19f6 bytes) 000471 1785878713.975069 write 0x03b832 thru 0x03dc1b (0x23ea bytes) 000473 1785878713.987201 write 0x0198fd thru 0x0280aa (0xe7ae bytes) 000475 1785878714.022423 MIRROR_RESYNC 5 mirrors 000476 1785878717.012588 trunc from 0x03dc1c to 0x013afa (0x2a121 bytes) 000477 1785878717.227880 trunc from 0x013afb to 0x02ff78 (0x1c47e bytes) 000478 1785878717.289400 read 0x00e703 thru 0x0120c3 (0x39c1 bytes) 000482 1785878717.308008 mapwrite 0x00715f thru 0x0147ad (0xd64f bytes) 000485 1785878717.598474 read 0x0084e3 thru 0x00febd (0x79db bytes) 000486 1785878717.610675 MIRROR_RESYNC 5 mirrors 000488 1785878719.877888 mapread 0x00bb72 thru 0x00edcd (0x325c bytes) 000491 1785878719.928054 read 0x0023f5 thru 0x00a7cf (0x83db bytes) 000492 1785878719.946304 write 0x03f462 thru 0x03ffff (0xb9e bytes) 000493 1785878720.196518 write 0x00fa4f thru 0x015c4a (0x61fc bytes) 000494 1785878720.226016 mapread 0x0362ff thru 0x03f334 (0x9036 bytes) 000496 1785878720.254430 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x1e225cd2 (stale) Mirror 6: 0x1e225cd2 (stale) Mirror 7: 0x1e225cd2 (stale) Mirror 8: 0x1e225cd2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcd601a1d Mirror 9: 0xcd601a1d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000497 1785878722.568888 read 0x02da1b thru 0x035f38 (0x851e bytes) 000500 1785878722.600774 write 0x024477 thru 0x02eef9 (0xaa83 bytes) 000501 1785878722.849920 mapread 0x00ad03 thru 0x018d60 (0xe05e bytes) 000502 1785878722.945574 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x1e225cd2 (stale) Mirror 6: 0x1e225cd2 (stale) Mirror 7: 0x1e225cd2 (stale) Mirror 8: 0x1e225cd2 (stale) Mirror 9: 0xcd601a1d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdecc225a Mirror 10: 0xdecc225a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000503 1785878725.314581 write 0x021f43 thru 0x02c49d (0xa55b bytes) 000504 1785878725.630092 mapread 0x02e3c3 thru 0x036e94 (0x8ad2 bytes) 000506 1785878725.733853 mapwrite 0x02ce9c thru 0x03bc79 (0xedde bytes) 000509 1785878725.920977 mapread 0x021bb8 thru 0x02a511 (0x895a bytes) 000510 1785878725.927186 mapwrite 0x035b32 thru 0x03ffff (0xa4ce bytes) 000511 1785878726.079999 trunc from 0x040000 to 0x00411e (0x3bee1 bytes) 000512 1785878726.142453 trunc from 0x00411f to 0x023405 (0x1f2e7 bytes) 000513 1785878726.166050 write 0x00d6ce thru 0x010f48 (0x387b bytes) 000515 1785878726.197584 trunc from 0x023406 to 0x029dd4 (0x69cf bytes) 000516 1785878726.233613 write 0x0348c4 thru 0x039bf9 (0x5336 bytes) 000519 1785878726.240799 trunc from 0x039bfa to 0x00f6c7 (0x2a532 bytes) 000521 1785878726.287763 read 0x0004f5 thru 0x0085da (0x80e6 bytes) 000522 1785878726.306207 mapread 0x007313 thru 0x00f6c7 (0x83b5 bytes) 000525 1785878726.317778 mapwrite 0x010783 thru 0x015bc9 (0x5447 bytes) 000528 1785878726.564946 mapwrite 0x0192c7 thru 0x0269a3 (0xd6dd bytes) 000529 1785878726.830828 write 0x01c94d thru 0x0294c0 (0xcb74 bytes) 000532 1785878726.839808 trunc from 0x0294c1 to 0x039ca3 (0x107e3 bytes) 000534 1785878726.894494 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39ca4): Mirror 5: 0x9b68ae38 (stale) Mirror 6: 0x9b68ae38 (stale) Mirror 7: 0x9b68ae38 (stale) Mirror 9: 0x58e0848f (stale) Mirror 10: 0xc90a42e8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39ca4): Mirror 5: 0x9b68ae38 (stale) Mirror 6: 0x9b68ae38 (stale) Mirror 7: 0x9b68ae38 (stale) Mirror 9: 0x58e0848f (stale) Mirror 10: 0xc90a42e8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39ca4: skipped 000537 1785878727.688170 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39ca4): Mirror 6: 0x9b68ae38 (stale) Mirror 7: 0x9b68ae38 (stale) Mirror 9: 0x58e0848f (stale) Mirror 10: 0xc90a42e8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39ca4): Mirror 6: 0x9b68ae38 (stale) Mirror 7: 0x9b68ae38 (stale) Mirror 9: 0x58e0848f (stale) Mirror 10: 0xc90a42e8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39ca4: skipped 000538 1785878728.664963 mapread 0x00f9f4 thru 0x01b555 (0xbb62 bytes) 000540 1785878728.739678 trunc from 0x039ca4 to 0x01248f (0x27814 bytes) 000541 1785878728.788230 mapwrite 0x0351bc thru 0x03e8da (0x971f bytes) 000544 1785878729.006588 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3e8db): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e8db): Mirror 6: 0x2764aff9 (stale) Mirror 7: 0x2764aff9 (stale) Mirror 9: 0x277a5548 (stale) Mirror 10: 0x2183168b (stale) CRC-32 checksum value for chunk [0, 0x3e8db): Mirror 1: 0xce60f57c Mirror 11: 0xce60f57c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e8db: skipped 000546 1785878730.864704 write 0x03a0a3 thru 0x03ffff (0x5f5d bytes) 000547 1785878730.991786 write 0x00b8a0 thru 0x018259 (0xc9ba bytes) 000550 1785878731.040462 mapwrite 0x0270fa thru 0x02d052 (0x5f59 bytes) 000551 1785878731.247495 mapwrite 0x01fb19 thru 0x024b08 (0x4ff0 bytes) 000553 1785878731.332168 read 0x02ad14 thru 0x02beb8 (0x11a5 bytes) 000554 1785878731.335379 read 0x01c165 thru 0x01ed89 (0x2c25 bytes) 000557 1785878731.346770 write 0x002378 thru 0x004d6a (0x29f3 bytes) 000558 1785878731.428334 MIRROR_RESYNC 6 mirrors 000562 1785878734.892493 mapread 0x013d06 thru 0x017a5a (0x3d55 bytes) 000565 1785878734.970330 write 0x01e2b6 thru 0x02700f (0x8d5a bytes) 000567 1785878735.187685 mapread 0x021304 thru 0x027d7d (0x6a7a bytes) 000568 1785878735.192031 write 0x02589c thru 0x03299b (0xd100 bytes) 000569 1785878735.209123 trunc from 0x040000 to 0x02dd6d (0x12292 bytes) 000571 1785878735.247758 mapwrite 0x039fae thru 0x03ffff (0x6052 bytes) 000572 1785878735.464406 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x62e5e0e0 (stale) Mirror 7: 0x62e5e0e0 (stale) Mirror 9: 0x62e5e0e0 (stale) Mirror 11: 0x62e5e0e0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x62e5e0e0 (stale) Mirror 7: 0x62e5e0e0 (stale) Mirror 9: 0x62e5e0e0 (stale) Mirror 11: 0x62e5e0e0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000574 1785878736.121324 write 0x00c0de thru 0x01ae34 (0xed57 bytes) 000575 1785878736.146932 MIRROR_RESYNC 5 mirrors 000576 1785878739.069437 mapread 0x031633 thru 0x032687 (0x1055 bytes) 000577 1785878739.100819 mapwrite 0x000144 thru 0x00a92e (0xa7eb bytes) 000578 1785878739.650397 mapwrite 0x02a145 thru 0x0371fb (0xd0b7 bytes) 000580 1785878739.954554 trunc from 0x040000 to 0x0394d2 (0x6b2d bytes) 000581 1785878740.016451 read 0x02b887 thru 0x030977 (0x50f1 bytes) 000582 1785878740.017181 mapwrite 0x023a2d thru 0x02a140 (0x6714 bytes) 000583 1785878740.180203 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x394d3): Mirror 7: 0x8eadba9d (stale) Mirror 9: 0x8eadba9d (stale) Mirror 11: 0x8eadba9d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x394d3): Mirror 7: 0x8eadba9d (stale) Mirror 9: 0x8eadba9d (stale) Mirror 11: 0x8eadba9d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x394d3: skipped 000584 1785878741.092919 mapwrite 0x027086 thru 0x02c5df (0x555a bytes) 000585 1785878741.347838 write 0x025a75 thru 0x02657f (0xb0b bytes) 000587 1785878741.401360 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x394d3): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x394d3): Mirror 7: 0x8eadba9d (stale) Mirror 9: 0x8eadba9d (stale) Mirror 11: 0x8eadba9d (stale) CRC-32 checksum value for chunk [0, 0x394d3): Mirror 1: 0xe4dfdbc5 Mirror 12: 0xe4dfdbc5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x394d3: skipped 000588 1785878743.650863 mapread 0x022e91 thru 0x02c1b9 (0x9329 bytes) 000589 1785878743.732057 mapwrite 0x0370ea thru 0x03d408 (0x631f bytes) 000590 1785878744.191563 mapwrite 0x03b893 thru 0x03ffff (0x476d bytes) 000591 1785878744.504395 mapwrite 0x021a0e thru 0x02a004 (0x85f7 bytes) 000592 1785878744.737082 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x9b13110 (stale) Mirror 9: 0x9b13110 (stale) Mirror 11: 0x9b13110 (stale) Mirror 12: 0x647ddbad (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb76799e4 Mirror 13: 0xb76799e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000596 1785878747.434814 MIRROR_RESYNC 6 mirrors 000597 1785878750.940475 trunc from 0x040000 to 0x004950 (0x3b6af bytes) 000598 1785878751.234933 mapwrite 0x02ab3e thru 0x0331a5 (0x8668 bytes) 000599 1785878751.586998 trunc from 0x0331a6 to 0x037d7c (0x4bd7 bytes) 000600 1785878751.649151 read 0x020d32 thru 0x0269a5 (0x5c74 bytes) 000601 1785878751.664269 mapread 0x01f6a0 thru 0x0286da (0x903b bytes) 000602 1785878751.684058 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x37d7d): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37d7d): Mirror 7: 0xe5930240 (stale) Mirror 9: 0xe5930240 (stale) Mirror 11: 0xe5930240 (stale) Mirror 12: 0xe5930240 (stale) Mirror 13: 0xe5930240 (stale) CRC-32 checksum value for chunk [0, 0x37d7d): Mirror 1: 0xf0acb5fd Mirror 14: 0xf0acb5fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37d7d: skipped 000604 1785878755.697566 write 0x03a18e thru 0x03ffff (0x5e72 bytes) 000605 1785878756.140167 read 0x0064d3 thru 0x0117f6 (0xb324 bytes) 000606 1785878756.203554 read 0x031142 thru 0x037926 (0x67e5 bytes) 000610 1785878756.246700 mapread 0x01fe4f thru 0x02ce18 (0xcfca bytes) 000612 1785878756.270028 mapread 0x006028 thru 0x00fa9d (0x9a76 bytes) 000613 1785878756.278301 read 0x03ac60 thru 0x03ffff (0x53a0 bytes) 000614 1785878756.279296 read 0x01d61c thru 0x02c27b (0xec60 bytes) 000617 1785878756.310224 mapwrite 0x01dd37 thru 0x0285b9 (0xa883 bytes) 000619 1785878756.472794 write 0x01bddd thru 0x01dac1 (0x1ce5 bytes) 000621 1785878756.474475 write 0x01df50 thru 0x024528 (0x65d9 bytes) 000623 1785878756.490199 trunc from 0x040000 to 0x01af26 (0x250d9 bytes) 000624 1785878756.563489 MIRROR_RESYNC 7 mirrors 000627 1785878760.284645 MIRROR_RESYNC 7 mirrors 000628 1785878761.352467 mapwrite 0x02ebec thru 0x02fa89 (0xe9e bytes) 000630 1785878761.830660 read 0x001b41 thru 0x00e72c (0xcbec bytes) 000632 1785878761.871868 trunc from 0x02fa8a to 0x02b567 (0x4522 bytes) 000633 1785878761.957417 read 0x002521 thru 0x0088e8 (0x63c8 bytes) 000634 1785878761.962936 mapread 0x020298 thru 0x0280eb (0x7e54 bytes) 000637 1785878762.011708 trunc from 0x02b568 to 0x011dd9 (0x1978e bytes) 000638 1785878762.100958 write 0x02fb47 thru 0x0390b2 (0x956c bytes) 000640 1785878762.113438 mapread 0x033533 thru 0x0390b2 (0x5b80 bytes) 000641 1785878762.114626 trunc from 0x0390b3 to 0x016367 (0x22d4b bytes) 000642 1785878762.219470 read 0x012b0c thru 0x0145d3 (0x1ac8 bytes) 000643 1785878762.238052 read 0x00cee0 thru 0x00d6e3 (0x804 bytes) 000645 1785878762.262345 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16368): Mirror 9: 0x6b36b223 (stale) Mirror 11: 0x6b36b223 (stale) Mirror 12: 0x6b36b223 (stale) Mirror 13: 0x6b36b223 (stale) Mirror 14: 0x6b36b223 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16368): Mirror 9: 0x6b36b223 (stale) Mirror 11: 0x6b36b223 (stale) Mirror 12: 0x6b36b223 (stale) Mirror 13: 0x6b36b223 (stale) Mirror 14: 0x6b36b223 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16368: skipped 000647 1785878763.390167 mapread 0x0107b2 thru 0x016367 (0x5bb6 bytes) truncating to largest ever: 0x3face 000648 1785878763.462773 trunc from 0x016368 to 0x03facd (0x29766 bytes) 000649 1785878763.501819 trunc from 0x03face to 0x02614e (0x1997f bytes) 000650 1785878763.596968 mapread 0x000883 thru 0x0095a4 (0x8d22 bytes) 000654 1785878763.634496 trunc from 0x02614f to 0x02e892 (0x8744 bytes) 000655 1785878763.702641 trunc from 0x02e893 to 0x030a06 (0x2174 bytes) 000659 1785878763.763109 mapwrite 0x02e23b thru 0x035a6c (0x7832 bytes) 000660 1785878764.065706 read 0x022f91 thru 0x029af9 (0x6b69 bytes) 000663 1785878764.098726 read 0x0223a7 thru 0x0233f7 (0x1051 bytes) 000664 1785878764.102430 mapwrite 0x02c34f thru 0x0313a5 (0x5057 bytes) 000666 1785878764.276267 mapwrite 0x002f8b thru 0x0109db (0xda51 bytes) 000667 1785878764.437437 mapread 0x01af17 thru 0x01f9f4 (0x4ade bytes) 000668 1785878764.459624 trunc from 0x035a6d to 0x0009bc (0x350b0 bytes) 000671 1785878764.585201 mapwrite 0x017b21 thru 0x01f697 (0x7b77 bytes) 000672 1785878765.031378 trunc from 0x01f698 to 0x00c41d (0x1327a bytes) 000675 1785878765.062154 mapread 0x00acc3 thru 0x00c41d (0x175b bytes) 000678 1785878765.085375 read 0x00836e thru 0x00c41d (0x40b0 bytes) 000679 1785878765.110309 write 0x031346 thru 0x03fa1d (0xe6d8 bytes) 000680 1785878765.116328 trunc from 0x03fa1e to 0x029d44 (0x15cd9 bytes) 000681 1785878765.172675 write 0x03ced9 thru 0x03ffff (0x3127 bytes) 000686 1785878765.188681 mapwrite 0x005545 thru 0x007a15 (0x24d1 bytes) 000687 1785878765.288181 write 0x00e81b thru 0x01195b (0x3141 bytes) 000689 1785878765.313487 mapwrite 0x0268c8 thru 0x02ad22 (0x445b bytes) 000690 1785878765.421128 mapwrite 0x01a86f thru 0x02622a (0xb9bc bytes) 000691 1785878765.547162 mapwrite 0x03b54e thru 0x03c840 (0x12f3 bytes) 000692 1785878765.653749 mapread 0x032328 thru 0x03c5c7 (0xa2a0 bytes) 000695 1785878765.656171 write 0x00c4ee thru 0x00db4b (0x165e bytes) 000696 1785878765.668577 mapread 0x02a3df thru 0x034708 (0xa32a bytes) 000697 1785878765.675375 trunc from 0x040000 to 0x01d9e6 (0x22619 bytes) 000700 1785878765.738337 trunc from 0x01d9e7 to 0x01f791 (0x1dab bytes) 000701 1785878765.777695 write 0x0142b8 thru 0x01ed25 (0xaa6e bytes) 000702 1785878765.800432 MIRROR_RESYNC 6 mirrors 000703 1785878769.777558 write 0x01f285 thru 0x02552c (0x62a8 bytes) 000704 1785878770.029272 mapwrite 0x0123a2 thru 0x0184f4 (0x6153 bytes) 000707 1785878770.225112 mapwrite 0x009250 thru 0x017220 (0xdfd1 bytes) 000708 1785878770.439965 mapread 0x00fd61 thru 0x01461c (0x48bc bytes) 000710 1785878770.466664 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2552d): Mirror 9: 0x450c79e1 (stale) Mirror 11: 0x450c79e1 (stale) Mirror 13: 0x450c79e1 (stale) Mirror 14: 0x450c79e1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2552d): Mirror 9: 0x450c79e1 (stale) Mirror 11: 0x450c79e1 (stale) Mirror 13: 0x450c79e1 (stale) Mirror 14: 0x450c79e1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2552d: skipped 000714 1785878771.281780 read 0x005c7e thru 0x00a484 (0x4807 bytes) 000715 1785878771.292599 trunc from 0x02552d to 0x039feb (0x14abf bytes) 000716 1785878771.337460 mapread 0x01a7ee thru 0x020594 (0x5da7 bytes) 000720 1785878771.387469 trunc from 0x039fec to 0x00ac98 (0x2f353 bytes) 000721 1785878771.437149 mapwrite 0x013532 thru 0x01a729 (0x71f8 bytes) 000722 1785878771.665665 trunc from 0x01a72a to 0x00fd30 (0xa9f9 bytes) 000723 1785878771.692385 mapwrite 0x005ad2 thru 0x00d1cd (0x76fc bytes) 000724 1785878771.835146 write 0x007a3b thru 0x00a839 (0x2dff bytes) 000725 1785878771.837609 trunc from 0x00fd31 to 0x00c0a0 (0x3c90 bytes) 000726 1785878771.911045 read 0x0026c6 thru 0x003fbb (0x18f6 bytes) 000727 1785878771.945735 mapwrite 0x037af4 thru 0x03ffff (0x850c bytes) 000729 1785878772.108851 trunc from 0x040000 to 0x01fa75 (0x2058a bytes) 000730 1785878772.151513 write 0x020548 thru 0x02453f (0x3ff8 bytes) 000733 1785878772.163701 mapread 0x0013a0 thru 0x0070d6 (0x5d37 bytes) 000736 1785878772.173381 mapwrite 0x030108 thru 0x03a3a4 (0xa29d bytes) 000737 1785878772.659679 read 0x015583 thru 0x02254f (0xcfcd bytes) 000739 1785878772.686172 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a3a5): Mirror 9: 0xab141c2a (stale) Mirror 11: 0xab141c2a (stale) Mirror 14: 0xab141c2a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a3a5): Mirror 9: 0xab141c2a (stale) Mirror 11: 0xab141c2a (stale) Mirror 14: 0xab141c2a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a3a5: skipped 000740 1785878773.446163 write 0x026b00 thru 0x02d34b (0x684c bytes) 000744 1785878773.474335 read 0x0211d2 thru 0x02bbaf (0xa9de bytes) 000746 1785878773.499479 read 0x0350b3 thru 0x03a018 (0x4f66 bytes) 000747 1785878773.516982 write 0x00aa45 thru 0x00fcc2 (0x527e bytes) 000748 1785878773.520885 mapwrite 0x017605 thru 0x026c0d (0xf609 bytes) 000751 1785878773.680931 trunc from 0x03a3a5 to 0x0310a3 (0x9301 bytes) 000752 1785878773.717176 mapwrite 0x023469 thru 0x02f66f (0xc207 bytes) 000753 1785878773.897136 trunc from 0x0310a4 to 0x0141a8 (0x1cefb bytes) 000761 1785878774.029318 mapwrite 0x00cfe8 thru 0x016aff (0x9b18 bytes) 000763 1785878774.198948 mapwrite 0x00cebd thru 0x00e2a1 (0x13e5 bytes) 000768 1785878774.351946 mapread 0x00b7f1 thru 0x00ec48 (0x3458 bytes) 000769 1785878774.355166 read 0x0084af thru 0x016aff (0xe651 bytes) 000770 1785878774.357857 mapwrite 0x0358ca thru 0x035e91 (0x5c8 bytes) 000774 1785878774.516383 write 0x03bea9 thru 0x03ffff (0x4157 bytes) 000778 1785878774.537999 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xeac46f09 (stale) Mirror 11: 0xeac46f09 (stale) Mirror 14: 0xeac46f09 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xeadfcf66 Mirror 15: 0xeadfcf66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000779 1785878776.790645 mapread 0x007a63 thru 0x01115b (0x96f9 bytes) 000780 1785878776.883983 trunc from 0x040000 to 0x008d67 (0x37298 bytes) 000781 1785878777.073048 write 0x01b274 thru 0x02303a (0x7dc7 bytes) 000784 1785878777.090170 read 0x011791 thru 0x01cd7b (0xb5eb bytes) 000785 1785878777.114227 mapwrite 0x00fd0a thru 0x01ed76 (0xf06d bytes) 000788 1785878777.323950 MIRROR_RESYNC 5 mirrors 000790 1785878780.012494 mapwrite 0x00d91c thru 0x01acd7 (0xd3bc bytes) 000791 1785878780.486059 trunc from 0x02303b to 0x031e17 (0xeddd bytes) 000793 1785878780.533307 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31e18): Mirror 9: 0xe8e11594 (stale) Mirror 11: 0xe8e11594 (stale) Mirror 15: 0xe8e11594 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31e18): Mirror 9: 0xe8e11594 (stale) Mirror 11: 0xe8e11594 (stale) Mirror 15: 0xe8e11594 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31e18: skipped 000797 1785878781.132974 write 0x0051ea thru 0x00c72f (0x7546 bytes) 000798 1785878781.157981 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x31e18): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31e18): Mirror 9: 0xe8e11594 (stale) Mirror 11: 0xe8e11594 (stale) Mirror 15: 0xe8e11594 (stale) CRC-32 checksum value for chunk [0, 0x31e18): Mirror 1: 0x588f3bfc Mirror 16: 0x588f3bfc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31e18: skipped 000799 1785878783.342205 mapread 0x00f830 thru 0x010f00 (0x16d1 bytes) 000802 1785878783.447714 read 0x0043b7 thru 0x00fadb (0xb725 bytes) 000804 1785878783.493057 read 0x01d578 thru 0x0237ce (0x6257 bytes) 000805 1785878783.558198 trunc from 0x031e18 to 0x029dca (0x804d bytes) 000806 1785878783.846578 mapread 0x02154a thru 0x029dca (0x8881 bytes) 000808 1785878784.012011 read 0x00dac0 thru 0x01b25a (0xd79b bytes) 000809 1785878784.047251 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29dcb): Mirror 11: 0x24a11d17 (stale) Mirror 15: 0x24a11d17 (stale) Mirror 16: 0x6a567601 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29dcb): Mirror 11: 0x24a11d17 (stale) Mirror 15: 0x24a11d17 (stale) Mirror 16: 0x6a567601 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29dcb: skipped 000810 1785878784.600241 read 0x00baf3 thru 0x015c49 (0xa157 bytes) 000812 1785878784.610501 read 0x02489c thru 0x029d96 (0x54fb bytes) 000814 1785878784.627609 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x29dcb): Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29dcb): Mirror 11: 0x24a11d17 (stale) Mirror 15: 0x24a11d17 (stale) Mirror 16: 0x6a567601 (stale) CRC-32 checksum value for chunk [0, 0x29dcb): Mirror 1: 0x6a567601 Mirror 17: 0x6a567601 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29dcb: skipped 000817 1785878786.003625 read 0x019e48 thru 0x02785c (0xda15 bytes) 000819 1785878786.116888 mapread 0x0188a8 thru 0x021637 (0x8d90 bytes) 000823 1785878786.239733 trunc from 0x029dcb to 0x015c9b (0x1412f bytes) 000826 1785878786.502060 write 0x01c950 thru 0x01f47c (0x2b2d bytes) 000827 1785878786.513406 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f47d): Mirror 11: 0xf0bed1d1 (stale) Mirror 15: 0xf0bed1d1 (stale) Mirror 16: 0x3c1e358a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f47d): Mirror 11: 0xf0bed1d1 (stale) Mirror 15: 0xf0bed1d1 (stale) Mirror 16: 0x3c1e358a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f47d: skipped 000828 1785878787.284058 MIRROR_RESYNC 4 mirrors 000829 1785878789.616301 mapwrite 0x03f498 thru 0x03ffff (0xb68 bytes) 000830 1785878789.883222 MIRROR_RESYNC 4 mirrors 000831 1785878792.887575 trunc from 0x040000 to 0x02ed77 (0x11288 bytes) 000832 1785878793.116617 write 0x0115fe thru 0x01c4f1 (0xaef4 bytes) 000833 1785878793.149816 MIRROR_RESYNC 4 mirrors 000834 1785878795.254051 read 0x0010ba thru 0x00ae6d (0x9db4 bytes) 000835 1785878795.276004 mapread 0x02af92 thru 0x02ed77 (0x3de6 bytes) 000836 1785878795.386508 write 0x014951 thru 0x01b91c (0x6fcc bytes) 000838 1785878795.814402 mapread 0x02a7bf thru 0x02ed77 (0x45b9 bytes) 000839 1785878795.836822 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ed78): Mirror 15: 0x16a4b845 (stale) Mirror 16: 0x16a4b845 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ed78): Mirror 15: 0x16a4b845 (stale) Mirror 16: 0x16a4b845 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ed78: skipped 000842 1785878796.397741 read 0x01c4c3 thru 0x02c3ad (0xfeeb bytes) 000843 1785878796.420982 MIRROR_RESYNC 3 mirrors 000844 1785878798.041449 write 0x01e43d thru 0x02cbe5 (0xe7a9 bytes) 000845 1785878798.260656 MIRROR_RESYNC 3 mirrors 000848 1785878799.987410 read 0x00149e thru 0x00b6a1 (0xa204 bytes) 000849 1785878800.011252 mapwrite 0x0157f7 thru 0x01bf7d (0x6787 bytes) 000851 1785878800.529355 read 0x007c05 thru 0x01797f (0xfd7b bytes) 000853 1785878800.581584 MIRROR_RESYNC 3 mirrors 000854 1785878802.435904 MIRROR_RESYNC 3 mirrors 000855 1785878803.085700 read 0x00de34 thru 0x015de1 (0x7fae bytes) 000857 1785878803.117294 write 0x0083e2 thru 0x00e1f9 (0x5e18 bytes) 000860 1785878803.426984 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2ed78): Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ed78): Mirror 15: 0x4aef5abb (stale) Mirror 16: 0x4aef5abb (stale) CRC-32 checksum value for chunk [0, 0x2ed78): Mirror 1: 0x7783cd11 Mirror 17: 0x7783cd11 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ed78: skipped 000861 1785878805.175991 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ed78): Mirror 16: 0x4aef5abb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ed78): Mirror 16: 0x4aef5abb (stale) CRC-32 checksum value for chunk [0, 0x2ed78): Mirror 1: 0x7783cd11 Mirror 17: 0x7783cd11 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ed78: skipped 000862 1785878806.124146 mapwrite 0x00f415 thru 0x0196b4 (0xa2a0 bytes) 000864 1785878806.615126 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2ed78): Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ed78): Mirror 16: 0x4aef5abb (stale) Mirror 17: 0x7783cd11 (stale) CRC-32 checksum value for chunk [0, 0x2ed78): Mirror 1: 0x1c012ca5 Mirror 18: 0x1c012ca5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ed78: skipped 000865 1785878807.688913 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2ed78): Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ed78): Mirror 16: 0x4aef5abb (stale) Mirror 17: 0x7783cd11 (stale) CRC-32 checksum value for chunk [0, 0x2ed78): Mirror 1: 0x1c012ca5 Mirror 18: 0x1c012ca5 Mirror 19: 0x1c012ca5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ed78: skipped 000866 1785878809.136252 trunc from 0x02ed78 to 0x02e268 (0xb0f bytes) 000867 1785878809.244119 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2e269): Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e269): Mirror 16: 0xe944a5fe (stale) Mirror 17: 0x1483f836 (stale) Mirror 18: 0x413b1074 (stale) Mirror 19: 0x413b1074 (stale) CRC-32 checksum value for chunk [0, 0x2e269): Mirror 1: 0x413b1074 Mirror 20: 0x413b1074 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e269: skipped 000868 1785878810.848678 trunc from 0x02e269 to 0x00365b (0x2ac0d bytes) 000872 1785878811.056332 write 0x034ed4 thru 0x038c62 (0x3d8f bytes) 000873 1785878811.074086 MIRROR_RESYNC 6 mirrors 000876 1785878814.440517 MIRROR_EXTEND to 7 mirrors 000878 1785878816.430606 mapread 0x021de7 thru 0x02321d (0x1437 bytes) 000879 1785878816.465316 MIRROR_EXTEND to 8 mirrors 000880 1785878817.354314 mapread 0x00fb96 thru 0x010784 (0xbef bytes) 000881 1785878817.368793 MIRROR_RESYNC 8 mirrors 000884 1785878818.004141 write 0x03589b thru 0x03b0f3 (0x5859 bytes) 000885 1785878818.179086 read 0x022e6e thru 0x029708 (0x689b bytes) 000886 1785878818.189241 trunc from 0x03b0f4 to 0x03a6b7 (0xa3c bytes) 000887 1785878818.230614 read 0x036a09 thru 0x036b32 (0x12a bytes) 000890 1785878818.238859 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3a6b8): Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a6b8): Mirror 16: 0x65a4aaf1 (stale) Mirror 17: 0x65a4aaf1 (stale) Mirror 18: 0x65a4aaf1 (stale) Mirror 19: 0x65a4aaf1 (stale) Mirror 20: 0x65a4aaf1 (stale) Mirror 21: 0x65a4aaf1 (stale) Mirror 22: 0x65a4aaf1 (stale) CRC-32 checksum value for chunk [0, 0x3a6b8): Mirror 1: 0xc4e8a3c4 Mirror 23: 0xc4e8a3c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a6b8: skipped 000891 1785878820.314792 read 0x035d18 thru 0x03a6b7 (0x49a0 bytes) 000893 1785878820.324129 trunc from 0x03a6b8 to 0x01cd48 (0x1d96f bytes) 000895 1785878820.419265 trunc from 0x01cd49 to 0x016340 (0x6a08 bytes) 000896 1785878820.441161 trunc from 0x016341 to 0x00525a (0x110e6 bytes) 000899 1785878820.470897 read 0x004cbc thru 0x00525a (0x59f bytes) 000900 1785878820.485034 read 0x00170d thru 0x00525a (0x3b4e bytes) 000903 1785878820.499007 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x525b): Mirror 16: 0xe23995b8 (stale) Mirror 18: 0xe23995b8 (stale) Mirror 19: 0xe23995b8 (stale) Mirror 20: 0xe23995b8 (stale) Mirror 21: 0xe23995b8 (stale) Mirror 22: 0xe23995b8 (stale) Mirror 23: 0xe23995b8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x525b): Mirror 16: 0xe23995b8 (stale) Mirror 18: 0xe23995b8 (stale) Mirror 19: 0xe23995b8 (stale) Mirror 20: 0xe23995b8 (stale) Mirror 21: 0xe23995b8 (stale) Mirror 22: 0xe23995b8 (stale) Mirror 23: 0xe23995b8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x525b: skipped 000904 1785878821.211335 read 0x003ce4 thru 0x00525a (0x1577 bytes) 000905 1785878821.226746 mapread 0x00323d thru 0x00525a (0x201e bytes) 000906 1785878821.238613 read 0x000fdd thru 0x001b1b (0xb3f bytes) 000908 1785878821.280988 write 0x01c21e thru 0x0268cc (0xa6af bytes) 000910 1785878821.288134 mapwrite 0x0373e3 thru 0x039ef9 (0x2b17 bytes) 000912 1785878821.437011 mapread 0x008765 thru 0x00fcd7 (0x7573 bytes) 000913 1785878821.440878 write 0x027237 thru 0x031415 (0xa1df bytes) 000914 1785878821.448691 trunc from 0x039efa to 0x01a066 (0x1fe93 bytes) 000915 1785878821.500667 trunc from 0x01a067 to 0x01c4d1 (0x246b bytes) 000916 1785878821.516843 mapread 0x007e6f thru 0x009f41 (0x20d3 bytes) 000919 1785878821.528541 mapread 0x00972e thru 0x0121ea (0x8abd bytes) 000923 1785878821.541780 write 0x03cabd thru 0x03ffff (0x3543 bytes) 000925 1785878821.543574 mapread 0x02571f thru 0x034c42 (0xf524 bytes) 000926 1785878821.692394 write 0x002ce3 thru 0x00de7f (0xb19d bytes) 000932 1785878821.701893 mapwrite 0x01a15d thru 0x01f1a8 (0x504c bytes) 000933 1785878821.766612 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x6506f918 (stale) Mirror 18: 0x6506f918 (stale) Mirror 19: 0x6506f918 (stale) Mirror 20: 0x6506f918 (stale) Mirror 21: 0x6506f918 (stale) Mirror 22: 0x6506f918 (stale) Mirror 23: 0x8d4db695 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfb52c4f6 Mirror 24: 0xfb52c4f6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000935 1785878823.731205 write 0x0104c1 thru 0x010b7c (0x6bc bytes) 000936 1785878824.034037 trunc from 0x040000 to 0x02f3d1 (0x10c2e bytes) 000939 1785878824.107182 read 0x00e49c thru 0x01cd8f (0xe8f4 bytes) 000941 1785878824.166089 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2f3d2): Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f3d2): Mirror 16: 0x54c63707 (stale) Mirror 18: 0x54c63707 (stale) Mirror 19: 0x54c63707 (stale) Mirror 20: 0x54c63707 (stale) Mirror 21: 0x54c63707 (stale) Mirror 22: 0x54c63707 (stale) Mirror 23: 0x54c63707 (stale) Mirror 24: 0x799db2d4 (stale) CRC-32 checksum value for chunk [0, 0x2f3d2): Mirror 1: 0x33adf6fa Mirror 25: 0x33adf6fa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f3d2: skipped 000943 1785878827.950235 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2f3d2): Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f3d2): Mirror 16: 0x54c63707 (stale) Mirror 18: 0x54c63707 (stale) Mirror 19: 0x54c63707 (stale) Mirror 20: 0x54c63707 (stale) Mirror 21: 0x54c63707 (stale) Mirror 22: 0x54c63707 (stale) Mirror 23: 0x54c63707 (stale) Mirror 24: 0x799db2d4 (stale) CRC-32 checksum value for chunk [0, 0x2f3d2): Mirror 1: 0x33adf6fa Mirror 25: 0x33adf6fa Mirror 26: 0x33adf6fa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f3d2: skipped 000946 1785878828.794064 mapwrite 0x035648 thru 0x03ad87 (0x5740 bytes) 000948 1785878829.191455 mapwrite 0x038e3f thru 0x03b879 (0x2a3b bytes) 000949 1785878829.348674 mapwrite 0x014bc1 thru 0x01a36b (0x57ab bytes) 000951 1785878829.470239 read 0x013f39 thru 0x016043 (0x210b bytes) 000955 1785878829.478173 write 0x00445e thru 0x007327 (0x2eca bytes) 000957 1785878829.503278 trunc from 0x03b87a to 0x00e5a6 (0x2d2d3 bytes) 000959 1785878829.546089 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe5a7): Mirror 16: 0x1a3f09fc (stale) Mirror 18: 0x1a3f09fc (stale) Mirror 19: 0x1a3f09fc (stale) Mirror 20: 0x1a3f09fc (stale) Mirror 21: 0x1a3f09fc (stale) Mirror 22: 0x1a3f09fc (stale) Mirror 23: 0x1a3f09fc (stale) Mirror 24: 0xbd81578c (stale) Mirror 25: 0xbd81578c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe5a7): Mirror 16: 0x1a3f09fc (stale) Mirror 18: 0x1a3f09fc (stale) Mirror 19: 0x1a3f09fc (stale) Mirror 20: 0x1a3f09fc (stale) Mirror 21: 0x1a3f09fc (stale) Mirror 22: 0x1a3f09fc (stale) Mirror 23: 0x1a3f09fc (stale) Mirror 24: 0xbd81578c (stale) Mirror 25: 0xbd81578c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe5a7: skipped 000962 1785878830.241794 read 0x007f95 thru 0x00e5a6 (0x6612 bytes) 000964 1785878830.249823 mapwrite 0x00757d thru 0x00c8d1 (0x5355 bytes) 000966 1785878830.294234 mapread 0x0096f1 thru 0x00e5a6 (0x4eb6 bytes) 000969 1785878830.297747 write 0x00f2ae thru 0x018c62 (0x99b5 bytes) 000970 1785878830.299239 write 0x032df6 thru 0x03d98c (0xab97 bytes) 000972 1785878830.301465 trunc from 0x03d98d to 0x01937b (0x24611 bytes) 000973 1785878830.330910 MIRROR_RESYNC 10 mirrors 000974 1785878832.030719 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) 000975 1785878832.837226 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x146:0x0]: Invalid argument (22) 000976 1785878833.814762 read 0x005293 thru 0x00b0a2 (0x5e10 bytes) 000977 1785878833.850091 mapwrite 0x006664 thru 0x00cd62 (0x66ff bytes) 000978 1785878834.225279 trunc from 0x01937c to 0x038dc2 (0x1fa47 bytes) 000979 1785878834.299011 trunc from 0x038dc3 to 0x0264cd (0x128f5 bytes) 000980 1785878834.334418 trunc from 0x0264ce to 0x03a63e (0x14171 bytes) 000982 1785878834.383024 mapread 0x036048 thru 0x03a63e (0x45f7 bytes) 000983 1785878834.414611 mapread 0x0141d8 thru 0x01c6db (0x8504 bytes) 000984 1785878834.443191 read 0x00be8c thru 0x01510b (0x9280 bytes) 000985 1785878834.449168 mapwrite 0x033f83 thru 0x03ffff (0xc07d bytes) 000988 1785878834.626456 write 0x029c6a thru 0x02f1fb (0x5592 bytes) 000989 1785878834.628219 mapread 0x0326c3 thru 0x03e46b (0xbda9 bytes) 000990 1785878834.636797 write 0x008815 thru 0x017ae0 (0xf2cc bytes) 000991 1785878834.642663 mapwrite 0x00c73e thru 0x01a701 (0xdfc4 bytes) 000992 1785878834.782333 MIRROR_RESYNC 8 mirrors 000993 1785878839.601519 read 0x011240 thru 0x0163f6 (0x51b7 bytes) 000995 1785878839.673616 MIRROR_RESYNC 8 mirrors 000996 1785878841.094408 trunc from 0x040000 to 0x00c49f (0x33b60 bytes) 000997 1785878841.297945 trunc from 0x00c4a0 to 0x02b40a (0x1ef6b bytes) 000998 1785878841.362193 write 0x020313 thru 0x0214db (0x11c9 bytes) 000999 1785878841.423358 write 0x03337d thru 0x03ffff (0xcc83 bytes) All operations completed A-OK!