== sanity-flr test 70a: flr mode fsx test ================ 15:13:23 (1787598803) Seed set to 8806 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read skipping zero size read 000005 1787598806.406136 write 0x010960 thru 0x01a019 (0x96ba bytes) 000007 1787598806.409341 write 0x01282a thru 0x021ec5 (0xf69c bytes) 000008 1787598806.411869 mapwrite 0x019741 thru 0x025545 (0xbe05 bytes) 000010 1787598806.569005 mapwrite 0x03f861 thru 0x03ffff (0x79f bytes) 000011 1787598806.694731 write 0x005cc5 thru 0x0107b6 (0xaaf2 bytes) 000012 1787598806.721208 mapwrite 0x028ef7 thru 0x028fd8 (0xe2 bytes) 000014 1787598806.851961 mapread 0x000a5d thru 0x000cf4 (0x298 bytes) 000015 1787598806.865742 mapread 0x004340 thru 0x00cc31 (0x88f2 bytes) 000017 1787598806.867988 read 0x0016fd thru 0x006c96 (0x559a bytes) 000019 1787598806.870970 mapwrite 0x015386 thru 0x023512 (0xe18d bytes) 000020 1787598807.068504 write 0x02de05 thru 0x02e3ba (0x5b6 bytes) truncating to largest ever: 0xf5e2 000025 1787598807.075045 trunc from 0x040000 to 0x00f5e1 (0x30a1e bytes) 000027 1787598807.122583 read 0x00e4b9 thru 0x00f5e1 (0x1129 bytes) truncating to largest ever: 0x2d4a4 000029 1787598807.128232 trunc from 0x00f5e2 to 0x02d4a3 (0x1dec2 bytes) 000030 1787598807.161964 read 0x001093 thru 0x007239 (0x61a7 bytes) 000031 1787598807.170366 read 0x0268a5 thru 0x02d4a3 (0x6bff bytes) 000032 1787598807.209045 trunc from 0x02d4a4 to 0x028868 (0x4c3b bytes) 000034 1787598807.263684 mapwrite 0x00740e thru 0x00b34e (0x3f41 bytes) 000035 1787598807.354640 trunc from 0x028869 to 0x00d0f0 (0x1b778 bytes) 000036 1787598807.398980 mapwrite 0x03e33d thru 0x03ffff (0x1cc3 bytes) 000041 1787598807.534521 mapread 0x01ad27 thru 0x028d0c (0xdfe6 bytes) 000044 1787598807.787130 mapwrite 0x031de6 thru 0x038c4b (0x6e66 bytes) 000046 1787598808.024222 write 0x0252fc thru 0x027df8 (0x2afd bytes) 000049 1787598808.029638 mapwrite 0x006943 thru 0x015ad3 (0xf191 bytes) 000050 1787598808.236012 read 0x039238 thru 0x03ffff (0x6dc8 bytes) 000051 1787598808.241305 MIRROR_EXTEND to 2 mirrors 000052 1787598809.441250 write 0x00596c thru 0x00c83f (0x6ed4 bytes) 000054 1787598809.589900 trunc from 0x040000 to 0x01ad07 (0x252f8 bytes) truncating to largest ever: 0x35052 000055 1787598809.645114 trunc from 0x01ad08 to 0x035051 (0x1a34a bytes) 000056 1787598809.660802 mapwrite 0x00fcef thru 0x015e17 (0x6129 bytes) 000061 1787598809.770040 trunc from 0x035052 to 0x008b85 (0x2c4cc bytes) 000063 1787598809.815189 mapread 0x00725c thru 0x0085ab (0x1350 bytes) 000064 1787598809.816944 write 0x027581 thru 0x032471 (0xaef1 bytes) 000066 1787598809.823937 MIRROR_RESYNC 2 mirrors 000067 1787598810.656777 mapread 0x02b4c7 thru 0x031324 (0x5e5e bytes) 000068 1787598810.675748 read 0x0168f3 thru 0x024f8c (0xe69a bytes) 000069 1787598810.690574 trunc from 0x032472 to 0x005f9e (0x2c4d3 bytes) 000070 1787598810.803908 read 0x001502 thru 0x00299e (0x149d bytes) 000075 1787598810.823036 mapwrite 0x01fb17 thru 0x0208e6 (0xdd0 bytes) 000076 1787598810.955138 mapread 0x00863d thru 0x009665 (0x1029 bytes) 000079 1787598810.959380 mapwrite 0x005311 thru 0x00b721 (0x6411 bytes) 000080 1787598811.028950 write 0x02ba51 thru 0x0361f4 (0xa7a4 bytes) truncating to largest ever: 0x3d893 000082 1787598811.040822 trunc from 0x0361f5 to 0x03d892 (0x769e bytes) 000083 1787598811.074192 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) 000084 1787598811.431008 mapwrite 0x02d309 thru 0x038971 (0xb669 bytes) 000085 1787598811.654989 mapwrite 0x002469 thru 0x0111b4 (0xed4c bytes) 000087 1787598811.772374 read 0x0384e0 thru 0x03b2bf (0x2de0 bytes) 000089 1787598811.773907 mapread 0x03050a thru 0x03d892 (0xd389 bytes) 000090 1787598811.774921 mapread 0x01e8f6 thru 0x027205 (0x8910 bytes) 000092 1787598811.811377 mapwrite 0x003fdd thru 0x00591d (0x1941 bytes) 000095 1787598811.904034 read 0x00e3d0 thru 0x013abb (0x56ec bytes) 000096 1787598811.904774 read 0x038e83 thru 0x03d892 (0x4a10 bytes) 000097 1787598811.907576 trunc from 0x03d893 to 0x0286c8 (0x151ca bytes) 000103 1787598811.948333 mapwrite 0x001eea thru 0x009b19 (0x7c30 bytes) 000105 1787598812.001974 read 0x01a090 thru 0x0286c8 (0xe639 bytes) 000106 1787598812.002625 read 0x00c077 thru 0x011084 (0x500e bytes) 000107 1787598812.005550 read 0x006740 thru 0x008149 (0x1a0a bytes) 000109 1787598812.007115 read 0x024892 thru 0x0286c8 (0x3e37 bytes) 000110 1787598812.007991 mapwrite 0x006f47 thru 0x00bcf3 (0x4dad bytes) 000112 1787598812.076990 write 0x00fcf5 thru 0x0157cc (0x5ad8 bytes) 000114 1787598812.080991 write 0x03882b thru 0x039f86 (0x175c bytes) 000117 1787598812.090773 MIRROR_EXTEND to 2 mirrors 000121 1787598813.064137 read 0x003cf6 thru 0x013cea (0xfff5 bytes) 000123 1787598813.122351 MIRROR_RESYNC 2 mirrors 000127 1787598813.594964 write 0x015dc9 thru 0x01dcf2 (0x7f2a bytes) truncating to largest ever: 0x3d969 000128 1787598813.875349 trunc from 0x039f87 to 0x03d968 (0x39e2 bytes) 000131 1787598813.969898 read 0x02f87d thru 0x03b95a (0xc0de bytes) 000133 1787598814.015176 mapwrite 0x028042 thru 0x037909 (0xf8c8 bytes) 000134 1787598814.165897 mapwrite 0x02684c thru 0x02f166 (0x891b bytes) 000136 1787598814.311341 MIRROR_RESYNC 2 mirrors 000137 1787598815.446530 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) 000139 1787598815.670271 mapwrite 0x021ceb thru 0x02a5a2 (0x88b8 bytes) 000142 1787598815.889271 mapwrite 0x024839 thru 0x02490b (0xd3 bytes) 000144 1787598815.958605 mapread 0x02928e thru 0x02ca8a (0x37fd bytes) 000146 1787598816.010137 trunc from 0x03d969 to 0x02311a (0x1a84e bytes) 000148 1787598816.107180 trunc from 0x02311b to 0x004d3c (0x1e3de bytes) 000151 1787598816.137955 trunc from 0x004d3d to 0x010e30 (0xc0f4 bytes) 000152 1787598816.166188 mapwrite 0x02f810 thru 0x03e913 (0xf104 bytes) 000153 1787598816.330464 read 0x030ee1 thru 0x0399ab (0x8acb bytes) 000154 1787598816.331629 read 0x01b039 thru 0x029e00 (0xedc8 bytes) 000155 1787598816.359629 mapwrite 0x021341 thru 0x026075 (0x4d35 bytes) 000156 1787598816.414997 mapwrite 0x026414 thru 0x02ecea (0x88d7 bytes) 000158 1787598816.470004 write 0x017992 thru 0x01acf4 (0x3363 bytes) 000160 1787598816.473155 read 0x00999d thru 0x015957 (0xbfbb bytes) 000161 1787598816.474906 read 0x03c13b thru 0x03e913 (0x27d9 bytes) 000163 1787598816.478627 write 0x02a1f0 thru 0x0333ae (0x91bf bytes) 000165 1787598816.482861 mapwrite 0x007cbf thru 0x009150 (0x1492 bytes) 000166 1787598816.552774 MIRROR_EXTEND to 2 mirrors 000167 1787598817.643055 mapwrite 0x039923 thru 0x03ffff (0x66dd bytes) 000168 1787598817.932329 mapread 0x003251 thru 0x007dc5 (0x4b75 bytes) 000169 1787598817.989064 read 0x02a9a9 thru 0x033f3c (0x9594 bytes) 000170 1787598818.016187 mapwrite 0x03a890 thru 0x03ffff (0x5770 bytes) 000172 1787598818.152159 mapwrite 0x0339e9 thru 0x039db2 (0x63ca bytes) 000173 1787598818.284808 mapread 0x016e8a thru 0x024f6d (0xe0e4 bytes) 000174 1787598818.359114 read 0x00e463 thru 0x01cdd8 (0xe976 bytes) 000176 1787598818.368066 mapread 0x021cac thru 0x02af29 (0x927e bytes) 000177 1787598818.387526 read 0x03ff8b thru 0x03ffff (0x75 bytes) 000178 1787598818.388241 mapwrite 0x013ace thru 0x017798 (0x3ccb bytes) 000180 1787598818.502913 MIRROR_RESYNC 2 mirrors 000181 1787598819.669154 trunc from 0x040000 to 0x03cfc5 (0x303a bytes) 000182 1787598819.729440 read 0x010ce8 thru 0x017096 (0x63af bytes) 000183 1787598819.752156 write 0x021709 thru 0x02d57f (0xbe77 bytes) 000184 1787598819.770656 trunc from 0x03cfc6 to 0x01104a (0x2bf7b bytes) 000185 1787598819.796651 mapwrite 0x011af0 thru 0x0193f7 (0x7908 bytes) 000186 1787598819.935078 read 0x00dac5 thru 0x0193f7 (0xb933 bytes) 000189 1787598819.936825 mapwrite 0x03a22e thru 0x03ffff (0x5dd2 bytes) 000192 1787598820.099327 read 0x018381 thru 0x027f86 (0xfc06 bytes) 000195 1787598820.106952 trunc from 0x040000 to 0x001d1a (0x3e2e5 bytes) 000196 1787598820.150870 mapread 0x000531 thru 0x001d1a (0x17ea bytes) 000199 1787598820.157313 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1d1b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d1b): Mirror 2: 0x7c8180bf (stale) CRC-32 checksum value for chunk [0, 0x1d1b): Mirror 1: 0x7c8180bf Mirror 3: 0x7c8180bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d1b: skipped 000201 1787598821.009518 trunc from 0x001d1b to 0x02d352 (0x2b638 bytes) 000202 1787598821.258525 read 0x0241d9 thru 0x02c77b (0x85a3 bytes) 000203 1787598821.304741 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2d353): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d353): Mirror 2: 0x406d2e99 (stale) Mirror 3: 0xf91ea915 (stale) CRC-32 checksum value for chunk [0, 0x2d353): Mirror 1: 0xf91ea915 Mirror 4: 0xf91ea915 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d353: skipped 000204 1787598823.089657 read 0x00e940 thru 0x01bafc (0xd1bd bytes) 000207 1787598823.146156 mapread 0x02938d thru 0x02d000 (0x3c74 bytes) 000208 1787598823.186132 write 0x02664e thru 0x035bf3 (0xf5a6 bytes) 000209 1787598823.309762 trunc from 0x035bf4 to 0x01a108 (0x1baeb bytes) 000210 1787598823.367096 write 0x029773 thru 0x02fc09 (0x6497 bytes) 000211 1787598823.377393 read 0x00db12 thru 0x01af4f (0xd43e bytes) 000212 1787598823.404987 write 0x00347b thru 0x008eae (0x5a34 bytes) 000213 1787598823.415062 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2fc0a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fc0a): Mirror 2: 0xbd85e365 (stale) Mirror 3: 0xbf295068 (stale) Mirror 4: 0xbf295068 (stale) CRC-32 checksum value for chunk [0, 0x2fc0a): Mirror 1: 0xa9b84e02 Mirror 5: 0xa9b84e02 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fc0a: skipped 000214 1787598824.284409 write 0x03d0a6 thru 0x03ffff (0x2f5a bytes) 000216 1787598824.408078 read 0x03a1cc thru 0x03ffff (0x5e34 bytes) 000217 1787598824.413241 mapread 0x024069 thru 0x03013b (0xc0d3 bytes) 000218 1787598824.449365 trunc from 0x040000 to 0x021f6a (0x1e095 bytes) 000221 1787598824.506809 read 0x01070f thru 0x012fcd (0x28bf bytes) 000225 1787598824.539625 read 0x0046bb thru 0x00e55b (0x9ea1 bytes) 000228 1787598824.543936 trunc from 0x021f6b to 0x006974 (0x1b5f6 bytes) 000229 1787598824.569171 mapwrite 0x022bf7 thru 0x02e383 (0xb78d bytes) 000230 1787598824.686140 MIRROR_RESYNC 5 mirrors 000235 1787598826.309954 mapwrite 0x0295ac thru 0x038ffc (0xfa51 bytes) 000236 1787598826.663426 MIRROR_RESYNC 5 mirrors 000237 1787598828.043740 write 0x0145cd thru 0x0187ee (0x4222 bytes) 000238 1787598828.121493 mapwrite 0x0362b2 thru 0x03d61e (0x736d bytes) 000239 1787598828.344164 trunc from 0x03d61f to 0x00935c (0x342c2 bytes) 000240 1787598828.371173 write 0x0327c2 thru 0x03ffff (0xd83e bytes) 000241 1787598828.374352 read 0x005327 thru 0x009901 (0x45db bytes) 000242 1787598828.386260 trunc from 0x040000 to 0x023378 (0x1cc87 bytes) 000244 1787598828.415121 mapread 0x01a8f4 thru 0x023378 (0x8a85 bytes) 000245 1787598828.443458 trunc from 0x023379 to 0x0323b2 (0xf03a bytes) 000248 1787598828.478548 mapread 0x029b1d thru 0x0323b2 (0x8896 bytes) 000249 1787598828.507885 trunc from 0x0323b3 to 0x0117b7 (0x20bfb bytes) 000251 1787598828.534891 trunc from 0x0117b8 to 0x003772 (0xe045 bytes) 000255 1787598828.572856 write 0x011d13 thru 0x01a960 (0x8c4e bytes) 000256 1787598828.574892 mapread 0x018129 thru 0x01a960 (0x2838 bytes) 000257 1787598828.577769 trunc from 0x01a961 to 0x01d7d1 (0x2e71 bytes) 000258 1787598828.623066 mapread 0x00c234 thru 0x018d07 (0xcad4 bytes) 000259 1787598828.649335 mapwrite 0x01e8bd thru 0x01f686 (0xdca bytes) 000262 1787598828.802853 mapwrite 0x02a220 thru 0x02aba4 (0x985 bytes) 000264 1787598828.966951 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2aba5): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aba5): Mirror 2: 0xd97b47c2 (stale) Mirror 3: 0xd97b47c2 (stale) Mirror 4: 0xd97b47c2 (stale) Mirror 5: 0xd97b47c2 (stale) CRC-32 checksum value for chunk [0, 0x2aba5): Mirror 1: 0x2b5c8b12 Mirror 6: 0x2b5c8b12 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aba5: skipped 000265 1787598830.482534 trunc from 0x02aba5 to 0x019f7e (0x10c26 bytes) 000266 1787598830.647359 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x19f7f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19f7f): Mirror 2: 0xe226a008 (stale) Mirror 3: 0xe226a008 (stale) Mirror 4: 0xe226a008 (stale) Mirror 5: 0xe226a008 (stale) Mirror 6: 0xb5164e2f (stale) CRC-32 checksum value for chunk [0, 0x19f7f): Mirror 1: 0xb5164e2f Mirror 7: 0xb5164e2f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19f7f: skipped 000269 1787598831.826623 mapwrite 0x0219c5 thru 0x02f59e (0xdbda bytes) 000270 1787598832.008394 mapread 0x021ffb thru 0x0296d7 (0x76dd bytes) 000271 1787598832.010542 read 0x014eab thru 0x016e5d (0x1fb3 bytes) 000272 1787598832.017388 read 0x01ecac thru 0x01f5a0 (0x8f5 bytes) 000273 1787598832.018157 write 0x037b77 thru 0x03ffff (0x8489 bytes) 000275 1787598832.021155 write 0x02da65 thru 0x034913 (0x6eaf bytes) 000276 1787598832.032140 read 0x02ab8b thru 0x02b881 (0xcf7 bytes) 000277 1787598832.033001 write 0x03c2c4 thru 0x03ffff (0x3d3c bytes) 000278 1787598832.034996 mapwrite 0x035443 thru 0x0387f1 (0x33af bytes) 000283 1787598832.115683 read 0x031bde thru 0x033fd9 (0x23fc bytes) 000284 1787598832.122806 write 0x0115dd thru 0x0135bb (0x1fdf bytes) 000285 1787598832.125781 mapread 0x01457d thru 0x01b15c (0x6be0 bytes) 000287 1787598832.129800 mapread 0x000cb6 thru 0x008558 (0x78a3 bytes) 000291 1787598832.135809 trunc from 0x040000 to 0x0358e4 (0xa71b bytes) 000293 1787598832.190429 mapread 0x017ccc thru 0x020f9f (0x92d4 bytes) 000295 1787598832.199824 write 0x03fab9 thru 0x03ffff (0x547 bytes) 000297 1787598832.203929 read 0x000d6e thru 0x007adb (0x6d6e bytes) 000300 1787598832.215737 write 0x021276 thru 0x02f054 (0xdddf bytes) 000301 1787598832.224955 read 0x03a4b2 thru 0x03ffff (0x5b4e bytes) 000303 1787598832.256770 read 0x0229ad thru 0x02dc46 (0xb29a bytes) 000304 1787598832.272458 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1201256 (stale) Mirror 3: 0x1201256 (stale) Mirror 4: 0x1201256 (stale) Mirror 5: 0x1201256 (stale) Mirror 7: 0x681a50b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1201256 (stale) Mirror 3: 0x1201256 (stale) Mirror 4: 0x1201256 (stale) Mirror 5: 0x1201256 (stale) Mirror 7: 0x681a50b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000306 1787598832.767213 MIRROR_RESYNC 6 mirrors 000307 1787598834.365516 write 0x0113ac thru 0x01dea4 (0xcaf9 bytes) 000308 1787598834.449485 read 0x03434a thru 0x03ae26 (0x6add bytes) 000310 1787598834.461802 write 0x03541d thru 0x03e7b3 (0x9397 bytes) 000311 1787598834.469062 read 0x03d2a5 thru 0x03f6bf (0x241b bytes) 000312 1787598834.486598 write 0x02acaf thru 0x031c20 (0x6f72 bytes) 000313 1787598834.488002 mapwrite 0x01a592 thru 0x01ff59 (0x59c8 bytes) 000314 1787598834.556282 mapread 0x007ee3 thru 0x008e54 (0xf72 bytes) 000315 1787598834.559126 read 0x025a13 thru 0x03558a (0xfb78 bytes) 000317 1787598834.561509 read 0x01f0e4 thru 0x02e815 (0xf732 bytes) 000318 1787598834.568139 MIRROR_RESYNC 6 mirrors truncating to largest ever: 0x3e905 000320 1787598835.873954 trunc from 0x040000 to 0x03e904 (0x16fb bytes) 000321 1787598835.984745 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e905): Mirror 2: 0xd0cf7963 (stale) Mirror 4: 0xd0cf7963 (stale) Mirror 5: 0xd0cf7963 (stale) Mirror 7: 0xd0cf7963 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e905): Mirror 2: 0xd0cf7963 (stale) Mirror 4: 0xd0cf7963 (stale) Mirror 5: 0xd0cf7963 (stale) Mirror 7: 0xd0cf7963 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e905: skipped 000322 1787598836.511310 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3e905): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e905): Mirror 2: 0xd0cf7963 (stale) Mirror 4: 0xd0cf7963 (stale) Mirror 5: 0xd0cf7963 (stale) Mirror 7: 0xd0cf7963 (stale) CRC-32 checksum value for chunk [0, 0x3e905): Mirror 1: 0xd0cf7963 Mirror 8: 0xd0cf7963 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e905: skipped 000323 1787598837.789071 trunc from 0x03e905 to 0x00eff5 (0x2f90f bytes) 000324 1787598838.013882 MIRROR_RESYNC 6 mirrors 000325 1787598839.788890 read 0x000c15 thru 0x00c74e (0xbb3a bytes) 000327 1787598839.798074 mapread 0x000167 thru 0x002dd2 (0x2c6c bytes) 000329 1787598839.800345 trunc from 0x00eff6 to 0x02d2fb (0x1e306 bytes) 000330 1787598839.904046 trunc from 0x02d2fc to 0x013156 (0x1a1a5 bytes) 000332 1787598839.939473 write 0x039488 thru 0x03ffff (0x6b78 bytes) 000333 1787598839.941172 read 0x0382a8 thru 0x03ffff (0x7d58 bytes) 000334 1787598839.955915 trunc from 0x040000 to 0x006494 (0x39b6b bytes) 000335 1787598839.973054 trunc from 0x006495 to 0x01e9fa (0x18566 bytes) 000336 1787598839.992450 mapwrite 0x0234d8 thru 0x02ad56 (0x787f bytes) 000337 1787598840.225406 trunc from 0x02ad57 to 0x03b610 (0x108ba bytes) 000339 1787598840.292370 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b611): Mirror 2: 0xf671aabe (stale) Mirror 4: 0xf671aabe (stale) Mirror 5: 0xf671aabe (stale) Mirror 7: 0xf671aabe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b611): Mirror 2: 0xf671aabe (stale) Mirror 4: 0xf671aabe (stale) Mirror 5: 0xf671aabe (stale) Mirror 7: 0xf671aabe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b611: skipped 000340 1787598840.858957 mapread 0x023610 thru 0x02874a (0x513b bytes) 000342 1787598840.886482 write 0x03c9d8 thru 0x03e622 (0x1c4b bytes) 000343 1787598840.888144 trunc from 0x03e623 to 0x02872f (0x15ef3 bytes) 000346 1787598840.915144 MIRROR_RESYNC 5 mirrors 000348 1787598842.143477 trunc from 0x028730 to 0x01b95c (0xcdd3 bytes) 000350 1787598842.214293 trunc from 0x01b95d to 0x01c435 (0xad9 bytes) 000351 1787598842.243398 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c436): Mirror 2: 0x74b0b453 (stale) Mirror 4: 0x74b0b453 (stale) Mirror 5: 0x74b0b453 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c436): Mirror 2: 0x74b0b453 (stale) Mirror 4: 0x74b0b453 (stale) Mirror 5: 0x74b0b453 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c436: skipped 000352 1787598842.706435 write 0x001390 thru 0x0048df (0x3550 bytes) 000355 1787598842.719615 trunc from 0x01c436 to 0x02f842 (0x1340d bytes) 000356 1787598842.741380 write 0x02d611 thru 0x03a773 (0xd163 bytes) 000357 1787598842.762424 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a774): Mirror 4: 0xab038e81 (stale) Mirror 5: 0xab038e81 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a774): Mirror 4: 0xab038e81 (stale) Mirror 5: 0xab038e81 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a774: skipped 000361 1787598843.232818 read 0x02ad2b thru 0x038ac3 (0xdd99 bytes) 000362 1787598843.250406 trunc from 0x03a774 to 0x03e71d (0x3faa bytes) 000363 1787598843.271774 mapwrite 0x021b28 thru 0x023ccc (0x21a5 bytes) 000366 1787598843.377061 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e71e): Mirror 4: 0xba4c0be1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e71e): Mirror 4: 0xba4c0be1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e71e: skipped 000368 1787598843.782386 write 0x00c225 thru 0x016443 (0xa21f bytes) 000370 1787598843.810546 MIRROR_RESYNC 2 mirrors 000372 1787598845.191404 trunc from 0x03e71e to 0x014adb (0x29c42 bytes) 000373 1787598845.263629 mapread 0x0134db thru 0x014adb (0x1601 bytes) 000376 1787598845.278983 mapwrite 0x00c124 thru 0x00e116 (0x1ff3 bytes) 000378 1787598845.342030 read 0x011662 thru 0x014adb (0x347a bytes) 000379 1787598845.353260 MIRROR_RESYNC 2 mirrors 000380 1787598846.188840 mapwrite 0x00f66d thru 0x01d1a5 (0xdb39 bytes) 000382 1787598846.427485 mapwrite 0x03016a thru 0x03c327 (0xc1be bytes) 000383 1787598846.524418 write 0x01f33c thru 0x01f819 (0x4de bytes) 000384 1787598846.531983 read 0x0103f5 thru 0x01a0a4 (0x9cb0 bytes) 000385 1787598846.532964 read 0x035125 thru 0x03c327 (0x7203 bytes) 000387 1787598846.538806 trunc from 0x03c328 to 0x018ef1 (0x23436 bytes) 000389 1787598846.565628 read 0x014ad8 thru 0x018ef1 (0x441a bytes) 000392 1787598846.568047 write 0x00e350 thru 0x01906b (0xad1c bytes) 000393 1787598846.570474 write 0x017dd1 thru 0x018825 (0xa55 bytes) truncating to largest ever: 0x3f232 000394 1787598846.572463 trunc from 0x01906c to 0x03f231 (0x261c6 bytes) 000398 1787598846.603525 trunc from 0x03f232 to 0x00e78d (0x30aa4 bytes) 000401 1787598846.626400 mapwrite 0x03fa87 thru 0x03ffff (0x579 bytes) 000403 1787598846.766127 read 0x03b0e8 thru 0x03ffff (0x4f18 bytes) 000405 1787598846.773884 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) 000406 1787598846.996621 write 0x00e83a thru 0x00ee59 (0x620 bytes) 000408 1787598847.005158 write 0x01c1b0 thru 0x024650 (0x84a1 bytes) 000409 1787598847.016816 trunc from 0x040000 to 0x01bab2 (0x2454d bytes) 000412 1787598847.040573 read 0x00714c thru 0x011245 (0xa0fa bytes) 000413 1787598847.051861 write 0x0368f5 thru 0x03ffff (0x970b bytes) 000414 1787598847.054545 trunc from 0x040000 to 0x00bf35 (0x340ca bytes) 000416 1787598847.076948 read 0x007c1f thru 0x00bf35 (0x4317 bytes) 000417 1787598847.078619 write 0x0275b6 thru 0x034b07 (0xd552 bytes) 000419 1787598847.083307 mapwrite 0x009664 thru 0x017b36 (0xe4d3 bytes) 000422 1787598847.170062 mapwrite 0x02a87c thru 0x02ff4f (0x56d4 bytes) 000425 1787598847.228587 mapread 0x028493 thru 0x032a5c (0xa5ca bytes) 000426 1787598847.230576 mapread 0x01fc87 thru 0x025bb5 (0x5f2f bytes) 000428 1787598847.232415 mapwrite 0x032dc7 thru 0x03b1a1 (0x83db bytes) 000429 1787598847.308274 write 0x03498f thru 0x03ffff (0xb671 bytes) 000433 1787598847.312153 mapwrite 0x02dfb7 thru 0x038ac5 (0xab0f bytes) 000434 1787598847.370338 read 0x00885d thru 0x015c7e (0xd422 bytes) 000435 1787598847.371136 trunc from 0x040000 to 0x0207e4 (0x1f81b bytes) 000437 1787598847.389661 write 0x0239c0 thru 0x03355b (0xfb9c bytes) 000439 1787598847.392305 trunc from 0x03355c to 0x0311fa (0x2361 bytes) 000442 1787598847.413493 trunc from 0x0311fb to 0x01caa3 (0x14757 bytes) 000443 1787598847.445770 mapwrite 0x026dcc thru 0x0363f5 (0xf62a bytes) 000444 1787598847.596100 write 0x0209e4 thru 0x02dc77 (0xd294 bytes) 000447 1787598847.605331 read 0x007893 thru 0x009aea (0x2258 bytes) 000453 1787598847.617201 trunc from 0x0363f6 to 0x033ade (0x2917 bytes) 000454 1787598847.669769 write 0x02a297 thru 0x030423 (0x618d bytes) 000456 1787598847.685445 mapread 0x016b6f thru 0x026308 (0xf79a bytes) 000457 1787598847.704677 MIRROR_EXTEND to 2 mirrors 000458 1787598848.894602 mapwrite 0x0095bc thru 0x0179f5 (0xe43a bytes) 000459 1787598849.170467 trunc from 0x033adf to 0x02419e (0xf940 bytes) 000463 1787598849.199601 trunc from 0x02419f to 0x036353 (0x121b5 bytes) 000464 1787598849.223681 read 0x02a48f thru 0x02f03d (0x4baf bytes) 000466 1787598849.250474 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x36354): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36354): Mirror 2: 0x535535bb (stale) CRC-32 checksum value for chunk [0, 0x36354): Mirror 1: 0x3bdb84a0 Mirror 3: 0x3bdb84a0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36354: skipped 000467 1787598850.499441 trunc from 0x036354 to 0x012b98 (0x237bb bytes) 000469 1787598850.646294 read 0x003653 thru 0x011d21 (0xe6cf bytes) 000473 1787598850.672664 read 0x005c5a thru 0x00aaa8 (0x4e4f bytes) 000477 1787598850.682286 MIRROR_RESYNC 3 mirrors 000480 1787598851.760386 mapwrite 0x032c94 thru 0x033ab8 (0xe25 bytes) 000481 1787598851.963952 mapwrite 0x02325c thru 0x02b5b2 (0x8357 bytes) 000484 1787598852.055287 trunc from 0x033ab9 to 0x020c62 (0x12e56 bytes) 000485 1787598852.084225 write 0x01596e thru 0x01a06a (0x46fd bytes) 000486 1787598852.110211 mapread 0x007558 thru 0x00c948 (0x53f1 bytes) 000487 1787598852.151056 write 0x035919 thru 0x03fc79 (0xa361 bytes) 000488 1787598852.153737 mapwrite 0x00c879 thru 0x017507 (0xac8f bytes) 000493 1787598852.345290 mapwrite 0x0058f9 thru 0x014548 (0xec50 bytes) 000495 1787598852.471366 mapwrite 0x029b97 thru 0x03000b (0x6475 bytes) 000496 1787598852.584444 trunc from 0x03fc7a to 0x016c23 (0x29056 bytes) 000497 1787598852.636565 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x16c24): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16c24): Mirror 2: 0xe405bc53 (stale) Mirror 3: 0xe405bc53 (stale) CRC-32 checksum value for chunk [0, 0x16c24): Mirror 1: 0xf1e9aa74 Mirror 4: 0xf1e9aa74 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16c24: skipped 000498 1787598854.270570 read 0x00725b thru 0x00cf99 (0x5d3f bytes) 000499 1787598854.295996 mapread 0x00759a thru 0x0152bb (0xdd22 bytes) 000500 1787598854.381091 trunc from 0x016c24 to 0x01377a (0x34a9 bytes) 000501 1787598854.487058 mapwrite 0x023cbc thru 0x028b06 (0x4e4b bytes) 000502 1787598854.581347 mapwrite 0x02b8f1 thru 0x0381a6 (0xc8b6 bytes) 000503 1787598854.750062 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x381a7): Mirror 3: 0x4b49d7db (stale) Mirror 4: 0xde05f75 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x381a7): Mirror 3: 0x4b49d7db (stale) Mirror 4: 0xde05f75 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x381a7: skipped 000505 1787598855.207578 trunc from 0x0381a7 to 0x02bfd6 (0xc1d0 bytes) 000506 1787598855.230241 read 0x013811 thru 0x01783b (0x402b bytes) 000507 1787598855.239915 trunc from 0x02bfd7 to 0x0152ba (0x16d1c bytes) 000508 1787598855.262640 mapread 0x01470f thru 0x0152ba (0xbac bytes) 000509 1787598855.268775 MIRROR_RESYNC 3 mirrors 000510 1787598856.082384 read 0x0053ea thru 0x009234 (0x3e4b bytes) 000512 1787598856.101960 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) 000513 1787598856.578233 trunc from 0x0152bb to 0x02254d (0xd293 bytes) 000514 1787598856.709672 MIRROR_RESYNC 2 mirrors 000515 1787598858.055942 MIRROR_RESYNC 2 mirrors 000516 1787598858.606663 mapread 0x01bebe thru 0x02254d (0x6690 bytes) 000517 1787598858.630999 mapwrite 0x01a7c5 thru 0x01a943 (0x17f bytes) 000518 1787598858.782053 mapwrite 0x004e7c thru 0x00de74 (0x8ff9 bytes) 000519 1787598858.879293 trunc from 0x02254e to 0x01a86a (0x7ce3 bytes) 000521 1787598858.922362 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1a86b): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a86b): Mirror 3: 0xf03193a6 (stale) CRC-32 checksum value for chunk [0, 0x1a86b): Mirror 1: 0xedd0bb2f Mirror 4: 0xedd0bb2f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a86b: skipped 000522 1787598860.270388 mapread 0x018f4e thru 0x01a86a (0x191d bytes) 000525 1787598860.304241 mapwrite 0x0228c7 thru 0x02365e (0xd98 bytes) 000527 1787598860.479784 mapwrite 0x00a926 thru 0x014d70 (0xa44b bytes) 000528 1787598860.552360 write 0x03fe15 thru 0x03ffff (0x1eb bytes) 000529 1787598860.557915 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x6dd68180 (stale) Mirror 4: 0xd7447dac (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc2738940 Mirror 5: 0xc2738940 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000531 1787598861.512048 write 0x02e313 thru 0x03d740 (0xf42e bytes) 000532 1787598861.620979 mapread 0x03aec0 thru 0x03ffff (0x5140 bytes) 000534 1787598861.670627 write 0x01c5ee thru 0x026877 (0xa28a bytes) 000535 1787598861.688172 read 0x01a0df thru 0x01b851 (0x1773 bytes) 000537 1787598861.704243 read 0x035356 thru 0x03ffff (0xacaa bytes) 000540 1787598861.707688 trunc from 0x040000 to 0x00eee2 (0x3111d bytes) 000542 1787598861.784498 mapwrite 0x02a253 thru 0x02b710 (0x14be bytes) 000543 1787598861.919771 mapread 0x009c1b thru 0x00fdb9 (0x619f bytes) 000544 1787598861.921035 mapwrite 0x00dded thru 0x01be12 (0xe026 bytes) 000545 1787598861.983991 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b711): Mirror 3: 0x631ecb31 (stale) Mirror 5: 0x34b7cc09 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b711): Mirror 3: 0x631ecb31 (stale) Mirror 5: 0x34b7cc09 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b711: skipped 000546 1787598862.762364 mapwrite 0x037981 thru 0x03f6fe (0x7d7e bytes) 000547 1787598862.962733 mapread 0x00e6b7 thru 0x017796 (0x90e0 bytes) 000548 1787598863.025561 mapread 0x004293 thru 0x010c11 (0xc97f bytes) 000549 1787598863.080679 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3f6ff): Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f6ff): Mirror 3: 0xd0ad52e0 (stale) Mirror 5: 0xa9e23923 (stale) CRC-32 checksum value for chunk [0, 0x3f6ff): Mirror 1: 0x7c405e84 Mirror 6: 0x7c405e84 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f6ff: skipped 000550 1787598864.823161 MIRROR_RESYNC 4 mirrors 000552 1787598866.188274 trunc from 0x03f6ff to 0x01b31e (0x243e0 bytes) 000553 1787598866.286373 trunc from 0x01b31f to 0x01ae87 (0x497 bytes) 000557 1787598866.314892 read 0x01a03e thru 0x01ae87 (0xe4a bytes) 000559 1787598866.323371 read 0x00c633 thru 0x00eb12 (0x24e0 bytes) 000560 1787598866.340423 trunc from 0x01ae88 to 0x0205bf (0x5738 bytes) 000562 1787598866.376434 trunc from 0x0205c0 to 0x02727c (0x6cbd bytes) 000563 1787598866.426463 MIRROR_RESYNC 4 mirrors 000566 1787598868.156796 mapwrite 0x01dcea thru 0x02be1e (0xe135 bytes) 000568 1787598868.358512 mapread 0x00e271 thru 0x010e4b (0x2bdb bytes) 000569 1787598868.397967 read 0x0268c3 thru 0x02be1e (0x555c bytes) 000571 1787598868.402219 mapread 0x0064d5 thru 0x00f8b3 (0x93df bytes) 000573 1787598868.441009 MIRROR_RESYNC 4 mirrors 000574 1787598869.972614 write 0x037822 thru 0x03e4a6 (0x6c85 bytes) 000577 1787598870.028590 mapwrite 0x0261d7 thru 0x02bc45 (0x5a6f bytes) 000579 1787598870.093759 read 0x00a205 thru 0x019b64 (0xf960 bytes) 000583 1787598870.106805 trunc from 0x03e4a7 to 0x034f03 (0x95a3 bytes) 000584 1787598870.130740 write 0x01be83 thru 0x024ff6 (0x9174 bytes) 000585 1787598870.138504 trunc from 0x034f04 to 0x017e32 (0x1d0d1 bytes) 000586 1787598870.158819 mapread 0x0118e7 thru 0x017e32 (0x654c bytes) 000587 1787598870.162617 write 0x006cd1 thru 0x00dc5e (0x6f8e bytes) 000588 1787598870.170890 read 0x00e75b thru 0x00fb5a (0x1400 bytes) 000589 1787598870.181844 MIRROR_RESYNC 4 mirrors 000590 1787598871.778224 write 0x005c48 thru 0x015bb8 (0xff71 bytes) 000591 1787598871.975984 mapwrite 0x039998 thru 0x03d86a (0x3ed3 bytes) 000592 1787598872.119588 write 0x00607c thru 0x00dc37 (0x7bbc bytes) 000595 1787598872.123984 read 0x0236e8 thru 0x0280f1 (0x4a0a bytes) 000598 1787598872.135675 mapwrite 0x01db45 thru 0x020cc2 (0x317e bytes) 000600 1787598872.230141 read 0x03001f thru 0x03d86a (0xd84c bytes) 000601 1787598872.242125 read 0x0312e0 thru 0x0379d7 (0x66f8 bytes) 000602 1787598872.243092 read 0x0353ae thru 0x038637 (0x328a bytes) 000603 1787598872.244234 read 0x0245b8 thru 0x0275a7 (0x2ff0 bytes) 000607 1787598872.247286 write 0x033068 thru 0x0379d9 (0x4972 bytes) 000608 1787598872.249462 read 0x0099c3 thru 0x00f063 (0x56a1 bytes) 000609 1787598872.250296 read 0x038a89 thru 0x03d86a (0x4de2 bytes) 000610 1787598872.252150 write 0x02ff69 thru 0x036f5a (0x6ff2 bytes) 000611 1787598872.254561 mapread 0x000fe9 thru 0x0041c4 (0x31dc bytes) 000612 1787598872.256677 mapread 0x00258d thru 0x00f24e (0xccc2 bytes) 000615 1787598872.260193 mapwrite 0x00d952 thru 0x015287 (0x7936 bytes) 000616 1787598872.297511 read 0x01760c thru 0x021647 (0xa03c bytes) 000617 1787598872.298306 mapwrite 0x013cb0 thru 0x01a78c (0x6add bytes) 000618 1787598872.336435 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d86b): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d86b): Mirror 3: 0xe9b3f000 (stale) Mirror 5: 0xe9b3f000 (stale) Mirror 6: 0xe9b3f000 (stale) CRC-32 checksum value for chunk [0, 0x3d86b): Mirror 1: 0xec724eef Mirror 7: 0xec724eef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d86b: skipped 000620 1787598873.216933 mapread 0x03237a thru 0x03d86a (0xb4f1 bytes) 000622 1787598873.272766 mapwrite 0x004c91 thru 0x00ebf5 (0x9f65 bytes) 000623 1787598873.588552 mapwrite 0x00b9f9 thru 0x00e67a (0x2c82 bytes) 000627 1787598873.671668 read 0x03ba31 thru 0x03d86a (0x1e3a bytes) 000630 1787598873.686744 read 0x01f16b thru 0x028651 (0x94e7 bytes) 000633 1787598873.710421 MIRROR_RESYNC 5 mirrors 000634 1787598875.042184 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) 000636 1787598875.506959 trunc from 0x03d86b to 0x011088 (0x2c7e2 bytes) 000637 1787598875.652288 mapread 0x00470a thru 0x011088 (0xc97f bytes) 000640 1787598875.686635 mapread 0x00add1 thru 0x011088 (0x62b8 bytes) 000643 1787598875.690174 mapwrite 0x018739 thru 0x019181 (0xa49 bytes) 000646 1787598875.787399 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19182): Mirror 6: 0xd8b0c47a (stale) Mirror 7: 0xd8b0c47a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19182): Mirror 6: 0xd8b0c47a (stale) Mirror 7: 0xd8b0c47a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19182: skipped 000647 1787598876.165182 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19182): Mirror 6: 0xd8b0c47a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19182): Mirror 6: 0xd8b0c47a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19182: skipped 000648 1787598876.541782 mapwrite 0x003470 thru 0x00d232 (0x9dc3 bytes) 000652 1787598876.638663 MIRROR_RESYNC 2 mirrors 000654 1787598877.490053 mapread 0x012f90 thru 0x019181 (0x61f2 bytes) 000655 1787598877.536594 write 0x03a335 thru 0x03ce47 (0x2b13 bytes) 000656 1787598877.600064 mapwrite 0x034ea3 thru 0x038ace (0x3c2c bytes) 000657 1787598877.691450 trunc from 0x03ce48 to 0x0093d9 (0x33a6e bytes) 000658 1787598877.738563 mapread 0x0057d6 thru 0x007779 (0x1fa4 bytes) 000661 1787598877.772763 mapwrite 0x0115da thru 0x014417 (0x2e3e bytes) 000663 1787598877.865371 mapread 0x005921 thru 0x00675a (0xe3a bytes) 000664 1787598877.867454 write 0x03313b thru 0x03e6f2 (0xb5b8 bytes) 000665 1787598877.874354 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e6f3): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e6f3): Mirror 6: 0xf43cd905 (stale) CRC-32 checksum value for chunk [0, 0x3e6f3): Mirror 1: 0x42d69da6 Mirror 7: 0x42d69da6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e6f3: skipped 000667 1787598878.986623 trunc from 0x03e6f3 to 0x03e714 (0x22 bytes) 000668 1787598879.089342 mapwrite 0x011c05 thru 0x021529 (0xf925 bytes) 000671 1787598879.232246 mapread 0x0063db thru 0x007230 (0xe56 bytes) 000674 1787598879.253616 mapwrite 0x00175d thru 0x008743 (0x6fe7 bytes) 000675 1787598879.341104 trunc from 0x03e715 to 0x015d2d (0x289e7 bytes) 000679 1787598879.402293 read 0x0037d2 thru 0x007196 (0x39c5 bytes) 000680 1787598879.408143 write 0x01315a thru 0x01b4df (0x8386 bytes) 000681 1787598879.412124 trunc from 0x01b4e0 to 0x00e943 (0xcb9c bytes) 000682 1787598879.446346 write 0x017f38 thru 0x026b5d (0xec26 bytes) 000684 1787598879.462656 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x26b5e): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26b5e): Mirror 6: 0x5556f6cc (stale) Mirror 7: 0xab9a3e18 (stale) CRC-32 checksum value for chunk [0, 0x26b5e): Mirror 1: 0x5773ffd5 Mirror 8: 0x5773ffd5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26b5e: skipped 000685 1787598880.820857 read 0x01f1ca thru 0x026b5d (0x7994 bytes) 000687 1787598880.868199 mapread 0x0099f8 thru 0x0145ee (0xabf7 bytes) 000688 1787598880.946115 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26b5e): Mirror 7: 0xab9a3e18 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26b5e): Mirror 7: 0xab9a3e18 (stale) CRC-32 checksum value for chunk [0, 0x26b5e): Mirror 1: 0x5773ffd5 Mirror 8: 0x5773ffd5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26b5e: skipped 000691 1787598881.742522 read 0x00b2bd thru 0x01a0ac (0xedf0 bytes) 000693 1787598881.755219 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x26b5e): Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26b5e): Mirror 7: 0xab9a3e18 (stale) CRC-32 checksum value for chunk [0, 0x26b5e): Mirror 1: 0x5773ffd5 Mirror 8: 0x5773ffd5 Mirror 9: 0x5773ffd5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26b5e: skipped 000696 1787598883.112148 mapwrite 0x03e68c thru 0x03ffff (0x1974 bytes) 000697 1787598883.298406 read 0x01e092 thru 0x029df7 (0xbd66 bytes) 000700 1787598883.309992 read 0x01f85e thru 0x02c883 (0xd026 bytes) 000702 1787598883.324536 write 0x000381 thru 0x00fc0a (0xf88a bytes) 000704 1787598883.330416 read 0x00b799 thru 0x018227 (0xca8f bytes) 000705 1787598883.331187 mapwrite 0x000ba3 thru 0x00258a (0x19e8 bytes) 000706 1787598883.411111 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x6fc546b6 (stale) Mirror 9: 0x4b5d79a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x6fc546b6 (stale) Mirror 9: 0x4b5d79a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000708 1787598883.878048 read 0x03d82c thru 0x03ffff (0x27d4 bytes) 000709 1787598883.887874 mapwrite 0x02a9b3 thru 0x034165 (0x97b3 bytes) 000710 1787598884.022245 mapread 0x029dd1 thru 0x02ca33 (0x2c63 bytes) 000713 1787598884.024675 read 0x0002cf thru 0x0062c7 (0x5ff9 bytes) 000714 1787598884.050427 trunc from 0x040000 to 0x038c6a (0x7395 bytes) 000715 1787598884.079122 mapread 0x032f51 thru 0x038c6a (0x5d1a bytes) 000716 1787598884.080254 write 0x0090a7 thru 0x0147b6 (0xb710 bytes) 000719 1787598884.084244 mapwrite 0x029845 thru 0x03750a (0xdcc6 bytes) 000720 1787598884.191039 read 0x00349f thru 0x0113e3 (0xdf45 bytes) 000721 1787598884.199043 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x38c6b): Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38c6b): Mirror 7: 0x8363e794 (stale) Mirror 9: 0x98fed36a (stale) CRC-32 checksum value for chunk [0, 0x38c6b): Mirror 1: 0xa3e1c5f1 Mirror 10: 0xa3e1c5f1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38c6b: skipped 000723 1787598885.221433 mapwrite 0x03dedf thru 0x03ffff (0x2121 bytes) 000724 1787598885.439234 trunc from 0x040000 to 0x017878 (0x28787 bytes) 000727 1787598885.492469 read 0x0001cb thru 0x009002 (0x8e38 bytes) 000729 1787598885.503543 write 0x024c3c thru 0x0303e5 (0xb7aa bytes) 000731 1787598885.508452 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x303e6): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x303e6): Mirror 7: 0x78a53cc (stale) Mirror 9: 0x1091145e (stale) Mirror 10: 0x2c21360d (stale) CRC-32 checksum value for chunk [0, 0x303e6): Mirror 1: 0xd15cd8f8 Mirror 11: 0xd15cd8f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x303e6: skipped 000732 1787598886.577470 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x303e6): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x303e6): Mirror 7: 0x78a53cc (stale) Mirror 9: 0x1091145e (stale) Mirror 10: 0x2c21360d (stale) CRC-32 checksum value for chunk [0, 0x303e6): Mirror 1: 0xd15cd8f8 Mirror 11: 0xd15cd8f8 Mirror 12: 0xd15cd8f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x303e6: skipped 000733 1787598887.895818 trunc from 0x0303e6 to 0x0172c1 (0x19124 bytes) 000734 1787598888.125374 read 0x00a8bc thru 0x00db03 (0x3248 bytes) 000735 1787598888.131762 read 0x008c5d thru 0x01045a (0x77fe bytes) 000736 1787598888.150057 mapwrite 0x00747a thru 0x013e51 (0xc9d8 bytes) 000737 1787598888.276214 mapwrite 0x03f8f9 thru 0x03ffff (0x707 bytes) 000741 1787598888.377416 mapwrite 0x03db67 thru 0x03ffff (0x2499 bytes) 000744 1787598888.443660 MIRROR_RESYNC 6 mirrors 000745 1787598889.952491 write 0x02d285 thru 0x032d2a (0x5aa6 bytes) 000746 1787598890.061394 read 0x01b079 thru 0x023ec7 (0x8e4f bytes) 000747 1787598890.084396 mapwrite 0x03a0b2 thru 0x03ffff (0x5f4e bytes) 000748 1787598890.226580 read 0x01e020 thru 0x01edd0 (0xdb1 bytes) 000749 1787598890.227259 mapread 0x00fed4 thru 0x014334 (0x4461 bytes) 000750 1787598890.250287 mapwrite 0x02937a thru 0x038db6 (0xfa3d bytes) 000751 1787598890.389389 mapwrite 0x03a181 thru 0x03ffff (0x5e7f bytes) 000752 1787598890.462111 MIRROR_RESYNC 6 mirrors 000753 1787598891.846448 write 0x01fcff thru 0x02e12a (0xe42c bytes) 000754 1787598891.943973 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd9adc92f (stale) Mirror 9: 0xd9adc92f (stale) Mirror 10: 0xd9adc92f (stale) Mirror 11: 0xd9adc92f (stale) Mirror 12: 0xd9adc92f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe4ba936a Mirror 13: 0xe4ba936a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000756 1787598893.327338 write 0x00f586 thru 0x01e866 (0xf2e1 bytes) 000758 1787598893.399987 write 0x006593 thru 0x0162f3 (0xfd61 bytes) 000759 1787598893.407074 trunc from 0x040000 to 0x0236dc (0x1c923 bytes) 000760 1787598893.422292 mapread 0x015445 thru 0x01e2a6 (0x8e62 bytes) 000761 1787598893.423375 write 0x029fcf thru 0x030103 (0x6135 bytes) 000764 1787598893.427565 write 0x00e809 thru 0x017baf (0x93a7 bytes) 000765 1787598893.428590 trunc from 0x030104 to 0x003c39 (0x2c4ca bytes) 000766 1787598893.457359 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c3a): Mirror 9: 0x43bd645b (stale) Mirror 10: 0x43bd645b (stale) Mirror 11: 0x43bd645b (stale) Mirror 12: 0x43bd645b (stale) Mirror 13: 0x43bd645b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c3a): Mirror 9: 0x43bd645b (stale) Mirror 10: 0x43bd645b (stale) Mirror 11: 0x43bd645b (stale) Mirror 12: 0x43bd645b (stale) Mirror 13: 0x43bd645b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c3a: skipped 000767 1787598893.822388 read 0x00218d thru 0x003495 (0x1309 bytes) 000773 1787598893.845205 trunc from 0x003c3a to 0x024470 (0x20837 bytes) 000774 1787598893.879832 mapread 0x0031ba thru 0x00d732 (0xa579 bytes) 000775 1787598893.919596 trunc from 0x024471 to 0x03e71e (0x1a2ae bytes) 000781 1787598893.969040 read 0x01954e thru 0x0267a3 (0xd256 bytes) 000782 1787598893.987879 write 0x01a584 thru 0x026ead (0xc92a bytes) 000784 1787598893.989542 mapread 0x00f8f4 thru 0x0148cb (0x4fd8 bytes) 000785 1787598893.990420 mapwrite 0x023c3b thru 0x025be9 (0x1faf bytes) 000786 1787598894.150536 mapwrite 0x014653 thru 0x01876b (0x4119 bytes) 000788 1787598894.273227 trunc from 0x03e71f to 0x01b28f (0x2348f bytes) 000791 1787598894.300075 mapwrite 0x02f714 thru 0x03e744 (0xf031 bytes) 000792 1787598894.592298 mapwrite 0x01eb49 thru 0x0288d5 (0x9d8d bytes) 000794 1787598894.860226 trunc from 0x03e745 to 0x02fd8c (0xe9b8 bytes) 000795 1787598894.880569 write 0x02623d thru 0x02aad1 (0x4895 bytes) 000796 1787598894.908231 MIRROR_RESYNC 6 mirrors 000797 1787598896.589175 mapwrite 0x03b03a thru 0x03ffff (0x4fc6 bytes) 000798 1787598896.771444 trunc from 0x040000 to 0x01d138 (0x22ec7 bytes) 000799 1787598896.802773 trunc from 0x01d139 to 0x0293d6 (0xc29e bytes) 000801 1787598896.830070 write 0x00f130 thru 0x011c31 (0x2b02 bytes) 000803 1787598896.844907 trunc from 0x0293d7 to 0x0137fc (0x15bda bytes) 000804 1787598896.868678 trunc from 0x0137fd to 0x025cbf (0x124c3 bytes) 000806 1787598896.893515 trunc from 0x025cc0 to 0x00f7fb (0x164c4 bytes) 000809 1787598896.925186 trunc from 0x00f7fc to 0x03bd90 (0x2c595 bytes) 000810 1787598896.946203 write 0x01daf2 thru 0x024dc1 (0x72d0 bytes) 000811 1787598896.957113 read 0x012283 thru 0x0142d6 (0x2054 bytes) 000812 1787598896.963473 mapwrite 0x03eddc thru 0x03ffff (0x1224 bytes) 000814 1787598897.067098 read 0x00fd45 thru 0x01d06d (0xd329 bytes) 000815 1787598897.083844 write 0x001f03 thru 0x00b8c1 (0x99bf bytes) 000816 1787598897.085504 write 0x0248ef thru 0x02c8de (0x7ff0 bytes) 000817 1787598897.091338 trunc from 0x040000 to 0x017cb5 (0x2834a bytes) 000818 1787598897.115664 mapwrite 0x00633f thru 0x00d2d7 (0x6f99 bytes) 000819 1787598897.181953 write 0x02be95 thru 0x02cc35 (0xda1 bytes) 000821 1787598897.186115 trunc from 0x02cc36 to 0x03c124 (0xf4ef bytes) 000822 1787598897.218688 trunc from 0x03c125 to 0x0138ed (0x28837 bytes) 000824 1787598897.244048 trunc from 0x0138ee to 0x022815 (0xef28 bytes) 000825 1787598897.272529 read 0x003e7a thru 0x00c2bf (0x8446 bytes) 000826 1787598897.273531 trunc from 0x022816 to 0x01b344 (0x74d1 bytes) 000828 1787598897.304408 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1b345): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b345): Mirror 9: 0x66f75242 (stale) Mirror 10: 0x66f75242 (stale) Mirror 11: 0x66f75242 (stale) Mirror 12: 0x66f75242 (stale) Mirror 13: 0x66f75242 (stale) CRC-32 checksum value for chunk [0, 0x1b345): Mirror 1: 0x222bf546 Mirror 14: 0x222bf546 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b345: skipped 000830 1787598898.251577 trunc from 0x01b345 to 0x03d5dd (0x22299 bytes) 000831 1787598898.362504 read 0x02d1ff thru 0x039f9c (0xcd9e bytes) 000833 1787598898.373297 read 0x01bead thru 0x028faf (0xd103 bytes) 000836 1787598898.398389 trunc from 0x03d5de to 0x008548 (0x35095 bytes) 000838 1787598898.427869 write 0x027fb7 thru 0x032efc (0xaf46 bytes) 000839 1787598898.431666 write 0x00ce9f thru 0x012dbb (0x5f1d bytes) 000840 1787598898.443421 mapwrite 0x0075bf thru 0x01417f (0xcbc1 bytes) 000842 1787598898.562799 trunc from 0x032efd to 0x033657 (0x75b bytes) 000843 1787598898.592340 mapread 0x0110af thru 0x01165b (0x5ad bytes) 000844 1787598898.595130 mapwrite 0x02c049 thru 0x02e7e9 (0x27a1 bytes) 000845 1787598898.659395 mapwrite 0x00a53f thru 0x00a6cb (0x18d bytes) 000846 1787598898.743003 trunc from 0x033658 to 0x03df5d (0xa906 bytes) 000847 1787598898.794259 write 0x004cdb thru 0x009025 (0x434b bytes) 000849 1787598898.799154 trunc from 0x03df5e to 0x012b7e (0x2b3df bytes) 000850 1787598898.825953 mapwrite 0x01dabf thru 0x02483a (0x6d7c bytes) 000851 1787598898.966388 trunc from 0x02483b to 0x01c65b (0x81df bytes) 000853 1787598899.002397 mapread 0x011014 thru 0x011939 (0x926 bytes) 000855 1787598899.006792 trunc from 0x01c65c to 0x034437 (0x17ddc bytes) 000856 1787598899.041420 mapwrite 0x00b20a thru 0x0169c7 (0xb7be bytes) 000858 1787598899.200344 write 0x013429 thru 0x022faf (0xfb87 bytes) 000859 1787598899.217184 MIRROR_RESYNC 7 mirrors 000860 1787598900.567196 trunc from 0x034438 to 0x002709 (0x31d2e bytes) 000862 1787598900.679936 mapwrite 0x008d3e thru 0x013501 (0xa7c4 bytes) 000863 1787598900.861882 trunc from 0x013502 to 0x00e9e3 (0x4b1e bytes) 000865 1787598900.904342 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe9e4): Mirror 9: 0xba6eadc1 (stale) Mirror 10: 0xba6eadc1 (stale) Mirror 11: 0xba6eadc1 (stale) Mirror 12: 0xba6eadc1 (stale) Mirror 14: 0xba6eadc1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe9e4): Mirror 9: 0xba6eadc1 (stale) Mirror 10: 0xba6eadc1 (stale) Mirror 11: 0xba6eadc1 (stale) Mirror 12: 0xba6eadc1 (stale) Mirror 14: 0xba6eadc1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe9e4: skipped 000870 1787598901.583364 mapread 0x007c95 thru 0x00b4e0 (0x384c bytes) 000871 1787598901.641964 mapread 0x00c8b8 thru 0x00e9e3 (0x212c bytes) 000872 1787598901.642822 mapread 0x00b53c thru 0x00e9e3 (0x34a8 bytes) 000873 1787598901.644654 mapwrite 0x019557 thru 0x020fb9 (0x7a63 bytes) 000875 1787598901.900142 trunc from 0x020fba to 0x00bd57 (0x15262 bytes) 000878 1787598901.978139 MIRROR_RESYNC 6 mirrors 000879 1787598903.178623 mapread 0x003c99 thru 0x007a1c (0x3d84 bytes) 000880 1787598903.217832 read 0x004ff5 thru 0x007e7b (0x2e87 bytes) 000881 1787598903.218160 mapwrite 0x022a4e thru 0x028c7f (0x6232 bytes) 000882 1787598903.386522 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28c80): Mirror 10: 0xc1f95e3e (stale) Mirror 11: 0xc1f95e3e (stale) Mirror 12: 0xc1f95e3e (stale) Mirror 14: 0xc1f95e3e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28c80): Mirror 10: 0xc1f95e3e (stale) Mirror 11: 0xc1f95e3e (stale) Mirror 12: 0xc1f95e3e (stale) Mirror 14: 0xc1f95e3e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28c80: skipped 000885 1787598903.857652 trunc from 0x028c80 to 0x0035c9 (0x256b6 bytes) 000887 1787598903.876299 mapwrite 0x038397 thru 0x038549 (0x1b3 bytes) 000888 1787598903.941629 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3854a): Mirror 10: 0xe0ff56c (stale) Mirror 12: 0xe0ff56c (stale) Mirror 14: 0xe0ff56c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3854a): Mirror 10: 0xe0ff56c (stale) Mirror 12: 0xe0ff56c (stale) Mirror 14: 0xe0ff56c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3854a: skipped 000891 1787598904.344546 read 0x00eb2e thru 0x0140b6 (0x5589 bytes) 000892 1787598904.361327 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3854a): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3854a): Mirror 10: 0xe0ff56c (stale) Mirror 12: 0xe0ff56c (stale) Mirror 14: 0xe0ff56c (stale) CRC-32 checksum value for chunk [0, 0x3854a): Mirror 1: 0x675c807d Mirror 15: 0x675c807d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3854a: skipped 000893 1787598905.525877 write 0x009fb7 thru 0x013769 (0x97b3 bytes) 000894 1787598905.623494 read 0x028ada thru 0x0353a4 (0xc8cb bytes) 000895 1787598905.636186 mapwrite 0x00c42f thru 0x01baa5 (0xf677 bytes) 000897 1787598905.713926 mapread 0x00537b thru 0x013794 (0xe41a bytes) 000898 1787598905.724557 mapwrite 0x0337f8 thru 0x03bdb5 (0x85be bytes) 000900 1787598905.835244 trunc from 0x03bdb6 to 0x00fdf7 (0x2bfbe bytes) 000901 1787598905.861281 MIRROR_RESYNC 5 mirrors 000902 1787598907.044898 write 0x027dff thru 0x02edc4 (0x6fc6 bytes) 000906 1787598907.133578 trunc from 0x02edc5 to 0x0101f2 (0x1ebd2 bytes) 000907 1787598907.164357 read 0x00d5dd thru 0x0101f2 (0x2c16 bytes) 000911 1787598907.190552 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x101f3): Mirror 10: 0xcafa5e5a (stale) Mirror 12: 0xcafa5e5a (stale) Mirror 14: 0xcafa5e5a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x101f3): Mirror 10: 0xcafa5e5a (stale) Mirror 12: 0xcafa5e5a (stale) Mirror 14: 0xcafa5e5a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x101f3: skipped 000914 1787598907.575016 mapwrite 0x02c7b0 thru 0x030437 (0x3c88 bytes) 000916 1787598907.671983 mapwrite 0x037ccf thru 0x03ffff (0x8331 bytes) 000917 1787598907.764040 MIRROR_RESYNC 4 mirrors 000918 1787598908.920300 mapwrite 0x03921a thru 0x03ffff (0x6de6 bytes) 000919 1787598909.159289 MIRROR_RESYNC 4 mirrors 000922 1787598910.336886 write 0x01c034 thru 0x024b3d (0x8b0a bytes) 000923 1787598910.484670 write 0x03ec13 thru 0x03ffff (0x13ed bytes) 000925 1787598910.499549 mapread 0x002b96 thru 0x0047db (0x1c46 bytes) 000926 1787598910.555174 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xa572ae0d (stale) Mirror 14: 0xa572ae0d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xa572ae0d (stale) Mirror 14: 0xa572ae0d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000927 1787598910.975880 mapwrite 0x02141a thru 0x0312da (0xfec1 bytes) 000928 1787598911.096423 trunc from 0x040000 to 0x031f81 (0xe07e bytes) 000930 1787598911.127183 MIRROR_RESYNC 3 mirrors 000936 1787598912.046891 trunc from 0x031f82 to 0x007ce8 (0x2a299 bytes) 000937 1787598912.168166 trunc from 0x007ce9 to 0x013ea7 (0xc1bf bytes) 000938 1787598912.200620 mapwrite 0x02e9f0 thru 0x037cab (0x92bc bytes) 000939 1787598912.382655 MIRROR_RESYNC 3 mirrors 000940 1787598913.358582 trunc from 0x037cac to 0x01ffa8 (0x17d03 bytes) 000942 1787598913.443323 mapwrite 0x00e81e thru 0x01a267 (0xba4a bytes) 000943 1787598913.613052 read 0x0024da thru 0x008979 (0x64a0 bytes) 000944 1787598913.643978 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ffa9): Mirror 14: 0xcda4e9ab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ffa9): Mirror 14: 0xcda4e9ab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ffa9: skipped 000945 1787598914.088551 read 0x003e17 thru 0x007312 (0x34fc bytes) 000946 1787598914.105052 trunc from 0x01ffa9 to 0x013af5 (0xc4b3 bytes) 000949 1787598914.131311 trunc from 0x013af6 to 0x00ba0e (0x80e7 bytes) 000950 1787598914.149578 trunc from 0x00ba0f to 0x017a43 (0xc035 bytes) 000952 1787598914.174976 mapread 0x007912 thru 0x017027 (0xf716 bytes) 000954 1787598914.213794 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x17a44): Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17a44): Mirror 14: 0xb0806c7d (stale) CRC-32 checksum value for chunk [0, 0x17a44): Mirror 1: 0xb0806c7d Mirror 15: 0xb0806c7d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17a44: skipped 000955 1787598915.194111 write 0x01e481 thru 0x02005a (0x1bda bytes) 000956 1787598915.289655 trunc from 0x02005b to 0x03666e (0x16614 bytes) 000957 1787598915.331529 read 0x03211c thru 0x03666e (0x4553 bytes) 000958 1787598915.340128 write 0x029617 thru 0x02c32e (0x2d18 bytes) 000959 1787598915.349668 read 0x01cc29 thru 0x01d8d9 (0xcb1 bytes) 000961 1787598915.359211 mapread 0x02c02c thru 0x035ebd (0x9e92 bytes) 000962 1787598915.360173 mapread 0x02bcb9 thru 0x035213 (0x955b bytes) 000964 1787598915.361957 read 0x00919c thru 0x00bb80 (0x29e5 bytes) 000966 1787598915.363379 trunc from 0x03666f to 0x00548d (0x311e1 bytes) 000970 1787598915.382689 read 0x0000bc thru 0x00548d (0x53d2 bytes) 000973 1787598915.385356 mapread 0x000b36 thru 0x004b45 (0x4010 bytes) 000974 1787598915.386332 write 0x01ea7b thru 0x029908 (0xae8e bytes) 000975 1787598915.388913 read 0x015102 thru 0x01dedf (0x8dde bytes) 000976 1787598915.394952 trunc from 0x029909 to 0x02a1d6 (0x8ce bytes) 000979 1787598915.418787 read 0x01702b thru 0x01b168 (0x413e bytes) 000980 1787598915.424286 MIRROR_RESYNC 3 mirrors 000981 1787598916.203935 mapwrite 0x00982e thru 0x00bfa5 (0x2778 bytes) 000982 1787598916.499279 mapread 0x01d0f6 thru 0x025214 (0x811f bytes) 000983 1787598916.550987 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a1d7): Mirror 15: 0xe6eea46 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a1d7): Mirror 15: 0xe6eea46 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a1d7: skipped 000985 1787598917.022180 trunc from 0x02a1d7 to 0x0122c5 (0x17f11 bytes) 000986 1787598917.069076 trunc from 0x0122c6 to 0x020cc7 (0xea02 bytes) 000987 1787598917.108651 write 0x009b90 thru 0x00ce2d (0x329e bytes) 000988 1787598917.131373 read 0x00527b thru 0x00e7c7 (0x954d bytes) 000989 1787598917.144085 mapread 0x00a41c thru 0x010fdf (0x6bc4 bytes) 000991 1787598917.156538 trunc from 0x020cc8 to 0x005e96 (0x1ae31 bytes) 000992 1787598917.177392 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x162:0x0]: Invalid argument (22) 000993 1787598917.356759 write 0x02ca36 thru 0x02f807 (0x2dd2 bytes) 000994 1787598917.357814 mapwrite 0x0162fe thru 0x01ff8d (0x9c90 bytes) 000995 1787598917.432981 trunc from 0x02f808 to 0x033d3f (0x4538 bytes) 000996 1787598917.464832 mapwrite 0x02e570 thru 0x03a386 (0xbe17 bytes) 000997 1787598917.625438 trunc from 0x03a387 to 0x015b81 (0x24805 bytes) 000999 1787598917.689188 write 0x03408f thru 0x03d72e (0x96a0 bytes) 001000 1787598917.699242 mapwrite 0x02a59c thru 0x03006b (0x5ad0 bytes) All operations completed A-OK!