== sanity-flr test 70a: flr mode fsx test ================ 01:28:31 (1785389311) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 9313 skipping zero length punch hole skipping zero length punch hole skipping zero size read skipping zero length zero range skipping zero size read truncating to largest ever: 0x21435 000007 1785389314.026148 trunc from 00000000 to 0x021434 (0x21435 bytes) 000008 1785389314.061464 fallocate 0x00c3d3 thru 0x0155db (0x9209 bytes) 000009 1785389314.073245 mapread 0x01fb71 thru 0x021434 (0x18c4 bytes) 000010 1785389314.147626 mapread 0x001d1e thru 0x008cba (0x6f9d bytes) 000011 1785389314.170217 write 0x030501 thru 0x03e323 (0xde23 bytes) 000012 1785389314.184251 MIRROR_EXTEND to 2 mirrors 000013 1785389314.838627 mapread 0x028aa8 thru 0x02d4ab (0x4a04 bytes) 000014 1785389314.917225 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) zero_range to largest ever: 0x258b1 000015 1785389315.215908 trunc from 0x01dcce to 0x0258b0 (0x7be3 bytes) fallocating to largest ever: 0x2f490 000016 1785389315.244860 fallocate 0x022531 thru 0x02f48f (0xcf5f bytes) 000017 1785389315.257685 fallocate 0x016733 thru 0x01da8f (0x735d bytes) 000018 1785389315.277656 mapread 0x0018ef thru 0x00363a (0x1d4c bytes) fallocating to largest ever: 0x39683 000019 1785389315.333127 fallocate 0x029c2b thru 0x039682 (0xfa58 bytes) 000020 1785389315.338138 mapread 0x02c29c thru 0x0316e2 (0x5447 bytes) 000021 1785389315.348081 punch from 0x00a7f7 to 0x0165f4 (0xbdfe bytes) 000022 1785389315.352081 read 0x02885c thru 0x030fb5 (0x875a bytes) 000023 1785389315.352979 mapread 0x033fb4 thru 0x03a318 (0x6365 bytes) 000024 1785389315.365236 punch from 0x02c859 to 0x03abca (0xe372 bytes) 000025 1785389315.377624 mapread 0x006d5e thru 0x009a81 (0x2d24 bytes) 000026 1785389315.379709 mapread 0x005851 thru 0x00d996 (0x8146 bytes) 000027 1785389315.391175 mapread 0x01e6bb thru 0x0294bc (0xae02 bytes) 000028 1785389315.405880 write 0x014b9c thru 0x01b706 (0x6b6b bytes) 000029 1785389315.417539 mapread 0x0332a1 thru 0x03786d (0x45cd bytes) 000030 1785389315.433630 punch from 0x03423b to 0x03e323 (0xa0e9 bytes) 000032 1785389315.445430 trunc from 0x03e324 to 0x01a0bc (0x24267 bytes) 000033 1785389315.482919 mapwrite 0x031981 thru 0x03ab86 (0x9206 bytes) 000034 1785389315.721597 trunc from 0x03ab87 to 0x01c9b4 (0x1e1d2 bytes) 000035 1785389315.784455 write 0x0037e5 thru 0x0123b5 (0xebd1 bytes) 000036 1785389315.786312 trunc from 0x004536 to 0x007cc9 (0x3794 bytes) 000037 1785389315.821579 punch from 0x015420 to 0x01a5ce (0x51af bytes) 000038 1785389315.830138 punch from 0x005837 to 0x00e93d (0x9107 bytes) 000041 1785389315.841603 mapread 0x00ed8d thru 0x014d02 (0x5f76 bytes) fallocating to largest ever: 0x3bd80 000042 1785389315.865311 fallocate 0x039491 thru 0x03bd7f (0x28ef bytes) 000043 1785389315.882719 trunc from 0x002ed8 to 0x00ad3e (0x7e67 bytes) 000044 1785389315.891692 mapwrite 0x03ccb8 thru 0x03fbfc (0x2f45 bytes) 000045 1785389315.962258 fallocate 0x027e02 thru 0x036534 (0xe733 bytes) 000046 1785389315.977732 punch from 0x00d95a to 0x01739a (0x9a41 bytes) 000047 1785389315.997767 mapwrite 0x01d165 thru 0x01e7a6 (0x1642 bytes) 000048 1785389316.023139 mapread 0x027a54 thru 0x02d037 (0x55e4 bytes) 000049 1785389316.052153 mapread 0x00b442 thru 0x010748 (0x5307 bytes) 000050 1785389316.066181 mapread 0x03ce06 thru 0x03e4de (0x16d9 bytes) 000051 1785389316.068059 trunc from 0x03fbfd to 0x026ae2 (0x1911a bytes) 000052 1785389316.089536 mapread 0x0022d2 thru 0x00cbbe (0xa8ed bytes) 000053 1785389316.097231 trunc from 0x01188c to 0x01e4f5 (0xcc6a bytes) 000054 1785389316.101319 punch from 0x00686a to 0x015bf9 (0xf390 bytes) 000055 1785389316.106061 mapwrite 0x0003f5 thru 0x00dcf3 (0xd8ff bytes) 000056 1785389316.131209 mapwrite 0x003cb2 thru 0x00aa76 (0x6dc5 bytes) 000060 1785389316.146760 read 0x022604 thru 0x0235be (0xfbb bytes) 000061 1785389316.147763 mapread 0x002d84 thru 0x007272 (0x44ef bytes) 000062 1785389316.151742 mapread 0x021d58 thru 0x026ae2 (0x4d8b bytes) 000063 1785389316.153242 mapread 0x00e6aa thru 0x013088 (0x49df bytes) 000064 1785389316.163566 write 0x002fc0 thru 0x012118 (0xf159 bytes) 000065 1785389316.165882 mapwrite 0x00f8e7 thru 0x019240 (0x995a bytes) 000066 1785389316.182841 punch from 0x01b027 to 0x024bc6 (0x9ba0 bytes) 000068 1785389316.188217 trunc from 0x026ae3 to 0x022ddd (0x3d05 bytes) 000069 1785389316.198606 trunc from 0x022dde to 0x02ff4e (0xd171 bytes) 000070 1785389316.212462 trunc from 0x005161 to 0x00a35b (0x51fb bytes) 000071 1785389316.222563 punch from 0x02678f to 0x02e186 (0x79f8 bytes) 000074 1785389316.240529 mapwrite 0x008e1a thru 0x010429 (0x7610 bytes) 000077 1785389316.323523 read 0x002b46 thru 0x004103 (0x15be bytes) 000078 1785389316.325879 read 0x014d92 thru 0x0159c6 (0xc35 bytes) 000079 1785389316.330693 mapwrite 0x034694 thru 0x03ffff (0xb96c bytes) 000080 1785389316.459802 mapwrite 0x00733f thru 0x008bd0 (0x1892 bytes) 000081 1785389316.481530 trunc from 0x0348af to 0x03ba13 (0x7165 bytes) 000082 1785389316.492798 mapwrite 0x00248d thru 0x011d8e (0xf902 bytes) 000084 1785389316.555987 read 0x00ff90 thru 0x019452 (0x94c3 bytes) 000085 1785389316.556877 trunc from 0x040000 to 0x02212c (0x1ded3 bytes) 000086 1785389316.607119 mapwrite 0x018c0d thru 0x025d65 (0xd159 bytes) 000087 1785389316.696240 write 0x010b17 thru 0x014658 (0x3b42 bytes) 000088 1785389316.697435 fallocate 0x037307 thru 0x0379e2 (0x6dc bytes) 000089 1785389316.720564 trunc from 0x01cbaf to 0x01e5e8 (0x1a3a bytes) 000090 1785389316.752432 trunc from 0x025d66 to 0x0183fa (0xd96b bytes) 000091 1785389316.775440 punch from 0x000811 to 0x00d9bd (0xd1ad bytes) 000092 1785389316.782944 trunc from 0x0003d4 to 0x00776e (0x739b bytes) 000093 1785389316.790425 mapread 0x010144 thru 0x0183fa (0x82b7 bytes) 000094 1785389316.804581 fallocate 0x0049e4 thru 0x011fb4 (0xd5d1 bytes) 000095 1785389316.839407 fallocate 0x00d4da thru 0x016a69 (0x9590 bytes) 000097 1785389316.851510 trunc from 0x006d63 to 0x00fcfe (0x8f9c bytes) 000098 1785389316.879493 mapwrite 0x026a0f thru 0x02e301 (0x78f3 bytes) 000099 1785389316.975700 trunc from 0x02e302 to 0x034273 (0x5f72 bytes) 000100 1785389316.991212 trunc from 0x017824 to 0x027420 (0xfbfd bytes) 000101 1785389317.015489 read 0x029f9b thru 0x034273 (0xa2d9 bytes) 000102 1785389317.069162 read 0x01e820 thru 0x02be34 (0xd615 bytes) 000104 1785389317.077516 mapread 0x0049de thru 0x00bff4 (0x7617 bytes) 000105 1785389317.078776 punch from 0x02ecbc to 0x030a1e (0x1d63 bytes) 000106 1785389317.116436 trunc from 0x034274 to 0x001f17 (0x3235c bytes) 000107 1785389317.142402 punch from 0x001d6d to 0x001f17 (0x1ab bytes) 000108 1785389317.151171 mapwrite 0x001e5a thru 0x00e519 (0xc6c0 bytes) 000109 1785389317.293406 punch from 0x001128 to 0x00e519 (0xd3f2 bytes) 000110 1785389317.311778 trunc from 0x00b72e to 0x00e519 (0x2dec bytes) 000111 1785389317.319608 fallocate 0x0171a6 thru 0x01a959 (0x37b4 bytes) 000112 1785389317.333404 write 0x02a0b9 thru 0x036b24 (0xca6c bytes) 000113 1785389317.338733 mapread 0x031731 thru 0x036b24 (0x53f4 bytes) 000114 1785389317.344605 read 0x00ac4e thru 0x010589 (0x593c bytes) 000116 1785389317.365075 mapread 0x02161e thru 0x02d05a (0xba3d bytes) 000117 1785389317.372890 trunc from 0x02b0a0 to 0x02ed3b (0x3c9c bytes) 000118 1785389317.411847 mapread 0x02a3a2 thru 0x030644 (0x62a3 bytes) 000119 1785389317.448876 read 0x03282a thru 0x036b24 (0x42fb bytes) 000120 1785389317.450121 read 0x0252f4 thru 0x02b216 (0x5f23 bytes) 000121 1785389317.451569 trunc from 0x036b25 to 0x01162f (0x254f5 bytes) 000123 1785389317.479596 trunc from 0x00c505 to 0x00e7a4 (0x22a0 bytes) 000124 1785389317.489924 fallocate 0x0177f0 thru 0x02318a (0xb99b bytes) 000125 1785389317.494897 mapwrite 0x03e691 thru 0x03ffff (0x196f bytes) 000126 1785389317.608870 trunc from 0x01636e to 0x024f41 (0xebd4 bytes) 000127 1785389317.624516 punch from 0x02a690 to 0x02c925 (0x2296 bytes) 000129 1785389317.641924 trunc from 0x033dc0 to 0x03af31 (0x7172 bytes) 000130 1785389317.650149 mapread 0x003b29 thru 0x009d08 (0x61e0 bytes) 000131 1785389317.671033 mapwrite 0x03cfca thru 0x03da35 (0xa6c bytes) 000132 1785389317.728833 mapread 0x01520a thru 0x018876 (0x366d bytes) 000133 1785389317.782562 mapread 0x01285b thru 0x01dfce (0xb774 bytes) 000134 1785389317.883051 mapwrite 0x01b7f0 thru 0x028e50 (0xd661 bytes) 000135 1785389318.067204 write 0x03e67f thru 0x03ffff (0x1981 bytes) 000136 1785389318.068146 read 0x01a560 thru 0x025960 (0xb401 bytes) 000137 1785389318.068672 mapwrite 0x014b40 thru 0x0248cd (0xfd8e bytes) 000138 1785389318.136438 read 0x01b4aa thru 0x02415d (0x8cb4 bytes) 000139 1785389318.137093 read 0x00b9ab thru 0x00e964 (0x2fba bytes) 000140 1785389318.137581 mapread 0x03299b thru 0x034b08 (0x216e bytes) 000141 1785389318.165512 fallocate 0x000db9 thru 0x006f43 (0x618b bytes) 000142 1785389318.186222 trunc from 0x018359 to 0x01de7c (0x5b24 bytes) 000143 1785389318.191507 trunc from 0x00a8a4 to 0x011e11 (0x756e bytes) 000144 1785389318.204513 fallocate 0x028c03 thru 0x032107 (0x9505 bytes) 000145 1785389318.216337 trunc from 0x040000 to 0x02d519 (0x12ae6 bytes) 000146 1785389318.230134 mapwrite 0x03001a thru 0x03a5d6 (0xa5bd bytes) 000148 1785389318.415579 write 0x00148a thru 0x004179 (0x2cf0 bytes) 000149 1785389318.426079 trunc from 0x03a5d7 to 0x01fd1e (0x1a8b8 bytes) 000151 1785389318.466598 write 0x01efc9 thru 0x02b5a7 (0xc5df bytes) 000152 1785389318.475836 trunc from 0x02b5a8 to 0x01729b (0x1430c bytes) 000153 1785389318.491203 mapwrite 0x01797a thru 0x019e66 (0x24ed bytes) 000154 1785389318.604858 mapread 0x011118 thru 0x0126fd (0x15e6 bytes) 000155 1785389318.628056 trunc from 0x00d813 to 0x015da4 (0x8592 bytes) 000156 1785389318.636355 trunc from 0x019e67 to 0x021a99 (0x7c33 bytes) 000157 1785389318.648398 punch from 0x000801 to 0x0086e8 (0x7ee8 bytes) 000158 1785389318.655221 mapwrite 0x00c7d7 thru 0x018d2a (0xc554 bytes) 000159 1785389318.840893 fallocate 0x00a8ef thru 0x01108a (0x679c bytes) 000160 1785389318.847363 mapwrite 0x01bc91 thru 0x027b91 (0xbf01 bytes) 000161 1785389319.119103 fallocate 0x015232 thru 0x024180 (0xef4f bytes) 000162 1785389319.122667 fallocate 0x031851 thru 0x0320e9 (0x899 bytes) 000164 1785389319.131944 fallocate 0x011126 thru 0x012b23 (0x19fe bytes) 000165 1785389319.146205 read 0x0100f3 thru 0x011336 (0x1244 bytes) 000166 1785389319.156015 MIRROR_EXTEND to 2 mirrors 000167 1785389320.136582 MIRROR_EXTEND to 3 mirrors 000168 1785389321.416590 mapwrite 0x03d39e thru 0x03ffff (0x2c62 bytes) 000169 1785389321.693057 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1a7cab6 (stale) Mirror 3: 0x1a7cab6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8cc7aae2 Mirror 4: 0x8cc7aae2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000170 1785389323.715756 trunc from 0x003f65 to 0x00f70b (0xb7a7 bytes) 000173 1785389323.841995 trunc from 0x013322 to 0x0175d3 (0x42b2 bytes) 000174 1785389323.863141 punch from 0x03e0cc to 0x03ffff (0x1f34 bytes) 000175 1785389323.878442 trunc from 0x040000 to 0x0306e7 (0xf918 bytes) 000176 1785389323.944152 write 0x0091ac thru 0x01867e (0xf4d3 bytes) 000177 1785389323.957578 trunc from 0x020dc1 to 0x028591 (0x77d1 bytes) 000179 1785389323.969449 read 0x00781a thru 0x00aaaf (0x3296 bytes) 000180 1785389323.984596 mapread 0x025d2b thru 0x02783a (0x1b10 bytes) 000181 1785389324.066513 fallocate 0x0297c5 thru 0x02cbcb (0x3407 bytes) 000182 1785389324.105751 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x306e8): Mirror 3: 0xab105e28 (stale) Mirror 4: 0xab105e28 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x306e8): Mirror 3: 0xab105e28 (stale) Mirror 4: 0xab105e28 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x306e8: skipped 000183 1785389324.718601 punch from 0x01e1f3 to 0x021a06 (0x3814 bytes) 000184 1785389324.722582 fallocate 0x0012e0 thru 0x002ae5 (0x1806 bytes) 000185 1785389324.734263 punch from 0x00933a to 0x00f3e7 (0x60ae bytes) 000186 1785389324.753588 mapread 0x00d5d0 thru 0x010daa (0x37db bytes) 000187 1785389324.810706 trunc from 0x000b91 to 0x007c43 (0x70b3 bytes) 000188 1785389324.828389 mapwrite 0x034eb0 thru 0x03ffff (0xb150 bytes) 000189 1785389324.962688 read 0x0348ec thru 0x03ceff (0x8614 bytes) zero_range to largest ever: 0x40000 000190 1785389324.964872 trunc from 0x03fc1f to 0x03ffff (0x3e1 bytes) 000191 1785389324.978237 write 0x033701 thru 0x03d4d9 (0x9dd9 bytes) 000192 1785389324.993322 MIRROR_RESYNC 3 mirrors 000193 1785389326.449434 punch from 0x01b920 to 0x0239be (0x809f bytes) 000195 1785389326.516934 mapread 0x006178 thru 0x006860 (0x6e9 bytes) 000196 1785389326.524966 write 0x010836 thru 0x011cc7 (0x1492 bytes) 000197 1785389326.553410 punch from 0x02490c to 0x029d2c (0x5421 bytes) 000199 1785389326.573214 fallocate 0x038cad thru 0x03ffff (0x7353 bytes) 000200 1785389326.578959 fallocate 0x01a8ff thru 0x01b435 (0xb37 bytes) 000201 1785389326.584393 write 0x03a6f7 thru 0x03c495 (0x1d9f bytes) 000202 1785389326.607243 MIRROR_RESYNC 3 mirrors 000203 1785389327.951073 trunc from 0x027c8b to 0x02cee1 (0x5257 bytes) 000204 1785389327.978577 trunc from 0x040000 to 0x01e186 (0x21e79 bytes) 000205 1785389328.001986 mapwrite 0x02c9e2 thru 0x02e1eb (0x180a bytes) 000206 1785389328.049671 trunc from 0x02e1ec to 0x00574f (0x28a9c bytes) 000207 1785389328.063482 fallocate 0x01e54b thru 0x02c1f2 (0xdca8 bytes) 000208 1785389328.068543 trunc from 0x027427 to 0x02bf2b (0x4b05 bytes) 000209 1785389328.071861 fallocate 0x03476f thru 0x03eae7 (0xa379 bytes) 000210 1785389328.076830 mapwrite 0x02d190 thru 0x035b98 (0x8a09 bytes) 000211 1785389328.105915 fallocate 0x0021f8 thru 0x003831 (0x163a bytes) 000213 1785389328.119879 punch from 0x03a12b to 0x03eae7 (0x49bd bytes) 000215 1785389328.127290 trunc from 0x03eae8 to 0x00ccaa (0x31e3d bytes) 000216 1785389328.144861 read 0x008dce thru 0x00c2b9 (0x34ec bytes) 000218 1785389328.156411 read 0x0075a8 thru 0x00ccaa (0x5703 bytes) 000220 1785389328.165986 trunc from 0x006e31 to 0x00ccaa (0x5e7a bytes) 000221 1785389328.170436 punch from 0x001f8f to 0x009f94 (0x8006 bytes) 000222 1785389328.175170 mapwrite 0x01fd55 thru 0x022505 (0x27b1 bytes) 000223 1785389328.215037 mapread 0x00bc63 thru 0x01af75 (0xf313 bytes) 000224 1785389328.227314 trunc from 0x022506 to 0x01a726 (0x7ddf bytes) 000225 1785389328.246346 MIRROR_RESYNC 3 mirrors 000226 1785389329.083908 trunc from 0x01a727 to 0x01626c (0x44ba bytes) 000227 1785389329.270210 mapwrite 0x010e52 thru 0x020044 (0xf1f3 bytes) 000228 1785389329.339022 trunc from 0x020045 to 0x039631 (0x195ed bytes) 000229 1785389329.372816 MIRROR_RESYNC 3 mirrors 000230 1785389330.288137 MIRROR_RESYNC 3 mirrors 000231 1785389331.002911 fallocate 0x00c381 thru 0x01b8fe (0xf57e bytes) 000232 1785389331.080291 fallocate 0x035e22 thru 0x03602a (0x209 bytes) 000233 1785389331.091184 mapread 0x015b10 thru 0x021400 (0xb8f1 bytes) 000234 1785389331.173703 mapread 0x02dcc9 thru 0x02f451 (0x1789 bytes) 000236 1785389331.186145 fallocate 0x01f6b3 thru 0x029df3 (0xa741 bytes) 000237 1785389331.192904 trunc from 0x039632 to 0x029941 (0xfcf0 bytes) 000238 1785389331.207883 trunc from 0x01754c to 0x01ec73 (0x7728 bytes) 000239 1785389331.218624 read 0x020617 thru 0x029941 (0x932b bytes) 000241 1785389331.232907 mapwrite 0x00cad1 thru 0x012540 (0x5a70 bytes) 000242 1785389331.319114 fallocate 0x0016cc thru 0x0066d9 (0x500e bytes) 000243 1785389331.333427 trunc from 0x0169a9 to 0x0249c7 (0xe01f bytes) 000244 1785389331.344615 write 0x01cb38 thru 0x022097 (0x5560 bytes) 000245 1785389331.368871 punch from 0x018001 to 0x01865d (0x65d bytes) 000246 1785389331.379129 mapwrite 0x015551 thru 0x02284b (0xd2fb bytes) 000247 1785389331.466413 read 0x000852 thru 0x00ded4 (0xd683 bytes) 000248 1785389331.488864 fallocate 0x03cfc7 thru 0x03ffff (0x3039 bytes) 000249 1785389331.497870 read 0x0067e8 thru 0x013ed6 (0xd6ef bytes) 000250 1785389331.507769 mapread 0x021990 thru 0x029941 (0x7fb2 bytes) 000251 1785389331.509759 mapread 0x012dde thru 0x013534 (0x757 bytes) 000252 1785389331.513386 trunc from 0x00f784 to 0x01a493 (0xad10 bytes) 000253 1785389331.519879 write 0x0250f1 thru 0x025ea4 (0xdb4 bytes) 000254 1785389331.521071 punch from 0x00e9d0 to 0x015bd4 (0x7205 bytes) 000255 1785389331.528009 trunc from 0x0093fb to 0x00e532 (0x5138 bytes) 000256 1785389331.534123 read 0x0258e1 thru 0x029941 (0x4061 bytes) 000258 1785389331.537122 read 0x01d526 thru 0x01ed81 (0x185c bytes) 000259 1785389331.540185 mapread 0x00e726 thru 0x00e845 (0x120 bytes) 000260 1785389331.553471 trunc from 0x001664 to 0x00f2ac (0xdc49 bytes) 000261 1785389331.563157 mapread 0x018183 thru 0x026c33 (0xeab1 bytes) 000262 1785389331.567632 mapwrite 0x01169a thru 0x01b777 (0xa0de bytes) 000263 1785389331.617749 fallocate 0x01f2ce thru 0x02e93a (0xf66d bytes) 000264 1785389331.634928 trunc from 0x02e93b to 0x012965 (0x1bfd5 bytes) 000265 1785389331.683215 trunc from 0x00d4f8 to 0x012965 (0x546e bytes) 000266 1785389331.704781 trunc from 0x00a135 to 0x00a4b6 (0x382 bytes) 000268 1785389331.712535 trunc from 0x012966 to 0x024fe5 (0x12680 bytes) 000269 1785389331.734054 write 0x033297 thru 0x036f50 (0x3cba bytes) 000270 1785389331.735590 mapwrite 0x0162be thru 0x023db6 (0xdaf9 bytes) 000271 1785389331.993623 read 0x032565 thru 0x032d0a (0x7a6 bytes) 000273 1785389331.995795 trunc from 0x036f51 to 0x0377d7 (0x887 bytes) 000275 1785389332.047169 write 0x01e313 thru 0x01e6d3 (0x3c1 bytes) 000277 1785389332.056600 mapwrite 0x0101b3 thru 0x0183a4 (0x81f2 bytes) 000278 1785389332.157230 trunc from 0x0377d8 to 0x033153 (0x4684 bytes) 000279 1785389332.175561 mapread 0x02a0b1 thru 0x033153 (0x90a3 bytes) 000280 1785389332.176864 trunc from 0x018414 to 0x01eaa5 (0x6692 bytes) 000281 1785389332.202519 mapread 0x01a19c thru 0x025ed3 (0xbd38 bytes) 000282 1785389332.235365 mapread 0x0031af thru 0x010c5e (0xdab0 bytes) 000284 1785389332.244171 trunc from 0x02fe4e to 0x030b34 (0xce7 bytes) 000285 1785389332.260967 trunc from 0x0140c4 to 0x018179 (0x40b6 bytes) 000286 1785389332.273587 trunc from 0x026d18 to 0x033153 (0xc43c bytes) 000287 1785389332.289812 mapread 0x00d365 thru 0x0185dd (0xb279 bytes) 000288 1785389332.333947 trunc from 0x008d58 to 0x00900a (0x2b3 bytes) 000290 1785389332.358756 trunc from 0x033154 to 0x02e9d3 (0x4780 bytes) 000291 1785389332.393053 mapwrite 0x0225bd thru 0x02cb28 (0xa56c bytes) 000292 1785389332.527490 read 0x01c4ed thru 0x01fb63 (0x3677 bytes) 000293 1785389332.528146 punch from 0x004a06 to 0x007715 (0x2d10 bytes) 000294 1785389332.542379 mapwrite 0x028d1c thru 0x03201d (0x9302 bytes) 000295 1785389332.646965 fallocate 0x01beb9 thru 0x028dc7 (0xcf0f bytes) 000296 1785389332.670147 mapwrite 0x035a09 thru 0x036d89 (0x1381 bytes) 000297 1785389332.763778 MIRROR_RESYNC 3 mirrors 000298 1785389334.672801 MIRROR_RESYNC 3 mirrors 000299 1785389335.567272 read 0x00c1e1 thru 0x01b818 (0xf638 bytes) 000300 1785389335.582953 mapwrite 0x03eeba thru 0x03f245 (0x38c bytes) 000301 1785389335.703840 punch from 0x03b424 to 0x03e7b0 (0x338d bytes) 000302 1785389335.713012 read 0x000c56 thru 0x001ebb (0x1266 bytes) 000303 1785389335.748779 trunc from 0x03f246 to 0x011aab (0x2d79a bytes) 000304 1785389335.813363 mapwrite 0x000d80 thru 0x00ff01 (0xf182 bytes) 000305 1785389335.878191 mapwrite 0x005122 thru 0x008ec9 (0x3da8 bytes) 000307 1785389335.929246 mapread 0x0029ad thru 0x00b970 (0x8fc4 bytes) 000308 1785389335.930400 mapwrite 0x02e88f thru 0x02f547 (0xcb9 bytes) 000309 1785389336.032523 trunc from 0x02f548 to 0x01b8c4 (0x13c83 bytes) 000310 1785389336.060341 fallocate 0x01c8da thru 0x023c2e (0x7355 bytes) 000311 1785389336.102119 read 0x0033ad thru 0x0054a3 (0x20f7 bytes) 000312 1785389336.105342 mapread 0x0160a5 thru 0x01b8c4 (0x5820 bytes) 000313 1785389336.128049 trunc from 0x01b8c5 to 0x01b27d (0x647 bytes) 000314 1785389336.159051 write 0x01a38c thru 0x02610a (0xbd7f bytes) 000316 1785389336.167224 mapread 0x011e35 thru 0x0175bf (0x578b bytes) 000317 1785389336.168473 punch from 0x006cfe to 0x00edb1 (0x80b4 bytes) 000318 1785389336.191276 trunc from 0x02610b to 0x036228 (0x1011e bytes) 000320 1785389336.221355 write 0x02cfab thru 0x02e443 (0x1499 bytes) 000321 1785389336.237275 trunc from 0x036229 to 0x019ae8 (0x1c740 bytes) 000322 1785389336.284170 mapwrite 0x024b29 thru 0x034938 (0xfe10 bytes) 000324 1785389336.703287 mapread 0x02ded2 thru 0x032452 (0x4581 bytes) 000325 1785389336.713304 read 0x01e7c1 thru 0x02d163 (0xe9a3 bytes) 000326 1785389336.789476 punch from 0x033283 to 0x034938 (0x16b6 bytes) 000327 1785389336.796952 mapwrite 0x03b6e2 thru 0x03fa48 (0x4367 bytes) 000328 1785389336.879328 mapwrite 0x010707 thru 0x0178f8 (0x71f2 bytes) 000329 1785389336.918578 write 0x035e46 thru 0x03ffff (0xa1ba bytes) 000330 1785389336.935124 mapread 0x01b852 thru 0x022c5e (0x740d bytes) 000331 1785389336.942476 trunc from 0x040000 to 0x022c5d (0x1d3a2 bytes) 000332 1785389337.008988 fallocate 0x039bf6 thru 0x03be29 (0x2234 bytes) 000333 1785389337.034109 mapwrite 0x00d135 thru 0x010b51 (0x3a1d bytes) 000334 1785389337.069986 fallocate 0x02bd8c thru 0x03b217 (0xf48c bytes) 000335 1785389337.104785 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3be2a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3be2a): Mirror 3: 0xf8386df3 (stale) Mirror 4: 0xf8386df3 (stale) CRC-32 checksum value for chunk [0, 0x3be2a): Mirror 1: 0x146b8d4c Mirror 5: 0x146b8d4c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3be2a: skipped 000336 1785389339.646940 trunc from 0x021f88 to 0x0310be (0xf137 bytes) 000337 1785389339.766359 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3be2a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3be2a): Mirror 3: 0xf8386df3 (stale) Mirror 4: 0xf8386df3 (stale) Mirror 5: 0x146b8d4c (stale) CRC-32 checksum value for chunk [0, 0x3be2a): Mirror 1: 0x146b8d4c Mirror 6: 0x146b8d4c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3be2a: skipped 000338 1785389341.825966 write 0x01bb55 thru 0x01c525 (0x9d1 bytes) 000339 1785389341.987373 trunc from 0x03be2a to 0x03baa0 (0x389 bytes) 000340 1785389342.047526 punch from 0x0210d6 to 0x029848 (0x8773 bytes) 000341 1785389342.076196 mapread 0x01cee4 thru 0x020db7 (0x3ed4 bytes) 000342 1785389342.134367 trunc from 0x0238cc to 0x029a03 (0x6138 bytes) 000343 1785389342.154505 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3baa1): Mirror 3: 0x925fa194 (stale) Mirror 4: 0x925fa194 (stale) Mirror 5: 0x5d4992ec (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3baa1): Mirror 3: 0x925fa194 (stale) Mirror 4: 0x925fa194 (stale) Mirror 5: 0x5d4992ec (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3baa1: skipped 000344 1785389343.188134 fallocate 0x0341c7 thru 0x035229 (0x1063 bytes) 000345 1785389343.215379 trunc from 0x03baa1 to 0x0394fe (0x25a2 bytes) 000346 1785389343.276597 write 0x0098c7 thru 0x00bf39 (0x2673 bytes) 000347 1785389343.305096 mapread 0x0125a8 thru 0x01836c (0x5dc5 bytes) 000349 1785389343.382048 trunc from 0x01239d to 0x01a98a (0x85ee bytes) 000351 1785389343.402890 punch from 0x02344b to 0x0257c1 (0x2377 bytes) 000352 1785389343.427104 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x394ff): Mirror 3: 0x928284e8 (stale) Mirror 4: 0x928284e8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x394ff): Mirror 3: 0x928284e8 (stale) Mirror 4: 0x928284e8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x394ff: skipped 000353 1785389344.051837 punch from 0x00c8c4 to 0x0144cf (0x7c0c bytes) 000354 1785389344.064980 mapread 0x00fea1 thru 0x01f18d (0xf2ed bytes) 000355 1785389344.136191 mapread 0x038b12 thru 0x0394fe (0x9ed bytes) 000356 1785389344.146949 mapread 0x01042f thru 0x014c74 (0x4846 bytes) 000359 1785389344.156193 punch from 0x0105e4 to 0x019f59 (0x9976 bytes) 000360 1785389344.192075 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x394ff): Mirror 3: 0x928284e8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x394ff): Mirror 3: 0x928284e8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x394ff: skipped 000361 1785389344.819538 trunc from 0x0394ff to 0x027816 (0x11ce8 bytes) 000362 1785389344.915922 write 0x03f5d6 thru 0x03ffff (0xa2a bytes) 000363 1785389344.924195 trunc from 0x040000 to 0x002fb0 (0x3d04f bytes) 000364 1785389345.005396 write 0x039717 thru 0x03ffff (0x68e9 bytes) 000365 1785389345.015680 trunc from 0x020407 to 0x02397b (0x3575 bytes) 000366 1785389345.040240 trunc from 0x040000 to 0x0338c8 (0xc737 bytes) 000367 1785389345.085054 read 0x01344e thru 0x016d00 (0x38b3 bytes) 000368 1785389345.111703 read 0x022a9a thru 0x03210a (0xf671 bytes) 000369 1785389345.141337 punch from 0x02238c to 0x02a0a0 (0x7d15 bytes) 000371 1785389345.164052 fallocate 0x00b63a thru 0x017287 (0xbc4e bytes) 000372 1785389345.180298 read 0x0145f5 thru 0x021e6a (0xd876 bytes) 000373 1785389345.184001 trunc from 0x0338c9 to 0x005590 (0x2e338 bytes) 000374 1785389345.212600 read 0x002f48 thru 0x003b53 (0xc0c bytes) 000375 1785389345.213591 fallocate 0x03b4dd thru 0x03cda8 (0x18cc bytes) 000376 1785389345.238364 read 0x0162d8 thru 0x01e2d0 (0x7ff9 bytes) 000377 1785389345.294599 write 0x02bbf1 thru 0x034c54 (0x9064 bytes) 000378 1785389345.304380 fallocate 0x0055b1 thru 0x00ee99 (0x98e9 bytes) 000379 1785389345.335180 mapwrite 0x03867d thru 0x038bca (0x54e bytes) 000380 1785389345.418512 fallocate 0x00861e thru 0x00b4a2 (0x2e85 bytes) 000381 1785389345.469351 trunc from 0x03cda9 to 0x0083c1 (0x349e7 bytes) 000382 1785389345.511173 trunc from 0x001477 to 0x0083c1 (0x6f4b bytes) 000383 1785389345.529021 write 0x008ca0 thru 0x017b58 (0xeeb9 bytes) 000384 1785389345.549037 mapwrite 0x01c061 thru 0x029cd0 (0xdc70 bytes) 000385 1785389346.012742 write 0x00ff12 thru 0x01ac72 (0xad61 bytes) 000386 1785389346.022417 mapread 0x0092bf thru 0x010c6b (0x79ad bytes) 000387 1785389346.023629 mapwrite 0x00caf5 thru 0x01baff (0xf00b bytes) 000389 1785389346.081766 write 0x000991 thru 0x007d3d (0x73ad bytes) 000390 1785389346.095569 mapwrite 0x02128d thru 0x0297e0 (0x8554 bytes) 000391 1785389346.132335 punch from 0x015c91 to 0x0194b5 (0x3825 bytes) 000392 1785389346.138828 punch from 0x00d182 to 0x00f389 (0x2208 bytes) 000393 1785389346.148027 fallocate 0x01f70b thru 0x024554 (0x4e4a bytes) 000395 1785389346.162584 write 0x01284b thru 0x01b1d1 (0x8987 bytes) 000396 1785389346.174586 trunc from 0x029cd1 to 0x02ecb3 (0x4fe3 bytes) 000397 1785389346.226349 MIRROR_RESYNC 2 mirrors 000398 1785389347.637621 fallocate 0x00ea00 thru 0x01e0cd (0xf6ce bytes) 000399 1785389347.727465 MIRROR_RESYNC 2 mirrors 000400 1785389348.776187 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) 000401 1785389349.062870 trunc from 0x014855 to 0x0181de (0x398a bytes) 000402 1785389349.079102 write 0x0087b4 thru 0x0181f7 (0xfa44 bytes) 000403 1785389349.096892 read 0x02d980 thru 0x02ecb3 (0x1334 bytes) 000404 1785389349.104413 trunc from 0x00895b to 0x010e8e (0x8534 bytes) 000405 1785389349.137424 write 0x0239f7 thru 0x028ed9 (0x54e3 bytes) 000406 1785389349.173328 mapread 0x01aade thru 0x01c099 (0x15bc bytes) 000407 1785389349.215234 mapwrite 0x0162d5 thru 0x01c11d (0x5e49 bytes) 000408 1785389349.248942 fallocate 0x01211f thru 0x018bd4 (0x6ab6 bytes) 000409 1785389349.269092 trunc from 0x01d347 to 0x0288b7 (0xb571 bytes) 000410 1785389349.277589 punch from 0x00685b to 0x010240 (0x99e6 bytes) 000411 1785389349.312723 MIRROR_EXTEND to 2 mirrors 000412 1785389350.699385 trunc from 0x02ecb4 to 0x023bd3 (0xb0e0 bytes) 000413 1785389350.802104 punch from 0x012547 to 0x012c67 (0x721 bytes) 000414 1785389350.825249 write 0x026ac6 thru 0x030c3d (0xa178 bytes) 000415 1785389350.830705 mapread 0x02f151 thru 0x030c3d (0x1aed bytes) 000416 1785389350.832978 fallocate 0x0175ba thru 0x01f7fd (0x8244 bytes) 000417 1785389350.841066 trunc from 0x021486 to 0x029e15 (0x8990 bytes) 000418 1785389350.893287 punch from 0x027477 to 0x02ab09 (0x3693 bytes) 000419 1785389350.904025 fallocate 0x01c34e thru 0x027c11 (0xb8c4 bytes) 000420 1785389350.923109 mapread 0x02cf23 thru 0x030c3d (0x3d1b bytes) 000421 1785389350.924909 punch from 0x02856b to 0x030c3d (0x86d3 bytes) 000422 1785389350.937031 write 0x014b72 thru 0x01e495 (0x9924 bytes) 000423 1785389350.952092 trunc from 0x030c3e to 0x0034b6 (0x2d787 bytes) 000424 1785389350.997100 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x34b7): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34b7): Mirror 2: 0x7e85d12a (stale) CRC-32 checksum value for chunk [0, 0x34b7): Mirror 1: 0x7e85d12a Mirror 3: 0x7e85d12a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34b7: skipped 000426 1785389352.152105 write 0x00a484 thru 0x0194c9 (0xf046 bytes) 000427 1785389352.235706 trunc from 0x0194ca to 0x03f7eb (0x26322 bytes) 000428 1785389352.296581 mapwrite 0x02d042 thru 0x032061 (0x5020 bytes) 000429 1785389352.405993 read 0x014719 thru 0x015bd1 (0x14b9 bytes) 000430 1785389352.406873 mapwrite 0x03927f thru 0x03949d (0x21f bytes) 000431 1785389352.470036 write 0x00a183 thru 0x01292f (0x87ad bytes) 000432 1785389352.477450 write 0x007b8e thru 0x00bbd1 (0x4044 bytes) 000433 1785389352.490035 trunc from 0x00bdd4 to 0x019b65 (0xdd92 bytes) 000435 1785389352.541000 read 0x020ecf thru 0x028b70 (0x7ca2 bytes) 000436 1785389352.568511 read 0x0281dd thru 0x032038 (0x9e5c bytes) 000437 1785389352.571996 mapread 0x012d18 thru 0x0194c5 (0x67ae bytes) 000438 1785389352.577907 write 0x03ed80 thru 0x03ffff (0x1280 bytes) 000439 1785389352.581875 mapread 0x00d5e1 thru 0x01118b (0x3bab bytes) 000440 1785389352.584702 mapwrite 0x00e3ab thru 0x01cc4f (0xe8a5 bytes) 000441 1785389352.624664 read 0x02ef6d thru 0x03c169 (0xd1fd bytes) 000442 1785389352.625319 write 0x03198b thru 0x03cfc9 (0xb63f bytes) 000443 1785389352.629520 read 0x0153f8 thru 0x01b3f9 (0x6002 bytes) 000445 1785389352.630876 read 0x01604c thru 0x024476 (0xe42b bytes) 000446 1785389352.645703 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x70be9d2b (stale) Mirror 3: 0x35b201bd (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x784a423a Mirror 4: 0x784a423a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000447 1785389354.265863 write 0x0142b4 thru 0x01fc88 (0xb9d5 bytes) 000448 1785389354.339120 write 0x00c5a9 thru 0x01190c (0x5364 bytes) 000450 1785389354.380457 fallocate 0x007669 thru 0x013d89 (0xc721 bytes) 000452 1785389354.399878 trunc from 0x00d637 to 0x015118 (0x7ae2 bytes) 000453 1785389354.431791 write 0x001e42 thru 0x00977f (0x793e bytes) 000454 1785389354.463091 mapwrite 0x006062 thru 0x00ca46 (0x69e5 bytes) 000455 1785389354.531839 write 0x01c6c0 thru 0x024c08 (0x8549 bytes) 000456 1785389354.545601 punch from 0x01c8af to 0x02023f (0x3991 bytes) 000457 1785389354.586998 mapwrite 0x03895d thru 0x03aebc (0x2560 bytes) 000459 1785389354.641005 fallocate 0x0261a4 thru 0x02e150 (0x7fad bytes) 000460 1785389354.655299 mapwrite 0x00a19a thru 0x013430 (0x9297 bytes) 000463 1785389354.742474 mapread 0x0119f7 thru 0x014537 (0x2b41 bytes) 000464 1785389354.746550 punch from 0x019313 to 0x01fa24 (0x6712 bytes) 000465 1785389354.754260 mapwrite 0x0316cd thru 0x0388a4 (0x71d8 bytes) 000466 1785389354.786454 write 0x000734 thru 0x0096f2 (0x8fbf bytes) 000467 1785389354.806224 fallocate 0x014457 thru 0x016880 (0x242a bytes) 000468 1785389354.827188 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x70be9d2b (stale) Mirror 3: 0x35b201bd (stale) Mirror 4: 0x784a423a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5713121f Mirror 5: 0x5713121f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000469 1785389357.024779 trunc from 0x0157c4 to 0x01e007 (0x8844 bytes) 000470 1785389357.136907 write 0x03ba65 thru 0x03ffff (0x459b bytes) 000471 1785389357.170582 trunc from 0x030cba to 0x03a1e7 (0x952e bytes) 000474 1785389357.195697 punch from 0x039499 to 0x03ffff (0x6b67 bytes) 000477 1785389357.222982 read 0x028440 thru 0x03648e (0xe04f bytes) 000478 1785389357.254242 read 0x007fed thru 0x011adc (0x9af0 bytes) 000479 1785389357.275264 read 0x031306 thru 0x0369e6 (0x56e1 bytes) 000480 1785389357.278986 read 0x03b9a9 thru 0x03ffff (0x4657 bytes) 000481 1785389357.287220 write 0x02e454 thru 0x038c17 (0xa7c4 bytes) 000482 1785389357.298311 trunc from 0x040000 to 0x00c798 (0x33867 bytes) 000483 1785389357.388528 write 0x0067dd thru 0x0136df (0xcf03 bytes) 000484 1785389357.392715 fallocate 0x02d92a thru 0x038d70 (0xb447 bytes) 000486 1785389357.405275 mapwrite 0x0326be thru 0x032cbb (0x5fe bytes) 000487 1785389357.621368 fallocate 0x0115f8 thru 0x0172a9 (0x5cb2 bytes) 000488 1785389357.628895 mapwrite 0x02feb0 thru 0x03e895 (0xe9e6 bytes) 000489 1785389357.812937 read 0x00734c thru 0x014d7b (0xda30 bytes) 000491 1785389357.814188 fallocate 0x016e28 thru 0x02404e (0xd227 bytes) 000493 1785389357.837684 fallocate 0x031463 thru 0x0362d8 (0x4e76 bytes) 000494 1785389357.877921 mapwrite 0x01967b thru 0x026177 (0xcafd bytes) 000495 1785389357.993140 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3e896): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e896): Mirror 2: 0xe640ad31 (stale) Mirror 3: 0x9ff4ce3e (stale) Mirror 4: 0x72d4d998 (stale) Mirror 5: 0x48f7516c (stale) CRC-32 checksum value for chunk [0, 0x3e896): Mirror 1: 0x8eea0bef Mirror 6: 0x8eea0bef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e896: skipped 000497 1785389359.818969 trunc from 0x0333d0 to 0x03731e (0x3f4f bytes) 000498 1785389359.940871 fallocate 0x0395a7 thru 0x03dcd9 (0x4733 bytes) 000499 1785389359.958832 fallocate 0x039950 thru 0x039ecd (0x57e bytes) 000500 1785389359.969279 trunc from 0x00a154 to 0x00b8ea (0x1797 bytes) 000501 1785389360.007830 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e896): Mirror 2: 0xe640ad31 (stale) Mirror 3: 0x9ff4ce3e (stale) Mirror 4: 0x72d4d998 (stale) Mirror 5: 0x48f7516c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e896): Mirror 2: 0xe640ad31 (stale) Mirror 3: 0x9ff4ce3e (stale) Mirror 4: 0x72d4d998 (stale) Mirror 5: 0x48f7516c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e896: skipped 000502 1785389361.069323 write 0x0367ba thru 0x0378e0 (0x1127 bytes) 000503 1785389361.107123 mapwrite 0x031bd3 thru 0x03ffff (0xe42d bytes) 000504 1785389361.254722 fallocate 0x01a5cc thru 0x022886 (0x82bb bytes) 000505 1785389361.265131 mapwrite 0x02466b thru 0x03454a (0xfee0 bytes) 000506 1785389361.419139 write 0x03d364 thru 0x03ffff (0x2c9c bytes) 000507 1785389361.420271 fallocate 0x023e36 thru 0x0264a1 (0x266c bytes) 000508 1785389361.428595 fallocate 0x021932 thru 0x027a41 (0x6110 bytes) 000509 1785389361.447318 trunc from 0x040000 to 0x001030 (0x3efcf bytes) 000510 1785389361.506354 mapread 0x000370 thru 0x001030 (0xcc1 bytes) 000512 1785389361.515062 trunc from 0x000f8b to 0x001030 (0xa6 bytes) 000513 1785389361.539889 MIRROR_RESYNC 5 mirrors 000514 1785389362.665354 mapwrite 0x01fa04 thru 0x026a54 (0x7051 bytes) 000515 1785389362.841577 trunc from 0x016cfa to 0x017b13 (0xe1a bytes) 000516 1785389362.849618 mapwrite 0x00fb16 thru 0x015260 (0x574b bytes) 000517 1785389362.907913 MIRROR_RESYNC 5 mirrors 000518 1785389363.954032 read 0x0153c5 thru 0x0195aa (0x41e6 bytes) 000519 1785389363.961130 mapwrite 0x025803 thru 0x028f5f (0x375d bytes) 000521 1785389364.023582 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x28f60): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28f60): Mirror 2: 0xd052bb54 (stale) Mirror 3: 0xd052bb54 (stale) Mirror 4: 0xd052bb54 (stale) Mirror 5: 0xd052bb54 (stale) CRC-32 checksum value for chunk [0, 0x28f60): Mirror 1: 0xe2a0dbac Mirror 6: 0xe2a0dbac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28f60: skipped 000522 1785389365.145610 write 0x005217 thru 0x00eb98 (0x9982 bytes) 000523 1785389365.204725 mapwrite 0x030268 thru 0x03e277 (0xe010 bytes) 000524 1785389365.268503 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3e278): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e278): Mirror 2: 0x79e1aad9 (stale) Mirror 3: 0x79e1aad9 (stale) Mirror 4: 0x79e1aad9 (stale) Mirror 5: 0x79e1aad9 (stale) Mirror 6: 0xc354511d (stale) CRC-32 checksum value for chunk [0, 0x3e278): Mirror 1: 0x38accdb0 Mirror 7: 0x38accdb0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e278: skipped 000525 1785389367.200555 trunc from 0x002c6b to 0x005362 (0x26f8 bytes) 000526 1785389367.304054 MIRROR_RESYNC 7 mirrors 000527 1785389370.517672 mapwrite 0x033022 thru 0x0347f6 (0x17d5 bytes) 000528 1785389370.687080 write 0x01c9a4 thru 0x01f3f9 (0x2a56 bytes) 000530 1785389370.706279 trunc from 0x00fa5b to 0x018281 (0x8827 bytes) 000531 1785389370.721078 trunc from 0x02330e to 0x02e9e4 (0xb6d7 bytes) 000532 1785389370.737120 trunc from 0x03e278 to 0x025f5b (0x1831c bytes) 000533 1785389370.792133 read 0x01d159 thru 0x025f5b (0x8e03 bytes) 000534 1785389370.822231 trunc from 0x025f5c to 0x0257cf (0x78c bytes) 000535 1785389370.875069 mapread 0x0120ee thru 0x01845e (0x6371 bytes) 000537 1785389370.908495 fallocate 0x005c44 thru 0x00c985 (0x6d42 bytes) 000539 1785389370.924145 trunc from 0x0067fb to 0x00a758 (0x3f5e bytes) 000540 1785389370.943803 write 0x02cf39 thru 0x034694 (0x775c bytes) 000541 1785389370.954057 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x34695): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34695): Mirror 2: 0xfcc28da (stale) Mirror 3: 0xfcc28da (stale) Mirror 4: 0xfcc28da (stale) Mirror 5: 0xfcc28da (stale) Mirror 6: 0xfcc28da (stale) Mirror 7: 0xfcc28da (stale) CRC-32 checksum value for chunk [0, 0x34695): Mirror 1: 0x61c52f51 Mirror 8: 0x61c52f51 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34695: skipped 000542 1785389373.277880 mapwrite 0x00a230 thru 0x00da52 (0x3823 bytes) 000543 1785389373.522447 mapwrite 0x03f62e thru 0x03ffff (0x9d2 bytes) 000544 1785389373.628533 write 0x013087 thru 0x019530 (0x64aa bytes) 000545 1785389373.649748 read 0x035acd thru 0x03d42c (0x7960 bytes) 000546 1785389373.668633 fallocate 0x02513d thru 0x02e88d (0x9751 bytes) 000547 1785389373.686671 read 0x013082 thru 0x0143e8 (0x1367 bytes) 000549 1785389373.688164 mapwrite 0x012ada thru 0x0135ce (0xaf5 bytes) 000551 1785389373.755165 mapread 0x02484a thru 0x033967 (0xf11e bytes) 000552 1785389373.800778 fallocate 0x016f5f thru 0x023345 (0xc3e7 bytes) 000553 1785389373.829313 mapwrite 0x02cb08 thru 0x030e94 (0x438d bytes) 000554 1785389373.888274 read 0x00501e thru 0x008743 (0x3726 bytes) 000555 1785389373.888903 trunc from 0x014861 to 0x01f212 (0xa9b2 bytes) 000556 1785389373.902080 write 0x02c54d thru 0x02fd44 (0x37f8 bytes) 000558 1785389373.907486 trunc from 0x040000 to 0x032bbd (0xd442 bytes) 000559 1785389373.955098 punch from 0x006192 to 0x014cc1 (0xeb30 bytes) 000561 1785389373.974587 punch from 0x007547 to 0x0104c5 (0x8f7f bytes) 000562 1785389373.982632 trunc from 0x032bbe to 0x00b3fc (0x277c1 bytes) 000563 1785389374.030120 read 0x00717c thru 0x00772a (0x5af bytes) 000564 1785389374.046731 mapread 0x0028ce thru 0x0039f8 (0x112b bytes) 000565 1785389374.047916 read 0x0097fe thru 0x00b3fc (0x1bff bytes) 000566 1785389374.067039 MIRROR_RESYNC 8 mirrors 000567 1785389376.629256 fallocate 0x013e7f thru 0x01cb31 (0x8cb3 bytes) 000568 1785389376.690768 write 0x014d17 thru 0x017ab6 (0x2da0 bytes) 000569 1785389376.726401 write 0x006543 thru 0x015152 (0xec10 bytes) 000570 1785389376.751306 mapwrite 0x03c98c thru 0x03ffff (0x3674 bytes) 000571 1785389376.897208 fallocate 0x0201bc thru 0x02b374 (0xb1b9 bytes) 000572 1785389376.925799 punch from 0x01357a to 0x01b0cc (0x7b53 bytes) 000574 1785389376.953879 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xbb64c279 (stale) Mirror 3: 0xbb64c279 (stale) Mirror 4: 0xbb64c279 (stale) Mirror 5: 0xbb64c279 (stale) Mirror 6: 0xbb64c279 (stale) Mirror 7: 0xbb64c279 (stale) Mirror 8: 0xbb64c279 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf7ee92a5 Mirror 9: 0xf7ee92a5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000575 1785389378.815171 punch from 0x01b17c to 0x01b285 (0x10a bytes) 000576 1785389378.900997 trunc from 0x004d96 to 0x0119cd (0xcc38 bytes) 000577 1785389378.908589 trunc from 0x040000 to 0x03f651 (0x9ae bytes) 000578 1785389378.951595 punch from 0x02fc7d to 0x039431 (0x97b5 bytes) 000579 1785389378.969428 fallocate 0x03429a thru 0x03ffff (0xbd66 bytes) 000581 1785389378.991248 write 0x02d81a thru 0x03b3a3 (0xdb8a bytes) 000582 1785389379.013371 punch from 0x00b1b1 to 0x00f5f9 (0x4449 bytes) 000583 1785389379.024523 write 0x01f503 thru 0x02dcc6 (0xe7c4 bytes) 000584 1785389379.037719 mapwrite 0x009c37 thru 0x00efcd (0x5397 bytes) 000586 1785389379.122099 mapread 0x02a318 thru 0x02fce3 (0x59cc bytes) 000587 1785389379.123185 punch from 0x0302c1 to 0x03322d (0x2f6d bytes) 000588 1785389379.131365 mapread 0x00b1e1 thru 0x015fb8 (0xadd8 bytes) 000589 1785389379.157335 trunc from 0x02c3c8 to 0x0320c1 (0x5cfa bytes) 000590 1785389379.172496 punch from 0x021fb5 to 0x031414 (0xf460 bytes) 000591 1785389379.186171 fallocate 0x00d639 thru 0x0167d7 (0x919f bytes) 000592 1785389379.203228 punch from 0x01741a to 0x01d01f (0x5c06 bytes) 000593 1785389379.210952 punch from 0x00aff3 to 0x00ca4a (0x1a58 bytes) 000594 1785389379.221017 trunc from 0x040000 to 0x028bbf (0x17440 bytes) 000595 1785389379.259209 mapwrite 0x01b5bd thru 0x023af8 (0x853c bytes) 000596 1785389379.327513 trunc from 0x000103 to 0x00e214 (0xe112 bytes) 000597 1785389379.334077 write 0x0094dc thru 0x00a81c (0x1341 bytes) 000598 1785389379.368712 fallocate 0x03de0f thru 0x03ffff (0x21f1 bytes) 000601 1785389379.381491 read 0x03a7f8 thru 0x03f1c5 (0x49ce bytes) 000602 1785389379.393668 write 0x02776b thru 0x02aec8 (0x375e bytes) 000603 1785389379.423380 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xbb64c279 (stale) Mirror 3: 0xbb64c279 (stale) Mirror 4: 0xbb64c279 (stale) Mirror 5: 0xbb64c279 (stale) Mirror 6: 0xbb64c279 (stale) Mirror 7: 0xbb64c279 (stale) Mirror 8: 0xbb64c279 (stale) Mirror 9: 0xf7ee92a5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2afec6c2 Mirror 10: 0x2afec6c2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000604 1785389382.159076 trunc from 0x040000 to 0x02769d (0x18962 bytes) 000606 1785389382.353098 fallocate 0x00b3e2 thru 0x00d223 (0x1e42 bytes) 000607 1785389382.367498 fallocate 0x038db2 thru 0x03ffff (0x724e bytes) 000608 1785389382.383822 trunc from 0x02769e to 0x00ac20 (0x1ca7d bytes) 000609 1785389382.409173 mapread 0x00a4fb thru 0x00ac20 (0x726 bytes) 000610 1785389382.420202 fallocate 0x024343 thru 0x02c8dc (0x859a bytes) 000612 1785389382.433542 mapwrite 0x03d9b2 thru 0x03eb7a (0x11c9 bytes) 000613 1785389382.538114 trunc from 0x03eb7b to 0x03950e (0x566c bytes) 000614 1785389382.558958 trunc from 0x03950f to 0x01da15 (0x1baf9 bytes) 000615 1785389382.578995 trunc from 0x00647d to 0x00c636 (0x61ba bytes) 000616 1785389382.592632 fallocate 0x00dfb9 thru 0x00fa36 (0x1a7e bytes) 000617 1785389382.615928 trunc from 0x01da16 to 0x023cc4 (0x62af bytes) 000618 1785389382.667941 punch from 0x01ef54 to 0x023cc4 (0x4d71 bytes) 000619 1785389382.684339 write 0x00e47c thru 0x00fbd7 (0x175c bytes) 000620 1785389382.703567 write 0x004f0f thru 0x0135ca (0xe6bc bytes) 000621 1785389382.748340 fallocate 0x0278fc thru 0x031e21 (0xa526 bytes) 000622 1785389382.766272 read 0x01b448 thru 0x01dea3 (0x2a5c bytes) 000623 1785389382.792147 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31e22): Mirror 2: 0x2ca4c5c (stale) Mirror 4: 0x2ca4c5c (stale) Mirror 5: 0x2ca4c5c (stale) Mirror 6: 0x2ca4c5c (stale) Mirror 7: 0x2ca4c5c (stale) Mirror 8: 0x2ca4c5c (stale) Mirror 9: 0xbf8b120 (stale) Mirror 10: 0xddf1f91f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31e22): Mirror 2: 0x2ca4c5c (stale) Mirror 4: 0x2ca4c5c (stale) Mirror 5: 0x2ca4c5c (stale) Mirror 6: 0x2ca4c5c (stale) Mirror 7: 0x2ca4c5c (stale) Mirror 8: 0x2ca4c5c (stale) Mirror 9: 0xbf8b120 (stale) Mirror 10: 0xddf1f91f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31e22: skipped 000624 1785389383.828131 write 0x032928 thru 0x039193 (0x686c bytes) 000625 1785389383.862961 mapread 0x02eceb thru 0x039193 (0xa4a9 bytes) 000626 1785389383.927891 mapread 0x00ac0b thru 0x00bfd0 (0x13c6 bytes) 000627 1785389383.945948 mapread 0x01d6a6 thru 0x0202e1 (0x2c3c bytes) 000628 1785389383.986262 mapwrite 0x033ac0 thru 0x03c5f7 (0x8b38 bytes) 000629 1785389384.188323 punch from 0x024a58 to 0x02cb28 (0x80d1 bytes) 000630 1785389384.201304 read 0x00eac8 thru 0x01d56c (0xeaa5 bytes) 000631 1785389384.215352 trunc from 0x03c5f8 to 0x037a3f (0x4bb8 bytes) 000632 1785389384.265816 punch from 0x006d9e to 0x009eb2 (0x3115 bytes) 000633 1785389384.311067 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x37a40): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37a40): Mirror 2: 0xe695695c (stale) Mirror 4: 0xe695695c (stale) Mirror 5: 0xe695695c (stale) Mirror 6: 0xe695695c (stale) Mirror 7: 0xe695695c (stale) Mirror 8: 0xe695695c (stale) Mirror 9: 0xab06b660 (stale) Mirror 10: 0x1b0fe8b9 (stale) CRC-32 checksum value for chunk [0, 0x37a40): Mirror 1: 0x84dc00c3 Mirror 11: 0x84dc00c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37a40: skipped 000634 1785389386.606719 mapwrite 0x007124 thru 0x014a11 (0xd8ee bytes) 000635 1785389386.982733 punch from 0x01c590 to 0x0271bd (0xac2e bytes) 000636 1785389386.997567 mapread 0x01ab03 thru 0x01be7d (0x137b bytes) 000637 1785389387.013390 trunc from 0x037a40 to 0x02d991 (0xa0ae bytes) 000638 1785389387.137423 write 0x03bdc7 thru 0x03ffff (0x4239 bytes) 000639 1785389387.151837 read 0x033113 thru 0x033a02 (0x8f0 bytes) 000640 1785389387.163707 read 0x02107a thru 0x022b47 (0x1ace bytes) 000641 1785389387.164543 mapwrite 0x034553 thru 0x03ffff (0xbaad bytes) 000642 1785389387.250042 trunc from 0x0335ef to 0x0350cd (0x1adf bytes) 000643 1785389387.276151 trunc from 0x040000 to 0x0292ac (0x16d53 bytes) 000644 1785389387.320909 fallocate 0x0251db thru 0x033afe (0xe924 bytes) 000646 1785389387.363466 MIRROR_RESYNC 10 mirrors 000647 1785389391.685283 read 0x025655 thru 0x0329b0 (0xd35c bytes) 000648 1785389391.724006 read 0x004906 thru 0x00b928 (0x7023 bytes) 000649 1785389391.754009 MIRROR_RESYNC 10 mirrors 000651 1785389392.938135 mapwrite 0x00454f thru 0x00690d (0x23bf bytes) 000652 1785389393.161507 punch from 0x016957 to 0x0172c4 (0x96e bytes) 000653 1785389393.174439 fallocate 0x016d87 thru 0x01c202 (0x547c bytes) 000654 1785389393.190064 trunc from 0x0165e7 to 0x02495d (0xe377 bytes) 000656 1785389393.212413 read 0x023722 thru 0x02d4be (0x9d9d bytes) 000658 1785389393.234397 mapwrite 0x030a58 thru 0x036ee4 (0x648d bytes) 000659 1785389393.364615 fallocate 0x03ce9e thru 0x03ffff (0x3162 bytes) 000660 1785389393.394799 fallocate 0x029c88 thru 0x03537d (0xb6f6 bytes) 000661 1785389393.406369 trunc from 0x036350 to 0x036ee4 (0xb95 bytes) 000662 1785389393.447363 trunc from 0x00e32a to 0x01a0c0 (0xbd97 bytes) 000663 1785389393.466998 trunc from 0x02b10b to 0x036596 (0xb48c bytes) 000664 1785389393.476401 trunc from 0x00c2d6 to 0x014e66 (0x8b91 bytes) 000665 1785389393.488985 trunc from 0x036ee5 to 0x017557 (0x1f98d bytes) 000666 1785389393.518488 fallocate 0x01f413 thru 0x02682c (0x741a bytes) 000667 1785389393.533321 mapread 0x01c583 thru 0x02544f (0x8ecd bytes) 000668 1785389393.571367 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2682d): Mirror 2: 0xf502606c (stale) Mirror 4: 0xf502606c (stale) Mirror 6: 0xf502606c (stale) Mirror 7: 0xf502606c (stale) Mirror 8: 0xf502606c (stale) Mirror 9: 0xf502606c (stale) Mirror 10: 0xf502606c (stale) Mirror 11: 0xf502606c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2682d): Mirror 2: 0xf502606c (stale) Mirror 4: 0xf502606c (stale) Mirror 6: 0xf502606c (stale) Mirror 7: 0xf502606c (stale) Mirror 8: 0xf502606c (stale) Mirror 9: 0xf502606c (stale) Mirror 10: 0xf502606c (stale) Mirror 11: 0xf502606c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2682d: skipped 000669 1785389394.633042 mapread 0x00c80b thru 0x00f58c (0x2d82 bytes) 000670 1785389394.672048 write 0x0199ac thru 0x02535e (0xb9b3 bytes) 000671 1785389394.715574 fallocate 0x02c946 thru 0x02f333 (0x29ee bytes) 000672 1785389394.735377 fallocate 0x02cb80 thru 0x035fa0 (0x9421 bytes) 000673 1785389394.744857 trunc from 0x0209ef to 0x02a0ed (0x96ff bytes) 000674 1785389394.788561 punch from 0x019650 to 0x021895 (0x8246 bytes) 000676 1785389394.825152 trunc from 0x028e6d to 0x02f333 (0x64c7 bytes) 000677 1785389394.850392 mapread 0x00d6c4 thru 0x00e3c4 (0xd01 bytes) 000678 1785389394.853922 write 0x031090 thru 0x035a40 (0x49b1 bytes) 000679 1785389394.861974 punch from 0x001909 to 0x005502 (0x3bfa bytes) 000680 1785389394.871428 punch from 0x0130c3 to 0x0153ae (0x22ec bytes) 000681 1785389394.878563 mapwrite 0x001d69 thru 0x00f1bc (0xd454 bytes) 000682 1785389395.001289 write 0x024faf thru 0x0332f0 (0xe342 bytes) 000683 1785389395.020594 trunc from 0x00bac6 to 0x015ee6 (0xa421 bytes) 000684 1785389395.039007 write 0x010aee thru 0x01d464 (0xc977 bytes) 000686 1785389395.076985 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35a41): Mirror 2: 0x28045342 (stale) Mirror 4: 0x28045342 (stale) Mirror 6: 0x28045342 (stale) Mirror 7: 0x28045342 (stale) Mirror 9: 0x28045342 (stale) Mirror 10: 0x28045342 (stale) Mirror 11: 0x28045342 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35a41): Mirror 2: 0x28045342 (stale) Mirror 4: 0x28045342 (stale) Mirror 6: 0x28045342 (stale) Mirror 7: 0x28045342 (stale) Mirror 9: 0x28045342 (stale) Mirror 10: 0x28045342 (stale) Mirror 11: 0x28045342 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35a41: skipped 000687 1785389395.881381 trunc from 0x008c51 to 0x009175 (0x525 bytes) 000688 1785389395.893161 mapwrite 0x018d2e thru 0x01b2c9 (0x259c bytes) 000689 1785389396.004973 read 0x01f24a thru 0x02b7d3 (0xc58a bytes) 000690 1785389396.047140 read 0x006eaa thru 0x015f12 (0xf069 bytes) 000691 1785389396.085891 mapwrite 0x017890 thru 0x022c7c (0xb3ed bytes) 000692 1785389396.154427 write 0x02ae28 thru 0x02df48 (0x3121 bytes) 000693 1785389396.172999 mapread 0x01adda thru 0x02106f (0x6296 bytes) 000694 1785389396.176172 fallocate 0x01d0b7 thru 0x0280a4 (0xafee bytes) 000695 1785389396.192321 fallocate 0x00e86b thru 0x019937 (0xb0cd bytes) 000696 1785389396.207527 read 0x00e7e6 thru 0x01051b (0x1d36 bytes) 000697 1785389396.208311 mapwrite 0x02e581 thru 0x03ca08 (0xe488 bytes) 000698 1785389396.328120 mapread 0x008ef0 thru 0x018633 (0xf744 bytes) 000699 1785389396.345595 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ca09): Mirror 4: 0x1bc59a0a (stale) Mirror 6: 0x1bc59a0a (stale) Mirror 7: 0x1bc59a0a (stale) Mirror 9: 0x1bc59a0a (stale) Mirror 10: 0x1bc59a0a (stale) Mirror 11: 0x1bc59a0a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ca09): Mirror 4: 0x1bc59a0a (stale) Mirror 6: 0x1bc59a0a (stale) Mirror 7: 0x1bc59a0a (stale) Mirror 9: 0x1bc59a0a (stale) Mirror 10: 0x1bc59a0a (stale) Mirror 11: 0x1bc59a0a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ca09: skipped 000700 1785389397.341562 fallocate 0x035abe thru 0x03d381 (0x78c4 bytes) 000701 1785389397.355867 trunc from 0x036bf4 to 0x03d381 (0x678e bytes) 000703 1785389397.369462 trunc from 0x03d382 to 0x012240 (0x2b141 bytes) 000704 1785389397.413975 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12241): Mirror 6: 0x4ca3693f (stale) Mirror 7: 0x4ca3693f (stale) Mirror 9: 0x4ca3693f (stale) Mirror 10: 0x4ca3693f (stale) Mirror 11: 0x4ca3693f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12241): Mirror 6: 0x4ca3693f (stale) Mirror 7: 0x4ca3693f (stale) Mirror 9: 0x4ca3693f (stale) Mirror 10: 0x4ca3693f (stale) Mirror 11: 0x4ca3693f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12241: skipped 000705 1785389398.146619 trunc from 0x012241 to 0x034b27 (0x228e7 bytes) 000706 1785389398.172453 punch from 0x00c689 to 0x01180c (0x5184 bytes) 000707 1785389398.184226 trunc from 0x00ec95 to 0x01174c (0x2ab8 bytes) 000708 1785389398.201024 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34b28): Mirror 6: 0x6e1ef0eb (stale) Mirror 7: 0x6e1ef0eb (stale) Mirror 9: 0x6e1ef0eb (stale) Mirror 10: 0x6e1ef0eb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34b28): Mirror 6: 0x6e1ef0eb (stale) Mirror 7: 0x6e1ef0eb (stale) Mirror 9: 0x6e1ef0eb (stale) Mirror 10: 0x6e1ef0eb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34b28: skipped 000709 1785389398.848715 mapwrite 0x004864 thru 0x0103a7 (0xbb44 bytes) 000710 1785389398.880285 trunc from 0x02a58e to 0x03309f (0x8b12 bytes) 000711 1785389398.890533 mapwrite 0x02b39f thru 0x03b1a4 (0xfe06 bytes) 000712 1785389398.972030 punch from 0x00661a to 0x014b06 (0xe4ed bytes) 000713 1785389398.976850 punch from 0x0164ce to 0x01cc2c (0x675f bytes) 000714 1785389398.981307 trunc from 0x03b1a5 to 0x00ffee (0x2b1b6 bytes) 000715 1785389399.005230 write 0x027b45 thru 0x0359c7 (0xde83 bytes) 000716 1785389399.012677 write 0x01eecc thru 0x027280 (0x83b5 bytes) 000717 1785389399.033433 mapread 0x0352cd thru 0x0359c7 (0x6fb bytes) 000718 1785389399.034676 trunc from 0x032cdd to 0x0359c7 (0x2ceb bytes) 000719 1785389399.058264 trunc from 0x00b400 to 0x00bb39 (0x73a bytes) 000721 1785389399.063306 punch from 0x021299 to 0x02602a (0x4d92 bytes) 000722 1785389399.073958 fallocate 0x0386d7 thru 0x03a0fc (0x1a26 bytes) 000723 1785389399.083409 write 0x034bc9 thru 0x03ffff (0xb437 bytes) 000725 1785389399.093842 mapread 0x0256d1 thru 0x02f4e6 (0x9e16 bytes) 000726 1785389399.106571 read 0x033762 thru 0x033fba (0x859 bytes) 000727 1785389399.115611 fallocate 0x013f24 thru 0x01bfad (0x808a bytes) 000728 1785389399.135665 mapread 0x03ec33 thru 0x03ffff (0x13cd bytes) 000729 1785389399.136564 mapread 0x02a400 thru 0x02ee1e (0x4a1f bytes) 000730 1785389399.137528 trunc from 0x040000 to 0x030679 (0xf986 bytes) 000732 1785389399.191793 read 0x009d89 thru 0x0198d4 (0xfb4c bytes) 000733 1785389399.213385 trunc from 0x03067a to 0x0275b1 (0x90c8 bytes) 000734 1785389399.255847 mapwrite 0x005242 thru 0x006e02 (0x1bc1 bytes) 000735 1785389399.293946 punch from 0x00b360 to 0x00e619 (0x32ba bytes) 000737 1785389399.300878 mapread 0x008867 thru 0x0104f5 (0x7c8f bytes) 000738 1785389399.363810 write 0x036db4 thru 0x03ffff (0x924c bytes) 000739 1785389399.366668 read 0x016615 thru 0x023ed4 (0xd8c0 bytes) 000740 1785389399.370899 punch from 0x011bb8 to 0x02194a (0xfd93 bytes) 000742 1785389399.383448 trunc from 0x01dc64 to 0x02bb0c (0xdea9 bytes) 000743 1785389399.389960 punch from 0x0338ec to 0x03eee4 (0xb5f9 bytes) 000745 1785389399.415205 punch from 0x007d07 to 0x012ec6 (0xb1c0 bytes) 000746 1785389399.449340 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x38ab9c44 (stale) Mirror 9: 0x38ab9c44 (stale) Mirror 10: 0x38ab9c44 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x38ab9c44 (stale) Mirror 9: 0x38ab9c44 (stale) Mirror 10: 0x38ab9c44 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000747 1785389400.378072 mapwrite 0x017027 thru 0x02678c (0xf766 bytes) 000748 1785389400.508062 read 0x015a64 thru 0x01fee5 (0xa482 bytes) 000749 1785389400.508769 read 0x00af22 thru 0x00cb79 (0x1c58 bytes) 000750 1785389400.531913 trunc from 0x023c1f to 0x025831 (0x1c13 bytes) 000751 1785389400.568118 MIRROR_RESYNC 4 mirrors 000752 1785389402.944708 trunc from 0x040000 to 0x00eaec (0x31513 bytes) 000753 1785389403.059387 punch from 0x00aa5a to 0x00eaec (0x4093 bytes) 000754 1785389403.071293 fallocate 0x03419a thru 0x03981e (0x5685 bytes) 000755 1785389403.090276 write 0x00561a thru 0x00fc6d (0xa654 bytes) 000756 1785389403.108913 mapwrite 0x02583a thru 0x0295cd (0x3d94 bytes) 000757 1785389403.284725 trunc from 0x0295ce to 0x008b93 (0x20a3a bytes) 000758 1785389403.338374 trunc from 0x004463 to 0x005632 (0x11d0 bytes) 000759 1785389403.357555 MIRROR_RESYNC 4 mirrors 000760 1785389404.418427 mapread 0x004019 thru 0x008b93 (0x4b7b bytes) 000761 1785389404.449236 trunc from 0x008b94 to 0x026a85 (0x1def2 bytes) 000762 1785389404.525756 fallocate 0x00f887 thru 0x011446 (0x1bc0 bytes) 000763 1785389404.542536 trunc from 0x026a86 to 0x024b2d (0x1f58 bytes) 000764 1785389404.617556 read 0x024702 thru 0x024b2d (0x42c bytes) 000765 1785389404.625914 mapread 0x02022b thru 0x024b2d (0x4903 bytes) 000766 1785389404.661238 MIRROR_RESYNC 4 mirrors 000767 1785389406.132110 fallocate 0x010be0 thru 0x02075c (0xfb7d bytes) 000768 1785389406.215797 MIRROR_RESYNC 4 mirrors 000769 1785389407.300746 read 0x01dff8 thru 0x024b2d (0x6b36 bytes) 000770 1785389407.308759 mapwrite 0x003e14 thru 0x00fe0b (0xbff8 bytes) 000771 1785389407.508812 write 0x019f34 thru 0x028afc (0xebc9 bytes) 000774 1785389407.528963 MIRROR_RESYNC 4 mirrors 000775 1785389408.640907 MIRROR_RESYNC 4 mirrors 000776 1785389408.971995 write 0x037deb thru 0x03a33f (0x2555 bytes) 000777 1785389408.990937 fallocate 0x0095c2 thru 0x0152ab (0xbcea bytes) 000778 1785389408.995178 read 0x018cc1 thru 0x024806 (0xbb46 bytes) 000779 1785389409.004911 mapwrite 0x00031d thru 0x0024ec (0x21d0 bytes) 000780 1785389409.028405 trunc from 0x03a340 to 0x01052f (0x29e10 bytes) 000783 1785389409.054552 trunc from 0x010530 to 0x02654f (0x16020 bytes) 000784 1785389409.068933 trunc from 0x01b5a3 to 0x01d018 (0x1a76 bytes) 000786 1785389409.073771 mapwrite 0x030d30 thru 0x03e7fe (0xdacf bytes) 000787 1785389409.137545 punch from 0x0212d6 to 0x02831c (0x7047 bytes) 000788 1785389409.142620 write 0x013d8e thru 0x022c3e (0xeeb1 bytes) 000789 1785389409.155433 punch from 0x00b4d6 to 0x0101c6 (0x4cf1 bytes) 000790 1785389409.161728 read 0x018bcb thru 0x01c922 (0x3d58 bytes) 000792 1785389409.168414 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e7ff): Mirror 9: 0x6193e4e7 (stale) Mirror 10: 0x6193e4e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7ff): Mirror 9: 0x6193e4e7 (stale) Mirror 10: 0x6193e4e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7ff: skipped 000793 1785389409.417842 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e7ff): Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7ff): Mirror 9: 0x6193e4e7 (stale) Mirror 10: 0x6193e4e7 (stale) CRC-32 checksum value for chunk [0, 0x3e7ff): Mirror 1: 0xb7b9f65 Mirror 11: 0xb7b9f65 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7ff: skipped 000794 1785389410.159573 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e7ff): Mirror 9: 0x6193e4e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7ff): Mirror 9: 0x6193e4e7 (stale) CRC-32 checksum value for chunk [0, 0x3e7ff): Mirror 1: 0xb7b9f65 Mirror 11: 0xb7b9f65 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7ff: skipped 000796 1785389410.769277 read 0x03316e thru 0x0372f8 (0x418b bytes) 000797 1785389410.803154 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) 000798 1785389411.146598 trunc from 0x015912 to 0x017c8c (0x237b bytes) 000799 1785389411.191553 trunc from 0x03e7ff to 0x034ce3 (0x9b1b bytes) 000800 1785389411.242795 trunc from 0x034ce4 to 0x03a992 (0x5caf bytes) 000801 1785389411.264439 MIRROR_RESYNC 2 mirrors 000802 1785389411.870300 mapread 0x00ea98 thru 0x00f455 (0x9be bytes) 000803 1785389411.883241 fallocate 0x025675 thru 0x02aa74 (0x5400 bytes) 000804 1785389411.911112 trunc from 0x03a993 to 0x00d854 (0x2d13e bytes) 000805 1785389411.937581 fallocate 0x00315d thru 0x00a4a2 (0x7346 bytes) 000806 1785389411.947138 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) 000808 1785389412.139095 trunc from 0x00a0a2 to 0x00d854 (0x37b3 bytes) 000810 1785389412.155055 read 0x00ce4d thru 0x00d854 (0xa08 bytes) 000811 1785389412.174597 trunc from 0x00d855 to 0x003f14 (0x9940 bytes) 000813 1785389412.209583 punch from 0x00246b to 0x003f14 (0x1aaa bytes) 000814 1785389412.217526 mapwrite 0x036ecb thru 0x03ffff (0x9135 bytes) 000815 1785389412.344046 read 0x0079a1 thru 0x00e256 (0x68b6 bytes) 000816 1785389412.373981 read 0x031c76 thru 0x037c16 (0x5fa1 bytes) 000817 1785389412.377037 mapwrite 0x00bdb2 thru 0x00e3f6 (0x2645 bytes) 000818 1785389412.411731 trunc from 0x040000 to 0x01cd68 (0x23297 bytes) 000819 1785389412.440578 mapwrite 0x03b3b1 thru 0x03ffff (0x4c4f bytes) 000821 1785389412.551759 mapread 0x03ec72 thru 0x03ffff (0x138e bytes) 000822 1785389412.579236 MIRROR_EXTEND to 2 mirrors 000823 1785389413.936036 punch from 0x01ae7c to 0x026e35 (0xbfba bytes) 000824 1785389414.039199 MIRROR_RESYNC 2 mirrors 000825 1785389415.361450 punch from 0x00a986 to 0x00e578 (0x3bf3 bytes) 000827 1785389415.492247 mapwrite 0x014f7e thru 0x01c495 (0x7518 bytes) 000828 1785389415.645572 read 0x007328 thru 0x012669 (0xb342 bytes) 000829 1785389415.719583 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) 000830 1785389416.119563 punch from 0x0175f1 to 0x025c96 (0xe6a6 bytes) 000831 1785389416.126355 mapwrite 0x012a79 thru 0x01e7a4 (0xbd2c bytes) 000832 1785389416.312897 read 0x03be13 thru 0x03ffff (0x41ed bytes) 000833 1785389416.351747 mapread 0x02c313 thru 0x038dcd (0xcabb bytes) 000834 1785389416.406701 mapread 0x008c21 thru 0x0152c0 (0xc6a0 bytes) 000835 1785389416.426310 mapwrite 0x02df17 thru 0x03d8d4 (0xf9be bytes) 000836 1785389416.498216 mapread 0x03afd8 thru 0x03ffff (0x5028 bytes) 000838 1785389416.508424 MIRROR_EXTEND to 2 mirrors 000839 1785389418.042028 read 0x03e7b6 thru 0x03ffff (0x184a bytes) 000840 1785389418.086024 fallocate 0x036779 thru 0x038689 (0x1f11 bytes) 000841 1785389418.132446 punch from 0x009199 to 0x00dfab (0x4e13 bytes) 000842 1785389418.136276 trunc from 0x040000 to 0x00ee1e (0x311e1 bytes) 000843 1785389418.184763 punch from 0x00bcae to 0x00ee1e (0x3171 bytes) 000844 1785389418.220765 fallocate 0x004525 thru 0x00efe3 (0xaabf bytes) 000845 1785389418.237204 punch from 0x00e2e8 to 0x00ee1e (0xb37 bytes) 000846 1785389418.269106 fallocate 0x0395ae thru 0x03e3eb (0x4e3e bytes) 000847 1785389418.278028 trunc from 0x03e3ec to 0x00ab68 (0x33883 bytes) 000848 1785389418.291174 write 0x013412 thru 0x01bd83 (0x8972 bytes) 000849 1785389418.296447 mapread 0x0073cb thru 0x010cf4 (0x992a bytes) 000850 1785389418.355204 fallocate 0x00918b thru 0x00cd18 (0x3b8e bytes) 000851 1785389418.374164 read 0x016344 thru 0x01bd83 (0x5a40 bytes) 000852 1785389418.387164 mapread 0x012a3e thru 0x01938d (0x6950 bytes) 000853 1785389418.408873 mapwrite 0x017cc0 thru 0x0267a4 (0xeae5 bytes) 000854 1785389418.601160 write 0x0360a5 thru 0x0382b1 (0x220d bytes) 000855 1785389418.603164 fallocate 0x00ff6c thru 0x01866b (0x8700 bytes) 000857 1785389418.633799 trunc from 0x0382b2 to 0x003795 (0x34b1c bytes) 000859 1785389418.662545 fallocate 0x00b518 thru 0x00ecca (0x37b3 bytes) 000861 1785389418.688455 mapread 0x00ca2f thru 0x00ecca (0x229c bytes) 000862 1785389418.739245 write 0x006cf7 thru 0x0137e6 (0xcaf0 bytes) 000863 1785389418.759140 mapwrite 0x004d8e thru 0x00b5f5 (0x6868 bytes) 000864 1785389418.861479 trunc from 0x0137e7 to 0x00ef8d (0x4859 bytes) 000865 1785389418.921500 trunc from 0x00ef8e to 0x023783 (0x147f6 bytes) 000866 1785389418.972009 mapread 0x007723 thru 0x010142 (0x8a20 bytes) 000867 1785389418.998060 trunc from 0x023784 to 0x03e5f3 (0x1ae70 bytes) 000868 1785389419.050393 mapwrite 0x03147e thru 0x033df2 (0x2975 bytes) 000869 1785389419.132739 mapread 0x0012d9 thru 0x0088a8 (0x75d0 bytes) 000870 1785389419.136814 punch from 0x001157 to 0x008ae0 (0x798a bytes) 000871 1785389419.146969 trunc from 0x03a421 to 0x03e5f3 (0x41d3 bytes) 000872 1785389419.173561 MIRROR_RESYNC 2 mirrors 000873 1785389420.715245 trunc from 0x001b8a to 0x00b72f (0x9ba6 bytes) 000874 1785389420.848475 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e5f4): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e5f4): Mirror 2: 0x44e490d2 (stale) CRC-32 checksum value for chunk [0, 0x3e5f4): Mirror 1: 0x5973e3c6 Mirror 3: 0x5973e3c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e5f4: skipped 000875 1785389422.448076 trunc from 0x01ba2f to 0x02808b (0xc65d bytes) 000876 1785389422.570870 mapwrite 0x03f539 thru 0x03ffff (0xac7 bytes) 000877 1785389422.697018 mapread 0x026688 thru 0x02ad44 (0x46bd bytes) 000878 1785389422.741108 mapread 0x02e9f2 thru 0x033511 (0x4b20 bytes) 000879 1785389422.799571 punch from 0x03ce4c to 0x03d697 (0x84c bytes) 000880 1785389422.818893 write 0x02fe6b thru 0x03ebda (0xed70 bytes) 000881 1785389422.834908 read 0x01e403 thru 0x01f50d (0x110b bytes) 000882 1785389422.856583 mapwrite 0x01dad9 thru 0x026697 (0x8bbf bytes) 000884 1785389422.938622 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd76768ca (stale) Mirror 3: 0xaf7bce88 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3ab343ea Mirror 4: 0x3ab343ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000887 1785389424.641027 punch from 0x015fb8 to 0x01f3c7 (0x9410 bytes) 000888 1785389424.688797 punch from 0x039a1b to 0x03af36 (0x151c bytes) 000889 1785389424.696758 mapread 0x027c85 thru 0x036a22 (0xed9e bytes) 000890 1785389424.726468 mapread 0x036c46 thru 0x03ffff (0x93ba bytes) 000891 1785389424.735105 mapread 0x00dfc4 thru 0x0151c4 (0x7201 bytes) 000892 1785389424.750623 MIRROR_RESYNC 4 mirrors 000893 1785389426.149525 mapread 0x037131 thru 0x03872a (0x15fa bytes) 000894 1785389426.158775 trunc from 0x02b2c0 to 0x0369a7 (0xb6e8 bytes) 000895 1785389426.192065 fallocate 0x0064d0 thru 0x00edb9 (0x88ea bytes) 000896 1785389426.198961 punch from 0x01e579 to 0x0237de (0x5266 bytes) 000897 1785389426.204128 fallocate 0x00bbc5 thru 0x01a14a (0xe586 bytes) 000898 1785389426.212468 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x301740ad (stale) Mirror 3: 0x301740ad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x301740ad (stale) Mirror 3: 0x301740ad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000899 1785389426.573219 read 0x015ec0 thru 0x01d810 (0x7951 bytes) 000900 1785389426.582344 fallocate 0x03f975 thru 0x03ffff (0x68b bytes) 000901 1785389426.587132 mapwrite 0x02c94b thru 0x0377bf (0xae75 bytes) 000902 1785389426.654357 mapwrite 0x02ec7f thru 0x033ff3 (0x5375 bytes) 000903 1785389426.701532 fallocate 0x001052 thru 0x009c49 (0x8bf8 bytes) 000905 1785389426.715732 fallocate 0x0069db thru 0x00d42c (0x6a52 bytes) 000906 1785389426.720280 mapwrite 0x002758 thru 0x009607 (0x6eb0 bytes) 000907 1785389426.799223 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x301740ad (stale) Mirror 3: 0x301740ad (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x18031011 Mirror 4: 0x18031011 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000908 1785389427.904189 punch from 0x0120e1 to 0x01300f (0xf2f bytes) 000909 1785389428.017388 mapread 0x00ff8f thru 0x0169bf (0x6a31 bytes) 000910 1785389428.062429 read 0x032d06 thru 0x03640b (0x3706 bytes) 000911 1785389428.092237 trunc from 0x040000 to 0x01f443 (0x20bbc bytes) 000912 1785389428.126307 read 0x011da3 thru 0x01533e (0x359c bytes) 000913 1785389428.128815 fallocate 0x00307f thru 0x00aeb7 (0x7e39 bytes) 000914 1785389428.135573 trunc from 0x01b144 to 0x01f443 (0x4300 bytes) 000915 1785389428.141295 mapread 0x00e0d9 thru 0x0107a8 (0x26d0 bytes) 000916 1785389428.143476 fallocate 0x03b633 thru 0x03cd5e (0x172c bytes) 000917 1785389428.149998 mapread 0x00ebfd thru 0x015338 (0x673c bytes) 000919 1785389428.153313 mapwrite 0x0285f1 thru 0x0301e5 (0x7bf5 bytes) 000920 1785389428.201999 read 0x015013 thru 0x01e10c (0x90fa bytes) 000921 1785389428.203681 read 0x010e5e thru 0x01ac86 (0x9e29 bytes) 000922 1785389428.205179 write 0x03b425 thru 0x03ffff (0x4bdb bytes) 000923 1785389428.208306 trunc from 0x020eee to 0x030483 (0xf596 bytes) 000924 1785389428.214370 read 0x009de9 thru 0x00dc5e (0x3e76 bytes) 000925 1785389428.215686 trunc from 0x02f75a to 0x03385c (0x4103 bytes) 000927 1785389428.225969 MIRROR_RESYNC 4 mirrors 000928 1785389429.138795 read 0x014544 thru 0x01f989 (0xb446 bytes) 000929 1785389429.165444 trunc from 0x040000 to 0x0282e6 (0x17d19 bytes) 000930 1785389429.270270 MIRROR_RESYNC 4 mirrors 000931 1785389430.213534 trunc from 0x0282e7 to 0x022b8a (0x575c bytes) 000932 1785389430.278565 read 0x010e22 thru 0x014fa3 (0x4182 bytes) 000933 1785389430.294680 punch from 0x00c0a8 to 0x00dda0 (0x1cf9 bytes) 000934 1785389430.300976 punch from 0x01d040 to 0x022b8a (0x5b4b bytes) 000935 1785389430.314120 read 0x00c358 thru 0x016dae (0xaa57 bytes) 000936 1785389430.323063 fallocate 0x026f22 thru 0x0279c0 (0xa9f bytes) 000937 1785389430.328036 write 0x002dd5 thru 0x011b1d (0xed49 bytes) 000938 1785389430.330494 mapwrite 0x008958 thru 0x016d0d (0xe3b6 bytes) 000939 1785389430.383747 write 0x00e554 thru 0x019090 (0xab3d bytes) 000941 1785389430.385542 mapread 0x00c50c thru 0x00f7ce (0x32c3 bytes) 000942 1785389430.404437 MIRROR_RESYNC 4 mirrors 000943 1785389431.526981 read 0x00dd15 thru 0x012ab1 (0x4d9d bytes) 000944 1785389431.567374 trunc from 0x022b8b to 0x00951f (0x1966b bytes) 000945 1785389431.659614 write 0x03d29d thru 0x03ffff (0x2d63 bytes) 000946 1785389431.668224 mapwrite 0x02d7f6 thru 0x034d19 (0x7524 bytes) 000947 1785389431.790810 write 0x026457 thru 0x032c16 (0xc7c0 bytes) 000948 1785389431.808447 punch from 0x01b9d3 to 0x021874 (0x5ea2 bytes) 000949 1785389431.823034 trunc from 0x03a388 to 0x03ac79 (0x8f2 bytes) 000950 1785389431.841316 punch from 0x02d44e to 0x03607b (0x8c2e bytes) 000951 1785389431.889489 write 0x0388ca thru 0x03ffff (0x7736 bytes) 000952 1785389431.904495 fallocate 0x01a773 thru 0x020fda (0x6868 bytes) 000953 1785389431.917038 fallocate 0x036639 thru 0x03ffff (0x99c7 bytes) 000954 1785389431.927768 fallocate 0x001851 thru 0x00f94c (0xe0fc bytes) 000956 1785389431.952117 mapread 0x034b78 thru 0x035ba4 (0x102d bytes) 000957 1785389431.991161 read 0x02a932 thru 0x0379d6 (0xd0a5 bytes) 000958 1785389431.994157 mapwrite 0x01bd8c thru 0x01dd6a (0x1fdf bytes) 000959 1785389432.108842 mapwrite 0x02c1ae thru 0x03a4a2 (0xe2f5 bytes) 000960 1785389432.169559 trunc from 0x016df4 to 0x0224b5 (0xb6c2 bytes) 000961 1785389432.184891 mapread 0x0029ff thru 0x011714 (0xed16 bytes) 000962 1785389432.196397 trunc from 0x019f2c to 0x01c522 (0x25f7 bytes) 000963 1785389432.207624 read 0x016f88 thru 0x025fa6 (0xf01f bytes) 000964 1785389432.242083 mapread 0x03cc69 thru 0x03ffff (0x3397 bytes) 000965 1785389432.243340 write 0x00c01b thru 0x00f4b5 (0x349b bytes) 000966 1785389432.257465 punch from 0x01bf44 to 0x025e4d (0x9f0a bytes) 000967 1785389432.303909 trunc from 0x040000 to 0x037a43 (0x85bc bytes) 000968 1785389432.388914 fallocate 0x035a13 thru 0x03ffff (0xa5ed bytes) 000969 1785389432.402277 read 0x011eb3 thru 0x01550e (0x365c bytes) 000970 1785389432.405693 trunc from 0x014ec8 to 0x01eb86 (0x9cbf bytes) 000971 1785389432.424347 punch from 0x01b77e to 0x0207a0 (0x5023 bytes) 000972 1785389432.447104 trunc from 0x00227f to 0x0043c4 (0x2146 bytes) 000973 1785389432.456444 punch from 0x02328e to 0x031b7c (0xe8ef bytes) 000974 1785389432.480436 mapwrite 0x017ee7 thru 0x01ecad (0x6dc7 bytes) 000975 1785389432.538585 trunc from 0x021f7d to 0x028bf8 (0x6c7c bytes) 000976 1785389432.561885 trunc from 0x02333d to 0x023806 (0x4ca bytes) 000977 1785389432.589289 fallocate 0x01da76 thru 0x01fffe (0x2589 bytes) 000978 1785389432.618954 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x7681f999 (stale) Mirror 3: 0x7681f999 (stale) Mirror 4: 0x7681f999 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9840461f Mirror 5: 0x9840461f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000979 1785389434.011863 punch from 0x0115ab to 0x012c05 (0x165b bytes) 000982 1785389434.070699 mapwrite 0x0066f1 thru 0x0077a2 (0x10b2 bytes) 000983 1785389434.112042 punch from 0x0381bb to 0x03ffff (0x7e45 bytes) 000984 1785389434.117495 trunc from 0x01d89c to 0x026e08 (0x956d bytes) 000985 1785389434.124018 punch from 0x00da84 to 0x01d58e (0xfb0b bytes) 000986 1785389434.140429 trunc from 0x040000 to 0x021df7 (0x1e208 bytes) 000987 1785389434.201255 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x46:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21df8): Mirror 2: 0xae3dc5b9 (stale) Mirror 3: 0xae3dc5b9 (stale) Mirror 5: 0xe73ecd53 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21df8): Mirror 2: 0xae3dc5b9 (stale) Mirror 3: 0xae3dc5b9 (stale) Mirror 5: 0xe73ecd53 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21df8: skipped 000988 1785389434.693348 read 0x01e139 thru 0x020909 (0x27d1 bytes) 000990 1785389434.701858 punch from 0x01133f to 0x01a1bb (0x8e7d bytes) 000992 1785389434.714268 MIRROR_RESYNC 4 mirrors 000993 1785389437.215053 trunc from 0x007b78 to 0x016bb3 (0xf03c bytes) 000994 1785389437.276397 punch from 0x0142a4 to 0x01a95b (0x66b8 bytes) 000995 1785389437.288618 mapread 0x01c3ab thru 0x0205b6 (0x420c bytes) 000996 1785389437.344179 trunc from 0x01ca8b to 0x021df7 (0x536d bytes) 000998 1785389437.362297 mapwrite 0x01cc19 thru 0x0264d0 (0x98b8 bytes) 000999 1785389437.497388 fallocate 0x0251a1 thru 0x0252c2 (0x122 bytes) 001000 1785389437.506237 mapwrite 0x00fbe2 thru 0x00fdd4 (0x1f3 bytes) All operations completed A-OK!