== sanity-flr test 70a: flr mode fsx test ================ 00:23:21 (1789187001) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 7002 skipping zero size read 000002 1789187002.865477 mapwrite 0x02d3c0 thru 0x037be9 (0xa82a bytes) 000004 1789187002.926622 read 0x01742d thru 0x024594 (0xd168 bytes) 000005 1789187002.953952 mapread 0x003005 thru 0x00fcba (0xccb6 bytes) zero_range to largest ever: 0x339be 000006 1789187002.973806 trunc from 0x02e191 to 0x0339bd (0x582d bytes) 000007 1789187002.986390 write 0x02a784 thru 0x02c5ad (0x1e2a bytes) 000008 1789187002.987375 punch from 0x00c4d7 to 0x013290 (0x6dba bytes) 000009 1789187002.999516 read 0x0145f0 thru 0x0189cb (0x43dc bytes) 000010 1789187003.024296 write 0x00d568 thru 0x012619 (0x50b2 bytes) 000011 1789187003.027477 write 0x02461b thru 0x02c8e5 (0x82cb bytes) 000012 1789187003.034463 trunc from 0x037bea to 0x015e76 (0x21d73 bytes) 000013 1789187003.073731 trunc from 0x00142b to 0x00afb0 (0x9b86 bytes) 000015 1789187003.093591 write 0x037b28 thru 0x03b6ed (0x3bc6 bytes) 000016 1789187003.095292 fallocate 0x023183 thru 0x02b652 (0x84d0 bytes) 000017 1789187003.104541 fallocate 0x027d2c thru 0x0296a4 (0x1979 bytes) 000020 1789187003.110786 fallocate 0x02880e thru 0x030b30 (0x8323 bytes) 000021 1789187003.115521 mapread 0x031560 thru 0x031953 (0x3f4 bytes) 000022 1789187003.123848 mapwrite 0x017329 thru 0x0205d5 (0x92ad bytes) 000023 1789187003.227033 punch from 0x008394 to 0x01383a (0xb4a7 bytes) 000024 1789187003.237457 MIRROR_EXTEND to 2 mirrors 000025 1789187003.811757 trunc from 0x001f44 to 0x0088be (0x697b bytes) 000026 1789187003.850550 fallocate 0x02721d thru 0x028288 (0x106c bytes) 000027 1789187003.856169 trunc from 0x00927f to 0x00de7b (0x4bfd bytes) 000028 1789187003.860755 trunc from 0x03b6ee to 0x0094e8 (0x32205 bytes) 000029 1789187003.906726 trunc from 0x0094e9 to 0x0059d9 (0x3b0f bytes) 000030 1789187003.917919 mapwrite 0x029f2d thru 0x032251 (0x8325 bytes) 000032 1789187003.966505 read 0x02c274 thru 0x032251 (0x5fde bytes) 000033 1789187003.967096 mapread 0x01f462 thru 0x026d7f (0x791e bytes) fallocating to largest ever: 0x359e1 000034 1789187003.983575 fallocate 0x02d8ec thru 0x0359e0 (0x80f5 bytes) 000036 1789187003.991397 mapwrite 0x01b8d7 thru 0x0233d5 (0x7aff bytes) 000037 1789187004.009519 fallocate 0x024e55 thru 0x032057 (0xd203 bytes) 000038 1789187004.015919 read 0x02fa55 thru 0x0359e0 (0x5f8c bytes) 000039 1789187004.029410 fallocate 0x0161be thru 0x0192ae (0x30f1 bytes) 000040 1789187004.035223 mapwrite 0x0231c6 thru 0x02f963 (0xc79e bytes) 000042 1789187004.064765 mapwrite 0x03cbef thru 0x03e7e7 (0x1bf9 bytes) fallocating to largest ever: 0x3946c 000043 1789187004.100390 fallocate 0x032bce thru 0x03946b (0x689e bytes) 000044 1789187004.115015 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e7e8): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7e8): Mirror 2: 0x95d95708 (stale) CRC-32 checksum value for chunk [0, 0x3e7e8): Mirror 1: 0x562b94ea Mirror 3: 0x562b94ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7e8: skipped 000045 1789187005.019120 mapread 0x03aeb7 thru 0x03b1de (0x328 bytes) 000046 1789187005.069886 read 0x037e92 thru 0x03e7e7 (0x6956 bytes) 000047 1789187005.091425 write 0x001867 thru 0x0069ae (0x5148 bytes) 000048 1789187005.156172 mapread 0x022438 thru 0x02c4ef (0xa0b8 bytes) 000049 1789187005.178391 mapwrite 0x00e932 thru 0x010905 (0x1fd4 bytes) 000050 1789187005.205445 mapwrite 0x021f5c thru 0x029140 (0x71e5 bytes) 000051 1789187005.222582 mapwrite 0x017dfc thru 0x02577e (0xd983 bytes) fallocating to largest ever: 0x40000 000052 1789187005.248557 fallocate 0x037e19 thru 0x03ffff (0x81e7 bytes) 000053 1789187005.254995 read 0x00d229 thru 0x0172b1 (0xa089 bytes) 000054 1789187005.255849 mapwrite 0x039e0b thru 0x03ffff (0x61f5 bytes) 000055 1789187005.350755 write 0x008934 thru 0x016235 (0xd902 bytes) 000056 1789187005.352008 mapread 0x00ba2a thru 0x01711e (0xb6f5 bytes) 000057 1789187005.360072 fallocate 0x02adc4 thru 0x02cfd8 (0x2215 bytes) 000059 1789187005.379849 read 0x020cd8 thru 0x0286aa (0x79d3 bytes) 000060 1789187005.385007 punch from 0x0037c0 to 0x006157 (0x2998 bytes) 000061 1789187005.396827 write 0x0249cd thru 0x02a2a9 (0x58dd bytes) 000062 1789187005.404915 trunc from 0x01bba7 to 0x02094c (0x4da6 bytes) 000063 1789187005.413074 mapwrite 0x01df5d thru 0x0243e8 (0x648c bytes) 000064 1789187005.464135 mapwrite 0x01e432 thru 0x02af18 (0xcae7 bytes) 000065 1789187005.483094 mapwrite 0x03ae84 thru 0x03ffff (0x517c bytes) 000066 1789187005.499313 trunc from 0x00a68b to 0x012301 (0x7c77 bytes) 000067 1789187005.505725 fallocate 0x031f5c thru 0x033cbb (0x1d60 bytes) 000068 1789187005.511304 write 0x009326 thru 0x009a8d (0x768 bytes) 000069 1789187005.513218 punch from 0x0275f2 to 0x0301c7 (0x8bd6 bytes) 000070 1789187005.519666 mapwrite 0x01bebc thru 0x01e14c (0x2291 bytes) 000071 1789187005.536473 read 0x012b57 thru 0x01b932 (0x8ddc bytes) 000072 1789187005.557966 mapread 0x032f69 thru 0x038711 (0x57a9 bytes) 000073 1789187005.559697 fallocate 0x009af1 thru 0x00c817 (0x2d27 bytes) 000074 1789187005.565829 fallocate 0x023be2 thru 0x028e49 (0x5268 bytes) 000075 1789187005.572954 fallocate 0x02db37 thru 0x03aba8 (0xd072 bytes) 000076 1789187005.578815 write 0x00c687 thru 0x01b94e (0xf2c8 bytes) 000077 1789187005.580552 mapwrite 0x02e365 thru 0x039c20 (0xb8bc bytes) 000078 1789187005.606839 fallocate 0x002fdf thru 0x00f89c (0xc8be bytes) 000079 1789187005.613940 punch from 0x02d143 to 0x03028c (0x314a bytes) 000080 1789187005.622415 mapwrite 0x021fd7 thru 0x029db4 (0x7dde bytes) 000081 1789187005.662055 read 0x03fd78 thru 0x03ffff (0x288 bytes) 000082 1789187005.671661 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x30ac53ff (stale) Mirror 3: 0xa4582e1f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6d463327 Mirror 4: 0x6d463327 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000084 1789187006.838378 read 0x00a510 thru 0x011d6f (0x7860 bytes) 000085 1789187006.857100 trunc from 0x02f670 to 0x03f37c (0xfd0d bytes) 000087 1789187006.913961 trunc from 0x01b6ce to 0x0278b6 (0xc1e9 bytes) 000088 1789187006.919840 write 0x03431f thru 0x038004 (0x3ce6 bytes) 000089 1789187006.936869 mapwrite 0x019e73 thru 0x028308 (0xe496 bytes) 000090 1789187006.986004 fallocate 0x0306de thru 0x03525d (0x4b80 bytes) 000091 1789187006.995087 fallocate 0x03e052 thru 0x03ffff (0x1fae bytes) 000093 1789187007.007485 trunc from 0x036a7c to 0x03d323 (0x68a8 bytes) 000094 1789187007.018560 trunc from 0x040000 to 0x037a30 (0x85cf bytes) 000095 1789187007.043633 trunc from 0x00808e to 0x00efa6 (0x6f19 bytes) 000096 1789187007.048813 write 0x02efee thru 0x0398cb (0xa8de bytes) 000097 1789187007.055719 trunc from 0x02fe40 to 0x0398cb (0x9a8c bytes) 000098 1789187007.072091 mapwrite 0x01ca50 thru 0x01d803 (0xdb4 bytes) 000099 1789187007.090744 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x398cc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x398cc): Mirror 2: 0xa9567ef7 (stale) Mirror 3: 0xf06936fc (stale) Mirror 4: 0x7989ff10 (stale) CRC-32 checksum value for chunk [0, 0x398cc): Mirror 1: 0xf3b43a59 Mirror 5: 0xf3b43a59 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x398cc: skipped 000100 1789187007.998441 punch from 0x034c51 to 0x0398cb (0x4c7b bytes) 000101 1789187008.063860 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x398cc): Mirror 2: 0xa9567ef7 (stale) Mirror 4: 0x7989ff10 (stale) Mirror 5: 0xf3b43a59 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x398cc): Mirror 2: 0xa9567ef7 (stale) Mirror 4: 0x7989ff10 (stale) Mirror 5: 0xf3b43a59 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x398cc: skipped 000102 1789187008.416071 mapread 0x01a0cf thru 0x0226d5 (0x8607 bytes) 000103 1789187008.445789 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x398cc): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x398cc): Mirror 2: 0xa9567ef7 (stale) Mirror 4: 0x7989ff10 (stale) Mirror 5: 0xf3b43a59 (stale) CRC-32 checksum value for chunk [0, 0x398cc): Mirror 1: 0xf3b43a59 Mirror 6: 0xf3b43a59 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x398cc: skipped 000104 1789187009.363038 fallocate 0x039dfa thru 0x03ffff (0x6206 bytes) 000105 1789187009.418469 mapwrite 0x036da0 thru 0x03f639 (0x889a bytes) 000106 1789187009.478671 read 0x016621 thru 0x025a13 (0xf3f3 bytes) 000107 1789187009.491714 write 0x02e370 thru 0x037c20 (0x98b1 bytes) 000109 1789187009.498112 trunc from 0x03f63a to 0x03688b (0x8dae bytes) 000110 1789187009.520623 write 0x006934 thru 0x011924 (0xaff1 bytes) 000111 1789187009.531826 mapwrite 0x03c295 thru 0x03c692 (0x3fe bytes) 000113 1789187009.582685 MIRROR_RESYNC 5 mirrors 000114 1789187010.961027 fallocate 0x02766c thru 0x035ec6 (0xe85b bytes) 000115 1789187010.994888 fallocate 0x034995 thru 0x03ffff (0xb66b bytes) 000116 1789187011.000502 trunc from 0x02c6cf to 0x0367e0 (0xa112 bytes) 000117 1789187011.007685 mapread 0x01a228 thru 0x01d5b4 (0x338d bytes) 000118 1789187011.027948 write 0x01d8d2 thru 0x025c42 (0x8371 bytes) 000119 1789187011.033414 write 0x00cdbd thru 0x016f36 (0xa17a bytes) 000120 1789187011.039104 trunc from 0x034d32 to 0x038c3e (0x3f0d bytes) 000121 1789187011.058527 punch from 0x028671 to 0x0374ae (0xee3e bytes) 000122 1789187011.064668 read 0x016381 thru 0x023551 (0xd1d1 bytes) 000123 1789187011.065061 write 0x00d097 thru 0x00eaf0 (0x1a5a bytes) 000125 1789187011.066100 mapwrite 0x013fee thru 0x018744 (0x4757 bytes) 000126 1789187011.077937 read 0x03fd4f thru 0x03ffff (0x2b1 bytes) 000127 1789187011.083755 read 0x029b80 thru 0x034921 (0xada2 bytes) 000128 1789187011.084259 mapwrite 0x0139d3 thru 0x016585 (0x2bb3 bytes) 000129 1789187011.097733 trunc from 0x040000 to 0x009b7b (0x36484 bytes) 000130 1789187011.114181 write 0x02951c thru 0x0342df (0xadc4 bytes) 000131 1789187011.115388 mapread 0x012d1d thru 0x01f849 (0xcb2d bytes) 000132 1789187011.120988 read 0x00e6ec thru 0x00f9f7 (0x130c bytes) 000133 1789187011.121484 punch from 0x01beef to 0x02206b (0x617d bytes) 000134 1789187011.124396 punch from 0x001914 to 0x00a5b5 (0x8ca2 bytes) 000135 1789187011.128652 write 0x003738 thru 0x00a5bc (0x6e85 bytes) 000136 1789187011.150977 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x342e0): Mirror 2: 0x84b6e941 (stale) Mirror 4: 0x84b6e941 (stale) Mirror 6: 0x84b6e941 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x342e0): Mirror 2: 0x84b6e941 (stale) Mirror 4: 0x84b6e941 (stale) Mirror 6: 0x84b6e941 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x342e0: skipped 000137 1789187011.435158 punch from 0x01f551 to 0x02f40d (0xfebd bytes) 000138 1789187011.440322 write 0x01c1ef thru 0x01d306 (0x1118 bytes) 000139 1789187011.450425 fallocate 0x000a55 thru 0x00bd42 (0xb2ee bytes) 000140 1789187011.461594 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x342e0): Mirror 4: 0x84b6e941 (stale) Mirror 6: 0x84b6e941 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x342e0): Mirror 4: 0x84b6e941 (stale) Mirror 6: 0x84b6e941 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x342e0: skipped 000141 1789187011.712107 fallocate 0x012d6e thru 0x01ec60 (0xbef3 bytes) 000142 1789187011.716047 write 0x02b030 thru 0x0329ad (0x797e bytes) 000143 1789187011.728756 mapwrite 0x028533 thru 0x0342f9 (0xbdc7 bytes) 000144 1789187011.785165 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x342fa): Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x342fa): Mirror 4: 0x27d0f14b (stale) Mirror 6: 0x27d0f14b (stale) CRC-32 checksum value for chunk [0, 0x342fa): Mirror 1: 0xa31d3bd7 Mirror 7: 0xa31d3bd7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x342fa: skipped 000145 1789187012.470804 fallocate 0x03441d thru 0x03f904 (0xb4e8 bytes) 000146 1789187012.528562 punch from 0x02709e to 0x02de40 (0x6da3 bytes) 000147 1789187012.538301 read 0x023a16 thru 0x025941 (0x1f2c bytes) 000148 1789187012.544049 write 0x0302da thru 0x038273 (0x7f9a bytes) 000149 1789187012.567355 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x38274): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38274): Mirror 4: 0x69e22ff8 (stale) Mirror 6: 0x69e22ff8 (stale) Mirror 7: 0x790d81fc (stale) CRC-32 checksum value for chunk [0, 0x38274): Mirror 1: 0xfc9627c5 Mirror 8: 0xfc9627c5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38274: skipped 000150 1789187013.645567 trunc from 0x038274 to 0x01cebf (0x1b3b4 bytes) 000151 1789187013.696256 write 0x00faca thru 0x01b452 (0xb989 bytes) 000152 1789187013.707072 fallocate 0x017a3b thru 0x01e7e4 (0x6daa bytes) 000153 1789187013.715539 fallocate 0x01c8aa thru 0x01ce44 (0x59b bytes) 000154 1789187013.720074 punch from 0x005e04 to 0x007323 (0x1520 bytes) 000155 1789187013.725318 write 0x010c9e thru 0x01b940 (0xaca3 bytes) 000156 1789187013.727744 write 0x03fa5f thru 0x03ffff (0x5a1 bytes) 000157 1789187013.729074 read 0x01e6bc thru 0x02df0b (0xf850 bytes) 000158 1789187013.735773 punch from 0x0394b7 to 0x03ffff (0x6b49 bytes) 000159 1789187013.755659 read 0x021cd6 thru 0x02989b (0x7bc6 bytes) 000161 1789187013.757698 trunc from 0x040000 to 0x03c563 (0x3a9c bytes) 000162 1789187013.780395 trunc from 0x03c564 to 0x038d49 (0x381a bytes) 000163 1789187013.796648 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x38d4a): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38d4a): Mirror 4: 0xfb254cec (stale) Mirror 6: 0xfb254cec (stale) Mirror 7: 0xa01550c3 (stale) Mirror 8: 0x13337ed4 (stale) CRC-32 checksum value for chunk [0, 0x38d4a): Mirror 1: 0x18ba150e Mirror 9: 0x18ba150e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38d4a: skipped 000164 1789187014.593984 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38d4a): Mirror 4: 0xfb254cec (stale) Mirror 6: 0xfb254cec (stale) Mirror 7: 0xa01550c3 (stale) Mirror 8: 0x13337ed4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38d4a): Mirror 4: 0xfb254cec (stale) Mirror 6: 0xfb254cec (stale) Mirror 7: 0xa01550c3 (stale) Mirror 8: 0x13337ed4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38d4a: skipped 000165 1789187014.870348 mapwrite 0x035484 thru 0x03cce0 (0x785d bytes) 000166 1789187014.936616 punch from 0x02701f to 0x02ebce (0x7bb0 bytes) 000167 1789187014.940595 fallocate 0x019393 thru 0x0226f1 (0x935f bytes) 000168 1789187014.944621 read 0x02134a thru 0x024983 (0x363a bytes) 000169 1789187014.949990 mapread 0x0100da thru 0x0169ec (0x6913 bytes) 000170 1789187014.961321 MIRROR_RESYNC 5 mirrors 000171 1789187016.667763 punch from 0x0122c9 to 0x0216db (0xf413 bytes) 000172 1789187016.711802 trunc from 0x023290 to 0x03287c (0xf5ed bytes) 000173 1789187016.717013 write 0x03541b thru 0x03ae87 (0x5a6d bytes) 000174 1789187016.729481 write 0x023528 thru 0x03238d (0xee66 bytes) 000175 1789187016.742677 punch from 0x02a6d4 to 0x039cbc (0xf5e9 bytes) 000176 1789187016.767382 write 0x01f309 thru 0x025213 (0x5f0b bytes) 000177 1789187016.773808 trunc from 0x03cce1 to 0x038eb3 (0x3e2d bytes) 000178 1789187016.797442 mapread 0x00330b thru 0x012e06 (0xfafc bytes) 000179 1789187016.827268 trunc from 0x034e60 to 0x038eb3 (0x4054 bytes) 000180 1789187016.832705 trunc from 0x038eb4 to 0x012db9 (0x260fa bytes) 000181 1789187016.855436 write 0x033d90 thru 0x038e18 (0x5089 bytes) 000182 1789187016.857180 mapread 0x02b155 thru 0x02fa54 (0x4900 bytes) 000183 1789187016.872487 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38e19): Mirror 4: 0x6d4bd1e5 (stale) Mirror 6: 0x6d4bd1e5 (stale) Mirror 8: 0x6d4bd1e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38e19): Mirror 4: 0x6d4bd1e5 (stale) Mirror 6: 0x6d4bd1e5 (stale) Mirror 8: 0x6d4bd1e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38e19: skipped 000184 1789187017.220778 read 0x018ffe thru 0x0217e5 (0x87e8 bytes) 000185 1789187017.230835 trunc from 0x038e19 to 0x02059d (0x1887b bytes) 000187 1789187017.264108 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2059e): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2059e): Mirror 4: 0xf755ac15 (stale) Mirror 6: 0xf755ac15 (stale) Mirror 8: 0xf755ac15 (stale) CRC-32 checksum value for chunk [0, 0x2059e): Mirror 1: 0x5eaa5068 Mirror 9: 0x5eaa5068 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2059e: skipped 000188 1789187018.235395 punch from 0x018a88 to 0x02059d (0x7b16 bytes) 000189 1789187018.293352 mapwrite 0x00bc4f thru 0x00cb42 (0xef4 bytes) 000190 1789187018.325273 write 0x0181c9 thru 0x01a43c (0x2274 bytes) 000191 1789187018.351840 punch from 0x015c6d to 0x01cbaa (0x6f3e bytes) 000193 1789187018.387714 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2059e): Mirror 6: 0xf755ac15 (stale) Mirror 8: 0xf755ac15 (stale) Mirror 9: 0x5eaa5068 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2059e): Mirror 6: 0xf755ac15 (stale) Mirror 8: 0xf755ac15 (stale) Mirror 9: 0x5eaa5068 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2059e: skipped 000194 1789187018.796084 fallocate 0x03b2c2 thru 0x03dbd7 (0x2916 bytes) 000196 1789187018.803382 read 0x00448b thru 0x0073c1 (0x2f37 bytes) 000197 1789187018.812310 trunc from 0x015d9d to 0x01618a (0x3ee bytes) 000198 1789187018.818285 read 0x014583 thru 0x02059d (0xc01b bytes) 000199 1789187018.842027 write 0x03cc1a thru 0x03ffff (0x33e6 bytes) 000200 1789187018.848408 punch from 0x01ff51 to 0x027485 (0x7535 bytes) 000201 1789187018.853873 write 0x02617f thru 0x033453 (0xd2d5 bytes) 000202 1789187018.862658 trunc from 0x02121e to 0x026158 (0x4f3b bytes) 000203 1789187018.877080 write 0x01c06f thru 0x028c88 (0xcc1a bytes) 000205 1789187018.880293 mapread 0x016af6 thru 0x0246db (0xdbe6 bytes) 000206 1789187018.882409 punch from 0x003c71 to 0x0136a1 (0xfa31 bytes) 000207 1789187018.887824 fallocate 0x034f81 thru 0x037d86 (0x2e06 bytes) 000208 1789187018.891999 mapread 0x0043f3 thru 0x0140bb (0xfcc9 bytes) 000209 1789187018.986943 write 0x0325f4 thru 0x0344e9 (0x1ef6 bytes) 000210 1789187018.988159 write 0x010e16 thru 0x01ade8 (0x9fd3 bytes) 000211 1789187019.000006 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x352165ec (stale) Mirror 9: 0xefb1bda7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x352165ec (stale) Mirror 9: 0xefb1bda7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000212 1789187019.353088 write 0x02367a thru 0x02a94e (0x72d5 bytes) 000213 1789187019.367277 write 0x014073 thru 0x01aec6 (0x6e54 bytes) 000214 1789187019.382866 mapread 0x019658 thru 0x01d240 (0x3be9 bytes) 000215 1789187019.413711 read 0x024834 thru 0x03132a (0xcaf7 bytes) 000216 1789187019.425044 read 0x004e7d thru 0x014080 (0xf204 bytes) 000217 1789187019.442454 punch from 0x0136a1 to 0x014bad (0x150d bytes) 000218 1789187019.455162 punch from 0x02b149 to 0x032b9a (0x7a52 bytes) 000219 1789187019.459387 trunc from 0x040000 to 0x0048d5 (0x3b72a bytes) 000220 1789187019.492160 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x48d6): Mirror 9: 0x9c296c28 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x48d6): Mirror 9: 0x9c296c28 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x48d6: skipped 000222 1789187019.785190 fallocate 0x0241ae thru 0x029927 (0x577a bytes) 000223 1789187019.792180 fallocate 0x0308a5 thru 0x0340b9 (0x3815 bytes) 000224 1789187019.798898 fallocate 0x018c03 thru 0x02341e (0xa81c bytes) 000225 1789187019.809901 trunc from 0x00ea68 to 0x010924 (0x1ebd bytes) 000226 1789187019.821432 fallocate 0x03dfea thru 0x03ffff (0x2016 bytes) 000227 1789187019.826103 trunc from 0x040000 to 0x02383c (0x1c7c3 bytes) 000228 1789187019.847381 read 0x0190c8 thru 0x02383c (0xa775 bytes) 000229 1789187019.862662 mapwrite 0x0221d6 thru 0x027e2d (0x5c58 bytes) 000230 1789187019.909889 read 0x01c2e7 thru 0x027e2d (0xbb47 bytes) 000232 1789187019.911167 mapread 0x01b6b8 thru 0x0254c9 (0x9e12 bytes) 000233 1789187019.917028 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x27e2e): Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27e2e): Mirror 9: 0x3f232bef (stale) CRC-32 checksum value for chunk [0, 0x27e2e): Mirror 1: 0x9fa75eec Mirror 10: 0x9fa75eec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27e2e: skipped 000234 1789187020.701676 write 0x0272cb thru 0x030538 (0x926e bytes) 000235 1789187020.745204 mapread 0x020e78 thru 0x0240da (0x3263 bytes) 000236 1789187020.762720 mapread 0x01c47b thru 0x022792 (0x6318 bytes) 000237 1789187020.763354 mapwrite 0x036a1c thru 0x03ffff (0x95e4 bytes) 000238 1789187020.809949 write 0x032e4e thru 0x03cadf (0x9c92 bytes) 000239 1789187020.810865 read 0x020820 thru 0x028d5f (0x8540 bytes) 000240 1789187020.811346 trunc from 0x014f05 to 0x01e6e3 (0x97df bytes) 000241 1789187020.815318 write 0x03d427 thru 0x03ffff (0x2bd9 bytes) 000242 1789187020.816513 mapread 0x0052fa thru 0x00ec49 (0x9950 bytes) 000243 1789187020.827715 punch from 0x034167 to 0x03ffff (0xbe99 bytes) 000244 1789187020.836882 punch from 0x02128f to 0x02792f (0x66a1 bytes) 000245 1789187020.840552 read 0x03d3f1 thru 0x03ffff (0x2c0f bytes) 000247 1789187020.850407 mapwrite 0x02e3dd thru 0x0379f0 (0x9614 bytes) 000248 1789187020.875381 mapread 0x034217 thru 0x03ffff (0xbde9 bytes) 000249 1789187020.876399 trunc from 0x040000 to 0x00aa45 (0x355ba bytes) 000250 1789187020.892534 write 0x031d82 thru 0x0327c9 (0xa48 bytes) 000251 1789187020.893614 write 0x01e1d0 thru 0x01eb50 (0x981 bytes) 000252 1789187020.899372 read 0x01d706 thru 0x02be57 (0xe752 bytes) 000253 1789187020.907762 trunc from 0x023dcd to 0x02d4b6 (0x96ea bytes) 000254 1789187020.913128 trunc from 0x0327ca to 0x019fb4 (0x18815 bytes) 000255 1789187020.937764 trunc from 0x006a59 to 0x015bab (0xf153 bytes) 000256 1789187020.943505 fallocate 0x029b86 thru 0x034fb3 (0xb42e bytes) 000257 1789187020.948903 write 0x03bdcf thru 0x03ffff (0x4231 bytes) 000258 1789187020.949959 trunc from 0x0145c1 to 0x021381 (0xcdc1 bytes) 000259 1789187020.960562 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xefb1bda7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xefb1bda7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000260 1789187021.278161 fallocate 0x022313 thru 0x0279cd (0x56bb bytes) 000261 1789187021.284493 punch from 0x027dbb to 0x028983 (0xbc9 bytes) 000262 1789187021.288085 read 0x027b6f thru 0x028007 (0x499 bytes) 000263 1789187021.297016 mapread 0x00a255 thru 0x013e0a (0x9bb6 bytes) 000264 1789187021.330370 mapread 0x02f1b5 thru 0x03e051 (0xee9d bytes) 000265 1789187021.346952 fallocate 0x01c6ca thru 0x024ada (0x8411 bytes) 000266 1789187021.351671 write 0x03684a thru 0x0373ec (0xba3 bytes) 000267 1789187021.357288 write 0x01c661 thru 0x020245 (0x3be5 bytes) 000268 1789187021.368181 punch from 0x0256d0 to 0x028f91 (0x38c2 bytes) 000269 1789187021.372812 mapread 0x0269cf thru 0x030c48 (0xa27a bytes) 000270 1789187021.380940 read 0x00f67a thru 0x01b09d (0xba24 bytes) 000271 1789187021.395563 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xefb1bda7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x30376e2a Mirror 10: 0x30376e2a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000272 1789187022.172540 read 0x0155ef thru 0x01a302 (0x4d14 bytes) 000273 1789187022.184328 trunc from 0x040000 to 0x028c3d (0x173c2 bytes) 000275 1789187022.270375 write 0x025616 thru 0x02e68e (0x9079 bytes) 000276 1789187022.281152 mapread 0x017328 thru 0x01d60a (0x62e3 bytes) 000277 1789187022.314880 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e68f): Mirror 10: 0xfab376b9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e68f): Mirror 10: 0xfab376b9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e68f: skipped 000278 1789187022.567107 mapread 0x024738 thru 0x02e68e (0x9f57 bytes) 000279 1789187022.588048 read 0x003e7a thru 0x00ad7e (0x6f05 bytes) 000280 1789187022.601743 MIRROR_RESYNC 2 mirrors 000281 1789187023.374173 mapread 0x002f05 thru 0x00b637 (0x8733 bytes) 000282 1789187023.418086 trunc from 0x02e68f to 0x02710a (0x7584 bytes) 000283 1789187023.481992 mapread 0x013ece thru 0x01e14f (0xa282 bytes) 000284 1789187023.509876 read 0x007413 thru 0x009f63 (0x2b51 bytes) 000285 1789187023.517930 mapread 0x005394 thru 0x00d9d0 (0x863d bytes) 000286 1789187023.531736 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) 000287 1789187023.676280 trunc from 0x02710b to 0x032f1c (0xbe12 bytes) 000288 1789187023.698281 write 0x02d9eb thru 0x03a8f2 (0xcf08 bytes) 000289 1789187023.707576 mapread 0x002b55 thru 0x007279 (0x4725 bytes) 000292 1789187023.726988 fallocate 0x0203de thru 0x02aafd (0xa720 bytes) 000294 1789187023.734186 mapwrite 0x015d0e thru 0x01e921 (0x8c14 bytes) 000295 1789187023.770220 mapwrite 0x004a21 thru 0x009458 (0x4a38 bytes) 000296 1789187023.786740 trunc from 0x03a8f3 to 0x03d40c (0x2b1a bytes) 000298 1789187023.813628 mapwrite 0x0034f0 thru 0x01151c (0xe02d bytes) 000299 1789187023.842371 write 0x01e103 thru 0x01e4f9 (0x3f7 bytes) 000300 1789187023.843294 fallocate 0x0244ad thru 0x033d97 (0xf8eb bytes) 000301 1789187023.848367 mapread 0x02c7cc thru 0x03a875 (0xe0aa bytes) 000302 1789187023.856851 fallocate 0x010922 thru 0x013158 (0x2837 bytes) 000305 1789187023.862871 write 0x00b279 thru 0x016d75 (0xbafd bytes) 000306 1789187023.864787 fallocate 0x0066e6 thru 0x01327f (0xcb9a bytes) 000309 1789187023.872029 mapread 0x014eb4 thru 0x0189f4 (0x3b41 bytes) 000310 1789187023.873778 read 0x0007c7 thru 0x005d57 (0x5591 bytes) 000311 1789187023.878774 fallocate 0x016494 thru 0x01aa8a (0x45f7 bytes) 000312 1789187023.882527 read 0x026588 thru 0x03465e (0xe0d7 bytes) 000313 1789187023.883430 mapwrite 0x019abd thru 0x026fb5 (0xd4f9 bytes) 000314 1789187023.902866 mapread 0x032df1 thru 0x03d40c (0xa61c bytes) 000315 1789187023.909180 mapwrite 0x010a48 thru 0x01a07f (0x9638 bytes) 000317 1789187023.946313 MIRROR_EXTEND to 2 mirrors 000318 1789187024.586123 write 0x01fafc thru 0x021874 (0x1d79 bytes) 000319 1789187024.614120 mapwrite 0x01d17c thru 0x022b3d (0x59c2 bytes) 000320 1789187024.648710 trunc from 0x01c804 to 0x01e7b4 (0x1fb1 bytes) 000321 1789187024.659719 MIRROR_RESYNC 2 mirrors 000322 1789187025.295943 punch from 0x0055c1 to 0x010662 (0xb0a2 bytes) 000323 1789187025.325521 trunc from 0x03d40d to 0x02e499 (0xef73 bytes) 000324 1789187025.352278 mapread 0x000a59 thru 0x00d1a3 (0xc74b bytes) 000325 1789187025.382368 fallocate 0x01b21e thru 0x025504 (0xa2e7 bytes) 000326 1789187025.389063 write 0x033e0c thru 0x037f64 (0x4159 bytes) 000327 1789187025.391404 write 0x00ddbf thru 0x01887e (0xaac0 bytes) 000328 1789187025.407389 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x37f65): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37f65): Mirror 2: 0x7fe90373 (stale) CRC-32 checksum value for chunk [0, 0x37f65): Mirror 1: 0x330f66a8 Mirror 3: 0x330f66a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37f65: skipped 000329 1789187026.284129 write 0x03ef54 thru 0x03ffff (0x10ac bytes) 000330 1789187026.333348 trunc from 0x0213e5 to 0x02a84a (0x9466 bytes) 000331 1789187026.340564 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5d21df77 (stale) Mirror 3: 0x93031080 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa8f15616 Mirror 4: 0xa8f15616 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000332 1789187027.198506 write 0x011af9 thru 0x013417 (0x191f bytes) 000333 1789187027.250032 mapread 0x00a62c thru 0x00f2fe (0x4cd3 bytes) 000334 1789187027.270726 read 0x00363c thru 0x00f9df (0xc3a4 bytes) 000335 1789187027.276647 mapwrite 0x022eec thru 0x02fe96 (0xcfab bytes) 000336 1789187027.327382 punch from 0x01a512 to 0x024d67 (0xa856 bytes) 000337 1789187027.333829 mapwrite 0x01f06f thru 0x024dc7 (0x5d59 bytes) 000338 1789187027.360729 trunc from 0x040000 to 0x01307c (0x2cf83 bytes) 000339 1789187027.383794 trunc from 0x011f10 to 0x01307c (0x116d bytes) 000340 1789187027.392165 mapread 0x00f88c thru 0x01307c (0x37f1 bytes) 000341 1789187027.401718 write 0x030324 thru 0x03a47c (0xa159 bytes) 000342 1789187027.408531 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3a47d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a47d): Mirror 2: 0xc3d13015 (stale) Mirror 3: 0x1baa9977 (stale) Mirror 4: 0x99a7341e (stale) CRC-32 checksum value for chunk [0, 0x3a47d): Mirror 1: 0x831d633b Mirror 5: 0x831d633b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a47d: skipped 000343 1789187028.246805 trunc from 0x02dfef to 0x03a47c (0xc48e bytes) 000344 1789187028.307966 trunc from 0x03a47d to 0x010469 (0x2a013 bytes) 000345 1789187028.388015 MIRROR_RESYNC 5 mirrors 000347 1789187029.534533 trunc from 0x01046a to 0x03f304 (0x2ee9b bytes) 000348 1789187029.560153 write 0x01f4fc thru 0x0253f7 (0x5efc bytes) 000350 1789187029.576085 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3f305): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f305): Mirror 2: 0xf124222 (stale) Mirror 3: 0xf124222 (stale) Mirror 4: 0xf124222 (stale) Mirror 5: 0xf124222 (stale) CRC-32 checksum value for chunk [0, 0x3f305): Mirror 1: 0x6d34d8cc Mirror 6: 0x6d34d8cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f305: skipped 000351 1789187030.366756 trunc from 0x03f305 to 0x02d907 (0x119fd bytes) 000352 1789187030.437474 read 0x007eb5 thru 0x00e614 (0x6760 bytes) 000353 1789187030.444440 trunc from 0x015365 to 0x018e2b (0x3ac7 bytes) 000354 1789187030.448495 read 0x0019e0 thru 0x009923 (0x7f44 bytes) 000355 1789187030.457864 mapread 0x0256f8 thru 0x025f7b (0x884 bytes) 000356 1789187030.458861 mapwrite 0x009f07 thru 0x00f7e9 (0x58e3 bytes) 000357 1789187030.478873 trunc from 0x02171b to 0x02d69e (0xbf84 bytes) 000358 1789187030.483661 read 0x01da93 thru 0x0227fb (0x4d69 bytes) 000360 1789187030.495939 trunc from 0x005a5c to 0x00d443 (0x79e8 bytes) 000362 1789187030.501640 trunc from 0x0101fb to 0x01a8c7 (0xa6cd bytes) 000364 1789187030.509991 trunc from 0x025800 to 0x02d4cd (0x7cce bytes) 000366 1789187030.515669 punch from 0x006bf7 to 0x01673c (0xfb46 bytes) 000367 1789187030.519784 trunc from 0x003acb to 0x010aa9 (0xcfdf bytes) 000368 1789187030.527950 read 0x01bbbb thru 0x024815 (0x8c5b bytes) 000369 1789187030.528525 fallocate 0x02c135 thru 0x031c51 (0x5b1d bytes) 000370 1789187030.533538 punch from 0x008dbe to 0x014185 (0xb3c8 bytes) 000371 1789187030.538653 trunc from 0x031c52 to 0x0336cd (0x1a7c bytes) 000372 1789187030.557201 trunc from 0x004379 to 0x00c02a (0x7cb2 bytes) 000373 1789187030.562676 write 0x03908a thru 0x03cc11 (0x3b88 bytes) 000374 1789187030.563728 fallocate 0x00d792 thru 0x0124a1 (0x4d10 bytes) 000375 1789187030.573190 punch from 0x0335ae to 0x03a49c (0x6eef bytes) 000376 1789187030.595194 punch from 0x0074be to 0x00edc2 (0x7905 bytes) 000377 1789187030.600580 mapwrite 0x03a311 thru 0x03ffff (0x5cef bytes) 000378 1789187030.704826 fallocate 0x02445c thru 0x032e18 (0xe9bd bytes) 000379 1789187030.710160 mapread 0x038e28 thru 0x03ffff (0x71d8 bytes) 000380 1789187030.710811 trunc from 0x040000 to 0x01c318 (0x23ce7 bytes) 000381 1789187030.726809 mapwrite 0x000604 thru 0x00f926 (0xf323 bytes) 000382 1789187030.759758 trunc from 0x01285f to 0x01c318 (0x9aba bytes) 000383 1789187030.767825 trunc from 0x0091d6 to 0x017c0a (0xea35 bytes) 000384 1789187030.774844 mapread 0x002b52 thru 0x012010 (0xf4bf bytes) 000385 1789187030.832568 trunc from 0x0014f2 to 0x00c442 (0xaf51 bytes) 000386 1789187030.840539 read 0x00a293 thru 0x0168da (0xc648 bytes) 000388 1789187030.859991 mapwrite 0x03b539 thru 0x03ffff (0x4ac7 bytes) 000389 1789187030.912658 MIRROR_RESYNC 6 mirrors 000390 1789187031.807838 MIRROR_RESYNC 6 mirrors 000391 1789187032.228889 trunc from 0x040000 to 0x038759 (0x78a6 bytes) 000392 1789187032.277789 fallocate 0x032487 thru 0x03468e (0x2208 bytes) 000393 1789187032.283894 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3875a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3875a): Mirror 2: 0x37d2626b (stale) Mirror 3: 0x37d2626b (stale) Mirror 4: 0x37d2626b (stale) Mirror 5: 0x37d2626b (stale) Mirror 6: 0x37d2626b (stale) CRC-32 checksum value for chunk [0, 0x3875a): Mirror 1: 0x37d2626b Mirror 7: 0x37d2626b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3875a: skipped 000394 1789187033.122866 fallocate 0x02a57f thru 0x036458 (0xbeda bytes) 000395 1789187033.160710 mapread 0x01bffb thru 0x027d7b (0xbd81 bytes) 000396 1789187033.188661 write 0x009770 thru 0x00cc01 (0x3492 bytes) 000397 1789187033.204496 punch from 0x033abc to 0x038759 (0x4c9e bytes) 000398 1789187033.216453 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3875a): Mirror 2: 0x37d2626b (stale) Mirror 3: 0x37d2626b (stale) Mirror 4: 0x37d2626b (stale) Mirror 5: 0x37d2626b (stale) Mirror 6: 0x37d2626b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3875a): Mirror 2: 0x37d2626b (stale) Mirror 3: 0x37d2626b (stale) Mirror 4: 0x37d2626b (stale) Mirror 5: 0x37d2626b (stale) Mirror 6: 0x37d2626b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3875a: skipped 000399 1789187033.572681 write 0x007210 thru 0x01311b (0xbf0c bytes) 000400 1789187033.604889 fallocate 0x03428e thru 0x03b83b (0x75ae bytes) 000401 1789187033.610693 write 0x016c91 thru 0x02321b (0xc58b bytes) 000402 1789187033.620616 trunc from 0x001e1d to 0x010c78 (0xee5c bytes) 000403 1789187033.632791 mapread 0x01b727 thru 0x01fbec (0x44c6 bytes) 000404 1789187033.633580 trunc from 0x009e48 to 0x00ab35 (0xcee bytes) 000405 1789187033.637726 mapwrite 0x0066e6 thru 0x008264 (0x1b7f bytes) 000406 1789187033.673794 trunc from 0x02de3a to 0x03b83b (0xda02 bytes) 000407 1789187033.680642 fallocate 0x03ba10 thru 0x03ffff (0x45f0 bytes) 000408 1789187033.689524 read 0x0282c6 thru 0x034dd2 (0xcb0d bytes) 000409 1789187033.705674 mapwrite 0x007525 thru 0x00d9a8 (0x6484 bytes) 000410 1789187033.726644 mapwrite 0x0281c1 thru 0x02a53c (0x237c bytes) 000411 1789187033.744543 mapread 0x0191e9 thru 0x027bed (0xea05 bytes) 000412 1789187033.757706 mapread 0x0192eb thru 0x01b3f4 (0x210a bytes) 000413 1789187033.759607 punch from 0x019fdb to 0x02681e (0xc844 bytes) 000414 1789187033.766755 read 0x021acf thru 0x02360f (0x1b41 bytes) 000416 1789187033.780897 fallocate 0x02e60c thru 0x03077f (0x2174 bytes) 000417 1789187033.786729 write 0x02f67f thru 0x0325c3 (0x2f45 bytes) 000418 1789187033.788036 fallocate 0x0378ef thru 0x03ffff (0x8711 bytes) 000419 1789187033.803135 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd3db56b (stale) Mirror 4: 0xd3db56b (stale) Mirror 5: 0xd3db56b (stale) Mirror 6: 0xd3db56b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd3db56b (stale) Mirror 4: 0xd3db56b (stale) Mirror 5: 0xd3db56b (stale) Mirror 6: 0xd3db56b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000422 1789187034.149841 punch from 0x00a19f to 0x015ef7 (0xbd59 bytes) 000423 1789187034.157855 mapread 0x01a0c9 thru 0x01a6c1 (0x5f9 bytes) 000424 1789187034.164396 mapread 0x03ddac thru 0x03ffff (0x2254 bytes) 000425 1789187034.182514 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd3db56b (stale) Mirror 4: 0xd3db56b (stale) Mirror 5: 0xd3db56b (stale) Mirror 6: 0xd3db56b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xac573258 Mirror 7: 0xac573258 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000426 1789187034.963595 read 0x038606 thru 0x039ee0 (0x18db bytes) 000427 1789187034.976173 write 0x009679 thru 0x00ab39 (0x14c1 bytes) 000428 1789187035.037690 mapread 0x03f70f thru 0x03ffff (0x8f1 bytes) 000429 1789187035.045970 write 0x0114f1 thru 0x019e3b (0x894b bytes) 000430 1789187035.067910 fallocate 0x03bec9 thru 0x03dab5 (0x1bed bytes) 000431 1789187035.078746 mapread 0x027f8b thru 0x02f859 (0x78cf bytes) 000432 1789187035.109442 fallocate 0x03726a thru 0x03cfc3 (0x5d5a bytes) 000433 1789187035.116138 trunc from 0x040000 to 0x00aabe (0x35541 bytes) 000434 1789187035.150732 read 0x0041bc thru 0x00aabe (0x6903 bytes) 000435 1789187035.162065 trunc from 0x007bec to 0x00aabe (0x2ed3 bytes) 000436 1789187035.178987 fallocate 0x008d96 thru 0x014233 (0xb49e bytes) 000437 1789187035.184208 trunc from 0x00aabf to 0x00534f (0x576f bytes) 000438 1789187035.199384 fallocate 0x016c74 thru 0x01c2b0 (0x563d bytes) 000439 1789187035.207808 MIRROR_RESYNC 6 mirrors 000440 1789187036.050689 punch from 0x0006b0 to 0x0020e5 (0x1a36 bytes) 000441 1789187036.084158 mapwrite 0x03147e thru 0x03463d (0x31c0 bytes) 000442 1789187036.171820 write 0x0093fb thru 0x00e464 (0x506a bytes) 000443 1789187036.181813 write 0x016db3 thru 0x025710 (0xe95e bytes) 000444 1789187036.192481 mapwrite 0x035c3b thru 0x03ffff (0xa3c5 bytes) 000445 1789187036.250401 write 0x03a5d0 thru 0x03ce01 (0x2832 bytes) 000447 1789187036.252150 read 0x01f062 thru 0x02b3f6 (0xc395 bytes) 000448 1789187036.264529 mapwrite 0x0095b6 thru 0x00dd34 (0x477f bytes) 000449 1789187036.282130 mapread 0x01ebf0 thru 0x028475 (0x9886 bytes) 000450 1789187036.283660 trunc from 0x001010 to 0x00d1d9 (0xc1ca bytes) 000451 1789187036.289073 mapread 0x01a151 thru 0x01f14b (0x4ffb bytes) 000452 1789187036.294427 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3528917a (stale) Mirror 4: 0x3528917a (stale) Mirror 5: 0x3528917a (stale) Mirror 6: 0x3528917a (stale) Mirror 7: 0x3528917a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5258f3a3 Mirror 8: 0x5258f3a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000453 1789187037.024192 punch from 0x034102 to 0x03632e (0x222d bytes) 000454 1789187037.069089 read 0x002040 thru 0x0021ec (0x1ad bytes) 000455 1789187037.075547 fallocate 0x0354c7 thru 0x03636f (0xea9 bytes) 000456 1789187037.080666 read 0x01febe thru 0x02c3e1 (0xc524 bytes) 000457 1789187037.091005 punch from 0x027b99 to 0x031b7e (0x9fe6 bytes) 000458 1789187037.101521 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3528917a (stale) Mirror 4: 0x3528917a (stale) Mirror 5: 0x3528917a (stale) Mirror 6: 0x3528917a (stale) Mirror 7: 0x3528917a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3528917a (stale) Mirror 4: 0x3528917a (stale) Mirror 5: 0x3528917a (stale) Mirror 6: 0x3528917a (stale) Mirror 7: 0x3528917a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000459 1789187037.433076 read 0x02f869 thru 0x036ce8 (0x7480 bytes) 000460 1789187037.445501 MIRROR_RESYNC 6 mirrors 000461 1789187039.119998 trunc from 0x040000 to 0x0149ac (0x2b653 bytes) 000462 1789187039.153534 trunc from 0x0149ad to 0x02e655 (0x19ca9 bytes) 000463 1789187039.182159 mapwrite 0x01f67d thru 0x02624c (0x6bd0 bytes) 000464 1789187039.227142 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2e656): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e656): Mirror 3: 0xaf572734 (stale) Mirror 4: 0xaf572734 (stale) Mirror 5: 0xaf572734 (stale) Mirror 6: 0xaf572734 (stale) Mirror 7: 0xaf572734 (stale) CRC-32 checksum value for chunk [0, 0x2e656): Mirror 1: 0x45a7f5c8 Mirror 8: 0x45a7f5c8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e656: skipped 000465 1789187040.180331 MIRROR_RESYNC 7 mirrors 000467 1789187041.423143 mapread 0x012dde thru 0x020bc6 (0xdde9 bytes) 000468 1789187041.448266 fallocate 0x02d54c thru 0x03b4f5 (0xdfaa bytes) 000469 1789187041.479420 read 0x019ffd thru 0x023f0f (0x9f13 bytes) 000470 1789187041.487794 write 0x006079 thru 0x01298b (0xc913 bytes) 000472 1789187041.503467 MIRROR_RESYNC 7 mirrors 000473 1789187043.359992 MIRROR_EXTEND to 8 mirrors 000474 1789187044.293366 mapwrite 0x029ae2 thru 0x0344e9 (0xaa08 bytes) 000476 1789187044.390227 MIRROR_RESYNC 8 mirrors 000477 1789187046.259801 mapread 0x0014db thru 0x00ceab (0xb9d1 bytes) 000478 1789187046.291506 MIRROR_RESYNC 8 mirrors 000480 1789187046.993749 fallocate 0x0035fe thru 0x010d8a (0xd78d bytes) 000482 1789187047.027993 mapread 0x007c14 thru 0x0176ce (0xfabb bytes) 000483 1789187047.061538 mapwrite 0x00721e thru 0x007ae1 (0x8c4 bytes) 000484 1789187047.074393 mapwrite 0x0146d3 thru 0x0147c2 (0xf0 bytes) 000485 1789187047.087497 trunc from 0x0344ea to 0x02e281 (0x6268 bytes) 000486 1789187047.105761 trunc from 0x02e282 to 0x031799 (0x3518 bytes) 000487 1789187047.117582 mapwrite 0x026568 thru 0x035b1f (0xf5b8 bytes) 000488 1789187047.172742 mapwrite 0x001f5d thru 0x00bb90 (0x9c34 bytes) 000489 1789187047.200441 trunc from 0x023e01 to 0x033461 (0xf661 bytes) 000491 1789187047.208116 read 0x02e9f6 thru 0x035b1f (0x712a bytes) 000492 1789187047.218597 read 0x03374c thru 0x035b1f (0x23d4 bytes) 000493 1789187047.219209 fallocate 0x032f56 thru 0x03fc1c (0xccc7 bytes) 000494 1789187047.224518 punch from 0x032d34 to 0x03fc1c (0xcee9 bytes) 000495 1789187047.234095 fallocate 0x03e279 thru 0x03ffff (0x1d87 bytes) 000496 1789187047.241277 write 0x011b2b thru 0x01ffcb (0xe4a1 bytes) 000497 1789187047.246165 trunc from 0x024efb to 0x02c5ae (0x76b4 bytes) 000498 1789187047.252422 mapread 0x006e02 thru 0x00fa57 (0x8c56 bytes) 000499 1789187047.253335 write 0x025272 thru 0x030da6 (0xbb35 bytes) 000500 1789187047.265569 read 0x011586 thru 0x017917 (0x6392 bytes) 000501 1789187047.266436 read 0x0144ca thru 0x0162a0 (0x1dd7 bytes) 000502 1789187047.267612 mapread 0x03489a thru 0x03ffff (0xb766 bytes) 000503 1789187047.269697 write 0x0152aa thru 0x01c3bf (0x7116 bytes) 000505 1789187047.271953 mapread 0x00047a thru 0x0010f5 (0xc7c bytes) 000506 1789187047.277792 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa41f2212 (stale) Mirror 4: 0xa41f2212 (stale) Mirror 5: 0xa41f2212 (stale) Mirror 6: 0xa41f2212 (stale) Mirror 7: 0xa41f2212 (stale) Mirror 8: 0xa41f2212 (stale) Mirror 9: 0xa41f2212 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd04fa9f8 Mirror 10: 0xd04fa9f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000508 1789187048.100477 mapwrite 0x001334 thru 0x00f053 (0xdd20 bytes) 000509 1789187048.213912 trunc from 0x040000 to 0x009cac (0x36353 bytes) 000510 1789187048.269848 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x9cad): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9cad): Mirror 3: 0x2627ba6e (stale) Mirror 4: 0x2627ba6e (stale) Mirror 5: 0x2627ba6e (stale) Mirror 6: 0x2627ba6e (stale) Mirror 7: 0x2627ba6e (stale) Mirror 8: 0x2627ba6e (stale) Mirror 9: 0x2627ba6e (stale) Mirror 10: 0x6b8ed368 (stale) CRC-32 checksum value for chunk [0, 0x9cad): Mirror 1: 0x4db94ff6 Mirror 11: 0x4db94ff6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9cad: skipped 000511 1789187049.218050 punch from 0x008a0c to 0x009cac (0x12a1 bytes) 000513 1789187049.256924 write 0x018351 thru 0x024c84 (0xc934 bytes) 000515 1789187049.263558 write 0x01d002 thru 0x0271c8 (0xa1c7 bytes) 000516 1789187049.267678 trunc from 0x019b2d to 0x021610 (0x7ae4 bytes) 000517 1789187049.280136 punch from 0x00e7fd to 0x00e95f (0x163 bytes) 000518 1789187049.285068 punch from 0x018023 to 0x01cae0 (0x4abe bytes) 000519 1789187049.295757 MIRROR_RESYNC 10 mirrors 000520 1789187050.970373 trunc from 0x00a5dd to 0x01624c (0xbc70 bytes) 000521 1789187050.999538 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x271c9): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x271c9): Mirror 3: 0x94297a40 (stale) Mirror 4: 0x94297a40 (stale) Mirror 5: 0x94297a40 (stale) Mirror 6: 0x94297a40 (stale) Mirror 7: 0x94297a40 (stale) Mirror 8: 0x94297a40 (stale) Mirror 9: 0x94297a40 (stale) Mirror 10: 0x94297a40 (stale) Mirror 11: 0x94297a40 (stale) CRC-32 checksum value for chunk [0, 0x271c9): Mirror 1: 0x94297a40 Mirror 12: 0x94297a40 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x271c9: skipped 000522 1789187051.848675 fallocate 0x0109bd thru 0x0119b9 (0xffd bytes) 000523 1789187051.903747 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x271c9): Mirror 3: 0x94297a40 (stale) Mirror 4: 0x94297a40 (stale) Mirror 6: 0x94297a40 (stale) Mirror 7: 0x94297a40 (stale) Mirror 8: 0x94297a40 (stale) Mirror 9: 0x94297a40 (stale) Mirror 10: 0x94297a40 (stale) Mirror 11: 0x94297a40 (stale) Mirror 12: 0x94297a40 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x271c9): Mirror 3: 0x94297a40 (stale) Mirror 4: 0x94297a40 (stale) Mirror 6: 0x94297a40 (stale) Mirror 7: 0x94297a40 (stale) Mirror 8: 0x94297a40 (stale) Mirror 9: 0x94297a40 (stale) Mirror 10: 0x94297a40 (stale) Mirror 11: 0x94297a40 (stale) Mirror 12: 0x94297a40 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x271c9: skipped 000524 1789187052.477591 trunc from 0x0271c9 to 0x025639 (0x1b8f bytes) 000525 1789187052.498500 fallocate 0x021b42 thru 0x02b2e2 (0x97a1 bytes) 000526 1789187052.503986 fallocate 0x02b12d thru 0x039b12 (0xe9e6 bytes) 000528 1789187052.513716 fallocate 0x0159b1 thru 0x024519 (0xeb69 bytes) 000529 1789187052.519775 punch from 0x00a964 to 0x017cfb (0xd398 bytes) 000530 1789187052.523788 read 0x007b39 thru 0x008172 (0x63a bytes) 000531 1789187052.534647 read 0x01ea39 thru 0x025639 (0x6c01 bytes) 000532 1789187052.546335 mapread 0x00ff95 thru 0x0178b3 (0x791f bytes) 000533 1789187052.548400 fallocate 0x034b26 thru 0x03ffff (0xb4da bytes) 000534 1789187052.554604 fallocate 0x013c85 thru 0x014099 (0x415 bytes) 000535 1789187052.561348 mapwrite 0x00ff5f thru 0x01ac62 (0xad04 bytes) 000536 1789187052.590708 mapwrite 0x030ed8 thru 0x03eac5 (0xdbee bytes) 000537 1789187052.663379 write 0x032f6f thru 0x03ffff (0xd091 bytes) 000539 1789187052.665567 mapread 0x02fb4e thru 0x03d45f (0xd912 bytes) 000540 1789187052.672472 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1dd348d3 (stale) Mirror 4: 0x1dd348d3 (stale) Mirror 6: 0x1dd348d3 (stale) Mirror 7: 0x1dd348d3 (stale) Mirror 8: 0x1dd348d3 (stale) Mirror 9: 0x1dd348d3 (stale) Mirror 10: 0x1dd348d3 (stale) Mirror 11: 0x1dd348d3 (stale) Mirror 12: 0x1dd348d3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6339432c Mirror 13: 0x6339432c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000541 1789187053.885104 trunc from 0x004284 to 0x00718c (0x2f09 bytes) 000542 1789187053.956866 trunc from 0x040000 to 0x01551a (0x2aae5 bytes) 000543 1789187053.996390 read 0x00c310 thru 0x01551a (0x920b bytes) 000546 1789187054.010407 read 0x008e55 thru 0x00a71c (0x18c8 bytes) 000547 1789187054.031082 trunc from 0x000a6f to 0x00bf67 (0xb4f9 bytes) 000548 1789187054.037662 write 0x022535 thru 0x0302d7 (0xdda3 bytes) 000549 1789187054.040053 mapread 0x008dad thru 0x0149e5 (0xbc39 bytes) 000550 1789187054.063957 mapread 0x002a31 thru 0x00857e (0x5b4e bytes) 000551 1789187054.090914 trunc from 0x0302d8 to 0x02f7cb (0xb0c bytes) 000552 1789187054.106544 mapread 0x01eb64 thru 0x01f5b2 (0xa4f bytes) 000553 1789187054.107487 write 0x0347a6 thru 0x03933a (0x4b95 bytes) 000554 1789187054.109085 trunc from 0x0108c5 to 0x0129cb (0x2107 bytes) 000555 1789187054.112575 fallocate 0x024a89 thru 0x027318 (0x2890 bytes) 000556 1789187054.116483 trunc from 0x03560d to 0x03933a (0x3d2e bytes) 000557 1789187054.127703 trunc from 0x032d7d to 0x03933a (0x65be bytes) 000558 1789187054.132031 read 0x02761c thru 0x02e7e0 (0x71c5 bytes) 000559 1789187054.132587 punch from 0x001c9f to 0x004820 (0x2b82 bytes) 000560 1789187054.136103 read 0x004048 thru 0x0061cd (0x2186 bytes) 000561 1789187054.142976 mapwrite 0x030eb8 thru 0x03ffff (0xf148 bytes) 000562 1789187054.198367 write 0x03e38f thru 0x03ffff (0x1c71 bytes) 000563 1789187054.200615 trunc from 0x008ee5 to 0x00aeaf (0x1fcb bytes) 000564 1789187054.207606 punch from 0x0214e6 to 0x02838d (0x6ea8 bytes) 000566 1789187054.222709 MIRROR_RESYNC 11 mirrors 000567 1789187056.779584 write 0x01e8ad thru 0x02ad1f (0xc473 bytes) 000568 1789187056.825305 trunc from 0x040000 to 0x01af29 (0x250d6 bytes) 000569 1789187056.843726 fallocate 0x02140b thru 0x02c789 (0xb37f bytes) 000570 1789187056.849548 fallocate 0x0199e2 thru 0x025fa6 (0xc5c5 bytes) 000571 1789187056.854998 fallocate 0x01dab3 thru 0x01dc60 (0x1ae bytes) 000572 1789187056.860787 punch from 0x01fb65 to 0x01fbef (0x8b bytes) 000573 1789187056.865534 write 0x009cd8 thru 0x010617 (0x6940 bytes) 000574 1789187056.876390 punch from 0x01bd14 to 0x025fa6 (0xa293 bytes) 000575 1789187056.882028 read 0x010c06 thru 0x011ed6 (0x12d1 bytes) 000576 1789187056.886965 write 0x0164f1 thru 0x01f090 (0x8ba0 bytes) 000577 1789187056.895640 mapwrite 0x01c79e thru 0x0221a6 (0x5a09 bytes) 000578 1789187056.931768 mapread 0x01c78e thru 0x025fa6 (0x9819 bytes) 000579 1789187056.932838 fallocate 0x00c84e thru 0x00f3c0 (0x2b73 bytes) 000580 1789187056.946715 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25fa7): Mirror 3: 0x26c1c9f8 (stale) Mirror 4: 0x26c1c9f8 (stale) Mirror 7: 0x26c1c9f8 (stale) Mirror 8: 0x26c1c9f8 (stale) Mirror 9: 0x26c1c9f8 (stale) Mirror 10: 0x26c1c9f8 (stale) Mirror 11: 0x26c1c9f8 (stale) Mirror 12: 0x26c1c9f8 (stale) Mirror 13: 0x26c1c9f8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25fa7): Mirror 3: 0x26c1c9f8 (stale) Mirror 4: 0x26c1c9f8 (stale) Mirror 7: 0x26c1c9f8 (stale) Mirror 8: 0x26c1c9f8 (stale) Mirror 9: 0x26c1c9f8 (stale) Mirror 10: 0x26c1c9f8 (stale) Mirror 11: 0x26c1c9f8 (stale) Mirror 12: 0x26c1c9f8 (stale) Mirror 13: 0x26c1c9f8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25fa7: skipped 000581 1789187057.441578 MIRROR_RESYNC 10 mirrors 000582 1789187059.781395 mapwrite 0x008a69 thru 0x00c6a8 (0x3c40 bytes) 000583 1789187059.878485 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25fa7): Mirror 3: 0x973ab67b (stale) Mirror 4: 0x973ab67b (stale) Mirror 7: 0x973ab67b (stale) Mirror 8: 0x973ab67b (stale) Mirror 10: 0x973ab67b (stale) Mirror 11: 0x973ab67b (stale) Mirror 12: 0x973ab67b (stale) Mirror 13: 0x973ab67b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25fa7): Mirror 3: 0x973ab67b (stale) Mirror 4: 0x973ab67b (stale) Mirror 7: 0x973ab67b (stale) Mirror 8: 0x973ab67b (stale) Mirror 10: 0x973ab67b (stale) Mirror 11: 0x973ab67b (stale) Mirror 12: 0x973ab67b (stale) Mirror 13: 0x973ab67b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25fa7: skipped 000584 1789187060.325057 mapwrite 0x022877 thru 0x02c6c1 (0x9e4b bytes) 000585 1789187060.387058 mapread 0x009adf thru 0x018e3e (0xf360 bytes) 000586 1789187060.408400 read 0x010c1b thru 0x01b220 (0xa606 bytes) 000587 1789187060.412505 trunc from 0x02c6c2 to 0x017273 (0x1544e bytes) 000588 1789187060.422925 trunc from 0x017274 to 0x01128f (0x5fe4 bytes) 000589 1789187060.436025 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x11290): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11290): Mirror 3: 0xdbd56c95 (stale) Mirror 4: 0xdbd56c95 (stale) Mirror 7: 0xdbd56c95 (stale) Mirror 8: 0xdbd56c95 (stale) Mirror 10: 0xdbd56c95 (stale) Mirror 11: 0xdbd56c95 (stale) Mirror 12: 0xdbd56c95 (stale) Mirror 13: 0xdbd56c95 (stale) CRC-32 checksum value for chunk [0, 0x11290): Mirror 1: 0xbf351d1e Mirror 14: 0xbf351d1e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11290: skipped 000590 1789187061.154170 mapwrite 0x019005 thru 0x01fc83 (0x6c7f bytes) 000591 1789187061.238345 punch from 0x000c12 to 0x00168c (0xa7b bytes) 000592 1789187061.247320 trunc from 0x00023d to 0x004888 (0x464c bytes) 000593 1789187061.256028 write 0x024687 thru 0x032417 (0xdd91 bytes) 000594 1789187061.258517 punch from 0x0301ed to 0x032417 (0x222b bytes) 000595 1789187061.292635 MIRROR_RESYNC 10 mirrors 000596 1789187063.920577 trunc from 0x032418 to 0x01d895 (0x14b82 bytes) 000597 1789187063.960598 fallocate 0x00bee5 thru 0x01a53b (0xe657 bytes) 000598 1789187063.965474 trunc from 0x01d896 to 0x0038b0 (0x19fe5 bytes) 000599 1789187063.981627 fallocate 0x018955 thru 0x02404d (0xb6f9 bytes) 000601 1789187063.986767 mapwrite 0x0181b5 thru 0x01cf76 (0x4dc2 bytes) 000602 1789187064.046894 mapwrite 0x01fd91 thru 0x020689 (0x8f9 bytes) 000603 1789187064.086729 mapread 0x015d47 thru 0x01870a (0x29c4 bytes) 000605 1789187064.088167 mapwrite 0x03ab6b thru 0x03ffff (0x5495 bytes) 000606 1789187064.133750 mapwrite 0x02fa95 thru 0x032326 (0x2892 bytes) 000607 1789187064.161207 trunc from 0x040000 to 0x0020fe (0x3df01 bytes) 000608 1789187064.179669 fallocate 0x02ae83 thru 0x030c65 (0x5de3 bytes) 000609 1789187064.186193 trunc from 0x02ac9a to 0x02e4b5 (0x381c bytes) 000610 1789187064.198213 MIRROR_RESYNC 10 mirrors 000611 1789187065.334523 trunc from 0x030c66 to 0x00d8be (0x233a7 bytes) 000614 1789187065.375414 mapwrite 0x034c6b thru 0x03bbc7 (0x6f5d bytes) 000615 1789187065.452015 punch from 0x032ef8 to 0x03bbc7 (0x8cd0 bytes) 000616 1789187065.458967 trunc from 0x000fbd to 0x007d9d (0x6de1 bytes) 000617 1789187065.465341 read 0x010d7b thru 0x01ed32 (0xdfb8 bytes) 000618 1789187065.474799 punch from 0x027e72 to 0x036637 (0xe7c6 bytes) 000620 1789187065.480370 mapwrite 0x032470 thru 0x03802e (0x5bbf bytes) 000621 1789187065.504137 fallocate 0x036c8e thru 0x03c0e9 (0x545c bytes) 000622 1789187065.509666 mapwrite 0x00e6b0 thru 0x01ac76 (0xc5c7 bytes) 000623 1789187065.537657 read 0x020691 thru 0x0213c6 (0xd36 bytes) 000624 1789187065.547644 punch from 0x028c9b to 0x02ff24 (0x728a bytes) 000625 1789187065.552453 trunc from 0x03c0ea to 0x001039 (0x3b0b0 bytes) 000626 1789187065.566984 mapread 0x000cb5 thru 0x001039 (0x385 bytes) 000627 1789187065.567890 mapwrite 0x021202 thru 0x02bdc5 (0xabc4 bytes) 000628 1789187065.693431 mapwrite 0x038145 thru 0x03ffff (0x7ebb bytes) 000629 1789187065.816693 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) Mirror 13: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) Mirror 13: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000630 1789187066.391797 mapwrite 0x02216e thru 0x026f30 (0x4dc3 bytes) 000632 1789187066.435186 write 0x0120e5 thru 0x01a5f8 (0x8514 bytes) 000633 1789187066.451435 fallocate 0x03ad99 thru 0x03ffff (0x5267 bytes) 000634 1789187066.461464 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000636 1789187066.981373 write 0x0375a6 thru 0x03ffff (0x8a5a bytes) 000637 1789187066.993663 punch from 0x035f8e to 0x03ffff (0xa072 bytes) 000638 1789187067.011702 fallocate 0x00bd13 thru 0x0113b6 (0x56a4 bytes) 000639 1789187067.016774 mapread 0x008d1f thru 0x017995 (0xec77 bytes) 000640 1789187067.049387 mapread 0x030e27 thru 0x032901 (0x1adb bytes) 000641 1789187067.061836 read 0x008af9 thru 0x01637c (0xd884 bytes) 000642 1789187067.062531 punch from 0x00fab6 to 0x01bd4d (0xc298 bytes) 000643 1789187067.067635 write 0x005640 thru 0x0057d7 (0x198 bytes) 000644 1789187067.068867 mapwrite 0x0266e1 thru 0x02ad61 (0x4681 bytes) 000645 1789187067.105044 trunc from 0x03f9ea to 0x03ffff (0x616 bytes) 000646 1789187067.110839 punch from 0x01a5cc to 0x01deba (0x38ef bytes) 000647 1789187067.120411 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000649 1789187067.670533 punch from 0x01f087 to 0x02d519 (0xe493 bytes) 000650 1789187067.679417 read 0x03ae1e thru 0x03ffff (0x51e2 bytes) 000651 1789187067.685689 read 0x038532 thru 0x03b281 (0x2d50 bytes) 000652 1789187067.698872 trunc from 0x040000 to 0x016be3 (0x2941c bytes) 000653 1789187067.719559 trunc from 0x001a2b to 0x0072e3 (0x58b9 bytes) 000654 1789187067.723949 trunc from 0x016be4 to 0x01b780 (0x4b9d bytes) 000655 1789187067.747007 MIRROR_RESYNC 7 mirrors 000656 1789187068.563493 trunc from 0x00c16f to 0x00d708 (0x159a bytes) 000657 1789187068.599309 fallocate 0x007689 thru 0x0128d9 (0xb251 bytes) 000658 1789187068.609690 trunc from 0x00c29f to 0x018fb6 (0xcd18 bytes) 000659 1789187068.614445 punch from 0x007caa to 0x014645 (0xc99c bytes) 000660 1789187068.619192 punch from 0x00d969 to 0x01b780 (0xde18 bytes) 000661 1789187068.623685 read 0x00d9fc thru 0x017244 (0x9849 bytes) 000662 1789187068.634936 punch from 0x014f9a to 0x01b780 (0x67e7 bytes) 000663 1789187068.639091 read 0x01398a thru 0x016ccb (0x3342 bytes) 000664 1789187068.652496 MIRROR_RESYNC 7 mirrors 000665 1789187069.634793 read 0x019413 thru 0x01af54 (0x1b42 bytes) 000666 1789187069.640421 fallocate 0x03d419 thru 0x03f4a6 (0x208e bytes) 000667 1789187069.674134 fallocate 0x031cbc thru 0x034a2f (0x2d74 bytes) 000668 1789187069.678561 mapread 0x01a2ab thru 0x029ba0 (0xf8f6 bytes) 000669 1789187069.707190 write 0x036762 thru 0x03e51e (0x7dbd bytes) 000670 1789187069.717203 fallocate 0x01f930 thru 0x023120 (0x37f1 bytes) 000671 1789187069.722327 trunc from 0x03f4a7 to 0x008bfe (0x368a8 bytes) 000672 1789187069.738517 mapwrite 0x0117d9 thru 0x017419 (0x5c41 bytes) 000673 1789187069.783279 read 0x008f48 thru 0x00d00d (0x40c6 bytes) 000674 1789187069.799652 read 0x014f36 thru 0x015dbe (0xe89 bytes) 000675 1789187069.800347 trunc from 0x01741a to 0x004df7 (0x12622 bytes) 000676 1789187069.830464 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x4df8): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4df8): Mirror 3: 0x3a2d741f (stale) Mirror 4: 0x3a2d741f (stale) Mirror 8: 0x3a2d741f (stale) Mirror 10: 0x3a2d741f (stale) Mirror 11: 0x3a2d741f (stale) Mirror 12: 0x3a2d741f (stale) CRC-32 checksum value for chunk [0, 0x4df8): Mirror 1: 0x3a2d741f Mirror 13: 0x3a2d741f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4df8: skipped 000677 1789187070.715463 mapwrite 0x01024b thru 0x01ab3e (0xa8f4 bytes) 000678 1789187070.890914 write 0x032cce thru 0x03bfca (0x92fd bytes) 000679 1789187070.913174 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bfcb): Mirror 3: 0xffe14825 (stale) Mirror 8: 0xffe14825 (stale) Mirror 10: 0xffe14825 (stale) Mirror 11: 0xffe14825 (stale) Mirror 12: 0xffe14825 (stale) Mirror 13: 0xffe14825 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bfcb): Mirror 3: 0xffe14825 (stale) Mirror 8: 0xffe14825 (stale) Mirror 10: 0xffe14825 (stale) Mirror 11: 0xffe14825 (stale) Mirror 12: 0xffe14825 (stale) Mirror 13: 0xffe14825 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bfcb: skipped 000680 1789187071.742524 fallocate 0x02c47a thru 0x03822f (0xbdb6 bytes) 000681 1789187071.759843 trunc from 0x03bfcb to 0x02a36a (0x11c60 bytes) 000683 1789187071.786915 mapwrite 0x009f0f thru 0x00cfa6 (0x3098 bytes) 000684 1789187071.868637 mapread 0x02a01a thru 0x02a36a (0x351 bytes) 000685 1789187071.905593 read 0x01fa8f thru 0x023204 (0x3776 bytes) 000686 1789187071.920555 punch from 0x01aa47 to 0x01ed68 (0x4322 bytes) 000687 1789187071.931775 punch from 0x00e694 to 0x017fe9 (0x9956 bytes) 000688 1789187071.943024 write 0x006624 thru 0x00c28e (0x5c6b bytes) 000689 1789187071.944820 trunc from 0x0095ce to 0x01809b (0xeace bytes) 000690 1789187071.975389 trunc from 0x00471d to 0x0056e6 (0xfca bytes) 000691 1789187071.988498 punch from 0x011001 to 0x01e571 (0xd571 bytes) 000692 1789187072.000704 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a36b): Mirror 8: 0x91b16d90 (stale) Mirror 10: 0x91b16d90 (stale) Mirror 11: 0x91b16d90 (stale) Mirror 12: 0x91b16d90 (stale) Mirror 13: 0x91b16d90 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a36b): Mirror 8: 0x91b16d90 (stale) Mirror 10: 0x91b16d90 (stale) Mirror 11: 0x91b16d90 (stale) Mirror 12: 0x91b16d90 (stale) Mirror 13: 0x91b16d90 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a36b: skipped 000693 1789187072.603651 fallocate 0x03ed7e thru 0x03ffff (0x1282 bytes) 000694 1789187072.611940 fallocate 0x01a2ad thru 0x025f4e (0xbca2 bytes) 000695 1789187072.618753 mapread 0x0180ed thru 0x023368 (0xb27c bytes) 000696 1789187072.654154 fallocate 0x00020f thru 0x00b017 (0xae09 bytes) 000697 1789187072.660114 mapread 0x01cc09 thru 0x029942 (0xcd3a bytes) 000698 1789187072.661502 write 0x02d097 thru 0x031af4 (0x4a5e bytes) 000699 1789187072.681348 punch from 0x035b90 to 0x03d575 (0x79e6 bytes) 000700 1789187072.688906 mapread 0x004694 thru 0x01340f (0xed7c bytes) 000701 1789187072.711387 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) Mirror 12: 0xe20eea22 (stale) Mirror 13: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5f5827f6 Mirror 14: 0x5f5827f6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000702 1789187073.816387 mapread 0x01bfa2 thru 0x02828a (0xc2e9 bytes) 000703 1789187073.899345 MIRROR_RESYNC 7 mirrors 000704 1789187075.470628 fallocate 0x02e277 thru 0x03a322 (0xc0ac bytes) 000705 1789187075.528292 trunc from 0x03d939 to 0x03ffff (0x26c7 bytes) 000706 1789187075.535006 trunc from 0x03d659 to 0x03ffff (0x29a7 bytes) 000707 1789187075.540699 mapwrite 0x0179fa thru 0x020d4d (0x9354 bytes) 000708 1789187075.584551 trunc from 0x037346 to 0x03b017 (0x3cd2 bytes) 000709 1789187075.589923 mapwrite 0x00ceb8 thru 0x01641f (0x9568 bytes) 000710 1789187075.616820 fallocate 0x02a6f7 thru 0x02cc51 (0x255b bytes) 000711 1789187075.621890 mapwrite 0x007d04 thru 0x016fbe (0xf2bb bytes) 000712 1789187075.645700 MIRROR_RESYNC 7 mirrors 000713 1789187077.005837 write 0x00aac4 thru 0x00f70b (0x4c48 bytes) 000714 1789187077.044157 punch from 0x016d47 to 0x024ec2 (0xe17c bytes) 000715 1789187077.049763 fallocate 0x017eb0 thru 0x01bced (0x3e3e bytes) 000717 1789187077.054030 trunc from 0x040000 to 0x0117c2 (0x2e83d bytes) 000718 1789187077.072174 write 0x004e7d thru 0x0120ec (0xd270 bytes) 000719 1789187077.079021 read 0x00ce88 thru 0x00d2c8 (0x441 bytes) 000720 1789187077.080410 punch from 0x001e2f to 0x00711f (0x52f1 bytes) 000722 1789187077.098774 mapread 0x004a12 thru 0x008758 (0x3d47 bytes) 000723 1789187077.120556 mapread 0x010af8 thru 0x0120ec (0x15f5 bytes) 000724 1789187077.121487 write 0x00c323 thru 0x00c4c4 (0x1a2 bytes) 000725 1789187077.122890 fallocate 0x025e06 thru 0x029593 (0x378e bytes) 000726 1789187077.129739 mapwrite 0x001b04 thru 0x00c177 (0xa674 bytes) 000727 1789187077.149298 mapread 0x00aac0 thru 0x00b2f7 (0x838 bytes) 000728 1789187077.150225 trunc from 0x00df6c to 0x013723 (0x57b8 bytes) 000729 1789187077.157028 trunc from 0x01727e to 0x018d0d (0x1a90 bytes) 000730 1789187077.161587 punch from 0x011edc to 0x01623c (0x4361 bytes) 000731 1789187077.165863 trunc from 0x029594 to 0x0126df (0x16eb4 bytes) 000732 1789187077.181789 mapwrite 0x00fb7b thru 0x012380 (0x2806 bytes) 000733 1789187077.207642 mapread 0x001f12 thru 0x005263 (0x3352 bytes) 000734 1789187077.213342 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x126e0): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x126e0): Mirror 8: 0x4d447bd (stale) Mirror 10: 0x4d447bd (stale) Mirror 11: 0x4d447bd (stale) Mirror 12: 0x4d447bd (stale) Mirror 13: 0x4d447bd (stale) Mirror 14: 0x4d447bd (stale) CRC-32 checksum value for chunk [0, 0x126e0): Mirror 1: 0x54dd3f2d Mirror 15: 0x54dd3f2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x126e0: skipped 000735 1789187077.877114 trunc from 0x01259f to 0x0126df (0x141 bytes) 000736 1789187077.912122 write 0x01a20c thru 0x0228e0 (0x86d5 bytes) 000737 1789187077.920754 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x228e1): Mirror 10: 0xbb4ef22f (stale) Mirror 11: 0xbb4ef22f (stale) Mirror 12: 0xbb4ef22f (stale) Mirror 13: 0xbb4ef22f (stale) Mirror 14: 0xbb4ef22f (stale) Mirror 15: 0x1eb4fe64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x228e1): Mirror 10: 0xbb4ef22f (stale) Mirror 11: 0xbb4ef22f (stale) Mirror 12: 0xbb4ef22f (stale) Mirror 13: 0xbb4ef22f (stale) Mirror 14: 0xbb4ef22f (stale) Mirror 15: 0x1eb4fe64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x228e1: skipped 000738 1789187078.394619 fallocate 0x0285e8 thru 0x034be9 (0xc602 bytes) 000739 1789187078.404381 trunc from 0x0228e1 to 0x023c25 (0x1345 bytes) 000740 1789187078.474331 trunc from 0x023c26 to 0x03f1f7 (0x1b5d2 bytes) 000741 1789187078.501579 MIRROR_RESYNC 7 mirrors 000742 1789187079.900269 fallocate 0x0124b0 thru 0x01a4f8 (0x8049 bytes) 000743 1789187079.924539 trunc from 0x03f1f8 to 0x0362fe (0x8ef9 bytes) 000744 1789187079.938034 trunc from 0x0038a4 to 0x009c81 (0x63de bytes) 000745 1789187079.941679 trunc from 0x01b904 to 0x02106d (0x576a bytes) 000746 1789187079.945676 mapwrite 0x00950d thru 0x00a287 (0xd7b bytes) 000747 1789187079.981094 trunc from 0x0362ff to 0x0189e5 (0x1d919 bytes) 000748 1789187079.997076 mapwrite 0x0207e9 thru 0x021d3a (0x1552 bytes) 000749 1789187080.043114 mapread 0x0214d3 thru 0x021d3a (0x868 bytes) 000750 1789187080.043972 write 0x036903 thru 0x03ffff (0x96fd bytes) 000752 1789187080.045800 mapread 0x013f9d thru 0x0229e1 (0xea45 bytes) 000753 1789187080.058765 write 0x0269f2 thru 0x026f8f (0x59e bytes) 000754 1789187080.062908 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x994a4a92 (stale) Mirror 12: 0x994a4a92 (stale) Mirror 13: 0x994a4a92 (stale) Mirror 14: 0x994a4a92 (stale) Mirror 15: 0x994a4a92 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x994a4a92 (stale) Mirror 12: 0x994a4a92 (stale) Mirror 13: 0x994a4a92 (stale) Mirror 14: 0x994a4a92 (stale) Mirror 15: 0x994a4a92 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000755 1789187080.426754 write 0x022dd3 thru 0x02be29 (0x9057 bytes) 000756 1789187080.437254 trunc from 0x0359dd to 0x03ffff (0xa623 bytes) 000757 1789187080.440778 trunc from 0x00b367 to 0x015137 (0x9dd1 bytes) 000758 1789187080.444059 mapwrite 0x02a96a thru 0x036709 (0xbda0 bytes) 000759 1789187080.476484 trunc from 0x03082f to 0x033e66 (0x3638 bytes) 000760 1789187080.484150 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x994a4a92 (stale) Mirror 12: 0x994a4a92 (stale) Mirror 13: 0x994a4a92 (stale) Mirror 14: 0x994a4a92 (stale) Mirror 15: 0x994a4a92 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x79919c4d Mirror 16: 0x79919c4d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000762 1789187081.244515 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x994a4a92 (stale) Mirror 12: 0x994a4a92 (stale) Mirror 13: 0x994a4a92 (stale) Mirror 15: 0x994a4a92 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x994a4a92 (stale) Mirror 12: 0x994a4a92 (stale) Mirror 13: 0x994a4a92 (stale) Mirror 15: 0x994a4a92 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x79919c4d Mirror 16: 0x79919c4d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000763 1789187081.697411 mapwrite 0x037263 thru 0x03ffff (0x8d9d bytes) 000764 1789187081.798276 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x994a4a92 (stale) Mirror 12: 0x994a4a92 (stale) Mirror 13: 0x994a4a92 (stale) Mirror 15: 0x994a4a92 (stale) Mirror 16: 0x79919c4d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7c56bc08 Mirror 17: 0x7c56bc08 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000765 1789187082.707209 mapwrite 0x00f066 thru 0x013844 (0x47df bytes) 000766 1789187082.806963 mapread 0x016340 thru 0x01ba8c (0x574d bytes) 000767 1789187082.818282 mapread 0x02d42b thru 0x02ed1a (0x18f0 bytes) 000768 1789187082.830147 trunc from 0x00c4b2 to 0x017ef3 (0xba42 bytes) 000769 1789187082.834526 write 0x014213 thru 0x01a33b (0x6129 bytes) 000770 1789187082.850283 fallocate 0x030264 thru 0x03404d (0x3dea bytes) 000771 1789187082.857361 mapwrite 0x007aa2 thru 0x009c75 (0x21d4 bytes) 000772 1789187082.893066 trunc from 0x040000 to 0x026565 (0x19a9a bytes) 000773 1789187082.919396 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x26566): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26566): Mirror 10: 0x7f3169ba (stale) Mirror 12: 0x7f3169ba (stale) Mirror 13: 0x7f3169ba (stale) Mirror 15: 0x7f3169ba (stale) Mirror 16: 0x5f1a47eb (stale) Mirror 17: 0x5f1a47eb (stale) CRC-32 checksum value for chunk [0, 0x26566): Mirror 1: 0x52bc1c62 Mirror 18: 0x52bc1c62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26566: skipped 000774 1789187083.843084 trunc from 0x026566 to 0x027f98 (0x1a33 bytes) 000775 1789187083.919925 mapwrite 0x007b81 thru 0x013195 (0xb615 bytes) 000776 1789187083.971394 mapwrite 0x021534 thru 0x0239cb (0x2498 bytes) 000777 1789187083.995497 write 0x03a380 thru 0x03ffff (0x5c80 bytes) 000778 1789187083.996811 punch from 0x03d0e4 to 0x03ffff (0x2f1c bytes) 000779 1789187084.009263 read 0x00b678 thru 0x00f3ac (0x3d35 bytes) 000780 1789187084.012874 MIRROR_RESYNC 8 mirrors 000781 1789187086.013226 mapread 0x00764f thru 0x00a75f (0x3111 bytes) 000782 1789187086.031059 mapread 0x03e2ec thru 0x03ffff (0x1d14 bytes) 000783 1789187086.036367 punch from 0x037948 to 0x037e6e (0x527 bytes) 000784 1789187086.058352 fallocate 0x01a0c1 thru 0x027a13 (0xd953 bytes) 000785 1789187086.075496 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x723ce4ae (stale) Mirror 12: 0x723ce4ae (stale) Mirror 13: 0x723ce4ae (stale) Mirror 15: 0x723ce4ae (stale) Mirror 16: 0x723ce4ae (stale) Mirror 17: 0x723ce4ae (stale) Mirror 18: 0x723ce4ae (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x723ce4ae Mirror 19: 0x723ce4ae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000786 1789187086.748385 write 0x004900 thru 0x00ee1d (0xa51e bytes) 000788 1789187086.786979 fallocate 0x00a89b thru 0x013e46 (0x95ac bytes) 000789 1789187086.790360 fallocate 0x029d8a thru 0x02a464 (0x6db bytes) 000790 1789187086.796106 punch from 0x02c2c8 to 0x03753c (0xb275 bytes) 000791 1789187086.799185 trunc from 0x040000 to 0x013aa1 (0x2c55e bytes) 000792 1789187086.816064 mapread 0x00e76d thru 0x013aa1 (0x5335 bytes) 000793 1789187086.838574 punch from 0x00e3da to 0x010e4d (0x2a74 bytes) 000794 1789187086.863735 mapwrite 0x021676 thru 0x021f79 (0x904 bytes) 000795 1789187086.889795 punch from 0x0169e8 to 0x01a1b1 (0x37ca bytes) 000796 1789187086.893536 write 0x028ef5 thru 0x036b80 (0xdc8c bytes) 000797 1789187086.895155 mapwrite 0x00f509 thru 0x012c79 (0x3771 bytes) 000798 1789187086.933058 fallocate 0x0375a9 thru 0x03ffff (0x8a57 bytes) 000799 1789187086.939675 mapread 0x005b38 thru 0x0065e8 (0xab1 bytes) 000800 1789187086.941712 trunc from 0x021808 to 0x02b327 (0x9b20 bytes) 000801 1789187086.947476 trunc from 0x031748 to 0x036b80 (0x5439 bytes) 000802 1789187086.953688 mapread 0x00df9e thru 0x010508 (0x256b bytes) 000803 1789187086.961933 MIRROR_RESYNC 9 mirrors 000804 1789187088.980071 mapwrite 0x0345cc thru 0x035022 (0xa57 bytes) 000805 1789187089.075062 mapwrite 0x0389cf thru 0x03ffff (0x7631 bytes) 000806 1789187089.128414 mapread 0x02735d thru 0x0363f1 (0xf095 bytes) 000807 1789187089.135626 mapwrite 0x01accb thru 0x01c8a4 (0x1bda bytes) 000808 1789187089.155565 trunc from 0x040000 to 0x001436 (0x3ebc9 bytes) 000809 1789187089.175462 write 0x02fc98 thru 0x038d79 (0x90e2 bytes) 000810 1789187089.176915 fallocate 0x004cbf thru 0x005b87 (0xec9 bytes) 000811 1789187089.181991 punch from 0x036586 to 0x038d79 (0x27f4 bytes) 000812 1789187089.194697 mapread 0x02926a thru 0x0292d8 (0x6f bytes) 000813 1789187089.201801 fallocate 0x012668 thru 0x014df2 (0x278b bytes) 000814 1789187089.206021 trunc from 0x038d7a to 0x02da1c (0xb35d bytes) 000815 1789187089.221096 mapread 0x018cf5 thru 0x01a5b6 (0x18c2 bytes) 000816 1789187089.228550 punch from 0x02228c to 0x02cc7f (0xa9f4 bytes) 000817 1789187089.232057 trunc from 0x02da1d to 0x00436b (0x296b1 bytes) 000818 1789187089.250360 mapwrite 0x00cd14 thru 0x01cc6e (0xff5b bytes) 000819 1789187089.311348 mapread 0x012dbc thru 0x017f95 (0x51da bytes) 000820 1789187089.312262 punch from 0x00c27e to 0x013608 (0x738b bytes) 000821 1789187089.316723 punch from 0x00779a to 0x013b07 (0xc36e bytes) 000822 1789187089.322318 mapread 0x003ca9 thru 0x009611 (0x5969 bytes) 000823 1789187089.332428 mapwrite 0x018f90 thru 0x025c7b (0xccec bytes) 000824 1789187089.367349 mapwrite 0x018496 thru 0x022212 (0x9d7d bytes) 000825 1789187089.387929 trunc from 0x025c7c to 0x00fcf7 (0x15f84 bytes) 000826 1789187089.406955 read 0x00709d thru 0x00fc2b (0x8b8f bytes) 000827 1789187089.407452 mapwrite 0x0051e2 thru 0x00889d (0x36bc bytes) 000828 1789187089.421110 mapread 0x00b256 thru 0x00fcf7 (0x4aa2 bytes) 000829 1789187089.422325 write 0x03c13e thru 0x03ffff (0x3ec2 bytes) 000830 1789187089.423437 mapwrite 0x01c97b thru 0x0213f6 (0x4a7c bytes) 000831 1789187089.442561 mapwrite 0x00a22b thru 0x00ffe4 (0x5dba bytes) 000832 1789187089.457397 fallocate 0x003bf4 thru 0x013bae (0xffbb bytes) 000833 1789187089.460778 trunc from 0x0077b7 to 0x007e60 (0x6aa bytes) 000834 1789187089.466347 mapwrite 0x03cd40 thru 0x03ffff (0x32c0 bytes) 000835 1789187089.484465 read 0x0059cd thru 0x00fd10 (0xa344 bytes) 000836 1789187089.493057 mapwrite 0x0211af thru 0x027002 (0x5e54 bytes) 000838 1789187089.509703 trunc from 0x040000 to 0x0332ba (0xcd45 bytes) 000839 1789187089.527635 punch from 0x022bf9 to 0x02386a (0xc72 bytes) 000840 1789187089.531951 trunc from 0x0332bb to 0x013a14 (0x1f8a6 bytes) 000841 1789187089.551341 mapwrite 0x03a19b thru 0x03ffff (0x5e65 bytes) 000842 1789187089.607086 mapread 0x030d9d thru 0x037169 (0x63cd bytes) 000843 1789187089.642792 fallocate 0x007b02 thru 0x012acc (0xafcb bytes) 000844 1789187089.651684 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xe0f9ed49 (stale) Mirror 12: 0xe0f9ed49 (stale) Mirror 13: 0xe0f9ed49 (stale) Mirror 15: 0xe0f9ed49 (stale) Mirror 16: 0xe0f9ed49 (stale) Mirror 17: 0xe0f9ed49 (stale) Mirror 18: 0xe0f9ed49 (stale) Mirror 19: 0xe0f9ed49 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3fd3768 Mirror 20: 0x3fd3768 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000845 1789187090.341979 fallocate 0x00ea4a thru 0x0188b9 (0x9e70 bytes) 000846 1789187090.386760 mapwrite 0x03380e thru 0x03ffff (0xc7f2 bytes) 000847 1789187090.432397 trunc from 0x01b031 to 0x01c864 (0x1834 bytes) 000848 1789187090.441983 write 0x00a2ca thru 0x010c9c (0x69d3 bytes) 000849 1789187090.460597 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xe0f9ed49 (stale) Mirror 12: 0xe0f9ed49 (stale) Mirror 13: 0xe0f9ed49 (stale) Mirror 15: 0xe0f9ed49 (stale) Mirror 16: 0xe0f9ed49 (stale) Mirror 18: 0xe0f9ed49 (stale) Mirror 19: 0xe0f9ed49 (stale) Mirror 20: 0x3fd3768 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xe0f9ed49 (stale) Mirror 12: 0xe0f9ed49 (stale) Mirror 13: 0xe0f9ed49 (stale) Mirror 15: 0xe0f9ed49 (stale) Mirror 16: 0xe0f9ed49 (stale) Mirror 18: 0xe0f9ed49 (stale) Mirror 19: 0xe0f9ed49 (stale) Mirror 20: 0x3fd3768 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000850 1789187090.804291 trunc from 0x040000 to 0x018cf3 (0x2730c bytes) 000851 1789187090.837112 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x18cf4): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18cf4): Mirror 10: 0x64c0d5fe (stale) Mirror 12: 0x64c0d5fe (stale) Mirror 13: 0x64c0d5fe (stale) Mirror 15: 0x64c0d5fe (stale) Mirror 16: 0x64c0d5fe (stale) Mirror 18: 0x64c0d5fe (stale) Mirror 19: 0x64c0d5fe (stale) Mirror 20: 0x190726d9 (stale) CRC-32 checksum value for chunk [0, 0x18cf4): Mirror 1: 0x84202950 Mirror 21: 0x84202950 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18cf4: skipped 000854 1789187091.815768 mapread 0x003cb9 thru 0x00ba32 (0x7d7a bytes) 000855 1789187091.870750 fallocate 0x03d2f4 thru 0x03ffff (0x2d0c bytes) 000856 1789187091.927673 read 0x014f19 thru 0x019962 (0x4a4a bytes) 000858 1789187091.937678 trunc from 0x012a28 to 0x01556a (0x2b43 bytes) 000859 1789187091.941886 read 0x010082 thru 0x0113fc (0x137b bytes) 000860 1789187091.956089 write 0x02f578 thru 0x031ab8 (0x2541 bytes) 000861 1789187091.965711 mapwrite 0x02e29b thru 0x038ce5 (0xaa4b bytes) 000862 1789187091.990221 trunc from 0x040000 to 0x02aba1 (0x1545e bytes) 000863 1789187092.013318 fallocate 0x02dd11 thru 0x036b7b (0x8e6b bytes) 000864 1789187092.022090 trunc from 0x00a931 to 0x014435 (0x9b05 bytes) 000865 1789187092.029742 read 0x01bed6 thru 0x01d722 (0x184d bytes) 000867 1789187092.032133 trunc from 0x019a65 to 0x01b319 (0x18b5 bytes) 000868 1789187092.037704 mapwrite 0x03a0c1 thru 0x03ffff (0x5f3f bytes) 000869 1789187092.080275 punch from 0x021112 to 0x02b3b7 (0xa2a6 bytes) 000870 1789187092.089001 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xe0f9ed49 (stale) Mirror 13: 0xe0f9ed49 (stale) Mirror 15: 0xe0f9ed49 (stale) Mirror 16: 0xe0f9ed49 (stale) Mirror 18: 0xe0f9ed49 (stale) Mirror 19: 0xe0f9ed49 (stale) Mirror 20: 0x3fd3768 (stale) Mirror 21: 0xaa35aa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xe0f9ed49 (stale) Mirror 13: 0xe0f9ed49 (stale) Mirror 15: 0xe0f9ed49 (stale) Mirror 16: 0xe0f9ed49 (stale) Mirror 18: 0xe0f9ed49 (stale) Mirror 19: 0xe0f9ed49 (stale) Mirror 20: 0x3fd3768 (stale) Mirror 21: 0xaa35aa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000871 1789187092.534548 punch from 0x00723a to 0x00b0f6 (0x3ebd bytes) 000872 1789187092.537995 write 0x003895 thru 0x0125fe (0xed6a bytes) 000873 1789187092.546207 mapwrite 0x001955 thru 0x00937e (0x7a2a bytes) 000874 1789187092.573803 mapwrite 0x03b6eb thru 0x03ffff (0x4915 bytes) 000875 1789187092.599701 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xe0f9ed49 (stale) Mirror 13: 0xe0f9ed49 (stale) Mirror 15: 0xe0f9ed49 (stale) Mirror 16: 0xe0f9ed49 (stale) Mirror 18: 0xe0f9ed49 (stale) Mirror 19: 0xe0f9ed49 (stale) Mirror 20: 0x3fd3768 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xe0f9ed49 (stale) Mirror 13: 0xe0f9ed49 (stale) Mirror 15: 0xe0f9ed49 (stale) Mirror 16: 0xe0f9ed49 (stale) Mirror 18: 0xe0f9ed49 (stale) Mirror 19: 0xe0f9ed49 (stale) Mirror 20: 0x3fd3768 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000876 1789187092.930421 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xe0f9ed49 (stale) Mirror 13: 0xe0f9ed49 (stale) Mirror 15: 0xe0f9ed49 (stale) Mirror 16: 0xe0f9ed49 (stale) Mirror 18: 0xe0f9ed49 (stale) Mirror 19: 0xe0f9ed49 (stale) Mirror 20: 0x3fd3768 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9eb32a48 Mirror 21: 0x9eb32a48 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000877 1789187093.755717 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xe0f9ed49 (stale) Mirror 13: 0xe0f9ed49 (stale) Mirror 15: 0xe0f9ed49 (stale) Mirror 16: 0xe0f9ed49 (stale) Mirror 18: 0xe0f9ed49 (stale) Mirror 19: 0xe0f9ed49 (stale) Mirror 20: 0x3fd3768 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9eb32a48 Mirror 21: 0x9eb32a48 Mirror 22: 0x9eb32a48 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000880 1789187094.660121 fallocate 0x01b55a thru 0x02a3ce (0xee75 bytes) 000881 1789187094.710464 fallocate 0x01fdf0 thru 0x02d006 (0xd217 bytes) 000882 1789187094.715975 mapread 0x02990f thru 0x02bd4b (0x243d bytes) 000883 1789187094.736700 fallocate 0x0067bd thru 0x007f5b (0x179f bytes) 000884 1789187094.741701 read 0x0191c8 thru 0x0233bf (0xa1f8 bytes) 000885 1789187094.749018 write 0x03feb8 thru 0x03ffff (0x148 bytes) 000886 1789187094.758008 fallocate 0x02570a thru 0x027be8 (0x24df bytes) 000887 1789187094.770873 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xe0f9ed49 (stale) Mirror 13: 0xe0f9ed49 (stale) Mirror 15: 0xe0f9ed49 (stale) Mirror 16: 0xe0f9ed49 (stale) Mirror 18: 0xe0f9ed49 (stale) Mirror 19: 0xe0f9ed49 (stale) Mirror 20: 0x3fd3768 (stale) Mirror 21: 0x9eb32a48 (stale) Mirror 22: 0x9eb32a48 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xedda30b0 Mirror 23: 0xedda30b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000888 1789187095.616174 punch from 0x02ca54 to 0x03ca03 (0xffb0 bytes) 000889 1789187095.667363 mapread 0x0123d1 thru 0x01af3d (0x8b6d bytes) 000892 1789187095.689437 fallocate 0x01a56b thru 0x01f76b (0x5201 bytes) 000893 1789187095.694431 punch from 0x0077b8 to 0x00a33a (0x2b83 bytes) 000894 1789187095.699161 trunc from 0x00c205 to 0x012f32 (0x6d2e bytes) 000895 1789187095.703872 trunc from 0x02f4de to 0x03cd7b (0xd89e bytes) 000896 1789187095.708752 fallocate 0x0170b7 thru 0x01b1e5 (0x412f bytes) 000897 1789187095.713208 read 0x00c71f thru 0x016517 (0x9df9 bytes) 000898 1789187095.723369 write 0x022a7c thru 0x023f69 (0x14ee bytes) 000899 1789187095.737881 punch from 0x021011 to 0x02f606 (0xe5f6 bytes) 000900 1789187095.747465 mapwrite 0x03f768 thru 0x03ffff (0x898 bytes) 000901 1789187095.773400 fallocate 0x028f10 thru 0x0353a3 (0xc494 bytes) 000902 1789187095.777913 punch from 0x030650 to 0x03d27f (0xcc30 bytes) 000903 1789187095.782458 fallocate 0x039e69 thru 0x03bc31 (0x1dc9 bytes) 000904 1789187095.787910 trunc from 0x023a90 to 0x028856 (0x4dc7 bytes) 000905 1789187095.793096 mapread 0x003be3 thru 0x013b04 (0xff22 bytes) 000910 1789187095.809632 mapwrite 0x00d621 thru 0x01907f (0xba5f bytes) 000911 1789187095.831539 mapread 0x03e2c0 thru 0x03ffff (0x1d40 bytes) 000912 1789187095.832518 trunc from 0x040000 to 0x02a3f6 (0x15c09 bytes) 000913 1789187095.850303 read 0x00c13c thru 0x015883 (0x9748 bytes) 000914 1789187095.850973 mapread 0x017c9c thru 0x021b92 (0x9ef7 bytes) 000915 1789187095.863024 fallocate 0x03fe82 thru 0x03ffff (0x17e bytes) 000916 1789187095.867589 mapwrite 0x00c059 thru 0x00dc9b (0x1c43 bytes) 000917 1789187095.879192 punch from 0x001738 to 0x00e9de (0xd2a7 bytes) 000918 1789187095.886157 mapread 0x01ac68 thru 0x021079 (0x6412 bytes) 000919 1789187095.887199 trunc from 0x040000 to 0x02a1e7 (0x15e18 bytes) 000920 1789187095.918876 trunc from 0x0047cb to 0x00a22c (0x5a62 bytes) 000921 1789187095.930625 fallocate 0x003b7a thru 0x011b5b (0xdfe2 bytes) 000922 1789187095.940723 trunc from 0x008313 to 0x00b127 (0x2e15 bytes) 000923 1789187095.949445 trunc from 0x012dd4 to 0x0163f3 (0x3620 bytes) 000924 1789187095.955348 read 0x019952 thru 0x01ebf2 (0x52a1 bytes) 000925 1789187095.956198 trunc from 0x02a1e8 to 0x03e962 (0x1477b bytes) 000926 1789187095.973690 read 0x0158c2 thru 0x019c39 (0x4378 bytes) 000928 1789187095.989984 fallocate 0x02ed42 thru 0x0365e9 (0x78a8 bytes) 000929 1789187095.994647 read 0x025b2c thru 0x02622b (0x700 bytes) 000930 1789187095.995729 write 0x035afa thru 0x03d30e (0x7815 bytes) 000931 1789187095.997703 read 0x014d1d thru 0x0229d4 (0xdcb8 bytes) 000932 1789187095.998339 fallocate 0x0238df thru 0x029779 (0x5e9b bytes) 000933 1789187096.002995 fallocate 0x01bb46 thru 0x01c4f5 (0x9b0 bytes) 000934 1789187096.010745 MIRROR_RESYNC 11 mirrors 000935 1789187098.460722 fallocate 0x00787d thru 0x014d06 (0xd48a bytes) 000936 1789187098.492973 read 0x024c7e thru 0x02993f (0x4cc2 bytes) 000937 1789187098.500500 write 0x00f38d thru 0x01a71f (0xb393 bytes) 000938 1789187098.510267 trunc from 0x03e963 to 0x026c52 (0x17d10 bytes) 000939 1789187098.530333 MIRROR_RESYNC 11 mirrors 000940 1789187100.119026 punch from 0x00fda6 to 0x01f742 (0xf99d bytes) 000941 1789187100.159655 trunc from 0x026c53 to 0x028117 (0x14c5 bytes) 000942 1789187100.187546 mapwrite 0x005b79 thru 0x006846 (0xcce bytes) 000943 1789187100.209911 mapread 0x007aab thru 0x00825b (0x7b1 bytes) 000944 1789187100.221087 fallocate 0x02c80c thru 0x036f77 (0xa76c bytes) 000945 1789187100.227848 mapread 0x010259 thru 0x018a26 (0x87ce bytes) 000946 1789187100.241942 MIRROR_RESYNC 11 mirrors 000948 1789187102.152894 mapwrite 0x00e0b5 thru 0x013b06 (0x5a52 bytes) 000949 1789187102.225576 fallocate 0x0042cc thru 0x005c72 (0x19a7 bytes) 000950 1789187102.229196 trunc from 0x036f78 to 0x00e4c4 (0x28ab3 bytes) 000951 1789187102.248970 mapwrite 0x01ca8b thru 0x026a03 (0x9f79 bytes) 000952 1789187102.284991 mapwrite 0x033e8a thru 0x03afc1 (0x7138 bytes) 000953 1789187102.339523 mapread 0x03a1ba thru 0x03afc1 (0xe08 bytes) 000954 1789187102.345371 MIRROR_RESYNC 11 mirrors 000955 1789187105.059179 mapread 0x00fe3c thru 0x016b25 (0x6cea bytes) 000956 1789187105.110622 trunc from 0x03afc2 to 0x033393 (0x7c2e bytes) 000957 1789187105.161876 MIRROR_RESYNC 11 mirrors 000958 1789187108.042490 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) 000959 1789187108.357528 mapwrite 0x02cb91 thru 0x03c869 (0xfcd9 bytes) 000961 1789187108.444848 mapread 0x02f04b thru 0x03c869 (0xd81f bytes) 000962 1789187108.446390 trunc from 0x02c99f to 0x02f31c (0x297e bytes) 000963 1789187108.450916 read 0x00d9b1 thru 0x0142e0 (0x6930 bytes) 000964 1789187108.458658 trunc from 0x0021ac to 0x00c9c8 (0xa81d bytes) 000965 1789187108.462564 trunc from 0x00e952 to 0x01426c (0x591b bytes) 000966 1789187108.466537 mapwrite 0x01f0e0 thru 0x02ce34 (0xdd55 bytes) 000967 1789187108.511884 mapwrite 0x03b53b thru 0x03f6cc (0x4192 bytes) 000968 1789187108.542587 fallocate 0x038977 thru 0x03f785 (0x6e0f bytes) 000969 1789187108.546649 mapread 0x01eff0 thru 0x02c702 (0xd713 bytes) 000970 1789187108.550644 MIRROR_RESYNC 10 mirrors 000971 1789187110.906951 mapwrite 0x01cf9e thru 0x01f5aa (0x260d bytes) 000972 1789187111.063386 trunc from 0x03f6cd to 0x0211e0 (0x1e4ec bytes) 000973 1789187111.110503 MIRROR_RESYNC 10 mirrors 000974 1789187112.901562 trunc from 0x0211e1 to 0x03d719 (0x1c539 bytes) 000975 1789187112.948102 trunc from 0x03d71a to 0x026931 (0x16de8 bytes) 000976 1789187112.967665 trunc from 0x0136aa to 0x018f17 (0x586e bytes) 000977 1789187112.975132 fallocate 0x015e43 thru 0x01d0e7 (0x72a5 bytes) 000978 1789187112.991952 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x26932): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26932): Mirror 12: 0xf9441fec (stale) Mirror 13: 0xf9441fec (stale) Mirror 15: 0xf9441fec (stale) Mirror 16: 0xf9441fec (stale) Mirror 18: 0xf9441fec (stale) Mirror 19: 0xf9441fec (stale) Mirror 21: 0xf9441fec (stale) Mirror 22: 0xf9441fec (stale) Mirror 23: 0xf9441fec (stale) CRC-32 checksum value for chunk [0, 0x26932): Mirror 1: 0xf9441fec Mirror 24: 0xf9441fec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26932: skipped 000979 1789187114.010727 read 0x02068b thru 0x026931 (0x62a7 bytes) 000981 1789187114.044567 punch from 0x01f4f3 to 0x026931 (0x743f bytes) 000982 1789187114.083152 fallocate 0x0065ac thru 0x00ea84 (0x84d9 bytes) 000983 1789187114.087340 mapwrite 0x0009bf thru 0x00fc5b (0xf29d bytes) 000984 1789187114.132766 trunc from 0x026932 to 0x00a215 (0x1c71c bytes) 000985 1789187114.168492 MIRROR_RESYNC 11 mirrors 000986 1789187115.265223 mapwrite 0x03ff8f thru 0x03ffff (0x71 bytes) 000987 1789187115.309007 fallocate 0x027054 thru 0x035b4c (0xeaf9 bytes) 000988 1789187115.316085 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x213:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x78c4b385 (stale) Mirror 13: 0x78c4b385 (stale) Mirror 15: 0x78c4b385 (stale) Mirror 16: 0x78c4b385 (stale) Mirror 18: 0x78c4b385 (stale) Mirror 19: 0x78c4b385 (stale) Mirror 21: 0x78c4b385 (stale) Mirror 22: 0x78c4b385 (stale) Mirror 24: 0x78c4b385 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x78c4b385 (stale) Mirror 13: 0x78c4b385 (stale) Mirror 15: 0x78c4b385 (stale) Mirror 16: 0x78c4b385 (stale) Mirror 18: 0x78c4b385 (stale) Mirror 19: 0x78c4b385 (stale) Mirror 21: 0x78c4b385 (stale) Mirror 22: 0x78c4b385 (stale) Mirror 24: 0x78c4b385 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000989 1789187115.774450 mapwrite 0x033d83 thru 0x03ffff (0xc27d bytes) 000990 1789187115.851437 trunc from 0x025710 to 0x026a17 (0x1308 bytes) 000991 1789187115.858091 trunc from 0x0293b9 to 0x033d19 (0xa961 bytes) 000992 1789187115.864183 trunc from 0x005d4b to 0x007e63 (0x2119 bytes) 000993 1789187115.868711 mapread 0x03ec0a thru 0x03ffff (0x13f6 bytes) 000994 1789187115.869640 read 0x011981 thru 0x018c66 (0x72e6 bytes) 000995 1789187115.879293 punch from 0x011de5 to 0x0200f1 (0xe30d bytes) 000996 1789187115.883954 mapwrite 0x02a02e thru 0x03725f (0xd232 bytes) 000997 1789187115.930086 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x78c4b385 (stale) Mirror 13: 0x78c4b385 (stale) Mirror 15: 0x78c4b385 (stale) Mirror 16: 0x78c4b385 (stale) Mirror 18: 0x78c4b385 (stale) Mirror 19: 0x78c4b385 (stale) Mirror 21: 0x78c4b385 (stale) Mirror 22: 0x78c4b385 (stale) Mirror 24: 0x78c4b385 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa8687139 Mirror 25: 0xa8687139 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000998 1789187116.930661 trunc from 0x02366e to 0x025636 (0x1fc9 bytes) 000999 1789187117.028180 trunc from 0x040000 to 0x004148 (0x3beb7 bytes) 001000 1789187117.066307 trunc from 0x0038c1 to 0x004148 (0x888 bytes) All operations completed A-OK!