== sanity-flr test 70a: flr mode fsx test ================ 10:22:21 (1783952541) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 2543 skipping zero size read skipping zero size read 000003 1783952543.196544 write 0x02bf4d thru 0x0309a8 (0x4a5c bytes) 000004 1783952543.199579 mapread 0x0150f7 thru 0x01c8b3 (0x77bd bytes) fallocating to largest ever: 0x21902 000005 1783952543.231611 fallocate 0x01ddea thru 0x021901 (0x3b18 bytes) 000006 1783952543.238532 mapread 0x015b3f thru 0x0251fd (0xf6bf bytes) 000008 1783952543.252662 mapread 0x007a8e thru 0x00affe (0x3571 bytes) 000010 1783952543.265047 mapwrite 0x0115a6 thru 0x01a3c9 (0x8e24 bytes) 000012 1783952543.315357 mapwrite 0x00ad6c thru 0x0176c1 (0xc956 bytes) fallocating to largest ever: 0x389d1 000013 1783952543.375873 fallocate 0x0383af thru 0x0389d0 (0x622 bytes) 000015 1783952543.410448 read 0x016533 thru 0x01846f (0x1f3d bytes) 000016 1783952543.413872 write 0x025992 thru 0x028b85 (0x31f4 bytes) 000017 1783952543.415212 read 0x0277cb thru 0x029b2e (0x2364 bytes) 000018 1783952543.436480 punch from 0x025fe5 to 0x02bfc1 (0x5fdd bytes) 000019 1783952543.467074 trunc from 0x01d954 to 0x02250d (0x4bba bytes) 000020 1783952543.474882 trunc from 0x0389d1 to 0x00cf37 (0x2ba99 bytes) 000021 1783952543.511256 punch from 0x006dc8 to 0x009948 (0x2b81 bytes) 000022 1783952543.522113 fallocate 0x016a20 thru 0x01cbf2 (0x61d3 bytes) 000023 1783952543.535054 write 0x031393 thru 0x03370f (0x237d bytes) 000024 1783952543.536209 trunc from 0x0318b7 to 0x03370f (0x1e59 bytes) 000025 1783952543.564690 mapwrite 0x011ab5 thru 0x01d6b2 (0xbbfe bytes) 000027 1783952543.683232 mapread 0x02d36e thru 0x03370f (0x63a2 bytes) 000028 1783952543.713477 punch from 0x02a797 to 0x03370f (0x8f79 bytes) 000029 1783952543.717980 mapwrite 0x0214ce thru 0x02cb1d (0xb650 bytes) 000030 1783952543.792452 punch from 0x03349b to 0x03370f (0x275 bytes) 000031 1783952543.803582 MIRROR_EXTEND to 2 mirrors 000032 1783952544.754305 punch from 0x017366 to 0x01ab4f (0x37ea bytes) 000033 1783952544.782699 mapwrite 0x028535 thru 0x02a892 (0x235e bytes) 000034 1783952544.811658 mapwrite 0x026cb6 thru 0x031dc1 (0xb10c bytes) 000035 1783952544.834575 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x33710): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33710): Mirror 2: 0x78f6ca84 (stale) CRC-32 checksum value for chunk [0, 0x33710): Mirror 1: 0x6ecc40c7 Mirror 3: 0x6ecc40c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33710: skipped 000037 1783952545.745542 read 0x029aea thru 0x02fc9a (0x61b1 bytes) 000038 1783952545.757214 mapwrite 0x0028f4 thru 0x011475 (0xeb82 bytes) 000039 1783952545.918757 read 0x00f1d6 thru 0x017d3b (0x8b66 bytes) 000040 1783952545.919704 mapwrite 0x025a31 thru 0x02b018 (0x55e8 bytes) 000041 1783952545.963875 write 0x025455 thru 0x02f1c9 (0x9d75 bytes) 000042 1783952545.973038 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33710): Mirror 3: 0x6ecc40c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33710): Mirror 3: 0x6ecc40c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33710: skipped 000043 1783952546.374073 mapread 0x02e1c1 thru 0x03370f (0x554f bytes) 000044 1783952546.406819 mapwrite 0x03a206 thru 0x03f18e (0x4f89 bytes) 000045 1783952546.458124 trunc from 0x03f18f to 0x01dc87 (0x21507 bytes) 000046 1783952546.476691 read 0x012e88 thru 0x018751 (0x58ca bytes) 000047 1783952546.487884 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1dc88): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1dc88): Mirror 3: 0xe27af92f (stale) CRC-32 checksum value for chunk [0, 0x1dc88): Mirror 1: 0x74166caa Mirror 4: 0x74166caa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1dc88: skipped 000048 1783952547.374785 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1dc88): Mirror 3: 0xe27af92f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1dc88): Mirror 3: 0xe27af92f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1dc88: skipped 000050 1783952547.717916 MIRROR_RESYNC 2 mirrors 000051 1783952548.481192 read 0x0182b3 thru 0x01b4d3 (0x3221 bytes) 000052 1783952548.491156 MIRROR_RESYNC 2 mirrors 000053 1783952548.872872 trunc from 0x00ffcb to 0x010c79 (0xcaf bytes) truncating to largest ever: 0x38cbe 000054 1783952548.924688 trunc from 0x01dc88 to 0x038cbd (0x1b036 bytes) 000055 1783952548.954011 punch from 0x0252cd to 0x02b035 (0x5d69 bytes) 000056 1783952548.968858 punch from 0x0054b8 to 0x01372b (0xe274 bytes) 000057 1783952548.979663 trunc from 0x038cbe to 0x02ee1f (0x9e9e bytes) 000058 1783952548.998854 read 0x02c1e3 thru 0x02ee1f (0x2c3d bytes) 000059 1783952549.008318 trunc from 0x02ee20 to 0x0049a5 (0x2a47a bytes) 000060 1783952549.026109 punch from 0x0011d5 to 0x0049a5 (0x37d1 bytes) 000061 1783952549.038643 fallocate 0x00575c thru 0x010772 (0xb017 bytes) 000062 1783952549.045762 trunc from 0x0049a6 to 0x020b83 (0x1c1de bytes) 000063 1783952549.065787 read 0x018b66 thru 0x020b83 (0x801e bytes) 000064 1783952549.079885 punch from 0x007819 to 0x013c55 (0xc43d bytes) 000065 1783952549.086226 punch from 0x01ae97 to 0x020b83 (0x5ced bytes) 000066 1783952549.101588 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) 000067 1783952549.251839 read 0x01dd9d thru 0x020b83 (0x2de7 bytes) 000069 1783952549.260972 trunc from 0x020b84 to 0x011153 (0xfa30 bytes) 000070 1783952549.280281 trunc from 0x011154 to 0x0369b6 (0x25863 bytes) 000072 1783952549.295771 mapwrite 0x010209 thru 0x014ad8 (0x48d0 bytes) 000073 1783952549.335924 read 0x030e9a thru 0x0369b6 (0x5b1d bytes) 000075 1783952549.347697 fallocate 0x02458a thru 0x02cd8c (0x8803 bytes) 000076 1783952549.353771 mapread 0x01f005 thru 0x026521 (0x751d bytes) 000077 1783952549.355542 mapread 0x0066ab thru 0x00efbd (0x8913 bytes) 000079 1783952549.358714 trunc from 0x0369b7 to 0x00dd8b (0x28c2b bytes) 000080 1783952549.376663 punch from 0x001a37 to 0x004323 (0x28ed bytes) 000081 1783952549.381764 trunc from 0x00dd8c to 0x023402 (0x15677 bytes) 000082 1783952549.394816 mapread 0x019d7d thru 0x021089 (0x730d bytes) 000083 1783952549.434589 read 0x0195ed thru 0x01ce39 (0x384d bytes) 000084 1783952549.435512 trunc from 0x023403 to 0x0282c4 (0x4ec2 bytes) truncating to largest ever: 0x3dea8 000085 1783952549.453899 trunc from 0x0282c5 to 0x03dea7 (0x15be3 bytes) 000086 1783952549.464562 punch from 0x03d48d to 0x03dea7 (0xa1b bytes) 000087 1783952549.469520 trunc from 0x03dea8 to 0x02f67e (0xe829 bytes) 000088 1783952549.486572 trunc from 0x0137d5 to 0x0183b4 (0x4be0 bytes) 000089 1783952549.493195 trunc from 0x02340b to 0x02c500 (0x90f6 bytes) 000090 1783952549.497882 trunc from 0x02f67f to 0x00c59f (0x230df bytes) 000091 1783952549.515878 read 0x004250 thru 0x00c59f (0x8350 bytes) 000093 1783952549.524126 punch from 0x003efe to 0x005c0a (0x1d0d bytes) 000095 1783952549.535557 fallocate 0x01592a thru 0x01f25f (0x9936 bytes) 000096 1783952549.545793 read 0x003d49 thru 0x00c59f (0x8857 bytes) 000097 1783952549.551799 read 0x005988 thru 0x007b60 (0x21d9 bytes) 000098 1783952549.552649 fallocate 0x00b918 thru 0x017524 (0xbc0d bytes) 000099 1783952549.558163 read 0x004e35 thru 0x005e8d (0x1059 bytes) 000100 1783952549.558960 write 0x00af5c thru 0x0130a4 (0x8149 bytes) 000101 1783952549.565677 trunc from 0x00188e to 0x009f81 (0x86f4 bytes) 000102 1783952549.571778 trunc from 0x017525 to 0x03b5f5 (0x240d1 bytes) 000103 1783952549.589580 read 0x005cae thru 0x00cc34 (0x6f87 bytes) 000105 1783952549.606207 trunc from 0x026d9d to 0x035c9e (0xef02 bytes) 000106 1783952549.613300 mapread 0x0158c1 thru 0x01800e (0x274e bytes) 000107 1783952549.615594 mapread 0x02b638 thru 0x02de6b (0x2834 bytes) 000108 1783952549.635939 punch from 0x00aaa7 to 0x014b99 (0xa0f3 bytes) 000109 1783952549.658132 read 0x011200 thru 0x0117c4 (0x5c5 bytes) 000110 1783952549.671191 mapread 0x024826 thru 0x02cc12 (0x83ed bytes) 000111 1783952549.674216 trunc from 0x03b5f6 to 0x008dbe (0x32837 bytes) 000112 1783952549.703908 fallocate 0x009b22 thru 0x0138b4 (0x9d93 bytes) 000113 1783952549.711445 mapwrite 0x000dee thru 0x005d92 (0x4fa5 bytes) 000114 1783952549.743911 mapwrite 0x006313 thru 0x00d387 (0x7075 bytes) 000115 1783952549.807757 MIRROR_EXTEND to 2 mirrors fallocating to largest ever: 0x40000 000116 1783952550.500205 fallocate 0x039eb8 thru 0x03ffff (0x6148 bytes) 000117 1783952550.525698 write 0x031def thru 0x036de0 (0x4ff2 bytes) 000118 1783952550.536902 write 0x01a288 thru 0x020425 (0x619e bytes) 000119 1783952550.546386 fallocate 0x02b1c8 thru 0x03aa4f (0xf888 bytes) 000120 1783952550.550945 mapwrite 0x024a61 thru 0x02822b (0x37cb bytes) 000121 1783952550.584345 write 0x0032c9 thru 0x0117c0 (0xe4f8 bytes) 000122 1783952550.596470 fallocate 0x00b4af thru 0x010c1b (0x576d bytes) 000123 1783952550.617800 MIRROR_RESYNC 2 mirrors 000125 1783952551.509138 fallocate 0x02785b thru 0x03142c (0x9bd2 bytes) 000126 1783952551.597959 mapread 0x02447f thru 0x030a65 (0xc5e7 bytes) 000127 1783952551.640388 mapread 0x02e1fe thru 0x02f653 (0x1456 bytes) 000128 1783952551.644475 mapread 0x02f898 thru 0x036de0 (0x7549 bytes) 000129 1783952551.650958 trunc from 0x036de1 to 0x0205ad (0x16833 bytes) 000130 1783952551.687493 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x205ae): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x205ae): Mirror 2: 0x9e74302e (stale) CRC-32 checksum value for chunk [0, 0x205ae): Mirror 1: 0x9e74302e Mirror 3: 0x9e74302e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x205ae: skipped 000131 1783952552.739654 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x205ae): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x205ae): Mirror 2: 0x9e74302e (stale) CRC-32 checksum value for chunk [0, 0x205ae): Mirror 1: 0x9e74302e Mirror 3: 0x9e74302e Mirror 4: 0x9e74302e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x205ae: skipped 000132 1783952553.863076 fallocate 0x01442c thru 0x023e0b (0xf9e0 bytes) 000133 1783952553.938811 mapread 0x01697d thru 0x01e061 (0x76e5 bytes) 000134 1783952553.961598 mapread 0x013be0 thru 0x01ed82 (0xb1a3 bytes) 000136 1783952553.964581 trunc from 0x018216 to 0x01ec0f (0x69fa bytes) 000137 1783952553.974192 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x205ae): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x205ae): Mirror 2: 0x9e74302e (stale) Mirror 3: 0x9e74302e (stale) Mirror 4: 0x9e74302e (stale) CRC-32 checksum value for chunk [0, 0x205ae): Mirror 1: 0x8660f8c3 Mirror 5: 0x8660f8c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x205ae: skipped 000138 1783952555.032958 punch from 0x019272 to 0x0205ad (0x733c bytes) 000139 1783952555.074374 write 0x03de46 thru 0x03ffff (0x21ba bytes) 000140 1783952555.084830 mapread 0x034ce4 thru 0x03b735 (0x6a52 bytes) 000141 1783952555.105899 trunc from 0x0165fb to 0x0186e0 (0x20e6 bytes) 000142 1783952555.113236 mapwrite 0x026c64 thru 0x031f4e (0xb2eb bytes) 000143 1783952555.149198 trunc from 0x03a89a to 0x03ffff (0x5766 bytes) 000144 1783952555.156023 trunc from 0x040000 to 0x01590a (0x2a6f5 bytes) 000145 1783952555.181393 fallocate 0x02c2d9 thru 0x03b609 (0xf331 bytes) 000146 1783952555.194024 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3b60a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b60a): Mirror 2: 0xa76b1bfc (stale) Mirror 3: 0x44c80876 (stale) Mirror 4: 0x44c80876 (stale) Mirror 5: 0xe97704bd (stale) CRC-32 checksum value for chunk [0, 0x3b60a): Mirror 1: 0xdb8694de Mirror 6: 0xdb8694de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b60a: skipped 000147 1783952556.309725 fallocate 0x02801f thru 0x03487a (0xc85c bytes) 000148 1783952556.355853 trunc from 0x0256be to 0x033606 (0xdf49 bytes) 000149 1783952556.361754 fallocate 0x00d06c thru 0x012fd3 (0x5f68 bytes) 000150 1783952556.372883 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3b60a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b60a): Mirror 2: 0xa76b1bfc (stale) Mirror 3: 0x44c80876 (stale) Mirror 4: 0x44c80876 (stale) Mirror 5: 0xe97704bd (stale) Mirror 6: 0xdb8694de (stale) CRC-32 checksum value for chunk [0, 0x3b60a): Mirror 1: 0xdb8694de Mirror 7: 0xdb8694de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b60a: skipped 000151 1783952557.456921 read 0x025e44 thru 0x02e253 (0x8410 bytes) 000152 1783952557.473230 trunc from 0x008865 to 0x0112e6 (0x8a82 bytes) 000153 1783952557.517574 trunc from 0x017870 to 0x02709d (0xf82e bytes) 000154 1783952557.522827 mapwrite 0x002830 thru 0x00f912 (0xd0e3 bytes) 000155 1783952557.558726 trunc from 0x036275 to 0x036aea (0x876 bytes) 000156 1783952557.563877 mapread 0x03635e thru 0x037b9d (0x1840 bytes) 000158 1783952557.574875 trunc from 0x01b628 to 0x02340c (0x7de5 bytes) 000159 1783952557.579788 punch from 0x02238a to 0x024605 (0x227c bytes) 000160 1783952557.589108 MIRROR_RESYNC 7 mirrors 000161 1783952558.706550 read 0x019461 thru 0x01ce48 (0x39e8 bytes) 000162 1783952558.714336 punch from 0x017ee6 to 0x021d14 (0x9e2f bytes) 000163 1783952558.758884 fallocate 0x00983f thru 0x00b7f2 (0x1fb4 bytes) 000164 1783952558.767055 mapwrite 0x016bdd thru 0x023799 (0xcbbd bytes) 000165 1783952558.847216 trunc from 0x03b60a to 0x010866 (0x2ada3 bytes) 000166 1783952558.867706 trunc from 0x007e36 to 0x008a40 (0xc0b bytes) 000167 1783952558.874631 write 0x0169a5 thru 0x017ccf (0x132b bytes) 000169 1783952558.876866 mapwrite 0x002223 thru 0x00b9b5 (0x9793 bytes) 000170 1783952558.907305 write 0x03a182 thru 0x03ffff (0x5e7e bytes) 000171 1783952558.908999 fallocate 0x03ce1d thru 0x03ffff (0x31e3 bytes) 000172 1783952558.913717 mapwrite 0x03495d thru 0x03be9c (0x7540 bytes) 000173 1783952558.948515 read 0x02df28 thru 0x038e3a (0xaf13 bytes) 000174 1783952558.952958 fallocate 0x03b930 thru 0x03ffff (0x46d0 bytes) 000175 1783952558.962120 trunc from 0x02e5fe to 0x037e5f (0x9862 bytes) 000176 1783952558.974860 punch from 0x0185f3 to 0x0252fb (0xcd09 bytes) 000177 1783952558.980831 punch from 0x0005cb to 0x00071d (0x153 bytes) 000178 1783952558.985851 fallocate 0x00acdc thru 0x01851f (0xd844 bytes) 000179 1783952558.990885 trunc from 0x040000 to 0x0326b1 (0xd94e bytes) 000180 1783952559.007732 write 0x03e8ff thru 0x03ffff (0x1701 bytes) 000181 1783952559.009025 trunc from 0x02dc10 to 0x03d08c (0xf47d bytes) 000182 1783952559.023235 fallocate 0x03ebcb thru 0x03ffff (0x1435 bytes) 000183 1783952559.029999 punch from 0x011e5f to 0x01fd79 (0xdf1b bytes) 000184 1783952559.038653 trunc from 0x02e49f to 0x03a9c6 (0xc528 bytes) 000185 1783952559.050221 write 0x00f82b thru 0x014634 (0x4e0a bytes) 000186 1783952559.078767 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x148d727a (stale) Mirror 4: 0x148d727a (stale) Mirror 5: 0x148d727a (stale) Mirror 6: 0x148d727a (stale) Mirror 7: 0x148d727a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x148d727a (stale) Mirror 4: 0x148d727a (stale) Mirror 5: 0x148d727a (stale) Mirror 6: 0x148d727a (stale) Mirror 7: 0x148d727a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000187 1783952559.641626 punch from 0x037533 to 0x038df3 (0x18c1 bytes) 000188 1783952559.646797 read 0x03168d thru 0x032016 (0x98a bytes) 000189 1783952559.653132 trunc from 0x03d1b3 to 0x03ffff (0x2e4d bytes) 000190 1783952559.660818 read 0x00674e thru 0x009ae2 (0x3395 bytes) 000191 1783952559.674577 MIRROR_RESYNC 6 mirrors 000192 1783952560.813854 trunc from 0x040000 to 0x017e51 (0x281ae bytes) 000195 1783952560.851975 punch from 0x002317 to 0x00e255 (0xbf3f bytes) 000196 1783952560.861358 fallocate 0x02cdd0 thru 0x03832b (0xb55c bytes) 000197 1783952560.866735 fallocate 0x01dac8 thru 0x02ace5 (0xd21e bytes) 000199 1783952560.876046 fallocate 0x030fa8 thru 0x03afa4 (0x9ffd bytes) 000200 1783952560.888067 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3afa5): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afa5): Mirror 3: 0x19bdfbd4 (stale) Mirror 4: 0x19bdfbd4 (stale) Mirror 5: 0x19bdfbd4 (stale) Mirror 6: 0x19bdfbd4 (stale) Mirror 7: 0x19bdfbd4 (stale) CRC-32 checksum value for chunk [0, 0x3afa5): Mirror 1: 0x972f7a50 Mirror 8: 0x972f7a50 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afa5: skipped 000201 1783952561.959515 trunc from 0x011d9f to 0x021c08 (0xfe6a bytes) 000202 1783952561.993367 write 0x009227 thru 0x013c18 (0xa9f2 bytes) 000203 1783952562.015168 punch from 0x00e38c to 0x01606d (0x7ce2 bytes) 000205 1783952562.048545 trunc from 0x03afa5 to 0x008f10 (0x32094 bytes) 000206 1783952562.082910 mapwrite 0x029eb0 thru 0x035e03 (0xbf54 bytes) 000207 1783952562.171032 write 0x02b058 thru 0x03ae95 (0xfe3e bytes) 000208 1783952562.181374 mapwrite 0x035683 thru 0x03abe0 (0x555e bytes) 000209 1783952562.231605 mapread 0x007b95 thru 0x007e97 (0x303 bytes) 000210 1783952562.251408 MIRROR_RESYNC 7 mirrors 000211 1783952563.397311 write 0x026a0d thru 0x033ef5 (0xd4e9 bytes) 000212 1783952563.435629 trunc from 0x03ae96 to 0x0092dd (0x31bb8 bytes) 000213 1783952563.454575 read 0x009052 thru 0x0092dd (0x28c bytes) 000215 1783952563.461326 mapwrite 0x004273 thru 0x0129a4 (0xe732 bytes) 000219 1783952563.515662 mapwrite 0x03ae63 thru 0x03ffff (0x519d bytes) 000220 1783952563.553297 trunc from 0x040000 to 0x0034f5 (0x3cb0a bytes) 000222 1783952563.571684 fallocate 0x001efe thru 0x0098e3 (0x79e6 bytes) 000223 1783952563.581032 fallocate 0x002c15 thru 0x00693e (0x3d2a bytes) 000224 1783952563.585628 write 0x02c193 thru 0x0396c3 (0xd531 bytes) 000225 1783952563.591561 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x396c4): Mirror 3: 0xfbc3b45a (stale) Mirror 4: 0xfbc3b45a (stale) Mirror 5: 0xfbc3b45a (stale) Mirror 7: 0xfbc3b45a (stale) Mirror 8: 0xfbc3b45a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x396c4): Mirror 3: 0xfbc3b45a (stale) Mirror 4: 0xfbc3b45a (stale) Mirror 5: 0xfbc3b45a (stale) Mirror 7: 0xfbc3b45a (stale) Mirror 8: 0xfbc3b45a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x396c4: skipped 000226 1783952564.024266 read 0x02e422 thru 0x034226 (0x5e05 bytes) 000227 1783952564.036677 fallocate 0x00e9f3 thru 0x016918 (0x7f26 bytes) 000228 1783952564.041786 write 0x015a1e thru 0x023172 (0xd755 bytes) 000229 1783952564.055772 read 0x0083c6 thru 0x00d791 (0x53cc bytes) 000230 1783952564.067132 read 0x00ded1 thru 0x011fda (0x410a bytes) 000231 1783952564.073678 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x396c4): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x396c4): Mirror 3: 0xfbc3b45a (stale) Mirror 4: 0xfbc3b45a (stale) Mirror 5: 0xfbc3b45a (stale) Mirror 7: 0xfbc3b45a (stale) Mirror 8: 0xfbc3b45a (stale) CRC-32 checksum value for chunk [0, 0x396c4): Mirror 1: 0x7270dae Mirror 9: 0x7270dae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x396c4: skipped 000233 1783952565.041345 trunc from 0x0396c4 to 0x01a793 (0x1ef30 bytes) 000234 1783952565.129518 mapwrite 0x01dbe5 thru 0x0288ad (0xacc9 bytes) 000235 1783952565.232880 MIRROR_RESYNC 7 mirrors 000236 1783952566.803202 read 0x0006c0 thru 0x005527 (0x4e68 bytes) 000237 1783952566.832701 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) 000238 1783952567.310749 mapread 0x023e5f thru 0x0288ad (0x4a4f bytes) 000239 1783952567.328319 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) 000240 1783952567.854579 trunc from 0x0288ae to 0x001b00 (0x26dad bytes) 000241 1783952567.931986 punch from 0x00080c to 0x001b00 (0x12f5 bytes) 000242 1783952567.937471 mapread 0x001a1f thru 0x001b00 (0xe2 bytes) 000243 1783952567.944059 punch from 0x00152e to 0x001b00 (0x5d3 bytes) 000244 1783952567.949377 read 0x0019ef thru 0x001b00 (0x112 bytes) 000245 1783952567.955854 read 0x001536 thru 0x001b00 (0x5cb bytes) 000246 1783952567.959941 punch from 0x0019e9 to 0x001b00 (0x118 bytes) 000248 1783952567.971885 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b01): Mirror 3: 0x3af824b5 (stale) Mirror 5: 0x3af824b5 (stale) Mirror 9: 0x3af824b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b01): Mirror 3: 0x3af824b5 (stale) Mirror 5: 0x3af824b5 (stale) Mirror 9: 0x3af824b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b01: skipped 000249 1783952568.316049 write 0x00eb6d thru 0x01674a (0x7bde bytes) 000250 1783952568.322763 read 0x007c90 thru 0x01661b (0xe98c bytes) 000251 1783952568.334390 trunc from 0x00458c to 0x012962 (0xe3d7 bytes) 000252 1783952568.365351 mapread 0x0025a3 thru 0x00b3bb (0x8e19 bytes) 000253 1783952568.399692 trunc from 0x000ad0 to 0x00ad4d (0xa27e bytes) 000254 1783952568.411574 write 0x00e563 thru 0x010ded (0x288b bytes) 000256 1783952568.416276 fallocate 0x039d6b thru 0x03ffff (0x6295 bytes) 000257 1783952568.421536 mapread 0x00130e thru 0x00ed2b (0xda1e bytes) 000258 1783952568.437650 punch from 0x00f635 to 0x01674a (0x7116 bytes) 000259 1783952568.455047 read 0x00ab3f thru 0x0136f5 (0x8bb7 bytes) 000260 1783952568.473837 write 0x03ad0d thru 0x03ffff (0x52f3 bytes) 000261 1783952568.475198 fallocate 0x01539b thru 0x023c62 (0xe8c8 bytes) 000262 1783952568.481524 fallocate 0x025748 thru 0x032759 (0xd012 bytes) 000263 1783952568.489474 punch from 0x027feb to 0x02a292 (0x22a8 bytes) 000264 1783952568.495620 trunc from 0x01231d to 0x01b373 (0x9057 bytes) 000265 1783952568.502295 read 0x03732c thru 0x03ffff (0x8cd4 bytes) 000266 1783952568.529904 trunc from 0x01924f to 0x020dd5 (0x7b87 bytes) 000267 1783952568.542701 punch from 0x008571 to 0x012596 (0xa026 bytes) 000268 1783952568.549858 mapwrite 0x008708 thru 0x00f4f8 (0x6df1 bytes) 000269 1783952568.613478 write 0x014adc thru 0x022fd8 (0xe4fd bytes) 000270 1783952568.615175 read 0x02aa9e thru 0x03275a (0x7cbd bytes) 000271 1783952568.620679 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd4de354a (stale) Mirror 5: 0xd4de354a (stale) Mirror 9: 0xd4de354a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb866eb06 Mirror 10: 0xb866eb06 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000272 1783952569.552821 punch from 0x01c6ca to 0x02759e (0xaed5 bytes) 000273 1783952569.592711 trunc from 0x039dd9 to 0x03ffff (0x6227 bytes) 000274 1783952569.597368 trunc from 0x040000 to 0x01d9c8 (0x22637 bytes) 000275 1783952569.619822 fallocate 0x03cb46 thru 0x03ffff (0x34ba bytes) 000276 1783952569.626639 read 0x00c819 thru 0x018103 (0xb8eb bytes) 000277 1783952569.635375 trunc from 0x040000 to 0x02fea3 (0x1015c bytes) 000278 1783952569.651192 fallocate 0x009f3e thru 0x016195 (0xc258 bytes) 000279 1783952569.656944 mapread 0x007980 thru 0x0150a6 (0xd727 bytes) 000281 1783952569.675059 trunc from 0x0257a9 to 0x02fea3 (0xa6fb bytes) 000282 1783952569.679251 trunc from 0x01b81e to 0x024974 (0x9157 bytes) 000283 1783952569.684039 mapwrite 0x026c07 thru 0x02b35e (0x4758 bytes) 000284 1783952569.717869 read 0x00e7bf thru 0x0183c5 (0x9c07 bytes) 000285 1783952569.721074 mapwrite 0x029e27 thru 0x038574 (0xe74e bytes) 000286 1783952569.789466 fallocate 0x01631a thru 0x022fa6 (0xcc8d bytes) 000287 1783952569.795625 punch from 0x03088b to 0x038574 (0x7cea bytes) 000288 1783952569.804680 fallocate 0x004ee9 thru 0x00fca3 (0xadbb bytes) 000289 1783952569.813540 mapwrite 0x017134 thru 0x0194ca (0x2397 bytes) 000290 1783952569.833532 trunc from 0x00678b to 0x011b22 (0xb398 bytes) 000291 1783952569.838782 punch from 0x028588 to 0x02f682 (0x70fb bytes) 000293 1783952569.850167 mapread 0x02848b thru 0x02e0c3 (0x5c39 bytes) 000294 1783952569.883875 trunc from 0x02306a to 0x02aef7 (0x7e8e bytes) 000295 1783952569.892662 trunc from 0x038575 to 0x018059 (0x2051b bytes) 000296 1783952569.918381 read 0x00135f thru 0x00cf2b (0xbbcd bytes) 000297 1783952569.937217 read 0x005c95 thru 0x006dd9 (0x1145 bytes) 000298 1783952569.937953 write 0x009eb4 thru 0x00fa7a (0x5bc7 bytes) 000299 1783952569.939636 mapread 0x006487 thru 0x009d78 (0x38f2 bytes) 000300 1783952569.941388 trunc from 0x01805a to 0x00f8fc (0x875d bytes) 000303 1783952569.959527 punch from 0x00aae8 to 0x00c1b9 (0x16d2 bytes) 000304 1783952569.974019 fallocate 0x03161f thru 0x033c47 (0x2629 bytes) 000305 1783952569.978687 trunc from 0x012cb7 to 0x01cd6e (0xa0b8 bytes) 000307 1783952569.983390 read 0x021489 thru 0x02ee72 (0xd9ea bytes) 000308 1783952569.993074 mapwrite 0x022375 thru 0x026ab6 (0x4742 bytes) 000309 1783952570.015533 mapread 0x01c56b thru 0x0287f3 (0xc289 bytes) 000310 1783952570.020878 trunc from 0x00b3ab to 0x01469b (0x92f1 bytes) 000311 1783952570.028273 fallocate 0x03f56e thru 0x03ffff (0xa92 bytes) 000312 1783952570.036792 fallocate 0x02b0a4 thru 0x03900a (0xdf67 bytes) 000313 1783952570.049230 write 0x01ff88 thru 0x0203ee (0x467 bytes) 000314 1783952570.054075 mapread 0x00e815 thru 0x01032d (0x1b19 bytes) 000315 1783952570.117267 write 0x008569 thru 0x00da59 (0x54f1 bytes) 000316 1783952570.125478 mapwrite 0x03a616 thru 0x03ffff (0x59ea bytes) 000318 1783952570.185888 trunc from 0x040000 to 0x00209a (0x3df65 bytes) 000319 1783952570.239884 mapread 0x001ba7 thru 0x00209a (0x4f4 bytes) 000320 1783952570.245029 read 0x00182f thru 0x00209a (0x86c bytes) 000321 1783952570.246314 mapwrite 0x0152bd thru 0x022c36 (0xd97a bytes) 000322 1783952570.330057 trunc from 0x00afcb to 0x00f52c (0x4562 bytes) 000323 1783952570.340993 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x22c37): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22c37): Mirror 3: 0x167c28d4 (stale) Mirror 5: 0x167c28d4 (stale) Mirror 9: 0x167c28d4 (stale) Mirror 10: 0x6634bc97 (stale) CRC-32 checksum value for chunk [0, 0x22c37): Mirror 1: 0x3d7432a5 Mirror 11: 0x3d7432a5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22c37: skipped 000324 1783952571.295360 write 0x03c12a thru 0x03ffff (0x3ed6 bytes) 000325 1783952571.358011 MIRROR_RESYNC 6 mirrors 000326 1783952572.878294 trunc from 0x040000 to 0x024a52 (0x1b5ad bytes) 000327 1783952572.937515 trunc from 0x024a53 to 0x01cc76 (0x7ddc bytes) 000328 1783952572.960819 punch from 0x01b27c to 0x01cc76 (0x19fb bytes) 000329 1783952572.968355 read 0x004741 thru 0x00e32b (0x9beb bytes) 000331 1783952572.994256 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1cc77): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cc77): Mirror 3: 0xee9e3d1d (stale) Mirror 5: 0xee9e3d1d (stale) Mirror 9: 0xee9e3d1d (stale) Mirror 10: 0xee9e3d1d (stale) Mirror 11: 0xee9e3d1d (stale) CRC-32 checksum value for chunk [0, 0x1cc77): Mirror 1: 0xeb18dc0a Mirror 12: 0xeb18dc0a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cc77: skipped 000332 1783952573.888383 MIRROR_RESYNC 7 mirrors 000333 1783952574.664419 MIRROR_RESYNC 7 mirrors 000334 1783952575.079470 write 0x01749f thru 0x01a933 (0x3495 bytes) 000335 1783952575.141563 fallocate 0x0117a4 thru 0x01e12a (0xc987 bytes) 000336 1783952575.149594 mapread 0x01b890 thru 0x01cc76 (0x13e7 bytes) 000337 1783952575.163622 trunc from 0x0040fd to 0x00847d (0x4381 bytes) 000338 1783952575.171165 trunc from 0x01cc77 to 0x026e09 (0xa193 bytes) 000339 1783952575.209620 fallocate 0x015026 thru 0x0184ca (0x34a5 bytes) 000340 1783952575.213664 fallocate 0x00f762 thru 0x00fdd4 (0x673 bytes) 000341 1783952575.219819 mapwrite 0x0065f5 thru 0x007c87 (0x1693 bytes) 000342 1783952575.247932 write 0x03a8c6 thru 0x03ffff (0x573a bytes) 000343 1783952575.250960 read 0x03dc97 thru 0x03ffff (0x2369 bytes) 000344 1783952575.252387 trunc from 0x040000 to 0x00355f (0x3caa0 bytes) 000345 1783952575.266731 trunc from 0x003560 to 0x02c44a (0x28eeb bytes) 000346 1783952575.280973 mapread 0x01738b thru 0x01c01a (0x4c90 bytes) 000347 1783952575.292866 fallocate 0x004732 thru 0x00ba1e (0x72ed bytes) 000348 1783952575.297619 punch from 0x00adb6 to 0x015f95 (0xb1e0 bytes) 000349 1783952575.302198 mapwrite 0x00d243 thru 0x0172c2 (0xa080 bytes) 000350 1783952575.327918 mapread 0x007759 thru 0x01476a (0xd012 bytes) 000352 1783952575.330717 mapwrite 0x00c756 thru 0x01c39a (0xfc45 bytes) 000353 1783952575.353012 mapread 0x0175d1 thru 0x0193e6 (0x1e16 bytes) 000354 1783952575.355991 mapwrite 0x03ffb2 thru 0x03ffff (0x4e bytes) 000355 1783952575.389642 fallocate 0x00f146 thru 0x019177 (0xa032 bytes) 000356 1783952575.394537 mapread 0x00def0 thru 0x00fcb1 (0x1dc2 bytes) 000357 1783952575.396644 mapread 0x03d190 thru 0x03e34b (0x11bc bytes) 000358 1783952575.397800 mapread 0x003c22 thru 0x00dae9 (0x9ec8 bytes) 000359 1783952575.404559 read 0x007067 thru 0x00a4aa (0x3444 bytes) 000360 1783952575.409275 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x43ad5114 (stale) Mirror 5: 0x43ad5114 (stale) Mirror 9: 0x43ad5114 (stale) Mirror 10: 0x43ad5114 (stale) Mirror 12: 0x43ad5114 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x43ad5114 (stale) Mirror 5: 0x43ad5114 (stale) Mirror 9: 0x43ad5114 (stale) Mirror 10: 0x43ad5114 (stale) Mirror 12: 0x43ad5114 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000361 1783952575.742733 trunc from 0x040000 to 0x03b972 (0x468d bytes) 000362 1783952575.760858 mapread 0x035fe4 thru 0x03a3b4 (0x43d1 bytes) 000363 1783952575.801138 mapwrite 0x01b2df thru 0x027f0d (0xcc2f bytes) 000364 1783952575.876983 read 0x020894 thru 0x026858 (0x5fc5 bytes) 000366 1783952575.885366 MIRROR_RESYNC 6 mirrors 000367 1783952577.095144 MIRROR_EXTEND to 7 mirrors 000368 1783952577.871309 read 0x004479 thru 0x014050 (0xfbd8 bytes) 000370 1783952577.880726 trunc from 0x0120b3 to 0x016d40 (0x4c8e bytes) 000371 1783952577.924511 punch from 0x0125bf to 0x01afc9 (0x8a0b bytes) 000373 1783952577.933795 write 0x02df9e thru 0x03d351 (0xf3b4 bytes) 000374 1783952577.946542 read 0x02ec7c thru 0x033108 (0x448d bytes) 000375 1783952577.951499 read 0x02c94e thru 0x034e3a (0x84ed bytes) 000376 1783952577.969726 write 0x003161 thru 0x004325 (0x11c5 bytes) 000377 1783952577.984499 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d352): Mirror 3: 0xc74d0d14 (stale) Mirror 9: 0xc74d0d14 (stale) Mirror 10: 0xc74d0d14 (stale) Mirror 12: 0xc74d0d14 (stale) Mirror 13: 0xc74d0d14 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d352): Mirror 3: 0xc74d0d14 (stale) Mirror 9: 0xc74d0d14 (stale) Mirror 10: 0xc74d0d14 (stale) Mirror 12: 0xc74d0d14 (stale) Mirror 13: 0xc74d0d14 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d352: skipped 000378 1783952578.479690 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d352): Mirror 3: 0xc74d0d14 (stale) Mirror 9: 0xc74d0d14 (stale) Mirror 12: 0xc74d0d14 (stale) Mirror 13: 0xc74d0d14 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d352): Mirror 3: 0xc74d0d14 (stale) Mirror 9: 0xc74d0d14 (stale) Mirror 12: 0xc74d0d14 (stale) Mirror 13: 0xc74d0d14 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d352: skipped 000379 1783952578.848144 mapread 0x0280f2 thru 0x030112 (0x8021 bytes) 000381 1783952578.870979 write 0x013513 thru 0x01a8f1 (0x73df bytes) 000382 1783952578.887361 punch from 0x023af2 to 0x028551 (0x4a60 bytes) 000383 1783952578.892050 trunc from 0x0082ac to 0x00d05e (0x4db3 bytes) 000384 1783952578.901913 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d352): Mirror 9: 0xc74d0d14 (stale) Mirror 12: 0xc74d0d14 (stale) Mirror 13: 0xc74d0d14 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d352): Mirror 9: 0xc74d0d14 (stale) Mirror 12: 0xc74d0d14 (stale) Mirror 13: 0xc74d0d14 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d352: skipped 000385 1783952579.315936 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d352): Mirror 9: 0xc74d0d14 (stale) Mirror 13: 0xc74d0d14 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d352): Mirror 9: 0xc74d0d14 (stale) Mirror 13: 0xc74d0d14 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d352: skipped 000387 1783952579.770630 fallocate 0x014346 thru 0x01ba5d (0x7718 bytes) 000388 1783952579.781256 mapwrite 0x033d53 thru 0x034658 (0x906 bytes) 000390 1783952579.841301 punch from 0x038031 to 0x03d351 (0x5321 bytes) 000391 1783952579.854606 trunc from 0x0081c2 to 0x012f34 (0xad73 bytes) 000393 1783952579.876283 trunc from 0x018e10 to 0x019fed (0x11de bytes) 000394 1783952579.886583 mapread 0x01b064 thru 0x022889 (0x7826 bytes) 000395 1783952579.902588 punch from 0x017cb0 to 0x01db14 (0x5e65 bytes) 000396 1783952579.913585 write 0x0358bb thru 0x035abd (0x203 bytes) 000397 1783952579.939914 trunc from 0x03d352 to 0x0317ee (0xbb63 bytes) 000398 1783952579.970870 write 0x01a0c6 thru 0x01d4d9 (0x3414 bytes) 000400 1783952579.984879 read 0x001053 thru 0x003090 (0x203e bytes) 000401 1783952579.998171 trunc from 0x027019 to 0x02ffd7 (0x8fbf bytes) 000403 1783952580.017627 trunc from 0x0317ef to 0x02e6e8 (0x3106 bytes) 000404 1783952580.042290 read 0x01cda7 thru 0x01f86b (0x2ac5 bytes) 000405 1783952580.043696 punch from 0x02a8c0 to 0x02e6dd (0x3e1e bytes) 000406 1783952580.049418 trunc from 0x02e6e9 to 0x01b75c (0x12f8c bytes) 000407 1783952580.064565 trunc from 0x01b75d to 0x002a97 (0x18cc5 bytes) 000408 1783952580.089071 read 0x00151a thru 0x002a97 (0x157e bytes) 000409 1783952580.089777 mapwrite 0x03c999 thru 0x03ffff (0x3667 bytes) 000410 1783952580.150668 mapwrite 0x01cf39 thru 0x026671 (0x9739 bytes) 000411 1783952580.193653 punch from 0x011cd7 to 0x014527 (0x2851 bytes) 000412 1783952580.202778 mapread 0x01fdd4 thru 0x02f488 (0xf6b5 bytes) 000414 1783952580.205827 fallocate 0x0369c5 thru 0x037bb6 (0x11f2 bytes) 000415 1783952580.212175 trunc from 0x00fed2 to 0x015931 (0x5a60 bytes) 000416 1783952580.227843 trunc from 0x040000 to 0x02da38 (0x125c7 bytes) 000417 1783952580.257237 write 0x02d2f6 thru 0x0344c3 (0x71ce bytes) 000418 1783952580.258770 trunc from 0x02ab11 to 0x0344c3 (0x99b3 bytes) 000420 1783952580.287145 read 0x015303 thru 0x01b119 (0x5e17 bytes) 000421 1783952580.298133 write 0x0122a7 thru 0x020b2d (0xe887 bytes) 000422 1783952580.302153 trunc from 0x010db3 to 0x0159c5 (0x4c13 bytes) 000423 1783952580.318024 punch from 0x020876 to 0x02f8a0 (0xf02b bytes) 000424 1783952580.323975 trunc from 0x0247ba to 0x030de9 (0xc630 bytes) 000425 1783952580.328454 trunc from 0x007f92 to 0x00d050 (0x50bf bytes) 000426 1783952580.332365 read 0x0288cd thru 0x03090b (0x803f bytes) 000427 1783952580.344650 mapwrite 0x0113b9 thru 0x01a600 (0x9248 bytes) 000428 1783952580.361398 fallocate 0x035024 thru 0x03ffff (0xafdc bytes) 000429 1783952580.366010 punch from 0x000f9b to 0x00ee68 (0xdece bytes) 000430 1783952580.371188 fallocate 0x023dbe thru 0x02fcb4 (0xbef7 bytes) 000432 1783952580.376454 mapwrite 0x038fba thru 0x03ffff (0x7046 bytes) 000433 1783952580.399635 fallocate 0x005ed4 thru 0x014fce (0xf0fb bytes) 000434 1783952580.403977 read 0x03b24d thru 0x03ffff (0x4db3 bytes) 000435 1783952580.404645 mapread 0x0029c7 thru 0x00ac80 (0x82ba bytes) 000436 1783952580.415284 trunc from 0x040000 to 0x00e1c8 (0x31e37 bytes) 000437 1783952580.429013 write 0x0090f4 thru 0x00e168 (0x5075 bytes) 000438 1783952580.430505 trunc from 0x00e1c9 to 0x009674 (0x4b54 bytes) 000439 1783952580.452405 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x9675): Mirror 9: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9675): Mirror 9: 0x4b648399 (stale) Mirror 13: 0x4b648399 (stale) CRC-32 checksum value for chunk [0, 0x9675): Mirror 1: 0x6cea23ca Mirror 14: 0x6cea23ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9675: skipped 000440 1783952581.124797 fallocate 0x03d5a8 thru 0x03ffff (0x2a58 bytes) 000441 1783952581.158592 read 0x03092a thru 0x03bfdf (0xb6b6 bytes) 000442 1783952581.167515 write 0x006e1b thru 0x0095b0 (0x2796 bytes) 000443 1783952581.178632 mapwrite 0x0142be thru 0x016535 (0x2278 bytes) 000444 1783952581.206895 trunc from 0x009be7 to 0x012473 (0x888d bytes) 000445 1783952581.211611 mapread 0x003011 thru 0x01052e (0xd51e bytes) 000446 1783952581.222566 trunc from 0x040000 to 0x02f929 (0x106d6 bytes) 000447 1783952581.257492 mapwrite 0x00acb3 thru 0x010df4 (0x6142 bytes) 000448 1783952581.274044 punch from 0x023920 to 0x025a6c (0x214d bytes) 000449 1783952581.278579 trunc from 0x02f92a to 0x026659 (0x92d0 bytes) 000450 1783952581.293377 trunc from 0x02665a to 0x006b35 (0x1fb24 bytes) 000451 1783952581.310473 MIRROR_RESYNC 4 mirrors 000452 1783952581.969732 mapread 0x0032d9 thru 0x004b6b (0x1893 bytes) 000453 1783952581.982893 write 0x03b1ae thru 0x03ffff (0x4e52 bytes) 000454 1783952582.013238 mapwrite 0x0007cf thru 0x00e63a (0xde6c bytes) 000455 1783952582.039525 fallocate 0x02f4dc thru 0x0361b0 (0x6cd5 bytes) 000456 1783952582.048162 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xe20eea22 (stale) Mirror 13: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xef88e59 Mirror 15: 0xef88e59 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000457 1783952582.796767 trunc from 0x02f845 to 0x03089d (0x1059 bytes) 000458 1783952582.855280 punch from 0x01815c to 0x0229ed (0xa892 bytes) 000459 1783952582.860899 punch from 0x008b54 to 0x011162 (0x860f bytes) 000460 1783952582.866947 punch from 0x03976f to 0x03ffff (0x6891 bytes) 000461 1783952582.882946 MIRROR_RESYNC 5 mirrors 000462 1783952583.854261 punch from 0x030128 to 0x03ec8d (0xeb66 bytes) 000463 1783952583.921976 write 0x025eb1 thru 0x028fb8 (0x3108 bytes) 000464 1783952583.948223 trunc from 0x040000 to 0x02381c (0x1c7e3 bytes) 000465 1783952583.998923 mapwrite 0x0318f6 thru 0x03c6a8 (0xadb3 bytes) 000466 1783952584.081741 punch from 0x030ef3 to 0x03a522 (0x9630 bytes) 000467 1783952584.087060 write 0x00e5f3 thru 0x01939f (0xadad bytes) 000468 1783952584.098753 punch from 0x0050c1 to 0x0068d5 (0x1815 bytes) 000469 1783952584.122183 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3c6a9): Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c6a9): Mirror 9: 0x863cad3d (stale) Mirror 13: 0x863cad3d (stale) Mirror 14: 0x863cad3d (stale) Mirror 15: 0x863cad3d (stale) CRC-32 checksum value for chunk [0, 0x3c6a9): Mirror 1: 0xf68d2d48 Mirror 16: 0xf68d2d48 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c6a9: skipped 000470 1783952585.188576 punch from 0x0094eb to 0x00c9ba (0x34d0 bytes) 000471 1783952585.256043 write 0x0022fe thru 0x006056 (0x3d59 bytes) 000472 1783952585.280564 mapread 0x01d8c8 thru 0x024a5e (0x7197 bytes) 000473 1783952585.308292 mapwrite 0x01c161 thru 0x02425b (0x80fb bytes) 000474 1783952585.354806 trunc from 0x00b487 to 0x01a618 (0xf192 bytes) 000476 1783952585.361994 trunc from 0x034412 to 0x03aa27 (0x6616 bytes) 000477 1783952585.371143 punch from 0x0204ec to 0x02344a (0x2f5f bytes) 000478 1783952585.380998 mapread 0x030dde thru 0x03c6a8 (0xb8cb bytes) 000479 1783952585.403282 read 0x01e544 thru 0x0217e8 (0x32a5 bytes) 000480 1783952585.412382 mapwrite 0x021a40 thru 0x027c7f (0x6240 bytes) 000481 1783952585.453098 punch from 0x027292 to 0x02bdc0 (0x4b2f bytes) 000482 1783952585.461969 trunc from 0x03c6a9 to 0x004941 (0x37d67 bytes) 000484 1783952585.510248 write 0x03156c thru 0x0316a3 (0x138 bytes) 000486 1783952585.511992 trunc from 0x0316a4 to 0x03cf54 (0xb8b1 bytes) 000487 1783952585.532819 MIRROR_RESYNC 6 mirrors 000488 1783952586.826514 MIRROR_RESYNC 6 mirrors 000489 1783952587.326360 punch from 0x0327cc to 0x03cf54 (0xa789 bytes) 000490 1783952587.371166 MIRROR_RESYNC 6 mirrors 000492 1783952588.641012 mapwrite 0x01248c thru 0x01d3cd (0xaf42 bytes) 000493 1783952588.753325 mapwrite 0x036971 thru 0x03ffff (0x968f bytes) 000494 1783952588.829238 trunc from 0x040000 to 0x023cc3 (0x1c33c bytes) 000495 1783952588.852963 punch from 0x01578e to 0x0181a4 (0x2a17 bytes) 000496 1783952588.860579 fallocate 0x032cef thru 0x03e575 (0xb887 bytes) 000497 1783952588.873575 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23cc4): Mirror 9: 0x3dcc949 (stale) Mirror 13: 0x3dcc949 (stale) Mirror 15: 0x3dcc949 (stale) Mirror 16: 0x3dcc949 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23cc4): Mirror 9: 0x3dcc949 (stale) Mirror 13: 0x3dcc949 (stale) Mirror 15: 0x3dcc949 (stale) Mirror 16: 0x3dcc949 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23cc4: skipped 000498 1783952589.412550 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23cc4): Mirror 9: 0x3dcc949 (stale) Mirror 13: 0x3dcc949 (stale) Mirror 16: 0x3dcc949 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23cc4): Mirror 9: 0x3dcc949 (stale) Mirror 13: 0x3dcc949 (stale) Mirror 16: 0x3dcc949 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23cc4: skipped 000499 1783952589.805261 trunc from 0x023cc4 to 0x03ca5c (0x18d99 bytes) 000500 1783952589.864526 MIRROR_RESYNC 4 mirrors 000501 1783952591.273824 punch from 0x024f34 to 0x025a9a (0xb67 bytes) 000502 1783952591.305389 trunc from 0x0288db to 0x02fc4f (0x7375 bytes) 000503 1783952591.314946 read 0x01ed17 thru 0x02800f (0x92f9 bytes) 000504 1783952591.330771 fallocate 0x02d3c9 thru 0x03653e (0x9176 bytes) 000506 1783952591.336828 read 0x030370 thru 0x031e7c (0x1b0d bytes) 000508 1783952591.347949 trunc from 0x03ca5d to 0x0230f7 (0x19965 bytes) 000509 1783952591.366271 trunc from 0x0230f8 to 0x00222e (0x20ec9 bytes) 000510 1783952591.379841 punch from 0x001616 to 0x00222e (0xc19 bytes) 000511 1783952591.384260 trunc from 0x001317 to 0x00222e (0xf18 bytes) 000513 1783952591.390171 trunc from 0x00222f to 0x02b9ac (0x2977e bytes) 000515 1783952591.407203 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2b9ad): Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b9ad): Mirror 9: 0x92950ee (stale) Mirror 13: 0x92950ee (stale) Mirror 16: 0x92950ee (stale) CRC-32 checksum value for chunk [0, 0x2b9ad): Mirror 1: 0xb3c4d44f Mirror 17: 0xb3c4d44f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b9ad: skipped 000516 1783952592.479009 write 0x007fac thru 0x00cbef (0x4c44 bytes) 000517 1783952592.580915 read 0x013d62 thru 0x0187cf (0x4a6e bytes) 000518 1783952592.588506 mapwrite 0x023714 thru 0x0315ca (0xdeb7 bytes) 000519 1783952592.743281 mapread 0x01969d thru 0x021bf4 (0x8558 bytes) 000520 1783952592.772386 trunc from 0x0315cb to 0x02998c (0x7c3e bytes) 000521 1783952592.792272 punch from 0x00c9b5 to 0x013814 (0x6e60 bytes) 000522 1783952592.797684 mapwrite 0x02252c thru 0x02fa20 (0xd4f5 bytes) 000523 1783952592.855461 punch from 0x00ae49 to 0x00cfb1 (0x2169 bytes) 000524 1783952592.865371 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fa21): Mirror 9: 0xdce68466 (stale) Mirror 16: 0xdce68466 (stale) Mirror 17: 0xeef4efb8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fa21): Mirror 9: 0xdce68466 (stale) Mirror 16: 0xdce68466 (stale) Mirror 17: 0xeef4efb8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fa21: skipped 000525 1783952593.224310 trunc from 0x02b6c9 to 0x02fa20 (0x4358 bytes) 000526 1783952593.228398 mapwrite 0x00a1ff thru 0x0159e6 (0xb7e8 bytes) 000528 1783952593.270245 write 0x0003d0 thru 0x00f121 (0xed52 bytes) 000530 1783952593.281674 trunc from 0x0281a8 to 0x02fa20 (0x7879 bytes) 000531 1783952593.287380 mapread 0x013ad4 thru 0x01883a (0x4d67 bytes) 000532 1783952593.302993 MIRROR_RESYNC 4 mirrors 000533 1783952594.657644 trunc from 0x014921 to 0x0200a8 (0xb788 bytes) 000534 1783952594.707457 write 0x016890 thru 0x02552f (0xeca0 bytes) 000536 1783952594.724092 punch from 0x007ad8 to 0x00b3e7 (0x3910 bytes) 000537 1783952594.730230 trunc from 0x0189a5 to 0x01af8f (0x25eb bytes) 000538 1783952594.771230 mapread 0x00e8bb thru 0x017edb (0x9621 bytes) 000539 1783952594.840257 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fa21): Mirror 9: 0xeb084570 (stale) Mirror 17: 0xeb084570 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fa21): Mirror 9: 0xeb084570 (stale) Mirror 17: 0xeb084570 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fa21: skipped 000540 1783952595.257676 fallocate 0x0212ce thru 0x02c386 (0xb0b9 bytes) 000541 1783952595.266965 read 0x004e26 thru 0x006ac7 (0x1ca2 bytes) 000542 1783952595.274133 trunc from 0x01f289 to 0x02ac3e (0xb9b6 bytes) 000543 1783952595.280998 mapread 0x01ba39 thru 0x02af6e (0xf536 bytes) 000544 1783952595.332895 trunc from 0x02fa21 to 0x03cef6 (0xd4d6 bytes) 000545 1783952595.363967 write 0x020076 thru 0x02c6fd (0xc688 bytes) 000546 1783952595.367123 mapread 0x016b65 thru 0x0223f3 (0xb88f bytes) 000547 1783952595.369769 mapread 0x00ef7f thru 0x01a38c (0xb40e bytes) 000548 1783952595.384392 mapwrite 0x014900 thru 0x01887c (0x3f7d bytes) 000549 1783952595.404164 fallocate 0x01e483 thru 0x02822b (0x9da9 bytes) 000550 1783952595.410562 read 0x0257f5 thru 0x0282c9 (0x2ad5 bytes) 000551 1783952595.414524 trunc from 0x001c83 to 0x00fe28 (0xe1a6 bytes) 000552 1783952595.423305 mapwrite 0x03a488 thru 0x03ffff (0x5b78 bytes) 000553 1783952595.535785 write 0x03d04d thru 0x03ffff (0x2fb3 bytes) 000554 1783952595.542927 write 0x031405 thru 0x03dfdc (0xcbd8 bytes) 000556 1783952595.567881 MIRROR_RESYNC 3 mirrors 000559 1783952596.997524 mapread 0x01302e thru 0x01812e (0x5101 bytes) 000560 1783952597.037417 mapwrite 0x018eb8 thru 0x01f651 (0x679a bytes) 000561 1783952597.176530 mapread 0x0034eb thru 0x00eaf6 (0xb60c bytes) 000562 1783952597.198761 mapwrite 0x024d2e thru 0x026fb8 (0x228b bytes) 000563 1783952597.276742 write 0x00664a thru 0x00da93 (0x744a bytes) 000564 1783952597.277961 write 0x01518c thru 0x01fcde (0xab53 bytes) 000565 1783952597.280676 mapread 0x0032f7 thru 0x00d6dd (0xa3e7 bytes) 000566 1783952597.288400 fallocate 0x017cc2 thru 0x01b058 (0x3397 bytes) 000567 1783952597.305258 fallocate 0x0068b7 thru 0x00f9be (0x9108 bytes) 000568 1783952597.326697 punch from 0x026fbb to 0x036dc9 (0xfe0f bytes) 000569 1783952597.338172 mapwrite 0x037675 thru 0x03e547 (0x6ed3 bytes) 000570 1783952597.423126 trunc from 0x03d9e7 to 0x03ffff (0x2619 bytes) 000571 1783952597.461210 trunc from 0x01cd24 to 0x02b612 (0xe8ef bytes) 000573 1783952597.488188 write 0x00455c thru 0x013766 (0xf20b bytes) 000575 1783952597.497275 trunc from 0x040000 to 0x00e7eb (0x31814 bytes) 000576 1783952597.569543 mapwrite 0x0036c1 thru 0x006359 (0x2c99 bytes) 000577 1783952597.630490 MIRROR_RESYNC 3 mirrors 000578 1783952598.604550 trunc from 0x00e7ec to 0x03dc32 (0x2f447 bytes) 000579 1783952598.671628 mapwrite 0x03477e thru 0x03735c (0x2bdf bytes) 000580 1783952598.714350 punch from 0x0250ab to 0x026128 (0x107e bytes) 000582 1783952598.726344 trunc from 0x03dc33 to 0x00ef2b (0x2ed07 bytes) 000583 1783952598.763613 write 0x00422f thru 0x00a0d0 (0x5ea2 bytes) 000584 1783952598.775282 fallocate 0x023f6e thru 0x02ecca (0xad5d bytes) 000585 1783952598.780654 read 0x002e55 thru 0x010e9b (0xe047 bytes) 000586 1783952598.789734 fallocate 0x00818e thru 0x00f76f (0x75e2 bytes) 000587 1783952598.796275 punch from 0x017d1c to 0x019ae5 (0x1dca bytes) 000589 1783952598.822243 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2eccb): Mirror 9: 0x77fe128a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eccb): Mirror 9: 0x77fe128a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eccb: skipped 000590 1783952599.175898 read 0x02d0de thru 0x02ecca (0x1bed bytes) 000591 1783952599.185108 trunc from 0x017e06 to 0x01b9d3 (0x3bce bytes) 000592 1783952599.194182 trunc from 0x000af2 to 0x0057e5 (0x4cf4 bytes) 000593 1783952599.198886 mapwrite 0x03a672 thru 0x03ffff (0x598e bytes) 000594 1783952599.264040 mapread 0x026f6f thru 0x02cdc0 (0x5e52 bytes) 000595 1783952599.281500 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) 000596 1783952599.435888 trunc from 0x040000 to 0x0016f1 (0x3e90e bytes) 000597 1783952599.466560 read 0x0012db thru 0x0016f1 (0x417 bytes) 000599 1783952599.473472 read 0x0010a9 thru 0x0016f1 (0x649 bytes) 000601 1783952599.475212 mapwrite 0x0045dc thru 0x00c3be (0x7de3 bytes) 000602 1783952599.515169 read 0x0087a9 thru 0x00c3be (0x3c16 bytes) 000603 1783952599.515997 mapread 0x003898 thru 0x00a4a8 (0x6c11 bytes) 000604 1783952599.518558 read 0x00b4f3 thru 0x00c3be (0xecc bytes) 000605 1783952599.519656 punch from 0x00b7e2 to 0x00c3be (0xbdd bytes) 000606 1783952599.527069 mapread 0x009917 thru 0x00c3be (0x2aa8 bytes) 000607 1783952599.532830 mapwrite 0x02dd26 thru 0x0344c4 (0x679f bytes) 000608 1783952599.589831 mapwrite 0x01404d thru 0x01960e (0x55c2 bytes) 000609 1783952599.605257 trunc from 0x0344c5 to 0x024131 (0x10393 bytes) 000610 1783952599.645257 write 0x02646b thru 0x02ec21 (0x87b7 bytes) 000611 1783952599.647308 fallocate 0x02a9a2 thru 0x037969 (0xcfc8 bytes) 000612 1783952599.652957 punch from 0x01e123 to 0x02c4f6 (0xe3d4 bytes) 000613 1783952599.670448 read 0x02bd92 thru 0x02cd77 (0xfe6 bytes) 000614 1783952599.679416 read 0x014423 thru 0x0199e4 (0x55c2 bytes) 000615 1783952599.681242 write 0x0262b5 thru 0x0307b0 (0xa4fc bytes) 000616 1783952599.683019 trunc from 0x03796a to 0x00ddcc (0x29b9d bytes) 000617 1783952599.706456 punch from 0x0001b7 to 0x00393b (0x3785 bytes) 000618 1783952599.714797 trunc from 0x00ddcd to 0x014553 (0x6787 bytes) 000619 1783952599.743802 trunc from 0x00e45d to 0x014553 (0x60f7 bytes) 000620 1783952599.763576 fallocate 0x03d62c thru 0x03ffff (0x29d4 bytes) 000621 1783952599.771360 mapwrite 0x018935 thru 0x020e43 (0x850f bytes) 000622 1783952599.975633 trunc from 0x0035fa to 0x003722 (0x129 bytes) 000623 1783952599.992209 mapread 0x012647 thru 0x014a49 (0x2403 bytes) 000624 1783952599.993511 mapwrite 0x035a7a thru 0x0399f8 (0x3f7f bytes) 000625 1783952600.128707 trunc from 0x034883 to 0x0399f8 (0x5176 bytes) 000626 1783952600.136154 mapread 0x00413c thru 0x00a0da (0x5f9f bytes) 000627 1783952600.137274 trunc from 0x02fe25 to 0x034b1b (0x4cf7 bytes) 000628 1783952600.149341 mapwrite 0x02297a thru 0x024de7 (0x246e bytes) 000629 1783952600.167291 trunc from 0x0399f9 to 0x0157a6 (0x24252 bytes) 000630 1783952600.214225 mapwrite 0x033d05 thru 0x03c24f (0x854b bytes) 000631 1783952600.348775 punch from 0x01cb76 to 0x026b0b (0x9f96 bytes) 000632 1783952600.378726 MIRROR_EXTEND to 2 mirrors 000635 1783952601.644542 trunc from 0x03c250 to 0x019c7c (0x225d3 bytes) 000636 1783952601.746368 fallocate 0x033fe5 thru 0x03f79f (0xb7bb bytes) 000637 1783952601.771152 punch from 0x00ccc6 to 0x0147e8 (0x7b23 bytes) 000638 1783952601.776813 trunc from 0x016668 to 0x019c7c (0x3615 bytes) 000639 1783952601.797508 punch from 0x007339 to 0x00ff02 (0x8bca bytes) 000640 1783952601.817078 mapwrite 0x0161de thru 0x01cdeb (0x6c0e bytes) 000642 1783952601.987399 mapread 0x002208 thru 0x00512a (0x2f23 bytes) 000643 1783952602.024639 fallocate 0x0119bd thru 0x012525 (0xb69 bytes) 000644 1783952602.039941 fallocate 0x001dcd thru 0x00f781 (0xd9b5 bytes) 000645 1783952602.055392 mapread 0x00b135 thru 0x00d87f (0x274b bytes) 000646 1783952602.066084 trunc from 0x0104ae to 0x011054 (0xba7 bytes) 000649 1783952602.082414 mapread 0x01a266 thru 0x01cdeb (0x2b86 bytes) 000650 1783952602.092288 read 0x009eb6 thru 0x010206 (0x6351 bytes) 000651 1783952602.106821 write 0x027982 thru 0x028677 (0xcf6 bytes) 000652 1783952602.108113 read 0x00cd46 thru 0x01564a (0x8905 bytes) 000653 1783952602.164493 mapwrite 0x00594e thru 0x005f25 (0x5d8 bytes) 000655 1783952602.187793 trunc from 0x028678 to 0x017812 (0x10e65 bytes) 000656 1783952602.219951 mapread 0x001acb thru 0x007f29 (0x645f bytes) 000657 1783952602.227317 mapwrite 0x00695c thru 0x0106bd (0x9d62 bytes) 000658 1783952602.307869 MIRROR_RESYNC 2 mirrors 000660 1783952603.333094 mapread 0x00bf00 thru 0x01512d (0x922e bytes) 000661 1783952603.384306 trunc from 0x00ebef to 0x017812 (0x8c24 bytes) 000662 1783952603.452100 mapread 0x0090b0 thru 0x00fb23 (0x6a74 bytes) 000663 1783952603.478607 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) 000664 1783952603.723287 fallocate 0x01c13f thru 0x029eb7 (0xdd79 bytes) 000665 1783952603.743403 mapwrite 0x00169d thru 0x00535d (0x3cc1 bytes) 000667 1783952603.816323 punch from 0x011c95 to 0x017812 (0x5b7e bytes) 000668 1783952603.827303 fallocate 0x007eb6 thru 0x009176 (0x12c1 bytes) 000669 1783952603.837627 write 0x010023 thru 0x013f4d (0x3f2b bytes) 000671 1783952603.861326 fallocate 0x03425e thru 0x03cffa (0x8d9d bytes) 000672 1783952603.870417 write 0x03c0b3 thru 0x03de79 (0x1dc7 bytes) 000673 1783952603.882373 mapwrite 0x01f315 thru 0x0253c3 (0x60af bytes) 000674 1783952603.922527 mapwrite 0x03a0a3 thru 0x03a5b0 (0x50e bytes) 000675 1783952603.958460 fallocate 0x02fcca thru 0x0328d4 (0x2c0b bytes) 000676 1783952603.985083 MIRROR_EXTEND to 2 mirrors 000678 1783952605.008000 mapread 0x02caa1 thru 0x03ad9c (0xe2fc bytes) 000679 1783952605.091912 mapread 0x0037e3 thru 0x006e6f (0x368d bytes) 000680 1783952605.154276 trunc from 0x03de7a to 0x00b7d2 (0x326a7 bytes) 000682 1783952605.243353 fallocate 0x031b28 thru 0x03ee8d (0xd366 bytes) 000683 1783952605.269014 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) 000684 1783952605.524644 write 0x03aabd thru 0x03ffff (0x5543 bytes) 000685 1783952605.535308 MIRROR_EXTEND to 2 mirrors 000686 1783952606.401198 MIRROR_RESYNC 2 mirrors 000687 1783952606.848806 fallocate 0x029812 thru 0x02f820 (0x600f bytes) 000688 1783952606.873390 trunc from 0x010a88 to 0x01e534 (0xdaad bytes) 000689 1783952606.898029 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) 000691 1783952607.071331 punch from 0x0041b5 to 0x00f924 (0xb770 bytes) 000693 1783952607.076862 punch from 0x034d3d to 0x038fc0 (0x4284 bytes) 000694 1783952607.081610 trunc from 0x02962f to 0x02a67a (0x104c bytes) 000695 1783952607.085909 mapread 0x02051b thru 0x02519a (0x4c80 bytes) 000696 1783952607.102390 punch from 0x026a54 to 0x029dea (0x3397 bytes) 000697 1783952607.108342 mapwrite 0x03ecf3 thru 0x03ffff (0x130d bytes) 000698 1783952607.128014 mapwrite 0x00da2f thru 0x011b88 (0x415a bytes) 000699 1783952607.155148 mapwrite 0x010b48 thru 0x01279c (0x1c55 bytes) 000700 1783952607.183549 fallocate 0x00829c thru 0x0162f1 (0xe056 bytes) 000701 1783952607.189056 punch from 0x024d41 to 0x026556 (0x1816 bytes) 000702 1783952607.194338 trunc from 0x040000 to 0x006d52 (0x392ad bytes) 000704 1783952607.224598 read 0x003c4c thru 0x006d52 (0x3107 bytes) 000705 1783952607.231781 read 0x002da7 thru 0x006d52 (0x3fac bytes) 000706 1783952607.238284 mapread 0x0025e8 thru 0x006d52 (0x476b bytes) 000707 1783952607.240862 trunc from 0x006d53 to 0x000381 (0x69d1 bytes) 000708 1783952607.258351 punch from 0x0001c6 to 0x000381 (0x1bc bytes) 000709 1783952607.263760 read 0x000311 thru 0x000381 (0x71 bytes) 000710 1783952607.268412 trunc from 0x000382 to 0x0125f4 (0x12273 bytes) 000711 1783952607.283153 mapread 0x002677 thru 0x011de7 (0xf771 bytes) 000712 1783952607.304477 punch from 0x009511 to 0x011de1 (0x88d1 bytes) 000713 1783952607.309853 trunc from 0x009f4f to 0x00cd97 (0x2e49 bytes) 000714 1783952607.314661 mapwrite 0x00b1fc thru 0x014e64 (0x9c69 bytes) 000715 1783952607.398224 fallocate 0x0396e3 thru 0x03ffff (0x691d bytes) 000716 1783952607.403376 write 0x033faf thru 0x03ffff (0xc051 bytes) 000717 1783952607.407146 fallocate 0x0154d6 thru 0x019ab5 (0x45e0 bytes) 000718 1783952607.413376 trunc from 0x03fcaa to 0x03ffff (0x356 bytes) 000719 1783952607.425552 read 0x03b8f6 thru 0x03ffff (0x470a bytes) 000721 1783952607.435962 trunc from 0x02e08c to 0x03dc3f (0xfbb4 bytes) 000722 1783952607.441466 write 0x03db02 thru 0x03ffff (0x24fe bytes) 000724 1783952607.448297 fallocate 0x01e8ae thru 0x021579 (0x2ccc bytes) 000725 1783952607.453357 write 0x00d6d5 thru 0x016a25 (0x9351 bytes) 000726 1783952607.456321 fallocate 0x029edb thru 0x039159 (0xf27f bytes) 000727 1783952607.462287 mapread 0x00d154 thru 0x01cd70 (0xfc1d bytes) 000728 1783952607.463756 punch from 0x016afe to 0x018dce (0x22d1 bytes) 000729 1783952607.483313 read 0x00c775 thru 0x00fcd8 (0x3564 bytes) 000730 1783952607.484045 write 0x0376c1 thru 0x038831 (0x1171 bytes) 000731 1783952607.495745 read 0x03ff02 thru 0x03ffff (0xfe bytes) 000733 1783952607.499005 read 0x00904c thru 0x00fc0f (0x6bc4 bytes) 000736 1783952607.503977 mapread 0x03e183 thru 0x03ffff (0x1e7d bytes) 000737 1783952607.506846 read 0x00c942 thru 0x00ee74 (0x2533 bytes) 000738 1783952607.508460 mapwrite 0x0387cf thru 0x03ffff (0x7831 bytes) 000739 1783952607.524064 mapread 0x01a46e thru 0x025eb1 (0xba44 bytes) 000741 1783952607.525932 punch from 0x00b302 to 0x013937 (0x8636 bytes) 000742 1783952607.529947 fallocate 0x01fb99 thru 0x022d46 (0x31ae bytes) 000744 1783952607.541868 trunc from 0x000a0b to 0x006399 (0x598f bytes) 000745 1783952607.547583 trunc from 0x040000 to 0x004984 (0x3b67b bytes) 000747 1783952607.564769 write 0x014ec5 thru 0x01ba5a (0x6b96 bytes) 000748 1783952607.566180 trunc from 0x01ba5b to 0x03e60b (0x22bb1 bytes) 000749 1783952607.582501 mapwrite 0x00d90c thru 0x018e68 (0xb55d bytes) 000750 1783952607.628126 punch from 0x02cba8 to 0x03b872 (0xeccb bytes) 000751 1783952607.635132 read 0x0343e3 thru 0x03b245 (0x6e63 bytes) 000752 1783952607.643339 punch from 0x02af0a to 0x035800 (0xa8f7 bytes) 000753 1783952607.647488 trunc from 0x0385af to 0x03e60b (0x605d bytes) 000755 1783952607.652044 mapwrite 0x03ff83 thru 0x03ffff (0x7d bytes) 000756 1783952607.675384 read 0x02f175 thru 0x037610 (0x849c bytes) 000757 1783952607.689875 trunc from 0x040000 to 0x017500 (0x28aff bytes) 000758 1783952607.707090 mapwrite 0x00606d thru 0x00b904 (0x5898 bytes) 000759 1783952607.721746 mapwrite 0x031757 thru 0x033a47 (0x22f1 bytes) 000760 1783952607.764061 write 0x032551 thru 0x03fcf1 (0xd7a1 bytes) 000761 1783952607.766305 trunc from 0x03fcf2 to 0x01b0e2 (0x24c0f bytes) 000762 1783952607.781750 trunc from 0x0137a0 to 0x01b0e2 (0x7943 bytes) 000763 1783952607.785987 mapread 0x01827b thru 0x01b0e2 (0x2e68 bytes) 000764 1783952607.812322 punch from 0x0134f5 to 0x01b0e2 (0x7bee bytes) 000765 1783952607.822390 write 0x01d8b9 thru 0x02b707 (0xde4f bytes) 000766 1783952607.824287 trunc from 0x0221ed to 0x0275c6 (0x53da bytes) 000767 1783952607.839726 fallocate 0x027c38 thru 0x02cee9 (0x52b2 bytes) 000768 1783952607.845454 trunc from 0x021150 to 0x02ad8b (0x9c3c bytes) 000769 1783952607.856234 trunc from 0x007c4f to 0x0089ff (0xdb1 bytes) 000770 1783952607.884164 fallocate 0x01c063 thru 0x02bcce (0xfc6c bytes) 000772 1783952607.901083 mapwrite 0x00a552 thru 0x00d3b4 (0x2e63 bytes) 000775 1783952607.934177 trunc from 0x0014b7 to 0x0016b9 (0x203 bytes) 000776 1783952607.942711 MIRROR_EXTEND to 2 mirrors 000777 1783952608.624166 fallocate 0x0149e6 thru 0x01c26f (0x788a bytes) 000778 1783952608.670735 mapread 0x001e41 thru 0x00f0f2 (0xd2b2 bytes) 000781 1783952608.706070 mapread 0x00ecc0 thru 0x01d11c (0xe45d bytes) 000782 1783952608.740932 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) 000783 1783952608.917486 mapwrite 0x012bae thru 0x01cf23 (0xa376 bytes) 000784 1783952608.974256 mapwrite 0x023703 thru 0x023897 (0x195 bytes) 000785 1783952608.994974 trunc from 0x002387 to 0x003c60 (0x18da bytes) 000786 1783952609.003096 MIRROR_EXTEND to 2 mirrors 000788 1783952610.310026 MIRROR_EXTEND to 3 mirrors 000789 1783952611.519390 punch from 0x02a45a to 0x02cee9 (0x2a90 bytes) 000790 1783952611.618030 fallocate 0x003168 thru 0x00b531 (0x83ca bytes) 000791 1783952611.624349 trunc from 0x02ceea to 0x001b11 (0x2b3d8 bytes) 000792 1783952611.663524 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1b12): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b12): Mirror 2: 0xdb4c60d4 (stale) Mirror 3: 0xdb4c60d4 (stale) CRC-32 checksum value for chunk [0, 0x1b12): Mirror 1: 0xdb4c60d4 Mirror 4: 0xdb4c60d4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b12: skipped 000793 1783952612.968939 fallocate 0x011e91 thru 0x01f18c (0xd2fc bytes) 000794 1783952613.021830 fallocate 0x031791 thru 0x03271f (0xf8f bytes) 000795 1783952613.039755 punch from 0x0254a5 to 0x03271f (0xd27b bytes) 000796 1783952613.055672 fallocate 0x035783 thru 0x03ffff (0xa87d bytes) 000797 1783952613.066703 trunc from 0x032720 to 0x011fae (0x20771 bytes) 000798 1783952613.111337 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11faf): Mirror 2: 0x590ba940 (stale) Mirror 3: 0x590ba940 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11faf): Mirror 2: 0x590ba940 (stale) Mirror 3: 0x590ba940 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11faf: skipped 000799 1783952613.592524 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x11faf): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11faf): Mirror 2: 0x590ba940 (stale) Mirror 3: 0x590ba940 (stale) CRC-32 checksum value for chunk [0, 0x11faf): Mirror 1: 0xc4e01a6f Mirror 4: 0xc4e01a6f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11faf: skipped 000800 1783952614.732185 mapread 0x0083a6 thru 0x00adc4 (0x2a1f bytes) 000801 1783952614.782981 punch from 0x001ebf to 0x00dc02 (0xbd44 bytes) 000803 1783952614.848958 mapwrite 0x01e6a9 thru 0x02a952 (0xc2aa bytes) 000804 1783952614.995755 mapread 0x00bd57 thru 0x017699 (0xb943 bytes) 000805 1783952615.031982 mapread 0x009fa5 thru 0x00ae85 (0xee1 bytes) 000806 1783952615.036849 punch from 0x02390a to 0x027f34 (0x462b bytes) 000807 1783952615.046681 trunc from 0x000419 to 0x002722 (0x230a bytes) 000809 1783952615.105897 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a953): Mirror 3: 0xb76f4125 (stale) Mirror 4: 0xac48e535 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a953): Mirror 3: 0xb76f4125 (stale) Mirror 4: 0xac48e535 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a953: skipped 000810 1783952615.583253 write 0x0347c7 thru 0x03d843 (0x907d bytes) 000811 1783952615.591383 mapwrite 0x00187b thru 0x00203b (0x7c1 bytes) 000812 1783952615.619185 mapwrite 0x00c3c2 thru 0x017113 (0xad52 bytes) 000813 1783952615.658214 write 0x010897 thru 0x013e05 (0x356f bytes) 000814 1783952615.659317 mapread 0x01ff91 thru 0x0223af (0x241f bytes) 000815 1783952615.669733 fallocate 0x03ba74 thru 0x03e6f8 (0x2c85 bytes) 000816 1783952615.675698 read 0x024ff0 thru 0x028e19 (0x3e2a bytes) 000817 1783952615.681044 trunc from 0x03e6f9 to 0x0284a8 (0x16250 bytes) 000819 1783952615.707155 MIRROR_RESYNC 3 mirrors 000820 1783952616.843484 read 0x01aa62 thru 0x022592 (0x7b31 bytes) 000821 1783952616.857001 trunc from 0x01a967 to 0x025d73 (0xb40d bytes) 000822 1783952616.947136 write 0x01b8e2 thru 0x02b73f (0xfe5e bytes) 000823 1783952616.954835 write 0x01ee6b thru 0x02a641 (0xb7d7 bytes) 000824 1783952616.968086 MIRROR_RESYNC 3 mirrors 000825 1783952618.109792 MIRROR_EXTEND to 4 mirrors 000826 1783952619.072836 trunc from 0x00b1b7 to 0x0181eb (0xd035 bytes) 000827 1783952619.134199 mapread 0x001395 thru 0x00b35e (0x9fca bytes) 000828 1783952619.161204 punch from 0x020a77 to 0x0242a3 (0x382d bytes) 000829 1783952619.168201 punch from 0x027fe6 to 0x02b73f (0x375a bytes) 000830 1783952619.174781 write 0x01acad thru 0x01e5a3 (0x38f7 bytes) 000831 1783952619.194346 trunc from 0x02b740 to 0x03d503 (0x11dc4 bytes) 000832 1783952619.233029 write 0x03536b thru 0x0385c5 (0x325b bytes) 000833 1783952619.265752 punch from 0x033a6b to 0x036c4e (0x31e4 bytes) 000834 1783952619.292913 write 0x01d67d thru 0x02caa6 (0xf42a bytes) 000835 1783952619.305194 write 0x02030d thru 0x026158 (0x5e4c bytes) 000837 1783952619.315247 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d504): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d504): Mirror 3: 0x58e48c19 (stale) Mirror 4: 0x58e48c19 (stale) Mirror 5: 0x58e48c19 (stale) CRC-32 checksum value for chunk [0, 0x3d504): Mirror 1: 0x487380c3 Mirror 6: 0x487380c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d504: skipped 000838 1783952620.596131 mapwrite 0x02cefe thru 0x02fc61 (0x2d64 bytes) 000839 1783952620.732973 write 0x000a6e thru 0x004104 (0x3697 bytes) 000840 1783952620.772397 MIRROR_RESYNC 5 mirrors 000841 1783952622.270129 fallocate 0x00cdf0 thru 0x01b9ac (0xebbd bytes) 000842 1783952622.300269 mapwrite 0x022575 thru 0x026104 (0x3b90 bytes) 000843 1783952622.328405 trunc from 0x038991 to 0x03d503 (0x4b73 bytes) 000844 1783952622.332960 mapread 0x005beb thru 0x00e88b (0x8ca1 bytes) 000845 1783952622.341313 trunc from 0x03d504 to 0x0048b4 (0x38c4f bytes) 000846 1783952622.368147 mapwrite 0x0366a0 thru 0x03cd31 (0x6692 bytes) 000847 1783952622.409266 read 0x009589 thru 0x0191f8 (0xfc70 bytes) 000849 1783952622.418872 mapread 0x0212c3 thru 0x02b9c4 (0xa702 bytes) 000850 1783952622.443838 MIRROR_RESYNC 5 mirrors 000851 1783952623.545585 fallocate 0x01e3aa thru 0x02e0dd (0xfd34 bytes) 000852 1783952623.585903 mapwrite 0x013714 thru 0x01e0b3 (0xa9a0 bytes) 000853 1783952623.685862 trunc from 0x03cd32 to 0x03339f (0x9992 bytes) 000854 1783952623.735185 mapread 0x021ace thru 0x02fa67 (0xdf9a bytes) 000855 1783952623.745325 trunc from 0x0025be to 0x010ef7 (0xe93a bytes) 000856 1783952623.751728 trunc from 0x0333a0 to 0x036b35 (0x3796 bytes) 000857 1783952623.775045 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36b36): Mirror 4: 0x8fad3044 (stale) Mirror 5: 0x8fad3044 (stale) Mirror 6: 0x8fad3044 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36b36): Mirror 4: 0x8fad3044 (stale) Mirror 5: 0x8fad3044 (stale) Mirror 6: 0x8fad3044 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36b36: skipped 000858 1783952624.277466 write 0x03691d thru 0x03bfb9 (0x569d bytes) 000859 1783952624.289312 trunc from 0x036957 to 0x03b55e (0x4c08 bytes) 000860 1783952624.305624 write 0x026c31 thru 0x027fee (0x13be bytes) 000861 1783952624.321590 punch from 0x03413f to 0x03bfb9 (0x7e7b bytes) 000862 1783952624.328135 read 0x0179c9 thru 0x025faf (0xe5e7 bytes) 000863 1783952624.338130 mapwrite 0x00ff39 thru 0x01cf5e (0xd026 bytes) 000864 1783952624.412103 mapwrite 0x034deb thru 0x03d3ab (0x85c1 bytes) 000865 1783952624.466046 mapread 0x00df02 thru 0x01bf02 (0xe001 bytes) 000866 1783952624.469069 punch from 0x008c4c to 0x00a554 (0x1909 bytes) 000867 1783952624.476634 mapwrite 0x020d3f thru 0x028102 (0x73c4 bytes) 000868 1783952624.526359 mapwrite 0x032c3c thru 0x03467b (0x1a40 bytes) 000869 1783952624.549602 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d3ac): Mirror 4: 0x95107d88 (stale) Mirror 6: 0x95107d88 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3ac): Mirror 4: 0x95107d88 (stale) Mirror 6: 0x95107d88 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3ac: skipped 000870 1783952624.821866 fallocate 0x003c3a thru 0x0068ff (0x2cc6 bytes) 000871 1783952624.844888 MIRROR_RESYNC 3 mirrors 000873 1783952626.120020 mapwrite 0x003ed5 thru 0x00bd9a (0x7ec6 bytes) 000874 1783952626.274657 fallocate 0x009a19 thru 0x010e00 (0x73e8 bytes) 000875 1783952626.282836 mapwrite 0x031710 thru 0x03ce57 (0xb748 bytes) 000876 1783952626.344141 mapread 0x006b33 thru 0x013728 (0xcbf6 bytes) 000877 1783952626.363527 write 0x01a0fc thru 0x01a3b2 (0x2b7 bytes) 000878 1783952626.371674 mapread 0x025770 thru 0x0299e2 (0x4273 bytes) 000879 1783952626.388201 trunc from 0x014594 to 0x023610 (0xf07d bytes) 000881 1783952626.403359 write 0x0029cc thru 0x00557a (0x2baf bytes) 000883 1783952626.406946 punch from 0x022391 to 0x031233 (0xeea3 bytes) 000884 1783952626.416341 trunc from 0x035b89 to 0x03d3ab (0x7823 bytes) 000885 1783952626.426348 trunc from 0x01cd0e to 0x02c292 (0xf585 bytes) 000886 1783952626.434544 mapread 0x01fa8f thru 0x021ccf (0x2241 bytes) 000887 1783952626.447446 write 0x02a240 thru 0x02e2bb (0x407c bytes) 000888 1783952626.481418 trunc from 0x03d3ac to 0x02ed3e (0xe66d bytes) 000889 1783952626.546894 read 0x0206e2 thru 0x028cbf (0x85de bytes) 000890 1783952626.552923 trunc from 0x02ed3f to 0x01b151 (0x13bed bytes) 000892 1783952626.585386 write 0x030356 thru 0x034d9b (0x4a46 bytes) 000893 1783952626.588397 mapwrite 0x02f7d4 thru 0x0386c8 (0x8ef5 bytes) 000894 1783952626.687323 write 0x030f78 thru 0x03ffff (0xf088 bytes) 000895 1783952626.694387 trunc from 0x040000 to 0x03ae4c (0x51b3 bytes) 000896 1783952626.719264 punch from 0x031f0a to 0x03ae4c (0x8f43 bytes) 000897 1783952626.748971 trunc from 0x010f29 to 0x0129c6 (0x1a9e bytes) 000898 1783952626.772319 MIRROR_RESYNC 3 mirrors 000899 1783952627.856815 fallocate 0x01362a thru 0x022875 (0xf24c bytes) 000900 1783952627.894941 read 0x02de49 thru 0x036d86 (0x8f3e bytes) 000901 1783952627.900634 read 0x01475a thru 0x023144 (0xe9eb bytes) 000902 1783952627.910730 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3ae4d): Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae4d): Mirror 4: 0xea95c5da (stale) Mirror 6: 0xea95c5da (stale) CRC-32 checksum value for chunk [0, 0x3ae4d): Mirror 1: 0xea95c5da Mirror 7: 0xea95c5da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae4d: skipped 000903 1783952629.105066 MIRROR_RESYNC 4 mirrors 000904 1783952630.208663 MIRROR_EXTEND to 5 mirrors 000905 1783952631.183320 fallocate 0x027a3f thru 0x02f940 (0x7f02 bytes) 000906 1783952631.226352 mapread 0x0193dc thru 0x01de45 (0x4a6a bytes) 000907 1783952631.244012 trunc from 0x03ae4d to 0x008e40 (0x3200c bytes) 000908 1783952631.268682 trunc from 0x008e41 to 0x03828b (0x2f44b bytes) 000909 1783952631.285585 MIRROR_RESYNC 5 mirrors 000910 1783952632.026760 read 0x02788b thru 0x029011 (0x1787 bytes) 000911 1783952632.030644 punch from 0x00e03f to 0x01b29b (0xd25d bytes) 000912 1783952632.076419 mapwrite 0x02127e thru 0x028f8e (0x7d11 bytes) 000913 1783952632.117056 trunc from 0x03828c to 0x020d7c (0x1750f bytes) 000914 1783952632.136968 mapread 0x01cc15 thru 0x020d7c (0x4168 bytes) 000915 1783952632.138288 mapread 0x0191c5 thru 0x01abd6 (0x1a12 bytes) 000916 1783952632.146053 trunc from 0x020d7d to 0x01959d (0x77df bytes) 000917 1783952632.159371 mapread 0x013813 thru 0x01959d (0x5d8b bytes) 000918 1783952632.161193 trunc from 0x0194ce to 0x01959d (0xd0 bytes) 000919 1783952632.165928 trunc from 0x014b59 to 0x01959d (0x4a45 bytes) 000920 1783952632.173112 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1959e): Mirror 6: 0x2e36be6b (stale) Mirror 7: 0x2e36be6b (stale) Mirror 8: 0x2e36be6b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1959e): Mirror 6: 0x2e36be6b (stale) Mirror 7: 0x2e36be6b (stale) Mirror 8: 0x2e36be6b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1959e: skipped 000921 1783952632.503378 mapread 0x0177b2 thru 0x018247 (0xa96 bytes) 000923 1783952632.516886 trunc from 0x01959e to 0x027c2b (0xe68e bytes) 000924 1783952632.551651 write 0x003ea5 thru 0x00d722 (0x987e bytes) 000927 1783952632.565610 punch from 0x016c9a to 0x018de3 (0x214a bytes) 000928 1783952632.575058 write 0x01431f thru 0x015d72 (0x1a54 bytes) 000929 1783952632.583309 write 0x01c3d7 thru 0x0298a8 (0xd4d2 bytes) 000930 1783952632.589162 mapread 0x019482 thru 0x01b034 (0x1bb3 bytes) 000931 1783952632.596610 mapread 0x0120ba thru 0x01dc3b (0xbb82 bytes) 000932 1783952632.598371 trunc from 0x01d8ca to 0x01ed23 (0x145a bytes) 000933 1783952632.630872 mapread 0x012682 thru 0x01b440 (0x8dbf bytes) 000934 1783952632.632597 trunc from 0x01574a to 0x01a3b9 (0x4c70 bytes) 000935 1783952632.637704 punch from 0x011325 to 0x01ddaa (0xca86 bytes) 000936 1783952632.642613 write 0x01be78 thru 0x029128 (0xd2b1 bytes) 000937 1783952632.648206 trunc from 0x020a2f to 0x0298a8 (0x8e7a bytes) 000938 1783952632.684282 trunc from 0x00f17f to 0x01305b (0x3edd bytes) 000940 1783952632.689651 trunc from 0x0298a9 to 0x008df7 (0x20ab1 bytes) 000942 1783952632.740245 fallocate 0x004b64 thru 0x00fbee (0xb08b bytes) 000943 1783952632.762062 trunc from 0x008df8 to 0x025149 (0x1c352 bytes) 000944 1783952632.814116 punch from 0x0128c2 to 0x01a99f (0x80de bytes) 000945 1783952632.829276 trunc from 0x02514a to 0x02c3d9 (0x7290 bytes) 000946 1783952632.867293 mapwrite 0x012054 thru 0x020f2e (0xeedb bytes) 000948 1783952632.939172 MIRROR_RESYNC 4 mirrors 000949 1783952634.417586 fallocate 0x025566 thru 0x02c6ff (0x719a bytes) 000950 1783952634.475054 write 0x03c54b thru 0x03ffff (0x3ab5 bytes) 000951 1783952634.480197 fallocate 0x031209 thru 0x03b94a (0xa742 bytes) 000952 1783952634.498608 fallocate 0x02a81f thru 0x02d133 (0x2915 bytes) 000953 1783952634.511466 mapread 0x03f7fd thru 0x03ffff (0x803 bytes) 000954 1783952634.516046 read 0x03a89a thru 0x03ffff (0x5766 bytes) 000955 1783952634.539220 punch from 0x011afd to 0x015194 (0x3698 bytes) 000956 1783952634.547930 fallocate 0x037c57 thru 0x03ffff (0x83a9 bytes) 000957 1783952634.556527 write 0x029a5e thru 0x03193d (0x7ee0 bytes) 000958 1783952634.593761 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x4d6c191 (stale) Mirror 8: 0x4d6c191 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x4d6c191 (stale) Mirror 8: 0x4d6c191 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000959 1783952635.121352 mapread 0x0360dd thru 0x038deb (0x2d0f bytes) 000960 1783952635.164210 mapread 0x01f24f thru 0x020158 (0xf0a bytes) 000961 1783952635.177144 punch from 0x01a7db to 0x0281be (0xd9e4 bytes) 000962 1783952635.191389 trunc from 0x028b79 to 0x0379e9 (0xee71 bytes) 000963 1783952635.214932 trunc from 0x00428f to 0x013e63 (0xfbd5 bytes) 000964 1783952635.225593 read 0x024afa thru 0x029897 (0x4d9e bytes) 000965 1783952635.269883 punch from 0x035902 to 0x03ffff (0xa6fe bytes) 000966 1783952635.284988 trunc from 0x040000 to 0x03b37a (0x4c85 bytes) 000967 1783952635.323335 punch from 0x00f15c to 0x014c75 (0x5b1a bytes) 000968 1783952635.332591 read 0x021108 thru 0x02ca10 (0xb909 bytes) 000969 1783952635.382252 fallocate 0x026e48 thru 0x028b50 (0x1d09 bytes) 000970 1783952635.392867 write 0x033f7e thru 0x03ffff (0xc082 bytes) 000971 1783952635.394460 trunc from 0x040000 to 0x03f1e9 (0xe16 bytes) 000972 1783952635.421328 trunc from 0x009803 to 0x0160b1 (0xc8af bytes) 000973 1783952635.436688 fallocate 0x00e867 thru 0x01001c (0x17b6 bytes) 000974 1783952635.441690 write 0x039b42 thru 0x03cf9d (0x345c bytes) 000975 1783952635.443385 mapwrite 0x014f07 thru 0x0223b4 (0xd4ae bytes) 000976 1783952635.500213 trunc from 0x027d82 to 0x0316bc (0x993b bytes) 000977 1783952635.505293 trunc from 0x03f1ea to 0x01c173 (0x23076 bytes) 000978 1783952635.527750 trunc from 0x01c174 to 0x030932 (0x147bf bytes) 000979 1783952635.544566 read 0x009ead thru 0x018760 (0xe8b4 bytes) 000980 1783952635.557709 punch from 0x019951 to 0x01d571 (0x3c21 bytes) 000981 1783952635.574005 read 0x01d9db thru 0x02b4be (0xdae4 bytes) 000982 1783952635.587160 mapread 0x01aa8f thru 0x01f44e (0x49c0 bytes) 000983 1783952635.589201 write 0x039d9c thru 0x03ffff (0x6264 bytes) 000984 1783952635.593209 trunc from 0x040000 to 0x0382db (0x7d24 bytes) 000985 1783952635.626377 write 0x0213c1 thru 0x02db88 (0xc7c8 bytes) 000986 1783952635.638378 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x382dc): Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x382dc): Mirror 6: 0x159002ac (stale) Mirror 8: 0x159002ac (stale) CRC-32 checksum value for chunk [0, 0x382dc): Mirror 1: 0x3a8fbec Mirror 9: 0x3a8fbec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x382dc: skipped 000987 1783952636.947142 punch from 0x017983 to 0x01e994 (0x7012 bytes) 000988 1783952637.008285 write 0x019376 thru 0x022f76 (0x9c01 bytes) 000989 1783952637.027137 punch from 0x00007c to 0x009821 (0x97a6 bytes) 000991 1783952637.039223 write 0x00737f thru 0x008fa8 (0x1c2a bytes) 000992 1783952637.053146 fallocate 0x00e5d2 thru 0x01bd62 (0xd791 bytes) 000993 1783952637.057911 fallocate 0x00fe2c thru 0x014296 (0x446b bytes) 000994 1783952637.066764 fallocate 0x018c51 thru 0x01d740 (0x4af0 bytes) 000995 1783952637.080854 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x382dc): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x382dc): Mirror 6: 0x159002ac (stale) Mirror 8: 0x159002ac (stale) Mirror 9: 0x3a8fbec (stale) CRC-32 checksum value for chunk [0, 0x382dc): Mirror 1: 0xfbd3d7e8 Mirror 10: 0xfbd3d7e8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x382dc: skipped 000998 1783952638.277779 read 0x0321f1 thru 0x0382db (0x60eb bytes) 001000 1783952638.295204 mapwrite 0x0396a3 thru 0x03fa05 (0x6363 bytes) All operations completed A-OK!