== sanity-flr test 70a: flr mode fsx test ================ 20:27:24 (1787099244) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 9246 skipping zero length punch hole skipping zero length punch hole 000005 1787099247.348723 write 0x036177 thru 0x03a5d2 (0x445c bytes) 000006 1787099247.359698 read 0x006b4e thru 0x0168c8 (0xfd7b bytes) truncating to largest ever: 0x16f61 000007 1787099247.379803 trunc from 0x03a5d3 to 0x016f60 (0x23672 bytes) 000008 1787099247.401358 write 0x001753 thru 0x001cd2 (0x580 bytes) 000009 1787099247.409107 punch from 0x003cfd to 0x004e65 (0x1169 bytes) 000010 1787099247.415360 read 0x009b07 thru 0x00dbfc (0x40f6 bytes) 000011 1787099247.416886 punch from 0x015f1a to 0x016f60 (0x1047 bytes) 000012 1787099247.423225 trunc from 0x016f61 to 0x0025b7 (0x149a9 bytes) fallocating to largest ever: 0x25846 000013 1787099247.452938 fallocate 0x01bef7 thru 0x025845 (0x994f bytes) 000014 1787099247.459299 trunc from 0x0025b8 to 0x008dab (0x67f4 bytes) 000015 1787099247.486584 mapwrite 0x00d37f thru 0x00ee1e (0x1aa0 bytes) 000017 1787099247.572917 punch from 0x002a85 to 0x009f46 (0x74c2 bytes) 000018 1787099247.580452 write 0x00b28c thru 0x010f58 (0x5ccd bytes) 000019 1787099247.581744 mapwrite 0x036f8d thru 0x03e15e (0x71d2 bytes) 000022 1787099247.734913 trunc from 0x015e9f to 0x021c23 (0xbd85 bytes) 000023 1787099247.753104 write 0x01498b thru 0x017504 (0x2b7a bytes) 000024 1787099247.761084 mapwrite 0x0183e6 thru 0x024b3e (0xc759 bytes) zero_range to largest ever: 0x2c8a8 000025 1787099247.912352 trunc from 0x02c4e7 to 0x02c8a7 (0x3c1 bytes) 000026 1787099247.928375 mapwrite 0x0027c0 thru 0x0089a3 (0x61e4 bytes) 000027 1787099248.034541 punch from 0x02c2ce to 0x02ed03 (0x2a36 bytes) 000028 1787099248.047965 fallocate 0x0115a0 thru 0x015b4f (0x45b0 bytes) 000030 1787099248.068839 mapwrite 0x03081f thru 0x03e121 (0xd903 bytes) 000031 1787099248.110939 trunc from 0x03e15f to 0x00ca5b (0x31703 bytes) 000032 1787099248.176957 write 0x02eb0f thru 0x03bf46 (0xd438 bytes) 000033 1787099248.184088 punch from 0x01f103 to 0x022bb8 (0x3ab6 bytes) 000034 1787099248.195486 fallocate 0x01c444 thru 0x01e24d (0x1e0a bytes) 000035 1787099248.214629 mapwrite 0x0369ff thru 0x03ffff (0x9601 bytes) 000037 1787099248.368714 trunc from 0x040000 to 0x01e21d (0x21de2 bytes) 000038 1787099248.408389 punch from 0x004987 to 0x00c829 (0x7ea3 bytes) 000039 1787099248.425681 mapread 0x01d5a5 thru 0x01e21d (0xc79 bytes) 000040 1787099248.468525 punch from 0x0127c9 to 0x01e21d (0xba55 bytes) 000041 1787099248.487946 write 0x0127f9 thru 0x01bea7 (0x96af bytes) 000042 1787099248.505505 write 0x02db5d thru 0x036de0 (0x9284 bytes) 000043 1787099248.509451 read 0x034264 thru 0x036de0 (0x2b7d bytes) 000045 1787099248.517875 read 0x029b2e thru 0x03525b (0xb72e bytes) 000046 1787099248.538689 write 0x021bee thru 0x024794 (0x2ba7 bytes) 000047 1787099248.541912 read 0x015d60 thru 0x01a4cb (0x476c bytes) 000048 1787099248.545396 write 0x021ba5 thru 0x024d95 (0x31f1 bytes) 000049 1787099248.548379 mapwrite 0x017f74 thru 0x01ae52 (0x2edf bytes) 000050 1787099248.583753 write 0x02824b thru 0x02ebe8 (0x699e bytes) fallocating to largest ever: 0x37dd8 000051 1787099248.593629 fallocate 0x02992e thru 0x037dd7 (0xe4aa bytes) 000052 1787099248.604322 fallocate 0x0101a1 thru 0x01c863 (0xc6c3 bytes) 000053 1787099248.619452 read 0x01d04e thru 0x026709 (0x96bc bytes) 000054 1787099248.621374 read 0x00ad33 thru 0x016bf1 (0xbebf bytes) 000055 1787099248.622961 punch from 0x0182e3 to 0x025cc9 (0xd9e7 bytes) 000056 1787099248.629186 mapwrite 0x02590b thru 0x02975d (0x3e53 bytes) 000057 1787099248.661244 write 0x00c51a thru 0x0124cb (0x5fb2 bytes) 000058 1787099248.668491 punch from 0x02ad2d to 0x02e9bd (0x3c91 bytes) 000059 1787099248.678892 trunc from 0x037dd8 to 0x02716d (0x10c6a bytes) 000060 1787099248.708648 trunc from 0x009c9f to 0x00def3 (0x4255 bytes) 000061 1787099248.758507 mapread 0x0007a2 thru 0x007f64 (0x77c3 bytes) 000062 1787099248.762831 trunc from 0x016877 to 0x01e513 (0x7c9d bytes) fallocating to largest ever: 0x40000 000063 1787099248.775662 fallocate 0x03e270 thru 0x03ffff (0x1d90 bytes) 000064 1787099248.792063 MIRROR_EXTEND to 2 mirrors 000065 1787099249.808052 punch from 0x02685a to 0x035710 (0xeeb7 bytes) 000066 1787099249.857547 fallocate 0x012199 thru 0x01e717 (0xc57f bytes) 000067 1787099249.864535 punch from 0x01e3ef to 0x023b16 (0x5728 bytes) 000068 1787099249.868871 trunc from 0x040000 to 0x039790 (0x686f bytes) 000069 1787099249.899042 mapread 0x00366b thru 0x004a6c (0x1402 bytes) 000070 1787099249.914598 trunc from 0x039791 to 0x011b5d (0x27c33 bytes) 000071 1787099249.943498 trunc from 0x0047df to 0x00de58 (0x967a bytes) 000072 1787099249.959887 trunc from 0x011b5e to 0x0065ab (0xb5b2 bytes) 000073 1787099249.978835 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x65ac): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x65ac): Mirror 2: 0xe2e683c7 (stale) CRC-32 checksum value for chunk [0, 0x65ac): Mirror 1: 0x974d3980 Mirror 3: 0x974d3980 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x65ac: skipped 000074 1787099250.980161 mapread 0x006474 thru 0x0065ab (0x138 bytes) 000075 1787099251.055198 trunc from 0x002fcb to 0x00653d (0x3573 bytes) 000076 1787099251.122300 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x65ac): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x65ac): Mirror 2: 0xe2e683c7 (stale) Mirror 3: 0x974d3980 (stale) CRC-32 checksum value for chunk [0, 0x65ac): Mirror 1: 0x67b52e32 Mirror 4: 0x67b52e32 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x65ac: skipped 000077 1787099252.839612 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x65ac): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x65ac): Mirror 2: 0xe2e683c7 (stale) Mirror 3: 0x974d3980 (stale) CRC-32 checksum value for chunk [0, 0x65ac): Mirror 1: 0x67b52e32 Mirror 4: 0x67b52e32 Mirror 5: 0x67b52e32 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x65ac: skipped 000078 1787099253.748012 mapwrite 0x0117fb thru 0x0193db (0x7be1 bytes) 000079 1787099253.877114 fallocate 0x018be0 thru 0x022e67 (0xa288 bytes) 000080 1787099253.886506 punch from 0x014a55 to 0x0193db (0x4987 bytes) 000081 1787099253.905284 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x193dc): Mirror 3: 0x732a8def (stale) Mirror 4: 0xa0044df7 (stale) Mirror 5: 0xa0044df7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x193dc): Mirror 3: 0x732a8def (stale) Mirror 4: 0xa0044df7 (stale) Mirror 5: 0xa0044df7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x193dc: skipped 000082 1787099254.243166 trunc from 0x0193dc to 0x015e5e (0x357d bytes) 000083 1787099254.261559 read 0x00136f thru 0x002a23 (0x16b5 bytes) 000084 1787099254.269173 trunc from 0x015e5f to 0x0025d2 (0x1388c bytes) 000085 1787099254.324468 MIRROR_RESYNC 4 mirrors 000086 1787099254.941734 mapread 0x000c3e thru 0x0025d2 (0x1995 bytes) 000087 1787099254.956297 punch from 0x0001a7 to 0x0025d2 (0x242c bytes) 000088 1787099255.002255 trunc from 0x0025d3 to 0x02afbb (0x289e9 bytes) 000089 1787099255.055858 read 0x00afc8 thru 0x00dd39 (0x2d72 bytes) 000090 1787099255.063768 punch from 0x022b75 to 0x0258af (0x2d3b bytes) 000092 1787099255.073035 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2afbc): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2afbc): Mirror 3: 0xbe7ad631 (stale) Mirror 4: 0xbe7ad631 (stale) Mirror 5: 0xbe7ad631 (stale) CRC-32 checksum value for chunk [0, 0x2afbc): Mirror 1: 0xf26c6d3c Mirror 6: 0xf26c6d3c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2afbc: skipped 000093 1787099256.215021 mapwrite 0x022c64 thru 0x02a71e (0x7abb bytes) 000094 1787099256.389209 read 0x000d63 thru 0x00c00f (0xb2ad bytes) 000095 1787099256.403059 write 0x02a932 thru 0x030f4e (0x661d bytes) 000097 1787099256.409728 write 0x030de1 thru 0x035371 (0x4591 bytes) 000099 1787099256.412876 read 0x0291d1 thru 0x02fa54 (0x6884 bytes) 000100 1787099256.415156 write 0x024580 thru 0x0314a6 (0xcf27 bytes) 000101 1787099256.420974 write 0x0334b9 thru 0x03ffff (0xcb47 bytes) 000102 1787099256.427131 write 0x024219 thru 0x02a089 (0x5e71 bytes) 000104 1787099256.430555 fallocate 0x0188c8 thru 0x01ba3d (0x3176 bytes) 000105 1787099256.438387 read 0x02557d thru 0x02f069 (0x9aed bytes) 000106 1787099256.440352 mapwrite 0x038425 thru 0x03fd70 (0x794c bytes) 000107 1787099256.480784 mapread 0x0027da thru 0x003715 (0xf3c bytes) 000108 1787099256.485732 punch from 0x002d12 to 0x004c24 (0x1f13 bytes) 000109 1787099256.506008 MIRROR_RESYNC 5 mirrors 000110 1787099258.503821 trunc from 0x040000 to 0x015726 (0x2a8d9 bytes) 000112 1787099258.559779 mapwrite 0x025046 thru 0x029252 (0x420d bytes) 000113 1787099258.711318 mapread 0x01a5a9 thru 0x0217e0 (0x7238 bytes) 000114 1787099258.735052 mapread 0x00597a thru 0x00a85d (0x4ee4 bytes) 000115 1787099258.760192 fallocate 0x014d5b thru 0x021309 (0xc5af bytes) 000116 1787099258.779860 mapread 0x01ce7d thru 0x026275 (0x93f9 bytes) 000117 1787099258.788359 mapwrite 0x03a81f thru 0x03ffff (0x57e1 bytes) 000119 1787099258.860829 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9cdfa994 (stale) Mirror 4: 0x9cdfa994 (stale) Mirror 5: 0x9cdfa994 (stale) Mirror 6: 0x9cdfa994 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdc515533 Mirror 7: 0xdc515533 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000121 1787099260.440994 write 0x036d1a thru 0x03fb83 (0x8e6a bytes) 000122 1787099260.579310 trunc from 0x03950f to 0x03ffff (0x6af1 bytes) 000123 1787099260.609327 trunc from 0x00651b to 0x015cab (0xf791 bytes) 000124 1787099260.621965 trunc from 0x000197 to 0x004d62 (0x4bcc bytes) 000125 1787099260.639435 mapread 0x00bd33 thru 0x01267e (0x694c bytes) 000126 1787099260.683155 fallocate 0x025020 thru 0x030fa0 (0xbf81 bytes) 000127 1787099260.704933 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9cdfa994 (stale) Mirror 5: 0x9cdfa994 (stale) Mirror 6: 0x9cdfa994 (stale) Mirror 7: 0xdc515533 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9cdfa994 (stale) Mirror 5: 0x9cdfa994 (stale) Mirror 6: 0x9cdfa994 (stale) Mirror 7: 0xdc515533 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000128 1787099261.176193 trunc from 0x00149c to 0x00748e (0x5ff3 bytes) 000129 1787099261.188502 trunc from 0x02d573 to 0x03c798 (0xf226 bytes) 000130 1787099261.200008 write 0x03bbc2 thru 0x03ffff (0x443e bytes) 000131 1787099261.220072 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9cdfa994 (stale) Mirror 5: 0x9cdfa994 (stale) Mirror 6: 0x9cdfa994 (stale) Mirror 7: 0xdc515533 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9a6db4d6 Mirror 8: 0x9a6db4d6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000132 1787099262.739164 read 0x0122d5 thru 0x014e13 (0x2b3f bytes) 000133 1787099262.757928 mapwrite 0x00234e thru 0x00b46d (0x9120 bytes) 000134 1787099262.902488 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9cdfa994 (stale) Mirror 5: 0x9cdfa994 (stale) Mirror 6: 0x9cdfa994 (stale) Mirror 7: 0xdc515533 (stale) Mirror 8: 0x9a6db4d6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9b90da9d Mirror 9: 0x9b90da9d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000135 1787099264.361331 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9cdfa994 (stale) Mirror 5: 0x9cdfa994 (stale) Mirror 6: 0x9cdfa994 (stale) Mirror 7: 0xdc515533 (stale) Mirror 8: 0x9a6db4d6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9b90da9d Mirror 9: 0x9b90da9d Mirror 10: 0x9b90da9d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000136 1787099265.651989 read 0x02b8de thru 0x034b05 (0x9228 bytes) 000137 1787099265.674015 mapwrite 0x038269 thru 0x03eb5c (0x68f4 bytes) 000138 1787099265.900504 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9cdfa994 (stale) Mirror 5: 0x9cdfa994 (stale) Mirror 6: 0x9cdfa994 (stale) Mirror 7: 0xdc515533 (stale) Mirror 8: 0x9a6db4d6 (stale) Mirror 9: 0x9b90da9d (stale) Mirror 10: 0x9b90da9d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9c3b7a41 Mirror 11: 0x9c3b7a41 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000139 1787099267.460531 mapwrite 0x0119e6 thru 0x01faa4 (0xe0bf bytes) 000140 1787099267.591205 mapread 0x029c97 thru 0x038aca (0xee34 bytes) 000141 1787099267.622712 mapwrite 0x034f68 thru 0x03ffff (0xb098 bytes) 000143 1787099267.666651 mapwrite 0x02f231 thru 0x033952 (0x4722 bytes) 000144 1787099267.694161 punch from 0x00afd6 to 0x0133e7 (0x8412 bytes) 000145 1787099267.702436 trunc from 0x01666e to 0x025444 (0xedd7 bytes) 000146 1787099267.711558 mapwrite 0x03ee30 thru 0x03ffff (0x11d0 bytes) 000147 1787099267.733601 mapread 0x009b61 thru 0x00d43e (0x38de bytes) 000149 1787099267.748261 write 0x02218e thru 0x02bdec (0x9c5f bytes) 000150 1787099267.769004 trunc from 0x040000 to 0x03a90f (0x56f0 bytes) 000151 1787099267.797158 mapread 0x01bebe thru 0x02b313 (0xf456 bytes) 000152 1787099267.811183 write 0x001978 thru 0x00de3e (0xc4c7 bytes) 000153 1787099267.819894 trunc from 0x03a910 to 0x02977b (0x11194 bytes) 000154 1787099267.847509 punch from 0x00ed2f to 0x017c7e (0x8f50 bytes) 000156 1787099267.858961 fallocate 0x033704 thru 0x036576 (0x2e73 bytes) 000157 1787099267.865612 punch from 0x003853 to 0x010e69 (0xd617 bytes) 000158 1787099267.883583 fallocate 0x0373dd thru 0x03ffff (0x8c23 bytes) 000159 1787099267.894116 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9cdfa994 (stale) Mirror 5: 0x9cdfa994 (stale) Mirror 6: 0x9cdfa994 (stale) Mirror 7: 0xdc515533 (stale) Mirror 8: 0x9a6db4d6 (stale) Mirror 9: 0x9b90da9d (stale) Mirror 10: 0x9b90da9d (stale) Mirror 11: 0x9c3b7a41 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x286d4498 Mirror 12: 0x286d4498 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000160 1787099269.060154 punch from 0x0207d6 to 0x02c457 (0xbc82 bytes) 000161 1787099269.105496 punch from 0x039e63 to 0x03ffff (0x619d bytes) 000162 1787099269.113626 trunc from 0x040000 to 0x00e1b2 (0x31e4d bytes) 000163 1787099269.137368 write 0x003a4a thru 0x010898 (0xce4f bytes) 000164 1787099269.147212 fallocate 0x018f07 thru 0x023d40 (0xae3a bytes) 000165 1787099269.153203 mapwrite 0x00bb51 thru 0x0139b7 (0x7e67 bytes) 000166 1787099269.200586 mapread 0x0093bd thru 0x00cd08 (0x394c bytes) 000167 1787099269.201823 trunc from 0x0139b8 to 0x0310d3 (0x1d71c bytes) 000168 1787099269.225883 trunc from 0x0310d4 to 0x01dff3 (0x130e0 bytes) 000169 1787099269.246773 trunc from 0x0085ab to 0x0163e6 (0xde3c bytes) 000170 1787099269.253199 trunc from 0x01399f to 0x01dff3 (0xa655 bytes) 000172 1787099269.260105 mapwrite 0x0332d6 thru 0x03ffff (0xcd2a bytes) 000173 1787099269.314719 mapread 0x01d309 thru 0x0266d9 (0x93d1 bytes) 000174 1787099269.338970 read 0x034c4a thru 0x0362bf (0x1676 bytes) 000175 1787099269.339826 write 0x00d29f thru 0x018d95 (0xbaf7 bytes) 000176 1787099269.346798 fallocate 0x013381 thru 0x0166aa (0x332a bytes) 000177 1787099269.355992 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9cdfa994 (stale) Mirror 5: 0x9cdfa994 (stale) Mirror 6: 0x9cdfa994 (stale) Mirror 7: 0xdc515533 (stale) Mirror 8: 0x9a6db4d6 (stale) Mirror 9: 0x9b90da9d (stale) Mirror 10: 0x9b90da9d (stale) Mirror 11: 0x9c3b7a41 (stale) Mirror 12: 0x286d4498 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb18a6c06 Mirror 13: 0xb18a6c06 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000178 1787099270.735096 read 0x02f8a7 thru 0x03b10b (0xb865 bytes) 000179 1787099270.750381 fallocate 0x000446 thru 0x004193 (0x3d4e bytes) 000180 1787099270.835181 write 0x01502e thru 0x01e062 (0x9035 bytes) 000181 1787099270.859054 write 0x024569 thru 0x02a675 (0x610d bytes) 000182 1787099270.876900 punch from 0x01f82f to 0x0279cd (0x819f bytes) 000183 1787099270.897387 punch from 0x03f12f to 0x03ffff (0xed1 bytes) 000184 1787099270.913750 trunc from 0x0237be to 0x02eb21 (0xb364 bytes) 000185 1787099270.932756 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9cdfa994 (stale) Mirror 5: 0x9cdfa994 (stale) Mirror 6: 0x9cdfa994 (stale) Mirror 7: 0xdc515533 (stale) Mirror 8: 0x9a6db4d6 (stale) Mirror 9: 0x9b90da9d (stale) Mirror 10: 0x9b90da9d (stale) Mirror 11: 0x9c3b7a41 (stale) Mirror 12: 0x286d4498 (stale) Mirror 13: 0xb18a6c06 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x28fe426 Mirror 14: 0x28fe426 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000186 1787099272.497197 read 0x0334b2 thru 0x03ffff (0xcb4e bytes) 000187 1787099272.522808 write 0x004b6e thru 0x0107af (0xbc42 bytes) 000188 1787099272.582835 trunc from 0x040000 to 0x03d218 (0x2de7 bytes) 000189 1787099272.620346 MIRROR_RESYNC 12 mirrors 000190 1787099275.471913 trunc from 0x03d219 to 0x017fe1 (0x25237 bytes) 000191 1787099275.583187 read 0x009b79 thru 0x01592a (0xbdb2 bytes) 000192 1787099275.633168 write 0x00cdf5 thru 0x017c50 (0xae5c bytes) 000194 1787099275.660437 trunc from 0x009265 to 0x01135d (0x80f9 bytes) 000195 1787099275.696490 trunc from 0x00a8f5 to 0x00cade (0x21ea bytes) 000196 1787099275.706870 punch from 0x0028b7 to 0x003e71 (0x15bb bytes) 000197 1787099275.724546 fallocate 0x00511d thru 0x0146bc (0xf5a0 bytes) 000198 1787099275.739019 fallocate 0x03c3b5 thru 0x03c896 (0x4e2 bytes) 000199 1787099275.749101 trunc from 0x00005a to 0x001f1a (0x1ec1 bytes) 000200 1787099275.760400 read 0x001d55 thru 0x00be79 (0xa125 bytes) 000201 1787099275.773210 trunc from 0x017fe2 to 0x02a7b1 (0x127d0 bytes) 000202 1787099275.814243 trunc from 0x01a379 to 0x027abc (0xd744 bytes) 000203 1787099275.824437 read 0x029b4f thru 0x02a7b1 (0xc63 bytes) 000204 1787099275.843557 trunc from 0x02a7b2 to 0x022f3f (0x7872 bytes) 000205 1787099275.870016 trunc from 0x016b0e to 0x01f7eb (0x8cde bytes) 000206 1787099275.877537 trunc from 0x022f40 to 0x00b9b5 (0x1758a bytes) 000207 1787099275.923092 MIRROR_RESYNC 12 mirrors 000208 1787099278.012732 mapread 0x00aceb thru 0x00aeb5 (0x1cb bytes) 000209 1787099278.030330 punch from 0x0038a7 to 0x00b9b5 (0x810f bytes) 000210 1787099278.096476 mapwrite 0x03a839 thru 0x03affd (0x7c5 bytes) 000211 1787099278.180753 punch from 0x0249fd to 0x02daab (0x90af bytes) 000212 1787099278.192880 punch from 0x0242a3 to 0x02b703 (0x7461 bytes) 000213 1787099278.211479 MIRROR_RESYNC 12 mirrors 000214 1787099280.274239 punch from 0x00922c to 0x018f11 (0xfce6 bytes) 000215 1787099280.320764 punch from 0x02c113 to 0x032987 (0x6875 bytes) 000216 1787099280.326477 write 0x00cb60 thru 0x0156a9 (0x8b4a bytes) 000217 1787099280.340362 mapwrite 0x005f42 thru 0x0123d8 (0xc497 bytes) 000218 1787099280.384274 mapwrite 0x00856a thru 0x00a687 (0x211e bytes) 000219 1787099280.397205 fallocate 0x027888 thru 0x027d88 (0x501 bytes) 000220 1787099280.402749 mapwrite 0x035645 thru 0x03d4ca (0x7e86 bytes) 000221 1787099280.468642 trunc from 0x03d4cb to 0x000006 (0x3d4c4 bytes) 000223 1787099280.503953 mapwrite 0x01e3af thru 0x02a8df (0xc531 bytes) 000224 1787099280.588101 write 0x02f8b1 thru 0x035289 (0x59d9 bytes) 000225 1787099280.591143 mapwrite 0x014fbb thru 0x01f8f0 (0xa936 bytes) 000226 1787099280.632360 mapwrite 0x027b67 thru 0x02c71d (0x4bb7 bytes) 000227 1787099280.710833 trunc from 0x026962 to 0x029b41 (0x31e0 bytes) 000228 1787099280.718703 mapread 0x03203e thru 0x035289 (0x324c bytes) 000230 1787099280.722150 trunc from 0x00d880 to 0x00f7c3 (0x1f44 bytes) 000231 1787099280.728179 trunc from 0x03528a to 0x00b5f1 (0x29c98 bytes) 000233 1787099280.754930 trunc from 0x00b5f2 to 0x00ae2b (0x7c6 bytes) 000236 1787099280.784976 write 0x01351d thru 0x0166b2 (0x3196 bytes) 000237 1787099280.790007 read 0x00048d thru 0x00ec08 (0xe77c bytes) 000238 1787099280.809125 mapread 0x010908 thru 0x013b7c (0x3275 bytes) 000239 1787099280.822451 punch from 0x0159da to 0x0166b2 (0xcd9 bytes) 000240 1787099280.847253 fallocate 0x0231f0 thru 0x032e82 (0xfc93 bytes) 000241 1787099280.856796 write 0x004094 thru 0x0041db (0x148 bytes) 000242 1787099280.857914 read 0x003e8f thru 0x00c53c (0x86ae bytes) 000244 1787099280.862967 trunc from 0x010914 to 0x0162d6 (0x59c3 bytes) 000245 1787099280.871201 read 0x0038ab thru 0x01053a (0xcc90 bytes) 000246 1787099280.887292 mapread 0x024964 thru 0x02b2f2 (0x698f bytes) 000247 1787099280.889636 trunc from 0x032e83 to 0x03b54d (0x86cb bytes) 000248 1787099280.914932 read 0x010f4b thru 0x01dded (0xcea3 bytes) 000250 1787099280.917209 trunc from 0x00bb96 to 0x012c4f (0x70ba bytes) 000251 1787099280.923883 mapwrite 0x013eb5 thru 0x01d211 (0x935d bytes) 000252 1787099280.946108 punch from 0x014f42 to 0x017431 (0x24f0 bytes) 000253 1787099280.952248 mapwrite 0x00b421 thru 0x01324b (0x7e2b bytes) 000255 1787099280.983196 punch from 0x025f9c to 0x035a4d (0xfab2 bytes) 000256 1787099280.987926 mapread 0x00c7bd thru 0x0175ef (0xae33 bytes) 000257 1787099280.990178 fallocate 0x009bf8 thru 0x00f1e8 (0x55f1 bytes) 000258 1787099280.996775 mapwrite 0x019255 thru 0x023696 (0xa442 bytes) 000259 1787099281.040561 MIRROR_SPLIT mirror 9 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b54e): Mirror 4: 0x64ca4735 (stale) Mirror 5: 0x64ca4735 (stale) Mirror 6: 0x64ca4735 (stale) Mirror 7: 0x64ca4735 (stale) Mirror 8: 0x64ca4735 (stale) Mirror 9: 0x64ca4735 (stale) Mirror 10: 0x64ca4735 (stale) Mirror 11: 0x64ca4735 (stale) Mirror 13: 0x64ca4735 (stale) Mirror 14: 0x64ca4735 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b54e): Mirror 4: 0x64ca4735 (stale) Mirror 5: 0x64ca4735 (stale) Mirror 6: 0x64ca4735 (stale) Mirror 7: 0x64ca4735 (stale) Mirror 8: 0x64ca4735 (stale) Mirror 9: 0x64ca4735 (stale) Mirror 10: 0x64ca4735 (stale) Mirror 11: 0x64ca4735 (stale) Mirror 13: 0x64ca4735 (stale) Mirror 14: 0x64ca4735 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b54e: skipped 000260 1787099281.820514 write 0x03f243 thru 0x03ffff (0xdbd bytes) 000261 1787099281.828155 mapwrite 0x022200 thru 0x02c89f (0xa6a0 bytes) 000262 1787099281.888184 mapwrite 0x02c08d thru 0x033816 (0x778a bytes) 000264 1787099281.927135 trunc from 0x00a314 to 0x016ddc (0xcac9 bytes) 000265 1787099281.935571 trunc from 0x034493 to 0x03ffff (0xbb6d bytes) 000267 1787099281.951301 mapwrite 0x023c68 thru 0x0324c8 (0xe861 bytes) 000268 1787099282.000026 punch from 0x0034f3 to 0x008374 (0x4e82 bytes) 000269 1787099282.008284 mapread 0x035938 thru 0x03faae (0xa177 bytes) 000270 1787099282.030365 trunc from 0x040000 to 0x01fc2a (0x203d5 bytes) 000271 1787099282.061278 write 0x026d00 thru 0x0306e5 (0x99e6 bytes) 000272 1787099282.062910 punch from 0x00d960 to 0x01d7ba (0xfe5b bytes) 000273 1787099282.075599 read 0x011661 thru 0x018473 (0x6e13 bytes) 000274 1787099282.103116 read 0x0029d4 thru 0x00f600 (0xcc2d bytes) 000276 1787099282.133064 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x306e6): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x306e6): Mirror 4: 0xc26fb5ef (stale) Mirror 5: 0xc26fb5ef (stale) Mirror 6: 0xc26fb5ef (stale) Mirror 7: 0xc26fb5ef (stale) Mirror 8: 0xc26fb5ef (stale) Mirror 9: 0xc26fb5ef (stale) Mirror 10: 0xc26fb5ef (stale) Mirror 11: 0xc26fb5ef (stale) Mirror 13: 0xc26fb5ef (stale) Mirror 14: 0xc26fb5ef (stale) CRC-32 checksum value for chunk [0, 0x306e6): Mirror 1: 0x8b7e505d Mirror 15: 0x8b7e505d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x306e6: skipped 000277 1787099283.390878 trunc from 0x01bec0 to 0x01d51f (0x1660 bytes) 000278 1787099283.438562 punch from 0x0114b1 to 0x011f0b (0xa5b bytes) 000279 1787099283.443794 punch from 0x026a73 to 0x02b86f (0x4dfd bytes) 000280 1787099283.451810 fallocate 0x00f53e thru 0x01e139 (0xebfc bytes) 000281 1787099283.468131 MIRROR_RESYNC 12 mirrors 000282 1787099287.058573 fallocate 0x029a86 thru 0x02aa50 (0xfcb bytes) 000283 1787099287.122324 trunc from 0x02dfda to 0x0306e5 (0x270c bytes) 000284 1787099287.133132 mapwrite 0x015c26 thru 0x02363c (0xda17 bytes) 000285 1787099287.186186 trunc from 0x0115d8 to 0x01250a (0xf33 bytes) 000286 1787099287.190734 mapwrite 0x03923d thru 0x03ffff (0x6dc3 bytes) 000287 1787099287.244740 trunc from 0x01b0b3 to 0x0287a9 (0xd6f7 bytes) 000288 1787099287.254146 mapread 0x00d09d thru 0x019206 (0xc16a bytes) 000289 1787099287.266142 mapread 0x032653 thru 0x03adb0 (0x875e bytes) 000290 1787099287.268006 mapread 0x01341f thru 0x019ee8 (0x6aca bytes) 000291 1787099287.270171 fallocate 0x03b5d5 thru 0x03f207 (0x3c33 bytes) 000292 1787099287.275082 read 0x03c54c thru 0x03ffff (0x3ab4 bytes) 000293 1787099287.276751 mapwrite 0x01938b thru 0x0194b5 (0x12b bytes) 000294 1787099287.289223 trunc from 0x03cbee to 0x03ffff (0x3412 bytes) 000295 1787099287.296768 read 0x019c38 thru 0x0203fe (0x67c7 bytes) 000296 1787099287.309859 mapwrite 0x03ab5c thru 0x03ffff (0x54a4 bytes) 000297 1787099287.329952 fallocate 0x01337b thru 0x01940e (0x6094 bytes) 000298 1787099287.341225 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1036c42a (stale) Mirror 5: 0x1036c42a (stale) Mirror 6: 0x1036c42a (stale) Mirror 7: 0x1036c42a (stale) Mirror 8: 0x1036c42a (stale) Mirror 9: 0x1036c42a (stale) Mirror 10: 0x1036c42a (stale) Mirror 11: 0x1036c42a (stale) Mirror 13: 0x1036c42a (stale) Mirror 14: 0x1036c42a (stale) Mirror 15: 0x1036c42a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5a7e16b2 Mirror 16: 0x5a7e16b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000299 1787099288.823870 trunc from 0x023ee6 to 0x025841 (0x195c bytes) 000300 1787099288.890998 mapwrite 0x000187 thru 0x00e8da (0xe754 bytes) 000302 1787099289.002238 mapread 0x0088ed thru 0x0115c7 (0x8cdb bytes) 000303 1787099289.014694 mapread 0x01675b thru 0x018f89 (0x282f bytes) 000304 1787099289.016615 punch from 0x00d621 to 0x01b5f7 (0xdfd7 bytes) 000305 1787099289.022714 mapwrite 0x02bbb8 thru 0x03165e (0x5aa7 bytes) 000306 1787099289.061217 punch from 0x00bfcb to 0x017837 (0xb86d bytes) 000307 1787099289.069160 punch from 0x017292 to 0x01a8f6 (0x3665 bytes) 000308 1787099289.075687 read 0x02a620 thru 0x0316fd (0x70de bytes) 000309 1787099289.076751 write 0x02c085 thru 0x03449d (0x8419 bytes) 000310 1787099289.094256 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1036c42a (stale) Mirror 5: 0x1036c42a (stale) Mirror 6: 0x1036c42a (stale) Mirror 7: 0x1036c42a (stale) Mirror 8: 0x1036c42a (stale) Mirror 9: 0x1036c42a (stale) Mirror 10: 0x1036c42a (stale) Mirror 11: 0x1036c42a (stale) Mirror 13: 0x1036c42a (stale) Mirror 14: 0x1036c42a (stale) Mirror 15: 0x1036c42a (stale) Mirror 16: 0x5a7e16b2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3b87bdf Mirror 17: 0x3b87bdf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000311 1787099290.806802 trunc from 0x040000 to 0x003ed2 (0x3c12d bytes) 000312 1787099290.974566 trunc from 0x003ed3 to 0x001e62 (0x2070 bytes) 000313 1787099290.997786 trunc from 0x001bc0 to 0x001e62 (0x2a3 bytes) 000314 1787099291.003992 trunc from 0x001e63 to 0x0209f4 (0x1eb92 bytes) 000315 1787099291.022081 read 0x01b631 thru 0x0209f4 (0x53c4 bytes) 000316 1787099291.035190 mapread 0x003d16 thru 0x010b19 (0xce04 bytes) 000317 1787099291.058980 trunc from 0x0175fc to 0x0209f4 (0x93f9 bytes) 000319 1787099291.065793 write 0x01a50c thru 0x026d4d (0xc842 bytes) 000320 1787099291.074506 punch from 0x01af22 to 0x01bf69 (0x1048 bytes) 000321 1787099291.092111 mapread 0x0199c3 thru 0x02547b (0xbab9 bytes) 000322 1787099291.106783 punch from 0x024c07 to 0x026d4d (0x2147 bytes) 000323 1787099291.117164 MIRROR_SPLIT mirror 4 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26d4e): Mirror 4: 0xf15b32dc (stale) Mirror 5: 0xf15b32dc (stale) Mirror 6: 0xf15b32dc (stale) Mirror 8: 0xf15b32dc (stale) Mirror 9: 0xf15b32dc (stale) Mirror 10: 0xf15b32dc (stale) Mirror 11: 0xf15b32dc (stale) Mirror 13: 0xf15b32dc (stale) Mirror 14: 0xf15b32dc (stale) Mirror 15: 0xf15b32dc (stale) Mirror 16: 0x1132f5b5 (stale) Mirror 17: 0x60da2d3d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26d4e): Mirror 4: 0xf15b32dc (stale) Mirror 5: 0xf15b32dc (stale) Mirror 6: 0xf15b32dc (stale) Mirror 8: 0xf15b32dc (stale) Mirror 9: 0xf15b32dc (stale) Mirror 10: 0xf15b32dc (stale) Mirror 11: 0xf15b32dc (stale) Mirror 13: 0xf15b32dc (stale) Mirror 14: 0xf15b32dc (stale) Mirror 15: 0xf15b32dc (stale) Mirror 16: 0x1132f5b5 (stale) Mirror 17: 0x60da2d3d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26d4e: skipped 000324 1787099291.905560 mapwrite 0x01f84f thru 0x024b02 (0x52b4 bytes) 000325 1787099291.968552 punch from 0x0023aa to 0x00667e (0x42d5 bytes) 000326 1787099291.976013 trunc from 0x00fae9 to 0x01ca66 (0xcf7e bytes) 000328 1787099291.996611 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26d4e): Mirror 5: 0xf15b32dc (stale) Mirror 6: 0xf15b32dc (stale) Mirror 8: 0xf15b32dc (stale) Mirror 9: 0xf15b32dc (stale) Mirror 10: 0xf15b32dc (stale) Mirror 11: 0xf15b32dc (stale) Mirror 13: 0xf15b32dc (stale) Mirror 14: 0xf15b32dc (stale) Mirror 15: 0xf15b32dc (stale) Mirror 16: 0x1132f5b5 (stale) Mirror 17: 0x60da2d3d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26d4e): Mirror 5: 0xf15b32dc (stale) Mirror 6: 0xf15b32dc (stale) Mirror 8: 0xf15b32dc (stale) Mirror 9: 0xf15b32dc (stale) Mirror 10: 0xf15b32dc (stale) Mirror 11: 0xf15b32dc (stale) Mirror 13: 0xf15b32dc (stale) Mirror 14: 0xf15b32dc (stale) Mirror 15: 0xf15b32dc (stale) Mirror 16: 0x1132f5b5 (stale) Mirror 17: 0x60da2d3d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26d4e: skipped 000329 1787099292.835132 trunc from 0x0006fa to 0x0084fb (0x7e02 bytes) 000330 1787099292.841580 read 0x011cd9 thru 0x021935 (0xfc5d bytes) 000331 1787099292.853707 punch from 0x0101e7 to 0x01da8c (0xd8a6 bytes) 000332 1787099292.863552 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26d4e): Mirror 5: 0xf15b32dc (stale) Mirror 6: 0xf15b32dc (stale) Mirror 8: 0xf15b32dc (stale) Mirror 9: 0xf15b32dc (stale) Mirror 10: 0xf15b32dc (stale) Mirror 13: 0xf15b32dc (stale) Mirror 14: 0xf15b32dc (stale) Mirror 15: 0xf15b32dc (stale) Mirror 16: 0x1132f5b5 (stale) Mirror 17: 0x60da2d3d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26d4e): Mirror 5: 0xf15b32dc (stale) Mirror 6: 0xf15b32dc (stale) Mirror 8: 0xf15b32dc (stale) Mirror 9: 0xf15b32dc (stale) Mirror 10: 0xf15b32dc (stale) Mirror 13: 0xf15b32dc (stale) Mirror 14: 0xf15b32dc (stale) Mirror 15: 0xf15b32dc (stale) Mirror 16: 0x1132f5b5 (stale) Mirror 17: 0x60da2d3d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26d4e: skipped 000333 1787099293.485712 MIRROR_RESYNC 11 mirrors 000334 1787099296.201569 write 0x010b7d thru 0x01dea8 (0xd32c bytes) 000335 1787099296.271272 fallocate 0x0299f6 thru 0x034a21 (0xb02c bytes) 000336 1787099296.282984 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x26d4e): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26d4e): Mirror 5: 0x34b0f269 (stale) Mirror 6: 0x34b0f269 (stale) Mirror 8: 0x34b0f269 (stale) Mirror 9: 0x34b0f269 (stale) Mirror 10: 0x34b0f269 (stale) Mirror 13: 0x34b0f269 (stale) Mirror 14: 0x34b0f269 (stale) Mirror 15: 0x34b0f269 (stale) Mirror 16: 0x34b0f269 (stale) Mirror 17: 0x34b0f269 (stale) CRC-32 checksum value for chunk [0, 0x26d4e): Mirror 1: 0x8e59c970 Mirror 18: 0x8e59c970 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26d4e: skipped 000337 1787099297.711304 MIRROR_RESYNC 12 mirrors 000338 1787099300.302537 trunc from 0x026d4e to 0x0206a5 (0x66a8 bytes) 000339 1787099300.371395 read 0x0047fd thru 0x00a00f (0x5813 bytes) 000341 1787099300.385008 trunc from 0x0206a6 to 0x03ece1 (0x1e63c bytes) 000342 1787099300.407287 punch from 0x02365e to 0x0263d7 (0x2d7a bytes) 000343 1787099300.415299 write 0x01e2a9 thru 0x02c9e1 (0xe739 bytes) 000344 1787099300.426127 write 0x032a2d thru 0x03dc6d (0xb241 bytes) 000345 1787099300.436961 fallocate 0x00d8d2 thru 0x01c364 (0xea93 bytes) 000346 1787099300.441908 trunc from 0x01b4cb to 0x02ac20 (0xf756 bytes) 000347 1787099300.460946 trunc from 0x028328 to 0x032dc3 (0xaa9c bytes) 000348 1787099300.471626 read 0x01cf00 thru 0x026dd7 (0x9ed8 bytes) 000350 1787099300.503043 trunc from 0x03ece2 to 0x00968e (0x35653 bytes) 000351 1787099300.520691 mapread 0x000c17 thru 0x00968e (0x8a78 bytes) 000352 1787099300.522293 punch from 0x006461 to 0x007bb5 (0x1755 bytes) 000353 1787099300.536607 MIRROR_RESYNC 12 mirrors 000354 1787099302.496957 mapwrite 0x010505 thru 0x017d44 (0x7840 bytes) 000355 1787099302.619375 mapwrite 0x02132a thru 0x02c06d (0xad44 bytes) 000356 1787099302.710867 trunc from 0x00fa3d to 0x01edff (0xf3c3 bytes) 000357 1787099302.715360 trunc from 0x02c06e to 0x0341b5 (0x8148 bytes) 000358 1787099302.735810 trunc from 0x004d5d to 0x00dc2e (0x8ed2 bytes) 000359 1787099302.742836 mapwrite 0x015e2e thru 0x019559 (0x372c bytes) 000360 1787099302.791256 read 0x004c96 thru 0x00c0a2 (0x740d bytes) 000361 1787099302.802000 mapread 0x019bc8 thru 0x01fbbc (0x5ff5 bytes) 000362 1787099302.809838 fallocate 0x0247c3 thru 0x0296ad (0x4eeb bytes) 000364 1787099302.817780 write 0x002aa7 thru 0x003ed2 (0x142c bytes) 000365 1787099302.828563 read 0x02f227 thru 0x0341b5 (0x4f8f bytes) 000366 1787099302.842150 mapwrite 0x0222bf thru 0x0310c9 (0xee0b bytes) 000368 1787099302.874738 mapread 0x028908 thru 0x033873 (0xaf6c bytes) 000369 1787099302.877823 write 0x033d97 thru 0x03ffff (0xc269 bytes) 000370 1787099302.880320 mapread 0x0082a4 thru 0x009095 (0xdf2 bytes) 000371 1787099302.882833 mapwrite 0x02ae87 thru 0x032c39 (0x7db3 bytes) 000372 1787099302.905066 read 0x00f051 thru 0x014240 (0x51f0 bytes) 000373 1787099302.906841 mapwrite 0x03711b thru 0x03958b (0x2471 bytes) 000374 1787099302.922430 mapwrite 0x0023b0 thru 0x0111cd (0xee1e bytes) 000375 1787099302.948589 mapread 0x013ff6 thru 0x0224bb (0xe4c6 bytes) 000376 1787099302.951143 fallocate 0x01acab thru 0x029a93 (0xede9 bytes) 000377 1787099302.957737 trunc from 0x02e724 to 0x02f037 (0x914 bytes) 000378 1787099302.965656 punch from 0x038757 to 0x038920 (0x1ca bytes) 000379 1787099302.973301 punch from 0x00d5af to 0x00fba8 (0x25fa bytes) 000380 1787099302.981940 mapread 0x00d708 thru 0x01d531 (0xfe2a bytes) 000381 1787099302.993538 mapwrite 0x031693 thru 0x035e6f (0x47dd bytes) 000382 1787099303.011550 punch from 0x022995 to 0x02764a (0x4cb6 bytes) 000383 1787099303.022664 trunc from 0x000eb1 to 0x00bd40 (0xae90 bytes) 000384 1787099303.040498 fallocate 0x03913c thru 0x03ffff (0x6ec4 bytes) 000385 1787099303.052866 punch from 0x02150e to 0x02f40c (0xdeff bytes) 000386 1787099303.078264 trunc from 0x007306 to 0x00987f (0x257a bytes) 000387 1787099303.088278 trunc from 0x011a81 to 0x01aff3 (0x9573 bytes) 000388 1787099303.098497 trunc from 0x040000 to 0x028bfb (0x17404 bytes) 000389 1787099303.124450 read 0x0246a8 thru 0x028bfb (0x4554 bytes) 000390 1787099303.145299 mapwrite 0x0288f4 thru 0x02ae31 (0x253e bytes) 000391 1787099303.232258 fallocate 0x03f3dd thru 0x03ffff (0xc23 bytes) 000392 1787099303.250810 fallocate 0x0385d1 thru 0x03c9e2 (0x4412 bytes) 000393 1787099303.273165 trunc from 0x006ee3 to 0x0089ed (0x1b0b bytes) 000394 1787099303.299367 read 0x00fe27 thru 0x01a406 (0xa5e0 bytes) 000395 1787099303.300195 mapread 0x007ba0 thru 0x0165b4 (0xea15 bytes) 000396 1787099303.308746 mapwrite 0x03cccf thru 0x03ffff (0x3331 bytes) 000397 1787099303.479076 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x651cf1f3 (stale) Mirror 6: 0x651cf1f3 (stale) Mirror 8: 0x651cf1f3 (stale) Mirror 9: 0x651cf1f3 (stale) Mirror 10: 0x651cf1f3 (stale) Mirror 13: 0x651cf1f3 (stale) Mirror 14: 0x651cf1f3 (stale) Mirror 15: 0x651cf1f3 (stale) Mirror 16: 0x651cf1f3 (stale) Mirror 17: 0x651cf1f3 (stale) Mirror 18: 0x651cf1f3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2c636e27 Mirror 19: 0x2c636e27 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000398 1787099305.202888 trunc from 0x040000 to 0x022d7a (0x1d285 bytes) 000399 1787099305.343465 fallocate 0x02c1c9 thru 0x032f85 (0x6dbd bytes) 000400 1787099305.352681 trunc from 0x032f86 to 0x016d9c (0x1c1e9 bytes) 000401 1787099305.380186 write 0x0068ce thru 0x0161a1 (0xf8d4 bytes) 000402 1787099305.409642 fallocate 0x03d70c thru 0x03ffff (0x28f4 bytes) 000403 1787099305.420289 punch from 0x0047b9 to 0x00ba8c (0x72d4 bytes) 000404 1787099305.454817 punch from 0x00fb04 to 0x016d9c (0x7299 bytes) 000405 1787099305.461876 read 0x003303 thru 0x00b7e7 (0x84e5 bytes) 000406 1787099305.479725 read 0x00ea15 thru 0x016d9c (0x8388 bytes) 000407 1787099305.495440 fallocate 0x00a553 thru 0x019d04 (0xf7b2 bytes) 000408 1787099305.509496 mapwrite 0x0375f3 thru 0x03ffff (0x8a0d bytes) 000409 1787099305.661931 mapread 0x013fb9 thru 0x018ead (0x4ef5 bytes) 000410 1787099305.668228 fallocate 0x000301 thru 0x0074df (0x71df bytes) 000412 1787099305.684940 write 0x022f2e thru 0x025002 (0x20d5 bytes) 000413 1787099305.688441 mapread 0x035067 thru 0x038d19 (0x3cb3 bytes) 000414 1787099305.692486 mapwrite 0x00784f thru 0x00acb6 (0x3468 bytes) 000415 1787099305.721369 mapwrite 0x01c03b thru 0x02075d (0x4723 bytes) 000416 1787099305.779196 MIRROR_RESYNC 13 mirrors 000417 1787099312.277916 trunc from 0x040000 to 0x005707 (0x3a8f8 bytes) 000419 1787099312.385003 punch from 0x0027c5 to 0x005707 (0x2f43 bytes) 000421 1787099312.399079 fallocate 0x0134e8 thru 0x01d9b8 (0xa4d1 bytes) 000422 1787099312.410042 read 0x005081 thru 0x005707 (0x687 bytes) 000423 1787099312.417469 punch from 0x002175 to 0x00485f (0x26eb bytes) 000424 1787099312.424366 trunc from 0x003c45 to 0x005707 (0x1ac3 bytes) 000425 1787099312.435135 read 0x004dd7 thru 0x005707 (0x931 bytes) 000426 1787099312.450993 mapwrite 0x01a834 thru 0x023af4 (0x92c1 bytes) 000427 1787099312.511546 fallocate 0x02d73c thru 0x031138 (0x39fd bytes) 000428 1787099312.517638 trunc from 0x031139 to 0x011d22 (0x1f416 bytes) 000429 1787099312.537151 trunc from 0x011d23 to 0x02cc2b (0x1af09 bytes) 000430 1787099312.579522 read 0x0133a8 thru 0x01e406 (0xb05f bytes) 000431 1787099312.620967 read 0x004d07 thru 0x004dc9 (0xc3 bytes) 000432 1787099312.625370 read 0x005c31 thru 0x013ab9 (0xde89 bytes) 000433 1787099312.632079 fallocate 0x032fe5 thru 0x03c185 (0x91a1 bytes) 000434 1787099312.655318 trunc from 0x0260b2 to 0x02e924 (0x8873 bytes) 000435 1787099312.668797 fallocate 0x032c2b thru 0x03f7c0 (0xcb96 bytes) 000436 1787099312.688731 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3c186): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c186): Mirror 5: 0x2ba1f783 (stale) Mirror 6: 0x2ba1f783 (stale) Mirror 8: 0x2ba1f783 (stale) Mirror 9: 0x2ba1f783 (stale) Mirror 10: 0x2ba1f783 (stale) Mirror 13: 0x2ba1f783 (stale) Mirror 14: 0x2ba1f783 (stale) Mirror 15: 0x2ba1f783 (stale) Mirror 16: 0x2ba1f783 (stale) Mirror 17: 0x2ba1f783 (stale) Mirror 18: 0x2ba1f783 (stale) Mirror 19: 0x2ba1f783 (stale) CRC-32 checksum value for chunk [0, 0x3c186): Mirror 1: 0xbc687bd2 Mirror 20: 0xbc687bd2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c186: skipped 000437 1787099314.625343 write 0x036692 thru 0x03ffff (0x996e bytes) 000438 1787099314.761745 punch from 0x00335b to 0x0115fb (0xe2a1 bytes) 000439 1787099314.767698 mapread 0x03b327 thru 0x03f3ea (0x40c4 bytes) 000440 1787099314.769944 trunc from 0x022a5a to 0x02e105 (0xb6ac bytes) 000441 1787099314.775561 mapread 0x01d161 thru 0x01e00a (0xeaa bytes) 000442 1787099314.787217 trunc from 0x040000 to 0x03d495 (0x2b6a bytes) 000443 1787099314.824897 MIRROR_RESYNC 14 mirrors 000444 1787099318.238676 MIRROR_EXTEND to 15 mirrors 000445 1787099319.941995 mapread 0x02de47 thru 0x03d1bd (0xf377 bytes) 000446 1787099319.989107 mapwrite 0x01facf thru 0x02f6c7 (0xfbf9 bytes) 000447 1787099320.154293 mapwrite 0x00e10e thru 0x018dc1 (0xacb4 bytes) 000448 1787099320.213005 mapread 0x01bf5a thru 0x027a56 (0xbafd bytes) 000449 1787099320.216004 punch from 0x0203c6 to 0x0294d2 (0x910d bytes) 000450 1787099320.229505 write 0x026785 thru 0x033e4e (0xd6ca bytes) 000451 1787099320.264166 fallocate 0x02d0b7 thru 0x03870d (0xb657 bytes) 000452 1787099320.273083 write 0x00bf30 thru 0x019d55 (0xde26 bytes) 000453 1787099320.277297 mapread 0x028a20 thru 0x02e62d (0x5c0e bytes) 000454 1787099320.280218 trunc from 0x03c65f to 0x03d495 (0xe37 bytes) 000455 1787099320.290907 trunc from 0x01518a to 0x022aed (0xd964 bytes) 000456 1787099320.311653 mapread 0x00fad1 thru 0x014f4b (0x547b bytes) 000457 1787099320.314953 fallocate 0x000a0e thru 0x007f3c (0x752f bytes) 000458 1787099320.323586 trunc from 0x03d496 to 0x009141 (0x34354 bytes) 000459 1787099320.373328 punch from 0x0051ec to 0x009141 (0x3f56 bytes) 000460 1787099320.380690 trunc from 0x009142 to 0x028c87 (0x1fb46 bytes) 000461 1787099320.441137 MIRROR_SPLIT mirror 10 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28c88): Mirror 5: 0x376d8bda (stale) Mirror 6: 0x376d8bda (stale) Mirror 8: 0x376d8bda (stale) Mirror 9: 0x376d8bda (stale) Mirror 10: 0x376d8bda (stale) Mirror 13: 0x376d8bda (stale) Mirror 14: 0x376d8bda (stale) Mirror 15: 0x376d8bda (stale) Mirror 16: 0x376d8bda (stale) Mirror 18: 0x376d8bda (stale) Mirror 19: 0x376d8bda (stale) Mirror 20: 0x376d8bda (stale) Mirror 21: 0x376d8bda (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28c88): Mirror 5: 0x376d8bda (stale) Mirror 6: 0x376d8bda (stale) Mirror 8: 0x376d8bda (stale) Mirror 9: 0x376d8bda (stale) Mirror 10: 0x376d8bda (stale) Mirror 13: 0x376d8bda (stale) Mirror 14: 0x376d8bda (stale) Mirror 15: 0x376d8bda (stale) Mirror 16: 0x376d8bda (stale) Mirror 18: 0x376d8bda (stale) Mirror 19: 0x376d8bda (stale) Mirror 20: 0x376d8bda (stale) Mirror 21: 0x376d8bda (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28c88: skipped 000462 1787099321.500085 write 0x0094ae thru 0x0145fb (0xb14e bytes) 000463 1787099321.533853 trunc from 0x014b90 to 0x01d088 (0x84f9 bytes) 000464 1787099321.560820 punch from 0x0048c1 to 0x00a5bc (0x5cfc bytes) 000466 1787099321.580048 punch from 0x019a69 to 0x0285e9 (0xeb81 bytes) 000467 1787099321.593538 trunc from 0x028c88 to 0x011c50 (0x17037 bytes) 000468 1787099321.644051 write 0x01ab9e thru 0x02352b (0x898e bytes) 000469 1787099321.654897 punch from 0x000979 to 0x002cf4 (0x237c bytes) 000470 1787099321.664148 fallocate 0x00119d thru 0x00b997 (0xa7fb bytes) 000471 1787099321.684472 MIRROR_SPLIT mirror 8 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2352c): Mirror 5: 0x845a3aa8 (stale) Mirror 6: 0x845a3aa8 (stale) Mirror 8: 0x845a3aa8 (stale) Mirror 9: 0x845a3aa8 (stale) Mirror 10: 0x845a3aa8 (stale) Mirror 13: 0x845a3aa8 (stale) Mirror 14: 0x845a3aa8 (stale) Mirror 16: 0x845a3aa8 (stale) Mirror 18: 0x845a3aa8 (stale) Mirror 19: 0x845a3aa8 (stale) Mirror 20: 0x845a3aa8 (stale) Mirror 21: 0x845a3aa8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2352c): Mirror 5: 0x845a3aa8 (stale) Mirror 6: 0x845a3aa8 (stale) Mirror 8: 0x845a3aa8 (stale) Mirror 9: 0x845a3aa8 (stale) Mirror 10: 0x845a3aa8 (stale) Mirror 13: 0x845a3aa8 (stale) Mirror 14: 0x845a3aa8 (stale) Mirror 16: 0x845a3aa8 (stale) Mirror 18: 0x845a3aa8 (stale) Mirror 19: 0x845a3aa8 (stale) Mirror 20: 0x845a3aa8 (stale) Mirror 21: 0x845a3aa8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2352c: skipped 000472 1787099322.916333 trunc from 0x0092f4 to 0x0139dc (0xa6e9 bytes) 000473 1787099322.936546 write 0x015a73 thru 0x01b8c7 (0x5e55 bytes) 000474 1787099322.977547 trunc from 0x02352c to 0x001d2e (0x217fd bytes) 000475 1787099323.019660 trunc from 0x0011c1 to 0x001d2e (0xb6e bytes) 000476 1787099323.026016 punch from 0x000830 to 0x001d2e (0x14ff bytes) 000477 1787099323.033448 mapwrite 0x006e88 thru 0x010add (0x9c56 bytes) 000478 1787099323.186989 mapwrite 0x00fa28 thru 0x01eb40 (0xf119 bytes) 000479 1787099323.301577 trunc from 0x0004ce to 0x006791 (0x62c4 bytes) 000480 1787099323.308340 read 0x01dbd6 thru 0x01eb40 (0xf6b bytes) 000481 1787099323.309104 trunc from 0x01eb41 to 0x00b388 (0x137b8 bytes) 000482 1787099323.337447 trunc from 0x000e9c to 0x008d96 (0x7efb bytes) 000483 1787099323.354709 MIRROR_SPLIT mirror 3 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xb389): Mirror 5: 0x93a3dafb (stale) Mirror 6: 0x93a3dafb (stale) Mirror 9: 0x93a3dafb (stale) Mirror 10: 0x93a3dafb (stale) Mirror 13: 0x93a3dafb (stale) Mirror 14: 0x93a3dafb (stale) Mirror 16: 0x93a3dafb (stale) Mirror 18: 0x93a3dafb (stale) Mirror 19: 0x93a3dafb (stale) Mirror 20: 0x93a3dafb (stale) Mirror 21: 0x93a3dafb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb389): Mirror 5: 0x93a3dafb (stale) Mirror 6: 0x93a3dafb (stale) Mirror 9: 0x93a3dafb (stale) Mirror 10: 0x93a3dafb (stale) Mirror 13: 0x93a3dafb (stale) Mirror 14: 0x93a3dafb (stale) Mirror 16: 0x93a3dafb (stale) Mirror 18: 0x93a3dafb (stale) Mirror 19: 0x93a3dafb (stale) Mirror 20: 0x93a3dafb (stale) Mirror 21: 0x93a3dafb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb389: skipped 000484 1787099324.445245 mapwrite 0x031922 thru 0x033d31 (0x2410 bytes) 000486 1787099324.529262 mapwrite 0x00216f thru 0x0088ee (0x6780 bytes) 000487 1787099324.561905 trunc from 0x033d32 to 0x01bef0 (0x17e41 bytes) 000488 1787099324.584846 punch from 0x00e74c to 0x016383 (0x7c38 bytes) 000489 1787099324.592469 mapread 0x0153bf thru 0x01a514 (0x5156 bytes) 000490 1787099324.606597 punch from 0x0034c5 to 0x00ff29 (0xca65 bytes) 000491 1787099324.611522 trunc from 0x01bef1 to 0x00d4c7 (0xea29 bytes) 000492 1787099324.632839 fallocate 0x033c28 thru 0x03d011 (0x93ea bytes) 000493 1787099324.641575 mapread 0x003097 thru 0x008e06 (0x5d70 bytes) 000494 1787099324.657701 trunc from 0x00d4c8 to 0x0179c6 (0xa4ff bytes) 000495 1787099324.677377 mapwrite 0x034437 thru 0x03ffff (0xbbc9 bytes) 000496 1787099324.773010 fallocate 0x02610f thru 0x02fe93 (0x9d85 bytes) 000497 1787099324.792912 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xe4de25d9 (stale) Mirror 9: 0xe4de25d9 (stale) Mirror 10: 0xe4de25d9 (stale) Mirror 13: 0xe4de25d9 (stale) Mirror 14: 0xe4de25d9 (stale) Mirror 16: 0xe4de25d9 (stale) Mirror 18: 0xe4de25d9 (stale) Mirror 19: 0xe4de25d9 (stale) Mirror 20: 0xe4de25d9 (stale) Mirror 21: 0xe4de25d9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xe4de25d9 (stale) Mirror 9: 0xe4de25d9 (stale) Mirror 10: 0xe4de25d9 (stale) Mirror 13: 0xe4de25d9 (stale) Mirror 14: 0xe4de25d9 (stale) Mirror 16: 0xe4de25d9 (stale) Mirror 18: 0xe4de25d9 (stale) Mirror 19: 0xe4de25d9 (stale) Mirror 20: 0xe4de25d9 (stale) Mirror 21: 0xe4de25d9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000498 1787099325.544138 write 0x00a445 thru 0x012867 (0x8423 bytes) 000499 1787099325.559796 punch from 0x00336e to 0x00b326 (0x7fb9 bytes) 000500 1787099325.579813 read 0x019958 thru 0x0199a7 (0x50 bytes) 000501 1787099325.585816 mapwrite 0x03a496 thru 0x03c139 (0x1ca4 bytes) 000502 1787099325.620967 write 0x0208e0 thru 0x02a982 (0xa0a3 bytes) 000503 1787099325.635731 punch from 0x024d03 to 0x026ba4 (0x1ea2 bytes) 000504 1787099325.653680 MIRROR_RESYNC 11 mirrors 000505 1787099330.970054 punch from 0x037adc to 0x03ffff (0x8524 bytes) 000506 1787099331.053878 mapread 0x026076 thru 0x031f66 (0xbef1 bytes) 000508 1787099331.097666 MIRROR_RESYNC 11 mirrors 000509 1787099337.815149 MIRROR_EXTEND to 12 mirrors 000510 1787099339.428246 MIRROR_RESYNC 12 mirrors 000511 1787099340.594079 fallocate 0x014f53 thru 0x01d1c8 (0x8276 bytes) 000512 1787099340.675202 fallocate 0x01688d thru 0x018a57 (0x21cb bytes) 000513 1787099340.697465 trunc from 0x02d034 to 0x037f02 (0xaecf bytes) 000514 1787099340.712251 mapwrite 0x034dc9 thru 0x03db43 (0x8d7b bytes) 000516 1787099340.819340 trunc from 0x040000 to 0x00516f (0x3ae90 bytes) 000517 1787099340.876829 trunc from 0x003380 to 0x00516f (0x1df0 bytes) 000518 1787099340.905195 trunc from 0x005170 to 0x025c17 (0x20aa8 bytes) 000519 1787099340.993302 trunc from 0x0190ad to 0x025c17 (0xcb6b bytes) 000520 1787099341.011856 trunc from 0x00fccc to 0x01a4e9 (0xa81e bytes) 000521 1787099341.024499 fallocate 0x028ea8 thru 0x02eda4 (0x5efd bytes) 000522 1787099341.042748 fallocate 0x02f370 thru 0x03e3cb (0xf05c bytes) 000523 1787099341.054608 read 0x033eb3 thru 0x03890b (0x4a59 bytes) 000524 1787099341.092902 trunc from 0x014ea0 to 0x01ddda (0x8f3b bytes) 000526 1787099341.115555 mapread 0x00a60e thru 0x00d671 (0x3064 bytes) 000527 1787099341.158829 trunc from 0x03e3cc to 0x01257a (0x2be51 bytes) 000528 1787099341.204541 trunc from 0x01257b to 0x00c25b (0x631f bytes) 000529 1787099341.228006 write 0x018094 thru 0x023002 (0xaf6f bytes) 000530 1787099341.231400 fallocate 0x00ff66 thru 0x019ab8 (0x9b53 bytes) 000531 1787099341.243657 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23003): Mirror 9: 0x4257a651 (stale) Mirror 10: 0x4257a651 (stale) Mirror 13: 0x4257a651 (stale) Mirror 14: 0x4257a651 (stale) Mirror 16: 0x4257a651 (stale) Mirror 18: 0x4257a651 (stale) Mirror 19: 0x4257a651 (stale) Mirror 20: 0x4257a651 (stale) Mirror 21: 0x4257a651 (stale) Mirror 22: 0x4257a651 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23003): Mirror 9: 0x4257a651 (stale) Mirror 10: 0x4257a651 (stale) Mirror 13: 0x4257a651 (stale) Mirror 14: 0x4257a651 (stale) Mirror 16: 0x4257a651 (stale) Mirror 18: 0x4257a651 (stale) Mirror 19: 0x4257a651 (stale) Mirror 20: 0x4257a651 (stale) Mirror 21: 0x4257a651 (stale) Mirror 22: 0x4257a651 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23003: skipped 000532 1787099342.148483 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23003): Mirror 9: 0x4257a651 (stale) Mirror 10: 0x4257a651 (stale) Mirror 13: 0x4257a651 (stale) Mirror 14: 0x4257a651 (stale) Mirror 18: 0x4257a651 (stale) Mirror 19: 0x4257a651 (stale) Mirror 20: 0x4257a651 (stale) Mirror 21: 0x4257a651 (stale) Mirror 22: 0x4257a651 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23003): Mirror 9: 0x4257a651 (stale) Mirror 10: 0x4257a651 (stale) Mirror 13: 0x4257a651 (stale) Mirror 14: 0x4257a651 (stale) Mirror 18: 0x4257a651 (stale) Mirror 19: 0x4257a651 (stale) Mirror 20: 0x4257a651 (stale) Mirror 21: 0x4257a651 (stale) Mirror 22: 0x4257a651 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23003: skipped 000533 1787099343.291456 mapwrite 0x02bf6b thru 0x03b36b (0xf401 bytes) 000534 1787099343.526132 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b36c): Mirror 10: 0x480868d (stale) Mirror 13: 0x480868d (stale) Mirror 14: 0x480868d (stale) Mirror 18: 0x480868d (stale) Mirror 19: 0x480868d (stale) Mirror 20: 0x480868d (stale) Mirror 21: 0x480868d (stale) Mirror 22: 0x480868d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b36c): Mirror 10: 0x480868d (stale) Mirror 13: 0x480868d (stale) Mirror 14: 0x480868d (stale) Mirror 18: 0x480868d (stale) Mirror 19: 0x480868d (stale) Mirror 20: 0x480868d (stale) Mirror 21: 0x480868d (stale) Mirror 22: 0x480868d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b36c: skipped 000535 1787099345.064997 read 0x0271cf thru 0x02f335 (0x8167 bytes) 000536 1787099345.081669 mapread 0x01ce5b thru 0x01e9b8 (0x1b5e bytes) 000537 1787099345.127807 trunc from 0x034c62 to 0x03b36b (0x670a bytes) 000538 1787099345.155632 MIRROR_RESYNC 9 mirrors 000539 1787099350.982152 punch from 0x017426 to 0x0261b0 (0xed8b bytes) 000540 1787099351.019739 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b36c): Mirror 10: 0xca1a60d3 (stale) Mirror 13: 0xca1a60d3 (stale) Mirror 14: 0xca1a60d3 (stale) Mirror 18: 0xca1a60d3 (stale) Mirror 19: 0xca1a60d3 (stale) Mirror 20: 0xca1a60d3 (stale) Mirror 22: 0xca1a60d3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b36c): Mirror 10: 0xca1a60d3 (stale) Mirror 13: 0xca1a60d3 (stale) Mirror 14: 0xca1a60d3 (stale) Mirror 18: 0xca1a60d3 (stale) Mirror 19: 0xca1a60d3 (stale) Mirror 20: 0xca1a60d3 (stale) Mirror 22: 0xca1a60d3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b36c: skipped 000543 1787099352.227259 punch from 0x0192c7 to 0x0220d7 (0x8e11 bytes) 000544 1787099352.239126 mapread 0x003810 thru 0x00fee8 (0xc6d9 bytes) 000545 1787099352.293212 punch from 0x008000 to 0x016817 (0xe818 bytes) 000546 1787099352.302242 write 0x02ced0 thru 0x02dcc0 (0xdf1 bytes) 000547 1787099352.336137 mapread 0x036625 thru 0x03b36b (0x4d47 bytes) 000548 1787099352.375505 fallocate 0x00e7ff thru 0x01533d (0x6b3f bytes) 000549 1787099352.394389 mapwrite 0x023a2e thru 0x02b22f (0x7802 bytes) 000550 1787099352.527141 read 0x002a1a thru 0x006bc4 (0x41ab bytes) 000551 1787099352.555966 MIRROR_RESYNC 8 mirrors 000552 1787099357.130478 punch from 0x020297 to 0x026034 (0x5d9e bytes) 000553 1787099357.179504 read 0x00fde2 thru 0x013fe4 (0x4203 bytes) 000554 1787099357.195258 trunc from 0x01a5aa to 0x02690c (0xc363 bytes) 000555 1787099357.213657 MIRROR_RESYNC 8 mirrors 000556 1787099361.379216 trunc from 0x022db4 to 0x03288a (0xfad7 bytes) 000557 1787099361.429796 trunc from 0x025e3b to 0x02e886 (0x8a4c bytes) 000558 1787099361.445116 mapwrite 0x00036e thru 0x00ed68 (0xe9fb bytes) 000559 1787099361.512079 mapread 0x012029 thru 0x01d493 (0xb46b bytes) 000560 1787099361.558055 read 0x019ca2 thru 0x01c78e (0x2aed bytes) 000561 1787099361.560949 trunc from 0x01a17b to 0x01c132 (0x1fb8 bytes) 000562 1787099361.567615 trunc from 0x03b36c to 0x02c30d (0xf05e bytes) 000563 1787099361.594311 mapread 0x004c9f thru 0x00628a (0x15ec bytes) 000564 1787099361.596284 fallocate 0x01ef14 thru 0x0279b0 (0x8a9d bytes) 000565 1787099361.604989 punch from 0x01c995 to 0x02b15b (0xe7c7 bytes) 000566 1787099361.625786 mapwrite 0x004fea thru 0x00e7c2 (0x97d9 bytes) 000567 1787099361.652964 write 0x03c2e2 thru 0x03ffff (0x3d1e bytes) 000568 1787099361.654294 fallocate 0x008fc5 thru 0x00b085 (0x20c1 bytes) 000569 1787099361.659467 trunc from 0x040000 to 0x037a77 (0x8588 bytes) 000570 1787099361.695102 read 0x0040d5 thru 0x00ccdf (0x8c0b bytes) 000573 1787099361.700101 mapread 0x029cf3 thru 0x02a6af (0x9bd bytes) 000574 1787099361.775850 read 0x008ab7 thru 0x00c1fe (0x3748 bytes) 000575 1787099361.776988 mapwrite 0x01d83d thru 0x025f03 (0x86c7 bytes) 000576 1787099361.799984 read 0x012e41 thru 0x014e8c (0x204c bytes) 000577 1787099361.801040 trunc from 0x013543 to 0x017c99 (0x4757 bytes) 000578 1787099361.808322 punch from 0x014c85 to 0x022a2e (0xddaa bytes) 000579 1787099361.828136 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x37a78): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37a78): Mirror 10: 0x8049e72 (stale) Mirror 13: 0x8049e72 (stale) Mirror 14: 0x8049e72 (stale) Mirror 18: 0x8049e72 (stale) Mirror 19: 0x8049e72 (stale) Mirror 20: 0x8049e72 (stale) Mirror 22: 0x8049e72 (stale) CRC-32 checksum value for chunk [0, 0x37a78): Mirror 1: 0x3f3d9c28 Mirror 23: 0x3f3d9c28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37a78: skipped 000580 1787099363.810305 fallocate 0x0358c8 thru 0x03a41b (0x4b54 bytes) 000581 1787099363.909283 mapread 0x001482 thru 0x00eddf (0xd95e bytes) 000582 1787099363.961341 mapwrite 0x005fb4 thru 0x00d154 (0x71a1 bytes) 000583 1787099364.017246 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37a78): Mirror 10: 0x8049e72 (stale) Mirror 14: 0x8049e72 (stale) Mirror 18: 0x8049e72 (stale) Mirror 19: 0x8049e72 (stale) Mirror 20: 0x8049e72 (stale) Mirror 22: 0x8049e72 (stale) Mirror 23: 0x3f3d9c28 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37a78): Mirror 10: 0x8049e72 (stale) Mirror 14: 0x8049e72 (stale) Mirror 18: 0x8049e72 (stale) Mirror 19: 0x8049e72 (stale) Mirror 20: 0x8049e72 (stale) Mirror 22: 0x8049e72 (stale) Mirror 23: 0x3f3d9c28 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37a78: skipped 000584 1787099364.934273 fallocate 0x03629f thru 0x03ffff (0x9d61 bytes) 000585 1787099364.943879 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xfd441e30 (stale) Mirror 14: 0xfd441e30 (stale) Mirror 18: 0xfd441e30 (stale) Mirror 19: 0xfd441e30 (stale) Mirror 20: 0xfd441e30 (stale) Mirror 22: 0xfd441e30 (stale) Mirror 23: 0xc409fb1a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcc9278b1 Mirror 24: 0xcc9278b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000586 1787099366.699640 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xfd441e30 (stale) Mirror 14: 0xfd441e30 (stale) Mirror 18: 0xfd441e30 (stale) Mirror 19: 0xfd441e30 (stale) Mirror 20: 0xfd441e30 (stale) Mirror 22: 0xfd441e30 (stale) Mirror 23: 0xc409fb1a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcc9278b1 Mirror 24: 0xcc9278b1 Mirror 25: 0xcc9278b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000587 1787099369.102687 trunc from 0x040000 to 0x03be87 (0x4178 bytes) 000589 1787099369.313620 trunc from 0x03be88 to 0x028550 (0x13937 bytes) 000590 1787099369.366660 trunc from 0x028551 to 0x02cf0e (0x49be bytes) 000591 1787099369.400065 read 0x00cc91 thru 0x01158b (0x48fb bytes) 000592 1787099369.412676 fallocate 0x03cb9e thru 0x03ffff (0x3462 bytes) 000593 1787099369.420743 write 0x03d347 thru 0x03ffff (0x2cb9 bytes) 000594 1787099369.421962 write 0x01d364 thru 0x0210d4 (0x3d71 bytes) 000595 1787099369.442040 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xfd441e30 (stale) Mirror 14: 0xfd441e30 (stale) Mirror 18: 0xfd441e30 (stale) Mirror 19: 0xfd441e30 (stale) Mirror 20: 0xfd441e30 (stale) Mirror 22: 0xfd441e30 (stale) Mirror 23: 0xc409fb1a (stale) Mirror 24: 0xcc9278b1 (stale) Mirror 25: 0xcc9278b1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6229a563 Mirror 26: 0x6229a563 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000596 1787099370.916586 read 0x023846 thru 0x02f7b7 (0xbf72 bytes) 000597 1787099370.943971 punch from 0x020fb7 to 0x021eb0 (0xefa bytes) 000599 1787099371.002052 mapread 0x015195 thru 0x0237fe (0xe66a bytes) 000600 1787099371.039686 mapwrite 0x01fe77 thru 0x02a1d8 (0xa362 bytes) 000602 1787099371.094844 mapwrite 0x03bdc5 thru 0x03c91d (0xb59 bytes) 000603 1787099371.129016 write 0x010563 thru 0x01d2cb (0xcd69 bytes) 000604 1787099371.137879 trunc from 0x00375a to 0x011598 (0xde3f bytes) 000605 1787099371.150955 write 0x02e211 thru 0x02e940 (0x730 bytes) 000607 1787099371.154637 mapwrite 0x022c7d thru 0x025916 (0x2c9a bytes) 000609 1787099371.171004 mapwrite 0x0380f4 thru 0x03ffff (0x7f0c bytes) 000610 1787099371.197918 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xfd441e30 (stale) Mirror 14: 0xfd441e30 (stale) Mirror 18: 0xfd441e30 (stale) Mirror 19: 0xfd441e30 (stale) Mirror 20: 0xfd441e30 (stale) Mirror 22: 0xfd441e30 (stale) Mirror 23: 0xc409fb1a (stale) Mirror 24: 0xcc9278b1 (stale) Mirror 25: 0xcc9278b1 (stale) Mirror 26: 0x6229a563 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1667adb2 Mirror 27: 0x1667adb2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000611 1787099373.024295 read 0x01a19c thru 0x0242f8 (0xa15d bytes) 000612 1787099373.053885 MIRROR_RESYNC 12 mirrors 000613 1787099376.806803 mapread 0x01abdc thru 0x025ba8 (0xafcd bytes) 000614 1787099376.925853 write 0x032976 thru 0x037b8f (0x521a bytes) 000615 1787099377.045713 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x1667adb2 (stale) Mirror 14: 0x1667adb2 (stale) Mirror 18: 0x1667adb2 (stale) Mirror 19: 0x1667adb2 (stale) Mirror 20: 0x1667adb2 (stale) Mirror 22: 0x1667adb2 (stale) Mirror 23: 0x1667adb2 (stale) Mirror 24: 0x1667adb2 (stale) Mirror 25: 0x1667adb2 (stale) Mirror 27: 0x1667adb2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x1667adb2 (stale) Mirror 14: 0x1667adb2 (stale) Mirror 18: 0x1667adb2 (stale) Mirror 19: 0x1667adb2 (stale) Mirror 20: 0x1667adb2 (stale) Mirror 22: 0x1667adb2 (stale) Mirror 23: 0x1667adb2 (stale) Mirror 24: 0x1667adb2 (stale) Mirror 25: 0x1667adb2 (stale) Mirror 27: 0x1667adb2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000616 1787099378.267464 read 0x001747 thru 0x00c997 (0xb251 bytes) 000618 1787099378.325227 punch from 0x02a646 to 0x03221e (0x7bd9 bytes) 000619 1787099378.348953 fallocate 0x004df2 thru 0x01260e (0xd81d bytes) 000620 1787099378.362090 trunc from 0x040000 to 0x023284 (0x1cd7b bytes) 000621 1787099378.446274 mapread 0x012833 thru 0x01db1a (0xb2e8 bytes) 000622 1787099378.498864 fallocate 0x02223c thru 0x026a49 (0x480e bytes) 000624 1787099378.512270 write 0x031469 thru 0x033fe7 (0x2b7f bytes) 000625 1787099378.516251 trunc from 0x003c85 to 0x005221 (0x159d bytes) 000627 1787099378.530199 mapwrite 0x011df9 thru 0x0159d1 (0x3bd9 bytes) 000629 1787099378.598941 write 0x0077ff thru 0x00fa25 (0x8227 bytes) 000630 1787099378.608199 trunc from 0x003a72 to 0x0051d5 (0x1764 bytes) 000631 1787099378.621441 mapread 0x0088c6 thru 0x01188f (0x8fca bytes) 000632 1787099378.623453 mapread 0x0231cf thru 0x02ed09 (0xbb3b bytes) 000633 1787099378.653875 trunc from 0x01e3a3 to 0x02b97e (0xd5dc bytes) 000634 1787099378.660928 trunc from 0x033fe8 to 0x037855 (0x386e bytes) 000635 1787099378.677790 trunc from 0x02162a to 0x0221e6 (0xbbd bytes) 000636 1787099378.686949 punch from 0x00982e to 0x016212 (0xc9e5 bytes) 000637 1787099378.712830 write 0x00f66e thru 0x01c2c9 (0xcc5c bytes) 000638 1787099378.719938 mapread 0x024757 thru 0x02801c (0x38c6 bytes) 000639 1787099378.740278 read 0x006990 thru 0x00827a (0x18eb bytes) 000640 1787099378.741175 read 0x032313 thru 0x03274e (0x43c bytes) 000641 1787099378.749080 mapwrite 0x038e67 thru 0x03ffff (0x7199 bytes) 000642 1787099378.854361 mapwrite 0x036545 thru 0x03ffff (0x9abb bytes) 000643 1787099378.892750 read 0x0114dd thru 0x01d45c (0xbf80 bytes) 000644 1787099378.895279 mapwrite 0x01a74e thru 0x01d82e (0x30e1 bytes) 000646 1787099378.938800 write 0x0196b7 thru 0x022792 (0x90dc bytes) 000647 1787099378.940594 punch from 0x0375f3 to 0x03ffff (0x8a0d bytes) 000648 1787099378.952742 trunc from 0x040000 to 0x03752c (0x8ad3 bytes) 000649 1787099378.982313 trunc from 0x03752d to 0x02b358 (0xc1d4 bytes) 000650 1787099379.016616 fallocate 0x004b26 thru 0x00caaa (0x7f85 bytes) 000651 1787099379.025191 mapwrite 0x02076c thru 0x02ccd1 (0xc566 bytes) 000652 1787099379.150115 mapread 0x01eecf thru 0x02194c (0x2a7e bytes) 000653 1787099379.162040 mapread 0x0153c8 thru 0x0181b7 (0x2df0 bytes) 000654 1787099379.163154 punch from 0x0097bc to 0x01017d (0x69c2 bytes) 000656 1787099379.208975 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2ccd2): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ccd2): Mirror 10: 0x386342df (stale) Mirror 14: 0x386342df (stale) Mirror 18: 0x386342df (stale) Mirror 19: 0x386342df (stale) Mirror 20: 0x386342df (stale) Mirror 22: 0x386342df (stale) Mirror 23: 0x386342df (stale) Mirror 24: 0x386342df (stale) Mirror 25: 0x386342df (stale) Mirror 27: 0x386342df (stale) CRC-32 checksum value for chunk [0, 0x2ccd2): Mirror 1: 0xdc46fe6f Mirror 28: 0xdc46fe6f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ccd2: skipped 000657 1787099380.761154 trunc from 0x01d84a to 0x022241 (0x49f8 bytes) 000658 1787099380.854061 trunc from 0x023749 to 0x02baa5 (0x835d bytes) 000659 1787099380.880305 punch from 0x01a74c to 0x028897 (0xe14c bytes) 000660 1787099380.891583 read 0x022737 thru 0x02470b (0x1fd5 bytes) 000661 1787099380.910313 punch from 0x004060 to 0x01357a (0xf51b bytes) 000662 1787099380.931155 trunc from 0x008688 to 0x01059f (0x7f18 bytes) 000663 1787099380.941974 fallocate 0x0379ba thru 0x037b12 (0x159 bytes) 000664 1787099380.951663 write 0x00c6e8 thru 0x011100 (0x4a19 bytes) 000665 1787099380.985839 mapread 0x033ee4 thru 0x037b12 (0x3c2f bytes) 000666 1787099381.046040 write 0x03fbee thru 0x03ffff (0x412 bytes) 000667 1787099381.047634 write 0x0170ad thru 0x01b3a8 (0x42fc bytes) 000668 1787099381.072377 mapwrite 0x031f72 thru 0x03bcdb (0x9d6a bytes) 000669 1787099381.183158 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x1667adb2 (stale) Mirror 14: 0x1667adb2 (stale) Mirror 18: 0x1667adb2 (stale) Mirror 19: 0x1667adb2 (stale) Mirror 20: 0x1667adb2 (stale) Mirror 22: 0x1667adb2 (stale) Mirror 23: 0x1667adb2 (stale) Mirror 24: 0x1667adb2 (stale) Mirror 25: 0x1667adb2 (stale) Mirror 27: 0x1667adb2 (stale) Mirror 28: 0x83300659 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc79fea15 Mirror 29: 0xc79fea15 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000670 1787099383.251728 punch from 0x0183b3 to 0x01be01 (0x3a4f bytes) 000671 1787099383.333332 mapread 0x022713 thru 0x024479 (0x1d67 bytes) 000672 1787099383.364184 punch from 0x037e9c to 0x03c090 (0x41f5 bytes) 000673 1787099383.374811 mapread 0x026d4f thru 0x0357b9 (0xea6b bytes) 000674 1787099383.394215 write 0x030ef9 thru 0x0354cb (0x45d3 bytes) 000675 1787099383.406358 trunc from 0x040000 to 0x007535 (0x38aca bytes) 000676 1787099383.442796 write 0x016bc9 thru 0x020efd (0xa335 bytes) 000677 1787099383.451843 trunc from 0x0071f8 to 0x0137f7 (0xc600 bytes) 000679 1787099383.463629 read 0x01eac0 thru 0x020efd (0x243e bytes) 000680 1787099383.464487 fallocate 0x034076 thru 0x038190 (0x411b bytes) 000681 1787099383.470117 fallocate 0x001582 thru 0x00f3bb (0xde3a bytes) 000682 1787099383.476926 mapwrite 0x03ecaf thru 0x03ffff (0x1351 bytes) 000683 1787099383.557975 punch from 0x033a9b to 0x03ffff (0xc565 bytes) 000684 1787099383.565964 trunc from 0x0275cf to 0x02c0c7 (0x4af9 bytes) 000685 1787099383.577369 trunc from 0x0122af to 0x012b8e (0x8e0 bytes) 000686 1787099383.593744 write 0x0111fe thru 0x01ec2c (0xda2f bytes) 000687 1787099383.612785 read 0x01ddc5 thru 0x0257c5 (0x7a01 bytes) 000688 1787099383.650264 write 0x0271ec thru 0x032f87 (0xbd9c bytes) 000689 1787099383.659097 mapread 0x000ebf thru 0x006650 (0x5792 bytes) 000690 1787099383.670396 write 0x017996 thru 0x017fbd (0x628 bytes) 000691 1787099383.673781 mapwrite 0x024424 thru 0x02df8a (0x9b67 bytes) 000692 1787099383.765969 MIRROR_RESYNC 13 mirrors 000693 1787099388.576363 trunc from 0x01c466 to 0x02595e (0x94f9 bytes) 000694 1787099388.619966 trunc from 0x025ee1 to 0x02e997 (0x8ab7 bytes) 000696 1787099388.627072 read 0x015fb0 thru 0x0218c5 (0xb916 bytes) 000697 1787099388.642335 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x764752c6 (stale) Mirror 14: 0x764752c6 (stale) Mirror 18: 0x764752c6 (stale) Mirror 19: 0x764752c6 (stale) Mirror 20: 0x764752c6 (stale) Mirror 22: 0x764752c6 (stale) Mirror 23: 0x764752c6 (stale) Mirror 24: 0x764752c6 (stale) Mirror 25: 0x764752c6 (stale) Mirror 27: 0x764752c6 (stale) Mirror 28: 0x764752c6 (stale) Mirror 29: 0x764752c6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x59ea886f Mirror 30: 0x59ea886f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000698 1787099389.979852 read 0x0225ff thru 0x024222 (0x1c24 bytes) 000699 1787099389.988190 mapwrite 0x02d7aa thru 0x030aa5 (0x32fc bytes) 000700 1787099390.102148 fallocate 0x034177 thru 0x037a1d (0x38a7 bytes) 000701 1787099390.114849 MIRROR_RESYNC 14 mirrors 000702 1787099395.145669 trunc from 0x025950 to 0x02eb86 (0x9237 bytes) 000703 1787099395.226169 mapwrite 0x03208b thru 0x032b90 (0xb06 bytes) 000704 1787099395.255736 mapwrite 0x0280bb thru 0x03438d (0xc2d3 bytes) 000705 1787099395.336351 trunc from 0x040000 to 0x01f42c (0x20bd3 bytes) 000706 1787099395.364145 read 0x01b5c9 thru 0x01f42c (0x3e64 bytes) 000707 1787099395.372980 punch from 0x013653 to 0x01f42c (0xbdda bytes) 000708 1787099395.378834 trunc from 0x011b12 to 0x01463a (0x2b29 bytes) 000709 1787099395.384220 read 0x01c5ca thru 0x01f42c (0x2e63 bytes) 000710 1787099395.422619 fallocate 0x01af6f thru 0x01e60e (0x36a0 bytes) 000711 1787099395.428380 fallocate 0x03e2c2 thru 0x03ffff (0x1d3e bytes) 000712 1787099395.434541 trunc from 0x012651 to 0x01a247 (0x7bf7 bytes) 000713 1787099395.439648 mapwrite 0x03d269 thru 0x03ffff (0x2d97 bytes) 000714 1787099395.464693 read 0x023a8e thru 0x03109c (0xd60f bytes) 000715 1787099395.466206 punch from 0x03a931 to 0x03cb23 (0x21f3 bytes) 000716 1787099395.473513 trunc from 0x01e93d to 0x02b6a1 (0xcd65 bytes) 000717 1787099395.479938 write 0x013abf thru 0x0147f5 (0xd37 bytes) 000718 1787099395.499244 read 0x032bf7 thru 0x037449 (0x4853 bytes) 000719 1787099395.500092 punch from 0x03c2b0 to 0x03ffff (0x3d50 bytes) 000720 1787099395.505051 trunc from 0x005fe7 to 0x013e27 (0xde41 bytes) 000721 1787099395.515751 mapwrite 0x01b525 thru 0x026307 (0xade3 bytes) 000722 1787099395.538467 fallocate 0x0312b4 thru 0x0382eb (0x7038 bytes) 000723 1787099395.545800 trunc from 0x040000 to 0x03474d (0xb8b2 bytes) 000724 1787099395.563120 read 0x006efa thru 0x0076db (0x7e2 bytes) 000725 1787099395.576718 mapwrite 0x03b56b thru 0x03ffff (0x4a95 bytes) 000727 1787099395.628518 mapread 0x00ec22 thru 0x01c411 (0xd7f0 bytes) 000728 1787099395.631696 mapread 0x0061e1 thru 0x00ab9a (0x49ba bytes) 000729 1787099395.634637 read 0x028246 thru 0x028e7d (0xc38 bytes) 000730 1787099395.636092 mapread 0x014e4c thru 0x0218c5 (0xca7a bytes) 000731 1787099395.638128 write 0x017a23 thru 0x01ee00 (0x73de bytes) 000732 1787099395.640639 trunc from 0x040000 to 0x00525f (0x3ada0 bytes) 000733 1787099395.664330 mapread 0x005122 thru 0x00525f (0x13e bytes) 000734 1787099395.667580 fallocate 0x026efb thru 0x0316f2 (0xa7f8 bytes) 000735 1787099395.675516 mapwrite 0x009dac thru 0x013a1b (0x9c70 bytes) 000737 1787099395.708171 read 0x0172ba thru 0x0255eb (0xe332 bytes) 000738 1787099395.714684 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x316f3): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x316f3): Mirror 10: 0x17bcca89 (stale) Mirror 14: 0x17bcca89 (stale) Mirror 18: 0x17bcca89 (stale) Mirror 19: 0x17bcca89 (stale) Mirror 20: 0x17bcca89 (stale) Mirror 22: 0x17bcca89 (stale) Mirror 23: 0x17bcca89 (stale) Mirror 24: 0x17bcca89 (stale) Mirror 25: 0x17bcca89 (stale) Mirror 27: 0x17bcca89 (stale) Mirror 28: 0x17bcca89 (stale) Mirror 29: 0x17bcca89 (stale) Mirror 30: 0x17bcca89 (stale) CRC-32 checksum value for chunk [0, 0x316f3): Mirror 1: 0xe1f44b6d Mirror 31: 0xe1f44b6d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x316f3: skipped 000739 1787099397.077388 trunc from 0x0316f3 to 0x032e44 (0x1752 bytes) 000740 1787099397.205183 mapwrite 0x0065ee thru 0x00fcf2 (0x9705 bytes) 000741 1787099397.291100 trunc from 0x032e45 to 0x0365a2 (0x375e bytes) 000742 1787099397.316375 write 0x0290ad thru 0x0304c7 (0x741b bytes) 000744 1787099397.329629 punch from 0x021869 to 0x026f8d (0x5725 bytes) 000745 1787099397.346618 MIRROR_RESYNC 15 mirrors 000746 1787099401.820233 MIRROR_SPLIT mirror 5 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) 000747 1787099402.586800 mapread 0x0028e7 thru 0x00f873 (0xcf8d bytes) 000748 1787099402.611179 fallocate 0x02caf0 thru 0x036fec (0xa4fd bytes) 000749 1787099402.668839 trunc from 0x012000 to 0x016e49 (0x4e4a bytes) 000750 1787099402.674701 mapwrite 0x020fd6 thru 0x03069b (0xf6c6 bytes) 000751 1787099402.730019 mapwrite 0x03bedd thru 0x03ffff (0x4123 bytes) 000752 1787099402.783580 write 0x03f9b6 thru 0x03f9ce (0x19 bytes) 000753 1787099402.786054 trunc from 0x015840 to 0x02112e (0xb8ef bytes) 000754 1787099402.793774 mapwrite 0x014b1f thru 0x021a2f (0xcf11 bytes) 000755 1787099402.840132 write 0x0386ac thru 0x03ffff (0x7954 bytes) 000756 1787099402.841747 mapread 0x03f4af thru 0x03ffff (0xb51 bytes) 000758 1787099402.845590 fallocate 0x0289ad thru 0x038696 (0xfcea bytes) 000759 1787099402.851986 read 0x009996 thru 0x00c393 (0x29fe bytes) 000760 1787099402.860914 mapwrite 0x03643c thru 0x03c5da (0x619f bytes) 000761 1787099402.881359 mapwrite 0x0321b3 thru 0x03ffff (0xde4d bytes) 000763 1787099402.916064 punch from 0x01bcf5 to 0x02b117 (0xf423 bytes) 000764 1787099402.922229 mapwrite 0x03741d thru 0x03ffff (0x8be3 bytes) 000765 1787099402.945260 fallocate 0x01cbaf thru 0x029a17 (0xce69 bytes) 000766 1787099402.965530 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x1ef85327 (stale) Mirror 14: 0x1ef85327 (stale) Mirror 18: 0x1ef85327 (stale) Mirror 19: 0x1ef85327 (stale) Mirror 22: 0x1ef85327 (stale) Mirror 23: 0x1ef85327 (stale) Mirror 24: 0x1ef85327 (stale) Mirror 25: 0x1ef85327 (stale) Mirror 27: 0x1ef85327 (stale) Mirror 28: 0x1ef85327 (stale) Mirror 29: 0x1ef85327 (stale) Mirror 30: 0x1ef85327 (stale) Mirror 31: 0x1ef85327 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe355332c Mirror 32: 0xe355332c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000767 1787099405.066512 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x1ef85327 (stale) Mirror 18: 0x1ef85327 (stale) Mirror 19: 0x1ef85327 (stale) Mirror 22: 0x1ef85327 (stale) Mirror 23: 0x1ef85327 (stale) Mirror 24: 0x1ef85327 (stale) Mirror 25: 0x1ef85327 (stale) Mirror 27: 0x1ef85327 (stale) Mirror 28: 0x1ef85327 (stale) Mirror 29: 0x1ef85327 (stale) Mirror 30: 0x1ef85327 (stale) Mirror 31: 0x1ef85327 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x1ef85327 (stale) Mirror 18: 0x1ef85327 (stale) Mirror 19: 0x1ef85327 (stale) Mirror 22: 0x1ef85327 (stale) Mirror 23: 0x1ef85327 (stale) Mirror 24: 0x1ef85327 (stale) Mirror 25: 0x1ef85327 (stale) Mirror 27: 0x1ef85327 (stale) Mirror 28: 0x1ef85327 (stale) Mirror 29: 0x1ef85327 (stale) Mirror 30: 0x1ef85327 (stale) Mirror 31: 0x1ef85327 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe355332c Mirror 32: 0xe355332c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000768 1787099406.325372 fallocate 0x03ef5e thru 0x03ffff (0x10a2 bytes) 000770 1787099406.402704 write 0x0297dc thru 0x02b4a6 (0x1ccb bytes) 000771 1787099406.428124 punch from 0x022e31 to 0x02ed3b (0xbf0b bytes) 000772 1787099406.446516 write 0x002030 thru 0x00d76a (0xb73b bytes) 000773 1787099406.463358 punch from 0x00d394 to 0x015d4b (0x89b8 bytes) 000777 1787099406.494519 trunc from 0x040000 to 0x029edc (0x16123 bytes) 000778 1787099406.531529 trunc from 0x029edd to 0x037ced (0xde11 bytes) 000779 1787099406.573954 fallocate 0x01b09c thru 0x027548 (0xc4ad bytes) 000781 1787099406.583770 mapwrite 0x027d8b thru 0x036763 (0xe9d9 bytes) 000782 1787099406.646896 read 0x0159cb thru 0x01cb4a (0x7180 bytes) 000783 1787099406.662158 MIRROR_RESYNC 14 mirrors 000784 1787099411.161113 punch from 0x0009c1 to 0x007ea9 (0x74e9 bytes) 000785 1787099411.231498 trunc from 0x01bbd4 to 0x0228b3 (0x6ce0 bytes) 000786 1787099411.240062 trunc from 0x037cee to 0x03a2bd (0x25d0 bytes) 000787 1787099411.267471 read 0x015310 thru 0x01735c (0x204d bytes) 000788 1787099411.276013 trunc from 0x03a2be to 0x028547 (0x11d76 bytes) 000789 1787099411.308615 trunc from 0x028548 to 0x038a3a (0x104f3 bytes) 000790 1787099411.327009 read 0x01e601 thru 0x0277d0 (0x91d0 bytes) 000791 1787099411.344381 mapwrite 0x00f22b thru 0x01886c (0x9642 bytes) 000792 1787099411.371240 mapread 0x034248 thru 0x038a3a (0x47f3 bytes) 000793 1787099411.373243 mapread 0x02f571 thru 0x030e67 (0x18f7 bytes) 000794 1787099411.375337 read 0x002fc6 thru 0x00aadc (0x7b17 bytes) 000795 1787099411.377013 mapread 0x037e6e thru 0x038a3a (0xbcd bytes) 000796 1787099411.379220 read 0x02e9c6 thru 0x035b0f (0x714a bytes) 000797 1787099411.381794 read 0x02135f thru 0x028974 (0x7616 bytes) 000798 1787099411.382879 mapread 0x021c88 thru 0x030cc1 (0xf03a bytes) 000799 1787099411.385367 write 0x03d80f thru 0x03ffff (0x27f1 bytes) 000800 1787099411.388181 mapwrite 0x0275be thru 0x0307aa (0x91ed bytes) 000801 1787099411.416440 write 0x038d09 thru 0x03ffff (0x72f7 bytes) 000802 1787099411.419893 trunc from 0x01100c to 0x0155db (0x45d0 bytes) 000803 1787099411.427579 mapread 0x026352 thru 0x0278f5 (0x15a4 bytes) 000804 1787099411.435882 MIRROR_RESYNC 14 mirrors 000805 1787099418.881173 fallocate 0x0090cf thru 0x01424b (0xb17d bytes) 000806 1787099418.944238 trunc from 0x038a71 to 0x03b1f1 (0x2781 bytes) 000807 1787099418.951740 trunc from 0x02f7be to 0x03ad11 (0xb554 bytes) 000808 1787099418.961321 trunc from 0x040000 to 0x01c2c4 (0x23d3b bytes) 000809 1787099419.026648 punch from 0x003fff to 0x004647 (0x649 bytes) 000810 1787099419.047148 mapwrite 0x01a81a thru 0x01e948 (0x412f bytes) 000811 1787099419.163598 trunc from 0x01e949 to 0x00acde (0x13c6a bytes) 000812 1787099419.199766 fallocate 0x03f501 thru 0x03ffff (0xaff bytes) 000813 1787099419.209105 mapwrite 0x0351fb thru 0x03ffff (0xae05 bytes) 000814 1787099419.299361 MIRROR_RESYNC 14 mirrors 000815 1787099423.515841 mapread 0x03e99d thru 0x03ffff (0x1663 bytes) 000816 1787099423.527830 trunc from 0x024edc to 0x02a41e (0x5543 bytes) 000817 1787099423.583731 read 0x038e99 thru 0x03ffff (0x7167 bytes) 000818 1787099423.656901 MIRROR_RESYNC 14 mirrors 000819 1787099428.726660 punch from 0x011ecf to 0x01ea9c (0xcbce bytes) 000820 1787099428.844671 read 0x02e4ba thru 0x03cb39 (0xe680 bytes) 000821 1787099428.873923 mapwrite 0x031eba thru 0x037719 (0x5860 bytes) 000822 1787099428.942985 read 0x011db9 thru 0x01637c (0x45c4 bytes) 000823 1787099429.000487 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0xce67515c (stale) Mirror 19: 0xce67515c (stale) Mirror 22: 0xce67515c (stale) Mirror 23: 0xce67515c (stale) Mirror 24: 0xce67515c (stale) Mirror 25: 0xce67515c (stale) Mirror 27: 0xce67515c (stale) Mirror 28: 0xce67515c (stale) Mirror 29: 0xce67515c (stale) Mirror 30: 0xce67515c (stale) Mirror 31: 0xce67515c (stale) Mirror 32: 0xce67515c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0xce67515c (stale) Mirror 19: 0xce67515c (stale) Mirror 22: 0xce67515c (stale) Mirror 23: 0xce67515c (stale) Mirror 24: 0xce67515c (stale) Mirror 25: 0xce67515c (stale) Mirror 27: 0xce67515c (stale) Mirror 28: 0xce67515c (stale) Mirror 29: 0xce67515c (stale) Mirror 30: 0xce67515c (stale) Mirror 31: 0xce67515c (stale) Mirror 32: 0xce67515c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000824 1787099430.225250 write 0x02bab1 thru 0x02cdc8 (0x1318 bytes) 000825 1787099430.249174 punch from 0x03064e to 0x038b55 (0x8508 bytes) 000826 1787099430.257992 trunc from 0x011d09 to 0x020c74 (0xef6c bytes) 000827 1787099430.271579 mapwrite 0x0013dd thru 0x006f4b (0x5b6f bytes) 000828 1787099430.362923 mapwrite 0x00bb8a thru 0x01177f (0x5bf6 bytes) 000829 1787099430.452345 punch from 0x02e43b to 0x03709e (0x8c64 bytes) 000830 1787099430.481852 mapread 0x02f7e9 thru 0x036ee1 (0x76f9 bytes) 000832 1787099430.520644 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0xce67515c (stale) Mirror 19: 0xce67515c (stale) Mirror 22: 0xce67515c (stale) Mirror 23: 0xce67515c (stale) Mirror 24: 0xce67515c (stale) Mirror 25: 0xce67515c (stale) Mirror 27: 0xce67515c (stale) Mirror 28: 0xce67515c (stale) Mirror 29: 0xce67515c (stale) Mirror 30: 0xce67515c (stale) Mirror 31: 0xce67515c (stale) Mirror 32: 0xce67515c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa2d23b3 Mirror 33: 0xa2d23b3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000833 1787099433.347077 fallocate 0x014a9c thru 0x015e73 (0x13d8 bytes) 000834 1787099433.489086 fallocate 0x0399fd thru 0x03f5a7 (0x5bab bytes) 000835 1787099433.521819 MIRROR_SPLIT mirror 9 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0xce67515c (stale) Mirror 19: 0xce67515c (stale) Mirror 22: 0xce67515c (stale) Mirror 23: 0xce67515c (stale) Mirror 24: 0xce67515c (stale) Mirror 25: 0xce67515c (stale) Mirror 27: 0xce67515c (stale) Mirror 28: 0xce67515c (stale) Mirror 30: 0xce67515c (stale) Mirror 31: 0xce67515c (stale) Mirror 32: 0xce67515c (stale) Mirror 33: 0xa2d23b3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0xce67515c (stale) Mirror 19: 0xce67515c (stale) Mirror 22: 0xce67515c (stale) Mirror 23: 0xce67515c (stale) Mirror 24: 0xce67515c (stale) Mirror 25: 0xce67515c (stale) Mirror 27: 0xce67515c (stale) Mirror 28: 0xce67515c (stale) Mirror 30: 0xce67515c (stale) Mirror 31: 0xce67515c (stale) Mirror 32: 0xce67515c (stale) Mirror 33: 0xa2d23b3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000836 1787099434.823932 fallocate 0x017ad8 thru 0x0246c7 (0xcbf0 bytes) 000837 1787099434.849446 MIRROR_RESYNC 13 mirrors 000838 1787099439.131840 read 0x01d582 thru 0x0213bd (0x3e3c bytes) 000839 1787099439.182668 trunc from 0x040000 to 0x01b539 (0x24ac6 bytes) 000840 1787099439.309647 punch from 0x018b61 to 0x01a0c8 (0x1568 bytes) 000841 1787099439.336604 mapwrite 0x02c4fd thru 0x0344b6 (0x7fba bytes) 000842 1787099439.468593 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x344b7): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x344b7): Mirror 18: 0x9b66cac4 (stale) Mirror 19: 0x9b66cac4 (stale) Mirror 22: 0x9b66cac4 (stale) Mirror 23: 0x9b66cac4 (stale) Mirror 24: 0x9b66cac4 (stale) Mirror 25: 0x9b66cac4 (stale) Mirror 27: 0x9b66cac4 (stale) Mirror 28: 0x9b66cac4 (stale) Mirror 30: 0x9b66cac4 (stale) Mirror 31: 0x9b66cac4 (stale) Mirror 32: 0x9b66cac4 (stale) Mirror 33: 0x9b66cac4 (stale) CRC-32 checksum value for chunk [0, 0x344b7): Mirror 1: 0xfdf7ea95 Mirror 34: 0xfdf7ea95 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x344b7: skipped 000843 1787099440.990100 fallocate 0x015f0d thru 0x022e88 (0xcf7c bytes) 000844 1787099441.121267 mapwrite 0x0227f9 thru 0x023b1a (0x1322 bytes) 000845 1787099441.207361 MIRROR_RESYNC 14 mirrors 000846 1787099444.934636 trunc from 0x01773b to 0x01d6e7 (0x5fad bytes) 000847 1787099444.991954 MIRROR_RESYNC 14 mirrors 000848 1787099448.666548 trunc from 0x001716 to 0x00a5ef (0x8eda bytes) 000849 1787099448.730129 write 0x021bb0 thru 0x02bdbd (0xa20e bytes) 000850 1787099448.746035 trunc from 0x02d362 to 0x033d93 (0x6a32 bytes) 000851 1787099448.752854 punch from 0x00c5fd to 0x01776f (0xb173 bytes) 000852 1787099448.758321 read 0x000fd0 thru 0x00e48c (0xd4bd bytes) 000853 1787099448.767352 read 0x02018e thru 0x02fafb (0xf96e bytes) 000854 1787099448.775750 mapread 0x019e1b thru 0x01d514 (0x36fa bytes) 000855 1787099448.776886 trunc from 0x0344b7 to 0x027378 (0xd13e bytes) 000856 1787099448.803527 mapwrite 0x02e5b7 thru 0x02fd3b (0x1785 bytes) 000857 1787099448.871071 mapwrite 0x03dccb thru 0x03ffff (0x2335 bytes) 000858 1787099448.942307 mapwrite 0x025b49 thru 0x02d3ec (0x78a4 bytes) 000859 1787099449.062046 fallocate 0x01a651 thru 0x01db46 (0x34f6 bytes) 000861 1787099449.079959 fallocate 0x00526a thru 0x009703 (0x449a bytes) 000862 1787099449.091829 read 0x02830b thru 0x02afee (0x2ce4 bytes) 000864 1787099449.096499 punch from 0x007d7b to 0x00f0d9 (0x735f bytes) 000865 1787099449.112146 fallocate 0x033146 thru 0x03d1c0 (0xa07b bytes) 000866 1787099449.120170 read 0x00cb74 thru 0x012e3b (0x62c8 bytes) 000867 1787099449.158326 MIRROR_RESYNC 14 mirrors 000868 1787099452.637349 MIRROR_RESYNC 14 mirrors 000869 1787099453.614087 MIRROR_RESYNC 14 mirrors 000870 1787099454.466200 trunc from 0x040000 to 0x000110 (0x3feef bytes) 000871 1787099454.548821 write 0x012bd1 thru 0x0131b3 (0x5e3 bytes) 000872 1787099454.551495 write 0x037adf thru 0x03ffff (0x8521 bytes) 000873 1787099454.562372 punch from 0x01f65a to 0x028f79 (0x9920 bytes) 000874 1787099454.572151 trunc from 0x040000 to 0x02f645 (0x109ba bytes) 000875 1787099454.656132 MIRROR_SPLIT mirror 6 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f646): Mirror 18: 0xdd4e92e2 (stale) Mirror 19: 0xdd4e92e2 (stale) Mirror 22: 0xdd4e92e2 (stale) Mirror 23: 0xdd4e92e2 (stale) Mirror 24: 0xdd4e92e2 (stale) Mirror 27: 0xdd4e92e2 (stale) Mirror 28: 0xdd4e92e2 (stale) Mirror 30: 0xdd4e92e2 (stale) Mirror 31: 0xdd4e92e2 (stale) Mirror 32: 0xdd4e92e2 (stale) Mirror 33: 0xdd4e92e2 (stale) Mirror 34: 0xdd4e92e2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f646): Mirror 18: 0xdd4e92e2 (stale) Mirror 19: 0xdd4e92e2 (stale) Mirror 22: 0xdd4e92e2 (stale) Mirror 23: 0xdd4e92e2 (stale) Mirror 24: 0xdd4e92e2 (stale) Mirror 27: 0xdd4e92e2 (stale) Mirror 28: 0xdd4e92e2 (stale) Mirror 30: 0xdd4e92e2 (stale) Mirror 31: 0xdd4e92e2 (stale) Mirror 32: 0xdd4e92e2 (stale) Mirror 33: 0xdd4e92e2 (stale) Mirror 34: 0xdd4e92e2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f646: skipped 000876 1787099455.812255 mapwrite 0x01c7a2 thru 0x025321 (0x8b80 bytes) 000879 1787099455.892522 fallocate 0x006f8a thru 0x016b41 (0xfbb8 bytes) 000880 1787099455.911253 trunc from 0x022e15 to 0x025763 (0x294f bytes) 000881 1787099455.930340 mapwrite 0x020ff5 thru 0x0289e5 (0x79f1 bytes) 000882 1787099455.975190 write 0x01ec0c thru 0x02dd3d (0xf132 bytes) 000883 1787099456.034063 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2f646): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f646): Mirror 18: 0xdd4e92e2 (stale) Mirror 19: 0xdd4e92e2 (stale) Mirror 22: 0xdd4e92e2 (stale) Mirror 23: 0xdd4e92e2 (stale) Mirror 24: 0xdd4e92e2 (stale) Mirror 27: 0xdd4e92e2 (stale) Mirror 28: 0xdd4e92e2 (stale) Mirror 30: 0xdd4e92e2 (stale) Mirror 31: 0xdd4e92e2 (stale) Mirror 32: 0xdd4e92e2 (stale) Mirror 33: 0xdd4e92e2 (stale) Mirror 34: 0xdd4e92e2 (stale) CRC-32 checksum value for chunk [0, 0x2f646): Mirror 1: 0x2641f8f2 Mirror 35: 0x2641f8f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f646: skipped 000884 1787099457.439307 trunc from 0x022e9f to 0x02f645 (0xc7a7 bytes) 000886 1787099457.545767 mapread 0x021a6e thru 0x0242d1 (0x2864 bytes) 000887 1787099457.595376 trunc from 0x02f646 to 0x01f08b (0x105ba bytes) 000888 1787099457.658856 mapread 0x000139 thru 0x00ce78 (0xcd40 bytes) 000889 1787099457.674264 write 0x01f18c thru 0x020391 (0x1206 bytes) 000890 1787099457.681501 trunc from 0x020392 to 0x01bb5e (0x4833 bytes) 000891 1787099457.718854 MIRROR_RESYNC 14 mirrors 000892 1787099460.618029 MIRROR_EXTEND to 15 mirrors 000895 1787099461.626133 write 0x017355 thru 0x017e61 (0xb0d bytes) 000896 1787099461.697291 mapread 0x018df4 thru 0x01bb5e (0x2d6b bytes) 000897 1787099461.728353 mapwrite 0x031515 thru 0x034974 (0x3460 bytes) 000898 1787099461.812283 trunc from 0x034975 to 0x015859 (0x1f11b bytes) 000899 1787099461.833320 punch from 0x00293a to 0x00dbd8 (0xb29f bytes) 000901 1787099461.839817 mapwrite 0x01be3e thru 0x01fa31 (0x3bf4 bytes) 000902 1787099461.894319 mapwrite 0x0288e1 thru 0x034db0 (0xc4d0 bytes) 000903 1787099461.960213 mapread 0x02776b thru 0x0326ad (0xaf43 bytes) 000904 1787099461.966363 mapwrite 0x03f317 thru 0x03ffff (0xce9 bytes) 000905 1787099462.060080 read 0x00d9e8 thru 0x013520 (0x5b39 bytes) 000906 1787099462.077860 trunc from 0x017c41 to 0x023305 (0xb6c5 bytes) 000907 1787099462.084907 trunc from 0x030ca3 to 0x03ffff (0xf35d bytes) 000908 1787099462.101802 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0x2b825737 (stale) Mirror 19: 0x2b825737 (stale) Mirror 22: 0x2b825737 (stale) Mirror 23: 0x2b825737 (stale) Mirror 24: 0x2b825737 (stale) Mirror 27: 0x2b825737 (stale) Mirror 28: 0x2b825737 (stale) Mirror 30: 0x2b825737 (stale) Mirror 31: 0x2b825737 (stale) Mirror 32: 0x2b825737 (stale) Mirror 33: 0x2b825737 (stale) Mirror 34: 0x2b825737 (stale) Mirror 35: 0x2b825737 (stale) Mirror 36: 0x2b825737 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x40f2b1de Mirror 37: 0x40f2b1de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000910 1787099463.444013 fallocate 0x010594 thru 0x0116f1 (0x115e bytes) 000911 1787099463.533770 read 0x01fd63 thru 0x028917 (0x8bb5 bytes) 000912 1787099463.547174 trunc from 0x0379f4 to 0x03ffff (0x860c bytes) 000913 1787099463.552184 fallocate 0x015ba7 thru 0x01fadd (0x9f37 bytes) 000914 1787099463.559284 fallocate 0x02a2e7 thru 0x0314cc (0x71e6 bytes) 000915 1787099463.564617 trunc from 0x00b238 to 0x0139f9 (0x87c2 bytes) 000916 1787099463.570319 write 0x0148f9 thru 0x01f532 (0xac3a bytes) 000917 1787099463.587343 MIRROR_RESYNC 16 mirrors 000918 1787099468.390131 write 0x037019 thru 0x03ffff (0x8fe7 bytes) 000919 1787099468.464896 MIRROR_RESYNC 16 mirrors 000920 1787099473.256272 trunc from 0x040000 to 0x008515 (0x37aea bytes) 000921 1787099473.356223 mapread 0x003da9 thru 0x008515 (0x476d bytes) 000922 1787099473.396600 trunc from 0x008516 to 0x030c35 (0x28720 bytes) 000923 1787099473.437614 trunc from 0x030c36 to 0x001cce (0x2ef67 bytes) 000925 1787099473.459989 trunc from 0x0009e8 to 0x001cce (0x12e7 bytes) 000926 1787099473.474218 write 0x028f34 thru 0x03302a (0xa0f7 bytes) 000927 1787099473.482358 write 0x035870 thru 0x037847 (0x1fd8 bytes) 000928 1787099473.484169 mapread 0x02be9f thru 0x037847 (0xb9a9 bytes) 000929 1787099473.492192 mapread 0x033ae7 thru 0x037847 (0x3d61 bytes) 000930 1787099473.496492 write 0x015458 thru 0x01618b (0xd34 bytes) 000931 1787099473.516358 MIRROR_RESYNC 16 mirrors 000932 1787099478.436521 mapwrite 0x024182 thru 0x02f9d3 (0xb852 bytes) 000934 1787099478.715986 read 0x02e64f thru 0x034dec (0x679e bytes) 000935 1787099478.717216 fallocate 0x01a7f0 thru 0x023325 (0x8b36 bytes) 000936 1787099478.731944 read 0x010971 thru 0x014ea5 (0x4535 bytes) 000937 1787099478.760721 mapread 0x033a57 thru 0x037847 (0x3df1 bytes) 000938 1787099478.769032 punch from 0x028b1a to 0x02d1d1 (0x46b8 bytes) 000939 1787099478.780496 trunc from 0x0168f0 to 0x02013b (0x984c bytes) 000940 1787099478.789056 trunc from 0x024a32 to 0x02c82a (0x7df9 bytes) 000941 1787099478.800664 trunc from 0x00eab1 to 0x0154f3 (0x6a43 bytes) 000942 1787099478.808060 mapwrite 0x03c432 thru 0x03ffff (0x3bce bytes) 000943 1787099478.883026 mapwrite 0x031636 thru 0x037374 (0x5d3f bytes) 000944 1787099478.919107 trunc from 0x02e626 to 0x02e91e (0x2f9 bytes) 000945 1787099478.929980 write 0x03366e thru 0x03ffff (0xc992 bytes) 000946 1787099478.936710 fallocate 0x03be50 thru 0x03ffff (0x41b0 bytes) 000948 1787099478.949963 mapwrite 0x035de6 thru 0x03b28b (0x54a6 bytes) 000949 1787099478.982328 trunc from 0x040000 to 0x02454a (0x1bab5 bytes) 000950 1787099479.000536 punch from 0x01e13b to 0x020020 (0x1ee6 bytes) 000951 1787099479.005871 fallocate 0x030d8c thru 0x039fa8 (0x921d bytes) 000952 1787099479.011513 write 0x02427d thru 0x027df6 (0x3b7a bytes) 000953 1787099479.022239 MIRROR_SPLIT mirror 15 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27df7): Mirror 18: 0x1c379cd7 (stale) Mirror 19: 0x1c379cd7 (stale) Mirror 22: 0x1c379cd7 (stale) Mirror 23: 0x1c379cd7 (stale) Mirror 24: 0x1c379cd7 (stale) Mirror 27: 0x1c379cd7 (stale) Mirror 28: 0x1c379cd7 (stale) Mirror 30: 0x1c379cd7 (stale) Mirror 31: 0x1c379cd7 (stale) Mirror 32: 0x1c379cd7 (stale) Mirror 33: 0x1c379cd7 (stale) Mirror 34: 0x1c379cd7 (stale) Mirror 35: 0x1c379cd7 (stale) Mirror 36: 0x1c379cd7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27df7): Mirror 18: 0x1c379cd7 (stale) Mirror 19: 0x1c379cd7 (stale) Mirror 22: 0x1c379cd7 (stale) Mirror 23: 0x1c379cd7 (stale) Mirror 24: 0x1c379cd7 (stale) Mirror 27: 0x1c379cd7 (stale) Mirror 28: 0x1c379cd7 (stale) Mirror 30: 0x1c379cd7 (stale) Mirror 31: 0x1c379cd7 (stale) Mirror 32: 0x1c379cd7 (stale) Mirror 33: 0x1c379cd7 (stale) Mirror 34: 0x1c379cd7 (stale) Mirror 35: 0x1c379cd7 (stale) Mirror 36: 0x1c379cd7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27df7: skipped 000954 1787099480.112089 trunc from 0x027df7 to 0x002dcb (0x2502b bytes) 000955 1787099480.133495 trunc from 0x002dcc to 0x02d5d4 (0x2a809 bytes) 000956 1787099480.152016 mapwrite 0x003d6d thru 0x00e69a (0xa92e bytes) 000957 1787099480.196521 read 0x01629f thru 0x01d824 (0x7586 bytes) 000958 1787099480.208023 trunc from 0x00a234 to 0x01148a (0x7257 bytes) 000959 1787099480.214080 fallocate 0x018909 thru 0x01fa4f (0x7147 bytes) 000960 1787099480.219880 fallocate 0x036ccd thru 0x0397a3 (0x2ad7 bytes) 000961 1787099480.238819 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x397a4): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x397a4): Mirror 18: 0xb8abb132 (stale) Mirror 19: 0xb8abb132 (stale) Mirror 22: 0xb8abb132 (stale) Mirror 23: 0xb8abb132 (stale) Mirror 24: 0xb8abb132 (stale) Mirror 27: 0xb8abb132 (stale) Mirror 28: 0xb8abb132 (stale) Mirror 30: 0xb8abb132 (stale) Mirror 31: 0xb8abb132 (stale) Mirror 32: 0xb8abb132 (stale) Mirror 33: 0xb8abb132 (stale) Mirror 34: 0xb8abb132 (stale) Mirror 35: 0xb8abb132 (stale) Mirror 36: 0xb8abb132 (stale) CRC-32 checksum value for chunk [0, 0x397a4): Mirror 1: 0xc9483660 Mirror 37: 0xc9483660 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x397a4: skipped 000962 1787099482.098629 punch from 0x023763 to 0x0242e3 (0xb81 bytes) 000963 1787099482.168767 MIRROR_SPLIT mirror 8 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x397a4): Mirror 18: 0xb8abb132 (stale) Mirror 19: 0xb8abb132 (stale) Mirror 22: 0xb8abb132 (stale) Mirror 23: 0xb8abb132 (stale) Mirror 24: 0xb8abb132 (stale) Mirror 27: 0xb8abb132 (stale) Mirror 28: 0xb8abb132 (stale) Mirror 31: 0xb8abb132 (stale) Mirror 32: 0xb8abb132 (stale) Mirror 33: 0xb8abb132 (stale) Mirror 34: 0xb8abb132 (stale) Mirror 35: 0xb8abb132 (stale) Mirror 36: 0xb8abb132 (stale) Mirror 37: 0xc9483660 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x397a4): Mirror 18: 0xb8abb132 (stale) Mirror 19: 0xb8abb132 (stale) Mirror 22: 0xb8abb132 (stale) Mirror 23: 0xb8abb132 (stale) Mirror 24: 0xb8abb132 (stale) Mirror 27: 0xb8abb132 (stale) Mirror 28: 0xb8abb132 (stale) Mirror 31: 0xb8abb132 (stale) Mirror 32: 0xb8abb132 (stale) Mirror 33: 0xb8abb132 (stale) Mirror 34: 0xb8abb132 (stale) Mirror 35: 0xb8abb132 (stale) Mirror 36: 0xb8abb132 (stale) Mirror 37: 0xc9483660 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x397a4: skipped 000965 1787099483.189976 mapwrite 0x035e0b thru 0x03ffff (0xa1f5 bytes) 000966 1787099483.293816 punch from 0x00e9b6 to 0x01c45c (0xdaa7 bytes) 000967 1787099483.303375 trunc from 0x040000 to 0x021461 (0x1eb9e bytes) 000968 1787099483.326287 write 0x0158ce thru 0x023a4f (0xe182 bytes) 000969 1787099483.339798 trunc from 0x013eca to 0x01ee74 (0xafab bytes) 000971 1787099483.366172 fallocate 0x02b9a4 thru 0x0339f1 (0x804e bytes) 000972 1787099483.380231 read 0x017d12 thru 0x017ded (0xdc bytes) 000973 1787099483.387898 mapwrite 0x037ece thru 0x038246 (0x379 bytes) 000974 1787099483.449365 read 0x01c2f8 thru 0x023011 (0x6d1a bytes) 000975 1787099483.473299 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x38247): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38247): Mirror 18: 0x838e7b06 (stale) Mirror 19: 0x838e7b06 (stale) Mirror 22: 0x838e7b06 (stale) Mirror 23: 0x838e7b06 (stale) Mirror 24: 0x838e7b06 (stale) Mirror 27: 0x838e7b06 (stale) Mirror 28: 0x838e7b06 (stale) Mirror 31: 0x838e7b06 (stale) Mirror 32: 0x838e7b06 (stale) Mirror 33: 0x838e7b06 (stale) Mirror 34: 0x838e7b06 (stale) Mirror 35: 0x838e7b06 (stale) Mirror 36: 0x838e7b06 (stale) Mirror 37: 0xe9fa8fc1 (stale) CRC-32 checksum value for chunk [0, 0x38247): Mirror 1: 0x1ef8bc5f Mirror 38: 0x1ef8bc5f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38247: skipped 000976 1787099485.302018 fallocate 0x0053a4 thru 0x00e521 (0x917e bytes) 000977 1787099485.388911 trunc from 0x038247 to 0x0129e5 (0x25861 bytes) 000978 1787099485.424360 MIRROR_RESYNC 16 mirrors 000979 1787099488.975185 mapwrite 0x00ad5b thru 0x0131d2 (0x8478 bytes) 000980 1787099489.076558 trunc from 0x0131d3 to 0x03a818 (0x27646 bytes) 000981 1787099489.108722 mapread 0x014ba4 thru 0x0237ad (0xec0a bytes) 000982 1787099489.133728 punch from 0x016596 to 0x020873 (0xa2de bytes) 000983 1787099489.139838 fallocate 0x012208 thru 0x01362b (0x1424 bytes) 000984 1787099489.147749 mapread 0x0230f4 thru 0x02a198 (0x70a5 bytes) 000986 1787099489.162064 trunc from 0x00179e to 0x00c170 (0xa9d3 bytes) 000988 1787099489.170155 read 0x00c16b thru 0x00e9a8 (0x283e bytes) 000989 1787099489.178062 trunc from 0x00223f to 0x0059cf (0x3791 bytes) 000990 1787099489.205157 MIRROR_RESYNC 16 mirrors 000991 1787099493.311372 trunc from 0x0179e9 to 0x018c3b (0x1253 bytes) 000993 1787099493.376311 read 0x038fd6 thru 0x03a818 (0x1843 bytes) 000994 1787099493.390248 MIRROR_SPLIT mirror 9 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a819): Mirror 18: 0xc6bdc362 (stale) Mirror 19: 0xc6bdc362 (stale) Mirror 22: 0xc6bdc362 (stale) Mirror 23: 0xc6bdc362 (stale) Mirror 24: 0xc6bdc362 (stale) Mirror 27: 0xc6bdc362 (stale) Mirror 28: 0xc6bdc362 (stale) Mirror 31: 0xc6bdc362 (stale) Mirror 33: 0xc6bdc362 (stale) Mirror 34: 0xc6bdc362 (stale) Mirror 35: 0xc6bdc362 (stale) Mirror 36: 0xc6bdc362 (stale) Mirror 37: 0xc6bdc362 (stale) Mirror 38: 0xc6bdc362 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a819): Mirror 18: 0xc6bdc362 (stale) Mirror 19: 0xc6bdc362 (stale) Mirror 22: 0xc6bdc362 (stale) Mirror 23: 0xc6bdc362 (stale) Mirror 24: 0xc6bdc362 (stale) Mirror 27: 0xc6bdc362 (stale) Mirror 28: 0xc6bdc362 (stale) Mirror 31: 0xc6bdc362 (stale) Mirror 33: 0xc6bdc362 (stale) Mirror 34: 0xc6bdc362 (stale) Mirror 35: 0xc6bdc362 (stale) Mirror 36: 0xc6bdc362 (stale) Mirror 37: 0xc6bdc362 (stale) Mirror 38: 0xc6bdc362 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a819: skipped 000995 1787099494.244850 trunc from 0x027b84 to 0x036841 (0xecbe bytes) 000996 1787099494.252537 punch from 0x00cd08 to 0x01034e (0x3647 bytes) 000997 1787099494.263350 MIRROR_RESYNC 15 mirrors 000998 1787099498.372544 mapread 0x01671d thru 0x0195b8 (0x2e9c bytes) 000999 1787099498.407619 fallocate 0x00f79c thru 0x01a328 (0xab8d bytes) All operations completed A-OK!