== sanity-flr test 70a: flr mode fsx test ================ 05:12:28 (1786353148) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 3150 skipping zero size read skipping zero length zero range truncating to largest ever: 0x114cd 000003 1786353150.215618 trunc from 00000000 to 0x0114cc (0x114cd bytes) 000004 1786353150.234080 read 0x0062f9 thru 0x00aa91 (0x4799 bytes) 000006 1786353150.248959 mapwrite 0x03f337 thru 0x03ffff (0xcc9 bytes) 000007 1786353150.291957 punch from 0x002fbb to 0x008647 (0x568d bytes) 000008 1786353150.299481 mapwrite 0x002bd7 thru 0x002ebf (0x2e9 bytes) 000010 1786353150.321468 punch from 0x030440 to 0x030a2f (0x5f0 bytes) 000011 1786353150.328942 mapread 0x02f05f thru 0x0355d3 (0x6575 bytes) 000012 1786353150.345871 trunc from 0x02b293 to 0x02df8f (0x2cfd bytes) truncating to largest ever: 0x1b295 000013 1786353150.352275 trunc from 0x040000 to 0x01b294 (0x24d6b bytes) 000014 1786353150.368327 fallocate 0x000008 thru 0x001179 (0x1172 bytes) 000015 1786353150.374844 punch from 0x013ad1 to 0x01b294 (0x77c4 bytes) 000016 1786353150.378979 write 0x03a299 thru 0x03ffff (0x5d67 bytes) truncating to largest ever: 0x35564 000017 1786353150.380962 trunc from 0x040000 to 0x035563 (0xaa9c bytes) 000018 1786353150.394550 write 0x013be7 thru 0x01b8ab (0x7cc5 bytes) 000020 1786353150.406094 read 0x0142ca thru 0x021728 (0xd45f bytes) 000021 1786353150.419156 trunc from 0x035564 to 0x018cb1 (0x1c8b2 bytes) 000022 1786353150.437975 mapread 0x0158ed thru 0x018cb1 (0x33c5 bytes) 000023 1786353150.439698 read 0x00f66a thru 0x018cb1 (0x9648 bytes) 000024 1786353150.440858 mapwrite 0x017b72 thru 0x0196cc (0x1b5b bytes) 000025 1786353150.485883 punch from 0x014ad1 to 0x0196cc (0x4bfc bytes) 000027 1786353150.494308 write 0x004e1e thru 0x007d22 (0x2f05 bytes) 000028 1786353150.496601 read 0x0069c1 thru 0x00c800 (0x5e40 bytes) 000029 1786353150.497627 mapwrite 0x0398e5 thru 0x03e447 (0x4b63 bytes) 000030 1786353150.551383 trunc from 0x015309 to 0x024825 (0xf51d bytes) 000032 1786353150.564226 write 0x0222fa thru 0x02c4e2 (0xa1e9 bytes) 000033 1786353150.573374 fallocate 0x0118f2 thru 0x01317a (0x1889 bytes) 000034 1786353150.584645 trunc from 0x03e448 to 0x033618 (0xae2f bytes) 000035 1786353150.605896 punch from 0x003547 to 0x00ab55 (0x760f bytes) fallocating to largest ever: 0x40000 000036 1786353150.614661 fallocate 0x03982f thru 0x03ffff (0x67d1 bytes) 000037 1786353150.621203 trunc from 0x033619 to 0x0223b5 (0x11263 bytes) 000038 1786353150.637561 write 0x03e816 thru 0x03ffff (0x17ea bytes) 000039 1786353150.639586 read 0x003062 thru 0x0104cd (0xd46c bytes) 000041 1786353150.655743 trunc from 0x02187c to 0x029e20 (0x85a5 bytes) 000042 1786353150.681344 write 0x002026 thru 0x004509 (0x24e4 bytes) 000043 1786353150.682428 fallocate 0x0337b6 thru 0x037181 (0x39cc bytes) 000044 1786353150.695490 MIRROR_EXTEND to 2 mirrors 000045 1786353151.261107 mapwrite 0x0292f9 thru 0x039065 (0xfd6d bytes) 000046 1786353151.366913 trunc from 0x02bdfc to 0x030310 (0x4515 bytes) 000047 1786353151.374310 fallocate 0x004237 thru 0x01158d (0xd357 bytes) 000048 1786353151.379923 mapread 0x013a88 thru 0x01a7c1 (0x6d3a bytes) 000049 1786353151.398637 MIRROR_RESYNC 2 mirrors 000050 1786353152.073838 punch from 0x017d30 to 0x0207b2 (0x8a83 bytes) 000051 1786353152.126315 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) 000052 1786353152.281446 mapread 0x03f582 thru 0x03ffff (0xa7e bytes) 000053 1786353152.285453 mapread 0x0278f8 thru 0x036b8e (0xf297 bytes) 000054 1786353152.309620 write 0x002b6a thru 0x00bbd5 (0x906c bytes) 000055 1786353152.333838 mapread 0x03f284 thru 0x03ffff (0xd7c bytes) 000056 1786353152.338340 trunc from 0x040000 to 0x0225f2 (0x1da0d bytes) 000057 1786353152.385393 trunc from 0x0225f3 to 0x02767d (0x508b bytes) 000058 1786353152.413285 mapread 0x008acf thru 0x00b371 (0x28a3 bytes) 000059 1786353152.414574 read 0x026718 thru 0x02767d (0xf66 bytes) 000060 1786353152.425004 mapread 0x0265b2 thru 0x02767d (0x10cc bytes) 000062 1786353152.430206 fallocate 0x028b98 thru 0x0312bb (0x8724 bytes) 000063 1786353152.441960 trunc from 0x025a54 to 0x02767d (0x1c2a bytes) 000064 1786353152.447676 write 0x03087a thru 0x03149a (0xc21 bytes) 000065 1786353152.448815 trunc from 0x020476 to 0x021c8e (0x1819 bytes) 000066 1786353152.457682 read 0x0110ae thru 0x019ccb (0x8c1e bytes) 000067 1786353152.478986 mapread 0x0309ef thru 0x03149a (0xaac bytes) 000069 1786353152.481113 write 0x0352b2 thru 0x03a60d (0x535c bytes) 000070 1786353152.482655 trunc from 0x0001bc to 0x00ebd2 (0xea17 bytes) 000071 1786353152.508938 read 0x009010 thru 0x0113f0 (0x83e1 bytes) 000072 1786353152.523293 mapwrite 0x02c78e thru 0x032edf (0x6752 bytes) 000073 1786353152.551453 mapread 0x033bd0 thru 0x0360d7 (0x2508 bytes) 000074 1786353152.553662 mapwrite 0x00361d thru 0x00f6ff (0xc0e3 bytes) 000075 1786353152.580397 mapwrite 0x006569 thru 0x00ab42 (0x45da bytes) 000076 1786353152.603661 trunc from 0x03a60e to 0x0168df (0x23d2e bytes) 000077 1786353152.622653 trunc from 0x00f2d0 to 0x014cff (0x5a30 bytes) 000078 1786353152.628921 trunc from 0x003c26 to 0x00b04a (0x7425 bytes) 000079 1786353152.634236 mapwrite 0x0232f4 thru 0x02d794 (0xa4a1 bytes) 000080 1786353152.736918 read 0x01150e thru 0x0158a4 (0x4397 bytes) 000082 1786353152.754404 fallocate 0x00ef86 thru 0x01435b (0x53d6 bytes) 000083 1786353152.760476 mapwrite 0x018b39 thru 0x025ef9 (0xd3c1 bytes) 000084 1786353152.788325 mapwrite 0x02654f thru 0x03195b (0xb40d bytes) 000085 1786353152.828992 fallocate 0x01c5a3 thru 0x020891 (0x42ef bytes) 000086 1786353152.834620 fallocate 0x000e85 thru 0x0038d6 (0x2a52 bytes) 000087 1786353152.841030 fallocate 0x03b8ce thru 0x03c1ff (0x932 bytes) 000088 1786353152.845630 fallocate 0x02a061 thru 0x033b4e (0x9aee bytes) 000089 1786353152.850643 fallocate 0x02d94b thru 0x034cd3 (0x7389 bytes) 000091 1786353152.857159 trunc from 0x00d9c8 to 0x014a00 (0x7039 bytes) 000092 1786353152.862970 mapread 0x00f34e thru 0x01be5c (0xcb0f bytes) 000093 1786353152.893668 trunc from 0x00d504 to 0x01b60c (0xe109 bytes) 000094 1786353152.899175 read 0x0012f9 thru 0x003c6c (0x2974 bytes) 000095 1786353152.899975 write 0x006cc7 thru 0x00e967 (0x7ca1 bytes) 000096 1786353152.905085 trunc from 0x03195c to 0x02673d (0xb21e bytes) 000097 1786353152.922554 mapread 0x0120ee thru 0x014304 (0x2217 bytes) 000099 1786353152.933319 trunc from 0x02673e to 0x0197ce (0xcf6f bytes) 000100 1786353152.955517 read 0x00e21b thru 0x0134af (0x5295 bytes) 000101 1786353152.958650 write 0x01c70c thru 0x02833f (0xbc34 bytes) 000103 1786353152.963133 punch from 0x00e4a6 to 0x01afb4 (0xcb0f bytes) 000105 1786353152.980239 fallocate 0x02ca54 thru 0x032d5c (0x6309 bytes) 000106 1786353152.985672 fallocate 0x017df0 thru 0x02573a (0xd94b bytes) 000107 1786353152.990364 read 0x029dd4 thru 0x02c6bd (0x28ea bytes) 000108 1786353153.001329 trunc from 0x016cfa to 0x01dc60 (0x6f67 bytes) 000110 1786353153.010995 punch from 0x0106eb to 0x01251d (0x1e33 bytes) 000111 1786353153.015718 trunc from 0x032d5d to 0x028b45 (0xa217 bytes) 000113 1786353153.036617 trunc from 0x028b46 to 0x001622 (0x27523 bytes) 000114 1786353153.056141 fallocate 0x00ad9e thru 0x00f4ea (0x474d bytes) 000115 1786353153.070453 MIRROR_EXTEND to 2 mirrors 000117 1786353153.541082 trunc from 0x00b9f9 to 0x00f4ea (0x3af2 bytes) 000118 1786353153.572092 punch from 0x00ab21 to 0x00f4ea (0x49ca bytes) 000119 1786353153.581408 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xf4eb): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf4eb): Mirror 2: 0x7f3ab15b (stale) CRC-32 checksum value for chunk [0, 0xf4eb): Mirror 1: 0x7f3ab15b Mirror 3: 0x7f3ab15b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf4eb: skipped 000120 1786353154.171136 mapread 0x0066dd thru 0x007fd9 (0x18fd bytes) 000121 1786353154.203464 write 0x02f895 thru 0x03de24 (0xe590 bytes) 000122 1786353154.244591 write 0x037167 thru 0x03ffff (0x8e99 bytes) 000123 1786353154.246887 mapread 0x011be9 thru 0x01a797 (0x8baf bytes) 000124 1786353154.268050 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000125 1786353154.502854 write 0x032da8 thru 0x036aff (0x3d58 bytes) 000126 1786353154.514216 trunc from 0x00c9f8 to 0x01bcd6 (0xf2df bytes) 000127 1786353154.527992 mapread 0x00bdf7 thru 0x010faa (0x51b4 bytes) 000128 1786353154.547465 mapread 0x012549 thru 0x013ab3 (0x156b bytes) 000130 1786353154.555511 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbe3ef0d5 Mirror 4: 0xbe3ef0d5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000131 1786353155.117691 read 0x01e2e7 thru 0x02bbe3 (0xd8fd bytes) 000132 1786353155.131965 mapwrite 0x03aff6 thru 0x03ffff (0x500a bytes) 000133 1786353155.225611 MIRROR_RESYNC 3 mirrors 000135 1786353155.799285 write 0x000ce6 thru 0x001b31 (0xe4c bytes) 000136 1786353155.833689 mapread 0x0390b5 thru 0x03ffff (0x6f4b bytes) 000137 1786353155.856713 MIRROR_RESYNC 3 mirrors 000138 1786353156.374413 trunc from 0x0397b9 to 0x03ffff (0x6847 bytes) 000140 1786353156.409189 punch from 0x015e43 to 0x016ee7 (0x10a5 bytes) 000141 1786353156.415417 punch from 0x01c278 to 0x01ed55 (0x2ade bytes) 000142 1786353156.423369 punch from 0x0021b5 to 0x00cc2d (0xaa79 bytes) 000143 1786353156.433432 mapread 0x00628f thru 0x00aa91 (0x4803 bytes) 000144 1786353156.461090 read 0x038b6e thru 0x03ffff (0x7492 bytes) 000145 1786353156.471377 write 0x01482c thru 0x01555d (0xd32 bytes) 000146 1786353156.479406 mapread 0x01baaa thru 0x01d71b (0x1c72 bytes) 000147 1786353156.489893 punch from 0x00e1bd to 0x01286f (0x46b3 bytes) 000148 1786353156.494120 punch from 0x011482 to 0x016682 (0x5201 bytes) 000149 1786353156.505705 mapread 0x02b27b thru 0x02ef32 (0x3cb8 bytes) 000150 1786353156.515322 read 0x0344ef thru 0x03bf95 (0x7aa7 bytes) 000151 1786353156.525322 punch from 0x01fd74 to 0x02a86e (0xaafb bytes) 000152 1786353156.531012 write 0x01cf21 thru 0x0281f1 (0xb2d1 bytes) 000153 1786353156.542567 mapwrite 0x020b48 thru 0x02388e (0x2d47 bytes) 000154 1786353156.565322 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x45f57210 (stale) Mirror 4: 0x45f57210 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4911753d Mirror 5: 0x4911753d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000155 1786353157.208311 trunc from 0x024893 to 0x0308eb (0xc059 bytes) 000156 1786353157.240972 punch from 0x030480 to 0x03a237 (0x9db8 bytes) 000157 1786353157.245900 write 0x017a68 thru 0x01d660 (0x5bf9 bytes) 000158 1786353157.268311 MIRROR_RESYNC 4 mirrors 000159 1786353158.121349 trunc from 0x020c53 to 0x030aad (0xfe5b bytes) 000160 1786353158.153017 fallocate 0x01a2bc thru 0x01c2da (0x201f bytes) 000161 1786353158.157822 mapwrite 0x032ba1 thru 0x03ffff (0xd45f bytes) 000162 1786353158.206035 mapwrite 0x023559 thru 0x025e8e (0x2936 bytes) 000163 1786353158.228047 mapread 0x0319eb thru 0x039095 (0x76ab bytes) 000164 1786353158.229401 mapwrite 0x0390f0 thru 0x03ffff (0x6f10 bytes) 000165 1786353158.254728 trunc from 0x0342ed to 0x03e07f (0x9d93 bytes) 000166 1786353158.259403 read 0x0395b5 thru 0x03ffff (0x6a4b bytes) 000167 1786353158.268262 fallocate 0x02fbe8 thru 0x0348ad (0x4cc6 bytes) 000168 1786353158.276251 mapwrite 0x016838 thru 0x024e6e (0xe637 bytes) 000169 1786353158.313930 trunc from 0x0155c1 to 0x018829 (0x3269 bytes) 000170 1786353158.320013 mapread 0x01902b thru 0x0273a0 (0xe376 bytes) 000172 1786353158.322424 mapwrite 0x02a004 thru 0x02c9df (0x29dc bytes) 000173 1786353158.345553 trunc from 0x040000 to 0x0047c3 (0x3b83c bytes) 000174 1786353158.368600 punch from 0x000d37 to 0x0047c3 (0x3a8d bytes) 000175 1786353158.378032 fallocate 0x015a8d thru 0x024696 (0xec0a bytes) 000176 1786353158.383140 trunc from 0x024697 to 0x030cf6 (0xc660 bytes) 000178 1786353158.400316 read 0x02d1ac thru 0x02fc1a (0x2a6f bytes) 000179 1786353158.409548 mapread 0x02c8a7 thru 0x030cf6 (0x4450 bytes) 000180 1786353158.410841 mapread 0x014da1 thru 0x02045f (0xb6bf bytes) 000181 1786353158.415271 MIRROR_RESYNC 4 mirrors 000182 1786353158.939321 trunc from 0x030cf7 to 0x00da9f (0x23257 bytes) 000183 1786353158.995759 mapread 0x003e7d thru 0x00a3dc (0x6560 bytes) 000184 1786353159.020436 trunc from 0x00daa0 to 0x02a2fb (0x1c85c bytes) 000185 1786353159.041182 write 0x00b64a thru 0x01275c (0x7113 bytes) 000186 1786353159.046904 mapwrite 0x02cba1 thru 0x035c12 (0x9072 bytes) 000187 1786353159.110134 trunc from 0x0165d0 to 0x02158f (0xafc0 bytes) 000189 1786353159.115142 write 0x01599f thru 0x01d2a6 (0x7908 bytes) 000190 1786353159.126739 mapwrite 0x0045a1 thru 0x008c28 (0x4688 bytes) 000191 1786353159.147972 trunc from 0x035c13 to 0x027b8b (0xe087 bytes) 000192 1786353159.166868 punch from 0x007fd2 to 0x014a50 (0xca7f bytes) 000193 1786353159.173683 read 0x00fa61 thru 0x019fa5 (0xa545 bytes) 000194 1786353159.188590 MIRROR_RESYNC 4 mirrors 000195 1786353160.033227 write 0x02b1e7 thru 0x03289b (0x76b5 bytes) 000197 1786353160.074476 mapread 0x011c8b thru 0x016b55 (0x4ecb bytes) 000198 1786353160.105329 fallocate 0x03f2d0 thru 0x03ffff (0xd30 bytes) 000200 1786353160.112002 mapwrite 0x0200df thru 0x02111e (0x1040 bytes) 000201 1786353160.143863 mapread 0x015e05 thru 0x01dccf (0x7ecb bytes) 000202 1786353160.145237 mapwrite 0x013612 thru 0x01ff3f (0xc92e bytes) 000203 1786353160.166008 trunc from 0x040000 to 0x01fd11 (0x202ee bytes) 000204 1786353160.210643 mapread 0x01c8c7 thru 0x01fd11 (0x344b bytes) 000205 1786353160.211823 punch from 0x018839 to 0x01fd11 (0x74d9 bytes) 000206 1786353160.218696 mapwrite 0x022712 thru 0x028de7 (0x66d6 bytes) 000207 1786353160.261148 trunc from 0x028de8 to 0x02e963 (0x5b7c bytes) 000208 1786353160.276650 punch from 0x0265d3 to 0x02dcfe (0x772c bytes) 000210 1786353160.283107 mapread 0x013138 thru 0x01d077 (0x9f40 bytes) 000211 1786353160.290634 punch from 0x011f1c to 0x012d63 (0xe48 bytes) 000212 1786353160.300858 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e964): Mirror 4: 0xd353c7d9 (stale) Mirror 5: 0xd353c7d9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e964): Mirror 4: 0xd353c7d9 (stale) Mirror 5: 0xd353c7d9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e964: skipped 000213 1786353160.586700 mapwrite 0x02e859 thru 0x033248 (0x49f0 bytes) 000214 1786353160.645073 punch from 0x02e4b1 to 0x032eb1 (0x4a01 bytes) 000215 1786353160.651540 read 0x0174fa thru 0x01d622 (0x6129 bytes) 000216 1786353160.663212 read 0x0183a7 thru 0x021c10 (0x986a bytes) 000217 1786353160.690486 read 0x0314b8 thru 0x033248 (0x1d91 bytes) 000218 1786353160.691318 mapread 0x02e15b thru 0x033248 (0x50ee bytes) 000219 1786353160.698277 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x33249): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33249): Mirror 4: 0x959b3780 (stale) Mirror 5: 0x959b3780 (stale) CRC-32 checksum value for chunk [0, 0x33249): Mirror 1: 0x5123aaed Mirror 6: 0x5123aaed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33249: skipped 000220 1786353161.534924 trunc from 0x01a739 to 0x021937 (0x71ff bytes) 000221 1786353161.575392 mapread 0x001fef thru 0x00b37c (0x938e bytes) 000222 1786353161.599133 trunc from 0x033249 to 0x030447 (0x2e01 bytes) 000223 1786353161.623210 trunc from 0x030448 to 0x030ff6 (0xbaf bytes) 000224 1786353161.641969 punch from 0x02ff26 to 0x030ff6 (0x10d1 bytes) 000225 1786353161.649556 read 0x0104d7 thru 0x010bff (0x729 bytes) 000227 1786353161.650866 punch from 0x013896 to 0x01c681 (0x8dec bytes) 000228 1786353161.658919 trunc from 0x030ff7 to 0x02dbfe (0x33f8 bytes) 000230 1786353161.676059 read 0x027039 thru 0x02dbfe (0x6bc6 bytes) 000232 1786353161.687147 read 0x0005c1 thru 0x00f239 (0xec79 bytes) 000233 1786353161.688057 punch from 0x01db0d to 0x02a9ac (0xcea0 bytes) 000234 1786353161.694284 trunc from 0x02dbff to 0x011cb6 (0x1bf48 bytes) 000235 1786353161.716535 fallocate 0x029ff5 thru 0x02f7e1 (0x57ed bytes) 000236 1786353161.728493 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11cb7): Mirror 4: 0x621cc1bf (stale) Mirror 6: 0x621cc1bf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11cb7): Mirror 4: 0x621cc1bf (stale) Mirror 6: 0x621cc1bf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11cb7: skipped 000237 1786353162.022192 fallocate 0x00050b thru 0x0033b3 (0x2ea9 bytes) 000238 1786353162.029988 read 0x0069d2 thru 0x00d31d (0x694c bytes) 000239 1786353162.037223 fallocate 0x00bd41 thru 0x014a6d (0x8d2d bytes) 000240 1786353162.045712 trunc from 0x014a6e to 0x001fef (0x12a7e bytes) 000241 1786353162.076711 fallocate 0x02d790 thru 0x03c519 (0xed8a bytes) 000243 1786353162.084179 trunc from 0x026a5d to 0x028353 (0x18f7 bytes) 000244 1786353162.091561 fallocate 0x006793 thru 0x00a3b3 (0x3c21 bytes) 000246 1786353162.099450 write 0x033eb5 thru 0x03fb2a (0xbc76 bytes) 000247 1786353162.106278 fallocate 0x02c5f5 thru 0x035300 (0x8d0c bytes) 000248 1786353162.113358 punch from 0x016884 to 0x01fc67 (0x93e4 bytes) 000249 1786353162.123112 MIRROR_RESYNC 3 mirrors 000251 1786353162.731300 MIRROR_EXTEND to 4 mirrors 000252 1786353163.429753 fallocate 0x02fa80 thru 0x036115 (0x6696 bytes) 000254 1786353163.504994 punch from 0x0295ba to 0x0324b0 (0x8ef7 bytes) 000255 1786353163.514761 punch from 0x036424 to 0x03fb2a (0x9707 bytes) 000256 1786353163.523424 fallocate 0x01eef5 thru 0x0277e7 (0x88f3 bytes) 000257 1786353163.538546 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3fb2b): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb2b): Mirror 4: 0x7c0a0587 (stale) Mirror 6: 0x7c0a0587 (stale) Mirror 7: 0x7c0a0587 (stale) CRC-32 checksum value for chunk [0, 0x3fb2b): Mirror 1: 0x96052422 Mirror 8: 0x96052422 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb2b: skipped 000258 1786353164.256898 fallocate 0x01c7f5 thru 0x0258f0 (0x90fc bytes) 000259 1786353164.296301 write 0x0293d4 thru 0x032ee3 (0x9b10 bytes) 000260 1786353164.320599 MIRROR_RESYNC 5 mirrors 000261 1786353165.354373 punch from 0x03d74d to 0x03fb2a (0x23de bytes) 000262 1786353165.388358 MIRROR_RESYNC 5 mirrors 000265 1786353166.430147 write 0x0238b8 thru 0x029ab1 (0x61fa bytes) 000266 1786353166.477050 mapread 0x00e136 thru 0x01a65c (0xc527 bytes) 000267 1786353166.511921 trunc from 0x031ad6 to 0x039da0 (0x82cb bytes) 000268 1786353166.518144 read 0x00a2f0 thru 0x00c96c (0x267d bytes) 000272 1786353166.521877 mapwrite 0x0280b7 thru 0x0370a8 (0xeff2 bytes) 000273 1786353166.568919 trunc from 0x01c85d to 0x02759b (0xad3f bytes) 000274 1786353166.576081 write 0x00569e thru 0x005f75 (0x8d8 bytes) 000275 1786353166.584392 write 0x02b844 thru 0x02ccbd (0x147a bytes) 000276 1786353166.586270 read 0x03c34c thru 0x03fb2a (0x37df bytes) 000277 1786353166.597497 fallocate 0x00d1ec thru 0x011bf6 (0x4a0b bytes) 000278 1786353166.612938 MIRROR_RESYNC 5 mirrors 000279 1786353167.993331 mapwrite 0x025886 thru 0x02f99f (0xa11a bytes) 000280 1786353168.108650 read 0x02a0ce thru 0x033c58 (0x9b8b bytes) 000281 1786353168.110687 trunc from 0x03fb2b to 0x00f981 (0x301a9 bytes) 000282 1786353168.135322 punch from 0x006b2d to 0x00f981 (0x8e55 bytes) 000284 1786353168.145520 fallocate 0x0293ec thru 0x034c57 (0xb86c bytes) 000285 1786353168.151875 write 0x0112a2 thru 0x0123ec (0x114b bytes) 000286 1786353168.153052 mapread 0x010d43 thru 0x0123ec (0x16aa bytes) 000287 1786353168.169057 fallocate 0x022fa1 thru 0x031f8d (0xefed bytes) 000289 1786353168.174519 mapread 0x02e092 thru 0x031f8d (0x3efc bytes) 000290 1786353168.184053 read 0x003c41 thru 0x004c4f (0x100f bytes) 000291 1786353168.195207 mapwrite 0x03746a thru 0x038632 (0x11c9 bytes) 000292 1786353168.235224 punch from 0x005c54 to 0x015635 (0xf9e2 bytes) 000293 1786353168.242153 trunc from 0x02a1da to 0x034d01 (0xab28 bytes) 000294 1786353168.247522 write 0x01ab46 thru 0x024db0 (0xa26b bytes) 000295 1786353168.250753 write 0x00da02 thru 0x00e50f (0xb0e bytes) 000296 1786353168.263018 read 0x01ea85 thru 0x02bbc9 (0xd145 bytes) 000297 1786353168.282936 trunc from 0x015d81 to 0x0254eb (0xf76b bytes) 000299 1786353168.297137 mapwrite 0x00605d thru 0x006784 (0x728 bytes) 000300 1786353168.309032 fallocate 0x007ce6 thru 0x0148e4 (0xcbff bytes) 000301 1786353168.314932 trunc from 0x0008f2 to 0x00d919 (0xd028 bytes) 000302 1786353168.322203 read 0x01a376 thru 0x0254f8 (0xb183 bytes) 000303 1786353168.332074 mapread 0x0216e3 thru 0x02707b (0x5999 bytes) 000304 1786353168.334200 trunc from 0x038633 to 0x02b7b7 (0xce7b bytes) 000305 1786353168.351660 trunc from 0x015fe6 to 0x019c50 (0x3c6b bytes) 000306 1786353168.357595 trunc from 0x0031fb to 0x01199b (0xe7a1 bytes) 000307 1786353168.362192 mapread 0x000398 thru 0x009b4c (0x97b5 bytes) 000310 1786353168.403195 MIRROR_RESYNC 5 mirrors 000311 1786353169.289112 mapwrite 0x036312 thru 0x03ffff (0x9cee bytes) 000313 1786353169.387878 read 0x014fb9 thru 0x024285 (0xf2cd bytes) 000314 1786353169.401080 fallocate 0x027896 thru 0x03431b (0xca86 bytes) 000315 1786353169.408695 punch from 0x00d97d to 0x0135f9 (0x5c7d bytes) 000316 1786353169.413704 trunc from 0x037d2f to 0x037e3e (0x110 bytes) 000317 1786353169.419026 mapread 0x03fe13 thru 0x03ffff (0x1ed bytes) 000318 1786353169.420321 trunc from 0x0176b8 to 0x025cb8 (0xe601 bytes) 000319 1786353169.428995 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe20eea22 (stale) Mirror 6: 0xe20eea22 (stale) Mirror 7: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe20eea22 (stale) Mirror 6: 0xe20eea22 (stale) Mirror 7: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000320 1786353169.729299 fallocate 0x007423 thru 0x009e38 (0x2a16 bytes) 000322 1786353169.737113 trunc from 0x040000 to 0x01a6b8 (0x25947 bytes) 000323 1786353169.756199 fallocate 0x01a618 thru 0x02676a (0xc153 bytes) 000324 1786353169.763636 fallocate 0x01b6b1 thru 0x029adb (0xe42b bytes) 000325 1786353169.772586 punch from 0x01a348 to 0x025d85 (0xba3e bytes) 000326 1786353169.779361 trunc from 0x00fbfe to 0x010bbf (0xfc2 bytes) 000327 1786353169.791127 MIRROR_RESYNC 4 mirrors 000328 1786353170.348364 read 0x01b5e9 thru 0x0241f4 (0x8c0c bytes) 000329 1786353170.359043 MIRROR_RESYNC 4 mirrors 000330 1786353170.691412 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) 000331 1786353170.973721 fallocate 0x0367a6 thru 0x03ffff (0x985a bytes) 000332 1786353171.000746 punch from 0x00ff1d to 0x016604 (0x66e8 bytes) 000333 1786353171.006166 trunc from 0x016fc1 to 0x01d051 (0x6091 bytes) 000334 1786353171.012600 mapwrite 0x035cb8 thru 0x03de0f (0x8158 bytes) 000335 1786353171.056922 write 0x0190c9 thru 0x023c3c (0xab74 bytes) 000336 1786353171.075383 fallocate 0x02dc7e thru 0x02e8f5 (0xc78 bytes) 000337 1786353171.083801 mapread 0x013799 thru 0x018dae (0x5616 bytes) 000338 1786353171.097097 read 0x0092ac thru 0x00bc07 (0x295c bytes) 000339 1786353171.104201 write 0x01c9b5 thru 0x02142f (0x4a7b bytes) 000341 1786353171.106629 write 0x02cacc thru 0x03c0af (0xf5e4 bytes) 000342 1786353171.113114 mapwrite 0x02798d thru 0x0322e1 (0xa955 bytes) 000343 1786353171.151680 fallocate 0x00723c thru 0x00e29f (0x7064 bytes) 000344 1786353171.157068 trunc from 0x010d79 to 0x012362 (0x15ea bytes) 000345 1786353171.162849 mapread 0x02c7dc thru 0x035eda (0x96ff bytes) 000346 1786353171.164086 mapwrite 0x01c29d thru 0x01f820 (0x3584 bytes) 000347 1786353171.183310 mapwrite 0x0205c0 thru 0x0288c8 (0x8309 bytes) 000348 1786353171.202264 mapread 0x0352cf thru 0x03ffff (0xad31 bytes) 000349 1786353171.205739 fallocate 0x01ee5d thru 0x021cdc (0x2e80 bytes) 000350 1786353171.211265 mapread 0x01d87c thru 0x021b36 (0x42bb bytes) 000352 1786353171.214741 trunc from 0x036ecc to 0x03e5c9 (0x76fe bytes) 000353 1786353171.222750 trunc from 0x040000 to 0x02aa50 (0x155af bytes) 000355 1786353171.243713 write 0x03a9d0 thru 0x03aab7 (0xe8 bytes) 000356 1786353171.245290 fallocate 0x02bcdb thru 0x035124 (0x944a bytes) 000357 1786353171.250142 trunc from 0x010025 to 0x01988b (0x9867 bytes) 000358 1786353171.255134 read 0x0135a2 thru 0x0225ed (0xf04c bytes) 000359 1786353171.266071 punch from 0x01a4bd to 0x024a36 (0xa57a bytes) 000360 1786353171.271889 fallocate 0x004e05 thru 0x01265c (0xd858 bytes) 000361 1786353171.277206 mapread 0x036bb0 thru 0x03aab7 (0x3f08 bytes) 000363 1786353171.279731 mapread 0x035c5f thru 0x03aab7 (0x4e59 bytes) 000364 1786353171.281367 mapread 0x00c168 thru 0x010b4f (0x49e8 bytes) 000365 1786353171.282675 trunc from 0x01ec8a to 0x029c30 (0xafa7 bytes) 000366 1786353171.288062 trunc from 0x028d38 to 0x0310c2 (0x838b bytes) 000367 1786353171.297877 read 0x008775 thru 0x009ba6 (0x1432 bytes) 000368 1786353171.298701 mapread 0x036664 thru 0x03aab7 (0x4454 bytes) 000369 1786353171.301437 read 0x002603 thru 0x009a57 (0x7455 bytes) 000370 1786353171.302273 punch from 0x01950b to 0x027f9e (0xea94 bytes) 000371 1786353171.319588 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3aab8): Mirror 4: 0xb3b18089 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aab8): Mirror 4: 0xb3b18089 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aab8: skipped 000372 1786353171.641029 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3aab8): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aab8): Mirror 4: 0xb3b18089 (stale) CRC-32 checksum value for chunk [0, 0x3aab8): Mirror 1: 0xbfbf09a6 Mirror 5: 0xbfbf09a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aab8: skipped 000373 1786353172.297458 mapread 0x035334 thru 0x03aab7 (0x5784 bytes) 000374 1786353172.334339 punch from 0x00b886 to 0x018b49 (0xd2c4 bytes) 000376 1786353172.374619 mapwrite 0x00abaf thru 0x014512 (0x9964 bytes) 000377 1786353172.409487 read 0x014e94 thru 0x01b674 (0x67e1 bytes) 000378 1786353172.410534 punch from 0x01ae69 to 0x020fe2 (0x617a bytes) 000379 1786353172.416657 mapwrite 0x03cfa8 thru 0x03ffff (0x3058 bytes) 000380 1786353172.487058 trunc from 0x040000 to 0x006142 (0x39ebd bytes) 000381 1786353172.510910 write 0x00574d thru 0x00f36a (0x9c1e bytes) 000382 1786353172.513104 read 0x00f160 thru 0x00f36a (0x20b bytes) 000383 1786353172.514086 mapwrite 0x01f8ac thru 0x0250a1 (0x57f6 bytes) 000384 1786353172.566175 write 0x023995 thru 0x032c92 (0xf2fe bytes) 000385 1786353172.572673 punch from 0x01314b to 0x01ea4a (0xb900 bytes) 000386 1786353172.579310 mapread 0x00e9bb thru 0x01d125 (0xe76b bytes) 000387 1786353172.635738 fallocate 0x006a8a thru 0x00c234 (0x57ab bytes) 000388 1786353172.647999 MIRROR_RESYNC 3 mirrors 000390 1786353173.310479 mapread 0x007430 thru 0x0079c8 (0x599 bytes) 000391 1786353173.318073 write 0x0062ff thru 0x007030 (0xd32 bytes) 000392 1786353173.354704 fallocate 0x005fbe thru 0x0149bb (0xe9fe bytes) 000393 1786353173.360278 trunc from 0x0284e8 to 0x032c92 (0xa7ab bytes) 000394 1786353173.365586 write 0x000f73 thru 0x00842d (0x74bb bytes) 000395 1786353173.376610 fallocate 0x00a5e6 thru 0x017e0e (0xd829 bytes) 000396 1786353173.382617 trunc from 0x02d98b to 0x032c92 (0x5308 bytes) 000397 1786353173.388690 trunc from 0x032c93 to 0x000336 (0x3295c bytes) 000398 1786353173.406951 mapread 0x0002c2 thru 0x000336 (0x75 bytes) 000399 1786353173.408053 trunc from 0x000337 to 0x023837 (0x23501 bytes) 000400 1786353173.423835 write 0x0199ab thru 0x025e1d (0xc473 bytes) 000401 1786353173.434204 read 0x01436e thru 0x01a484 (0x6117 bytes) 000402 1786353173.442623 read 0x01b2dd thru 0x01f874 (0x4598 bytes) 000403 1786353173.443633 trunc from 0x022505 to 0x025e1d (0x3919 bytes) 000404 1786353173.459009 write 0x00250d thru 0x003ddf (0x18d3 bytes) 000405 1786353173.468866 fallocate 0x02d38f thru 0x02d9cd (0x63f bytes) 000406 1786353173.478095 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2d9ce): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d9ce): Mirror 4: 0xb5829d84 (stale) Mirror 5: 0xb5829d84 (stale) CRC-32 checksum value for chunk [0, 0x2d9ce): Mirror 1: 0x3c2e2b1f Mirror 6: 0x3c2e2b1f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d9ce: skipped 000407 1786353174.149214 mapwrite 0x035dda thru 0x03ffff (0xa226 bytes) 000408 1786353174.267967 fallocate 0x02f4fe thru 0x03af8f (0xba92 bytes) 000409 1786353174.276745 punch from 0x0105f6 to 0x016057 (0x5a62 bytes) 000410 1786353174.285551 write 0x01275a thru 0x0214ba (0xed61 bytes) 000412 1786353174.301625 mapread 0x021f83 thru 0x02330a (0x1388 bytes) 000413 1786353174.317703 trunc from 0x040000 to 0x027cfb (0x18304 bytes) 000414 1786353174.340536 fallocate 0x01cef4 thru 0x020785 (0x3892 bytes) 000415 1786353174.347127 fallocate 0x03f452 thru 0x03ffff (0xbae bytes) 000416 1786353174.354157 punch from 0x00f05e to 0x00fa33 (0x9d6 bytes) 000417 1786353174.360370 trunc from 0x027cfc to 0x006d2c (0x20fcf bytes) 000418 1786353174.376310 punch from 0x004700 to 0x006d2c (0x262d bytes) 000419 1786353174.381951 write 0x0338da thru 0x03fb01 (0xc228 bytes) 000421 1786353174.386126 fallocate 0x03cffe thru 0x03ffff (0x3002 bytes) 000422 1786353174.391841 punch from 0x01e680 to 0x01fd7a (0x16fb bytes) 000423 1786353174.403715 MIRROR_RESYNC 4 mirrors 000425 1786353175.149685 mapread 0x00106f thru 0x00a27d (0x920f bytes) 000426 1786353175.166959 write 0x000fde thru 0x00655d (0x5580 bytes) 000427 1786353175.210661 write 0x00a814 thru 0x017704 (0xcef1 bytes) 000428 1786353175.226118 trunc from 0x0252c5 to 0x02d217 (0x7f53 bytes) 000429 1786353175.233100 trunc from 0x03fb02 to 0x02e64d (0x114b4 bytes) 000430 1786353175.254893 mapwrite 0x023eff thru 0x032fcd (0xf0cf bytes) 000431 1786353175.316894 trunc from 0x032fce to 0x00ed4f (0x2427e bytes) 000432 1786353175.335796 read 0x002fbf thru 0x00ea2a (0xba6c bytes) 000433 1786353175.340209 fallocate 0x03a973 thru 0x03ffff (0x568d bytes) 000434 1786353175.344059 mapread 0x0054cd thru 0x00ed4f (0x9883 bytes) 000435 1786353175.345254 read 0x00c5bb thru 0x00ed4f (0x2795 bytes) 000436 1786353175.346081 trunc from 0x00e617 to 0x00ed4f (0x739 bytes) 000437 1786353175.350587 punch from 0x001668 to 0x006740 (0x50d9 bytes) 000438 1786353175.356657 trunc from 0x00ed50 to 0x03f01d (0x302ce bytes) 000439 1786353175.367028 trunc from 0x02bd96 to 0x039e9f (0xe10a bytes) 000440 1786353175.372137 trunc from 0x03f01e to 0x0352a6 (0x9d77 bytes) 000441 1786353175.386169 write 0x017610 thru 0x01a7d7 (0x31c8 bytes) 000442 1786353175.402998 mapread 0x02c7e9 thru 0x0352a6 (0x8abe bytes) 000443 1786353175.404271 write 0x02c127 thru 0x02e2d1 (0x21ab bytes) 000444 1786353175.409661 fallocate 0x01ed28 thru 0x02cd40 (0xe019 bytes) 000445 1786353175.418644 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x352a7): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x352a7): Mirror 4: 0x6c15a086 (stale) Mirror 5: 0x6c15a086 (stale) Mirror 6: 0x6c15a086 (stale) CRC-32 checksum value for chunk [0, 0x352a7): Mirror 1: 0x2c079139 Mirror 7: 0x2c079139 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x352a7: skipped 000446 1786353176.137108 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x352a7): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x352a7): Mirror 4: 0x6c15a086 (stale) Mirror 5: 0x6c15a086 (stale) Mirror 6: 0x6c15a086 (stale) CRC-32 checksum value for chunk [0, 0x352a7): Mirror 1: 0x2c079139 Mirror 7: 0x2c079139 Mirror 8: 0x2c079139 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x352a7: skipped 000447 1786353176.888607 mapread 0x02bcd9 thru 0x02cb90 (0xeb8 bytes) 000448 1786353176.913055 trunc from 0x02f7f5 to 0x0344ad (0x4cb9 bytes) 000449 1786353176.949951 trunc from 0x015cd3 to 0x020eac (0xb1da bytes) 000450 1786353176.955188 write 0x01609d thru 0x01c4ea (0x644e bytes) 000451 1786353176.975921 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x352a7): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x352a7): Mirror 4: 0x6c15a086 (stale) Mirror 5: 0x6c15a086 (stale) Mirror 6: 0x6c15a086 (stale) Mirror 7: 0x2c079139 (stale) Mirror 8: 0x2c079139 (stale) CRC-32 checksum value for chunk [0, 0x352a7): Mirror 1: 0x3dd450eb Mirror 9: 0x3dd450eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x352a7: skipped 000452 1786353177.819096 write 0x005e05 thru 0x0133aa (0xd5a6 bytes) 000453 1786353177.869648 mapwrite 0x026205 thru 0x02e484 (0x8280 bytes) 000454 1786353177.911556 mapwrite 0x015da6 thru 0x019757 (0x39b2 bytes) 000455 1786353177.938677 MIRROR_RESYNC 7 mirrors 000456 1786353179.567370 mapread 0x00ab01 thru 0x019f15 (0xf415 bytes) 000457 1786353179.591700 mapwrite 0x03b707 thru 0x03ffff (0x48f9 bytes) 000459 1786353179.646896 trunc from 0x00c2b4 to 0x01b349 (0xf096 bytes) 000460 1786353179.651219 mapread 0x03d220 thru 0x03ffff (0x2de0 bytes) 000462 1786353179.653646 mapread 0x03b5d9 thru 0x03dca9 (0x26d1 bytes) 000463 1786353179.657113 trunc from 0x040000 to 0x028a27 (0x175d8 bytes) 000464 1786353179.676705 mapwrite 0x00d9ce thru 0x00e324 (0x957 bytes) 000465 1786353179.697398 write 0x008a22 thru 0x013a3c (0xb01b bytes) 000466 1786353179.702085 MIRROR_RESYNC 7 mirrors 000468 1786353180.839177 write 0x01429c thru 0x02294c (0xe6b1 bytes) 000469 1786353180.877570 trunc from 0x009395 to 0x00cb23 (0x378f bytes) 000470 1786353180.882900 write 0x02cd82 thru 0x02d416 (0x695 bytes) 000471 1786353180.884998 write 0x006f64 thru 0x00f350 (0x83ed bytes) 000472 1786353180.900002 read 0x018dc5 thru 0x01d895 (0x4ad1 bytes) 000473 1786353180.900807 mapread 0x0061d2 thru 0x00fd9e (0x9bcd bytes) 000475 1786353180.910438 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d417): Mirror 5: 0xe6f51c5 (stale) Mirror 6: 0xe6f51c5 (stale) Mirror 7: 0xe6f51c5 (stale) Mirror 8: 0xe6f51c5 (stale) Mirror 9: 0xe6f51c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d417): Mirror 5: 0xe6f51c5 (stale) Mirror 6: 0xe6f51c5 (stale) Mirror 7: 0xe6f51c5 (stale) Mirror 8: 0xe6f51c5 (stale) Mirror 9: 0xe6f51c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d417: skipped 000478 1786353181.210738 punch from 0x02ac50 to 0x02d416 (0x27c7 bytes) 000479 1786353181.214411 trunc from 0x011083 to 0x012ff0 (0x1f6e bytes) 000480 1786353181.218868 mapwrite 0x028e0d thru 0x038df6 (0xffea bytes) 000482 1786353181.282971 trunc from 0x038df7 to 0x00a352 (0x2eaa4 bytes) 000484 1786353181.301519 mapread 0x002b3a thru 0x007db1 (0x5278 bytes) 000485 1786353181.309238 read 0x00a323 thru 0x00a352 (0x30 bytes) 000486 1786353181.309894 fallocate 0x0010db thru 0x00175b (0x681 bytes) 000487 1786353181.314065 punch from 0x002828 to 0x009469 (0x6c42 bytes) 000488 1786353181.318287 write 0x01511c thru 0x01ca85 (0x796a bytes) 000489 1786353181.319668 read 0x00106e thru 0x00531f (0x42b2 bytes) 000490 1786353181.331302 fallocate 0x02a974 thru 0x037cd9 (0xd366 bytes) 000491 1786353181.336836 trunc from 0x01ca86 to 0x0235bf (0x6b3a bytes) 000493 1786353181.353072 punch from 0x0004a4 to 0x00c682 (0xc1df bytes) 000494 1786353181.359801 mapwrite 0x03386e thru 0x035924 (0x20b7 bytes) 000495 1786353181.400410 write 0x008056 thru 0x010f2e (0x8ed9 bytes) 000497 1786353181.408661 read 0x009ed6 thru 0x00dcce (0x3df9 bytes) 000498 1786353181.409691 read 0x019541 thru 0x01aa4c (0x150c bytes) 000499 1786353181.410899 fallocate 0x0099c0 thru 0x00ca00 (0x3041 bytes) 000500 1786353181.422303 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35925): Mirror 6: 0xdc9c03de (stale) Mirror 7: 0xdc9c03de (stale) Mirror 8: 0xdc9c03de (stale) Mirror 9: 0xdc9c03de (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35925): Mirror 6: 0xdc9c03de (stale) Mirror 7: 0xdc9c03de (stale) Mirror 8: 0xdc9c03de (stale) Mirror 9: 0xdc9c03de (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35925: skipped 000501 1786353181.741119 trunc from 0x035925 to 0x009996 (0x2bf8e bytes) 000503 1786353181.763413 punch from 0x0045c0 to 0x009996 (0x53d7 bytes) 000504 1786353181.771030 read 0x0012a7 thru 0x009996 (0x86f0 bytes) 000505 1786353181.786534 trunc from 0x003d9c to 0x006a52 (0x2cb7 bytes) 000506 1786353181.793650 trunc from 0x004a86 to 0x009996 (0x4f11 bytes) 000508 1786353181.800289 punch from 0x0039c0 to 0x009996 (0x5fd7 bytes) 000509 1786353181.808633 MIRROR_RESYNC 5 mirrors 000510 1786353182.420334 read 0x0008b7 thru 0x009996 (0x90e0 bytes) 000512 1786353182.429430 trunc from 0x006640 to 0x006e4d (0x80e bytes) 000513 1786353182.457275 read 0x001cb5 thru 0x00634b (0x4697 bytes) 000514 1786353182.466575 mapwrite 0x006cb7 thru 0x009471 (0x27bb bytes) 000515 1786353182.482547 mapwrite 0x005f5f thru 0x00d86b (0x790d bytes) 000516 1786353182.534989 write 0x029336 thru 0x0296b8 (0x383 bytes) 000517 1786353182.536212 mapwrite 0x0235f3 thru 0x02dbf7 (0xa605 bytes) 000518 1786353182.585566 trunc from 0x0122d4 to 0x021648 (0xf375 bytes) 000519 1786353182.591941 fallocate 0x026c6f thru 0x027de9 (0x117b bytes) 000520 1786353182.598167 mapread 0x005e86 thru 0x00f149 (0x92c4 bytes) 000521 1786353182.600452 trunc from 0x0127f4 to 0x01a62d (0x7e3a bytes) 000522 1786353182.605386 trunc from 0x02dbf8 to 0x00eaf5 (0x1f102 bytes) 000523 1786353182.622970 trunc from 0x00eaf6 to 0x0174cd (0x89d8 bytes) 000524 1786353182.640954 fallocate 0x024f67 thru 0x025372 (0x40c bytes) 000525 1786353182.650761 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x174ce): Mirror 7: 0x558f9c79 (stale) Mirror 8: 0x558f9c79 (stale) Mirror 9: 0x558f9c79 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x174ce): Mirror 7: 0x558f9c79 (stale) Mirror 8: 0x558f9c79 (stale) Mirror 9: 0x558f9c79 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x174ce: skipped 000526 1786353182.874899 punch from 0x0125e3 to 0x0172ae (0x4ccc bytes) 000527 1786353182.879326 punch from 0x0131ed to 0x0147e1 (0x15f5 bytes) 000528 1786353182.888611 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x174ce): Mirror 8: 0x558f9c79 (stale) Mirror 9: 0x558f9c79 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x174ce): Mirror 8: 0x558f9c79 (stale) Mirror 9: 0x558f9c79 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x174ce: skipped 000529 1786353183.118917 trunc from 0x0099dc to 0x00d250 (0x3875 bytes) 000531 1786353183.126199 read 0x00cb5c thru 0x0174cd (0xa972 bytes) 000532 1786353183.136615 write 0x01d56a thru 0x028bf9 (0xb690 bytes) 000534 1786353183.144007 read 0x00a397 thru 0x017509 (0xd173 bytes) 000535 1786353183.157150 punch from 0x013b59 to 0x01edfe (0xb2a6 bytes) 000536 1786353183.172428 write 0x0282f6 thru 0x033eed (0xbbf8 bytes) 000537 1786353183.174563 mapread 0x005e15 thru 0x00f2b9 (0x94a5 bytes) 000539 1786353183.176966 fallocate 0x021627 thru 0x02dcf2 (0xc6cc bytes) 000540 1786353183.181403 fallocate 0x009412 thru 0x015c16 (0xc805 bytes) 000541 1786353183.190144 MIRROR_RESYNC 3 mirrors 000543 1786353183.766195 MIRROR_EXTEND to 4 mirrors 000544 1786353184.288717 mapread 0x02ed91 thru 0x033eed (0x515d bytes) 000545 1786353184.307340 mapread 0x015c3c thru 0x020b15 (0xaeda bytes) 000546 1786353184.328492 read 0x0124f3 thru 0x01be64 (0x9972 bytes) 000547 1786353184.329230 mapwrite 0x006a6c thru 0x00f2f8 (0x888d bytes) 000548 1786353184.409709 punch from 0x022b25 to 0x02e8d9 (0xbdb5 bytes) 000549 1786353184.414609 write 0x01f1f6 thru 0x020c51 (0x1a5c bytes) 000550 1786353184.428862 fallocate 0x038e2b thru 0x03a261 (0x1437 bytes) 000551 1786353184.437528 MIRROR_RESYNC 4 mirrors 000552 1786353185.265555 trunc from 0x010c2f to 0x014b15 (0x3ee7 bytes) 000553 1786353185.298407 mapwrite 0x0358ed thru 0x03ffff (0xa713 bytes) 000554 1786353185.355527 write 0x0033ff thru 0x00528e (0x1e90 bytes) 000555 1786353185.362851 mapread 0x02f819 thru 0x03370a (0x3ef2 bytes) 000556 1786353185.375350 punch from 0x008c68 to 0x00a289 (0x1622 bytes) 000557 1786353185.386052 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x233ac3ad (stale) Mirror 9: 0x233ac3ad (stale) Mirror 10: 0x233ac3ad (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x81e6702d Mirror 11: 0x81e6702d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000558 1786353186.105765 trunc from 0x040000 to 0x0211a7 (0x1ee58 bytes) 000559 1786353186.167275 trunc from 0x013e88 to 0x01ed86 (0xaeff bytes) 000560 1786353186.172880 write 0x033ca5 thru 0x03ad41 (0x709d bytes) 000561 1786353186.175192 punch from 0x0204a8 to 0x02d00e (0xcb67 bytes) 000562 1786353186.181418 fallocate 0x037f7c thru 0x03db4e (0x5bd3 bytes) 000565 1786353186.189405 punch from 0x033128 to 0x03a894 (0x776d bytes) 000566 1786353186.203558 mapread 0x034f50 thru 0x03814e (0x31ff bytes) 000567 1786353186.223232 trunc from 0x030f77 to 0x037aab (0x6b35 bytes) 000568 1786353186.232719 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ad42): Mirror 8: 0x9e0b6809 (stale) Mirror 10: 0x9e0b6809 (stale) Mirror 11: 0x935ee872 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad42): Mirror 8: 0x9e0b6809 (stale) Mirror 10: 0x9e0b6809 (stale) Mirror 11: 0x935ee872 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad42: skipped 000569 1786353186.508262 trunc from 0x000714 to 0x0067e3 (0x60d0 bytes) 000572 1786353186.515668 punch from 0x009ed7 to 0x015646 (0xb770 bytes) 000573 1786353186.525319 trunc from 0x00222f to 0x0047ac (0x257e bytes) 000574 1786353186.530993 trunc from 0x011591 to 0x01b80f (0xa27f bytes) 000575 1786353186.535372 read 0x02ffd0 thru 0x03a5c7 (0xa5f8 bytes) 000576 1786353186.542153 trunc from 0x03ad42 to 0x024217 (0x16b2a bytes) 000577 1786353186.564989 fallocate 0x034221 thru 0x03ffff (0xbddf bytes) 000578 1786353186.571637 punch from 0x002efa to 0x004c7e (0x1d85 bytes) 000579 1786353186.580431 punch from 0x0227fc to 0x024217 (0x1a1c bytes) 000580 1786353186.586089 mapread 0x011f1c thru 0x01951c (0x7601 bytes) 000581 1786353186.608380 mapwrite 0x0047cf thru 0x007f42 (0x3774 bytes) 000582 1786353186.624408 fallocate 0x018e3b thru 0x0234ff (0xa6c5 bytes) 000583 1786353186.627759 write 0x0219db thru 0x02a788 (0x8dae bytes) 000584 1786353186.632543 trunc from 0x029317 to 0x02a788 (0x1472 bytes) 000585 1786353186.645869 write 0x017465 thru 0x023295 (0xbe31 bytes) 000586 1786353186.650062 punch from 0x00c59e to 0x01842e (0xbe91 bytes) 000587 1786353186.667712 trunc from 0x0054b3 to 0x012a53 (0xd5a1 bytes) 000588 1786353186.672927 trunc from 0x02a42b to 0x02a788 (0x35e bytes) 000590 1786353186.677456 write 0x013bf8 thru 0x0214b7 (0xd8c0 bytes) 000591 1786353186.682949 mapread 0x003fc1 thru 0x0105b2 (0xc5f2 bytes) 000592 1786353186.696085 MIRROR_RESYNC 4 mirrors 000593 1786353187.378540 read 0x008480 thru 0x012691 (0xa212 bytes) 000594 1786353187.386762 mapread 0x01c43e thru 0x021f01 (0x5ac4 bytes) 000595 1786353187.404165 punch from 0x024645 to 0x026f8d (0x2949 bytes) 000596 1786353187.434508 punch from 0x0099e2 to 0x016756 (0xcd75 bytes) 000599 1786353187.442667 trunc from 0x01a545 to 0x01f492 (0x4f4e bytes) 000600 1786353187.447684 mapwrite 0x0140be thru 0x01a682 (0x65c5 bytes) 000601 1786353187.482629 punch from 0x006271 to 0x0114c9 (0xb259 bytes) 000602 1786353187.489067 fallocate 0x02089a thru 0x030150 (0xf8b7 bytes) 000603 1786353187.494013 fallocate 0x00ca99 thru 0x00d45e (0x9c6 bytes) 000604 1786353187.498852 mapread 0x0063e2 thru 0x00b553 (0x5172 bytes) 000605 1786353187.508480 write 0x013eb8 thru 0x0141c2 (0x30b bytes) 000606 1786353187.509579 mapwrite 0x027c62 thru 0x0296c5 (0x1a64 bytes) 000607 1786353187.528446 read 0x0113fa thru 0x019728 (0x832f bytes) 000609 1786353187.537900 trunc from 0x01d1bd to 0x026906 (0x974a bytes) 000610 1786353187.544435 mapread 0x02200c thru 0x02a038 (0x802d bytes) 000613 1786353187.569486 mapwrite 0x03cd12 thru 0x03ffff (0x32ee bytes) 000614 1786353187.606434 mapwrite 0x0395dc thru 0x03ec12 (0x5637 bytes) 000615 1786353187.625169 write 0x02adc4 thru 0x03044a (0x5687 bytes) 000616 1786353187.626443 mapread 0x01f7b9 thru 0x02b9b0 (0xc1f8 bytes) 000617 1786353187.640346 mapwrite 0x023a62 thru 0x02d455 (0x99f4 bytes) 000618 1786353187.658277 read 0x005ac8 thru 0x00c1e9 (0x6722 bytes) 000619 1786353187.658865 read 0x00a427 thru 0x015503 (0xb0dd bytes) 000620 1786353187.659673 mapwrite 0x002f18 thru 0x00bd40 (0x8e29 bytes) 000622 1786353187.682272 read 0x00b111 thru 0x0182cb (0xd1bb bytes) 000623 1786353187.683087 punch from 0x020831 to 0x0297ac (0x8f7c bytes) 000624 1786353187.686975 read 0x037233 thru 0x03c83c (0x560a bytes) 000625 1786353187.691134 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x7396466e (stale) Mirror 10: 0x7396466e (stale) Mirror 11: 0x7396466e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe3964f34 Mirror 12: 0xe3964f34 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000627 1786353188.359528 read 0x01c15f thru 0x02a60f (0xe4b1 bytes) 000628 1786353188.373502 mapwrite 0x019649 thru 0x01ab2f (0x14e7 bytes) 000629 1786353188.451498 read 0x0053a5 thru 0x006e4f (0x1aab bytes) 000630 1786353188.463462 mapread 0x010795 thru 0x01f468 (0xecd4 bytes) 000632 1786353188.466009 mapwrite 0x00bf6a thru 0x01bedf (0xff76 bytes) 000633 1786353188.487234 mapread 0x0286d5 thru 0x03791d (0xf249 bytes) 000634 1786353188.488640 mapwrite 0x009839 thru 0x00d9ce (0x4196 bytes) 000635 1786353188.501854 read 0x020ca7 thru 0x022aa0 (0x1dfa bytes) 000636 1786353188.503352 punch from 0x0264f4 to 0x0333c5 (0xced2 bytes) 000638 1786353188.512215 trunc from 0x040000 to 0x03f66d (0x992 bytes) 000639 1786353188.543294 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3f66e): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f66e): Mirror 8: 0x1883cb7c (stale) Mirror 10: 0x1883cb7c (stale) Mirror 11: 0x1883cb7c (stale) Mirror 12: 0x6a7a9a87 (stale) CRC-32 checksum value for chunk [0, 0x3f66e): Mirror 1: 0xfa0046d2 Mirror 13: 0xfa0046d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f66e: skipped 000640 1786353189.119110 read 0x02c2f6 thru 0x034d59 (0x8a64 bytes) 000641 1786353189.135659 trunc from 0x03f66e to 0x015ad6 (0x29b97 bytes) 000642 1786353189.191582 read 0x000ca6 thru 0x008970 (0x7ccb bytes) 000643 1786353189.202036 write 0x025834 thru 0x02882b (0x2ff8 bytes) 000644 1786353189.204685 trunc from 0x0202fd to 0x02882b (0x852f bytes) 000645 1786353189.215376 trunc from 0x016617 to 0x020f07 (0xa8f1 bytes) 000646 1786353189.225559 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2882c): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2882c): Mirror 8: 0xaa39232e (stale) Mirror 10: 0xaa39232e (stale) Mirror 11: 0xaa39232e (stale) Mirror 12: 0x8e94d97b (stale) Mirror 13: 0xa8e3cc51 (stale) CRC-32 checksum value for chunk [0, 0x2882c): Mirror 1: 0xad977f4d Mirror 14: 0xad977f4d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2882c: skipped 000647 1786353189.832898 mapread 0x01fc29 thru 0x02882b (0x8c03 bytes) 000649 1786353189.873501 mapwrite 0x03ff60 thru 0x03ffff (0xa0 bytes) 000650 1786353189.962097 write 0x039703 thru 0x03ffff (0x68fd bytes) 000651 1786353189.963499 trunc from 0x02f612 to 0x030375 (0xd64 bytes) 000652 1786353189.967907 mapread 0x007a65 thru 0x0089d4 (0xf70 bytes) 000653 1786353189.984544 MIRROR_RESYNC 7 mirrors 000654 1786353191.356163 trunc from 0x0125ef to 0x015f2f (0x3941 bytes) 000655 1786353191.394736 MIRROR_RESYNC 7 mirrors 000656 1786353192.929090 write 0x0346d2 thru 0x0353de (0xd0d bytes) 000657 1786353192.969614 trunc from 0x040000 to 0x03398c (0xc673 bytes) 000658 1786353192.991142 trunc from 0x00a15e to 0x0169fc (0xc89f bytes) 000659 1786353192.995815 punch from 0x031e50 to 0x03340f (0x15c0 bytes) 000660 1786353193.004755 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3398d): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3398d): Mirror 8: 0x6299b21c (stale) Mirror 10: 0x6299b21c (stale) Mirror 11: 0x6299b21c (stale) Mirror 12: 0x6299b21c (stale) Mirror 13: 0x6299b21c (stale) Mirror 14: 0x6299b21c (stale) CRC-32 checksum value for chunk [0, 0x3398d): Mirror 1: 0x8a191e43 Mirror 15: 0x8a191e43 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3398d: skipped 000661 1786353193.791517 mapread 0x03291b thru 0x03398c (0x1072 bytes) 000662 1786353193.827227 mapwrite 0x000fd8 thru 0x00b392 (0xa3bb bytes) 000663 1786353193.922606 trunc from 0x0049a4 to 0x0100d9 (0xb736 bytes) 000664 1786353193.928333 mapread 0x016d6e thru 0x021e4b (0xb0de bytes) 000665 1786353193.947013 fallocate 0x03d22a thru 0x03fbae (0x2985 bytes) 000666 1786353193.951323 read 0x0060c7 thru 0x006f44 (0xe7e bytes) 000667 1786353193.956858 read 0x027aaa thru 0x02e946 (0x6e9d bytes) 000668 1786353193.966012 trunc from 0x024fdd to 0x03398c (0xe9b0 bytes) 000669 1786353193.970586 read 0x016bf5 thru 0x01a69b (0x3aa7 bytes) 000670 1786353193.971612 trunc from 0x03398d to 0x03c77e (0x8df2 bytes) 000671 1786353193.998145 trunc from 0x0339d8 to 0x03c77e (0x8da7 bytes) 000673 1786353194.006048 mapread 0x03220e thru 0x0334b1 (0x12a4 bytes) 000674 1786353194.021007 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c77f): Mirror 8: 0xd3211682 (stale) Mirror 10: 0xd3211682 (stale) Mirror 12: 0xd3211682 (stale) Mirror 13: 0xd3211682 (stale) Mirror 14: 0xd3211682 (stale) Mirror 15: 0x7ed71f12 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c77f): Mirror 8: 0xd3211682 (stale) Mirror 10: 0xd3211682 (stale) Mirror 12: 0xd3211682 (stale) Mirror 13: 0xd3211682 (stale) Mirror 14: 0xd3211682 (stale) Mirror 15: 0x7ed71f12 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c77f: skipped 000675 1786353194.410172 fallocate 0x00f8c7 thru 0x01d1c3 (0xd8fd bytes) 000676 1786353194.415233 trunc from 0x027eda to 0x02ae2d (0x2f54 bytes) 000677 1786353194.423192 mapread 0x00f508 thru 0x01d714 (0xe20d bytes) 000678 1786353194.453650 mapread 0x0110bb thru 0x011bb2 (0xaf8 bytes) 000679 1786353194.455054 mapwrite 0x03362d thru 0x03a86e (0x7242 bytes) 000680 1786353194.479446 fallocate 0x02b375 thru 0x033046 (0x7cd2 bytes) 000681 1786353194.483766 trunc from 0x03c77f to 0x02e070 (0xe70e bytes) 000682 1786353194.501617 fallocate 0x028f51 thru 0x02d1f5 (0x42a5 bytes) 000683 1786353194.508088 mapread 0x01c907 thru 0x01e159 (0x1853 bytes) 000684 1786353194.510315 write 0x022f38 thru 0x02a4f7 (0x75c0 bytes) 000685 1786353194.517262 trunc from 0x02e071 to 0x008fa2 (0x250ce bytes) 000686 1786353194.533991 mapwrite 0x011553 thru 0x016402 (0x4eb0 bytes) 000687 1786353194.578476 read 0x005f14 thru 0x011d53 (0xbe40 bytes) 000688 1786353194.588977 read 0x00bb40 thru 0x0132d4 (0x7795 bytes) 000689 1786353194.591429 punch from 0x0028b8 to 0x0039e5 (0x112e bytes) 000690 1786353194.597527 trunc from 0x00ab58 to 0x016402 (0xb8ab bytes) 000691 1786353194.604925 trunc from 0x016403 to 0x01ea6d (0x866b bytes) 000692 1786353194.625050 fallocate 0x0245b2 thru 0x024d15 (0x764 bytes) 000693 1786353194.630554 mapread 0x001055 thru 0x009ce1 (0x8c8d bytes) 000694 1786353194.639425 trunc from 0x01ea6e to 0x03a5aa (0x1bb3d bytes) 000695 1786353194.656933 punch from 0x012f52 to 0x0225f4 (0xf6a3 bytes) 000696 1786353194.662333 mapread 0x011534 thru 0x01d6e0 (0xc1ad bytes) 000697 1786353194.730501 mapread 0x0393e4 thru 0x039eba (0xad7 bytes) 000698 1786353194.732437 mapwrite 0x02458e thru 0x02da39 (0x94ac bytes) 000699 1786353194.753988 fallocate 0x00dd97 thru 0x00dde2 (0x4c bytes) 000700 1786353194.758578 write 0x01265b thru 0x018916 (0x62bc bytes) 000701 1786353194.760216 write 0x029b9d thru 0x032d8b (0x91ef bytes) 000702 1786353194.761684 read 0x02752b thru 0x02f738 (0x820e bytes) 000703 1786353194.762607 read 0x005a07 thru 0x014903 (0xeefd bytes) 000704 1786353194.763397 read 0x030866 thru 0x038e9b (0x8636 bytes) 000705 1786353194.764538 trunc from 0x03a5ab to 0x00658d (0x3401d bytes) 000706 1786353194.782102 mapwrite 0x0213f9 thru 0x02e2ab (0xceb3 bytes) 000707 1786353194.835740 mapwrite 0x01922f thru 0x026ff1 (0xddc3 bytes) 000709 1786353194.854441 fallocate 0x03a13e thru 0x03ffff (0x5ec2 bytes) 000710 1786353194.860738 fallocate 0x03794b thru 0x03b8dd (0x3f93 bytes) 000711 1786353194.866573 read 0x0033b2 thru 0x009e61 (0x6ab0 bytes) 000712 1786353194.867664 trunc from 0x01e883 to 0x02c1d3 (0xd951 bytes) 000713 1786353194.874178 mapwrite 0x02aa85 thru 0x035b3b (0xb0b7 bytes) 000714 1786353194.918844 read 0x034744 thru 0x035b3b (0x13f8 bytes) 000715 1786353194.923512 MIRROR_RESYNC 7 mirrors 000716 1786353196.139626 trunc from 0x035b3c to 0x01ae5c (0x1acdf bytes) 000717 1786353196.178462 fallocate 0x00ecef thru 0x01159d (0x28af bytes) 000718 1786353196.184948 trunc from 0x00a6db to 0x00bd79 (0x169f bytes) 000719 1786353196.190461 fallocate 0x00257a thru 0x00cceb (0xa772 bytes) 000721 1786353196.196814 fallocate 0x01da06 thru 0x02736a (0x9965 bytes) 000722 1786353196.202745 trunc from 0x00790e to 0x012fee (0xb6e1 bytes) 000723 1786353196.208479 fallocate 0x017889 thru 0x020d90 (0x9508 bytes) 000726 1786353196.217060 mapread 0x01aaec thru 0x020d90 (0x62a5 bytes) 000727 1786353196.236177 mapread 0x00b98c thru 0x00f908 (0x3f7d bytes) 000728 1786353196.245598 write 0x03ba2e thru 0x03c753 (0xd26 bytes) 000729 1786353196.247312 read 0x02467b thru 0x02ba4b (0x73d1 bytes) 000730 1786353196.260225 punch from 0x00bf7f to 0x010f60 (0x4fe2 bytes) 000732 1786353196.266907 trunc from 0x03c754 to 0x0330d7 (0x967c bytes) 000733 1786353196.287601 mapwrite 0x0261d5 thru 0x02c663 (0x648f bytes) 000735 1786353196.319168 read 0x029877 thru 0x030151 (0x68db bytes) 000736 1786353196.320200 read 0x005c26 thru 0x006f53 (0x132e bytes) 000737 1786353196.326726 MIRROR_RESYNC 7 mirrors 000738 1786353197.695493 trunc from 0x03162e to 0x0330d7 (0x1aaa bytes) 000739 1786353197.727114 read 0x0078e1 thru 0x009392 (0x1ab2 bytes) 000740 1786353197.733475 mapwrite 0x0196cb thru 0x01a674 (0xfaa bytes) 000741 1786353197.754807 trunc from 0x0330d8 to 0x0003d3 (0x32d04 bytes) 000742 1786353197.770459 punch from 0x0001a5 to 0x0003d3 (0x22f bytes) 000743 1786353197.775033 mapwrite 0x00b99d thru 0x016e6b (0xb4cf bytes) 000744 1786353197.827707 mapwrite 0x038a76 thru 0x03ffff (0x758a bytes) 000745 1786353197.865357 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xc735dcfd (stale) Mirror 10: 0xc735dcfd (stale) Mirror 12: 0xc735dcfd (stale) Mirror 13: 0xc735dcfd (stale) Mirror 14: 0xc735dcfd (stale) Mirror 15: 0xc735dcfd (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdf0111c6 Mirror 16: 0xdf0111c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000746 1786353198.592343 fallocate 0x003851 thru 0x01356a (0xfd1a bytes) 000747 1786353198.633958 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xc735dcfd (stale) Mirror 10: 0xc735dcfd (stale) Mirror 13: 0xc735dcfd (stale) Mirror 14: 0xc735dcfd (stale) Mirror 15: 0xc735dcfd (stale) Mirror 16: 0xdf0111c6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xc735dcfd (stale) Mirror 10: 0xc735dcfd (stale) Mirror 13: 0xc735dcfd (stale) Mirror 14: 0xc735dcfd (stale) Mirror 15: 0xc735dcfd (stale) Mirror 16: 0xdf0111c6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000748 1786353198.971882 trunc from 0x040000 to 0x036ee3 (0x911c bytes) 000749 1786353198.989048 punch from 0x021413 to 0x024115 (0x2d03 bytes) 000751 1786353198.995519 fallocate 0x03b2ec thru 0x03c01e (0xd33 bytes) 000752 1786353199.000866 fallocate 0x018769 thru 0x01bc6a (0x3502 bytes) 000753 1786353199.009075 read 0x030266 thru 0x032603 (0x239e bytes) 000754 1786353199.020168 fallocate 0x0240fd thru 0x029e6e (0x5d72 bytes) 000755 1786353199.027445 fallocate 0x01c2a7 thru 0x0288fb (0xc655 bytes) 000756 1786353199.032504 trunc from 0x03c01f to 0x03b513 (0xb0b bytes) 000757 1786353199.043969 read 0x032aaf thru 0x03436b (0x18bd bytes) 000758 1786353199.053507 punch from 0x01cb2c to 0x027a23 (0xaef8 bytes) 000759 1786353199.059530 read 0x03a46e thru 0x03b513 (0x10a6 bytes) 000760 1786353199.060687 read 0x01f669 thru 0x025997 (0x632f bytes) 000761 1786353199.069259 punch from 0x016d60 to 0x01d518 (0x67b9 bytes) 000762 1786353199.075184 punch from 0x0397c2 to 0x03b513 (0x1d52 bytes) 000763 1786353199.079817 mapread 0x00077f thru 0x00314c (0x29ce bytes) 000765 1786353199.082024 trunc from 0x02861e to 0x02cd04 (0x46e7 bytes) 000766 1786353199.087239 mapwrite 0x01c884 thru 0x022a52 (0x61cf bytes) 000767 1786353199.114070 trunc from 0x03b514 to 0x03535c (0x61b7 bytes) 000768 1786353199.129929 write 0x0189d9 thru 0x024e52 (0xc47a bytes) 000769 1786353199.136878 read 0x00bd96 thru 0x01990e (0xdb79 bytes) 000770 1786353199.151261 trunc from 0x0304f8 to 0x033906 (0x340f bytes) 000771 1786353199.159244 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3535d): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3535d): Mirror 8: 0x35d222f5 (stale) Mirror 10: 0x35d222f5 (stale) Mirror 13: 0x35d222f5 (stale) Mirror 14: 0x35d222f5 (stale) Mirror 15: 0x35d222f5 (stale) Mirror 16: 0x1129fe27 (stale) CRC-32 checksum value for chunk [0, 0x3535d): Mirror 1: 0x65964a78 Mirror 17: 0x65964a78 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3535d: skipped 000772 1786353199.878161 read 0x02ba46 thru 0x03535c (0x9917 bytes) 000773 1786353199.901912 mapread 0x015350 thru 0x020091 (0xad42 bytes) 000774 1786353199.949266 read 0x009457 thru 0x017800 (0xe3aa bytes) 000776 1786353199.968928 fallocate 0x00333d thru 0x005477 (0x213b bytes) 000777 1786353200.002611 trunc from 0x03535d to 0x01e9f4 (0x16968 bytes) 000778 1786353200.054983 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1e9f5): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e9f5): Mirror 8: 0xf4fc894a (stale) Mirror 10: 0xf4fc894a (stale) Mirror 13: 0xf4fc894a (stale) Mirror 14: 0xf4fc894a (stale) Mirror 15: 0xf4fc894a (stale) Mirror 16: 0x4a5f1b80 (stale) Mirror 17: 0x2d673813 (stale) CRC-32 checksum value for chunk [0, 0x1e9f5): Mirror 1: 0x2d673813 Mirror 18: 0x2d673813 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e9f5: skipped 000779 1786353200.777361 write 0x02e006 thru 0x03c8ac (0xe8a7 bytes) 000780 1786353200.822748 mapwrite 0x0301f7 thru 0x03e242 (0xe04c bytes) 000781 1786353200.876376 mapwrite 0x0297e1 thru 0x03735a (0xdb7a bytes) 000782 1786353200.897741 fallocate 0x036a96 thru 0x03d8e4 (0x6e4f bytes) 000784 1786353200.902768 read 0x016761 thru 0x025c46 (0xf4e6 bytes) 000785 1786353200.911986 write 0x01832c thru 0x026e4f (0xeb24 bytes) 000787 1786353200.914749 mapread 0x029ab7 thru 0x035a5a (0xbfa4 bytes) 000788 1786353200.916550 trunc from 0x03e243 to 0x02ddc4 (0x1047e bytes) 000789 1786353200.932543 write 0x010f1a thru 0x011745 (0x82c bytes) 000790 1786353200.945008 mapread 0x00ea45 thru 0x01c660 (0xdc1c bytes) 000791 1786353200.958354 read 0x01518f thru 0x017a3b (0x28ad bytes) 000792 1786353200.959137 mapread 0x01b716 thru 0x0298ad (0xe198 bytes) 000793 1786353200.961275 mapwrite 0x03e13f thru 0x03ec22 (0xae4 bytes) 000794 1786353201.023605 mapread 0x03817d thru 0x03ec22 (0x6aa6 bytes) 000795 1786353201.028286 fallocate 0x0335c3 thru 0x034fbf (0x19fd bytes) 000797 1786353201.036749 write 0x03517f thru 0x03599c (0x81e bytes) 000798 1786353201.039593 trunc from 0x03ec23 to 0x00cf23 (0x31cff bytes) 000799 1786353201.059031 punch from 0x009a38 to 0x00cdf3 (0x33bc bytes) 000800 1786353201.064977 trunc from 0x00cf24 to 0x015893 (0x8970 bytes) 000801 1786353201.086015 fallocate 0x016e6e thru 0x022b3a (0xbccd bytes) 000802 1786353201.097002 punch from 0x011a47 to 0x01a34b (0x8905 bytes) 000803 1786353201.109457 mapread 0x01e2e6 thru 0x022b3a (0x4855 bytes) 000804 1786353201.150939 trunc from 0x022b3b to 0x005b39 (0x1d001 bytes) 000805 1786353201.167409 trunc from 0x005b3a to 0x024fba (0x1f481 bytes) 000806 1786353201.183442 mapread 0x00021a thru 0x00227e (0x2065 bytes) 000807 1786353201.188816 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x24fbb): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24fbb): Mirror 8: 0x7f384e37 (stale) Mirror 10: 0x7f384e37 (stale) Mirror 13: 0x7f384e37 (stale) Mirror 14: 0x7f384e37 (stale) Mirror 15: 0x7f384e37 (stale) Mirror 16: 0x83a1bd05 (stale) Mirror 17: 0xf01978ff (stale) Mirror 18: 0x91f9ec03 (stale) CRC-32 checksum value for chunk [0, 0x24fbb): Mirror 1: 0x8c733748 Mirror 19: 0x8c733748 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24fbb: skipped 000808 1786353201.876363 read 0x00a54d thru 0x018d7d (0xe831 bytes) 000811 1786353201.911362 punch from 0x017667 to 0x024fba (0xd954 bytes) 000812 1786353201.951711 mapwrite 0x03a09a thru 0x03e61d (0x4584 bytes) 000813 1786353202.036162 punch from 0x016d3a to 0x021137 (0xa3fe bytes) 000814 1786353202.041465 fallocate 0x0191df thru 0x025a6d (0xc88f bytes) 000815 1786353202.046759 trunc from 0x01107f to 0x016910 (0x5892 bytes) 000816 1786353202.054719 mapread 0x035f7e thru 0x0375c4 (0x1647 bytes) 000817 1786353202.058355 trunc from 0x02dd53 to 0x03a5ba (0xc868 bytes) 000818 1786353202.065891 write 0x001937 thru 0x00a18d (0x8857 bytes) 000819 1786353202.076639 mapread 0x02100e thru 0x02e323 (0xd316 bytes) 000821 1786353202.102105 fallocate 0x013f8a thru 0x0238f3 (0xf96a bytes) 000822 1786353202.110273 trunc from 0x03e61e to 0x0039fb (0x3ac22 bytes) 000823 1786353202.126994 mapread 0x003788 thru 0x0039fb (0x274 bytes) 000824 1786353202.128472 write 0x016322 thru 0x01a917 (0x45f6 bytes) 000825 1786353202.130006 fallocate 0x01feb1 thru 0x0276cc (0x781c bytes) 000826 1786353202.136372 mapread 0x016375 thru 0x01a917 (0x45a3 bytes) 000827 1786353202.137804 fallocate 0x02521a thru 0x026369 (0x1150 bytes) 000828 1786353202.143902 write 0x00b3af thru 0x018d33 (0xd985 bytes) 000829 1786353202.150003 trunc from 0x0006bf to 0x00ecb5 (0xe5f7 bytes) 000830 1786353202.162614 read 0x00cd11 thru 0x01043c (0x372c bytes) 000831 1786353202.172150 write 0x01643d thru 0x0199bb (0x357f bytes) 000832 1786353202.174219 trunc from 0x01a918 to 0x018f1d (0x19fa bytes) 000833 1786353202.194263 punch from 0x00b7e1 to 0x0147e7 (0x9007 bytes) 000834 1786353202.200040 trunc from 0x018f1e to 0x01dde3 (0x4ec6 bytes) 000835 1786353202.216474 punch from 0x000f35 to 0x003fe7 (0x30b3 bytes) 000836 1786353202.222870 mapwrite 0x01eeab thru 0x02113f (0x2295 bytes) 000837 1786353202.274405 trunc from 0x00fa16 to 0x013b1a (0x4105 bytes) 000838 1786353202.279828 trunc from 0x021140 to 0x00b9b1 (0x1578e bytes) 000839 1786353202.297826 mapwrite 0x021fc1 thru 0x02e025 (0xc065 bytes) 000840 1786353202.339911 fallocate 0x01fb65 thru 0x02e807 (0xeca3 bytes) 000841 1786353202.349435 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2e026): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e026): Mirror 8: 0x72c4e9a6 (stale) Mirror 10: 0x72c4e9a6 (stale) Mirror 13: 0x72c4e9a6 (stale) Mirror 14: 0x72c4e9a6 (stale) Mirror 15: 0x72c4e9a6 (stale) Mirror 16: 0x607f8405 (stale) Mirror 17: 0xef9f597a (stale) Mirror 18: 0xf0fe6720 (stale) Mirror 19: 0x992a9578 (stale) CRC-32 checksum value for chunk [0, 0x2e026): Mirror 1: 0xb152dd65 Mirror 20: 0xb152dd65 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e026: skipped 000842 1786353203.046659 trunc from 0x017185 to 0x01b39f (0x421b bytes) 000843 1786353203.090888 fallocate 0x01d1b9 thru 0x01ef64 (0x1dac bytes) 000844 1786353203.100016 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2e026): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e026): Mirror 8: 0x72c4e9a6 (stale) Mirror 10: 0x72c4e9a6 (stale) Mirror 13: 0x72c4e9a6 (stale) Mirror 14: 0x72c4e9a6 (stale) Mirror 15: 0x72c4e9a6 (stale) Mirror 16: 0x607f8405 (stale) Mirror 17: 0xef9f597a (stale) Mirror 18: 0xf0fe6720 (stale) Mirror 19: 0x992a9578 (stale) Mirror 20: 0xb152dd65 (stale) CRC-32 checksum value for chunk [0, 0x2e026): Mirror 1: 0xb152dd65 Mirror 21: 0xb152dd65 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e026: skipped 000845 1786353203.947444 trunc from 0x02e026 to 0x028cf6 (0x532f bytes) 000846 1786353204.011884 mapwrite 0x030558 thru 0x03cf89 (0xca32 bytes) 000847 1786353204.075001 fallocate 0x02ff1f thru 0x03790a (0x79ec bytes) 000848 1786353204.081717 trunc from 0x03cf8a to 0x018010 (0x24f79 bytes) 000849 1786353204.104146 fallocate 0x00cea8 thru 0x00e4c1 (0x161a bytes) 000850 1786353204.110473 trunc from 0x00f046 to 0x018010 (0x8fcb bytes) 000851 1786353204.116245 read 0x009481 thru 0x00f022 (0x5ba2 bytes) 000852 1786353204.127557 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x18011): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18011): Mirror 8: 0x530a35d7 (stale) Mirror 10: 0x530a35d7 (stale) Mirror 13: 0x530a35d7 (stale) Mirror 14: 0x530a35d7 (stale) Mirror 15: 0x530a35d7 (stale) Mirror 16: 0xbfe1ed57 (stale) Mirror 17: 0xb38ad08d (stale) Mirror 18: 0xb38ad08d (stale) Mirror 19: 0xfd8ac240 (stale) Mirror 20: 0xfd8ac240 (stale) Mirror 21: 0xfd8ac240 (stale) CRC-32 checksum value for chunk [0, 0x18011): Mirror 1: 0xfd8ac240 Mirror 22: 0xfd8ac240 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18011: skipped 000853 1786353204.780254 read 0x015896 thru 0x018010 (0x277b bytes) 000854 1786353204.794381 punch from 0x01030b to 0x018010 (0x7d06 bytes) 000855 1786353204.826533 trunc from 0x015e6e to 0x018010 (0x21a3 bytes) 000856 1786353204.836360 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18011): Mirror 8: 0x530a35d7 (stale) Mirror 10: 0x530a35d7 (stale) Mirror 13: 0x530a35d7 (stale) Mirror 15: 0x530a35d7 (stale) Mirror 16: 0xbfe1ed57 (stale) Mirror 17: 0xb38ad08d (stale) Mirror 18: 0xb38ad08d (stale) Mirror 19: 0xfd8ac240 (stale) Mirror 20: 0xfd8ac240 (stale) Mirror 21: 0xfd8ac240 (stale) Mirror 22: 0xfd8ac240 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18011): Mirror 8: 0x530a35d7 (stale) Mirror 10: 0x530a35d7 (stale) Mirror 13: 0x530a35d7 (stale) Mirror 15: 0x530a35d7 (stale) Mirror 16: 0xbfe1ed57 (stale) Mirror 17: 0xb38ad08d (stale) Mirror 18: 0xb38ad08d (stale) Mirror 19: 0xfd8ac240 (stale) Mirror 20: 0xfd8ac240 (stale) Mirror 21: 0xfd8ac240 (stale) Mirror 22: 0xfd8ac240 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18011: skipped 000857 1786353205.272514 punch from 0x012237 to 0x016275 (0x403f bytes) 000858 1786353205.277915 trunc from 0x012b99 to 0x01747e (0x48e6 bytes) 000859 1786353205.285567 punch from 0x0112fd to 0x018010 (0x6d14 bytes) 000861 1786353205.294014 trunc from 0x018011 to 0x00e75d (0x98b3 bytes) 000862 1786353205.332232 read 0x0061ae thru 0x00b0bc (0x4f0f bytes) 000863 1786353205.339999 mapread 0x00a790 thru 0x00e75d (0x3fce bytes) 000864 1786353205.358184 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe75e): Mirror 8: 0x5f591edd (stale) Mirror 10: 0x5f591edd (stale) Mirror 13: 0x5f591edd (stale) Mirror 15: 0x5f591edd (stale) Mirror 16: 0x73647826 (stale) Mirror 17: 0x73647826 (stale) Mirror 18: 0x73647826 (stale) Mirror 20: 0xf0d5e00a (stale) Mirror 21: 0xf0d5e00a (stale) Mirror 22: 0xf0d5e00a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe75e): Mirror 8: 0x5f591edd (stale) Mirror 10: 0x5f591edd (stale) Mirror 13: 0x5f591edd (stale) Mirror 15: 0x5f591edd (stale) Mirror 16: 0x73647826 (stale) Mirror 17: 0x73647826 (stale) Mirror 18: 0x73647826 (stale) Mirror 20: 0xf0d5e00a (stale) Mirror 21: 0xf0d5e00a (stale) Mirror 22: 0xf0d5e00a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe75e: skipped 000865 1786353205.757508 write 0x039f09 thru 0x03ffff (0x60f7 bytes) 000866 1786353205.763453 write 0x037b80 thru 0x03c8c4 (0x4d45 bytes) 000867 1786353205.771606 trunc from 0x040000 to 0x03672e (0x98d1 bytes) 000868 1786353205.789225 write 0x018b5f thru 0x021f3f (0x93e1 bytes) 000869 1786353205.798990 read 0x0213f2 thru 0x02608e (0x4c9d bytes) 000870 1786353205.808002 write 0x0231ee thru 0x028fee (0x5e01 bytes) 000871 1786353205.812757 fallocate 0x0390d1 thru 0x03ffff (0x6f2f bytes) 000873 1786353205.818445 mapwrite 0x0181ca thru 0x01904d (0xe84 bytes) 000874 1786353205.836481 mapread 0x02e1d1 thru 0x0335f9 (0x5429 bytes) 000875 1786353205.857284 write 0x01f7f5 thru 0x02516e (0x597a bytes) 000876 1786353205.858585 fallocate 0x0356c8 thru 0x03ff94 (0xa8cd bytes) 000877 1786353205.864628 trunc from 0x032233 to 0x039ad6 (0x78a4 bytes) 000878 1786353205.869431 write 0x01ba9e thru 0x02092e (0x4e91 bytes) 000880 1786353205.876596 MIRROR_RESYNC 11 mirrors 000881 1786353207.628560 mapread 0x03381c thru 0x03e476 (0xac5b bytes) 000882 1786353207.656249 write 0x022d36 thru 0x029bba (0x6e85 bytes) 000883 1786353207.693506 mapwrite 0x031078 thru 0x03e26f (0xd1f8 bytes) 000884 1786353207.749649 read 0x03b431 thru 0x03ffff (0x4bcf bytes) 000885 1786353207.750982 mapread 0x0369c7 thru 0x03dd58 (0x7392 bytes) 000886 1786353207.752662 punch from 0x02d0cc to 0x03ba24 (0xe959 bytes) 000888 1786353207.761128 trunc from 0x00adff to 0x010c79 (0x5e7b bytes) 000889 1786353207.768390 mapread 0x022df0 thru 0x0251cd (0x23de bytes) 000890 1786353207.770081 punch from 0x006d19 to 0x012f27 (0xc20f bytes) 000891 1786353207.775326 write 0x0274a6 thru 0x0274be (0x19 bytes) 000892 1786353207.776454 fallocate 0x008323 thru 0x00ae07 (0x2ae5 bytes) 000893 1786353207.781462 mapread 0x01deb2 thru 0x024075 (0x61c4 bytes) 000894 1786353207.790222 read 0x01ed61 thru 0x0279ab (0x8c4b bytes) 000895 1786353207.794480 MIRROR_RESYNC 11 mirrors 000896 1786353209.508846 mapread 0x03dfc5 thru 0x03ffff (0x203b bytes) 000897 1786353209.522500 read 0x021c97 thru 0x0298c8 (0x7c32 bytes) 000898 1786353209.529990 write 0x018174 thru 0x026a49 (0xe8d6 bytes) 000899 1786353209.571959 punch from 0x02f456 to 0x030721 (0x12cc bytes) 000900 1786353209.576740 mapwrite 0x01751f thru 0x022dac (0xb88e bytes) 000901 1786353209.610392 mapwrite 0x02a0e0 thru 0x02b72b (0x164c bytes) 000902 1786353209.640655 mapread 0x002fd0 thru 0x00a530 (0x7561 bytes) 000903 1786353209.650372 read 0x03e770 thru 0x03ffff (0x1890 bytes) 000904 1786353209.659008 trunc from 0x0387bf to 0x03ffff (0x7841 bytes) 000905 1786353209.663180 punch from 0x029862 to 0x03506b (0xb80a bytes) 000906 1786353209.667341 mapread 0x00270a thru 0x0053ec (0x2ce3 bytes) 000907 1786353209.676399 MIRROR_RESYNC 11 mirrors 000909 1786353211.140470 trunc from 0x028be9 to 0x02c3aa (0x37c2 bytes) 000910 1786353211.168159 trunc from 0x040000 to 0x009aa9 (0x36556 bytes) 000911 1786353211.190475 MIRROR_RESYNC 11 mirrors 000912 1786353212.182101 mapread 0x008edd thru 0x009aa9 (0xbcd bytes) 000913 1786353212.193130 mapwrite 0x02261f thru 0x030512 (0xdef4 bytes) 000917 1786353212.270400 punch from 0x002b6b to 0x00959f (0x6a35 bytes) 000918 1786353212.276243 trunc from 0x030513 to 0x0331ea (0x2cd8 bytes) 000919 1786353212.297597 read 0x000042 thru 0x00a79a (0xa759 bytes) 000920 1786353212.307064 mapread 0x021c91 thru 0x02eddf (0xd14f bytes) 000921 1786353212.308527 fallocate 0x036aa1 thru 0x03ffff (0x955f bytes) 000922 1786353212.319479 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x331eb): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x331eb): Mirror 8: 0xad3162fa (stale) Mirror 10: 0xad3162fa (stale) Mirror 13: 0xad3162fa (stale) Mirror 15: 0xad3162fa (stale) Mirror 16: 0xad3162fa (stale) Mirror 17: 0xad3162fa (stale) Mirror 18: 0xad3162fa (stale) Mirror 20: 0xad3162fa (stale) Mirror 21: 0xad3162fa (stale) Mirror 22: 0xad3162fa (stale) CRC-32 checksum value for chunk [0, 0x331eb): Mirror 1: 0x4a11d85f Mirror 23: 0x4a11d85f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x331eb: skipped 000923 1786353213.031156 mapwrite 0x0092c9 thru 0x01655c (0xd294 bytes) 000924 1786353213.120055 trunc from 0x01778a to 0x01fb6c (0x83e3 bytes) 000925 1786353213.127840 MIRROR_RESYNC 12 mirrors 000926 1786353214.960546 MIRROR_EXTEND to 13 mirrors 000927 1786353215.500833 fallocate 0x03c5c9 thru 0x03ffff (0x3a37 bytes) 000928 1786353215.538061 mapread 0x00cbc0 thru 0x018c5f (0xc0a0 bytes) 000929 1786353215.570666 write 0x03405b thru 0x03ffff (0xbfa5 bytes) 000930 1786353215.582928 trunc from 0x025e7f to 0x02cfb1 (0x7133 bytes) 000931 1786353215.588520 trunc from 0x040000 to 0x02f2e1 (0x10d1e bytes) 000932 1786353215.607738 read 0x011b07 thru 0x018a1b (0x6f15 bytes) 000933 1786353215.608488 punch from 0x0259d5 to 0x027914 (0x1f40 bytes) 000934 1786353215.612464 mapwrite 0x003a62 thru 0x00aad6 (0x7075 bytes) 000935 1786353215.639268 fallocate 0x0385be thru 0x03a705 (0x2148 bytes) 000936 1786353215.644495 punch from 0x01f03b to 0x020d68 (0x1d2e bytes) 000937 1786353215.650016 write 0x00f22c thru 0x0170b8 (0x7e8d bytes) 000938 1786353215.652731 mapwrite 0x0000cf thru 0x00dcbc (0xdbee bytes) 000939 1786353215.679327 mapwrite 0x03de78 thru 0x03ffff (0x2188 bytes) 000940 1786353215.716537 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x45abdff2 (stale) Mirror 10: 0x45abdff2 (stale) Mirror 13: 0x45abdff2 (stale) Mirror 15: 0x45abdff2 (stale) Mirror 16: 0x45abdff2 (stale) Mirror 17: 0x45abdff2 (stale) Mirror 18: 0x45abdff2 (stale) Mirror 20: 0x45abdff2 (stale) Mirror 21: 0x45abdff2 (stale) Mirror 22: 0x45abdff2 (stale) Mirror 23: 0x45abdff2 (stale) Mirror 24: 0x45abdff2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf929edbf Mirror 25: 0xf929edbf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000942 1786353216.383637 mapread 0x01b300 thru 0x020891 (0x5592 bytes) 000943 1786353216.416208 mapwrite 0x0352ec thru 0x03b7db (0x64f0 bytes) 000944 1786353216.512036 punch from 0x038679 to 0x03ffff (0x7987 bytes) 000945 1786353216.516050 mapread 0x02c3cf thru 0x03203e (0x5c70 bytes) 000946 1786353216.524374 trunc from 0x021b3d to 0x02cca5 (0xb169 bytes) 000947 1786353216.528570 mapwrite 0x00eee8 thru 0x018782 (0x989b bytes) 000948 1786353216.559055 fallocate 0x02ba81 thru 0x039f07 (0xe487 bytes) 000949 1786353216.564128 trunc from 0x014fff to 0x0234d7 (0xe4d9 bytes) 000950 1786353216.570903 mapread 0x00e1b5 thru 0x01a891 (0xc6dd bytes) 000952 1786353216.578997 mapwrite 0x0175ca thru 0x026a53 (0xf48a bytes) 000953 1786353216.615838 punch from 0x023f33 to 0x02a612 (0x66e0 bytes) 000954 1786353216.621132 mapread 0x0287fb thru 0x03575f (0xcf65 bytes) 000955 1786353216.630205 mapread 0x027ff4 thru 0x02cdab (0x4db8 bytes) 000957 1786353216.634044 mapread 0x02a6df thru 0x035918 (0xb23a bytes) 000958 1786353216.636609 mapwrite 0x03f921 thru 0x03ffff (0x6df bytes) 000959 1786353216.654866 punch from 0x027158 to 0x02b7ce (0x4677 bytes) 000960 1786353216.663091 MIRROR_RESYNC 14 mirrors 000961 1786353219.256742 trunc from 0x040000 to 0x01667e (0x29981 bytes) 000962 1786353219.310170 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x1667f): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1667f): Mirror 8: 0x79884df2 (stale) Mirror 10: 0x79884df2 (stale) Mirror 13: 0x79884df2 (stale) Mirror 15: 0x79884df2 (stale) Mirror 16: 0x79884df2 (stale) Mirror 17: 0x79884df2 (stale) Mirror 18: 0x79884df2 (stale) Mirror 20: 0x79884df2 (stale) Mirror 21: 0x79884df2 (stale) Mirror 22: 0x79884df2 (stale) Mirror 23: 0x79884df2 (stale) Mirror 24: 0x79884df2 (stale) Mirror 25: 0x79884df2 (stale) CRC-32 checksum value for chunk [0, 0x1667f): Mirror 1: 0x79884df2 Mirror 26: 0x79884df2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1667f: skipped 000963 1786353219.952942 trunc from 0x01667f to 0x02cdca (0x1674c bytes) 000964 1786353219.995299 mapread 0x010e63 thru 0x01523b (0x43d9 bytes) 000965 1786353220.011159 mapread 0x016de8 thru 0x017dba (0xfd3 bytes) 000966 1786353220.012181 trunc from 0x02cdcb to 0x01fef3 (0xced7 bytes) 000967 1786353220.029264 mapwrite 0x02b451 thru 0x0363a7 (0xaf57 bytes) 000968 1786353220.077972 trunc from 0x0363a8 to 0x03a6fb (0x4354 bytes) 000970 1786353220.094239 punch from 0x028f1c to 0x0335cb (0xa6b0 bytes) 000971 1786353220.099557 trunc from 0x028b8b to 0x0334b1 (0xa927 bytes) 000972 1786353220.106527 trunc from 0x03a6fc to 0x02dd7b (0xc980 bytes) 000973 1786353220.121748 punch from 0x01fc3c to 0x027f7e (0x8343 bytes) 000974 1786353220.125621 trunc from 0x02dd7c to 0x03053b (0x27c0 bytes) 000976 1786353220.137571 trunc from 0x03053c to 0x03b2fe (0xadc3 bytes) 000977 1786353220.151668 punch from 0x01c53a to 0x0294e3 (0xcfaa bytes) 000978 1786353220.156013 mapwrite 0x02d851 thru 0x03c890 (0xf040 bytes) 000979 1786353220.200507 read 0x02ceee thru 0x0369dc (0x9aef bytes) 000980 1786353220.202728 trunc from 0x03c891 to 0x009ca5 (0x32beb bytes) 000981 1786353220.222579 punch from 0x0090ea to 0x009ca5 (0xbbc bytes) 000982 1786353220.227291 mapwrite 0x021a76 thru 0x028df3 (0x737e bytes) 000984 1786353220.270626 mapwrite 0x024f02 thru 0x02d395 (0x8494 bytes) 000985 1786353220.302175 write 0x021fe8 thru 0x030b88 (0xeba1 bytes) 000986 1786353220.307376 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x30b89): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30b89): Mirror 8: 0x6fce136b (stale) Mirror 10: 0x6fce136b (stale) Mirror 13: 0x6fce136b (stale) Mirror 15: 0x6fce136b (stale) Mirror 16: 0x6fce136b (stale) Mirror 17: 0x6fce136b (stale) Mirror 18: 0x6fce136b (stale) Mirror 20: 0x6fce136b (stale) Mirror 21: 0x6fce136b (stale) Mirror 22: 0x6fce136b (stale) Mirror 23: 0x6fce136b (stale) Mirror 24: 0x6fce136b (stale) Mirror 25: 0x6fce136b (stale) Mirror 26: 0x3b4fb313 (stale) CRC-32 checksum value for chunk [0, 0x30b89): Mirror 1: 0xc3fe2c54 Mirror 27: 0xc3fe2c54 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30b89: skipped 000987 1786353220.926195 trunc from 0x02c467 to 0x030b88 (0x4722 bytes) 000988 1786353220.960044 trunc from 0x030b89 to 0x00640e (0x2a77a bytes) 000990 1786353221.000562 trunc from 0x005ea2 to 0x00640e (0x56d bytes) 000991 1786353221.011575 MIRROR_SPLIT mirror 6 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x51:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x640f): Mirror 8: 0xb7b75cc1 (stale) Mirror 10: 0xb7b75cc1 (stale) Mirror 13: 0xb7b75cc1 (stale) Mirror 15: 0xb7b75cc1 (stale) Mirror 16: 0xb7b75cc1 (stale) Mirror 18: 0xb7b75cc1 (stale) Mirror 20: 0xb7b75cc1 (stale) Mirror 21: 0xb7b75cc1 (stale) Mirror 22: 0xb7b75cc1 (stale) Mirror 23: 0xb7b75cc1 (stale) Mirror 24: 0xb7b75cc1 (stale) Mirror 25: 0xb7b75cc1 (stale) Mirror 26: 0xb7b75cc1 (stale) Mirror 27: 0xb7b75cc1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x640f): Mirror 8: 0xb7b75cc1 (stale) Mirror 10: 0xb7b75cc1 (stale) Mirror 13: 0xb7b75cc1 (stale) Mirror 15: 0xb7b75cc1 (stale) Mirror 16: 0xb7b75cc1 (stale) Mirror 18: 0xb7b75cc1 (stale) Mirror 20: 0xb7b75cc1 (stale) Mirror 21: 0xb7b75cc1 (stale) Mirror 22: 0xb7b75cc1 (stale) Mirror 23: 0xb7b75cc1 (stale) Mirror 24: 0xb7b75cc1 (stale) Mirror 25: 0xb7b75cc1 (stale) Mirror 26: 0xb7b75cc1 (stale) Mirror 27: 0xb7b75cc1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x640f: skipped 000992 1786353221.404228 trunc from 0x00640f to 0x03e539 (0x3812b bytes) 000993 1786353221.417285 read 0x00fc59 thru 0x017ba4 (0x7f4c bytes) 000994 1786353221.425452 mapwrite 0x030c43 thru 0x034d82 (0x4140 bytes) 000996 1786353221.456892 MIRROR_RESYNC 15 mirrors 000997 1786353223.324590 MIRROR_RESYNC 15 mirrors 000998 1786353223.839732 read 0x02b85e thru 0x02da4d (0x21f0 bytes) 001000 1786353223.847455 fallocate 0x0058d8 thru 0x01548e (0xfbb7 bytes) All operations completed A-OK!