== sanity-flr test 70a: flr mode fsx test ================ 05:10:52 (1789636252) Seed set to 6253 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x1b65d 000005 1789636254.197686 trunc from 00000000 to 0x01b65c (0x1b65d bytes) 000006 1789636254.215873 trunc from 0x01b65d to 0x019f20 (0x173c bytes) 000007 1789636254.230038 read 0x01168d thru 0x019f20 (0x8894 bytes) 000008 1789636254.239661 read 0x00bd19 thru 0x0196a1 (0xd989 bytes) 000009 1789636254.250233 mapwrite 0x016b21 thru 0x022e32 (0xc312 bytes) 000010 1789636254.328403 mapread 0x000aea thru 0x0064e4 (0x59fb bytes) 000012 1789636254.329665 trunc from 0x022e33 to 0x005cf1 (0x1d141 bytes) truncating to largest ever: 0x37bc8 000013 1789636254.346977 trunc from 0x005cf2 to 0x037bc7 (0x31ed6 bytes) 000015 1789636254.363060 write 0x03195b thru 0x03234b (0x9f1 bytes) 000016 1789636254.373174 punch from 0x02ae40 to 0x032b26 (0x7ce7 bytes) 000017 1789636254.384238 mapread 0x037692 thru 0x037bc7 (0x536 bytes) 000018 1789636254.388025 punch from 0x000b23 to 0x005908 (0x4de6 bytes) 000019 1789636254.393644 trunc from 0x037bc8 to 0x0252e0 (0x128e7 bytes) 000020 1789636254.411214 read 0x011a86 thru 0x01e01c (0xc597 bytes) 000021 1789636254.429138 MIRROR_EXTEND to 2 mirrors 000022 1789636255.067387 trunc from 0x0252e1 to 0x02020d (0x50d3 bytes) 000023 1789636255.194589 punch from 0x00fb0e to 0x012b57 (0x304a bytes) 000024 1789636255.200550 write 0x0067f6 thru 0x00d859 (0x7064 bytes) 000025 1789636255.217708 punch from 0x013820 to 0x01ce0b (0x95ec bytes) 000026 1789636255.232683 read 0x0078c8 thru 0x00fa98 (0x81d1 bytes) 000027 1789636255.239757 mapread 0x007c60 thru 0x010f2d (0x92ce bytes) 000028 1789636255.248054 write 0x032b74 thru 0x03bd7a (0x9207 bytes) 000030 1789636255.251030 mapwrite 0x029d18 thru 0x0301ff (0x64e8 bytes) 000031 1789636255.359545 mapwrite 0x0386ee thru 0x03d0ca (0x49dd bytes) 000034 1789636255.447869 trunc from 0x03d0cb to 0x033b00 (0x95ca bytes) 000035 1789636255.471268 mapread 0x008b82 thru 0x0116e1 (0x8b60 bytes) 000037 1789636255.482513 mapwrite 0x036b78 thru 0x03a889 (0x3d12 bytes) 000040 1789636255.576282 mapread 0x01568e thru 0x020af8 (0xb46b bytes) 000041 1789636255.584581 mapwrite 0x0332a7 thru 0x03ffff (0xcd59 bytes) 000043 1789636255.671955 mapread 0x0149b4 thru 0x01d94b (0x8f98 bytes) 000044 1789636255.672754 mapwrite 0x03a9a2 thru 0x03ffff (0x565e bytes) 000045 1789636255.716558 MIRROR_RESYNC 2 mirrors 000046 1789636256.616959 mapwrite 0x035a43 thru 0x03ffff (0xa5bd bytes) 000047 1789636256.780621 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xee158c48 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2e9cb923 Mirror 3: 0x2e9cb923 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000048 1789636257.936724 punch from 0x00f2da to 0x01703e (0x7d65 bytes) 000050 1789636258.039720 trunc from 0x040000 to 0x011eec (0x2e113 bytes) 000052 1789636258.072553 read 0x0034c4 thru 0x0103ba (0xcef7 bytes) 000053 1789636258.083728 mapread 0x001e8f thru 0x005e82 (0x3ff4 bytes) 000055 1789636258.109679 read 0x00f7a5 thru 0x011eec (0x2748 bytes) 000056 1789636258.163048 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x11eed): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11eed): Mirror 2: 0x64fedfc3 (stale) Mirror 3: 0x64fedfc3 (stale) CRC-32 checksum value for chunk [0, 0x11eed): Mirror 1: 0x64fedfc3 Mirror 4: 0x64fedfc3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11eed: skipped 000058 1789636259.620162 read 0x001c70 thru 0x002ba5 (0xf36 bytes) 000059 1789636259.637943 trunc from 0x011eed to 0x01ec0e (0xcd22 bytes) 000062 1789636259.845716 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ec0f): Mirror 2: 0x290404a0 (stale) Mirror 4: 0x290404a0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ec0f): Mirror 2: 0x290404a0 (stale) Mirror 4: 0x290404a0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ec0f: skipped 000064 1789636260.191996 mapread 0x00ca52 thru 0x01313b (0x66ea bytes) 000066 1789636260.232622 punch from 0x01e97a to 0x01ec0e (0x295 bytes) truncating to largest ever: 0x3887d 000067 1789636260.250372 trunc from 0x01ec0f to 0x03887c (0x19c6e bytes) 000070 1789636260.284115 write 0x01e1f7 thru 0x02ab7d (0xc987 bytes) 000071 1789636260.293219 trunc from 0x03887d to 0x01505d (0x2381f bytes) 000072 1789636260.321340 read 0x002ab4 thru 0x011919 (0xee66 bytes) 000073 1789636260.332228 trunc from 0x01505e to 0x01c263 (0x7206 bytes) 000074 1789636260.376553 read 0x00ffd3 thru 0x019db4 (0x9de2 bytes) 000076 1789636260.403571 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c264): Mirror 4: 0xab89d291 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c264): Mirror 4: 0xab89d291 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c264: skipped 000077 1789636260.820892 write 0x03756d thru 0x03ffff (0x8a93 bytes) 000080 1789636260.825185 write 0x02faf1 thru 0x037c11 (0x8121 bytes) 000082 1789636260.837840 MIRROR_RESYNC 2 mirrors 000084 1789636262.002495 punch from 0x03a0fd to 0x03ba4b (0x194f bytes) 000085 1789636262.070507 mapwrite 0x02ffa5 thru 0x03acb8 (0xad14 bytes) 000087 1789636262.147612 trunc from 0x040000 to 0x014b1e (0x2b4e1 bytes) 000088 1789636262.167804 mapwrite 0x0209d2 thru 0x020ec3 (0x4f2 bytes) 000089 1789636262.232233 trunc from 0x020ec4 to 0x00cbc5 (0x142fe bytes) 000091 1789636262.253979 mapwrite 0x007ecd thru 0x00b3a6 (0x34da bytes) 000092 1789636262.312129 write 0x007506 thru 0x00e0cc (0x6bc7 bytes) truncating to largest ever: 0x3fb14 000093 1789636262.313612 trunc from 0x00e0cd to 0x03fb13 (0x31a47 bytes) 000094 1789636262.333639 mapwrite 0x0093b1 thru 0x009c48 (0x898 bytes) 000095 1789636262.395319 mapwrite 0x0337c6 thru 0x039168 (0x59a3 bytes) 000098 1789636262.453443 mapread 0x00806e thru 0x00e8d2 (0x6865 bytes) 000099 1789636262.454327 write 0x007e6b thru 0x01725e (0xf3f4 bytes) 000100 1789636262.465118 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) 000101 1789636262.602107 punch from 0x0395c4 to 0x03fb13 (0x6550 bytes) 000103 1789636262.608624 punch from 0x006edb to 0x009ae0 (0x2c06 bytes) 000104 1789636262.613382 punch from 0x028f5f to 0x030d33 (0x7dd5 bytes) 000106 1789636262.618991 punch from 0x0045cd to 0x00f44a (0xae7e bytes) 000108 1789636262.624331 mapwrite 0x01eb9b thru 0x02ea2e (0xfe94 bytes) 000109 1789636262.728414 write 0x02266b thru 0x02af95 (0x892b bytes) 000112 1789636262.745314 punch from 0x0271c2 to 0x033e1b (0xcc5a bytes) 000113 1789636262.762843 mapread 0x03978f thru 0x03fb13 (0x6385 bytes) 000115 1789636262.775384 punch from 0x03e8a7 to 0x03fb13 (0x126d bytes) 000116 1789636262.780924 read 0x020cd8 thru 0x0225f6 (0x191f bytes) 000117 1789636262.783420 write 0x03c6bc thru 0x03ffff (0x3944 bytes) 000118 1789636262.785527 mapread 0x01c15f thru 0x01feb8 (0x3d5a bytes) 000122 1789636262.789671 write 0x006150 thru 0x0133ac (0xd25d bytes) 000123 1789636262.804113 read 0x012a44 thru 0x016c68 (0x4225 bytes) 000124 1789636262.815235 read 0x01495d thru 0x01cee1 (0x8585 bytes) 000125 1789636262.815842 mapwrite 0x0233b5 thru 0x0293ef (0x603b bytes) 000126 1789636262.917142 trunc from 0x040000 to 0x019a9a (0x26565 bytes) 000128 1789636262.940718 punch from 0x007f89 to 0x00adc5 (0x2e3d bytes) 000129 1789636262.945994 mapwrite 0x021c4e thru 0x02efdf (0xd392 bytes) 000130 1789636263.039380 mapread 0x019b71 thru 0x01e2ae (0x473e bytes) 000131 1789636263.043930 MIRROR_EXTEND to 2 mirrors 000132 1789636263.864231 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) 000133 1789636264.097889 trunc from 0x02efe0 to 0x02d3bd (0x1c22 bytes) 000134 1789636264.132682 read 0x0191ed thru 0x01d867 (0x467b bytes) 000138 1789636264.154205 trunc from 0x02d3be to 0x018369 (0x15054 bytes) 000139 1789636264.171636 read 0x003f10 thru 0x00a750 (0x6841 bytes) 000143 1789636264.195955 punch from 0x004918 to 0x005756 (0xe3f bytes) 000144 1789636264.207683 mapwrite 0x02ec5f thru 0x03585b (0x6bfd bytes) 000145 1789636264.304778 write 0x01ba49 thru 0x024f14 (0x94cc bytes) 000146 1789636264.305833 trunc from 0x03585c to 0x02f539 (0x6322 bytes) 000147 1789636264.339922 punch from 0x012a8d to 0x018c80 (0x61f4 bytes) 000148 1789636264.378866 mapwrite 0x039a49 thru 0x03ffff (0x65b7 bytes) 000149 1789636264.469745 mapread 0x027095 thru 0x0325cd (0xb539 bytes) 000150 1789636264.492825 read 0x03522f thru 0x03ffff (0xadd1 bytes) 000151 1789636264.503381 mapwrite 0x000c32 thru 0x00209d (0x146c bytes) 000152 1789636264.558555 mapwrite 0x0090e0 thru 0x00cde1 (0x3d02 bytes) 000153 1789636264.604177 mapwrite 0x03ef63 thru 0x03ffff (0x109d bytes) 000154 1789636264.652816 mapwrite 0x018dea thru 0x01c617 (0x382e bytes) 000157 1789636264.706837 write 0x0100c6 thru 0x01b06c (0xafa7 bytes) 000158 1789636264.725613 punch from 0x00a92e to 0x01a5f0 (0xfcc3 bytes) 000160 1789636264.742818 punch from 0x017df5 to 0x022e4c (0xb058 bytes) 000163 1789636264.752868 punch from 0x031cee to 0x03cd15 (0xb028 bytes) 000164 1789636264.759080 mapwrite 0x0313e3 thru 0x03a783 (0x93a1 bytes) 000165 1789636264.854534 trunc from 0x040000 to 0x01ccbd (0x23342 bytes) 000166 1789636264.871953 read 0x017722 thru 0x01ccbd (0x559c bytes) 000167 1789636264.891398 mapwrite 0x004299 thru 0x004f22 (0xc8a bytes) 000168 1789636264.947951 punch from 0x016e2b to 0x01ccbd (0x5e93 bytes) 000169 1789636264.956374 trunc from 0x01ccbe to 0x0109b6 (0xc307 bytes) 000171 1789636264.972220 mapwrite 0x0339a0 thru 0x037201 (0x3862 bytes) 000172 1789636265.071443 write 0x009bd3 thru 0x00f5c1 (0x59ef bytes) 000174 1789636265.073088 read 0x027c83 thru 0x036da2 (0xf120 bytes) 000175 1789636265.073811 read 0x003609 thru 0x00e6cc (0xb0c4 bytes) 000176 1789636265.074972 write 0x02bc4b thru 0x03aa46 (0xedfc bytes) 000181 1789636265.079975 write 0x01b5d3 thru 0x02a6f2 (0xf120 bytes) 000183 1789636265.088877 punch from 0x0079f1 to 0x00c271 (0x4881 bytes) 000186 1789636265.106880 write 0x00a6a4 thru 0x019ea1 (0xf7fe bytes) 000189 1789636265.118841 MIRROR_EXTEND to 2 mirrors 000190 1789636266.312408 trunc from 0x03aa47 to 0x00e01d (0x2ca29 bytes) 000192 1789636266.484944 trunc from 0x00e01e to 0x0268d0 (0x188b3 bytes) 000193 1789636266.518565 write 0x03d343 thru 0x03ffff (0x2cbd bytes) 000194 1789636266.520431 mapread 0x02354a thru 0x025f31 (0x29e8 bytes) 000195 1789636266.556581 mapread 0x00c8c9 thru 0x00d4b9 (0xbf1 bytes) 000196 1789636266.577886 mapwrite 0x021f4a thru 0x02c43f (0xa4f6 bytes) 000197 1789636266.633614 trunc from 0x040000 to 0x0362ce (0x9d31 bytes) 000198 1789636266.644271 punch from 0x016d30 to 0x0179b7 (0xc88 bytes) 000199 1789636266.650863 mapread 0x01984d thru 0x02128c (0x7a40 bytes) 000200 1789636266.657938 read 0x01a63d thru 0x025bed (0xb5b1 bytes) 000202 1789636266.662780 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x362cf): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x362cf): Mirror 2: 0xbfca34cd (stale) CRC-32 checksum value for chunk [0, 0x362cf): Mirror 1: 0x9f2af3b1 Mirror 3: 0x9f2af3b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x362cf: skipped 000203 1789636267.538859 read 0x010309 thru 0x0146eb (0x43e3 bytes) 000204 1789636267.555961 punch from 0x018350 to 0x01a568 (0x2219 bytes) 000205 1789636267.638990 trunc from 0x0362cf to 0x00b6f7 (0x2abd7 bytes) 000206 1789636267.664043 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xb6f8): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb6f8): Mirror 2: 0x5287fa6 (stale) Mirror 3: 0x5287fa6 (stale) CRC-32 checksum value for chunk [0, 0xb6f8): Mirror 1: 0x5287fa6 Mirror 4: 0x5287fa6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb6f8: skipped 000207 1789636268.643156 read 0x003516 thru 0x00b6f7 (0x81e2 bytes) 000208 1789636268.651555 trunc from 0x00b6f8 to 0x00d5ae (0x1eb7 bytes) 000210 1789636268.750398 read 0x00731d thru 0x00d5ae (0x6292 bytes) 000214 1789636268.761415 punch from 0x004f67 to 0x00d5ae (0x8648 bytes) 000215 1789636268.777429 MIRROR_RESYNC 4 mirrors 000216 1789636270.340650 punch from 0x00704e to 0x00d5ae (0x6561 bytes) 000219 1789636270.385939 read 0x00a813 thru 0x00d5ae (0x2d9c bytes) 000220 1789636270.396463 MIRROR_RESYNC 4 mirrors 000221 1789636271.543946 mapread 0x00d0e7 thru 0x00d5ae (0x4c8 bytes) 000222 1789636271.549695 mapread 0x0080c8 thru 0x00d5ae (0x54e7 bytes) 000223 1789636271.561281 read 0x00c172 thru 0x00d5ae (0x143d bytes) 000224 1789636271.561872 trunc from 0x00d5af to 0x02ee41 (0x21893 bytes) 000225 1789636271.680672 punch from 0x01280f to 0x013778 (0xf6a bytes) 000226 1789636271.691588 read 0x00ad30 thru 0x011552 (0x6823 bytes) 000228 1789636271.710673 trunc from 0x02ee42 to 0x0033fa (0x2ba47 bytes) 000229 1789636271.745125 write 0x029795 thru 0x02a045 (0x8b1 bytes) 000230 1789636271.746799 punch from 0x01381d to 0x01a458 (0x6c3c bytes) 000231 1789636271.761418 punch from 0x007844 to 0x010524 (0x8ce1 bytes) 000232 1789636271.768164 mapread 0x01b70f thru 0x0257bb (0xa0ad bytes) 000235 1789636271.836450 punch from 0x00098d to 0x00cc17 (0xc28b bytes) 000236 1789636271.843647 mapread 0x001d2f thru 0x01088e (0xeb60 bytes) 000238 1789636271.966186 trunc from 0x02a046 to 0x03013d (0x60f8 bytes) 000239 1789636271.989691 punch from 0x0100fb to 0x016731 (0x6637 bytes) 000240 1789636271.995568 trunc from 0x03013e to 0x028bc3 (0x757a bytes) 000245 1789636272.016134 punch from 0x0024a0 to 0x00fd64 (0xd8c5 bytes) 000246 1789636272.027040 mapread 0x00fdbb thru 0x014d91 (0x4fd7 bytes) 000247 1789636272.075672 mapread 0x004013 thru 0x00e973 (0xa961 bytes) 000248 1789636272.138718 read 0x00820b thru 0x0176e2 (0xf4d8 bytes) 000250 1789636272.149682 write 0x01aea4 thru 0x021f95 (0x70f2 bytes) 000251 1789636272.159909 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x28bc4): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28bc4): Mirror 2: 0xca7ade (stale) Mirror 3: 0xca7ade (stale) Mirror 4: 0xca7ade (stale) CRC-32 checksum value for chunk [0, 0x28bc4): Mirror 1: 0xb817813b Mirror 5: 0xb817813b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28bc4: skipped 000252 1789636273.475882 trunc from 0x028bc4 to 0x00f34a (0x19879 bytes) 000254 1789636273.570679 punch from 0x002ccd to 0x00f34a (0xc67e bytes) 000255 1789636273.573767 read 0x0056a1 thru 0x00f34a (0x9caa bytes) 000257 1789636273.579965 mapwrite 0x018952 thru 0x022fa0 (0xa64f bytes) 000259 1789636273.681052 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x22fa1): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22fa1): Mirror 2: 0x40cd953a (stale) Mirror 3: 0x40cd953a (stale) Mirror 4: 0x40cd953a (stale) Mirror 5: 0x7039c8c9 (stale) CRC-32 checksum value for chunk [0, 0x22fa1): Mirror 1: 0x2cac6fd9 Mirror 6: 0x2cac6fd9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22fa1: skipped 000262 1789636274.844861 mapwrite 0x0354fe thru 0x03693f (0x1442 bytes) 000263 1789636275.014048 trunc from 0x036940 to 0x03c76d (0x5e2e bytes) 000265 1789636275.033885 write 0x0274e9 thru 0x02f542 (0x805a bytes) 000266 1789636275.041229 trunc from 0x03c76e to 0x022b23 (0x19c4a bytes) 000267 1789636275.057805 read 0x01cfcb thru 0x022b23 (0x5b59 bytes) 000268 1789636275.062731 trunc from 0x022b24 to 0x03d27b (0x1a758 bytes) 000269 1789636275.074929 read 0x00b54e thru 0x00b5d1 (0x84 bytes) 000270 1789636275.083372 punch from 0x009be1 to 0x014612 (0xaa32 bytes) 000271 1789636275.089222 punch from 0x02cb60 to 0x02cdc3 (0x264 bytes) 000272 1789636275.092861 mapwrite 0x0043da thru 0x008282 (0x3ea9 bytes) 000274 1789636275.162720 read 0x0343a5 thru 0x03d27b (0x8ed7 bytes) 000275 1789636275.163611 trunc from 0x03d27c to 0x02a1ff (0x1307c bytes) 000276 1789636275.196196 trunc from 0x02a200 to 0x03980f (0xf610 bytes) 000278 1789636275.220897 mapread 0x010028 thru 0x01805e (0x8037 bytes) 000279 1789636275.228452 write 0x02ec5d thru 0x03686e (0x7c12 bytes) 000280 1789636275.229450 mapread 0x023a19 thru 0x02b32d (0x7915 bytes) 000282 1789636275.231290 read 0x01c19a thru 0x01d793 (0x15fa bytes) 000283 1789636275.231829 trunc from 0x039810 to 0x038cb2 (0xb5d bytes) 000284 1789636275.257404 punch from 0x002e6e to 0x004306 (0x1499 bytes) 000285 1789636275.292925 read 0x02afd2 thru 0x0364b7 (0xb4e6 bytes) 000287 1789636275.294429 trunc from 0x038cb3 to 0x03781a (0x1498 bytes) 000290 1789636275.324087 punch from 0x02de97 to 0x03781a (0x9984 bytes) 000291 1789636275.349673 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3781b): Mirror 2: 0xe6f52d02 (stale) Mirror 4: 0xe6f52d02 (stale) Mirror 5: 0x5cb518d7 (stale) Mirror 6: 0xf4c605bc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3781b): Mirror 2: 0xe6f52d02 (stale) Mirror 4: 0xe6f52d02 (stale) Mirror 5: 0x5cb518d7 (stale) Mirror 6: 0xf4c605bc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3781b: skipped 000292 1789636275.819543 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3781b): Mirror 2: 0xe6f52d02 (stale) Mirror 4: 0xe6f52d02 (stale) Mirror 5: 0x5cb518d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3781b): Mirror 2: 0xe6f52d02 (stale) Mirror 4: 0xe6f52d02 (stale) Mirror 5: 0x5cb518d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3781b: skipped 000294 1789636276.223835 mapwrite 0x00ef23 thru 0x00fa90 (0xb6e bytes) 000297 1789636276.287283 mapread 0x02af2d thru 0x03781a (0xc8ee bytes) 000300 1789636276.311788 write 0x018362 thru 0x0241d9 (0xbe78 bytes) 000301 1789636276.329767 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3781b): Mirror 2: 0xe6f52d02 (stale) Mirror 4: 0xe6f52d02 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3781b): Mirror 2: 0xe6f52d02 (stale) Mirror 4: 0xe6f52d02 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3781b: skipped 000303 1789636276.653704 punch from 0x01b673 to 0x02b067 (0xf9f5 bytes) 000305 1789636276.660168 write 0x009607 thru 0x012807 (0x9201 bytes) 000306 1789636276.671432 read 0x00831e thru 0x00cf83 (0x4c66 bytes) 000307 1789636276.678151 mapread 0x02a0b5 thru 0x03781a (0xd766 bytes) 000309 1789636276.706833 trunc from 0x03781b to 0x007064 (0x307b6 bytes) 000311 1789636276.739677 mapread 0x0051e3 thru 0x007064 (0x1e82 bytes) 000312 1789636276.748501 punch from 0x006510 to 0x007064 (0xb55 bytes) 000315 1789636276.759846 MIRROR_RESYNC 3 mirrors 000316 1789636277.948099 MIRROR_EXTEND to 4 mirrors 000317 1789636278.733053 trunc from 0x007065 to 0x037f1e (0x30eba bytes) 000318 1789636278.821380 trunc from 0x037f1f to 0x036678 (0x18a6 bytes) 000319 1789636278.853186 mapread 0x020ef0 thru 0x022835 (0x1946 bytes) 000320 1789636278.875553 write 0x033aac thru 0x037ba1 (0x40f6 bytes) 000321 1789636278.892198 punch from 0x019973 to 0x0262bd (0xc94b bytes) 000322 1789636278.912186 mapwrite 0x035573 thru 0x03607c (0xb0a bytes) 000323 1789636278.979661 read 0x008683 thru 0x00ae51 (0x27cf bytes) 000325 1789636278.988614 write 0x038e42 thru 0x03a72d (0x18ec bytes) 000327 1789636278.993345 mapread 0x01504a thru 0x01b900 (0x68b7 bytes) 000329 1789636279.014686 punch from 0x02c97b to 0x02f87b (0x2f01 bytes) 000330 1789636279.031187 MIRROR_RESYNC 4 mirrors 000333 1789636280.611739 mapread 0x0218ea thru 0x023788 (0x1e9f bytes) 000334 1789636280.630578 mapwrite 0x00e519 thru 0x00f453 (0xf3b bytes) 000335 1789636280.793537 MIRROR_RESYNC 4 mirrors 000337 1789636282.833997 mapread 0x01d631 thru 0x023dac (0x677c bytes) 000338 1789636282.864427 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) 000339 1789636283.165400 MIRROR_RESYNC 3 mirrors 000340 1789636283.570937 punch from 0x035568 to 0x03a72d (0x51c6 bytes) 000342 1789636283.653857 mapwrite 0x01de9c thru 0x024089 (0x61ee bytes) 000343 1789636283.724729 read 0x02f24a thru 0x032c65 (0x3a1c bytes) 000347 1789636283.743955 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a72e): Mirror 4: 0x75d47fd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a72e): Mirror 4: 0x75d47fd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a72e: skipped 000348 1789636284.046556 punch from 0x018b00 to 0x02311d (0xa61e bytes) 000349 1789636284.052943 punch from 0x00a18b to 0x01064f (0x64c5 bytes) 000350 1789636284.057941 trunc from 0x03a72e to 0x00ec41 (0x2baec bytes) 000351 1789636284.080843 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xec42): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xec42): Mirror 4: 0x81c379b9 (stale) CRC-32 checksum value for chunk [0, 0xec42): Mirror 1: 0xdb1234e9 Mirror 5: 0xdb1234e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xec42: skipped 000352 1789636285.237667 mapread 0x00334e thru 0x00ec41 (0xb8f4 bytes) 000353 1789636285.263623 mapread 0x00096b thru 0x00ac4c (0xa2e2 bytes) 000355 1789636285.295182 mapwrite 0x03ecf7 thru 0x03ffff (0x1309 bytes) 000356 1789636285.468134 mapwrite 0x01326a thru 0x01eef6 (0xbc8d bytes) 000357 1789636285.521503 punch from 0x0267ec to 0x02aef6 (0x470b bytes) 000358 1789636285.526057 mapwrite 0x0007de thru 0x008d0c (0x852f bytes) 000359 1789636285.603018 MIRROR_RESYNC 3 mirrors 000360 1789636287.367435 punch from 0x003602 to 0x012dee (0xf7ed bytes) 000361 1789636287.459498 punch from 0x037ed5 to 0x0393a8 (0x14d4 bytes) 000362 1789636287.473236 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x30b2af33 (stale) Mirror 5: 0x30b2af33 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd027c700 Mirror 6: 0xd027c700 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000364 1789636289.023327 mapread 0x012d31 thru 0x02217f (0xf44f bytes) 000365 1789636289.071842 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x30b2af33 (stale) Mirror 5: 0x30b2af33 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x30b2af33 (stale) Mirror 5: 0x30b2af33 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000367 1789636289.315625 MIRROR_RESYNC 3 mirrors 000368 1789636290.607891 write 0x030f00 thru 0x03bfb7 (0xb0b8 bytes) 000369 1789636290.690192 write 0x0208c8 thru 0x02a483 (0x9bbc bytes) 000370 1789636290.725580 write 0x006604 thru 0x010b04 (0xa501 bytes) 000371 1789636290.742229 mapwrite 0x00f465 thru 0x00f497 (0x33 bytes) 000373 1789636290.819775 write 0x0387d1 thru 0x03976d (0xf9d bytes) 000374 1789636290.820971 mapread 0x034c13 thru 0x03ffff (0xb3ed bytes) 000376 1789636290.866892 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd027c700 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd027c700 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000378 1789636291.177125 punch from 0x02c708 to 0x033cc9 (0x75c2 bytes) 000379 1789636291.184982 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) 000380 1789636291.319846 mapwrite 0x01ea54 thru 0x029688 (0xac35 bytes) 000381 1789636291.394051 write 0x03ac17 thru 0x03ffff (0x53e9 bytes) 000385 1789636291.401483 punch from 0x036125 to 0x03ffff (0x9edb bytes) 000387 1789636291.410838 punch from 0x019ae8 to 0x02552f (0xba48 bytes) 000389 1789636291.416756 write 0x02b525 thru 0x036faa (0xba86 bytes) 000391 1789636291.423940 read 0x03507e thru 0x03ffff (0xaf82 bytes) 000394 1789636291.439474 write 0x0288e8 thru 0x02f73c (0x6e55 bytes) 000395 1789636291.441001 write 0x03b8be thru 0x03ffff (0x4742 bytes) 000396 1789636291.442794 read 0x007273 thru 0x0082aa (0x1038 bytes) 000397 1789636291.457066 write 0x02fbd9 thru 0x03b327 (0xb74f bytes) 000398 1789636291.462861 write 0x016765 thru 0x018b76 (0x2412 bytes) 000400 1789636291.466166 mapwrite 0x00efd7 thru 0x018261 (0x928b bytes) 000401 1789636291.535441 punch from 0x00d571 to 0x010277 (0x2d07 bytes) 000402 1789636291.541600 trunc from 0x040000 to 0x01a014 (0x25feb bytes) 000403 1789636291.566173 write 0x03e84a thru 0x03ffff (0x17b6 bytes) 000404 1789636291.568307 write 0x03bd6a thru 0x03ffff (0x4296 bytes) 000405 1789636291.579475 MIRROR_EXTEND to 2 mirrors 000406 1789636292.452941 punch from 0x00d1be to 0x010945 (0x3788 bytes) 000407 1789636292.525948 trunc from 0x040000 to 0x03cb8d (0x3472 bytes) 000408 1789636292.549842 trunc from 0x03cb8e to 0x03e496 (0x1909 bytes) 000410 1789636292.568099 write 0x035539 thru 0x03f505 (0x9fcd bytes) 000411 1789636292.578719 mapread 0x0377a9 thru 0x03b4e6 (0x3d3e bytes) 000412 1789636292.579626 read 0x03d1e9 thru 0x03f505 (0x231d bytes) 000414 1789636292.581928 mapwrite 0x027371 thru 0x029045 (0x1cd5 bytes) 000416 1789636292.647000 mapwrite 0x027074 thru 0x036d7c (0xfd09 bytes) 000417 1789636292.693694 mapread 0x004caf thru 0x00d306 (0x8658 bytes) 000418 1789636292.702816 trunc from 0x03f506 to 0x01a692 (0x24e73 bytes) 000419 1789636292.722153 read 0x007800 thru 0x00c98d (0x518e bytes) 000420 1789636292.722774 write 0x02ff37 thru 0x038c03 (0x8ccd bytes) 000422 1789636292.725483 read 0x03528d thru 0x038c03 (0x3977 bytes) 000423 1789636292.726028 write 0x01ebe1 thru 0x01fce2 (0x1102 bytes) 000425 1789636292.736312 mapwrite 0x025120 thru 0x0321dd (0xd0be bytes) 000427 1789636292.793037 trunc from 0x038c04 to 0x016e31 (0x21dd2 bytes) 000428 1789636292.820766 trunc from 0x016e32 to 0x03a992 (0x23b61 bytes) 000430 1789636292.838769 mapwrite 0x003ecf thru 0x00c1ca (0x82fc bytes) 000431 1789636292.891697 punch from 0x01c1ce to 0x027e72 (0xbca5 bytes) 000432 1789636292.896890 write 0x0361ac thru 0x039b49 (0x399e bytes) 000433 1789636292.905920 mapread 0x0110d8 thru 0x016926 (0x584f bytes) 000434 1789636292.907312 read 0x00c416 thru 0x01843e (0xc029 bytes) 000435 1789636292.916040 punch from 0x02904f to 0x036542 (0xd4f4 bytes) 000436 1789636292.926117 mapwrite 0x0232fa thru 0x02bf8d (0x8c94 bytes) 000437 1789636292.987616 write 0x02a994 thru 0x02ec25 (0x4292 bytes) 000438 1789636292.995452 write 0x015141 thru 0x01c401 (0x72c1 bytes) 000440 1789636292.996999 mapwrite 0x03d770 thru 0x03ffff (0x2890 bytes) 000442 1789636293.113440 write 0x027703 thru 0x029305 (0x1c03 bytes) 000443 1789636293.114328 read 0x02ba39 thru 0x0316b3 (0x5c7b bytes) 000444 1789636293.122188 write 0x016e4a thru 0x01d151 (0x6308 bytes) 000445 1789636293.123972 write 0x00f435 thru 0x01c0a3 (0xcc6f bytes) 000446 1789636293.125304 punch from 0x03a609 to 0x03ffff (0x59f7 bytes) 000448 1789636293.150068 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xbed91606 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7657fbfe Mirror 3: 0x7657fbfe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000451 1789636294.224182 mapwrite 0x00f8af thru 0x01dd57 (0xe4a9 bytes) 000452 1789636294.397285 MIRROR_RESYNC 3 mirrors 000453 1789636295.697317 write 0x01a58b thru 0x01ab01 (0x577 bytes) 000456 1789636295.745988 read 0x038fa9 thru 0x03ffff (0x7057 bytes) 000457 1789636295.753017 mapwrite 0x02a46e thru 0x02d31f (0x2eb2 bytes) 000459 1789636295.821136 write 0x0185be thru 0x02789a (0xf2dd bytes) 000460 1789636295.827831 trunc from 0x040000 to 0x0233ad (0x1cc52 bytes) 000461 1789636295.848893 read 0x014744 thru 0x016a08 (0x22c5 bytes) 000462 1789636295.861187 MIRROR_RESYNC 3 mirrors 000464 1789636296.896878 mapread 0x00c268 thru 0x018e5b (0xcbf4 bytes) 000467 1789636296.924644 read 0x0060df thru 0x010a47 (0xa969 bytes) 000471 1789636296.930813 write 0x0202e0 thru 0x0260dd (0x5dfe bytes) 000472 1789636296.998502 mapread 0x00c535 thru 0x013b89 (0x7655 bytes) 000473 1789636297.017875 punch from 0x002a92 to 0x0098cc (0x6e3b bytes) 000474 1789636297.038505 write 0x018c7c thru 0x0192f4 (0x679 bytes) 000475 1789636297.050509 mapwrite 0x00ef47 thru 0x016cec (0x7da6 bytes) 000477 1789636297.119036 MIRROR_RESYNC 3 mirrors 000478 1789636297.909939 mapread 0x01f1fb thru 0x0260dd (0x6ee3 bytes) 000479 1789636297.927371 mapwrite 0x0181e9 thru 0x01f815 (0x762d bytes) 000480 1789636298.075681 punch from 0x003e66 to 0x009329 (0x54c4 bytes) 000481 1789636298.081052 read 0x01e7d0 thru 0x020c0e (0x243f bytes) 000482 1789636298.081946 mapread 0x00fa90 thru 0x01d28d (0xd7fe bytes) 000483 1789636298.088979 write 0x0396ad thru 0x03ce3d (0x3791 bytes) 000485 1789636298.090820 write 0x015909 thru 0x018daf (0x34a7 bytes) 000486 1789636298.091564 mapwrite 0x00def0 thru 0x00f6e0 (0x17f1 bytes) 000488 1789636298.141922 mapread 0x018758 thru 0x01e85e (0x6107 bytes) 000489 1789636298.147869 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3ce3e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce3e): Mirror 2: 0xa32b776a (stale) Mirror 3: 0xa32b776a (stale) CRC-32 checksum value for chunk [0, 0x3ce3e): Mirror 1: 0x84e240fe Mirror 4: 0x84e240fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce3e: skipped 000490 1789636299.272494 read 0x031cf4 thru 0x0367ce (0x4adb bytes) 000491 1789636299.301931 read 0x00ff3b thru 0x0110bc (0x1182 bytes) 000492 1789636299.325322 mapread 0x03bcf8 thru 0x03ce3d (0x1146 bytes) 000493 1789636299.326827 read 0x037029 thru 0x03ce3d (0x5e15 bytes) 000494 1789636299.327331 mapread 0x0128fc thru 0x018e10 (0x6515 bytes) 000495 1789636299.328817 mapread 0x023273 thru 0x02f417 (0xc1a5 bytes) 000497 1789636299.330283 mapread 0x0118ee thru 0x011a1f (0x132 bytes) 000498 1789636299.336994 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3ce3e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce3e): Mirror 2: 0xa32b776a (stale) Mirror 3: 0xa32b776a (stale) CRC-32 checksum value for chunk [0, 0x3ce3e): Mirror 1: 0x84e240fe Mirror 4: 0x84e240fe Mirror 5: 0x84e240fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce3e: skipped 000499 1789636300.625849 mapwrite 0x006e94 thru 0x015663 (0xe7d0 bytes) 000500 1789636300.792443 mapwrite 0x03db18 thru 0x03ffff (0x24e8 bytes) 000501 1789636300.861855 mapwrite 0x00b23d thru 0x01802b (0xcdef bytes) 000502 1789636300.908178 read 0x0110aa thru 0x01400e (0x2f65 bytes) 000504 1789636300.909284 mapread 0x00a565 thru 0x01776f (0xd20b bytes) 000505 1789636300.915451 MIRROR_RESYNC 5 mirrors 000507 1789636302.472800 mapwrite 0x0029c4 thru 0x0073bc (0x49f9 bytes) 000508 1789636302.727874 trunc from 0x040000 to 0x021d9f (0x1e260 bytes) truncating to largest ever: 0x3fb18 000510 1789636302.775211 trunc from 0x021da0 to 0x03fb17 (0x1dd78 bytes) 000512 1789636302.814221 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3fb18): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb18): Mirror 2: 0xd2d05dd (stale) Mirror 3: 0xd2d05dd (stale) Mirror 4: 0xd2d05dd (stale) Mirror 5: 0xd2d05dd (stale) CRC-32 checksum value for chunk [0, 0x3fb18): Mirror 1: 0xb6482f1d Mirror 6: 0xb6482f1d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb18: skipped 000513 1789636303.771227 mapread 0x00382b thru 0x00bb36 (0x830c bytes) 000515 1789636303.802235 read 0x02af3d thru 0x033cb2 (0x8d76 bytes) 000516 1789636303.815024 punch from 0x03ab32 to 0x03fb17 (0x4fe6 bytes) 000517 1789636303.890157 mapwrite 0x0368ae thru 0x03d7ff (0x6f52 bytes) 000518 1789636303.946307 mapwrite 0x02f8de thru 0x03539d (0x5ac0 bytes) 000520 1789636303.988756 mapread 0x006fd8 thru 0x013d80 (0xcda9 bytes) 000522 1789636304.009684 write 0x028556 thru 0x032f77 (0xaa22 bytes) 000523 1789636304.017414 mapread 0x000091 thru 0x00d536 (0xd4a6 bytes) 000525 1789636304.031065 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fb18): Mirror 2: 0xd2d05dd (stale) Mirror 3: 0xd2d05dd (stale) Mirror 4: 0xd2d05dd (stale) Mirror 6: 0xb6482f1d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb18): Mirror 2: 0xd2d05dd (stale) Mirror 3: 0xd2d05dd (stale) Mirror 4: 0xd2d05dd (stale) Mirror 6: 0xb6482f1d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb18: skipped 000526 1789636304.449335 mapread 0x02c13b thru 0x02d88c (0x1752 bytes) 000528 1789636304.466645 read 0x01d1a6 thru 0x01d4c8 (0x323 bytes) 000529 1789636304.473675 mapwrite 0x01e793 thru 0x02b3a9 (0xcc17 bytes) 000531 1789636304.541087 mapwrite 0x002878 thru 0x005dce (0x3557 bytes) 000532 1789636304.615007 trunc from 0x03fb18 to 0x039987 (0x6190 bytes) 000533 1789636304.636154 punch from 0x01b5a5 to 0x01f6fe (0x415a bytes) 000534 1789636304.640973 trunc from 0x039988 to 0x02b548 (0xe43f bytes) 000536 1789636304.662896 write 0x012697 thru 0x0222f7 (0xfc61 bytes) 000537 1789636304.669866 mapwrite 0x0299cf thru 0x03183e (0x7e70 bytes) 000538 1789636304.728334 write 0x014ae0 thru 0x01fd97 (0xb2b8 bytes) 000539 1789636304.737119 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3183f): Mirror 3: 0x5ac68332 (stale) Mirror 4: 0x5ac68332 (stale) Mirror 6: 0x7f603409 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3183f): Mirror 3: 0x5ac68332 (stale) Mirror 4: 0x5ac68332 (stale) Mirror 6: 0x7f603409 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3183f: skipped 000540 1789636305.097562 trunc from 0x03183f to 0x0032a6 (0x2e598 bytes) 000541 1789636305.118854 mapwrite 0x0095b1 thru 0x00bfbd (0x2a0d bytes) 000543 1789636305.176001 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xbfbe): Mirror 3: 0x159c9da8 (stale) Mirror 4: 0x159c9da8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbfbe): Mirror 3: 0x159c9da8 (stale) Mirror 4: 0x159c9da8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbfbe: skipped 000544 1789636305.511833 mapread 0x0059a2 thru 0x00bfbd (0x661c bytes) 000547 1789636305.529788 read 0x0091b1 thru 0x00ad88 (0x1bd8 bytes) 000548 1789636305.530509 punch from 0x004d10 to 0x00bfbd (0x72ae bytes) 000550 1789636305.550088 trunc from 0x00bfbe to 0x009984 (0x2639 bytes) 000551 1789636305.572029 mapwrite 0x002001 thru 0x00d3d0 (0xb3d0 bytes) 000553 1789636305.646523 punch from 0x006651 to 0x00d3d0 (0x6d80 bytes) 000554 1789636305.651606 read 0x001feb thru 0x002a19 (0xa2f bytes) 000555 1789636305.652209 mapread 0x00a9b7 thru 0x00d3d0 (0x2a1a bytes) 000556 1789636305.660684 mapwrite 0x02291a thru 0x02b909 (0x8ff0 bytes) 000557 1789636305.719450 write 0x003a4e thru 0x008922 (0x4ed5 bytes) 000558 1789636305.720547 mapwrite 0x006fc4 thru 0x00a99c (0x39d9 bytes) 000560 1789636305.780475 read 0x009da4 thru 0x0197a0 (0xf9fd bytes) 000561 1789636305.780954 mapwrite 0x01b874 thru 0x0277db (0xbf68 bytes) 000562 1789636305.834004 read 0x00a800 thru 0x00fa66 (0x5267 bytes) 000563 1789636305.834705 mapwrite 0x02b7f4 thru 0x035956 (0xa163 bytes) 000565 1789636305.930490 mapread 0x024ae1 thru 0x0322a8 (0xd7c8 bytes) 000567 1789636305.945799 MIRROR_RESYNC 3 mirrors 000568 1789636307.020113 mapwrite 0x02d1b9 thru 0x039a63 (0xc8ab bytes) 000569 1789636307.144731 write 0x012bbf thru 0x01856e (0x59b0 bytes) 000571 1789636307.162023 mapread 0x007491 thru 0x00c6eb (0x525b bytes) 000574 1789636307.189508 MIRROR_RESYNC 3 mirrors 000575 1789636308.338761 mapwrite 0x02ed33 thru 0x03e2b0 (0xf57e bytes) 000577 1789636308.548466 mapread 0x00ae55 thru 0x0193e5 (0xe591 bytes) 000578 1789636308.572595 trunc from 0x03e2b1 to 0x03e68f (0x3df bytes) 000579 1789636308.598314 mapwrite 0x016090 thru 0x02236e (0xc2df bytes) 000580 1789636308.660920 punch from 0x019099 to 0x023326 (0xa28e bytes) 000581 1789636308.666164 read 0x03d607 thru 0x03e68f (0x1089 bytes) 000582 1789636308.668750 mapread 0x01d6ce thru 0x029b4a (0xc47d bytes) 000583 1789636308.699158 trunc from 0x03e690 to 0x00f6bc (0x2efd3 bytes) 000584 1789636308.747256 punch from 0x0014a9 to 0x004d87 (0x38df bytes) 000585 1789636308.757663 read 0x00ebd1 thru 0x00f6bc (0xaec bytes) 000586 1789636308.759817 trunc from 0x00f6bd to 0x00bb5e (0x3b5e bytes) 000587 1789636308.806800 mapwrite 0x011111 thru 0x01ac49 (0x9b39 bytes) 000588 1789636308.936574 mapwrite 0x01afbe thru 0x022cd8 (0x7d1b bytes) 000591 1789636309.019780 mapwrite 0x02fd9b thru 0x033b3b (0x3da1 bytes) 000594 1789636309.104299 punch from 0x01bacc to 0x02902a (0xd55f bytes) 000596 1789636309.114271 read 0x02aca6 thru 0x033b3b (0x8e96 bytes) 000597 1789636309.116537 punch from 0x00ee08 to 0x00f2b7 (0x4b0 bytes) 000599 1789636309.151102 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x33b3c): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33b3c): Mirror 3: 0x7237be83 (stale) Mirror 4: 0x7237be83 (stale) CRC-32 checksum value for chunk [0, 0x33b3c): Mirror 1: 0x9c6d8df9 Mirror 5: 0x9c6d8df9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33b3c: skipped 000601 1789636310.392730 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x33b3c): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33b3c): Mirror 3: 0x7237be83 (stale) Mirror 4: 0x7237be83 (stale) CRC-32 checksum value for chunk [0, 0x33b3c): Mirror 1: 0x9c6d8df9 Mirror 5: 0x9c6d8df9 Mirror 6: 0x9c6d8df9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33b3c: skipped 000602 1789636311.652611 read 0x033355 thru 0x033b3b (0x7e7 bytes) 000603 1789636311.664567 mapread 0x0018d2 thru 0x00fa49 (0xe178 bytes) 000604 1789636311.710187 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33b3c): Mirror 4: 0x7237be83 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33b3c): Mirror 4: 0x7237be83 (stale) CRC-32 checksum value for chunk [0, 0x33b3c): Mirror 1: 0x9c6d8df9 Mirror 5: 0x9c6d8df9 Mirror 6: 0x9c6d8df9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33b3c: skipped 000606 1789636312.234875 write 0x00e884 thru 0x00ea17 (0x194 bytes) 000607 1789636312.329520 MIRROR_RESYNC 4 mirrors 000608 1789636314.180852 mapwrite 0x031ae2 thru 0x039140 (0x765f bytes) 000609 1789636314.319610 punch from 0x02584a to 0x027856 (0x200d bytes) 000610 1789636314.330679 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x39141): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39141): Mirror 4: 0xd05f52a3 (stale) Mirror 5: 0xd05f52a3 (stale) Mirror 6: 0xd05f52a3 (stale) CRC-32 checksum value for chunk [0, 0x39141): Mirror 1: 0x404a5557 Mirror 7: 0x404a5557 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39141: skipped 000611 1789636315.448105 write 0x00da2e thru 0x017ea1 (0xa474 bytes) 000612 1789636315.578606 trunc from 0x039141 to 0x0297b0 (0xf990 bytes) 000613 1789636315.629333 mapwrite 0x022228 thru 0x02dffb (0xbdd4 bytes) 000615 1789636315.738900 mapread 0x01cd8e thru 0x01d123 (0x396 bytes) 000619 1789636315.747921 mapwrite 0x01f9df thru 0x0219b5 (0x1fd7 bytes) 000620 1789636315.791721 punch from 0x027eee to 0x02dffb (0x610e bytes) 000621 1789636315.810167 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2dffc): Mirror 4: 0x4d507704 (stale) Mirror 6: 0x4d507704 (stale) Mirror 7: 0x4d507704 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dffc): Mirror 4: 0x4d507704 (stale) Mirror 6: 0x4d507704 (stale) Mirror 7: 0x4d507704 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dffc: skipped 000622 1789636316.180720 read 0x01857f thru 0x024783 (0xc205 bytes) 000623 1789636316.194803 trunc from 0x02dffc to 0x01b852 (0x127a9 bytes) 000624 1789636316.223486 trunc from 0x01b853 to 0x028de9 (0xd597 bytes) 000625 1789636316.251146 mapwrite 0x00f6e8 thru 0x012d3f (0x3658 bytes) 000626 1789636316.374012 MIRROR_RESYNC 4 mirrors 000629 1789636317.874204 read 0x00bc6c thru 0x012baf (0x6f44 bytes) 000631 1789636317.884658 trunc from 0x028dea to 0x00c8c2 (0x1c527 bytes) 000634 1789636317.981445 mapwrite 0x01ca07 thru 0x02c26f (0xf869 bytes) 000636 1789636318.092886 mapread 0x008326 thru 0x00979b (0x1476 bytes) 000637 1789636318.100873 mapwrite 0x004761 thru 0x00f264 (0xab04 bytes) 000639 1789636318.182432 MIRROR_RESYNC 4 mirrors 000640 1789636319.414456 write 0x021c13 thru 0x02cbca (0xafb8 bytes) 000643 1789636319.515577 write 0x00c56c thru 0x018676 (0xc10b bytes) 000644 1789636319.532828 write 0x00e991 thru 0x01e5b9 (0xfc29 bytes) 000646 1789636319.541387 write 0x000f51 thru 0x000f60 (0x10 bytes) 000647 1789636319.549094 trunc from 0x02cbcb to 0x02401b (0x8baf bytes) 000648 1789636319.579807 write 0x00dbef thru 0x01559a (0x79ac bytes) 000649 1789636319.587890 punch from 0x011f7c to 0x0186f9 (0x677e bytes) 000650 1789636319.631066 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2401c): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2401c): Mirror 4: 0x341a9586 (stale) Mirror 6: 0x341a9586 (stale) Mirror 7: 0x341a9586 (stale) CRC-32 checksum value for chunk [0, 0x2401c): Mirror 1: 0xcc4b2af4 Mirror 8: 0xcc4b2af4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2401c: skipped 000653 1789636320.925007 punch from 0x01381c to 0x021cc7 (0xe4ac bytes) 000654 1789636321.075745 write 0x03754e thru 0x038e1c (0x18cf bytes) 000656 1789636321.079724 read 0x028029 thru 0x02d249 (0x5221 bytes) 000658 1789636321.090535 mapwrite 0x02e7e6 thru 0x0375f2 (0x8e0d bytes) 000660 1789636321.143822 MIRROR_RESYNC 5 mirrors 000662 1789636323.341766 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) 000664 1789636323.722550 mapwrite 0x01a14c thru 0x01d379 (0x322e bytes) 000665 1789636323.900101 write 0x003d5d thru 0x007f76 (0x421a bytes) 000666 1789636323.910865 mapwrite 0x00c85b thru 0x01518b (0x8931 bytes) 000668 1789636323.976854 mapread 0x036531 thru 0x038e1c (0x28ec bytes) 000669 1789636323.985084 read 0x031f26 thru 0x038e1c (0x6ef7 bytes) 000670 1789636323.985748 punch from 0x02693e to 0x03161f (0xace2 bytes) 000671 1789636323.990908 trunc from 0x038e1d to 0x01a82b (0x1e5f1 bytes) 000672 1789636324.011832 read 0x007db9 thru 0x009400 (0x1648 bytes) 000673 1789636324.012549 punch from 0x017d13 to 0x01a82b (0x2b19 bytes) 000674 1789636324.023317 MIRROR_RESYNC 4 mirrors 000675 1789636325.222224 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) 000676 1789636325.503813 trunc from 0x01a82c to 0x0222d9 (0x7aae bytes) 000677 1789636325.590883 mapread 0x009f56 thru 0x00e814 (0x48bf bytes) 000678 1789636325.612349 read 0x018542 thru 0x01fa5c (0x751b bytes) 000679 1789636325.629434 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x222da): Mirror 8: 0xd317b5d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x222da): Mirror 8: 0xd317b5d1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x222da: skipped 000680 1789636325.919898 read 0x00bf2e thru 0x013abc (0x7b8f bytes) 000681 1789636325.927530 mapwrite 0x03012c thru 0x03532f (0x5204 bytes) 000683 1789636326.041171 mapread 0x01495d thru 0x01f555 (0xabf9 bytes) 000684 1789636326.059396 mapread 0x007fee thru 0x00a172 (0x2185 bytes) 000686 1789636326.069947 write 0x03a7f2 thru 0x03ffff (0x580e bytes) 000687 1789636326.076875 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) 000688 1789636326.271401 read 0x02791a thru 0x02e1af (0x6896 bytes) 000689 1789636326.285404 write 0x00407c thru 0x00d8e0 (0x9865 bytes) 000693 1789636326.309918 trunc from 0x040000 to 0x004903 (0x3b6fc bytes) 000694 1789636326.334818 punch from 0x0015f9 to 0x003c92 (0x269a bytes) 000695 1789636326.345214 trunc from 0x004904 to 0x02a2dc (0x259d9 bytes) 000696 1789636326.365224 mapwrite 0x0170c8 thru 0x025540 (0xe479 bytes) 000697 1789636326.445360 write 0x039320 thru 0x03ffff (0x6ce0 bytes) 000699 1789636326.447826 write 0x0030a7 thru 0x01208b (0xefe5 bytes) 000700 1789636326.454925 mapread 0x0153fa thru 0x023770 (0xe377 bytes) 000701 1789636326.456487 punch from 0x003ce7 to 0x0075b6 (0x38d0 bytes) 000703 1789636326.480879 read 0x010f2a thru 0x01bd65 (0xae3c bytes) 000704 1789636326.481781 mapread 0x005e94 thru 0x013f1b (0xe088 bytes) 000705 1789636326.491453 read 0x020d70 thru 0x026a10 (0x5ca1 bytes) 000706 1789636326.492530 mapread 0x0324db thru 0x03c4fa (0xa020 bytes) 000707 1789636326.493817 write 0x00e989 thru 0x01dbd0 (0xf248 bytes) 000709 1789636326.496868 write 0x00a7e2 thru 0x00f973 (0x5192 bytes) 000712 1789636326.500926 punch from 0x01bec4 to 0x02b17b (0xf2b8 bytes) 000715 1789636326.520424 punch from 0x0330fa to 0x03b16a (0x8071 bytes) 000716 1789636326.525994 trunc from 0x040000 to 0x019228 (0x26dd7 bytes) 000717 1789636326.544123 mapread 0x015d08 thru 0x017709 (0x1a02 bytes) 000718 1789636326.545369 trunc from 0x019229 to 0x038e11 (0x1fbe9 bytes) 000719 1789636326.562780 mapwrite 0x024b89 thru 0x028293 (0x370b bytes) 000720 1789636326.631777 mapwrite 0x02a791 thru 0x036351 (0xbbc1 bytes) 000721 1789636326.679093 trunc from 0x038e12 to 0x02917e (0xfc93 bytes) 000722 1789636326.701107 mapread 0x023812 thru 0x02917e (0x596d bytes) 000724 1789636326.704345 punch from 0x0090d2 to 0x009cd8 (0xc07 bytes) 000725 1789636326.710139 write 0x01f067 thru 0x024eba (0x5e54 bytes) 000727 1789636326.713764 read 0x0151a9 thru 0x01da2d (0x8885 bytes) 000728 1789636326.714725 read 0x0205de thru 0x020c92 (0x6b5 bytes) 000729 1789636326.715366 mapwrite 0x003504 thru 0x006b0d (0x360a bytes) 000730 1789636326.769876 write 0x00bff1 thru 0x014734 (0x8744 bytes) 000732 1789636326.773387 read 0x01a76e thru 0x026837 (0xc0ca bytes) 000733 1789636326.774371 mapread 0x00e165 thru 0x014b56 (0x69f2 bytes) 000736 1789636326.777738 read 0x018b88 thru 0x01bd2e (0x31a7 bytes) 000739 1789636326.780458 mapread 0x016275 thru 0x01b958 (0x56e4 bytes) 000742 1789636326.783167 write 0x0063a7 thru 0x00892f (0x2589 bytes) 000743 1789636326.785119 punch from 0x006c2b to 0x00bb79 (0x4f4f bytes) 000747 1789636326.804511 mapread 0x01565d thru 0x017b59 (0x24fd bytes) 000749 1789636326.806500 mapwrite 0x003984 thru 0x010869 (0xcee6 bytes) 000750 1789636326.859741 write 0x024044 thru 0x02c80b (0x87c8 bytes) 000751 1789636326.862091 mapwrite 0x02dc11 thru 0x02efb4 (0x13a4 bytes) 000752 1789636326.925361 write 0x006e6b thru 0x007ebc (0x1052 bytes) 000754 1789636326.926905 punch from 0x00f778 to 0x01be06 (0xc68f bytes) 000755 1789636326.936657 mapread 0x003987 thru 0x00a615 (0x6c8f bytes) 000757 1789636326.939282 mapread 0x0236d6 thru 0x02efb4 (0xb8df bytes) 000759 1789636326.941453 read 0x01ec04 thru 0x024962 (0x5d5f bytes) 000760 1789636326.942835 trunc from 0x02efb5 to 0x03ca65 (0xdab1 bytes) 000761 1789636326.958813 punch from 0x00b51e to 0x016623 (0xb106 bytes) 000763 1789636326.965446 read 0x015386 thru 0x015c05 (0x880 bytes) 000764 1789636326.979094 write 0x02b9b9 thru 0x02d0cf (0x1717 bytes) 000765 1789636326.980172 read 0x01db28 thru 0x02d155 (0xf62e bytes) 000766 1789636326.980802 mapwrite 0x01e432 thru 0x026da8 (0x8977 bytes) 000767 1789636327.032898 write 0x03078d thru 0x0381bf (0x7a33 bytes) 000768 1789636327.038665 MIRROR_EXTEND to 2 mirrors 000769 1789636328.410028 write 0x01b2a2 thru 0x02953a (0xe299 bytes) 000770 1789636328.527969 trunc from 0x03ca66 to 0x002f05 (0x39b60 bytes) 000771 1789636328.555190 write 0x02f6de thru 0x03653d (0x6e60 bytes) 000772 1789636328.560032 write 0x018d88 thru 0x019084 (0x2fd bytes) 000773 1789636328.581931 read 0x005d95 thru 0x010e35 (0xb0a1 bytes) 000774 1789636328.598411 mapwrite 0x0069a7 thru 0x00e1c7 (0x7821 bytes) 000775 1789636328.706873 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3653e): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3653e): Mirror 2: 0xd0705b09 (stale) CRC-32 checksum value for chunk [0, 0x3653e): Mirror 1: 0x39d805ab Mirror 3: 0x39d805ab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3653e: skipped 000776 1789636329.913926 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3653e): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3653e): Mirror 2: 0xd0705b09 (stale) CRC-32 checksum value for chunk [0, 0x3653e): Mirror 1: 0x39d805ab Mirror 3: 0x39d805ab Mirror 4: 0x39d805ab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3653e: skipped 000777 1789636330.689700 punch from 0x00abf3 to 0x015c3d (0xb04b bytes) 000781 1789636330.766451 write 0x018152 thru 0x01aeef (0x2d9e bytes) 000782 1789636330.775673 read 0x017f08 thru 0x0272d5 (0xf3ce bytes) 000783 1789636330.785799 trunc from 0x03653e to 0x02b0f8 (0xb445 bytes) 000784 1789636330.809230 trunc from 0x02b0f9 to 0x006a40 (0x246b8 bytes) 000787 1789636330.820074 mapwrite 0x0331d5 thru 0x0345db (0x1407 bytes) 000788 1789636330.871404 read 0x02f33a thru 0x0345db (0x52a2 bytes) 000793 1789636330.896602 write 0x0191c8 thru 0x01b8bc (0x26f5 bytes) 000795 1789636330.897703 mapwrite 0x01a205 thru 0x02385d (0x9659 bytes) 000796 1789636330.972805 mapread 0x02ce8d thru 0x030c5f (0x3dd3 bytes) 000797 1789636330.982747 MIRROR_RESYNC 4 mirrors 000800 1789636332.307902 mapwrite 0x016e3a thru 0x025008 (0xe1cf bytes) 000801 1789636332.458201 read 0x000014 thru 0x006a93 (0x6a80 bytes) 000802 1789636332.471442 read 0x01bee2 thru 0x027457 (0xb576 bytes) 000803 1789636332.472301 mapread 0x000499 thru 0x003a8e (0x35f6 bytes) 000804 1789636332.473654 mapread 0x028e0f thru 0x032ab9 (0x9cab bytes) 000805 1789636332.481290 read 0x014556 thru 0x01a56f (0x601a bytes) 000806 1789636332.483385 trunc from 0x0345dc to 0x02dcc7 (0x6914 bytes) 000808 1789636332.515368 punch from 0x026610 to 0x02d0cc (0x6abd bytes) 000809 1789636332.522668 mapwrite 0x014ad2 thru 0x01e6cf (0x9bfe bytes) 000811 1789636332.579957 trunc from 0x02dcc8 to 0x01bc1b (0x120ac bytes) 000812 1789636332.594506 read 0x018179 thru 0x01bc1b (0x3aa3 bytes) 000813 1789636332.595292 punch from 0x011d34 to 0x018c5f (0x6f2c bytes) 000815 1789636332.603270 trunc from 0x01bc1c to 0x03e1af (0x22594 bytes) 000816 1789636332.619827 write 0x03bd1b thru 0x03ffff (0x42e5 bytes) 000818 1789636332.637508 read 0x028f4f thru 0x037547 (0xe5f9 bytes) 000820 1789636332.638641 mapread 0x0241e4 thru 0x030644 (0xc461 bytes) 000821 1789636332.642759 write 0x036723 thru 0x03ffff (0x98dd bytes) 000822 1789636332.647202 mapread 0x01a535 thru 0x01f3d5 (0x4ea1 bytes) 000823 1789636332.648148 read 0x032b2d thru 0x03aa28 (0x7efc bytes) 000824 1789636332.649572 read 0x02ad9b thru 0x02d3ae (0x2614 bytes) 000825 1789636332.650207 mapwrite 0x019397 thru 0x0256ba (0xc324 bytes) 000826 1789636332.716148 read 0x02a2d1 thru 0x0363b9 (0xc0e9 bytes) 000827 1789636332.717050 mapwrite 0x0309bc thru 0x0327ed (0x1e32 bytes) 000828 1789636332.755226 mapwrite 0x014c03 thru 0x0158e7 (0xce5 bytes) 000829 1789636332.800689 read 0x0089dd thru 0x00f422 (0x6a46 bytes) 000830 1789636332.801587 trunc from 0x040000 to 0x03e9e9 (0x1616 bytes) 000831 1789636332.819099 mapwrite 0x038713 thru 0x03ffff (0x78ed bytes) 000832 1789636332.887602 mapwrite 0x0248f1 thru 0x0305ca (0xbcda bytes) 000834 1789636332.937300 read 0x00e7fc thru 0x015445 (0x6c4a bytes) 000835 1789636332.938236 mapwrite 0x014dc9 thru 0x019b20 (0x4d58 bytes) 000836 1789636332.986326 trunc from 0x040000 to 0x02ef02 (0x110fd bytes) 000837 1789636333.001140 write 0x02710f thru 0x0297e5 (0x26d7 bytes) 000838 1789636333.002152 write 0x01bb45 thru 0x02a7e2 (0xec9e bytes) 000839 1789636333.003467 punch from 0x00166c to 0x001dfa (0x78f bytes) 000841 1789636333.018404 trunc from 0x02ef03 to 0x00ac14 (0x242ee bytes) 000842 1789636333.045204 punch from 0x009872 to 0x00ac14 (0x13a3 bytes) 000843 1789636333.051306 trunc from 0x00ac15 to 0x01b779 (0x10b65 bytes) 000844 1789636333.072701 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b77a): Mirror 2: 0x26a2d4e3 (stale) Mirror 4: 0x26a2d4e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b77a): Mirror 2: 0x26a2d4e3 (stale) Mirror 4: 0x26a2d4e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b77a: skipped 000845 1789636333.338180 trunc from 0x01b77a to 0x0304ed (0x14d74 bytes) 000846 1789636333.363998 trunc from 0x0304ee to 0x03129e (0xdb1 bytes) 000847 1789636333.390218 mapwrite 0x011589 thru 0x0145e1 (0x3059 bytes) 000849 1789636333.494272 mapwrite 0x035531 thru 0x039c3c (0x470c bytes) 000855 1789636333.575060 trunc from 0x039c3d to 0x01e6c6 (0x1b576 bytes) 000856 1789636333.592321 punch from 0x015e7b to 0x01e6c6 (0x884c bytes) 000857 1789636333.597278 mapwrite 0x0321d8 thru 0x035e81 (0x3caa bytes) 000858 1789636333.670323 mapwrite 0x018fc9 thru 0x027d6f (0xeda7 bytes) 000859 1789636333.743394 punch from 0x011e03 to 0x01f19a (0xd398 bytes) 000860 1789636333.749193 mapwrite 0x028cd3 thru 0x02b617 (0x2945 bytes) 000861 1789636333.837018 mapread 0x017b31 thru 0x01feeb (0x83bb bytes) 000862 1789636333.845640 punch from 0x01a334 to 0x01dc14 (0x38e1 bytes) 000864 1789636333.856756 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35e82): Mirror 4: 0x1b572882 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35e82): Mirror 4: 0x1b572882 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35e82: skipped 000865 1789636334.162132 write 0x00102b thru 0x010f1b (0xfef1 bytes) 000866 1789636334.179903 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) 000867 1789636334.307743 write 0x01873e thru 0x01a172 (0x1a35 bytes) 000868 1789636334.327775 MIRROR_EXTEND to 2 mirrors 000870 1789636335.542556 write 0x03666f thru 0x03ffff (0x9991 bytes) 000871 1789636335.716357 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) 000872 1789636335.869755 mapwrite 0x03a5b8 thru 0x03ffff (0x5a48 bytes) 000874 1789636336.012237 read 0x00e0d9 thru 0x01dd2f (0xfc57 bytes) 000875 1789636336.019658 trunc from 0x040000 to 0x0001db (0x3fe24 bytes) 000876 1789636336.041212 punch from 0x0000b3 to 0x0001db (0x129 bytes) 000877 1789636336.057786 read 0x000112 thru 0x0001db (0xca bytes) 000879 1789636336.067392 mapread 0x000184 thru 0x0001db (0x58 bytes) 000881 1789636336.071026 mapread 0x00008b thru 0x0001db (0x151 bytes) 000882 1789636336.072224 read 0x000089 thru 0x0001db (0x153 bytes) 000883 1789636336.072800 write 0x02b837 thru 0x02baca (0x294 bytes) 000885 1789636336.074458 mapread 0x01cf38 thru 0x01d767 (0x830 bytes) 000886 1789636336.085283 read 0x02923b thru 0x029b6b (0x931 bytes) 000887 1789636336.085993 mapread 0x01671f thru 0x017303 (0xbe5 bytes) 000889 1789636336.093164 read 0x029abc thru 0x02baca (0x200f bytes) 000890 1789636336.093956 trunc from 0x02bacb to 0x01c811 (0xf2b9 bytes) 000891 1789636336.120643 write 0x034627 thru 0x03c148 (0x7b22 bytes) 000893 1789636336.126612 mapread 0x016fc9 thru 0x01e4cd (0x7505 bytes) 000894 1789636336.137959 punch from 0x0277e6 to 0x035c94 (0xe4af bytes) 000895 1789636336.160715 mapwrite 0x017c25 thru 0x01eb0f (0x6eeb bytes) 000897 1789636336.255477 MIRROR_EXTEND to 2 mirrors 000899 1789636337.114996 mapread 0x033723 thru 0x03505c (0x193a bytes) 000901 1789636337.133893 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) 000903 1789636337.231067 punch from 0x007e67 to 0x015ff8 (0xe192 bytes) 000905 1789636337.248953 mapread 0x0035cd thru 0x00749f (0x3ed3 bytes) 000907 1789636337.271129 trunc from 0x03c149 to 0x00d26f (0x2eed9 bytes) 000909 1789636337.311163 write 0x00d2fb thru 0x00e622 (0x1328 bytes) 000911 1789636337.313763 mapwrite 0x033a7a thru 0x03ffff (0xc586 bytes) 000913 1789636337.419570 trunc from 0x040000 to 0x019cbe (0x26341 bytes) 000916 1789636337.449191 read 0x005b1d thru 0x00b2f7 (0x57db bytes) 000917 1789636337.449816 mapwrite 0x028708 thru 0x031b0e (0x9407 bytes) 000918 1789636337.555405 write 0x0356cc thru 0x03ebfe (0x9533 bytes) 000928 1789636337.572388 read 0x01b203 thru 0x01dbca (0x29c8 bytes) 000929 1789636337.591779 mapwrite 0x024b20 thru 0x026dd9 (0x22ba bytes) 000930 1789636337.626856 read 0x036abb thru 0x03ebfe (0x8144 bytes) 000931 1789636337.627594 trunc from 0x03ebff to 0x03d60c (0x15f2 bytes) 000932 1789636337.650337 mapwrite 0x0002ad thru 0x00dedb (0xdc2f bytes) 000933 1789636337.708665 mapread 0x025cab thru 0x02b1f7 (0x554d bytes) 000934 1789636337.709496 punch from 0x03b4e1 to 0x03d60c (0x212c bytes) 000935 1789636337.714497 punch from 0x02d45d to 0x0335bb (0x615f bytes) 000936 1789636337.731075 MIRROR_EXTEND to 2 mirrors 000937 1789636338.811329 mapread 0x017ada thru 0x021d41 (0xa268 bytes) 000938 1789636338.832897 write 0x01423b thru 0x017e24 (0x3bea bytes) 000939 1789636338.911717 mapwrite 0x03cf0e thru 0x03ffff (0x30f2 bytes) 000940 1789636338.978204 trunc from 0x040000 to 0x028b71 (0x1748e bytes) 000941 1789636339.015080 mapread 0x023606 thru 0x028b71 (0x556c bytes) 000942 1789636339.036869 read 0x01ee39 thru 0x021f97 (0x315f bytes) 000944 1789636339.039308 mapwrite 0x0157d8 thru 0x019e80 (0x46a9 bytes) 000945 1789636339.110566 read 0x013803 thru 0x0182c8 (0x4ac6 bytes) 000946 1789636339.111750 mapread 0x01eda7 thru 0x022131 (0x338b bytes) 000947 1789636339.127705 MIRROR_RESYNC 2 mirrors 000948 1789636340.303952 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e9:0x0]: Invalid argument (22) 000951 1789636340.508073 punch from 0x016962 to 0x0238d2 (0xcf71 bytes) 000952 1789636340.526288 trunc from 0x028b72 to 0x0137ac (0x153c5 bytes) 000954 1789636340.587928 mapwrite 0x03360c thru 0x03ffff (0xc9f4 bytes) 000955 1789636340.723163 mapwrite 0x03e118 thru 0x03ffff (0x1ee8 bytes) 000956 1789636340.766465 mapread 0x00a213 thru 0x013b01 (0x98ef bytes) 000957 1789636340.790822 mapwrite 0x02c90c thru 0x03aef0 (0xe5e5 bytes) 000958 1789636340.885477 trunc from 0x040000 to 0x00494c (0x3b6b3 bytes) 000961 1789636340.911437 read 0x00202a thru 0x00494c (0x2923 bytes) 000962 1789636340.918265 punch from 0x000312 to 0x00494c (0x463b bytes) 000965 1789636340.929599 write 0x021e8d thru 0x0266bd (0x4831 bytes) 000968 1789636340.935100 write 0x0220ea thru 0x030cee (0xec05 bytes) 000969 1789636340.936591 mapwrite 0x024820 thru 0x028eb7 (0x4698 bytes) 000970 1789636340.997943 trunc from 0x030cef to 0x0100f5 (0x20bf9 bytes) 000971 1789636341.012493 punch from 0x00c151 to 0x0100f5 (0x3fa5 bytes) 000972 1789636341.020964 write 0x0251ed thru 0x02b0f3 (0x5f07 bytes) 000974 1789636341.026025 write 0x021b2d thru 0x02474c (0x2c20 bytes) 000978 1789636341.054019 read 0x02506b thru 0x0271fa (0x2190 bytes) 000979 1789636341.054610 mapwrite 0x001d31 thru 0x00baf9 (0x9dc9 bytes) 000980 1789636341.157049 read 0x005867 thru 0x00d8fb (0x8095 bytes) 000981 1789636341.159871 mapread 0x019927 thru 0x01f68a (0x5d64 bytes) 000985 1789636341.166439 write 0x008b12 thru 0x012cf2 (0xa1e1 bytes) 000986 1789636341.182506 MIRROR_EXTEND to 2 mirrors 000987 1789636342.167308 trunc from 0x02b0f4 to 0x023794 (0x795f bytes) 000988 1789636342.314185 read 0x007833 thru 0x00daed (0x62bb bytes) 000989 1789636342.326323 mapwrite 0x0346c7 thru 0x03ffff (0xb939 bytes) 000990 1789636342.478635 write 0x026e73 thru 0x02df0a (0x7098 bytes) 000992 1789636342.488196 read 0x021f53 thru 0x0260d1 (0x417f bytes) 000993 1789636342.505550 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2551e95 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x30237d33 Mirror 3: 0x30237d33 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000994 1789636343.589984 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2551e95 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x30237d33 Mirror 3: 0x30237d33 Mirror 4: 0x30237d33 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000995 1789636344.406112 mapwrite 0x00daa4 thru 0x013d39 (0x6296 bytes) 000996 1789636344.618122 mapwrite 0x016018 thru 0x01afda (0x4fc3 bytes) 000997 1789636344.746910 punch from 0x0108e7 to 0x01492e (0x4048 bytes) 000999 1789636344.760084 mapread 0x02e280 thru 0x02ecdc (0xa5d bytes) All operations completed A-OK!