== sanity-flr test 70a: flr mode fsx test ================ 04:34:50 (1769074490) Seed set to 4492 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x2435b 000001 1769074493.312332 trunc from 00000000 to 0x02435a (0x2435b bytes) 000003 1769074493.341361 write 0x034df9 thru 0x037de2 (0x2fea bytes) 000005 1769074493.348476 read 0x010893 thru 0x0121e7 (0x1955 bytes) 000006 1769074493.356660 mapread 0x0153e9 thru 0x016585 (0x119d bytes) 000007 1769074493.379397 read 0x0345d3 thru 0x037de2 (0x3810 bytes) 000009 1769074493.381491 write 0x0129c0 thru 0x021df4 (0xf435 bytes) 000010 1769074493.399528 read 0x00972b thru 0x00de51 (0x4727 bytes) 000014 1769074493.403445 read 0x00b9da thru 0x00bc32 (0x259 bytes) 000016 1769074493.404830 trunc from 0x037de3 to 0x01d3ad (0x1aa35 bytes) 000017 1769074493.436006 mapwrite 0x0144da thru 0x018514 (0x403b bytes) 000019 1769074493.627149 MIRROR_EXTEND to 2 mirrors 000021 1769074494.933504 mapwrite 0x038297 thru 0x03ffff (0x7d69 bytes) 000022 1769074495.262310 trunc from 0x040000 to 0x020ad1 (0x1f52e bytes) 000023 1769074495.321480 write 0x03b252 thru 0x03e755 (0x3504 bytes) 000027 1769074495.345265 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000030 1769074495.691069 trunc from 0x03e756 to 0x00d28a (0x314cb bytes) 000031 1769074495.715682 read 0x006d32 thru 0x00d28a (0x6559 bytes) 000032 1769074495.726612 mapread 0x003ecc thru 0x00d28a (0x93bf bytes) 000034 1769074495.750576 read 0x005541 thru 0x00d28a (0x7d4a bytes) 000035 1769074495.751460 mapread 0x003fd1 thru 0x009906 (0x5936 bytes) 000037 1769074495.757013 write 0x011894 thru 0x01f327 (0xda94 bytes) 000038 1769074495.758689 read 0x000107 thru 0x007510 (0x740a bytes) 000039 1769074495.769297 read 0x0027fc thru 0x0077a7 (0x4fac bytes) 000040 1769074495.770497 mapwrite 0x03c073 thru 0x03ffff (0x3f8d bytes) 000041 1769074495.889478 trunc from 0x040000 to 0x0059ee (0x3a611 bytes) 000042 1769074495.919577 mapread 0x00041c thru 0x0059ee (0x55d3 bytes) 000044 1769074495.931635 MIRROR_EXTEND to 2 mirrors 000047 1769074496.826133 mapwrite 0x01d068 thru 0x02ba23 (0xe9bc bytes) 000050 1769074497.187307 trunc from 0x02ba24 to 0x0051f6 (0x2682d bytes) 000051 1769074497.231137 mapwrite 0x0198b1 thru 0x02124e (0x799e bytes) 000052 1769074497.411646 write 0x003b22 thru 0x00aec1 (0x73a0 bytes) 000053 1769074497.428577 write 0x023c0f thru 0x02a630 (0x6a22 bytes) 000054 1769074497.430641 read 0x015fc7 thru 0x022568 (0xc5a2 bytes) 000055 1769074497.442112 MIRROR_RESYNC 2 mirrors 000057 1769074498.799997 mapwrite 0x0195de thru 0x0254b3 (0xbed6 bytes) 000058 1769074499.068377 MIRROR_RESYNC 2 mirrors truncating to largest ever: 0x35e02 000059 1769074500.149680 trunc from 0x02a631 to 0x035e01 (0xb7d1 bytes) 000060 1769074500.303247 read 0x033a45 thru 0x035e01 (0x23bd bytes) 000061 1769074500.311965 write 0x000f12 thru 0x00f57a (0xe669 bytes) 000063 1769074500.327603 write 0x03fc39 thru 0x03ffff (0x3c7 bytes) 000064 1769074500.333311 MIRROR_RESYNC 2 mirrors 000065 1769074501.549139 mapread 0x03b221 thru 0x03ffff (0x4ddf bytes) 000066 1769074501.625642 mapwrite 0x02994f thru 0x02dbd1 (0x4283 bytes) 000067 1769074501.887448 mapread 0x00e3b0 thru 0x01e100 (0xfd51 bytes) 000068 1769074501.921751 trunc from 0x040000 to 0x01f5ff (0x20a00 bytes) 000069 1769074502.006450 mapread 0x00cd54 thru 0x00fd58 (0x3005 bytes) 000070 1769074502.014514 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1f600): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f600): Mirror 2: 0x1dbf5191 (stale) CRC-32 checksum value for chunk [0, 0x1f600): Mirror 1: 0x1dbf5191 Mirror 3: 0x1dbf5191 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f600: skipped 000071 1769074503.598465 read 0x0125b0 thru 0x01949e (0x6eef bytes) 000077 1769074503.679765 read 0x002319 thru 0x0110c5 (0xedad bytes) 000078 1769074503.708759 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f600): Mirror 2: 0x1dbf5191 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f600): Mirror 2: 0x1dbf5191 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f600: skipped 000080 1769074504.071481 read 0x005023 thru 0x0128fd (0xd8db bytes) 000082 1769074504.103589 MIRROR_RESYNC 2 mirrors 000084 1769074504.988003 write 0x02dcd3 thru 0x0353ac (0x76da bytes) 000086 1769074505.149478 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x353ad): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x353ad): Mirror 2: 0x23b3448a (stale) CRC-32 checksum value for chunk [0, 0x353ad): Mirror 1: 0xc841e3a6 Mirror 3: 0xc841e3a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x353ad: skipped 000087 1769074506.570066 mapwrite 0x00fe80 thru 0x01e923 (0xeaa4 bytes) 000090 1769074506.869221 mapwrite 0x002e35 thru 0x00a593 (0x775f bytes) 000092 1769074506.948015 trunc from 0x0353ad to 0x016c83 (0x1e729 bytes) 000093 1769074506.998825 trunc from 0x016c84 to 0x01d556 (0x68d3 bytes) 000094 1769074507.028562 read 0x0178eb thru 0x01d556 (0x5c6c bytes) 000095 1769074507.054767 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d557): Mirror 2: 0x707a3c6a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d557): Mirror 2: 0x707a3c6a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d557: skipped 000096 1769074507.556226 MIRROR_RESYNC 2 mirrors 000097 1769074508.544645 write 0x015af0 thru 0x0204a2 (0xa9b3 bytes) 000099 1769074508.708333 mapread 0x01c676 thru 0x0204a2 (0x3e2d bytes) 000102 1769074508.711569 mapwrite 0x03993b thru 0x03ffff (0x66c5 bytes) 000103 1769074508.838924 write 0x02aa3e thru 0x02deea (0x34ad bytes) 000104 1769074508.855039 MIRROR_RESYNC 2 mirrors 000108 1769074510.000543 write 0x016c76 thru 0x0170ea (0x475 bytes) 000109 1769074510.167525 read 0x017e92 thru 0x022791 (0xa900 bytes) 000111 1769074510.178715 read 0x001c89 thru 0x010eeb (0xf263 bytes) 000113 1769074510.209279 mapread 0x0003f9 thru 0x00cd4e (0xc956 bytes) 000114 1769074510.211234 mapread 0x015a20 thru 0x01cdd2 (0x73b3 bytes) 000115 1769074510.230518 MIRROR_RESYNC 2 mirrors 000116 1769074511.109234 mapwrite 0x02a462 thru 0x037905 (0xd4a4 bytes) 000117 1769074511.372269 write 0x03b08e thru 0x03ffff (0x4f72 bytes) 000122 1769074511.377693 mapwrite 0x0373eb thru 0x03ffff (0x8c15 bytes) 000124 1769074511.455862 write 0x001c9f thru 0x011ae1 (0xfe43 bytes) 000125 1769074511.485070 read 0x012356 thru 0x0139cb (0x1676 bytes) 000127 1769074511.515113 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2eed4da (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xafc9eba0 Mirror 3: 0xafc9eba0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000128 1769074512.776468 MIRROR_RESYNC 3 mirrors 000129 1769074513.372015 mapread 0x0133b0 thru 0x0210c2 (0xdd13 bytes) 000130 1769074513.401821 mapread 0x00f4ff thru 0x01dd44 (0xe846 bytes) 000131 1769074513.402446 read 0x0082a7 thru 0x0135ff (0xb359 bytes) 000137 1769074513.412326 mapread 0x01b2fe thru 0x01c7dc (0x14df bytes) 000138 1769074513.418243 MIRROR_RESYNC 3 mirrors 000139 1769074513.812643 read 0x02b7e2 thru 0x0315ae (0x5dcd bytes) 000141 1769074513.824086 write 0x011c2f thru 0x01649b (0x486d bytes) 000142 1769074513.950163 read 0x003cd3 thru 0x008034 (0x4362 bytes) 000144 1769074513.967345 read 0x016d21 thru 0x021e2f (0xb10f bytes) 000145 1769074513.968119 mapwrite 0x02ab59 thru 0x02cacc (0x1f74 bytes) 000146 1769074514.077631 mapwrite 0x00dc76 thru 0x01027a (0x2605 bytes) 000147 1769074514.161941 read 0x03f24d thru 0x03ffff (0xdb3 bytes) 000148 1769074514.163108 mapread 0x01834b thru 0x0187f5 (0x4ab bytes) 000150 1769074514.175627 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xafc9eba0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xafc9eba0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000151 1769074514.449408 write 0x003b40 thru 0x010c5d (0xd11e bytes) 000154 1769074514.467511 read 0x035def thru 0x03fa5d (0x9c6f bytes) 000155 1769074514.476112 mapwrite 0x01377a thru 0x01a39b (0x6c22 bytes) 000156 1769074514.552229 read 0x02be76 thru 0x03577e (0x9909 bytes) 000157 1769074514.569413 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000158 1769074514.761655 trunc from 0x040000 to 0x0080b3 (0x37f4c bytes) 000159 1769074514.788931 mapwrite 0x0028b2 thru 0x004179 (0x18c8 bytes) 000160 1769074514.901452 trunc from 0x0080b4 to 0x0293f4 (0x21341 bytes) 000162 1769074514.931707 mapread 0x016c34 thru 0x0233e7 (0xc7b4 bytes) 000168 1769074514.972066 mapwrite 0x018a30 thru 0x01cdf5 (0x43c6 bytes) 000176 1769074515.043461 trunc from 0x0293f5 to 0x03216f (0x8d7b bytes) 000177 1769074515.067055 trunc from 0x032170 to 0x02d820 (0x494f bytes) 000180 1769074515.097117 mapread 0x0098a7 thru 0x009fd0 (0x72a bytes) 000181 1769074515.107377 mapread 0x00aa84 thru 0x013190 (0x870d bytes) 000184 1769074515.110495 write 0x018103 thru 0x024ef0 (0xcdee bytes) 000185 1769074515.112159 write 0x02e6cc thru 0x036297 (0x7bcc bytes) 000186 1769074515.139472 MIRROR_EXTEND to 2 mirrors 000189 1769074516.034374 trunc from 0x036298 to 0x035643 (0xc54 bytes) 000190 1769074516.175644 write 0x036f16 thru 0x03f69a (0x8785 bytes) 000191 1769074516.177018 read 0x0089c7 thru 0x016333 (0xd96d bytes) 000192 1769074516.187147 write 0x035194 thru 0x03ffff (0xae6c bytes) 000193 1769074516.194125 mapread 0x02f078 thru 0x02fe93 (0xe1c bytes) 000194 1769074516.200012 read 0x01bb47 thru 0x027e7a (0xc334 bytes) 000196 1769074516.212496 read 0x023894 thru 0x0276b2 (0x3e1f bytes) 000198 1769074516.215191 read 0x00a69b thru 0x0118fd (0x7263 bytes) 000199 1769074516.215875 write 0x036d46 thru 0x03d7d2 (0x6a8d bytes) 000200 1769074516.217311 trunc from 0x040000 to 0x0179f7 (0x28608 bytes) 000202 1769074516.248888 read 0x00110a thru 0x0034a2 (0x2399 bytes) 000204 1769074516.251205 mapwrite 0x0162da thru 0x0164e7 (0x20e bytes) 000205 1769074516.307103 read 0x00d322 thru 0x0179f7 (0xa6d6 bytes) 000206 1769074516.307743 trunc from 0x0179f8 to 0x01ba25 (0x402e bytes) 000207 1769074516.333188 write 0x027c58 thru 0x0306d3 (0x8a7c bytes) 000208 1769074516.336217 trunc from 0x0306d4 to 0x021d2e (0xe9a5 bytes) 000209 1769074516.357188 mapread 0x011702 thru 0x019ca5 (0x85a4 bytes) 000210 1769074516.367186 read 0x0085a8 thru 0x0173c1 (0xee1a bytes) 000212 1769074516.368517 write 0x01a34d thru 0x021ee5 (0x7b99 bytes) 000215 1769074516.376765 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000216 1769074516.528585 trunc from 0x021ee6 to 0x0356e4 (0x137ff bytes) 000218 1769074516.546757 mapwrite 0x0217d7 thru 0x02350d (0x1d37 bytes) 000219 1769074516.635741 read 0x005b53 thru 0x0139bf (0xde6d bytes) 000220 1769074516.648019 mapwrite 0x010f80 thru 0x01a58e (0x960f bytes) 000221 1769074516.736078 mapread 0x02d881 thru 0x032430 (0x4bb0 bytes) 000223 1769074516.756376 write 0x0350c2 thru 0x03cbe6 (0x7b25 bytes) 000226 1769074516.765947 MIRROR_EXTEND to 2 mirrors 000227 1769074517.978223 mapread 0x011d6b thru 0x01c864 (0xaafa bytes) 000228 1769074518.030993 write 0x019b6a thru 0x020fd4 (0x746b bytes) 000229 1769074518.198675 mapwrite 0x03ac10 thru 0x03ffff (0x53f0 bytes) 000232 1769074518.349362 mapwrite 0x0009ee thru 0x0065f2 (0x5c05 bytes) 000233 1769074518.430055 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xcee04162 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x70aa0a6a Mirror 3: 0x70aa0a6a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000235 1769074519.514423 read 0x039361 thru 0x03bb04 (0x27a4 bytes) 000236 1769074519.530771 mapread 0x0358b5 thru 0x039ae7 (0x4233 bytes) 000237 1769074519.611424 trunc from 0x040000 to 0x007e1c (0x381e3 bytes) 000239 1769074519.838245 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x7e1d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7e1d): Mirror 2: 0xa43c037c (stale) Mirror 3: 0x7a403e50 (stale) CRC-32 checksum value for chunk [0, 0x7e1d): Mirror 1: 0x7a403e50 Mirror 4: 0x7a403e50 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7e1d: skipped 000240 1769074521.053295 trunc from 0x007e1d to 0x031413 (0x295f7 bytes) 000243 1769074521.159253 mapwrite 0x02dcf0 thru 0x0332b5 (0x55c6 bytes) 000245 1769074521.277258 trunc from 0x0332b6 to 0x02224e (0x11067 bytes) 000246 1769074521.304015 write 0x03635f thru 0x03ffff (0x9ca1 bytes) 000247 1769074521.313562 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xcee04162 (stale) Mirror 3: 0x70aa0a6a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xcee04162 (stale) Mirror 3: 0x70aa0a6a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000248 1769074521.708540 write 0x02016f thru 0x023b78 (0x3a0a bytes) 000251 1769074521.725919 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x70aa0a6a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x70aa0a6a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000252 1769074522.103883 read 0x000737 thru 0x00cdcd (0xc697 bytes) 000253 1769074522.128036 mapwrite 0x00c7e3 thru 0x00fb5f (0x337d bytes) 000256 1769074522.227180 mapread 0x018a90 thru 0x022ed6 (0xa447 bytes) 000257 1769074522.251154 write 0x00b858 thru 0x0101fd (0x49a6 bytes) 000259 1769074522.261875 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000260 1769074522.451090 MIRROR_EXTEND to 2 mirrors 000261 1769074523.355296 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000263 1769074523.490875 mapwrite 0x02d4dc thru 0x03af9e (0xdac3 bytes) 000264 1769074523.611538 read 0x004088 thru 0x008974 (0x48ed bytes) 000265 1769074523.622504 read 0x007117 thru 0x007db4 (0xc9e bytes) 000266 1769074523.623165 read 0x033c07 thru 0x036d3e (0x3138 bytes) 000267 1769074523.623650 mapwrite 0x03f267 thru 0x03ffff (0xd99 bytes) 000273 1769074523.676528 read 0x022324 thru 0x023d54 (0x1a31 bytes) truncating to largest ever: 0x3d263 000275 1769074523.688017 trunc from 0x040000 to 0x03d262 (0x2d9d bytes) 000276 1769074523.704709 mapwrite 0x027e81 thru 0x037005 (0xf185 bytes) 000278 1769074523.766235 trunc from 0x03d263 to 0x028906 (0x1495c bytes) 000279 1769074523.788839 mapread 0x003e0e thru 0x004fc6 (0x11b9 bytes) 000280 1769074523.794762 MIRROR_EXTEND to 2 mirrors 000281 1769074524.800281 mapwrite 0x00da23 thru 0x01d0e2 (0xf6c0 bytes) 000283 1769074524.995286 write 0x01b1f4 thru 0x01dc32 (0x2a3f bytes) 000287 1769074524.999294 read 0x023a8b thru 0x028906 (0x4e7c bytes) 000290 1769074525.014505 mapread 0x020fd9 thru 0x028906 (0x792e bytes) 000291 1769074525.035035 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x28907): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28907): Mirror 2: 0xf1a29d4f (stale) CRC-32 checksum value for chunk [0, 0x28907): Mirror 1: 0x713df278 Mirror 3: 0x713df278 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28907: skipped 000292 1769074526.091720 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000294 1769074526.664662 trunc from 0x028907 to 0x0372f4 (0xe9ee bytes) 000295 1769074526.786098 read 0x005a65 thru 0x006bce (0x116a bytes) 000297 1769074526.793402 read 0x00e029 thru 0x01772f (0x9707 bytes) 000298 1769074526.813306 mapread 0x01fb9e thru 0x02b5f3 (0xba56 bytes) 000300 1769074526.816720 write 0x010690 thru 0x0167b3 (0x6124 bytes) 000301 1769074526.819203 mapread 0x012d04 thru 0x0140e4 (0x13e1 bytes) 000302 1769074526.821043 mapwrite 0x0365b0 thru 0x037690 (0x10e1 bytes) 000303 1769074526.904462 trunc from 0x037691 to 0x014b7c (0x22b14 bytes) 000305 1769074526.930239 mapread 0x003f3e thru 0x00acd9 (0x6d9c bytes) 000306 1769074526.932311 write 0x03fe9f thru 0x03ffff (0x161 bytes) 000308 1769074526.950047 trunc from 0x040000 to 0x0232d5 (0x1cd2a bytes) 000309 1769074526.979187 write 0x02bc0d thru 0x031f15 (0x6309 bytes) 000310 1769074526.982119 read 0x01d46e thru 0x0293ed (0xbf80 bytes) 000311 1769074526.998145 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000313 1769074527.253303 mapwrite 0x00afb7 thru 0x013730 (0x877a bytes) 000314 1769074527.459681 read 0x00c04f thru 0x011c88 (0x5c3a bytes) 000315 1769074527.460411 mapwrite 0x02ee12 thru 0x0378cc (0x8abb bytes) 000317 1769074527.806634 MIRROR_EXTEND to 2 mirrors 000319 1769074528.910709 mapwrite 0x00de9a thru 0x01aeea (0xd051 bytes) 000322 1769074529.273167 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000323 1769074529.600498 trunc from 0x0378cd to 0x03c897 (0x4fcb bytes) 000325 1769074529.643932 read 0x031ee6 thru 0x038f14 (0x702f bytes) 000326 1769074529.659287 trunc from 0x03c898 to 0x00a652 (0x32245 bytes) 000327 1769074529.720678 mapread 0x007b64 thru 0x00a652 (0x2aef bytes) 000328 1769074529.775190 trunc from 0x00a653 to 0x02e0bb (0x23a69 bytes) 000330 1769074529.825258 mapread 0x000d49 thru 0x005ee4 (0x519c bytes) 000333 1769074529.884322 trunc from 0x02e0bc to 0x01c6bb (0x11a00 bytes) 000335 1769074529.936130 read 0x0198d8 thru 0x01c6bb (0x2de4 bytes) 000336 1769074529.948672 read 0x007c3c thru 0x01187e (0x9c43 bytes) 000337 1769074529.949643 mapwrite 0x03b11a thru 0x03ffff (0x4ee6 bytes) 000339 1769074530.102435 trunc from 0x040000 to 0x0045af (0x3ba50 bytes) 000340 1769074530.138618 mapread 0x001915 thru 0x0045af (0x2c9b bytes) 000346 1769074530.147833 mapwrite 0x03bbf4 thru 0x03ffff (0x440c bytes) 000347 1769074530.357272 mapwrite 0x032651 thru 0x032c96 (0x646 bytes) 000348 1769074530.505128 read 0x02ab9d thru 0x02c950 (0x1db4 bytes) 000351 1769074530.549035 MIRROR_EXTEND to 2 mirrors 000353 1769074531.797954 mapread 0x000bb4 thru 0x00b506 (0xa953 bytes) 000354 1769074531.845069 mapread 0x000ff8 thru 0x00c9ce (0xb9d7 bytes) 000358 1769074531.848877 write 0x03febf thru 0x03ffff (0x141 bytes) 000359 1769074531.976990 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000360 1769074532.165682 read 0x01c9ea thru 0x01e9e7 (0x1ffe bytes) 000361 1769074532.174701 mapread 0x031b0e thru 0x03ffff (0xe4f2 bytes) 000362 1769074532.209469 mapread 0x01013e thru 0x01fcaf (0xfb72 bytes) 000363 1769074532.232671 read 0x00a784 thru 0x0193a8 (0xec25 bytes) 000364 1769074532.235042 write 0x02fb87 thru 0x0385a0 (0x8a1a bytes) 000366 1769074532.237391 mapread 0x02fcee thru 0x036759 (0x6a6c bytes) 000367 1769074532.239618 mapread 0x023810 thru 0x02cac3 (0x92b4 bytes) 000369 1769074532.258293 read 0x003c77 thru 0x011999 (0xdd23 bytes) 000371 1769074532.266487 trunc from 0x040000 to 0x013b84 (0x2c47b bytes) 000373 1769074532.335430 mapwrite 0x00178c thru 0x00f9c6 (0xe23b bytes) 000374 1769074532.491608 mapwrite 0x039739 thru 0x03ffff (0x68c7 bytes) 000376 1769074532.697447 mapread 0x03c228 thru 0x03ffff (0x3dd8 bytes) 000377 1769074532.699654 mapwrite 0x005f37 thru 0x011a55 (0xbb1f bytes) 000379 1769074532.769152 mapwrite 0x03a4e7 thru 0x03ffff (0x5b19 bytes) 000380 1769074532.861678 mapwrite 0x029b65 thru 0x02b835 (0x1cd1 bytes) 000381 1769074532.930913 trunc from 0x040000 to 0x01b0b0 (0x24f4f bytes) 000383 1769074532.960603 mapwrite 0x01bc9d thru 0x01d6f7 (0x1a5b bytes) truncating to largest ever: 0x3df4b 000384 1769074533.093495 trunc from 0x01d6f8 to 0x03df4a (0x20853 bytes) 000387 1769074533.183531 write 0x024123 thru 0x030ce3 (0xcbc1 bytes) 000391 1769074533.248311 MIRROR_EXTEND to 2 mirrors 000392 1769074534.433739 read 0x01728c thru 0x024f1f (0xdc94 bytes) 000393 1769074534.446394 mapread 0x00df9a thru 0x0141e1 (0x6248 bytes) 000394 1769074534.483175 write 0x02958f thru 0x038631 (0xf0a3 bytes) 000395 1769074534.697734 write 0x01a178 thru 0x020ad8 (0x6961 bytes) 000396 1769074534.731540 read 0x020186 thru 0x02865f (0x84da bytes) 000397 1769074534.732356 mapwrite 0x00e88c thru 0x019e3e (0xb5b3 bytes) 000398 1769074534.958067 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000399 1769074535.190094 write 0x01d390 thru 0x02c683 (0xf2f4 bytes) 000401 1769074535.232954 trunc from 0x03df4b to 0x009d9e (0x341ac bytes) 000402 1769074535.271371 read 0x00676a thru 0x009d9e (0x3635 bytes) 000403 1769074535.283035 mapwrite 0x000c90 thru 0x00bd7a (0xb0eb bytes) 000406 1769074535.405543 mapwrite 0x00218f thru 0x011697 (0xf509 bytes) 000407 1769074535.651308 trunc from 0x011698 to 0x0230bc (0x11a25 bytes) 000410 1769074535.714393 trunc from 0x0230bd to 0x01ec9d (0x441f bytes) 000414 1769074535.788015 MIRROR_EXTEND to 2 mirrors 000415 1769074536.937206 write 0x031552 thru 0x033651 (0x2100 bytes) 000416 1769074537.097997 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000417 1769074537.289434 write 0x01609f thru 0x01f968 (0x98ca bytes) 000419 1769074537.316408 MIRROR_EXTEND to 2 mirrors 000420 1769074537.951675 mapwrite 0x02cad8 thru 0x03c06f (0xf598 bytes) 000421 1769074538.284267 read 0x01d179 thru 0x01f9ba (0x2842 bytes) 000422 1769074538.297356 write 0x01a972 thru 0x01ee8b (0x451a bytes) 000423 1769074538.317601 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000424 1769074538.576257 read 0x02000b thru 0x02bd1f (0xbd15 bytes) 000425 1769074538.592873 mapwrite 0x00cf87 thru 0x01b8e6 (0xe960 bytes) 000430 1769074538.757702 trunc from 0x03c070 to 0x022bbc (0x194b3 bytes) 000431 1769074538.806996 read 0x00b76c thru 0x00edc9 (0x365e bytes) 000437 1769074538.812422 read 0x005975 thru 0x010379 (0xaa05 bytes) 000438 1769074538.845025 write 0x01cea5 thru 0x0233b2 (0x650e bytes) 000441 1769074538.847092 write 0x039100 thru 0x03ffff (0x6f00 bytes) 000442 1769074538.851023 read 0x03b8f5 thru 0x03f589 (0x3c95 bytes) 000446 1769074538.854590 trunc from 0x040000 to 0x010cf5 (0x2f30a bytes) 000448 1769074538.889035 MIRROR_EXTEND to 2 mirrors 000449 1769074539.526017 trunc from 0x010cf6 to 0x0288ee (0x17bf9 bytes) 000453 1769074539.647360 mapwrite 0x00fbba thru 0x0151d8 (0x561f bytes) 000454 1769074539.837640 write 0x006c28 thru 0x01679b (0xfb74 bytes) 000455 1769074539.853536 mapread 0x015051 thru 0x0158aa (0x85a bytes) 000457 1769074539.856529 mapread 0x01eb4b thru 0x0288ee (0x9da4 bytes) 000460 1769074539.884667 mapwrite 0x03bbd4 thru 0x03ffff (0x442c bytes) 000461 1769074540.010695 mapread 0x018d4b thru 0x028507 (0xf7bd bytes) 000462 1769074540.012222 write 0x02e451 thru 0x036f6b (0x8b1b bytes) 000466 1769074540.027237 read 0x02258a thru 0x02f9bf (0xd436 bytes) 000467 1769074540.028751 mapwrite 0x01b24d thru 0x029c3b (0xe9ef bytes) 000468 1769074540.118547 read 0x00f90c thru 0x010132 (0x827 bytes) 000469 1769074540.124394 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000471 1769074540.306756 read 0x01fd23 thru 0x029b3c (0x9e1a bytes) 000472 1769074540.326933 mapread 0x03423d thru 0x036286 (0x204a bytes) 000473 1769074540.357641 MIRROR_EXTEND to 2 mirrors 000475 1769074541.248658 read 0x01ef4e thru 0x022aff (0x3bb2 bytes) 000476 1769074541.258042 mapwrite 0x02125d thru 0x026f24 (0x5cc8 bytes) 000477 1769074541.724943 trunc from 0x040000 to 0x00593b (0x3a6c4 bytes) 000480 1769074541.828877 trunc from 0x00593c to 0x0028f3 (0x3048 bytes) 000482 1769074541.859325 read 0x001ea4 thru 0x0028f3 (0xa50 bytes) 000483 1769074541.884370 read 0x0023ed thru 0x0028f3 (0x507 bytes) 000484 1769074541.885564 trunc from 0x0028f4 to 0x011954 (0xf061 bytes) 000486 1769074541.927886 read 0x007fc9 thru 0x011954 (0x998c bytes) 000491 1769074541.955703 mapwrite 0x00effd thru 0x019615 (0xa619 bytes) 000492 1769074542.182512 trunc from 0x019616 to 0x016e5a (0x27bb bytes) 000495 1769074542.216478 trunc from 0x016e5b to 0x0169ec (0x46e bytes) 000496 1769074542.281034 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000502 1769074542.525189 write 0x022f60 thru 0x027f07 (0x4fa8 bytes) 000503 1769074542.527863 write 0x0246f0 thru 0x02e180 (0x9a91 bytes) 000504 1769074542.531467 trunc from 0x02e181 to 0x012238 (0x1bf48 bytes) 000507 1769074542.554654 write 0x031f5d thru 0x03e499 (0xc53d bytes) 000508 1769074542.558663 trunc from 0x03e49a to 0x01bd07 (0x22792 bytes) 000509 1769074542.583700 trunc from 0x01bd08 to 0x032055 (0x1634e bytes) 000510 1769074542.609079 mapwrite 0x03f5a6 thru 0x03ffff (0xa5a bytes) 000513 1769074542.708298 write 0x01528d thru 0x01561e (0x392 bytes) 000515 1769074542.722001 write 0x00aad0 thru 0x0156d6 (0xac07 bytes) 000517 1769074542.735742 trunc from 0x040000 to 0x0363b3 (0x9c4c bytes) 000518 1769074542.764039 read 0x031479 thru 0x0363b3 (0x4f3b bytes) 000520 1769074542.775654 mapwrite 0x017115 thru 0x01eee2 (0x7dce bytes) 000521 1769074542.872378 trunc from 0x0363b4 to 0x003a00 (0x329b3 bytes) 000522 1769074542.900502 trunc from 0x003a01 to 0x029ae5 (0x260e5 bytes) 000524 1769074542.935183 read 0x025e11 thru 0x028a1a (0x2c0a bytes) 000526 1769074542.955022 mapread 0x013762 thru 0x017a48 (0x42e7 bytes) 000527 1769074542.956547 mapread 0x015ce4 thru 0x01cb86 (0x6ea3 bytes) 000529 1769074542.963769 mapread 0x026c20 thru 0x029ae5 (0x2ec6 bytes) 000531 1769074542.969608 trunc from 0x029ae6 to 0x025e02 (0x3ce3 bytes) 000532 1769074543.038921 MIRROR_EXTEND to 2 mirrors 000533 1769074544.261012 trunc from 0x025e03 to 0x025f85 (0x183 bytes) 000534 1769074544.405223 mapwrite 0x01948d thru 0x01c907 (0x347b bytes) 000536 1769074544.589399 trunc from 0x025f86 to 0x03227f (0xc2fa bytes) 000537 1769074544.642883 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000538 1769074544.894896 write 0x00f6af thru 0x010834 (0x1186 bytes) 000541 1769074544.903002 read 0x001e02 thru 0x00efd5 (0xd1d4 bytes) 000544 1769074544.914908 mapread 0x024740 thru 0x03227f (0xdb40 bytes) 000549 1769074544.933916 mapread 0x02556b thru 0x02a147 (0x4bdd bytes) 000550 1769074544.935677 mapwrite 0x0026bf thru 0x00822e (0x5b70 bytes) 000551 1769074544.988934 mapwrite 0x006048 thru 0x012266 (0xc21f bytes) 000553 1769074545.031909 mapread 0x0192c3 thru 0x01961f (0x35d bytes) 000554 1769074545.033313 read 0x027858 thru 0x02e8a9 (0x7052 bytes) 000555 1769074545.034508 write 0x0092bf thru 0x00a1dd (0xf1f bytes) 000556 1769074545.035881 mapwrite 0x0345c7 thru 0x03ffff (0xba39 bytes) 000558 1769074545.150925 read 0x011aea thru 0x02153d (0xfa54 bytes) 000560 1769074545.152891 read 0x0271c7 thru 0x035a4d (0xe887 bytes) 000563 1769074545.156975 mapwrite 0x004d1b thru 0x00aa61 (0x5d47 bytes) 000564 1769074545.204901 mapwrite 0x01b55c thru 0x028ddc (0xd881 bytes) 000565 1769074545.265006 read 0x006ddb thru 0x015298 (0xe4be bytes) 000566 1769074545.266145 mapwrite 0x001e35 thru 0x004fc4 (0x3190 bytes) 000567 1769074545.368708 trunc from 0x040000 to 0x00e69a (0x31965 bytes) 000568 1769074545.416135 trunc from 0x00e69b to 0x00d0e4 (0x15b6 bytes) 000573 1769074545.491714 trunc from 0x00d0e5 to 0x02ccd5 (0x1fbf1 bytes) 000575 1769074545.554673 trunc from 0x02ccd6 to 0x021b58 (0xb17d bytes) 000579 1769074545.615296 write 0x01348d thru 0x01aae1 (0x7655 bytes) 000580 1769074545.637119 read 0x01ff2e thru 0x021b58 (0x1c2b bytes) 000581 1769074545.638838 mapread 0x01f6c4 thru 0x021b58 (0x2495 bytes) 000582 1769074545.641330 write 0x009c2c thru 0x017dff (0xe1d4 bytes) 000585 1769074545.645447 mapwrite 0x01b9a2 thru 0x0232e8 (0x7947 bytes) 000586 1769074545.742123 write 0x03c2df thru 0x03ffff (0x3d21 bytes) 000587 1769074545.751603 MIRROR_EXTEND to 2 mirrors 000588 1769074546.506095 mapread 0x020868 thru 0x022a9c (0x2235 bytes) 000589 1769074546.530125 write 0x026dbd thru 0x02c277 (0x54bb bytes) 000591 1769074546.642733 mapwrite 0x00a86c thru 0x010434 (0x5bc9 bytes) 000592 1769074546.760278 write 0x0221aa thru 0x0296b8 (0x750f bytes) 000593 1769074546.767715 read 0x02a923 thru 0x0364a4 (0xbb82 bytes) 000594 1769074546.783172 mapread 0x00e4d1 thru 0x0160ff (0x7c2f bytes) 000595 1769074546.800647 mapwrite 0x00da6b thru 0x012705 (0x4c9b bytes) 000596 1769074546.871165 trunc from 0x040000 to 0x0113db (0x2ec24 bytes) 000598 1769074546.905488 write 0x011d68 thru 0x01a31c (0x85b5 bytes) 000600 1769074546.909643 mapwrite 0x019777 thru 0x026d37 (0xd5c1 bytes) 000603 1769074547.016423 trunc from 0x026d38 to 0x0217cf (0x5568 bytes) 000604 1769074547.068002 mapread 0x0106e2 thru 0x01731d (0x6c3c bytes) 000605 1769074547.069172 mapwrite 0x02323f thru 0x02e2c6 (0xb088 bytes) 000608 1769074547.200259 mapwrite 0x017fd7 thru 0x01c2ea (0x4314 bytes) 000612 1769074547.265538 MIRROR_RESYNC 2 mirrors 000613 1769074548.217917 mapread 0x001cc5 thru 0x006d46 (0x5082 bytes) 000616 1769074548.254384 write 0x01a1a1 thru 0x01b23a (0x109a bytes) 000617 1769074548.329331 MIRROR_RESYNC 2 mirrors 000618 1769074549.086513 read 0x016b52 thru 0x018fac (0x245b bytes) 000619 1769074549.093540 write 0x0319f0 thru 0x03bc7f (0xa290 bytes) 000623 1769074549.158685 read 0x008f7f thru 0x00d8b2 (0x4934 bytes) 000625 1769074549.171705 mapread 0x01ba69 thru 0x024b12 (0x90aa bytes) 000626 1769074549.173048 read 0x01e1a9 thru 0x0225b0 (0x4408 bytes) 000627 1769074549.174766 trunc from 0x03bc80 to 0x03a417 (0x1868 bytes) 000629 1769074549.199088 mapread 0x01fd2f thru 0x02cd95 (0xd067 bytes) 000631 1769074549.200718 trunc from 0x03a418 to 0x016be2 (0x23835 bytes) 000633 1769074549.234215 MIRROR_RESYNC 2 mirrors 000635 1769074549.966547 write 0x039586 thru 0x03ffff (0x6a7a bytes) 000637 1769074550.114485 MIRROR_RESYNC 2 mirrors 000638 1769074551.322362 trunc from 0x040000 to 0x02253f (0x1dac0 bytes) 000642 1769074551.555822 read 0x013e8c thru 0x01b063 (0x71d8 bytes) 000644 1769074551.576694 trunc from 0x022540 to 0x01a194 (0x83ab bytes) 000646 1769074551.676878 read 0x0090d7 thru 0x017011 (0xdf3b bytes) 000647 1769074551.709599 read 0x0150b3 thru 0x01a194 (0x50e2 bytes) 000649 1769074551.710824 write 0x00d92c thru 0x01506f (0x7744 bytes) 000650 1769074551.712076 mapread 0x00874b thru 0x0119f5 (0x92ab bytes) 000651 1769074551.723809 mapread 0x00ca81 thru 0x010f7e (0x44fe bytes) 000652 1769074551.728698 trunc from 0x01a195 to 0x021083 (0x6eef bytes) 000655 1769074551.795338 mapread 0x00bf63 thru 0x0159b7 (0x9a55 bytes) 000656 1769074551.803976 trunc from 0x021084 to 0x02aba0 (0x9b1d bytes) 000657 1769074551.831623 mapread 0x026444 thru 0x02aba0 (0x475d bytes) 000658 1769074551.849305 mapwrite 0x03ac71 thru 0x03ffff (0x538f bytes) 000659 1769074551.996365 write 0x02adab thru 0x0334b0 (0x8706 bytes) 000660 1769074551.998607 read 0x03fccb thru 0x03ffff (0x335 bytes) 000661 1769074552.003626 trunc from 0x040000 to 0x00a0d3 (0x35f2c bytes) 000662 1769074552.035529 read 0x0038d4 thru 0x00a0d3 (0x6800 bytes) 000663 1769074552.036323 read 0x0071f4 thru 0x0095da (0x23e7 bytes) 000666 1769074552.053402 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xa0d4): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa0d4): Mirror 2: 0x78f96e30 (stale) CRC-32 checksum value for chunk [0, 0xa0d4): Mirror 1: 0x78f96e30 Mirror 3: 0x78f96e30 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa0d4: skipped 000668 1769074553.057186 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000669 1769074553.510645 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000671 1769074553.930557 MIRROR_EXTEND to 2 mirrors 000672 1769074555.068176 MIRROR_RESYNC 2 mirrors 000673 1769074555.539218 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000677 1769074555.716577 mapread 0x009dd7 thru 0x00a060 (0x28a bytes) 000678 1769074555.736970 mapwrite 0x0248b7 thru 0x03322d (0xe977 bytes) 000684 1769074555.855464 read 0x016f39 thru 0x02048d (0x9555 bytes) 000685 1769074555.865375 mapwrite 0x0124ac thru 0x016ad8 (0x462d bytes) 000686 1769074555.926674 mapwrite 0x019e0c thru 0x01b0f0 (0x12e5 bytes) 000687 1769074555.976353 mapwrite 0x018f5b thru 0x01aca7 (0x1d4d bytes) 000688 1769074556.025194 mapwrite 0x01827c thru 0x01ac6a (0x29ef bytes) 000689 1769074556.074721 trunc from 0x03322e to 0x00da97 (0x25796 bytes) 000691 1769074556.105350 mapread 0x006d6a thru 0x00da97 (0x6d2e bytes) 000694 1769074556.131130 mapread 0x005368 thru 0x00da97 (0x8730 bytes) 000695 1769074556.133310 mapread 0x00aee1 thru 0x00da97 (0x2bb7 bytes) 000696 1769074556.135127 read 0x00a6d3 thru 0x00ab6a (0x498 bytes) 000697 1769074556.137130 mapread 0x002372 thru 0x00c181 (0x9e10 bytes) 000698 1769074556.139350 write 0x02fb28 thru 0x0334ce (0x39a7 bytes) 000699 1769074556.140540 mapread 0x00d4ca thru 0x01d426 (0xff5d bytes) 000700 1769074556.156715 trunc from 0x0334cf to 0x035e03 (0x2935 bytes) 000704 1769074556.187446 read 0x016278 thru 0x01a671 (0x43fa bytes) 000705 1769074556.188442 read 0x0080c7 thru 0x0105b9 (0x84f3 bytes) 000706 1769074556.190204 trunc from 0x035e04 to 0x0163f0 (0x1fa13 bytes) 000708 1769074556.211339 mapread 0x007238 thru 0x008dfd (0x1bc6 bytes) 000709 1769074556.212327 read 0x00fb97 thru 0x0163f0 (0x685a bytes) 000711 1769074556.215504 mapread 0x0017fb thru 0x00c4a0 (0xaca6 bytes) 000712 1769074556.218166 write 0x03e933 thru 0x03eff6 (0x6c4 bytes) 000714 1769074556.221259 read 0x011e98 thru 0x014a48 (0x2bb1 bytes) 000716 1769074556.225504 mapwrite 0x03cb82 thru 0x03ffff (0x347e bytes) 000717 1769074556.324748 mapwrite 0x03cac7 thru 0x03ffff (0x3539 bytes) 000718 1769074556.380571 trunc from 0x040000 to 0x023b16 (0x1c4e9 bytes) 000720 1769074556.415573 read 0x00c38b thru 0x011fa6 (0x5c1c bytes) 000721 1769074556.417751 mapread 0x012702 thru 0x01c674 (0x9f73 bytes) 000722 1769074556.421269 mapread 0x0030b8 thru 0x003fc5 (0xf0e bytes) 000724 1769074556.424724 read 0x0025ca thru 0x00c508 (0x9f3f bytes) 000725 1769074556.426943 trunc from 0x023b17 to 0x00f33e (0x147d8 bytes) 000727 1769074556.461646 mapwrite 0x02c964 thru 0x035dab (0x9448 bytes) 000728 1769074556.567495 MIRROR_EXTEND to 2 mirrors 000730 1769074557.603827 mapread 0x000876 thru 0x00d248 (0xc9d3 bytes) 000732 1769074557.642849 mapread 0x0271e1 thru 0x02bfd4 (0x4df4 bytes) truncating to largest ever: 0x3f3be 000733 1769074557.671045 trunc from 0x035dac to 0x03f3bd (0x9612 bytes) 000735 1769074557.843537 read 0x02bce1 thru 0x030fb5 (0x52d5 bytes) 000736 1769074557.860305 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000739 1769074558.082647 mapwrite 0x011f9b thru 0x015e6b (0x3ed1 bytes) 000740 1769074558.182014 mapread 0x018d8c thru 0x01e131 (0x53a6 bytes) 000741 1769074558.201530 mapwrite 0x016092 thru 0x01f7c1 (0x9730 bytes) 000742 1769074558.347874 mapwrite 0x033302 thru 0x0374c1 (0x41c0 bytes) 000745 1769074558.544488 mapwrite 0x00dfe5 thru 0x0174f4 (0x9510 bytes) 000746 1769074558.698055 read 0x006317 thru 0x00e6dc (0x83c6 bytes) 000747 1769074558.716611 read 0x003a9b thru 0x0042b6 (0x81c bytes) 000748 1769074558.750227 MIRROR_EXTEND to 2 mirrors 000750 1769074559.778233 mapread 0x002eff thru 0x00f327 (0xc429 bytes) 000751 1769074559.801439 read 0x011bb9 thru 0x0188e6 (0x6d2e bytes) 000752 1769074559.809499 trunc from 0x03f3be to 0x013508 (0x2beb5 bytes) 000753 1769074559.917399 mapwrite 0x02a69c thru 0x02bdc9 (0x172e bytes) 000755 1769074560.034296 trunc from 0x02bdca to 0x00e198 (0x1dc31 bytes) 000756 1769074560.069434 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xe199): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe199): Mirror 2: 0xe524769d (stale) CRC-32 checksum value for chunk [0, 0xe199): Mirror 1: 0xe524769d Mirror 3: 0xe524769d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe199: skipped 000758 1769074561.298392 mapwrite 0x012f18 thru 0x02204d (0xf136 bytes) 000759 1769074561.541028 read 0x01d382 thru 0x02204d (0x4ccc bytes) 000760 1769074561.541878 mapwrite 0x016117 thru 0x021a09 (0xb8f3 bytes) 000764 1769074561.631243 mapread 0x0206f8 thru 0x02204d (0x1956 bytes) 000765 1769074561.633250 read 0x017f4e thru 0x019b2f (0x1be2 bytes) 000767 1769074561.641581 write 0x039faa thru 0x03ffff (0x6056 bytes) 000768 1769074561.644244 mapwrite 0x01bbed thru 0x029943 (0xdd57 bytes) 000769 1769074561.746098 trunc from 0x040000 to 0x01aef0 (0x2510f bytes) 000771 1769074561.776000 mapwrite 0x01a19a thru 0x0232a4 (0x910b bytes) 000776 1769074561.940439 trunc from 0x0232a5 to 0x00f0f0 (0x141b4 bytes) 000777 1769074561.980409 read 0x00d605 thru 0x00f0f0 (0x1aec bytes) 000778 1769074561.983585 mapread 0x00e669 thru 0x00f0f0 (0xa88 bytes) 000779 1769074561.996595 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xf0f1): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf0f1): Mirror 2: 0x24d0490a (stale) Mirror 3: 0x39f84d7f (stale) CRC-32 checksum value for chunk [0, 0xf0f1): Mirror 1: 0x39f84d7f Mirror 4: 0x39f84d7f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf0f1: skipped 000780 1769074563.441452 MIRROR_RESYNC 4 mirrors 000785 1769074564.472586 read 0x0066b8 thru 0x00f0f0 (0x8a39 bytes) 000786 1769074564.488667 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000787 1769074565.068325 mapread 0x00eea9 thru 0x00f0f0 (0x248 bytes) 000789 1769074565.085287 mapwrite 0x018dc4 thru 0x0206f5 (0x7932 bytes) 000790 1769074565.397454 mapread 0x00aeb6 thru 0x012946 (0x7a91 bytes) 000793 1769074565.412284 write 0x0195c8 thru 0x0214a3 (0x7edc bytes) 000794 1769074565.414551 trunc from 0x0214a4 to 0x01d2d8 (0x41cb bytes) 000795 1769074565.453100 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1d2d9): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d2d9): Mirror 2: 0xf298cb2e (stale) Mirror 3: 0xf298cb2e (stale) CRC-32 checksum value for chunk [0, 0x1d2d9): Mirror 1: 0xaa9b7584 Mirror 4: 0xaa9b7584 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d2d9: skipped 000797 1769074566.908201 mapread 0x00c30d thru 0x0101a4 (0x3e98 bytes) 000798 1769074566.950004 trunc from 0x01d2d9 to 0x033599 (0x162c1 bytes) 000801 1769074567.115268 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3359a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3359a): Mirror 2: 0xb2545d64 (stale) Mirror 3: 0xb2545d64 (stale) Mirror 4: 0x86e07e (stale) CRC-32 checksum value for chunk [0, 0x3359a): Mirror 1: 0x86e07e Mirror 5: 0x86e07e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3359a: skipped 000807 1769074568.300769 read 0x031fee thru 0x033599 (0x15ac bytes) 000808 1769074568.330248 MIRROR_RESYNC 5 mirrors 000809 1769074569.946036 trunc from 0x03359a to 0x03c083 (0x8aea bytes) 000810 1769074570.160102 mapread 0x016131 thru 0x025ead (0xfd7d bytes) 000811 1769074570.240611 MIRROR_RESYNC 5 mirrors 000812 1769074572.473278 MIRROR_RESYNC 5 mirrors 000813 1769074573.418299 mapwrite 0x02e6e4 thru 0x03a775 (0xc092 bytes) 000815 1769074573.789225 read 0x026b63 thru 0x031965 (0xae03 bytes) 000817 1769074573.803211 write 0x00a6e7 thru 0x018526 (0xde40 bytes) 000819 1769074573.820571 write 0x0199b8 thru 0x01b13e (0x1787 bytes) 000820 1769074573.836227 mapread 0x02a93f thru 0x036358 (0xba1a bytes) 000822 1769074573.838669 write 0x00c10c thru 0x01bba3 (0xfa98 bytes) 000823 1769074573.842587 trunc from 0x03c084 to 0x002117 (0x39f6c bytes) 000824 1769074573.896489 mapread 0x0016b2 thru 0x00196a (0x2b9 bytes) 000825 1769074573.912078 trunc from 0x002118 to 0x02e3ef (0x2c2d8 bytes) 000827 1769074573.936842 mapread 0x0231c3 thru 0x024173 (0xfb1 bytes) 000828 1769074573.951419 mapwrite 0x00ed51 thru 0x01b9c9 (0xcc79 bytes) 000829 1769074574.131946 mapread 0x01f5dc thru 0x02dedd (0xe902 bytes) 000830 1769074574.152262 trunc from 0x02e3f0 to 0x022ba9 (0xb846 bytes) 000831 1769074574.199188 mapread 0x01182d thru 0x012abf (0x1293 bytes) 000832 1769074574.205394 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22baa): Mirror 3: 0x159f855c (stale) Mirror 4: 0x159f855c (stale) Mirror 5: 0x159f855c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22baa): Mirror 3: 0x159f855c (stale) Mirror 4: 0x159f855c (stale) Mirror 5: 0x159f855c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22baa: skipped 000834 1769074574.881521 mapread 0x003b58 thru 0x00fe84 (0xc32d bytes) 000835 1769074574.907079 trunc from 0x022baa to 0x01403d (0xeb6c bytes) 000836 1769074574.942455 mapread 0x00ebdf thru 0x01403d (0x545f bytes) 000837 1769074574.962224 read 0x007794 thru 0x00ddc7 (0x6634 bytes) 000838 1769074574.962999 write 0x011ff0 thru 0x012369 (0x37a bytes) 000842 1769074574.968039 read 0x00a6b6 thru 0x011674 (0x6fbf bytes) 000845 1769074574.969975 write 0x00f179 thru 0x010a72 (0x18fa bytes) 000846 1769074574.971091 mapwrite 0x039cd4 thru 0x03ffff (0x632c bytes) 000847 1769074575.153443 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9764a24c (stale) Mirror 4: 0x9764a24c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9764a24c (stale) Mirror 4: 0x9764a24c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000848 1769074575.896426 write 0x01f70c thru 0x0224ee (0x2de3 bytes) 000851 1769074575.929475 mapread 0x024993 thru 0x02fa31 (0xb09f bytes) 000856 1769074576.008486 mapwrite 0x02a733 thru 0x03892f (0xe1fd bytes) 000857 1769074576.191225 MIRROR_RESYNC 3 mirrors 000858 1769074577.710558 write 0x011347 thru 0x016d2a (0x59e4 bytes) 000859 1769074577.897837 mapread 0x00e316 thru 0x017b6d (0x9858 bytes) 000862 1769074577.955170 mapread 0x00570e thru 0x012a1f (0xd312 bytes) 000863 1769074577.976937 mapwrite 0x01c39f thru 0x020296 (0x3ef8 bytes) 000864 1769074578.120061 mapread 0x01d573 thru 0x028db6 (0xb844 bytes) 000866 1769074578.127294 write 0x016cb3 thru 0x0174c7 (0x815 bytes) 000867 1769074578.131666 read 0x014fb2 thru 0x016d7a (0x1dc9 bytes) 000868 1769074578.153949 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x94499d7f (stale) Mirror 4: 0x94499d7f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xeecfcb53 Mirror 5: 0xeecfcb53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000871 1769074579.834227 read 0x031a3e thru 0x0373bd (0x5980 bytes) 000872 1769074579.864835 mapwrite 0x00061f thru 0x00d052 (0xca34 bytes) 000873 1769074580.372983 mapread 0x011d4e thru 0x01f248 (0xd4fb bytes) 000874 1769074580.443156 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x94499d7f (stale) Mirror 5: 0xeecfcb53 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x94499d7f (stale) Mirror 5: 0xeecfcb53 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000876 1769074581.133482 write 0x0357c4 thru 0x03709b (0x18d8 bytes) 000877 1769074581.148273 mapread 0x02fdf1 thru 0x030e1e (0x102e bytes) 000878 1769074581.166272 mapread 0x0071af thru 0x011ca1 (0xaaf3 bytes) 000881 1769074581.206659 read 0x01c5c6 thru 0x024acb (0x8506 bytes) 000884 1769074581.223505 read 0x00db2e thru 0x01a986 (0xce59 bytes) 000885 1769074581.244395 mapwrite 0x02263e thru 0x02acce (0x8691 bytes) 000886 1769074581.351511 read 0x02e7bf thru 0x0373f5 (0x8c37 bytes) 000887 1769074581.353133 mapwrite 0x03d5b6 thru 0x03d6b4 (0xff bytes) 000888 1769074581.411123 mapwrite 0x009622 thru 0x016249 (0xcc28 bytes) 000889 1769074581.601944 write 0x026074 thru 0x02b93d (0x58ca bytes) 000890 1769074581.608724 trunc from 0x040000 to 0x03913b (0x6ec4 bytes) 000891 1769074581.694044 mapread 0x03642e thru 0x03913b (0x2d0e bytes) 000892 1769074581.695301 write 0x003dd1 thru 0x005308 (0x1538 bytes) 000893 1769074581.699163 mapread 0x028fca thru 0x02d296 (0x42cd bytes) 000894 1769074581.701082 read 0x024e44 thru 0x030fdf (0xc19c bytes) 000895 1769074581.705028 mapread 0x015b4c thru 0x0258c9 (0xfd7e bytes) 000896 1769074581.708532 mapread 0x0179e2 thru 0x01adda (0x33f9 bytes) 000897 1769074581.719757 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3913c): Mirror 5: 0x49d5e62b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3913c): Mirror 5: 0x49d5e62b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3913c: skipped 000898 1769074582.056370 mapwrite 0x02e9e6 thru 0x039847 (0xae62 bytes) 000900 1769074582.190306 trunc from 0x039848 to 0x02a61c (0xf22b bytes) 000901 1769074582.226756 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2a61d): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a61d): Mirror 5: 0x95d58eab (stale) CRC-32 checksum value for chunk [0, 0x2a61d): Mirror 1: 0x815fb43d Mirror 6: 0x815fb43d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a61d: skipped 000902 1769074583.823637 write 0x037282 thru 0x03ffff (0x8d7e bytes) 000903 1769074583.967149 trunc from 0x040000 to 0x01c776 (0x23889 bytes) 000904 1769074583.996999 mapread 0x00c067 thru 0x012567 (0x6501 bytes) 000907 1769074584.021207 trunc from 0x01c777 to 0x00dcc8 (0xeaae bytes) 000909 1769074584.049163 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xdcc9): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdcc9): Mirror 5: 0xa5b5f417 (stale) Mirror 6: 0xa4670d45 (stale) CRC-32 checksum value for chunk [0, 0xdcc9): Mirror 1: 0xa4670d45 Mirror 7: 0xa4670d45 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdcc9: skipped 000910 1769074585.217924 MIRROR_RESYNC 4 mirrors 000913 1769074586.803632 mapwrite 0x037027 thru 0x03cc3e (0x5c18 bytes) 000914 1769074587.089479 trunc from 0x03cc3f to 0x00aee7 (0x31d57 bytes) 000915 1769074587.166971 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xaee8): Mirror 5: 0xb0d501d0 (stale) Mirror 6: 0xb0d501d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xaee8): Mirror 5: 0xb0d501d0 (stale) Mirror 6: 0xb0d501d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xaee8: skipped 000918 1769074587.639382 trunc from 0x00aee8 to 0x03ce55 (0x31f6e bytes) 000919 1769074587.659916 mapwrite 0x03a00c thru 0x03ffff (0x5ff4 bytes) 000920 1769074587.798238 mapread 0x02fc75 thru 0x035a51 (0x5ddd bytes) 000921 1769074587.824287 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x8625c26e (stale) Mirror 6: 0x8625c26e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x90eca4bc Mirror 7: 0x90eca4bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000922 1769074588.904112 trunc from 0x040000 to 0x008f1a (0x370e5 bytes) 000926 1769074589.048743 mapwrite 0x003b1f thru 0x00e08e (0xa570 bytes) 000927 1769074589.172752 read 0x00a341 thru 0x00aea8 (0xb68 bytes) 000930 1769074589.183669 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe08f): Mirror 5: 0x4a149939 (stale) Mirror 7: 0x5eec775a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe08f): Mirror 5: 0x4a149939 (stale) Mirror 7: 0x5eec775a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe08f: skipped 000931 1769074589.542320 read 0x00cca3 thru 0x00e08e (0x13ec bytes) 000932 1769074589.551602 mapwrite 0x02e18d thru 0x0320b1 (0x3f25 bytes) 000935 1769074589.639735 read 0x00714d thru 0x00ffa8 (0x8e5c bytes) 000937 1769074589.652539 write 0x01f7db thru 0x02cc08 (0xd42e bytes) 000938 1769074589.654124 write 0x023969 thru 0x0279b8 (0x4050 bytes) 000940 1769074589.657162 mapwrite 0x00c00c thru 0x01b4b1 (0xf4a6 bytes) 000944 1769074589.741945 mapread 0x00a0b1 thru 0x016ff8 (0xcf48 bytes) 000946 1769074589.743845 read 0x00f852 thru 0x017b73 (0x8322 bytes) 000947 1769074589.744874 mapread 0x0242f4 thru 0x0320b1 (0xddbe bytes) 000948 1769074589.746221 read 0x00247f thru 0x00d5b5 (0xb137 bytes) 000949 1769074589.747217 write 0x00e249 thru 0x0194c2 (0xb27a bytes) 000950 1769074589.748868 read 0x00d0bf thru 0x01c08f (0xefd1 bytes) 000951 1769074589.750056 trunc from 0x0320b2 to 0x002528 (0x2fb89 bytes) 000952 1769074589.792661 trunc from 0x002529 to 0x0033da (0xeb2 bytes) 000953 1769074589.849220 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33db): Mirror 7: 0xdc4df60a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33db): Mirror 7: 0xdc4df60a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33db: skipped 000954 1769074590.408935 read 0x000133 thru 0x0033da (0x32a8 bytes) 000955 1769074590.424685 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x33db): Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33db): Mirror 7: 0xdc4df60a (stale) CRC-32 checksum value for chunk [0, 0x33db): Mirror 1: 0x27cefd5b Mirror 8: 0x27cefd5b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33db: skipped 000956 1769074591.824464 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33db): Mirror 7: 0xdc4df60a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33db): Mirror 7: 0xdc4df60a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33db: skipped 000957 1769074592.149633 mapwrite 0x02436f thru 0x0330cc (0xed5e bytes) 000961 1769074592.344431 mapwrite 0x02bf05 thru 0x0319ac (0x5aa8 bytes) 000962 1769074592.478873 mapread 0x016de7 thru 0x02338f (0xc5a9 bytes) 000963 1769074592.516302 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x330cd): Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x330cd): Mirror 7: 0x40a4e639 (stale) CRC-32 checksum value for chunk [0, 0x330cd): Mirror 1: 0xf6065db4 Mirror 8: 0xf6065db4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x330cd: skipped 000965 1769074593.797563 mapread 0x01f784 thru 0x02246e (0x2ceb bytes) 000966 1769074593.843232 write 0x017640 thru 0x0265eb (0xefac bytes) 000967 1769074593.966029 mapread 0x01b244 thru 0x01f83c (0x45f9 bytes) 000968 1769074593.967979 mapread 0x02c979 thru 0x031a2d (0x50b5 bytes) 000969 1769074593.980172 mapread 0x0044de thru 0x00853f (0x4062 bytes) 000971 1769074593.996114 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x330cd): Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x330cd): Mirror 7: 0x40a4e639 (stale) Mirror 8: 0xf6065db4 (stale) CRC-32 checksum value for chunk [0, 0x330cd): Mirror 1: 0x5fc63f01 Mirror 9: 0x5fc63f01 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x330cd: skipped 000972 1769074595.259692 read 0x01142c thru 0x01b012 (0x9be7 bytes) 000973 1769074595.269876 trunc from 0x0330cd to 0x00397f (0x2f74d bytes) 000974 1769074595.375900 mapwrite 0x025f68 thru 0x032eeb (0xcf84 bytes) 000975 1769074595.532932 read 0x0082db thru 0x009aae (0x17d4 bytes) 000976 1769074595.550695 mapwrite 0x007218 thru 0x01047f (0x9268 bytes) 000979 1769074595.602399 trunc from 0x032eec to 0x013382 (0x1fb69 bytes) 000981 1769074595.626102 mapread 0x008401 thru 0x013382 (0xaf82 bytes) 000982 1769074595.633266 MIRROR_RESYNC 4 mirrors 000985 1769074596.884511 mapread 0x01180c thru 0x013382 (0x1b77 bytes) 000989 1769074596.908375 trunc from 0x013383 to 0x03c29a (0x28f18 bytes) 000990 1769074597.006246 read 0x03859f thru 0x03c1d7 (0x3c39 bytes) 000991 1769074597.015044 trunc from 0x03c29b to 0x022e27 (0x19473 bytes) 000993 1769074597.045121 MIRROR_RESYNC 4 mirrors 000994 1769074598.074713 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x157:0x0]: Invalid argument (22) 000995 1769074598.490238 trunc from 0x022e28 to 0x015dda (0xd04d bytes) 000996 1769074598.744720 mapwrite 0x039249 thru 0x03ffff (0x6db7 bytes) 000997 1769074598.942069 write 0x005e8f thru 0x01495f (0xead1 bytes) 000999 1769074598.968985 read 0x02eab8 thru 0x035b17 (0x7060 bytes) 001000 1769074598.983061 write 0x00477f thru 0x005137 (0x9b9 bytes) All operations completed A-OK!