== sanity-flr test 70a: flr mode fsx test ================ 23:07:03 (1787368023) Seed set to 8025 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1787368025.910516 write 0x003b68 thru 0x00fd4f (0xc1e8 bytes) 000008 1787368025.932617 mapread 0x007c95 thru 0x00fd4f (0x80bb bytes) 000009 1787368025.933687 read 0x000ae9 thru 0x00e03d (0xd555 bytes) 000013 1787368025.976745 mapwrite 0x010c31 thru 0x0157d3 (0x4ba3 bytes) 000021 1787368026.214591 write 0x001600 thru 0x00e8e6 (0xd2e7 bytes) 000023 1787368026.221223 write 0x03dadd thru 0x03ffff (0x2523 bytes) 000024 1787368026.223592 write 0x0204d9 thru 0x02593a (0x5462 bytes) 000025 1787368026.253759 mapread 0x03afbf thru 0x03ffff (0x5041 bytes) 000026 1787368026.266432 write 0x037f21 thru 0x03ffff (0x80df bytes) truncating to largest ever: 0x59cf 000032 1787368026.283655 trunc from 0x040000 to 0x0059ce (0x3a631 bytes) 000033 1787368026.310165 mapread 0x003e32 thru 0x0059ce (0x1b9d bytes) truncating to largest ever: 0x213d1 000037 1787368026.315181 trunc from 0x0059cf to 0x0213d0 (0x1ba02 bytes) truncating to largest ever: 0x3ea69 000039 1787368026.340541 trunc from 0x0213d1 to 0x03ea68 (0x1d698 bytes) 000040 1787368026.362483 mapwrite 0x01fcf9 thru 0x028484 (0x878c bytes) 000042 1787368026.430425 read 0x00834a thru 0x013ca6 (0xb95d bytes) 000043 1787368026.440981 mapwrite 0x038f02 thru 0x03ffff (0x70fe bytes) 000046 1787368026.506540 read 0x0130a1 thru 0x01aa41 (0x79a1 bytes) 000047 1787368026.507249 mapread 0x0302de thru 0x03206b (0x1d8e bytes) 000048 1787368026.508773 read 0x03d960 thru 0x03e01a (0x6bb bytes) 000053 1787368026.513256 mapread 0x02fe46 thru 0x03611b (0x62d6 bytes) 000054 1787368026.515491 trunc from 0x040000 to 0x00cbe6 (0x33419 bytes) 000056 1787368026.534402 trunc from 0x00cbe7 to 0x01f9c6 (0x12de0 bytes) 000059 1787368026.555555 mapwrite 0x02e8dd thru 0x038234 (0x9958 bytes) 000061 1787368026.628547 write 0x008a1a thru 0x01891f (0xff06 bytes) truncating to largest ever: 0x3f158 000062 1787368026.631322 trunc from 0x038235 to 0x03f157 (0x6f23 bytes) 000065 1787368026.646143 mapread 0x00faae thru 0x014cb8 (0x520b bytes) 000067 1787368026.649678 trunc from 0x03f158 to 0x03a512 (0x4c45 bytes) 000069 1787368026.665416 write 0x03c466 thru 0x03ffff (0x3b9a bytes) 000072 1787368026.668885 write 0x0290ce thru 0x033c29 (0xab5c bytes) 000073 1787368026.670358 trunc from 0x040000 to 0x03c85a (0x37a5 bytes) 000077 1787368026.691982 mapread 0x036a49 thru 0x03ab57 (0x410f bytes) 000080 1787368026.702364 trunc from 0x03c85b to 0x018750 (0x2410a bytes) 000082 1787368026.723316 mapread 0x013948 thru 0x018750 (0x4e09 bytes) 000084 1787368026.726318 trunc from 0x018751 to 0x008439 (0x10317 bytes) 000085 1787368026.747629 mapwrite 0x02a93d thru 0x03901e (0xe6e2 bytes) 000087 1787368026.875256 mapwrite 0x03e188 thru 0x03ffff (0x1e78 bytes) 000088 1787368026.946675 mapwrite 0x014193 thru 0x022687 (0xe4f5 bytes) truncating to largest ever: 0x3f5a7 000092 1787368027.076418 trunc from 0x040000 to 0x03f5a6 (0xa59 bytes) 000094 1787368027.096275 mapread 0x030a47 thru 0x03e9dc (0xdf96 bytes) 000095 1787368027.110468 read 0x002db9 thru 0x00fab0 (0xccf8 bytes) 000096 1787368027.128223 read 0x03303f thru 0x03d3de (0xa3a0 bytes) 000098 1787368027.132250 mapwrite 0x0355aa thru 0x03592e (0x385 bytes) 000099 1787368027.172102 MIRROR_EXTEND to 2 mirrors 000100 1787368027.665176 trunc from 0x03f5a7 to 0x021056 (0x1e550 bytes) 000101 1787368027.776086 mapwrite 0x03b7c4 thru 0x03ffff (0x483c bytes) 000103 1787368027.857180 trunc from 0x040000 to 0x009717 (0x368e8 bytes) 000104 1787368027.871704 write 0x014fcc thru 0x0183eb (0x3420 bytes) 000105 1787368027.873269 write 0x023a70 thru 0x02d78e (0x9d1f bytes) 000106 1787368027.875383 mapwrite 0x00f7fb thru 0x016824 (0x702a bytes) 000108 1787368027.933470 MIRROR_RESYNC 2 mirrors 000109 1787368028.556386 mapread 0x008157 thru 0x00cced (0x4b97 bytes) 000110 1787368028.575239 mapread 0x01c172 thru 0x01db13 (0x19a2 bytes) 000114 1787368028.596983 MIRROR_RESYNC 2 mirrors 000115 1787368028.937120 trunc from 0x02d78f to 0x03b563 (0xddd5 bytes) 000116 1787368029.077708 write 0x00afb9 thru 0x00e793 (0x37db bytes) 000117 1787368029.093329 read 0x012c9c thru 0x01ea8b (0xbdf0 bytes) 000118 1787368029.110387 write 0x01355b thru 0x019b34 (0x65da bytes) 000119 1787368029.113486 mapread 0x00f962 thru 0x019399 (0x9a38 bytes) 000120 1787368029.147202 MIRROR_RESYNC 2 mirrors 000121 1787368029.769937 trunc from 0x03b564 to 0x023442 (0x18121 bytes) 000123 1787368029.955588 read 0x00fa0c thru 0x01b136 (0xb72b bytes) 000124 1787368029.970682 read 0x020e8c thru 0x023442 (0x25b7 bytes) 000125 1787368029.994280 mapwrite 0x01a038 thru 0x01e5cc (0x4595 bytes) 000126 1787368030.079158 mapwrite 0x00c417 thru 0x014c3a (0x8824 bytes) 000127 1787368030.135010 trunc from 0x023443 to 0x010897 (0x12bab bytes) 000128 1787368030.158604 mapwrite 0x00d2e3 thru 0x0140ff (0x6e1d bytes) 000129 1787368030.275660 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x14100): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14100): Mirror 2: 0xb709aba0 (stale) CRC-32 checksum value for chunk [0, 0x14100): Mirror 1: 0x8aeedd0e Mirror 3: 0x8aeedd0e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14100: skipped 000130 1787368030.916629 read 0x013dc5 thru 0x0140ff (0x33b bytes) 000131 1787368030.926025 mapread 0x00a37d thru 0x012658 (0x82dc bytes) 000132 1787368030.953001 write 0x0061fa thru 0x01093e (0xa745 bytes) 000134 1787368031.033620 write 0x010cfe thru 0x017dee (0x70f1 bytes) 000135 1787368031.036404 mapread 0x0024ec thru 0x002825 (0x33a bytes) 000136 1787368031.044708 mapwrite 0x03bb09 thru 0x03bc25 (0x11d bytes) 000143 1787368031.158369 write 0x00a628 thru 0x00b745 (0x111e bytes) 000146 1787368031.163474 trunc from 0x03bc26 to 0x026296 (0x1598f bytes) 000148 1787368031.207344 mapwrite 0x021dba thru 0x02cdbc (0xb003 bytes) 000149 1787368031.311162 trunc from 0x02cdbd to 0x017954 (0x15468 bytes) 000150 1787368031.344369 trunc from 0x017955 to 0x00c484 (0xb4d0 bytes) 000152 1787368031.369708 read 0x00747f thru 0x00c484 (0x5006 bytes) 000153 1787368031.371502 write 0x03cbe4 thru 0x03ffff (0x341c bytes) 000154 1787368031.373483 trunc from 0x040000 to 0x03e6a1 (0x195e bytes) 000158 1787368031.403484 write 0x01ebb4 thru 0x021296 (0x26e3 bytes) 000159 1787368031.422785 mapread 0x0331f4 thru 0x03e6a1 (0xb4ae bytes) 000161 1787368031.426550 write 0x02ffcf thru 0x037a0b (0x7a3d bytes) 000162 1787368031.435106 mapwrite 0x02a574 thru 0x031abb (0x7548 bytes) 000165 1787368031.578497 mapwrite 0x015cc8 thru 0x01a8c2 (0x4bfb bytes) 000167 1787368031.715431 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e6a2): Mirror 3: 0x3fb6d2fd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e6a2): Mirror 3: 0x3fb6d2fd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e6a2: skipped 000168 1787368032.144774 read 0x025018 thru 0x02805e (0x3047 bytes) 000169 1787368032.171200 write 0x03ff34 thru 0x03ffff (0xcc bytes) 000172 1787368032.179616 write 0x00ff6b thru 0x0161c1 (0x6257 bytes) 000173 1787368032.201676 mapwrite 0x0002ed thru 0x003ba4 (0x38b8 bytes) 000174 1787368032.318773 mapwrite 0x0330fd thru 0x03f75d (0xc661 bytes) 000175 1787368032.396982 read 0x029a49 thru 0x033448 (0x9a00 bytes) 000176 1787368032.411296 mapwrite 0x00082a thru 0x00a527 (0x9cfe bytes) 000178 1787368032.464511 trunc from 0x040000 to 0x01ce25 (0x231da bytes) 000179 1787368032.483483 read 0x011147 thru 0x014977 (0x3831 bytes) 000180 1787368032.489180 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1ce26): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ce26): Mirror 3: 0xd10c5e76 (stale) CRC-32 checksum value for chunk [0, 0x1ce26): Mirror 1: 0x2e09d7d9 Mirror 4: 0x2e09d7d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ce26: skipped 000181 1787368033.161413 write 0x014c83 thru 0x01f2e1 (0xa65f bytes) 000182 1787368033.264968 trunc from 0x01f2e2 to 0x006fcb (0x18316 bytes) 000183 1787368033.310880 mapread 0x001cd5 thru 0x005d8d (0x40b9 bytes) 000187 1787368033.326637 read 0x0020ff thru 0x006fcb (0x4ecd bytes) 000188 1787368033.327593 trunc from 0x006fcc to 0x01b333 (0x14368 bytes) 000189 1787368033.341478 mapread 0x0095d9 thru 0x014975 (0xb39d bytes) 000190 1787368033.362570 trunc from 0x01b334 to 0x0225b3 (0x7280 bytes) 000191 1787368033.379332 MIRROR_RESYNC 3 mirrors 000196 1787368034.284966 read 0x01fcdf thru 0x0225b3 (0x28d5 bytes) 000198 1787368034.294668 read 0x00c865 thru 0x012440 (0x5bdc bytes) 000199 1787368034.318639 trunc from 0x0225b4 to 0x02a055 (0x7aa2 bytes) 000202 1787368034.481950 write 0x01aceb thru 0x01b629 (0x93f bytes) 000203 1787368034.498025 write 0x017560 thru 0x025506 (0xdfa7 bytes) 000204 1787368034.504127 read 0x01c93e thru 0x028881 (0xbf44 bytes) 000205 1787368034.506190 write 0x0295be thru 0x034617 (0xb05a bytes) 000209 1787368034.510156 mapread 0x020944 thru 0x02f647 (0xed04 bytes) 000212 1787368034.512139 trunc from 0x034618 to 0x036b4f (0x2538 bytes) 000213 1787368034.529282 trunc from 0x036b50 to 0x000773 (0x363dc bytes) 000215 1787368034.545351 mapwrite 0x03a17a thru 0x03ffff (0x5e86 bytes) 000217 1787368034.604514 MIRROR_RESYNC 3 mirrors 000218 1787368035.717742 read 0x0330ba thru 0x03fa19 (0xc960 bytes) 000219 1787368035.742435 read 0x029d15 thru 0x038943 (0xec2f bytes) 000220 1787368035.764302 trunc from 0x040000 to 0x02e3a9 (0x11c56 bytes) 000222 1787368035.871348 trunc from 0x02e3aa to 0x00bfb3 (0x223f6 bytes) 000223 1787368035.900508 trunc from 0x00bfb4 to 0x023182 (0x171cf bytes) 000224 1787368035.931887 trunc from 0x023183 to 0x02369a (0x518 bytes) 000225 1787368035.953274 trunc from 0x02369b to 0x0139a4 (0xfcf6 bytes) 000226 1787368035.982219 trunc from 0x0139a5 to 0x025d40 (0x1239c bytes) 000227 1787368035.997300 mapread 0x021338 thru 0x025d40 (0x4a09 bytes) 000228 1787368036.020222 trunc from 0x025d41 to 0x03e47c (0x1873c bytes) 000230 1787368036.034506 read 0x023b5b thru 0x029f7c (0x6422 bytes) 000231 1787368036.044126 read 0x013267 thru 0x01834f (0x50e9 bytes) 000232 1787368036.044790 write 0x0131b3 thru 0x014874 (0x16c2 bytes) 000233 1787368036.049721 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e47d): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e47d): Mirror 3: 0x9ca7fd4b (stale) Mirror 4: 0x9ca7fd4b (stale) CRC-32 checksum value for chunk [0, 0x3e47d): Mirror 1: 0x5be488cf Mirror 5: 0x5be488cf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e47d: skipped 000235 1787368036.904776 mapwrite 0x02ae01 thru 0x03855d (0xd75d bytes) 000236 1787368037.114953 trunc from 0x03e47d to 0x03b018 (0x3464 bytes) 000240 1787368037.171178 write 0x02f73d thru 0x033791 (0x4055 bytes) 000241 1787368037.172791 write 0x0367a3 thru 0x03ffff (0x985d bytes) 000242 1787368037.174133 read 0x03f91d thru 0x03fd4e (0x432 bytes) 000243 1787368037.175243 trunc from 0x040000 to 0x030ddb (0xf224 bytes) 000245 1787368037.195281 write 0x00b09d thru 0x0183b4 (0xd318 bytes) 000247 1787368037.210819 trunc from 0x030ddc to 0x0247cc (0xc60f bytes) 000248 1787368037.233032 mapread 0x018d49 thru 0x01ff9e (0x7256 bytes) 000250 1787368037.242776 write 0x03f7cd thru 0x03ffff (0x833 bytes) 000252 1787368037.244226 mapwrite 0x010e90 thru 0x018fa3 (0x8114 bytes) 000253 1787368037.299968 MIRROR_RESYNC 4 mirrors 000255 1787368038.033088 trunc from 0x040000 to 0x02a2e4 (0x15d1b bytes) 000256 1787368038.131971 write 0x00be36 thru 0x011bb9 (0x5d84 bytes) 000257 1787368038.141164 mapwrite 0x0086cf thru 0x00c5eb (0x3f1d bytes) 000258 1787368038.200692 trunc from 0x02a2e5 to 0x0233e5 (0x6eff bytes) 000260 1787368038.226145 trunc from 0x0233e6 to 0x01e0d2 (0x5313 bytes) 000261 1787368038.239811 read 0x0043e0 thru 0x007684 (0x32a5 bytes) 000262 1787368038.240545 mapwrite 0x01f55b thru 0x026e98 (0x793e bytes) 000264 1787368038.306540 read 0x026220 thru 0x026e98 (0xc79 bytes) 000265 1787368038.307174 trunc from 0x026e99 to 0x01facc (0x73cc bytes) 000266 1787368038.332930 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1facd): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1facd): Mirror 3: 0x13daa496 (stale) Mirror 4: 0x13daa496 (stale) Mirror 5: 0x13daa496 (stale) CRC-32 checksum value for chunk [0, 0x1facd): Mirror 1: 0xb3253420 Mirror 6: 0xb3253420 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1facd: skipped 000267 1787368039.052900 mapread 0x01ca01 thru 0x01facc (0x30cc bytes) 000271 1787368039.109905 write 0x022dd1 thru 0x02bbef (0x8e1f bytes) 000273 1787368039.196442 write 0x029cb6 thru 0x02b583 (0x18ce bytes) 000275 1787368039.198801 write 0x03637a thru 0x0366d4 (0x35b bytes) 000278 1787368039.204317 mapwrite 0x039f76 thru 0x03ffff (0x608a bytes) 000280 1787368039.253322 trunc from 0x040000 to 0x00a43a (0x35bc5 bytes) 000284 1787368039.270532 trunc from 0x00a43b to 0x00dffb (0x3bc1 bytes) 000287 1787368039.292535 mapread 0x0064af thru 0x00dffb (0x7b4d bytes) 000289 1787368039.309158 mapread 0x007850 thru 0x00aec0 (0x3671 bytes) 000290 1787368039.310459 trunc from 0x00dffc to 0x021296 (0x1329b bytes) 000292 1787368039.339927 trunc from 0x021297 to 0x0178bd (0x99d9 bytes) 000294 1787368039.384822 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x178be): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x178be): Mirror 3: 0x93452a67 (stale) Mirror 4: 0x93452a67 (stale) Mirror 5: 0x93452a67 (stale) Mirror 6: 0xe36906b8 (stale) CRC-32 checksum value for chunk [0, 0x178be): Mirror 1: 0x8b5dd739 Mirror 7: 0x8b5dd739 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x178be: skipped 000295 1787368040.555195 trunc from 0x0178be to 0x016334 (0x1589 bytes) 000298 1787368040.630311 read 0x00f891 thru 0x016334 (0x6aa4 bytes) 000299 1787368040.638921 trunc from 0x016335 to 0x01e153 (0x7e1f bytes) 000300 1787368040.655890 write 0x00768a thru 0x00935a (0x1cd1 bytes) 000301 1787368040.663336 read 0x016286 thru 0x0189e5 (0x2760 bytes) 000303 1787368040.671444 read 0x005e92 thru 0x007d74 (0x1ee3 bytes) 000304 1787368040.672401 mapwrite 0x03679a thru 0x038b11 (0x2378 bytes) 000305 1787368040.747109 read 0x015d41 thru 0x020487 (0xa747 bytes) 000306 1787368040.748518 mapwrite 0x01d776 thru 0x023332 (0x5bbd bytes) 000307 1787368040.803764 write 0x03630d thru 0x03d36a (0x705e bytes) 000308 1787368040.807906 mapwrite 0x007fe0 thru 0x00e08a (0x60ab bytes) 000310 1787368040.865855 write 0x001f30 thru 0x005f81 (0x4052 bytes) 000311 1787368040.873346 MIRROR_RESYNC 6 mirrors 000312 1787368041.875313 mapwrite 0x02211e thru 0x03098e (0xe871 bytes) 000313 1787368042.056620 mapwrite 0x01e242 thru 0x025d2e (0x7aed bytes) 000315 1787368042.098990 trunc from 0x03d36b to 0x03d45e (0xf4 bytes) 000318 1787368042.118302 mapread 0x03ccce thru 0x03d45e (0x791 bytes) 000319 1787368042.127263 write 0x0361fd thru 0x03cdb6 (0x6bba bytes) 000321 1787368042.128735 write 0x02aa55 thru 0x02fe07 (0x53b3 bytes) 000322 1787368042.134086 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d45f): Mirror 3: 0x1c540692 (stale) Mirror 5: 0x1c540692 (stale) Mirror 6: 0x1c540692 (stale) Mirror 7: 0x1c540692 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d45f): Mirror 3: 0x1c540692 (stale) Mirror 5: 0x1c540692 (stale) Mirror 6: 0x1c540692 (stale) Mirror 7: 0x1c540692 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d45f: skipped 000324 1787368042.470740 mapwrite 0x03d8e0 thru 0x03ffff (0x2720 bytes) 000325 1787368042.587966 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa6528fa2 (stale) Mirror 5: 0xa6528fa2 (stale) Mirror 6: 0xa6528fa2 (stale) Mirror 7: 0xa6528fa2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa69454e5 Mirror 8: 0xa69454e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000326 1787368043.276941 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xa6528fa2 (stale) Mirror 6: 0xa6528fa2 (stale) Mirror 7: 0xa6528fa2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xa6528fa2 (stale) Mirror 6: 0xa6528fa2 (stale) Mirror 7: 0xa6528fa2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa69454e5 Mirror 8: 0xa69454e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000327 1787368043.784715 mapwrite 0x039f07 thru 0x03d41d (0x3517 bytes) 000328 1787368043.949171 write 0x0044dc thru 0x006bc2 (0x26e7 bytes) 000330 1787368043.960203 write 0x00555b thru 0x00bf99 (0x6a3f bytes) 000331 1787368043.965188 mapread 0x03b070 thru 0x03ffff (0x4f90 bytes) 000332 1787368043.966353 trunc from 0x040000 to 0x015062 (0x2af9d bytes) 000334 1787368044.005617 mapwrite 0x03e47b thru 0x03ffff (0x1b85 bytes) 000335 1787368044.068242 mapwrite 0x01c368 thru 0x026de8 (0xaa81 bytes) 000337 1787368044.139733 mapwrite 0x004bc7 thru 0x00da45 (0x8e7f bytes) 000341 1787368044.195805 mapread 0x0244d7 thru 0x02fc67 (0xb791 bytes) 000342 1787368044.206684 mapwrite 0x000789 thru 0x004bb5 (0x442d bytes) 000343 1787368044.251214 trunc from 0x040000 to 0x00ebd2 (0x3142d bytes) 000344 1787368044.269920 read 0x008b88 thru 0x00ebd2 (0x604b bytes) 000347 1787368044.274333 read 0x00aee1 thru 0x00ebd2 (0x3cf2 bytes) 000349 1787368044.275458 mapwrite 0x036977 thru 0x03ffff (0x9689 bytes) 000350 1787368044.352692 trunc from 0x040000 to 0x0117ee (0x2e811 bytes) 000351 1787368044.366907 mapread 0x00c676 thru 0x00fe92 (0x381d bytes) 000354 1787368044.368825 mapwrite 0x016e43 thru 0x01907f (0x223d bytes) 000355 1787368044.433855 read 0x013229 thru 0x01907f (0x5e57 bytes) 000356 1787368044.443786 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19080): Mirror 6: 0x43b2e0bd (stale) Mirror 7: 0x43b2e0bd (stale) Mirror 8: 0x43b2e0bd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19080): Mirror 6: 0x43b2e0bd (stale) Mirror 7: 0x43b2e0bd (stale) Mirror 8: 0x43b2e0bd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19080: skipped 000357 1787368044.715420 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19080): Mirror 7: 0x43b2e0bd (stale) Mirror 8: 0x43b2e0bd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19080): Mirror 7: 0x43b2e0bd (stale) Mirror 8: 0x43b2e0bd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19080: skipped 000358 1787368045.016809 read 0x004daa thru 0x0079cb (0x2c22 bytes) 000359 1787368045.026538 mapread 0x003f61 thru 0x008d47 (0x4de7 bytes) 000361 1787368045.064003 write 0x03dcce thru 0x03ffff (0x2332 bytes) 000363 1787368045.069675 trunc from 0x040000 to 0x02895f (0x176a0 bytes) 000365 1787368045.094318 mapread 0x020c62 thru 0x0271e6 (0x6585 bytes) 000366 1787368045.127124 read 0x01c151 thru 0x021e1c (0x5ccc bytes) 000367 1787368045.127682 mapread 0x01187c thru 0x013d57 (0x24dc bytes) 000369 1787368045.143728 write 0x003cef thru 0x0139ce (0xfce0 bytes) 000370 1787368045.174741 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x28960): Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28960): Mirror 7: 0x17e25c6b (stale) Mirror 8: 0xd63781de (stale) CRC-32 checksum value for chunk [0, 0x28960): Mirror 1: 0xc08f857c Mirror 9: 0xc08f857c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28960: skipped 000371 1787368046.645795 write 0x00636e thru 0x00b806 (0x5499 bytes) 000374 1787368046.795177 mapwrite 0x03faec thru 0x03ffff (0x514 bytes) 000375 1787368046.872310 MIRROR_RESYNC 4 mirrors 000376 1787368047.822959 mapread 0x00c867 thru 0x013b9d (0x7337 bytes) 000378 1787368047.858337 trunc from 0x040000 to 0x029e74 (0x1618b bytes) 000381 1787368047.978332 mapread 0x01ef71 thru 0x029e74 (0xaf04 bytes) 000382 1787368048.030773 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29e75): Mirror 8: 0xb6f3adf9 (stale) Mirror 9: 0xb6f3adf9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29e75): Mirror 8: 0xb6f3adf9 (stale) Mirror 9: 0xb6f3adf9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29e75: skipped 000383 1787368048.331182 trunc from 0x029e75 to 0x02b283 (0x140f bytes) 000384 1787368048.345657 mapread 0x0228fe thru 0x029116 (0x6819 bytes) 000385 1787368048.366370 trunc from 0x02b284 to 0x024ae3 (0x67a0 bytes) 000387 1787368048.383345 mapwrite 0x029bc5 thru 0x033c30 (0xa06c bytes) 000389 1787368048.459110 write 0x03dfb4 thru 0x03ffff (0x204c bytes) 000390 1787368048.461256 mapread 0x0073a0 thru 0x012d70 (0xb9d1 bytes) 000391 1787368048.483639 write 0x02c909 thru 0x034371 (0x7a69 bytes) 000395 1787368048.491216 read 0x021656 thru 0x029c80 (0x862b bytes) 000396 1787368048.491957 mapread 0x01a34e thru 0x02678b (0xc43e bytes) 000397 1787368048.498037 read 0x01f0d0 thru 0x029cca (0xabfb bytes) 000400 1787368048.499292 write 0x01a6e5 thru 0x026724 (0xc040 bytes) 000401 1787368048.500348 mapread 0x00ae66 thru 0x00dc67 (0x2e02 bytes) 000402 1787368048.501347 mapread 0x01d1f7 thru 0x023686 (0x6490 bytes) 000403 1787368048.502326 trunc from 0x040000 to 0x02a033 (0x15fcc bytes) 000405 1787368048.524701 mapwrite 0x01b87f thru 0x025971 (0xa0f3 bytes) 000407 1787368048.576429 trunc from 0x02a034 to 0x01203f (0x17ff4 bytes) 000408 1787368048.591926 write 0x035754 thru 0x03ffff (0xa8ac bytes) 000410 1787368048.593659 mapread 0x001b0f thru 0x0036e9 (0x1bdb bytes) 000411 1787368048.594276 mapread 0x0065bd thru 0x013b4d (0xd591 bytes) 000413 1787368048.600762 mapwrite 0x00d020 thru 0x0188df (0xb8c0 bytes) 000419 1787368048.663351 mapread 0x00a5f5 thru 0x0117b4 (0x71c0 bytes) 000420 1787368048.664281 write 0x022ac6 thru 0x0297c1 (0x6cfc bytes) 000421 1787368048.665199 mapread 0x03b748 thru 0x03c5f5 (0xeae bytes) 000422 1787368048.665802 read 0x03b9aa thru 0x03ffff (0x4656 bytes) 000425 1787368048.666902 read 0x006150 thru 0x00d663 (0x7514 bytes) 000426 1787368048.667617 mapwrite 0x007360 thru 0x00a814 (0x34b5 bytes) 000427 1787368048.711878 write 0x018b69 thru 0x0281ca (0xf662 bytes) 000428 1787368048.712900 mapwrite 0x03297d thru 0x033869 (0xeed bytes) 000430 1787368048.740451 read 0x00729e thru 0x012e45 (0xbba8 bytes) 000431 1787368048.741039 trunc from 0x040000 to 0x0111e1 (0x2ee1e bytes) 000433 1787368048.763193 MIRROR_RESYNC 3 mirrors 000436 1787368049.614161 write 0x02c82f thru 0x03bf1f (0xf6f1 bytes) 000437 1787368049.686135 write 0x02dcbf thru 0x0338ee (0x5c30 bytes) 000438 1787368049.687113 mapread 0x011d20 thru 0x016fca (0x52ab bytes) 000440 1787368049.708329 mapwrite 0x01d1d2 thru 0x02c582 (0xf3b1 bytes) 000441 1787368049.789207 trunc from 0x03bf20 to 0x01d916 (0x1e609 bytes) 000442 1787368049.815327 MIRROR_RESYNC 3 mirrors 000444 1787368050.548135 MIRROR_EXTEND to 4 mirrors 000447 1787368051.062737 mapread 0x00ccca thru 0x01b142 (0xe479 bytes) 000449 1787368051.102873 trunc from 0x01d917 to 0x00a025 (0x138f1 bytes) 000450 1787368051.163398 mapread 0x007273 thru 0x00a025 (0x2db3 bytes) 000451 1787368051.173691 mapread 0x00282c thru 0x00a025 (0x77fa bytes) 000452 1787368051.175294 write 0x03ab8e thru 0x03ffff (0x5472 bytes) 000453 1787368051.177395 mapwrite 0x034005 thru 0x03a42b (0x6427 bytes) 000454 1787368051.235224 mapwrite 0x03493f thru 0x03e2c7 (0x9989 bytes) 000455 1787368051.277111 trunc from 0x040000 to 0x011335 (0x2ecca bytes) 000457 1787368051.307660 mapread 0x0049e8 thru 0x00fe0c (0xb425 bytes) 000458 1787368051.316651 trunc from 0x011336 to 0x01cd6b (0xba36 bytes) 000459 1787368051.337829 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1cd6c): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cd6c): Mirror 8: 0xb5c363bc (stale) Mirror 9: 0xb5c363bc (stale) Mirror 10: 0xb5c363bc (stale) CRC-32 checksum value for chunk [0, 0x1cd6c): Mirror 1: 0xa1017098 Mirror 11: 0xa1017098 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cd6c: skipped 000461 1787368052.197609 mapread 0x012bfc thru 0x01bf32 (0x9337 bytes) 000462 1787368052.237854 mapread 0x005fbc thru 0x00a2eb (0x4330 bytes) 000463 1787368052.270603 mapwrite 0x03d6ec thru 0x03ffff (0x2914 bytes) 000465 1787368052.425542 mapread 0x03fdee thru 0x03ffff (0x212 bytes) 000468 1787368052.427982 mapread 0x00eeed thru 0x00eef3 (0x7 bytes) 000470 1787368052.443839 read 0x011b89 thru 0x0146f2 (0x2b6a bytes) 000471 1787368052.444689 read 0x01f3d6 thru 0x02d69f (0xe2ca bytes) 000472 1787368052.454569 write 0x03dc43 thru 0x03ffff (0x23bd bytes) 000473 1787368052.459675 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x5b674397 (stale) Mirror 10: 0x5b674397 (stale) Mirror 11: 0x6f30bf52 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x5b674397 (stale) Mirror 10: 0x5b674397 (stale) Mirror 11: 0x6f30bf52 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000477 1787368052.776885 MIRROR_RESYNC 4 mirrors 000478 1787368053.809444 write 0x005534 thru 0x00f604 (0xa0d1 bytes) 000480 1787368053.858706 MIRROR_RESYNC 4 mirrors 000481 1787368054.863577 read 0x015e97 thru 0x019201 (0x336b bytes) 000482 1787368054.879617 mapwrite 0x02a4d6 thru 0x02edb9 (0x48e4 bytes) 000483 1787368055.123908 MIRROR_RESYNC 4 mirrors 000484 1787368056.233208 MIRROR_RESYNC 4 mirrors 000486 1787368056.603657 read 0x02db74 thru 0x03958d (0xba1a bytes) 000487 1787368056.621926 write 0x0365d3 thru 0x03a3b1 (0x3ddf bytes) 000488 1787368056.740539 trunc from 0x040000 to 0x027fb9 (0x18046 bytes) 000489 1787368056.786093 write 0x03cb19 thru 0x03ffff (0x34e7 bytes) 000490 1787368056.788964 mapread 0x024d04 thru 0x0294d6 (0x47d3 bytes) 000492 1787368056.816455 mapread 0x0225ba thru 0x0280ab (0x5af2 bytes) 000493 1787368056.817314 mapwrite 0x01ffbf thru 0x02dde0 (0xde22 bytes) 000494 1787368056.950390 mapwrite 0x011852 thru 0x01ba6d (0xa21c bytes) 000495 1787368057.066606 mapread 0x038b9e thru 0x03ffff (0x7462 bytes) 000496 1787368057.082634 trunc from 0x040000 to 0x0391d8 (0x6e27 bytes) 000498 1787368057.101533 mapread 0x01d16d thru 0x023f5e (0x6df2 bytes) 000499 1787368057.103390 mapwrite 0x01a742 thru 0x020bd0 (0x648f bytes) 000502 1787368057.154101 write 0x022020 thru 0x02c1c6 (0xa1a7 bytes) 000504 1787368057.156697 mapread 0x0276dd thru 0x0366ca (0xefee bytes) 000505 1787368057.167805 write 0x0177f7 thru 0x0190a0 (0x18aa bytes) 000506 1787368057.169100 mapwrite 0x02e3ef thru 0x037424 (0x9036 bytes) 000509 1787368057.295589 mapread 0x02d2f1 thru 0x0391d8 (0xbee8 bytes) 000510 1787368057.297385 read 0x03628d thru 0x0391d8 (0x2f4c bytes) 000511 1787368057.302502 MIRROR_RESYNC 4 mirrors 000514 1787368057.955842 read 0x012500 thru 0x01c06e (0x9b6f bytes) 000517 1787368057.965735 write 0x01ac28 thru 0x024221 (0x95fa bytes) 000519 1787368058.073612 mapwrite 0x032a7b thru 0x036e5d (0x43e3 bytes) 000520 1787368058.189473 trunc from 0x0391d9 to 0x032802 (0x69d6 bytes) 000522 1787368058.258909 MIRROR_RESYNC 4 mirrors 000526 1787368059.214677 mapread 0x0089b4 thru 0x00d089 (0x46d6 bytes) 000528 1787368059.235372 read 0x030443 thru 0x032802 (0x23c0 bytes) 000529 1787368059.240944 trunc from 0x032803 to 0x028931 (0x9ed1 bytes) 000530 1787368059.312208 read 0x0144d7 thru 0x023fdb (0xfb05 bytes) 000531 1787368059.326614 read 0x010c6d thru 0x01606f (0x5403 bytes) 000532 1787368059.327572 write 0x012744 thru 0x012d15 (0x5d2 bytes) 000533 1787368059.328429 read 0x00e90c thru 0x01e4f3 (0xfbe8 bytes) 000536 1787368059.331204 mapread 0x010632 thru 0x0147f0 (0x41bf bytes) 000538 1787368059.333406 mapread 0x018372 thru 0x0204d7 (0x8166 bytes) 000539 1787368059.339265 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x28932): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28932): Mirror 9: 0x73559b02 (stale) Mirror 10: 0x73559b02 (stale) Mirror 11: 0x73559b02 (stale) CRC-32 checksum value for chunk [0, 0x28932): Mirror 1: 0xb075bb07 Mirror 12: 0xb075bb07 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28932: skipped 000540 1787368059.958621 trunc from 0x028932 to 0x03768e (0xed5d bytes) 000541 1787368060.070203 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3768f): Mirror 10: 0xa7331c9e (stale) Mirror 11: 0xa7331c9e (stale) Mirror 12: 0x41433ebc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3768f): Mirror 10: 0xa7331c9e (stale) Mirror 11: 0xa7331c9e (stale) Mirror 12: 0x41433ebc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3768f: skipped 000543 1787368060.417193 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3768f): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3768f): Mirror 10: 0xa7331c9e (stale) Mirror 11: 0xa7331c9e (stale) Mirror 12: 0x41433ebc (stale) CRC-32 checksum value for chunk [0, 0x3768f): Mirror 1: 0x41433ebc Mirror 13: 0x41433ebc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3768f: skipped 000544 1787368061.559966 mapwrite 0x03bd73 thru 0x03ffff (0x428d bytes) 000547 1787368061.771279 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x52f6d333 (stale) Mirror 12: 0xb03059a1 (stale) Mirror 13: 0xb03059a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x52f6d333 (stale) Mirror 12: 0xb03059a1 (stale) Mirror 13: 0xb03059a1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000548 1787368062.111181 write 0x01aca5 thru 0x022edc (0x8238 bytes) 000549 1787368062.133883 MIRROR_RESYNC 4 mirrors 000551 1787368062.897655 read 0x01ac7b thru 0x01df97 (0x331d bytes) 000555 1787368062.902943 trunc from 0x040000 to 0x006e6a (0x39195 bytes) 000556 1787368062.979352 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x6e6b): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6e6b): Mirror 11: 0x849dcf10 (stale) Mirror 12: 0x849dcf10 (stale) Mirror 13: 0x849dcf10 (stale) CRC-32 checksum value for chunk [0, 0x6e6b): Mirror 1: 0x849dcf10 Mirror 14: 0x849dcf10 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6e6b: skipped 000557 1787368063.707823 mapread 0x001a54 thru 0x002efb (0x14a8 bytes) 000558 1787368063.729461 mapwrite 0x03e139 thru 0x03ffff (0x1ec7 bytes) 000563 1787368063.852172 trunc from 0x040000 to 0x00b8ab (0x34754 bytes) 000564 1787368063.877391 MIRROR_RESYNC 5 mirrors 000567 1787368065.104009 MIRROR_RESYNC 5 mirrors 000568 1787368065.397859 trunc from 0x00b8ac to 0x01d2e3 (0x11a38 bytes) 000569 1787368065.482300 mapwrite 0x035bef thru 0x037525 (0x1937 bytes) 000570 1787368065.566491 mapread 0x002023 thru 0x009964 (0x7942 bytes) 000571 1787368065.577770 mapread 0x034288 thru 0x037525 (0x329e bytes) 000573 1787368065.582579 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37526): Mirror 11: 0xec08034a (stale) Mirror 12: 0xec08034a (stale) Mirror 14: 0xec08034a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37526): Mirror 11: 0xec08034a (stale) Mirror 12: 0xec08034a (stale) Mirror 14: 0xec08034a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37526: skipped 000574 1787368065.927469 read 0x036c32 thru 0x0373aa (0x779 bytes) 000575 1787368065.932990 mapwrite 0x00261a thru 0x00a30d (0x7cf4 bytes) 000578 1787368066.027365 MIRROR_RESYNC 4 mirrors 000581 1787368067.008726 mapwrite 0x02c3f4 thru 0x0337a3 (0x73b0 bytes) 000582 1787368067.225874 trunc from 0x037526 to 0x011f4b (0x255da bytes) 000583 1787368067.260536 write 0x033a09 thru 0x03ffff (0xc5f7 bytes) 000585 1787368067.262490 write 0x01de20 thru 0x02d13c (0xf31d bytes) 000586 1787368067.282834 write 0x00b90e thru 0x0185a9 (0xcc9c bytes) 000588 1787368067.294611 write 0x038304 thru 0x03ffff (0x7cfc bytes) 000592 1787368067.297598 trunc from 0x040000 to 0x023755 (0x1c8aa bytes) 000594 1787368067.315455 mapread 0x0056ca thru 0x010ea0 (0xb7d7 bytes) 000595 1787368067.345584 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x23756): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23756): Mirror 11: 0x7eb175af (stale) Mirror 12: 0x7eb175af (stale) Mirror 14: 0x7eb175af (stale) CRC-32 checksum value for chunk [0, 0x23756): Mirror 1: 0xbdac1da Mirror 15: 0xbdac1da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23756: skipped 000598 1787368068.002575 MIRROR_RESYNC 5 mirrors 000601 1787368068.614639 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) 000602 1787368068.902572 trunc from 0x023756 to 0x03ec7b (0x1b526 bytes) 000603 1787368069.006568 write 0x006553 thru 0x010142 (0x9bf0 bytes) 000605 1787368069.016988 read 0x020510 thru 0x024bd2 (0x46c3 bytes) 000606 1787368069.024480 trunc from 0x03ec7c to 0x038eb3 (0x5dc8 bytes) 000607 1787368069.048545 read 0x01a08b thru 0x01b662 (0x15d8 bytes) 000608 1787368069.060693 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x38eb4): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38eb4): Mirror 11: 0x3d5be259 (stale) Mirror 12: 0x3d5be259 (stale) Mirror 15: 0x3d5be259 (stale) CRC-32 checksum value for chunk [0, 0x38eb4): Mirror 1: 0xaa2a83c7 Mirror 16: 0xaa2a83c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38eb4: skipped 000609 1787368069.924554 mapread 0x0004a4 thru 0x00ad0d (0xa86a bytes) 000610 1787368069.959553 write 0x0234d3 thru 0x02a663 (0x7191 bytes) 000612 1787368070.044412 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38eb4): Mirror 11: 0x3d5be259 (stale) Mirror 12: 0x3d5be259 (stale) Mirror 15: 0x3d5be259 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38eb4): Mirror 11: 0x3d5be259 (stale) Mirror 12: 0x3d5be259 (stale) Mirror 15: 0x3d5be259 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38eb4: skipped 000613 1787368070.351744 mapwrite 0x020674 thru 0x026083 (0x5a10 bytes) 000615 1787368070.468589 MIRROR_RESYNC 4 mirrors 000616 1787368071.536630 trunc from 0x038eb4 to 0x00518b (0x33d28 bytes) 000617 1787368071.610418 read 0x00278e thru 0x00518b (0x29fe bytes) 000618 1787368071.616557 read 0x0007ef thru 0x00518b (0x499d bytes) 000619 1787368071.621687 read 0x003914 thru 0x00518b (0x1878 bytes) 000622 1787368071.623737 write 0x02b08c thru 0x02ea44 (0x39b9 bytes) 000624 1787368071.626461 write 0x038e49 thru 0x03ffff (0x71b7 bytes) 000625 1787368071.628269 read 0x030a53 thru 0x03e4fd (0xdaab bytes) 000629 1787368071.639484 mapread 0x014bcb thru 0x017319 (0x274f bytes) 000630 1787368071.641494 write 0x0219a2 thru 0x022301 (0x960 bytes) 000633 1787368071.644598 read 0x00b1cd thru 0x0160c7 (0xaefb bytes) 000636 1787368071.649404 read 0x02bbc8 thru 0x03023b (0x4674 bytes) 000637 1787368071.650096 mapread 0x000926 thru 0x0048b7 (0x3f92 bytes) 000638 1787368071.650919 mapread 0x016f42 thru 0x023a93 (0xcb52 bytes) 000639 1787368071.656922 write 0x004bdc thru 0x01480d (0xfc32 bytes) 000643 1787368071.670698 write 0x01fcff thru 0x0269d0 (0x6cd2 bytes) 000644 1787368071.676553 mapread 0x00b959 thru 0x00f928 (0x3fd0 bytes) 000645 1787368071.685616 write 0x0367da thru 0x038be8 (0x240f bytes) 000646 1787368071.702589 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x91fea74b (stale) Mirror 15: 0x91fea74b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x91fea74b (stale) Mirror 15: 0x91fea74b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000647 1787368072.021598 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x91fea74b (stale) Mirror 15: 0x91fea74b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x96631b01 Mirror 16: 0x96631b01 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000648 1787368072.794090 mapread 0x007aea thru 0x01725c (0xf773 bytes) 000649 1787368072.837518 read 0x01d349 thru 0x029323 (0xbfdb bytes) 000651 1787368072.865492 write 0x01be67 thru 0x01eb92 (0x2d2c bytes) 000652 1787368072.948462 write 0x00da3b thru 0x013f73 (0x6539 bytes) 000653 1787368072.961880 mapwrite 0x000bf8 thru 0x009433 (0x883c bytes) 000654 1787368073.017773 read 0x0362fe thru 0x03a72e (0x4431 bytes) 000655 1787368073.033021 mapwrite 0x03dd87 thru 0x03ffff (0x2279 bytes) 000656 1787368073.067305 mapread 0x01965c thru 0x026b83 (0xd528 bytes) 000657 1787368073.068477 write 0x007523 thru 0x00c873 (0x5351 bytes) 000661 1787368073.072367 mapread 0x025fb2 thru 0x02682a (0x879 bytes) 000666 1787368073.075701 mapwrite 0x00312d thru 0x007c74 (0x4b48 bytes) 000667 1787368073.109546 mapread 0x029488 thru 0x02e6a5 (0x521e bytes) 000669 1787368073.110991 write 0x01efcb thru 0x02002d (0x1063 bytes) 000670 1787368073.112619 mapwrite 0x0296b3 thru 0x02f345 (0x5c93 bytes) 000671 1787368073.152294 write 0x028cca thru 0x037004 (0xe33b bytes) 000672 1787368073.154687 read 0x01ec83 thru 0x023bf7 (0x4f75 bytes) 000673 1787368073.155392 trunc from 0x040000 to 0x020d21 (0x1f2de bytes) 000676 1787368073.177361 mapread 0x00a9e8 thru 0x00e29c (0x38b5 bytes) 000679 1787368073.179778 mapread 0x0107d6 thru 0x017375 (0x6ba0 bytes) 000680 1787368073.181307 mapread 0x00633e thru 0x00c097 (0x5d5a bytes) 000682 1787368073.186347 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20d22): Mirror 15: 0xa1273201 (stale) Mirror 16: 0xc14b12c1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20d22): Mirror 15: 0xa1273201 (stale) Mirror 16: 0xc14b12c1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20d22: skipped 000683 1787368073.465130 mapwrite 0x024f7c thru 0x0265d0 (0x1655 bytes) 000686 1787368073.530660 mapread 0x01006e thru 0x01a55c (0xa4ef bytes) 000687 1787368073.551339 trunc from 0x0265d1 to 0x01e067 (0x8569 bytes) 000689 1787368073.565896 trunc from 0x01e068 to 0x002076 (0x1bff1 bytes) 000690 1787368073.581952 mapread 0x0016ee thru 0x002076 (0x989 bytes) 000691 1787368073.588528 trunc from 0x002077 to 0x030fe9 (0x2ef73 bytes) 000692 1787368073.605984 trunc from 0x030fea to 0x02a8f6 (0x66f3 bytes) 000693 1787368073.619497 mapread 0x01d25a thru 0x0258cc (0x8673 bytes) 000696 1787368073.630518 read 0x018abe thru 0x01d7be (0x4d01 bytes) 000697 1787368073.634449 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a8f7): Mirror 16: 0x1fdb32f4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a8f7): Mirror 16: 0x1fdb32f4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a8f7: skipped 000698 1787368073.857894 mapread 0x0059ad thru 0x0141a6 (0xe7fa bytes) 000700 1787368073.886351 read 0x012034 thru 0x015f84 (0x3f51 bytes) 000701 1787368073.887316 write 0x014f8c thru 0x017738 (0x27ad bytes) 000702 1787368073.892719 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) 000707 1787368074.004337 mapwrite 0x02aab1 thru 0x02d45d (0x29ad bytes) 000708 1787368074.080356 MIRROR_EXTEND to 2 mirrors 000709 1787368074.526918 read 0x008a26 thru 0x00a3c5 (0x19a0 bytes) 000710 1787368074.536943 read 0x007cea thru 0x010827 (0x8b3e bytes) 000711 1787368074.547814 mapwrite 0x015ae6 thru 0x021867 (0xbd82 bytes) 000712 1787368074.738376 mapwrite 0x026556 thru 0x032a08 (0xc4b3 bytes) 000713 1787368074.855707 mapread 0x0140d9 thru 0x0234bc (0xf3e4 bytes) 000714 1787368074.866648 mapread 0x027549 thru 0x02f004 (0x7abc bytes) 000715 1787368074.869712 write 0x0388d6 thru 0x03ffff (0x772a bytes) 000716 1787368074.871605 mapwrite 0x02497f thru 0x02969b (0x4d1d bytes) 000719 1787368074.909902 mapread 0x03cd5f thru 0x03ffff (0x32a1 bytes) 000720 1787368074.911153 read 0x03031e thru 0x03236d (0x2050 bytes) 000721 1787368074.912218 trunc from 0x040000 to 0x032bd9 (0xd426 bytes) 000722 1787368074.923731 mapwrite 0x0123af thru 0x014f6d (0x2bbf bytes) 000725 1787368074.956414 mapread 0x02b862 thru 0x032bd9 (0x7378 bytes) 000728 1787368074.959486 mapread 0x01a517 thru 0x01bb0e (0x15f8 bytes) 000729 1787368074.960647 trunc from 0x032bda to 0x03f0bd (0xc4e4 bytes) 000732 1787368074.975563 mapwrite 0x024432 thru 0x02e0c5 (0x9c94 bytes) 000733 1787368075.016940 write 0x021515 thru 0x02db29 (0xc615 bytes) 000736 1787368075.018432 write 0x01b6e4 thru 0x029be4 (0xe501 bytes) 000738 1787368075.020406 read 0x0346c5 thru 0x037d21 (0x365d bytes) 000739 1787368075.029533 mapread 0x0248d4 thru 0x02cae2 (0x820f bytes) 000740 1787368075.030469 trunc from 0x03f0be to 0x00c406 (0x32cb7 bytes) 000741 1787368075.047505 mapwrite 0x00949d thru 0x013833 (0xa397 bytes) 000742 1787368075.156186 write 0x017793 thru 0x01aeb6 (0x3724 bytes) 000746 1787368075.158436 mapread 0x0157a2 thru 0x01aeb6 (0x5715 bytes) 000747 1787368075.165895 mapread 0x005cbc thru 0x011126 (0xb46b bytes) 000748 1787368075.166847 mapread 0x00b758 thru 0x01135c (0x5c05 bytes) 000751 1787368075.168456 read 0x009e7d thru 0x00e519 (0x469d bytes) 000752 1787368075.169220 mapwrite 0x015e8b thru 0x01d69b (0x7811 bytes) 000754 1787368075.231320 read 0x00ef70 thru 0x00f11d (0x1ae bytes) 000755 1787368075.232023 read 0x0146fb thru 0x01d69b (0x8fa1 bytes) 000756 1787368075.232913 mapread 0x00bcde thru 0x00d8da (0x1bfd bytes) 000758 1787368075.238025 MIRROR_RESYNC 2 mirrors 000759 1787368075.807298 mapwrite 0x020639 thru 0x02fe17 (0xf7df bytes) 000761 1787368076.029919 trunc from 0x02fe18 to 0x016b75 (0x192a2 bytes) 000765 1787368076.047424 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) 000766 1787368076.195753 write 0x03360d thru 0x03c28e (0x8c82 bytes) 000767 1787368076.201090 read 0x00cefc thru 0x011d53 (0x4e58 bytes) 000769 1787368076.215537 trunc from 0x03c28f to 0x01005a (0x2c234 bytes) 000770 1787368076.242147 trunc from 0x01005b to 0x0119dc (0x1982 bytes) 000771 1787368076.261162 mapread 0x006c50 thru 0x008132 (0x14e3 bytes) 000772 1787368076.286930 mapread 0x0072ec thru 0x0119dc (0xa6f1 bytes) 000773 1787368076.297036 mapwrite 0x01d094 thru 0x02ce18 (0xfd85 bytes) 000774 1787368076.425422 trunc from 0x02ce19 to 0x01412a (0x18cee bytes) 000776 1787368076.455547 mapwrite 0x00e7f5 thru 0x0109f7 (0x2203 bytes) 000777 1787368076.602610 mapwrite 0x00ac10 thru 0x00f8a5 (0x4c96 bytes) 000778 1787368076.688036 write 0x029482 thru 0x02b334 (0x1eb3 bytes) 000781 1787368076.701646 write 0x002ca2 thru 0x004321 (0x1680 bytes) 000786 1787368076.710137 mapwrite 0x007edc thru 0x014b63 (0xcc88 bytes) 000787 1787368076.845744 write 0x00bcc9 thru 0x017e75 (0xc1ad bytes) 000788 1787368076.855276 write 0x02c045 thru 0x03a552 (0xe50e bytes) 000790 1787368076.863737 mapread 0x013359 thru 0x0167bf (0x3467 bytes) 000792 1787368076.866652 mapwrite 0x01640f thru 0x02225f (0xbe51 bytes) 000794 1787368076.947321 write 0x03ca21 thru 0x03fef2 (0x34d2 bytes) 000797 1787368076.950507 trunc from 0x03fef3 to 0x03418f (0xbd63 bytes) 000802 1787368076.973557 trunc from 0x034190 to 0x023c8d (0x10502 bytes) 000803 1787368076.991863 mapread 0x010402 thru 0x01fcf5 (0xf8f4 bytes) 000804 1787368076.993677 mapread 0x010817 thru 0x018cb4 (0x849e bytes) 000806 1787368076.996385 mapwrite 0x002430 thru 0x00ed28 (0xc8f9 bytes) 000809 1787368077.063691 read 0x00fc60 thru 0x0173bb (0x775c bytes) 000810 1787368077.064601 trunc from 0x023c8e to 0x01369f (0x105ee bytes) 000811 1787368077.090990 MIRROR_EXTEND to 2 mirrors 000815 1787368077.802174 mapread 0x00cb1b thru 0x01369f (0x6b85 bytes) 000816 1787368077.837552 write 0x0338ab thru 0x0391f5 (0x594b bytes) 000820 1787368077.929717 mapwrite 0x00d2eb thru 0x015d1b (0x8a31 bytes) 000822 1787368078.007664 mapread 0x02a48f thru 0x033a56 (0x95c8 bytes) 000823 1787368078.016154 mapwrite 0x01bb30 thru 0x02a50a (0xe9db bytes) 000824 1787368078.079120 trunc from 0x0391f6 to 0x0366ee (0x2b07 bytes) 000826 1787368078.099150 mapread 0x000b91 thru 0x007a7d (0x6eed bytes) 000827 1787368078.108664 write 0x0177f6 thru 0x01e31c (0x6b27 bytes) 000830 1787368078.110714 mapread 0x018927 thru 0x01da00 (0x50da bytes) 000832 1787368078.116858 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x366ef): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x366ef): Mirror 2: 0xa313cb9 (stale) CRC-32 checksum value for chunk [0, 0x366ef): Mirror 1: 0x8582ca4e Mirror 3: 0x8582ca4e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x366ef: skipped 000834 1787368078.804698 write 0x01baa2 thru 0x022253 (0x67b2 bytes) 000838 1787368078.896295 read 0x00244a thru 0x002a94 (0x64b bytes) 000839 1787368078.913867 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x366ef): Mirror 2: 0xa313cb9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x366ef): Mirror 2: 0xa313cb9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x366ef: skipped 000841 1787368079.256321 mapwrite 0x00f22b thru 0x014a29 (0x57ff bytes) 000843 1787368079.345661 write 0x024e4f thru 0x0257c0 (0x972 bytes) 000844 1787368079.357721 mapwrite 0x02d797 thru 0x02f65f (0x1ec9 bytes) 000845 1787368079.403647 write 0x0211e6 thru 0x02da37 (0xc852 bytes) 000846 1787368079.423951 write 0x03d271 thru 0x03ffff (0x2d8f bytes) 000851 1787368079.438437 mapwrite 0x0214d5 thru 0x03114e (0xfc7a bytes) 000852 1787368079.524199 read 0x028061 thru 0x036dc0 (0xed60 bytes) 000855 1787368079.530644 trunc from 0x040000 to 0x0032e9 (0x3cd16 bytes) 000856 1787368079.557465 read 0x000d24 thru 0x0032e9 (0x25c6 bytes) 000858 1787368079.562803 trunc from 0x0032ea to 0x036d58 (0x33a6f bytes) 000859 1787368079.583590 mapread 0x0355b0 thru 0x036d58 (0x17a9 bytes) 000862 1787368079.597620 read 0x035154 thru 0x036d58 (0x1c05 bytes) 000863 1787368079.598413 mapread 0x02aef3 thru 0x0352c4 (0xa3d2 bytes) 000864 1787368079.600475 mapwrite 0x014867 thru 0x024495 (0xfc2f bytes) 000865 1787368079.709275 write 0x0160f7 thru 0x01665c (0x566 bytes) 000866 1787368079.710182 trunc from 0x036d59 to 0x03b6e9 (0x4991 bytes) 000868 1787368079.731291 read 0x0154a1 thru 0x01e8dd (0x943d bytes) 000869 1787368079.732329 mapwrite 0x01bed9 thru 0x028cf2 (0xce1a bytes) 000870 1787368079.806321 MIRROR_RESYNC 2 mirrors 000872 1787368080.901302 read 0x03814a thru 0x03b6e9 (0x35a0 bytes) 000873 1787368080.919689 mapread 0x03a83d thru 0x03b6e9 (0xead bytes) 000875 1787368080.923405 mapwrite 0x0228a2 thru 0x027ddf (0x553e bytes) 000876 1787368081.100779 read 0x00c3ab thru 0x013244 (0x6e9a bytes) 000877 1787368081.110293 mapread 0x02f4fe thru 0x03b6e9 (0xc1ec bytes) 000880 1787368081.113461 trunc from 0x03b6ea to 0x01a5e0 (0x21109 bytes) 000881 1787368081.142220 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1a5e1): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a5e1): Mirror 2: 0xeab370a2 (stale) CRC-32 checksum value for chunk [0, 0x1a5e1): Mirror 1: 0xeab370a2 Mirror 3: 0xeab370a2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a5e1: skipped 000882 1787368081.783636 mapread 0x001f7c thru 0x00ab71 (0x8bf6 bytes) 000883 1787368081.812157 read 0x009077 thru 0x016aaf (0xda39 bytes) 000885 1787368081.828208 trunc from 0x01a5e1 to 0x012ee1 (0x76ff bytes) 000888 1787368081.925960 mapwrite 0x02cbda thru 0x0374fd (0xa924 bytes) 000889 1787368082.017576 mapread 0x02282b thru 0x0230d6 (0x8ac bytes) 000890 1787368082.032479 trunc from 0x0374fe to 0x02a032 (0xd4cb bytes) 000891 1787368082.068564 trunc from 0x02a033 to 0x0274e2 (0x2b50 bytes) 000894 1787368082.100586 mapread 0x01921f thru 0x01ce9f (0x3c81 bytes) 000901 1787368082.129642 mapwrite 0x0034ab thru 0x0054a7 (0x1ffd bytes) 000902 1787368082.279423 trunc from 0x0274e3 to 0x03b4a6 (0x13fc4 bytes) 000905 1787368082.299407 read 0x0146a4 thru 0x01509d (0x9fa bytes) 000906 1787368082.300810 write 0x0343f7 thru 0x039a19 (0x5623 bytes) 000909 1787368082.336252 mapwrite 0x018ab2 thru 0x020dfa (0x8349 bytes) 000912 1787368082.465795 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b4a7): Mirror 2: 0x6d3cc525 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b4a7): Mirror 2: 0x6d3cc525 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b4a7: skipped 000914 1787368082.868753 MIRROR_RESYNC 2 mirrors 000915 1787368083.493529 read 0x0294be thru 0x02c624 (0x3167 bytes) 000916 1787368083.505348 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) 000921 1787368083.648284 mapwrite 0x02f060 thru 0x03513d (0x60de bytes) 000922 1787368083.726979 mapwrite 0x00f850 thru 0x012fe0 (0x3791 bytes) 000924 1787368083.768937 write 0x021180 thru 0x027b29 (0x69aa bytes) 000925 1787368083.779375 read 0x037f0a thru 0x03b4a6 (0x359d bytes) 000927 1787368083.788622 MIRROR_EXTEND to 2 mirrors 000930 1787368084.351608 read 0x00a842 thru 0x012497 (0x7c56 bytes) 000931 1787368084.371416 write 0x01299f thru 0x01ccfb (0xa35d bytes) 000934 1787368084.447457 mapread 0x009b54 thru 0x00ba7c (0x1f29 bytes) 000936 1787368084.465170 trunc from 0x03b4a7 to 0x02afa8 (0x104fe bytes) 000937 1787368084.485352 read 0x01d0ad thru 0x01e1d9 (0x112d bytes) 000938 1787368084.508728 read 0x0091be thru 0x00d4a7 (0x42ea bytes) 000939 1787368084.509733 mapwrite 0x01c030 thru 0x02622b (0xa1fc bytes) 000940 1787368084.607514 mapread 0x0171d0 thru 0x01e377 (0x71a8 bytes) 000941 1787368084.608680 mapread 0x00947b thru 0x01553d (0xc0c3 bytes) 000943 1787368084.620012 MIRROR_RESYNC 2 mirrors 000944 1787368085.079961 write 0x032ee1 thru 0x03abf0 (0x7d10 bytes) 000946 1787368085.135634 mapread 0x01e037 thru 0x02b4af (0xd479 bytes) 000949 1787368085.170201 read 0x023f01 thru 0x029385 (0x5485 bytes) 000951 1787368085.175448 MIRROR_RESYNC 2 mirrors 000953 1787368085.943638 mapread 0x0103b5 thru 0x015002 (0x4c4e bytes) 000955 1787368085.963540 read 0x033051 thru 0x03abf0 (0x7ba0 bytes) 000956 1787368085.970978 read 0x003fc8 thru 0x011bb0 (0xdbe9 bytes) 000958 1787368085.982232 read 0x036715 thru 0x03784c (0x1138 bytes) 000960 1787368085.987458 write 0x03a05d thru 0x03ffff (0x5fa3 bytes) 000961 1787368086.108545 read 0x022652 thru 0x0254de (0x2e8d bytes) 000962 1787368086.109552 read 0x025ab4 thru 0x030396 (0xa8e3 bytes) 000963 1787368086.117359 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d8:0x0]: Invalid argument (22) 000964 1787368086.285035 write 0x026833 thru 0x026bf6 (0x3c4 bytes) 000965 1787368086.288552 mapread 0x01f5ea thru 0x02cce2 (0xd6f9 bytes) 000967 1787368086.329185 mapwrite 0x03cfb6 thru 0x03ffff (0x304a bytes) 000968 1787368086.425013 write 0x0111ce thru 0x01c63e (0xb471 bytes) 000969 1787368086.438536 read 0x0029e5 thru 0x009f12 (0x752e bytes) 000970 1787368086.464282 trunc from 0x040000 to 0x01c095 (0x23f6a bytes) 000971 1787368086.526329 read 0x002ecc thru 0x0048d4 (0x1a09 bytes) 000975 1787368086.528659 write 0x036562 thru 0x03adea (0x4889 bytes) 000977 1787368086.531691 trunc from 0x03adeb to 0x00c3d2 (0x2ea18 bytes) 000979 1787368086.550665 trunc from 0x00c3d3 to 0x01bb83 (0xf7b1 bytes) 000982 1787368086.566456 trunc from 0x01bb84 to 0x026c69 (0xb0e6 bytes) 000983 1787368086.580309 read 0x00212e thru 0x009b2b (0x79fe bytes) 000985 1787368086.581941 trunc from 0x026c6a to 0x0164dd (0x1078c bytes) 000991 1787368086.598433 mapread 0x0116ff thru 0x0164dd (0x4ddf bytes) 000992 1787368086.608523 write 0x01c9d0 thru 0x027d7d (0xb3ae bytes) 000993 1787368086.609868 read 0x021254 thru 0x024fe1 (0x3d8e bytes) 000994 1787368086.610622 mapwrite 0x00bba2 thru 0x0106c5 (0x4b24 bytes) 000995 1787368086.649725 read 0x024125 thru 0x027d7d (0x3c59 bytes) 000996 1787368086.650348 trunc from 0x027d7e to 0x009742 (0x1e63b bytes) 000997 1787368086.662532 read 0x000c8f thru 0x009742 (0x8ab4 bytes) 000999 1787368086.664322 read 0x0084a6 thru 0x009742 (0x129d bytes) All operations completed A-OK!