== sanity-flr test 70a: flr mode fsx test ================ 06:08:48 (1786529328) Seed set to 9330 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x27485 000002 1786529331.301489 trunc from 00000000 to 0x027484 (0x27485 bytes) 000004 1786529331.336274 mapread 0x00af39 thru 0x00ddec (0x2eb4 bytes) truncating to largest ever: 0x2c030 000007 1786529331.373492 trunc from 0x027485 to 0x02c02f (0x4bab bytes) 000008 1786529331.411410 read 0x00557e thru 0x0145f4 (0xf077 bytes) 000009 1786529331.412531 write 0x0127f0 thru 0x01eda5 (0xc5b6 bytes) 000012 1786529331.424462 read 0x016375 thru 0x018808 (0x2494 bytes) 000016 1786529331.432458 mapwrite 0x0029f0 thru 0x011d39 (0xf34a bytes) 000017 1786529331.700995 mapread 0x01366d thru 0x022102 (0xea96 bytes) 000018 1786529331.702460 mapread 0x00f4c3 thru 0x0128af (0x33ed bytes) 000019 1786529331.706327 mapwrite 0x0189a0 thru 0x02863f (0xfca0 bytes) 000020 1786529331.789015 read 0x016d69 thru 0x0242da (0xd572 bytes) 000025 1786529331.800619 mapwrite 0x01a4c4 thru 0x027839 (0xd376 bytes) 000026 1786529331.895060 mapwrite 0x039adc thru 0x03ffff (0x6524 bytes) 000027 1786529332.077272 mapwrite 0x00427b thru 0x00dc00 (0x9986 bytes) 000033 1786529332.144487 trunc from 0x040000 to 0x02ac0e (0x153f1 bytes) 000034 1786529332.164775 mapwrite 0x00a7af thru 0x00e9cd (0x421f bytes) 000035 1786529332.253059 mapwrite 0x038cd1 thru 0x03ffff (0x732f bytes) 000036 1786529332.449299 trunc from 0x040000 to 0x01b4f1 (0x24b0e bytes) 000037 1786529332.478267 read 0x008efd thru 0x013a97 (0xab9b bytes) truncating to largest ever: 0x39167 000039 1786529332.480930 trunc from 0x01b4f2 to 0x039166 (0x1dc75 bytes) 000040 1786529332.509484 mapread 0x023809 thru 0x02b3b1 (0x7ba9 bytes) truncating to largest ever: 0x3ae64 000042 1786529332.527472 trunc from 0x039167 to 0x03ae63 (0x1cfd bytes) 000043 1786529332.551842 mapwrite 0x03efb3 thru 0x03ffff (0x104d bytes) 000044 1786529332.676003 trunc from 0x040000 to 0x024810 (0x1b7ef bytes) 000045 1786529332.709850 mapread 0x018e04 thru 0x01c331 (0x352e bytes) 000046 1786529332.714296 mapwrite 0x01cd82 thru 0x0272c3 (0xa542 bytes) 000047 1786529332.878323 read 0x022a5b thru 0x0272c3 (0x4869 bytes) 000049 1786529332.881567 trunc from 0x0272c4 to 0x03a6c6 (0x13403 bytes) 000050 1786529332.914895 mapread 0x01af86 thru 0x01fad2 (0x4b4d bytes) 000052 1786529332.919801 read 0x032a1d thru 0x034f1b (0x24ff bytes) 000053 1786529332.934998 read 0x005c62 thru 0x00c490 (0x682f bytes) 000059 1786529332.943779 mapread 0x0226fd thru 0x031c91 (0xf595 bytes) 000062 1786529332.967213 mapread 0x0399d4 thru 0x03a6c6 (0xcf3 bytes) 000063 1786529332.975585 read 0x01ed8d thru 0x020025 (0x1299 bytes) 000064 1786529332.981015 mapread 0x019800 thru 0x02235a (0x8b5b bytes) 000066 1786529332.990835 mapread 0x02d8a9 thru 0x02eee5 (0x163d bytes) 000067 1786529332.994921 trunc from 0x03a6c7 to 0x024ae4 (0x15be2 bytes) 000069 1786529333.057523 mapread 0x022d79 thru 0x024ae4 (0x1d6c bytes) 000073 1786529333.064636 mapread 0x0140b2 thru 0x01f46f (0xb3be bytes) 000076 1786529333.096983 MIRROR_EXTEND to 2 mirrors 000077 1786529334.512217 MIRROR_RESYNC 2 mirrors 000078 1786529335.135317 write 0x03e4a9 thru 0x03ffff (0x1b57 bytes) 000082 1786529335.289875 mapread 0x03839b thru 0x03ffff (0x7c65 bytes) 000083 1786529335.331246 mapwrite 0x03d40d thru 0x03ffff (0x2bf3 bytes) 000085 1786529335.429908 MIRROR_RESYNC 2 mirrors 000087 1786529336.353760 mapread 0x01fa55 thru 0x02587c (0x5e28 bytes) 000088 1786529336.374884 mapwrite 0x03e3b8 thru 0x03ffff (0x1c48 bytes) 000092 1786529336.535756 mapread 0x01d734 thru 0x01efe8 (0x18b5 bytes) 000093 1786529336.551328 write 0x002e61 thru 0x00e7e4 (0xb984 bytes) 000094 1786529336.583043 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4d914335 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x94bd94b2 Mirror 3: 0x94bd94b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000095 1786529337.718410 mapread 0x00d7a2 thru 0x00f879 (0x20d8 bytes) 000096 1786529337.755873 write 0x013fdd thru 0x017984 (0x39a8 bytes) 000097 1786529337.958202 mapread 0x02b385 thru 0x035642 (0xa2be bytes) 000098 1786529338.009734 write 0x0369bd thru 0x0384e7 (0x1b2b bytes) 000099 1786529338.012638 mapwrite 0x0354f9 thru 0x03fae9 (0xa5f1 bytes) 000100 1786529338.155425 write 0x00d41e thru 0x01804c (0xac2f bytes) 000101 1786529338.169753 read 0x028826 thru 0x02d1b2 (0x498d bytes) 000103 1786529338.171038 mapread 0x02ca65 thru 0x0317cc (0x4d68 bytes) 000104 1786529338.173717 mapwrite 0x038bff thru 0x03ffff (0x7401 bytes) 000106 1786529338.270510 write 0x035a58 thru 0x03614b (0x6f4 bytes) 000108 1786529338.276766 mapread 0x004af3 thru 0x011331 (0xc83f bytes) 000109 1786529338.316385 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x94bd94b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x94bd94b2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000110 1786529338.765201 write 0x026e4a thru 0x0272ef (0x4a6 bytes) 000111 1786529338.778076 trunc from 0x040000 to 0x00237f (0x3dc80 bytes) 000112 1786529338.804297 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) 000113 1786529338.925556 read 0x001ca1 thru 0x00237f (0x6df bytes) 000114 1786529338.932474 mapread 0x00012e thru 0x00237f (0x2252 bytes) 000118 1786529338.941844 trunc from 0x002380 to 0x02554e (0x231cf bytes) 000119 1786529338.956384 mapread 0x00ad4e thru 0x013fc0 (0x9273 bytes) 000122 1786529338.976091 mapread 0x005b56 thru 0x01334f (0xd7fa bytes) 000123 1786529338.980777 mapread 0x003acc thru 0x00b585 (0x7aba bytes) 000125 1786529338.986967 mapread 0x020c6a thru 0x02554e (0x48e5 bytes) 000126 1786529338.997810 mapwrite 0x03a883 thru 0x03c24e (0x19cc bytes) 000128 1786529339.060478 read 0x01859f thru 0x022e3e (0xa8a0 bytes) 000131 1786529339.076296 mapread 0x03a071 thru 0x03c24e (0x21de bytes) 000133 1786529339.078633 write 0x015a79 thru 0x016a9c (0x1024 bytes) 000135 1786529339.080558 mapwrite 0x0284d2 thru 0x028741 (0x270 bytes) 000140 1786529339.124036 trunc from 0x03c24f to 0x0184fa (0x23d54 bytes) 000145 1786529339.143476 mapwrite 0x01974d thru 0x0231d8 (0x9a8c bytes) 000150 1786529339.259780 trunc from 0x0231d9 to 0x039d15 (0x16b3d bytes) 000154 1786529339.285417 read 0x0255ad thru 0x034217 (0xec6b bytes) 000156 1786529339.297786 read 0x028658 thru 0x02b260 (0x2c09 bytes) 000158 1786529339.299907 trunc from 0x039d16 to 0x02d3e7 (0xc92e bytes) 000160 1786529339.317416 mapread 0x028dd7 thru 0x0299ed (0xc17 bytes) 000161 1786529339.318753 read 0x01d569 thru 0x01f388 (0x1e20 bytes) 000162 1786529339.320256 read 0x00d491 thru 0x0112cd (0x3e3d bytes) 000163 1786529339.321699 trunc from 0x02d3e8 to 0x0256ae (0x7d39 bytes) 000165 1786529339.339622 read 0x0250e0 thru 0x0256ae (0x5cf bytes) 000166 1786529339.340267 write 0x026896 thru 0x036868 (0xffd3 bytes) 000169 1786529339.345840 mapread 0x00fa45 thru 0x013182 (0x373e bytes) 000170 1786529339.347713 write 0x0009e1 thru 0x00e657 (0xdc77 bytes) 000171 1786529339.349483 trunc from 0x036869 to 0x01e81e (0x1804a bytes) 000172 1786529339.367827 mapwrite 0x039f98 thru 0x03b26e (0x12d7 bytes) 000174 1786529339.433411 trunc from 0x03b26f to 0x021aef (0x1977f bytes) 000177 1786529339.450467 mapread 0x003cc5 thru 0x009f48 (0x6284 bytes) 000178 1786529339.452765 read 0x010b32 thru 0x01f64b (0xeb1a bytes) 000183 1786529339.457958 trunc from 0x021af0 to 0x02990e (0x7e1f bytes) 000185 1786529339.475151 read 0x018af8 thru 0x01cacd (0x3fd6 bytes) 000187 1786529339.477301 mapread 0x016b02 thru 0x026a12 (0xff11 bytes) 000188 1786529339.484927 read 0x0067c0 thru 0x00993d (0x317e bytes) 000191 1786529339.487211 mapread 0x01ac8f thru 0x02707d (0xc3ef bytes) 000193 1786529339.489901 mapread 0x019fad thru 0x01c864 (0x28b8 bytes) 000198 1786529339.495075 read 0x009781 thru 0x014be4 (0xb464 bytes) 000200 1786529339.497480 mapwrite 0x00fd8d thru 0x0135bb (0x382f bytes) 000203 1786529339.593010 write 0x0015d2 thru 0x009c78 (0x86a7 bytes) 000204 1786529339.596168 trunc from 0x02990f to 0x0142a7 (0x15667 bytes) 000205 1786529339.626486 read 0x0027d5 thru 0x00e924 (0xc150 bytes) 000208 1786529339.631929 read 0x0025b9 thru 0x0123ea (0xfe32 bytes) 000209 1786529339.637768 mapwrite 0x03325f thru 0x03b9ae (0x8750 bytes) 000210 1786529339.826057 read 0x019385 thru 0x028a78 (0xf6f4 bytes) 000211 1786529339.828852 write 0x033535 thru 0x034059 (0xb25 bytes) 000212 1786529339.830137 write 0x002d07 thru 0x007867 (0x4b61 bytes) 000214 1786529339.833466 write 0x009875 thru 0x016eae (0xd63a bytes) 000215 1786529339.842708 mapwrite 0x013bf1 thru 0x01ad6d (0x717d bytes) 000217 1786529339.928706 write 0x01b700 thru 0x024875 (0x9176 bytes) 000218 1786529339.930067 trunc from 0x03b9af to 0x029828 (0x12186 bytes) 000220 1786529339.951836 mapwrite 0x021182 thru 0x02c587 (0xb406 bytes) 000222 1786529340.085395 write 0x01d5bb thru 0x021aca (0x4510 bytes) 000224 1786529340.087939 read 0x01a960 thru 0x027d52 (0xd3f3 bytes) 000225 1786529340.089053 mapwrite 0x0058c5 thru 0x00952b (0x3c67 bytes) 000226 1786529340.137120 write 0x011d2a thru 0x01e9f1 (0xccc8 bytes) 000229 1786529340.141677 trunc from 0x02c588 to 0x0160b5 (0x164d2 bytes) 000231 1786529340.160643 mapwrite 0x0259cf thru 0x027b35 (0x2167 bytes) 000234 1786529340.230330 trunc from 0x027b36 to 0x029968 (0x1e33 bytes) 000238 1786529340.250429 mapwrite 0x023058 thru 0x02b6dc (0x8685 bytes) 000239 1786529340.318421 read 0x007f0c thru 0x00ae73 (0x2f68 bytes) 000240 1786529340.324168 MIRROR_EXTEND to 2 mirrors 000241 1786529341.078503 MIRROR_EXTEND to 3 mirrors 000244 1786529341.837378 write 0x038d93 thru 0x03ffff (0x726d bytes) 000245 1786529341.924143 trunc from 0x040000 to 0x03a56b (0x5a94 bytes) 000246 1786529341.969930 mapread 0x00fbfa thru 0x01f414 (0xf81b bytes) 000255 1786529342.030597 mapwrite 0x01522a thru 0x01b6eb (0x64c2 bytes) 000256 1786529342.091558 mapwrite 0x022df3 thru 0x030e4e (0xe05c bytes) 000257 1786529342.185959 MIRROR_RESYNC 3 mirrors 000259 1786529343.170597 trunc from 0x03a56c to 0x01155a (0x29011 bytes) 000260 1786529343.306587 trunc from 0x01155b to 0x016453 (0x4ef9 bytes) 000261 1786529343.350377 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x16454): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16454): Mirror 2: 0xa8d00bd5 (stale) Mirror 3: 0xa8d00bd5 (stale) CRC-32 checksum value for chunk [0, 0x16454): Mirror 1: 0x1d309d5b Mirror 4: 0x1d309d5b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16454: skipped 000262 1786529344.446366 trunc from 0x016454 to 0x0039d3 (0x12a80 bytes) 000265 1786529344.586407 mapwrite 0x01310b thru 0x01fa80 (0xc976 bytes) 000266 1786529344.783159 write 0x02bdf6 thru 0x02d463 (0x166e bytes) 000269 1786529344.801685 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2d464): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d464): Mirror 2: 0xf29b68e (stale) Mirror 3: 0xf29b68e (stale) Mirror 4: 0x49d2f21d (stale) CRC-32 checksum value for chunk [0, 0x2d464): Mirror 1: 0xc39003e7 Mirror 5: 0xc39003e7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d464: skipped 000270 1786529345.963878 read 0x029025 thru 0x02d463 (0x443f bytes) 000271 1786529345.988861 write 0x0308ca thru 0x03af1c (0xa653 bytes) 000273 1786529346.069744 trunc from 0x03af1d to 0x030c60 (0xa2bc bytes) 000275 1786529346.096822 mapwrite 0x01eb29 thru 0x0254bf (0x6997 bytes) 000277 1786529346.237053 MIRROR_RESYNC 5 mirrors 000280 1786529347.651334 mapread 0x017797 thru 0x01f38f (0x7bf9 bytes) 000281 1786529347.691806 write 0x001ae7 thru 0x004383 (0x289d bytes) 000282 1786529347.854778 MIRROR_RESYNC 5 mirrors 000283 1786529348.828996 MIRROR_RESYNC 5 mirrors 000284 1786529349.305473 write 0x03a00c thru 0x03ffff (0x5ff4 bytes) 000285 1786529349.400900 mapwrite 0x00ad48 thru 0x00fc37 (0x4ef0 bytes) 000286 1786529349.459408 write 0x00ee5f thru 0x016d31 (0x7ed3 bytes) 000287 1786529349.464875 mapread 0x02a4ab thru 0x0348e2 (0xa438 bytes) 000289 1786529349.521942 MIRROR_RESYNC 5 mirrors 000294 1786529350.498978 write 0x01ada3 thru 0x021c14 (0x6e72 bytes) 000296 1786529350.626909 mapread 0x00d436 thru 0x018277 (0xae42 bytes) 000297 1786529350.663669 mapread 0x03cb6e thru 0x03ffff (0x3492 bytes) 000299 1786529350.696772 mapread 0x00201b thru 0x0083e8 (0x63ce bytes) 000300 1786529350.735704 write 0x023422 thru 0x02c21b (0x8dfa bytes) 000302 1786529350.758139 read 0x03b5b8 thru 0x03ffff (0x4a48 bytes) 000304 1786529350.765151 trunc from 0x040000 to 0x0335ac (0xca53 bytes) 000305 1786529350.798414 write 0x011b6b thru 0x01c7b8 (0xac4e bytes) 000306 1786529350.801143 read 0x019d31 thru 0x021026 (0x72f6 bytes) 000307 1786529350.802601 read 0x00327a thru 0x00c401 (0x9188 bytes) 000308 1786529350.804970 mapwrite 0x00b9c5 thru 0x01046f (0x4aab bytes) truncating to largest ever: 0x3ee07 000309 1786529350.894254 trunc from 0x0335ad to 0x03ee06 (0xb85a bytes) 000310 1786529350.917442 mapread 0x031869 thru 0x03ee06 (0xd59e bytes) 000312 1786529350.950956 read 0x02fa7e thru 0x03a2e6 (0xa869 bytes) 000313 1786529350.954258 mapwrite 0x0063dd thru 0x00bfad (0x5bd1 bytes) 000315 1786529351.055065 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ee07): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ee07): Mirror 2: 0xaa1833aa (stale) Mirror 3: 0xaa1833aa (stale) Mirror 4: 0xaa1833aa (stale) Mirror 5: 0xaa1833aa (stale) CRC-32 checksum value for chunk [0, 0x3ee07): Mirror 1: 0x5818dda7 Mirror 6: 0x5818dda7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ee07: skipped 000316 1786529352.027738 read 0x02dd31 thru 0x03294f (0x4c1f bytes) 000317 1786529352.053507 read 0x01c017 thru 0x025fe5 (0x9fcf bytes) 000318 1786529352.085593 MIRROR_RESYNC 6 mirrors 000319 1786529353.025531 write 0x0113fa thru 0x01583d (0x4444 bytes) 000322 1786529353.127296 read 0x017e8f thru 0x0237bc (0xb92e bytes) 000323 1786529353.135785 mapread 0x00f5a9 thru 0x019ae5 (0xa53d bytes) 000324 1786529353.163353 mapwrite 0x014560 thru 0x01682c (0x22cd bytes) 000328 1786529353.246960 write 0x01c777 thru 0x029927 (0xd1b1 bytes) 000329 1786529353.261178 mapread 0x033dd4 thru 0x03c5c7 (0x87f4 bytes) 000330 1786529353.302448 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ee07): Mirror 3: 0x5818dda7 (stale) Mirror 4: 0x5818dda7 (stale) Mirror 5: 0x5818dda7 (stale) Mirror 6: 0x5818dda7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ee07): Mirror 3: 0x5818dda7 (stale) Mirror 4: 0x5818dda7 (stale) Mirror 5: 0x5818dda7 (stale) Mirror 6: 0x5818dda7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ee07: skipped 000331 1786529353.741164 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ee07): Mirror 4: 0x5818dda7 (stale) Mirror 5: 0x5818dda7 (stale) Mirror 6: 0x5818dda7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ee07): Mirror 4: 0x5818dda7 (stale) Mirror 5: 0x5818dda7 (stale) Mirror 6: 0x5818dda7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ee07: skipped 000332 1786529354.136043 write 0x015df3 thru 0x021799 (0xb9a7 bytes) 000334 1786529354.151784 mapwrite 0x021691 thru 0x02ec17 (0xd587 bytes) 000335 1786529354.245158 mapwrite 0x01c3f1 thru 0x02adae (0xe9be bytes) 000339 1786529354.286004 mapwrite 0x034396 thru 0x03b9d1 (0x763c bytes) 000340 1786529354.372515 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3ee07): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ee07): Mirror 4: 0x5818dda7 (stale) Mirror 5: 0x5818dda7 (stale) Mirror 6: 0x5818dda7 (stale) CRC-32 checksum value for chunk [0, 0x3ee07): Mirror 1: 0x4fa00f8f Mirror 7: 0x4fa00f8f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ee07: skipped 000341 1786529355.310690 mapwrite 0x007317 thru 0x0152f1 (0xdfdb bytes) 000342 1786529355.571705 trunc from 0x03ee07 to 0x0141be (0x2ac48 bytes) 000343 1786529355.615839 trunc from 0x0141bf to 0x0133bd (0xe01 bytes) 000345 1786529355.633877 trunc from 0x0133be to 0x00fdcc (0x35f1 bytes) 000347 1786529355.663609 trunc from 0x00fdcd to 0x01806b (0x829f bytes) 000348 1786529355.679470 mapwrite 0x00ea11 thru 0x01571c (0x6d0c bytes) 000349 1786529355.738690 mapwrite 0x014890 thru 0x0244f2 (0xfc63 bytes) 000353 1786529355.824685 mapwrite 0x00d18c thru 0x013cbe (0x6b33 bytes) 000358 1786529355.947562 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x244f3): Mirror 5: 0x4a6e5490 (stale) Mirror 6: 0x4a6e5490 (stale) Mirror 7: 0xb0fa3452 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x244f3): Mirror 5: 0x4a6e5490 (stale) Mirror 6: 0x4a6e5490 (stale) Mirror 7: 0xb0fa3452 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x244f3: skipped 000359 1786529356.496376 mapread 0x0093a7 thru 0x0113f1 (0x804b bytes) 000360 1786529356.527196 mapread 0x000f01 thru 0x00d373 (0xc473 bytes) 000362 1786529356.546322 mapread 0x01d40e thru 0x0244f2 (0x70e5 bytes) 000364 1786529356.567003 mapwrite 0x0125ab thru 0x01774a (0x51a0 bytes) 000365 1786529356.671049 trunc from 0x0244f3 to 0x0268b6 (0x23c4 bytes) 000367 1786529356.711149 MIRROR_RESYNC 4 mirrors 000370 1786529357.942332 read 0x007021 thru 0x00fe43 (0x8e23 bytes) 000371 1786529357.954550 mapwrite 0x023417 thru 0x02441d (0x1007 bytes) 000372 1786529358.183299 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x268b7): Mirror 5: 0xe9ca883b (stale) Mirror 6: 0xe9ca883b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x268b7): Mirror 5: 0xe9ca883b (stale) Mirror 6: 0xe9ca883b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x268b7: skipped 000373 1786529358.622777 mapwrite 0x017dc1 thru 0x019556 (0x1796 bytes) 000374 1786529358.715480 write 0x022143 thru 0x022683 (0x541 bytes) 000377 1786529358.731957 mapwrite 0x03b466 thru 0x03ffff (0x4b9a bytes) 000378 1786529358.819966 trunc from 0x040000 to 0x029b3d (0x164c2 bytes) 000379 1786529358.843783 write 0x00e260 thru 0x01283b (0x45dc bytes) 000380 1786529358.854986 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29b3e): Mirror 5: 0xace6d91f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29b3e): Mirror 5: 0xace6d91f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29b3e: skipped 000382 1786529359.161809 mapread 0x0239ab thru 0x029b3d (0x6193 bytes) 000384 1786529359.200695 write 0x036caa thru 0x03ffff (0x9356 bytes) 000385 1786529359.203532 write 0x01a7ab thru 0x0290b4 (0xe90a bytes) 000388 1786529359.211078 write 0x02bbc3 thru 0x0353da (0x9818 bytes) 000389 1786529359.232801 mapread 0x026d78 thru 0x02f756 (0x89df bytes) 000391 1786529359.246604 read 0x030817 thru 0x031a79 (0x1263 bytes) 000393 1786529359.250642 write 0x001716 thru 0x002a4d (0x1338 bytes) 000396 1786529359.267989 mapread 0x0398c9 thru 0x03ffff (0x6737 bytes) 000399 1786529359.280954 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) 000402 1786529359.485308 mapread 0x021e23 thru 0x02e17c (0xc35a bytes) 000403 1786529359.515076 mapwrite 0x029d92 thru 0x03193b (0x7baa bytes) 000404 1786529359.566796 mapwrite 0x00b78a thru 0x012552 (0x6dc9 bytes) 000406 1786529359.627940 read 0x0319be thru 0x03ffff (0xe642 bytes) 000408 1786529359.650450 mapread 0x034fbd thru 0x0371b5 (0x21f9 bytes) 000410 1786529359.652388 trunc from 0x040000 to 0x02bf86 (0x14079 bytes) 000411 1786529359.671085 mapread 0x015751 thru 0x02397e (0xe22e bytes) 000412 1786529359.697039 mapwrite 0x01b487 thru 0x01d936 (0x24b0 bytes) 000413 1786529359.801843 read 0x003c47 thru 0x0120ce (0xe488 bytes) 000414 1786529359.812533 write 0x0110bf thru 0x01f825 (0xe767 bytes) 000416 1786529359.822680 mapwrite 0x02966b thru 0x0381cc (0xeb62 bytes) 000417 1786529359.934556 write 0x029373 thru 0x0386d1 (0xf35f bytes) 000420 1786529359.940635 trunc from 0x0386d2 to 0x017150 (0x21581 bytes) 000421 1786529359.965207 mapwrite 0x013fce thru 0x023a71 (0xfaa4 bytes) 000422 1786529360.099492 mapwrite 0x019f1b thru 0x01fe7a (0x5f60 bytes) 000423 1786529360.135494 write 0x03eea2 thru 0x03ffff (0x115e bytes) 000424 1786529360.136636 mapwrite 0x00c33a thru 0x01bff5 (0xfcbc bytes) 000426 1786529360.175482 mapread 0x02b0e6 thru 0x036abc (0xb9d7 bytes) 000427 1786529360.248403 write 0x002ce1 thru 0x00ce53 (0xa173 bytes) 000428 1786529360.251637 mapread 0x00894e thru 0x0149d9 (0xc08c bytes) 000429 1786529360.253457 mapread 0x02528e thru 0x02f896 (0xa609 bytes) 000430 1786529360.284427 read 0x03e288 thru 0x03ffff (0x1d78 bytes) 000432 1786529360.286599 mapread 0x010d2b thru 0x02099d (0xfc73 bytes) 000433 1786529360.289336 read 0x0379a6 thru 0x03df4a (0x65a5 bytes) 000435 1786529360.299591 mapread 0x00fb44 thru 0x01902b (0x94e8 bytes) 000438 1786529360.303200 mapread 0x0272c1 thru 0x028d06 (0x1a46 bytes) 000439 1786529360.304318 mapread 0x0024f8 thru 0x006799 (0x42a2 bytes) 000444 1786529360.318889 MIRROR_EXTEND to 2 mirrors 000445 1786529361.158923 MIRROR_EXTEND to 3 mirrors 000446 1786529362.025678 read 0x036160 thru 0x03ffff (0x9ea0 bytes) 000448 1786529362.038607 read 0x014006 thru 0x01ccc8 (0x8cc3 bytes) 000449 1786529362.076590 MIRROR_EXTEND to 4 mirrors 000450 1786529362.843739 write 0x031021 thru 0x035375 (0x4355 bytes) 000451 1786529362.913470 read 0x00249a thru 0x00766e (0x51d5 bytes) 000452 1786529362.923459 mapwrite 0x027a17 thru 0x03428d (0xc877 bytes) 000454 1786529363.003551 mapwrite 0x013e53 thru 0x01d650 (0x97fe bytes) 000455 1786529363.072787 mapwrite 0x027995 thru 0x0366c3 (0xed2f bytes) 000456 1786529363.146993 trunc from 0x040000 to 0x002881 (0x3d77e bytes) 000460 1786529363.181234 read 0x000d2e thru 0x002881 (0x1b54 bytes) 000461 1786529363.204335 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2882): Mirror 3: 0xcb908198 (stale) Mirror 4: 0xcb908198 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2882): Mirror 3: 0xcb908198 (stale) Mirror 4: 0xcb908198 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2882: skipped 000462 1786529363.624395 read 0x0014cb thru 0x002881 (0x13b7 bytes) 000463 1786529363.634800 read 0x000a88 thru 0x002881 (0x1dfa bytes) 000467 1786529363.662341 mapwrite 0x03b724 thru 0x03ffff (0x48dc bytes) 000469 1786529363.814217 mapread 0x03a048 thru 0x03d3c2 (0x337b bytes) 000471 1786529363.822592 write 0x01f5f0 thru 0x026f7e (0x798f bytes) 000472 1786529363.826336 mapread 0x007d79 thru 0x00a957 (0x2bdf bytes) 000473 1786529363.840029 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x32a5135d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x32a5135d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000479 1786529364.248387 write 0x0196ed thru 0x024e6a (0xb77e bytes) 000481 1786529364.261667 write 0x03578c thru 0x03e32f (0x8ba4 bytes) 000484 1786529364.272870 mapread 0x0216bf thru 0x02f168 (0xdaaa bytes) 000485 1786529364.290238 mapread 0x01cde5 thru 0x01df5e (0x117a bytes) 000489 1786529364.293905 write 0x03074c thru 0x038839 (0x80ee bytes) 000490 1786529364.299528 mapwrite 0x0324bf thru 0x03ffff (0xdb41 bytes) 000491 1786529364.353370 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) 000493 1786529364.473693 mapread 0x03ff93 thru 0x03ffff (0x6d bytes) 000496 1786529364.480759 write 0x014be3 thru 0x0186b6 (0x3ad4 bytes) 000499 1786529364.494561 mapwrite 0x0360d4 thru 0x03ffff (0x9f2c bytes) 000500 1786529364.568165 MIRROR_EXTEND to 2 mirrors 000501 1786529365.215683 trunc from 0x040000 to 0x013dfc (0x2c203 bytes) 000503 1786529365.294993 mapwrite 0x025739 thru 0x035116 (0xf9de bytes) 000504 1786529365.412847 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35117): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35117): Mirror 2: 0x87ba7e9a (stale) CRC-32 checksum value for chunk [0, 0x35117): Mirror 1: 0x6fd59a23 Mirror 3: 0x6fd59a23 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35117: skipped 000505 1786529366.353350 mapwrite 0x03568a thru 0x03ffff (0xa976 bytes) 000506 1786529366.520587 read 0x035920 thru 0x03ffff (0xa6e0 bytes) 000507 1786529366.521522 mapwrite 0x01464c thru 0x01ffcb (0xb980 bytes) 000509 1786529366.591694 write 0x00cf08 thru 0x016b95 (0x9c8e bytes) 000512 1786529366.598688 trunc from 0x040000 to 0x00f783 (0x3087c bytes) 000515 1786529366.626609 read 0x0006a5 thru 0x00e2ac (0xdc08 bytes) 000516 1786529366.637301 write 0x0089cd thru 0x00d3a0 (0x49d4 bytes) 000517 1786529366.639626 write 0x017ed8 thru 0x0254b6 (0xd5df bytes) 000518 1786529366.642396 mapwrite 0x0024f6 thru 0x00953d (0x7048 bytes) 000520 1786529366.697076 read 0x01996e thru 0x01c335 (0x29c8 bytes) 000521 1786529366.697770 write 0x00012b thru 0x00a6e3 (0xa5b9 bytes) 000523 1786529366.701340 write 0x02eb30 thru 0x03c729 (0xdbfa bytes) 000524 1786529366.703639 write 0x03564a thru 0x039069 (0x3a20 bytes) 000525 1786529366.705466 mapread 0x02865d thru 0x033ee4 (0xb888 bytes) 000526 1786529366.715667 write 0x0361f5 thru 0x03df8e (0x7d9a bytes) 000529 1786529366.721410 write 0x01bcdf thru 0x01c7e3 (0xb05 bytes) 000531 1786529366.727950 mapread 0x02b7d3 thru 0x03b045 (0xf873 bytes) 000532 1786529366.730299 mapwrite 0x01e22a thru 0x0290a4 (0xae7b bytes) 000533 1786529366.841480 write 0x00b66d thru 0x014774 (0x9108 bytes) 000534 1786529366.843167 mapread 0x01c9e0 thru 0x023fe2 (0x7603 bytes) 000535 1786529366.844351 trunc from 0x03df8f to 0x0351e1 (0x8dad bytes) 000536 1786529366.864274 mapwrite 0x03e460 thru 0x03ffff (0x1ba0 bytes) 000537 1786529366.945386 mapread 0x02668e thru 0x026ca5 (0x618 bytes) 000538 1786529366.947514 read 0x021b0f thru 0x023f14 (0x2406 bytes) 000539 1786529366.948640 mapwrite 0x025212 thru 0x027946 (0x2735 bytes) 000540 1786529367.025581 trunc from 0x040000 to 0x022475 (0x1db8a bytes) 000542 1786529367.046496 trunc from 0x022476 to 0x02b2ba (0x8e45 bytes) 000545 1786529367.065040 read 0x019d3b thru 0x029267 (0xf52d bytes) 000546 1786529367.076886 read 0x024d43 thru 0x02b2ba (0x6578 bytes) 000547 1786529367.078385 mapwrite 0x034b22 thru 0x03ffff (0xb4de bytes) 000548 1786529367.166582 write 0x02c7ba thru 0x02f824 (0x306b bytes) 000549 1786529367.168763 trunc from 0x040000 to 0x01327e (0x2cd81 bytes) 000550 1786529367.186537 write 0x029608 thru 0x02fdd6 (0x67cf bytes) 000551 1786529367.188159 write 0x01fa2f thru 0x02d099 (0xd66b bytes) 000555 1786529367.204419 mapread 0x00388d thru 0x00c1fe (0x8972 bytes) 000560 1786529367.215725 trunc from 0x02fdd7 to 0x00eb0b (0x212cb bytes) 000561 1786529367.246485 write 0x01c9a5 thru 0x028e57 (0xc4b3 bytes) 000563 1786529367.250770 trunc from 0x028e58 to 0x02eacf (0x5c78 bytes) 000568 1786529367.283511 mapread 0x0292fd thru 0x02eacf (0x57d3 bytes) 000571 1786529367.312602 mapread 0x000578 thru 0x00553c (0x4fc5 bytes) 000572 1786529367.315254 read 0x009800 thru 0x011be5 (0x83e6 bytes) 000575 1786529367.327775 trunc from 0x02ead0 to 0x02fad1 (0x1002 bytes) 000576 1786529367.348071 trunc from 0x02fad2 to 0x0062bb (0x29816 bytes) 000579 1786529367.369613 write 0x019c97 thru 0x023e78 (0xa1e2 bytes) 000582 1786529367.374656 trunc from 0x023e79 to 0x01bbe5 (0x8293 bytes) 000583 1786529367.398510 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1bbe6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bbe6): Mirror 2: 0x9e7198c3 (stale) Mirror 3: 0xabe886a2 (stale) CRC-32 checksum value for chunk [0, 0x1bbe6): Mirror 1: 0xaf55a3c6 Mirror 4: 0xaf55a3c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bbe6: skipped 000584 1786529368.302723 write 0x012c35 thru 0x020502 (0xd8ce bytes) 000586 1786529368.389351 read 0x00e19a thru 0x00f58b (0x13f2 bytes) 000588 1786529368.398247 read 0x001059 thru 0x00c34d (0xb2f5 bytes) 000590 1786529368.411415 mapread 0x01efc0 thru 0x020502 (0x1543 bytes) 000591 1786529368.413171 trunc from 0x020503 to 0x02096d (0x46b bytes) 000592 1786529368.468823 read 0x0102f9 thru 0x0124d8 (0x21e0 bytes) 000598 1786529368.477750 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2096e): Mirror 2: 0xd39432d7 (stale) Mirror 4: 0xd425cea3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2096e): Mirror 2: 0xd39432d7 (stale) Mirror 4: 0xd425cea3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2096e: skipped 000602 1786529368.776735 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2096e): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2096e): Mirror 2: 0xd39432d7 (stale) Mirror 4: 0xd425cea3 (stale) CRC-32 checksum value for chunk [0, 0x2096e): Mirror 1: 0x6128b26c Mirror 5: 0x6128b26c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2096e: skipped 000606 1786529369.739471 mapwrite 0x016c12 thru 0x02342a (0xc819 bytes) 000607 1786529369.899146 trunc from 0x02342b to 0x020b6f (0x28bb bytes) 000608 1786529369.917860 write 0x03b9d9 thru 0x03ffff (0x4627 bytes) 000609 1786529369.919952 mapwrite 0x0325df thru 0x03cb34 (0xa556 bytes) 000612 1786529369.975466 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb8a8310f (stale) Mirror 5: 0xa7401502 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb8a8310f (stale) Mirror 5: 0xa7401502 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000613 1786529370.266727 mapread 0x023f9b thru 0x033ebc (0xff22 bytes) 000614 1786529370.298506 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb8a8310f (stale) Mirror 5: 0xa7401502 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcfe855cb Mirror 6: 0xcfe855cb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000615 1786529371.081500 read 0x03b0b5 thru 0x03ffff (0x4f4b bytes) 000616 1786529371.113790 mapread 0x00548d thru 0x0057d7 (0x34b bytes) 000617 1786529371.138837 mapread 0x028858 thru 0x032496 (0x9c3f bytes) 000618 1786529371.193505 trunc from 0x040000 to 0x014622 (0x2b9dd bytes) 000620 1786529371.288931 read 0x00718a thru 0x0095cb (0x2442 bytes) 000621 1786529371.303016 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x14623): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14623): Mirror 4: 0x1607eefa (stale) Mirror 5: 0xcfee6815 (stale) Mirror 6: 0xcfee6815 (stale) CRC-32 checksum value for chunk [0, 0x14623): Mirror 1: 0xcfee6815 Mirror 7: 0xcfee6815 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14623: skipped 000622 1786529372.141391 mapread 0x0009b2 thru 0x00f1cc (0xe81b bytes) 000623 1786529372.171802 mapwrite 0x037591 thru 0x03e025 (0x6a95 bytes) 000624 1786529372.378689 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3e026): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e026): Mirror 4: 0x48ded817 (stale) Mirror 5: 0x176789d0 (stale) Mirror 6: 0x4cc5b707 (stale) Mirror 7: 0x75d9ad81 (stale) CRC-32 checksum value for chunk [0, 0x3e026): Mirror 1: 0x6c0b9b3b Mirror 8: 0x6c0b9b3b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e026: skipped 000625 1786529373.846610 read 0x030d82 thru 0x03e025 (0xd2a4 bytes) 000626 1786529373.866376 trunc from 0x03e026 to 0x0364b4 (0x7b71 bytes) 000627 1786529373.974942 mapwrite 0x01b2f0 thru 0x025b8a (0xa89b bytes) 000631 1786529374.128199 mapread 0x00a15f thru 0x017de9 (0xdc8b bytes) 000632 1786529374.146616 mapread 0x02cbcc thru 0x032417 (0x584c bytes) 000635 1786529374.163410 MIRROR_RESYNC 6 mirrors 000637 1786529375.453944 mapwrite 0x024bf3 thru 0x02ade7 (0x61f5 bytes) 000639 1786529375.786642 write 0x001b2e thru 0x0021f3 (0x6c6 bytes) 000642 1786529375.808686 mapread 0x0087ad thru 0x014e4d (0xc6a1 bytes) 000643 1786529375.833702 mapwrite 0x0293ea thru 0x0383ce (0xefe5 bytes) 000645 1786529376.022322 write 0x02e5ae thru 0x0388e0 (0xa333 bytes) 000647 1786529376.026040 read 0x02335a thru 0x029ec1 (0x6b68 bytes) 000650 1786529376.028056 mapwrite 0x031977 thru 0x039a3b (0x80c5 bytes) 000651 1786529376.118450 mapwrite 0x003d6b thru 0x011a64 (0xdcfa bytes) 000652 1786529376.194624 trunc from 0x039a3c to 0x02779d (0x1229e bytes) 000653 1786529376.210607 mapread 0x007504 thru 0x00d28d (0x5d8a bytes) 000654 1786529376.216566 MIRROR_RESYNC 6 mirrors 000656 1786529377.202069 trunc from 0x02779e to 0x03a569 (0x12dcc bytes) 000657 1786529377.292549 mapwrite 0x02f8d2 thru 0x030952 (0x1081 bytes) 000658 1786529377.347369 mapwrite 0x00fbd3 thru 0x01a6dd (0xab0b bytes) 000660 1786529377.413057 mapread 0x025e74 thru 0x03198c (0xbb19 bytes) 000661 1786529377.430120 mapwrite 0x00fa2c thru 0x01aa83 (0xb058 bytes) 000665 1786529377.478576 trunc from 0x03a56a to 0x02b835 (0xed34 bytes) 000667 1786529377.511266 trunc from 0x02b836 to 0x026699 (0x519c bytes) 000670 1786529377.534154 mapwrite 0x03201d thru 0x03ffff (0xdfe3 bytes) 000673 1786529377.713857 mapread 0x020aec thru 0x024e61 (0x4376 bytes) 000674 1786529377.715083 read 0x032675 thru 0x0341e8 (0x1b74 bytes) 000675 1786529377.715717 mapread 0x0302c9 thru 0x03d4dc (0xd214 bytes) 000676 1786529377.719142 read 0x03a147 thru 0x03cb9f (0x2a59 bytes) 000677 1786529377.720908 mapwrite 0x03a9a6 thru 0x03ffff (0x565a bytes) 000679 1786529377.790309 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9b704272 (stale) Mirror 6: 0x9b704272 (stale) Mirror 7: 0x9b704272 (stale) Mirror 8: 0x9b704272 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9b704272 (stale) Mirror 6: 0x9b704272 (stale) Mirror 7: 0x9b704272 (stale) Mirror 8: 0x9b704272 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000681 1786529378.305566 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9b704272 (stale) Mirror 6: 0x9b704272 (stale) Mirror 7: 0x9b704272 (stale) Mirror 8: 0x9b704272 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6a6a890f Mirror 9: 0x6a6a890f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000683 1786529379.439807 write 0x0106b0 thru 0x01f62a (0xef7b bytes) 000685 1786529379.535296 mapread 0x03cf5b thru 0x03ded5 (0xf7b bytes) 000687 1786529379.548657 write 0x02433c thru 0x027aa9 (0x376e bytes) 000688 1786529379.565326 trunc from 0x040000 to 0x038766 (0x7899 bytes) 000690 1786529379.594532 mapread 0x035899 thru 0x038766 (0x2ece bytes) 000691 1786529379.622584 trunc from 0x038767 to 0x0274aa (0x112bc bytes) 000693 1786529379.639482 mapread 0x006fd5 thru 0x0081b2 (0x11de bytes) 000694 1786529379.656655 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x274ab): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x274ab): Mirror 4: 0x3719686 (stale) Mirror 6: 0x3719686 (stale) Mirror 7: 0x3719686 (stale) Mirror 8: 0x3719686 (stale) Mirror 9: 0x621effec (stale) CRC-32 checksum value for chunk [0, 0x274ab): Mirror 1: 0xcfc2df3f Mirror 10: 0xcfc2df3f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x274ab: skipped 000695 1786529380.920284 mapread 0x01d203 thru 0x025acc (0x88ca bytes) 000696 1786529380.951959 write 0x03a2b3 thru 0x03e0ac (0x3dfa bytes) 000698 1786529381.020513 trunc from 0x03e0ad to 0x004f74 (0x39138 bytes) 000700 1786529381.042138 mapwrite 0x014a21 thru 0x01f7cc (0xadac bytes) 000702 1786529381.115963 read 0x012ca1 thru 0x01e973 (0xbcd3 bytes) 000704 1786529381.117206 read 0x01f2f0 thru 0x01f7cc (0x4dd bytes) 000709 1786529381.122313 mapwrite 0x01c361 thru 0x023aa7 (0x7747 bytes) 000710 1786529381.192566 mapread 0x01346c thru 0x016eb8 (0x3a4d bytes) 000711 1786529381.194555 write 0x02db5c thru 0x03c5a1 (0xea46 bytes) 000712 1786529381.201541 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3c5a2): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c5a2): Mirror 4: 0x1d80f62f (stale) Mirror 6: 0x1d80f62f (stale) Mirror 7: 0x1d80f62f (stale) Mirror 8: 0x1d80f62f (stale) Mirror 9: 0x6009c6e8 (stale) Mirror 10: 0x16c8ee40 (stale) CRC-32 checksum value for chunk [0, 0x3c5a2): Mirror 1: 0x6c45495f Mirror 11: 0x6c45495f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c5a2: skipped 000713 1786529382.407212 read 0x007165 thru 0x00c68a (0x5526 bytes) 000714 1786529382.418493 read 0x004463 thru 0x006854 (0x23f2 bytes) 000715 1786529382.440053 write 0x00224f thru 0x00bd41 (0x9af3 bytes) 000719 1786529382.517493 read 0x008213 thru 0x00f2ab (0x7099 bytes) 000720 1786529382.527785 read 0x000221 thru 0x0075c0 (0x73a0 bytes) 000722 1786529382.529328 mapread 0x017b67 thru 0x023c23 (0xc0bd bytes) 000725 1786529382.531877 write 0x039cd0 thru 0x03ffff (0x6330 bytes) 000728 1786529382.535289 write 0x002a2b thru 0x006471 (0x3a47 bytes) 000730 1786529382.537267 mapread 0x00319e thru 0x009797 (0x65fa bytes) 000731 1786529382.538974 trunc from 0x040000 to 0x02d521 (0x12ade bytes) 000733 1786529382.580017 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d522): Mirror 4: 0xefdd40f0 (stale) Mirror 6: 0xefdd40f0 (stale) Mirror 7: 0xefdd40f0 (stale) Mirror 9: 0x1abaeb12 (stale) Mirror 10: 0x4147b377 (stale) Mirror 11: 0x929d0010 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d522): Mirror 4: 0xefdd40f0 (stale) Mirror 6: 0xefdd40f0 (stale) Mirror 7: 0xefdd40f0 (stale) Mirror 9: 0x1abaeb12 (stale) Mirror 10: 0x4147b377 (stale) Mirror 11: 0x929d0010 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d522: skipped 000734 1786529383.064735 trunc from 0x02d522 to 0x00bc2a (0x218f7 bytes) 000736 1786529383.079727 write 0x0284fc thru 0x034490 (0xbf95 bytes) 000737 1786529383.090987 write 0x011573 thru 0x01bf79 (0xaa07 bytes) 000738 1786529383.103664 write 0x018bf4 thru 0x01e5b8 (0x59c5 bytes) 000740 1786529383.111212 mapwrite 0x0041a9 thru 0x0071f9 (0x3051 bytes) 000742 1786529383.203931 trunc from 0x034491 to 0x02fa62 (0x4a2e bytes) 000743 1786529383.222853 read 0x005580 thru 0x008f20 (0x39a1 bytes) 000744 1786529383.227366 trunc from 0x02fa63 to 0x0237d2 (0xc290 bytes) 000745 1786529383.247553 write 0x0075bd thru 0x00a903 (0x3347 bytes) 000751 1786529383.254459 trunc from 0x0237d3 to 0x02c88d (0x90bb bytes) 000752 1786529383.284335 mapwrite 0x03030b thru 0x031611 (0x1307 bytes) 000753 1786529383.384151 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31612): Mirror 4: 0x7200230a (stale) Mirror 6: 0x7200230a (stale) Mirror 7: 0x7200230a (stale) Mirror 9: 0x63a2bfd (stale) Mirror 10: 0x7ebbb9b1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31612): Mirror 4: 0x7200230a (stale) Mirror 6: 0x7200230a (stale) Mirror 7: 0x7200230a (stale) Mirror 9: 0x63a2bfd (stale) Mirror 10: 0x7ebbb9b1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31612: skipped 000756 1786529383.867554 mapwrite 0x02fc9d thru 0x03e5ad (0xe911 bytes) 000757 1786529383.966762 write 0x00f46e thru 0x017076 (0x7c09 bytes) 000760 1786529383.978320 mapread 0x018a10 thru 0x01cc35 (0x4226 bytes) 000762 1786529383.994930 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3e5ae): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e5ae): Mirror 4: 0x7e78227e (stale) Mirror 6: 0x7e78227e (stale) Mirror 7: 0x7e78227e (stale) Mirror 9: 0xc066c16e (stale) Mirror 10: 0x32bd9af0 (stale) CRC-32 checksum value for chunk [0, 0x3e5ae): Mirror 1: 0xdba91275 Mirror 11: 0xdba91275 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e5ae: skipped 000763 1786529384.975404 MIRROR_RESYNC 7 mirrors 000764 1786529386.438178 MIRROR_RESYNC 7 mirrors 000766 1786529387.024072 read 0x0024b1 thru 0x0030b5 (0xc05 bytes) 000768 1786529387.030404 mapwrite 0x039a5e thru 0x03fc8b (0x622e bytes) 000769 1786529387.186184 trunc from 0x03fc8c to 0x03dd79 (0x1f12 bytes) 000770 1786529387.222805 mapwrite 0x02dafe thru 0x0368ac (0x8daf bytes) 000771 1786529387.308730 mapwrite 0x0381e1 thru 0x03ba15 (0x3835 bytes) truncating to largest ever: 0x3f2dd 000772 1786529387.344003 trunc from 0x03dd7a to 0x03f2dc (0x1563 bytes) 000773 1786529387.364693 write 0x012d1d thru 0x012f47 (0x22b bytes) 000775 1786529387.372091 trunc from 0x03f2dd to 0x02dbc8 (0x11714 bytes) 000776 1786529387.388515 read 0x01116f thru 0x020c4b (0xfadd bytes) 000777 1786529387.403458 mapwrite 0x014c8b thru 0x01cb7a (0x7ef0 bytes) 000778 1786529387.500303 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2dbc9): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dbc9): Mirror 4: 0x4dab2981 (stale) Mirror 6: 0x4dab2981 (stale) Mirror 7: 0x4dab2981 (stale) Mirror 9: 0x4dab2981 (stale) Mirror 10: 0x4dab2981 (stale) Mirror 11: 0x4dab2981 (stale) CRC-32 checksum value for chunk [0, 0x2dbc9): Mirror 1: 0x6e99a0f5 Mirror 12: 0x6e99a0f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dbc9: skipped 000779 1786529388.334821 MIRROR_RESYNC 8 mirrors 000782 1786529389.533310 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) 000783 1786529389.975618 mapwrite 0x0263cc thru 0x02904e (0x2c83 bytes) 000784 1786529390.217670 trunc from 0x02dbc9 to 0x00dc3b (0x1ff8d bytes) 000785 1786529390.268632 trunc from 0x00dc3c to 0x02a093 (0x1c458 bytes) 000787 1786529390.286578 mapread 0x012686 thru 0x01e1d3 (0xbb4e bytes) 000790 1786529390.323616 mapread 0x0297c8 thru 0x02a093 (0x8cc bytes) 000791 1786529390.347390 trunc from 0x02a094 to 0x029e57 (0x23c bytes) 000793 1786529390.392933 trunc from 0x029e58 to 0x00be71 (0x1dfe6 bytes) 000795 1786529390.426886 write 0x014822 thru 0x01bd94 (0x7573 bytes) 000797 1786529390.429605 trunc from 0x01bd95 to 0x03d38c (0x215f8 bytes) 000802 1786529390.457010 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3d38d): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d38d): Mirror 4: 0xc2cbe56e (stale) Mirror 6: 0xc2cbe56e (stale) Mirror 7: 0xc2cbe56e (stale) Mirror 9: 0xc2cbe56e (stale) Mirror 11: 0xc2cbe56e (stale) Mirror 12: 0xc2cbe56e (stale) CRC-32 checksum value for chunk [0, 0x3d38d): Mirror 1: 0x44020a5f Mirror 13: 0x44020a5f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d38d: skipped 000803 1786529391.625670 read 0x01a8f5 thru 0x01db4a (0x3256 bytes) 000804 1786529391.645929 write 0x026483 thru 0x03207c (0xbbfa bytes) 000805 1786529391.794601 mapwrite 0x033fd0 thru 0x03ffff (0xc030 bytes) 000806 1786529391.897455 trunc from 0x040000 to 0x03349c (0xcb63 bytes) 000807 1786529391.916940 mapwrite 0x0294ee thru 0x02eb0f (0x5622 bytes) 000810 1786529392.000595 mapread 0x02e0f9 thru 0x02e540 (0x448 bytes) 000812 1786529392.004063 mapwrite 0x02d443 thru 0x038ea0 (0xba5e bytes) 000814 1786529392.129555 write 0x03db69 thru 0x03ffff (0x2497 bytes) 000815 1786529392.132965 mapwrite 0x001924 thru 0x005d6a (0x4447 bytes) 000816 1786529392.229838 mapwrite 0x01b8f5 thru 0x024950 (0x905c bytes) 000817 1786529392.321561 MIRROR_RESYNC 8 mirrors 000818 1786529393.600304 mapwrite 0x0352ab thru 0x035f13 (0xc69 bytes) 000819 1786529393.742542 write 0x016d2d thru 0x021b15 (0xade9 bytes) 000820 1786529393.757542 mapread 0x02705f thru 0x0300a9 (0x904b bytes) 000821 1786529393.784731 write 0x003ca4 thru 0x00a32c (0x6689 bytes) 000824 1786529393.796608 trunc from 0x040000 to 0x01c732 (0x238cd bytes) 000825 1786529393.816763 write 0x01a63f thru 0x01e4e9 (0x3eab bytes) 000826 1786529393.824906 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1e4ea): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e4ea): Mirror 4: 0x754998d (stale) Mirror 6: 0x754998d (stale) Mirror 7: 0x754998d (stale) Mirror 9: 0x754998d (stale) Mirror 11: 0x754998d (stale) Mirror 12: 0x754998d (stale) Mirror 13: 0x754998d (stale) CRC-32 checksum value for chunk [0, 0x1e4ea): Mirror 1: 0xb8f800f6 Mirror 14: 0xb8f800f6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e4ea: skipped 000827 1786529395.291625 trunc from 0x01e4ea to 0x0358fe (0x17415 bytes) 000828 1786529395.453838 write 0x0367f9 thru 0x03f5a1 (0x8da9 bytes) 000829 1786529395.455323 write 0x0283e3 thru 0x036401 (0xe01f bytes) 000832 1786529395.464064 mapread 0x023fce thru 0x033674 (0xf6a7 bytes) 000833 1786529395.493827 write 0x03e5d9 thru 0x03ffff (0x1a27 bytes) 000834 1786529395.497974 mapread 0x034d35 thru 0x036194 (0x1460 bytes) 000835 1786529395.502647 mapread 0x00e52c thru 0x01c550 (0xe025 bytes) 000838 1786529395.544060 write 0x031586 thru 0x034de6 (0x3861 bytes) 000839 1786529395.546881 mapread 0x00d93b thru 0x0165b1 (0x8c77 bytes) 000842 1786529395.549977 write 0x030a03 thru 0x03ffff (0xf5fd bytes) 000844 1786529395.553081 read 0x01ebc8 thru 0x024052 (0x548b bytes) 000846 1786529395.555007 mapread 0x00649f thru 0x012891 (0xc3f3 bytes) 000847 1786529395.567993 mapread 0x0029d5 thru 0x00c517 (0x9b43 bytes) 000848 1786529395.569951 mapwrite 0x01ea0f thru 0x020b2f (0x2121 bytes) 000850 1786529395.637263 mapwrite 0x023660 thru 0x027b5c (0x44fd bytes) 000851 1786529395.682797 read 0x03bc89 thru 0x03ffff (0x4377 bytes) 000853 1786529395.684303 mapwrite 0x03b888 thru 0x03ffff (0x4778 bytes) 000855 1786529395.729515 mapread 0x008b0d thru 0x0103d5 (0x78c9 bytes) 000857 1786529395.733297 write 0x002697 thru 0x004954 (0x22be bytes) 000858 1786529395.734676 read 0x0304f9 thru 0x0324fb (0x2003 bytes) 000861 1786529395.743363 MIRROR_RESYNC 9 mirrors 000862 1786529397.331443 read 0x0095a1 thru 0x01247e (0x8ede bytes) 000867 1786529397.349709 mapread 0x01d05e thru 0x029fbf (0xcf62 bytes) 000869 1786529397.404902 write 0x00810e thru 0x0084c9 (0x3bc bytes) 000870 1786529397.519180 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x7b7e5be4 (stale) Mirror 6: 0x7b7e5be4 (stale) Mirror 7: 0x7b7e5be4 (stale) Mirror 9: 0x7b7e5be4 (stale) Mirror 11: 0x7b7e5be4 (stale) Mirror 12: 0x7b7e5be4 (stale) Mirror 13: 0x7b7e5be4 (stale) Mirror 14: 0x7b7e5be4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5d0099e1 Mirror 15: 0x5d0099e1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000872 1786529398.788449 read 0x03ea34 thru 0x03ffff (0x15cc bytes) 000875 1786529398.830836 mapwrite 0x0036c9 thru 0x009d3e (0x6676 bytes) 000877 1786529399.088256 mapwrite 0x02a40e thru 0x031620 (0x7213 bytes) 000878 1786529399.151856 mapwrite 0x03e0fb thru 0x03ffff (0x1f05 bytes) 000879 1786529399.200636 mapwrite 0x03625a thru 0x037baf (0x1956 bytes) 000880 1786529399.240146 trunc from 0x040000 to 0x0071d8 (0x38e27 bytes) 000881 1786529399.258527 trunc from 0x0071d9 to 0x00611f (0x10b9 bytes) 000882 1786529399.273416 trunc from 0x006120 to 0x031f5e (0x2be3f bytes) 000883 1786529399.292668 write 0x00869a thru 0x01145f (0x8dc6 bytes) 000884 1786529399.303172 mapwrite 0x01cca0 thru 0x0252be (0x861f bytes) 000885 1786529399.367766 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31f5f): Mirror 4: 0x319d010 (stale) Mirror 6: 0x319d010 (stale) Mirror 7: 0x319d010 (stale) Mirror 9: 0x319d010 (stale) Mirror 11: 0x319d010 (stale) Mirror 12: 0x319d010 (stale) Mirror 13: 0x319d010 (stale) Mirror 14: 0x319d010 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31f5f): Mirror 4: 0x319d010 (stale) Mirror 6: 0x319d010 (stale) Mirror 7: 0x319d010 (stale) Mirror 9: 0x319d010 (stale) Mirror 11: 0x319d010 (stale) Mirror 12: 0x319d010 (stale) Mirror 13: 0x319d010 (stale) Mirror 14: 0x319d010 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31f5f: skipped 000886 1786529399.969942 write 0x03ed7b thru 0x03ffff (0x1285 bytes) 000888 1786529399.979181 trunc from 0x040000 to 0x004ac7 (0x3b538 bytes) 000889 1786529400.014984 mapwrite 0x005738 thru 0x00956d (0x3e36 bytes) 000890 1786529400.216698 mapwrite 0x029f61 thru 0x035eb0 (0xbf50 bytes) 000892 1786529400.330866 mapread 0x00e481 thru 0x0146ca (0x624a bytes) 000894 1786529400.353644 trunc from 0x035eb1 to 0x01c0d1 (0x19ddf bytes) 000896 1786529400.380598 write 0x027e0d thru 0x02b358 (0x354c bytes) 000897 1786529400.386013 mapwrite 0x013ef5 thru 0x0183f8 (0x4504 bytes) 000898 1786529400.511630 MIRROR_RESYNC 9 mirrors 000899 1786529402.461085 mapwrite 0x00a25b thru 0x011e6d (0x7c13 bytes) 000900 1786529402.746045 write 0x022606 thru 0x029919 (0x7314 bytes) 000901 1786529402.771366 mapwrite 0x03ba74 thru 0x03ffff (0x458c bytes) 000903 1786529402.924936 write 0x015876 thru 0x022995 (0xd120 bytes) 000904 1786529402.938082 write 0x00bf06 thru 0x014d2f (0x8e2a bytes) 000906 1786529402.950507 mapread 0x01cecd thru 0x02b151 (0xe285 bytes) 000908 1786529402.978601 read 0x004cf8 thru 0x00b46f (0x6778 bytes) 000909 1786529402.984612 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb51f8a48 (stale) Mirror 6: 0xb51f8a48 (stale) Mirror 7: 0xb51f8a48 (stale) Mirror 9: 0xb51f8a48 (stale) Mirror 11: 0xb51f8a48 (stale) Mirror 12: 0xb51f8a48 (stale) Mirror 13: 0xb51f8a48 (stale) Mirror 14: 0xb51f8a48 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe73e1323 Mirror 15: 0xe73e1323 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000910 1786529404.135480 mapread 0x039e33 thru 0x03d465 (0x3633 bytes) 000911 1786529404.170765 write 0x01968c thru 0x026df7 (0xd76c bytes) 000914 1786529404.270244 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb51f8a48 (stale) Mirror 6: 0xb51f8a48 (stale) Mirror 7: 0xb51f8a48 (stale) Mirror 9: 0xb51f8a48 (stale) Mirror 11: 0xb51f8a48 (stale) Mirror 12: 0xb51f8a48 (stale) Mirror 13: 0xb51f8a48 (stale) Mirror 14: 0xb51f8a48 (stale) Mirror 15: 0xe73e1323 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x286d7ed2 Mirror 16: 0x286d7ed2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000916 1786529405.433447 write 0x004d38 thru 0x00951b (0x47e4 bytes) 000917 1786529405.524024 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb51f8a48 (stale) Mirror 6: 0xb51f8a48 (stale) Mirror 9: 0xb51f8a48 (stale) Mirror 11: 0xb51f8a48 (stale) Mirror 12: 0xb51f8a48 (stale) Mirror 13: 0xb51f8a48 (stale) Mirror 14: 0xb51f8a48 (stale) Mirror 15: 0xe73e1323 (stale) Mirror 16: 0x286d7ed2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb51f8a48 (stale) Mirror 6: 0xb51f8a48 (stale) Mirror 9: 0xb51f8a48 (stale) Mirror 11: 0xb51f8a48 (stale) Mirror 12: 0xb51f8a48 (stale) Mirror 13: 0xb51f8a48 (stale) Mirror 14: 0xb51f8a48 (stale) Mirror 15: 0xe73e1323 (stale) Mirror 16: 0x286d7ed2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000919 1786529406.057848 mapwrite 0x00c2e9 thru 0x00f951 (0x3669 bytes) 000920 1786529406.162155 trunc from 0x040000 to 0x00828d (0x37d72 bytes) 000923 1786529406.194765 write 0x02396e thru 0x02ef20 (0xb5b3 bytes) 000925 1786529406.197519 mapread 0x01a98f thru 0x022c87 (0x82f9 bytes) 000926 1786529406.205599 trunc from 0x02ef21 to 0x01a39f (0x14b81 bytes) 000927 1786529406.221876 mapread 0x0194e7 thru 0x01a39f (0xeb9 bytes) 000928 1786529406.223957 mapwrite 0x009313 thru 0x01534a (0xc038 bytes) 000929 1786529406.328744 mapwrite 0x010b8c thru 0x01afe6 (0xa45b bytes) 000930 1786529406.507680 MIRROR_RESYNC 10 mirrors 000933 1786529408.243092 read 0x0013c4 thru 0x0108db (0xf518 bytes) 000934 1786529408.262006 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) 000935 1786529408.656921 write 0x00d049 thru 0x01a578 (0xd530 bytes) 000936 1786529408.792623 mapwrite 0x012aa0 thru 0x01bafc (0x905d bytes) 000938 1786529408.882428 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1bafd): Mirror 4: 0x4a9ebbd0 (stale) Mirror 6: 0x4a9ebbd0 (stale) Mirror 9: 0x4a9ebbd0 (stale) Mirror 12: 0x4a9ebbd0 (stale) Mirror 13: 0x4a9ebbd0 (stale) Mirror 14: 0x4a9ebbd0 (stale) Mirror 16: 0x4a9ebbd0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bafd): Mirror 4: 0x4a9ebbd0 (stale) Mirror 6: 0x4a9ebbd0 (stale) Mirror 9: 0x4a9ebbd0 (stale) Mirror 12: 0x4a9ebbd0 (stale) Mirror 13: 0x4a9ebbd0 (stale) Mirror 14: 0x4a9ebbd0 (stale) Mirror 16: 0x4a9ebbd0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bafd: skipped 000939 1786529409.327893 mapread 0x00a69b thru 0x01031e (0x5c84 bytes) 000941 1786529409.348749 mapwrite 0x025de0 thru 0x02a172 (0x4393 bytes) 000942 1786529409.419382 mapwrite 0x01e290 thru 0x02a600 (0xc371 bytes) 000943 1786529409.481716 write 0x0165de thru 0x017f8e (0x19b1 bytes) 000944 1786529409.491061 mapwrite 0x001a8b thru 0x00856b (0x6ae1 bytes) 000946 1786529409.551895 MIRROR_RESYNC 8 mirrors 000950 1786529411.502935 trunc from 0x02a601 to 0x032554 (0x7f54 bytes) 000952 1786529411.606982 read 0x00f44a thru 0x01ed0a (0xf8c1 bytes) 000954 1786529411.624928 trunc from 0x032555 to 0x0240e8 (0xe46c bytes) 000955 1786529411.652741 read 0x00f7c6 thru 0x019588 (0x9dc3 bytes) 000960 1786529411.659355 mapread 0x01fa3f thru 0x0240e8 (0x46aa bytes) 000968 1786529411.678544 trunc from 0x0240e9 to 0x0091e5 (0x1af03 bytes) 000969 1786529411.698372 mapread 0x008877 thru 0x0091e5 (0x96f bytes) 000971 1786529411.701587 trunc from 0x0091e6 to 0x01cd53 (0x13b6e bytes) 000973 1786529411.723964 read 0x006e16 thru 0x010f09 (0xa0f4 bytes) 000974 1786529411.739186 mapread 0x0140e9 thru 0x015a08 (0x1920 bytes) 000975 1786529411.749562 MIRROR_RESYNC 8 mirrors 000976 1786529413.540068 MIRROR_RESYNC 8 mirrors 000978 1786529414.066841 read 0x00b064 thru 0x00c8de (0x187b bytes) 000979 1786529414.071914 write 0x03e792 thru 0x03eb50 (0x3bf bytes) 000983 1786529414.138167 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3eb51): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb51): Mirror 4: 0xca6f2e57 (stale) Mirror 6: 0xca6f2e57 (stale) Mirror 9: 0xca6f2e57 (stale) Mirror 12: 0xca6f2e57 (stale) Mirror 13: 0xca6f2e57 (stale) Mirror 14: 0xca6f2e57 (stale) Mirror 16: 0xca6f2e57 (stale) CRC-32 checksum value for chunk [0, 0x3eb51): Mirror 1: 0xc8dae456 Mirror 17: 0xc8dae456 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb51: skipped 000984 1786529415.422982 mapwrite 0x037816 thru 0x03e3e3 (0x6bce bytes) 000985 1786529415.807408 read 0x00f368 thru 0x0143e7 (0x5080 bytes) 000986 1786529415.820309 read 0x032df8 thru 0x03eb50 (0xbd59 bytes) 000989 1786529415.823459 mapread 0x00c709 thru 0x00d1b2 (0xaaa bytes) 000990 1786529415.841942 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3eb51): Mirror 6: 0xca6f2e57 (stale) Mirror 9: 0xca6f2e57 (stale) Mirror 12: 0xca6f2e57 (stale) Mirror 13: 0xca6f2e57 (stale) Mirror 14: 0xca6f2e57 (stale) Mirror 16: 0xca6f2e57 (stale) Mirror 17: 0xc8dae456 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb51): Mirror 6: 0xca6f2e57 (stale) Mirror 9: 0xca6f2e57 (stale) Mirror 12: 0xca6f2e57 (stale) Mirror 13: 0xca6f2e57 (stale) Mirror 14: 0xca6f2e57 (stale) Mirror 16: 0xca6f2e57 (stale) Mirror 17: 0xc8dae456 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb51: skipped 000991 1786529416.355826 read 0x01a6c9 thru 0x025061 (0xa999 bytes) 000992 1786529416.366610 read 0x028f75 thru 0x029bff (0xc8b bytes) 000993 1786529416.382420 mapread 0x02d5f5 thru 0x03789d (0xa2a9 bytes) 000997 1786529416.387322 mapread 0x03965f thru 0x03eb50 (0x54f2 bytes) 000998 1786529416.389264 mapread 0x0118e8 thru 0x01268d (0xda6 bytes) 000999 1786529416.395022 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3eb51): Mirror 6: 0xca6f2e57 (stale) Mirror 9: 0xca6f2e57 (stale) Mirror 12: 0xca6f2e57 (stale) Mirror 13: 0xca6f2e57 (stale) Mirror 16: 0xca6f2e57 (stale) Mirror 17: 0xc8dae456 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb51): Mirror 6: 0xca6f2e57 (stale) Mirror 9: 0xca6f2e57 (stale) Mirror 12: 0xca6f2e57 (stale) Mirror 13: 0xca6f2e57 (stale) Mirror 16: 0xca6f2e57 (stale) Mirror 17: 0xc8dae456 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb51: skipped 001000 1786529416.826634 trunc from 0x03eb51 to 0x037501 (0x764f bytes) All operations completed A-OK!