== sanity-flr test 70a: flr mode fsx test ================ 13:11:59 (1780333919) Seed set to 3921 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x8e79 000002 1780333922.128776 trunc from 00000000 to 0x008e78 (0x8e79 bytes) 000006 1780333922.153968 mapread 0x0057f9 thru 0x008e78 (0x3680 bytes) truncating to largest ever: 0x38a40 000008 1780333922.174619 trunc from 0x008e79 to 0x038a3f (0x2fbc7 bytes) 000009 1780333922.190220 read 0x030970 thru 0x036b12 (0x61a3 bytes) 000011 1780333922.200271 mapwrite 0x02c33d thru 0x03964d (0xd311 bytes) 000012 1780333922.446900 mapwrite 0x01d845 thru 0x023f48 (0x6704 bytes) 000014 1780333922.560602 write 0x03c91b thru 0x03ffff (0x36e5 bytes) 000016 1780333922.562291 mapwrite 0x023053 thru 0x02f585 (0xc533 bytes) 000017 1780333922.680647 read 0x027b62 thru 0x032015 (0xa4b4 bytes) 000018 1780333922.681584 mapread 0x018418 thru 0x01c659 (0x4242 bytes) 000022 1780333922.684948 write 0x03e3aa thru 0x03ffff (0x1c56 bytes) 000029 1780333922.693298 trunc from 0x040000 to 0x013887 (0x2c778 bytes) 000031 1780333922.716967 mapwrite 0x01a7da thru 0x025d3a (0xb561 bytes) 000035 1780333922.842631 mapread 0x0218e3 thru 0x025d3a (0x4458 bytes) 000037 1780333922.845701 trunc from 0x025d3b to 0x0046ae (0x2168c bytes) 000043 1780333922.881759 read 0x002b63 thru 0x003c0a (0x10a8 bytes) 000044 1780333922.882526 mapread 0x00261f thru 0x0046ae (0x2090 bytes) 000046 1780333922.885518 write 0x004055 thru 0x011215 (0xd1c1 bytes) 000048 1780333922.888548 mapread 0x00d8db thru 0x00f1de (0x1904 bytes) 000053 1780333922.892939 trunc from 0x011216 to 0x01ceae (0xbc99 bytes) 000054 1780333922.917700 trunc from 0x01ceaf to 0x02121f (0x4371 bytes) 000061 1780333922.947560 mapread 0x01588b thru 0x01fd1b (0xa491 bytes) 000062 1780333922.958162 read 0x01c74d thru 0x02121f (0x4ad3 bytes) 000064 1780333922.959624 trunc from 0x021220 to 0x02b4f8 (0xa2d9 bytes) 000066 1780333922.981196 trunc from 0x02b4f9 to 0x03158a (0x6092 bytes) 000067 1780333923.002216 write 0x0153fa thru 0x020a95 (0xb69c bytes) 000070 1780333923.015916 MIRROR_EXTEND to 2 mirrors 000072 1780333924.007026 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) 000073 1780333924.225267 mapwrite 0x012033 thru 0x0160a5 (0x4073 bytes) 000074 1780333924.338947 mapread 0x020121 thru 0x02df84 (0xde64 bytes) 000076 1780333924.375272 trunc from 0x03158b to 0x01938f (0x181fb bytes) 000079 1780333924.413170 trunc from 0x019390 to 0x00a255 (0xf13a bytes) 000080 1780333924.440534 trunc from 0x00a256 to 0x02beca (0x21c75 bytes) 000081 1780333924.465268 trunc from 0x02becb to 0x0216dd (0xa7ed bytes) 000082 1780333924.485873 trunc from 0x0216de to 0x00160c (0x200d1 bytes) 000083 1780333924.522182 mapwrite 0x032ac0 thru 0x03bd19 (0x925a bytes) 000085 1780333924.651150 read 0x0216f4 thru 0x02c015 (0xa922 bytes) 000086 1780333924.678071 trunc from 0x03bd1a to 0x013dd3 (0x27f46 bytes) 000089 1780333924.703654 read 0x009fbb thru 0x00a2dd (0x323 bytes) 000091 1780333924.719263 mapwrite 0x026811 thru 0x02cdf7 (0x65e7 bytes) 000095 1780333924.827895 trunc from 0x02cdf8 to 0x02bc37 (0x11c0 bytes) 000096 1780333924.859869 mapwrite 0x01ceb4 thru 0x0250ba (0x8207 bytes) 000097 1780333924.930081 write 0x001606 thru 0x00c5cd (0xafc8 bytes) 000099 1780333924.934170 trunc from 0x02bc38 to 0x01c746 (0xf4f1 bytes) 000101 1780333924.968157 read 0x0196ee thru 0x01aca2 (0x15b5 bytes) 000103 1780333924.974670 mapwrite 0x02fa27 thru 0x038f9c (0x9576 bytes) 000106 1780333925.090240 write 0x033f79 thru 0x03768a (0x3712 bytes) 000110 1780333925.102242 mapread 0x03485a thru 0x0374ad (0x2c54 bytes) 000111 1780333925.104602 write 0x01d554 thru 0x01e300 (0xdad bytes) 000112 1780333925.107066 read 0x0146b8 thru 0x015018 (0x961 bytes) 000113 1780333925.108680 read 0x003a3b thru 0x00c9aa (0x8f70 bytes) 000114 1780333925.110522 read 0x00398b thru 0x007a98 (0x410e bytes) 000115 1780333925.112738 read 0x0361ff thru 0x038f9c (0x2d9e bytes) 000116 1780333925.114740 trunc from 0x038f9d to 0x020232 (0x18d6a bytes) 000117 1780333925.138116 trunc from 0x020233 to 0x036467 (0x16235 bytes) 000118 1780333925.187941 read 0x02f31d thru 0x036467 (0x714b bytes) 000119 1780333925.211736 mapread 0x0001fa thru 0x001dda (0x1be1 bytes) 000120 1780333925.213002 read 0x02addc thru 0x02b2f6 (0x51b bytes) 000124 1780333925.230878 read 0x0128ce thru 0x015b51 (0x3284 bytes) 000127 1780333925.252089 read 0x02c510 thru 0x036467 (0x9f58 bytes) 000128 1780333925.262110 trunc from 0x036468 to 0x00a97b (0x2baec bytes) 000129 1780333925.304541 mapread 0x001698 thru 0x0016b7 (0x20 bytes) 000130 1780333925.308516 mapwrite 0x011364 thru 0x01a02a (0x8cc7 bytes) 000132 1780333925.456919 read 0x0125d7 thru 0x012cba (0x6e4 bytes) 000133 1780333925.458133 mapwrite 0x03b6b2 thru 0x03ffff (0x494e bytes) 000138 1780333925.551262 read 0x01430f thru 0x016a43 (0x2735 bytes) 000143 1780333925.557120 mapwrite 0x01abbd thru 0x024fa7 (0xa3eb bytes) 000144 1780333925.664601 mapwrite 0x00cac7 thru 0x00d7b1 (0xceb bytes) 000145 1780333925.780752 trunc from 0x040000 to 0x014783 (0x2b87c bytes) 000149 1780333925.811192 trunc from 0x014784 to 0x01c44a (0x7cc7 bytes) 000154 1780333925.885145 mapread 0x003a9b thru 0x007088 (0x35ee bytes) 000156 1780333925.887468 read 0x01b436 thru 0x01c44a (0x1015 bytes) 000157 1780333925.910428 read 0x0047a0 thru 0x014501 (0xfd62 bytes) 000158 1780333925.911177 write 0x00fb65 thru 0x0156b3 (0x5b4f bytes) 000159 1780333925.912605 write 0x03d3f1 thru 0x03ffff (0x2c0f bytes) 000160 1780333925.922176 MIRROR_EXTEND to 2 mirrors 000162 1780333926.996131 trunc from 0x040000 to 0x00455d (0x3baa2 bytes) 000163 1780333927.175208 mapwrite 0x018e58 thru 0x019cd9 (0xe82 bytes) 000164 1780333927.279141 mapwrite 0x014fcf thru 0x01e6f7 (0x9729 bytes) 000171 1780333927.579318 read 0x018ade thru 0x01ca65 (0x3f88 bytes) 000172 1780333927.581030 trunc from 0x01e6f8 to 0x01b6d8 (0x301f bytes) 000173 1780333927.643078 write 0x004266 thru 0x008ca0 (0x4a3b bytes) 000174 1780333927.693313 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) 000175 1780333928.045216 mapwrite 0x011a61 thru 0x01dfb5 (0xc555 bytes) 000178 1780333928.246995 trunc from 0x01dfb6 to 0x0082a7 (0x15d0e bytes) 000180 1780333928.275466 write 0x031978 thru 0x0323dd (0xa66 bytes) 000182 1780333928.286900 trunc from 0x0323de to 0x033d7a (0x199d bytes) 000183 1780333928.308158 read 0x010fd1 thru 0x01caa0 (0xbad0 bytes) 000188 1780333928.331862 write 0x01f335 thru 0x029052 (0x9d1e bytes) 000190 1780333928.354615 read 0x027770 thru 0x02bac7 (0x4358 bytes) 000191 1780333928.374775 read 0x010cd1 thru 0x02047a (0xf7aa bytes) 000193 1780333928.377002 mapwrite 0x01f668 thru 0x02e09c (0xea35 bytes) 000196 1780333928.443384 mapread 0x031400 thru 0x033d7a (0x297b bytes) 000199 1780333928.447063 mapread 0x02350b thru 0x02d639 (0xa12f bytes) 000200 1780333928.448905 read 0x021460 thru 0x028473 (0x7014 bytes) 000204 1780333928.454754 trunc from 0x033d7b to 0x02f702 (0x4678 bytes) 000206 1780333928.500691 MIRROR_EXTEND to 2 mirrors 000207 1780333929.542168 MIRROR_EXTEND to 3 mirrors 000210 1780333930.448227 read 0x02ca37 thru 0x02f702 (0x2ccc bytes) 000213 1780333930.459831 write 0x00d7e0 thru 0x01759e (0x9dbf bytes) 000214 1780333930.600573 read 0x004a1c thru 0x011774 (0xcd59 bytes) 000215 1780333930.612609 mapwrite 0x0327ec thru 0x03a49a (0x7caf bytes) 000216 1780333930.695669 mapread 0x022e7c thru 0x0270dc (0x4261 bytes) 000217 1780333930.698513 trunc from 0x03a49b to 0x00006e (0x3a42c bytes) 000220 1780333930.730151 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6f): Mirror 3: 0xb062b673 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6f): Mirror 3: 0xb062b673 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6f: skipped 000223 1780333931.031600 mapwrite 0x028987 thru 0x035c81 (0xd2fb bytes) 000226 1780333931.209125 write 0x03eb13 thru 0x03ffff (0x14ed bytes) 000229 1780333931.221011 MIRROR_RESYNC 2 mirrors 000236 1780333932.393653 mapwrite 0x0022e9 thru 0x01034c (0xe064 bytes) 000239 1780333932.701131 MIRROR_RESYNC 2 mirrors 000241 1780333933.876804 trunc from 0x040000 to 0x00f550 (0x30aaf bytes) 000243 1780333934.076123 write 0x016354 thru 0x01ef08 (0x8bb5 bytes) 000244 1780333934.079913 mapwrite 0x02e417 thru 0x033466 (0x5050 bytes) 000248 1780333934.200024 mapwrite 0x028908 thru 0x038028 (0xf721 bytes) 000249 1780333934.285804 trunc from 0x038029 to 0x02aa4b (0xd5dd bytes) 000250 1780333934.319097 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) 000251 1780333934.500098 mapwrite 0x027fad thru 0x0313bc (0x9410 bytes) 000254 1780333934.595104 write 0x01707a thru 0x0217c5 (0xa74c bytes) 000256 1780333934.612032 read 0x028265 thru 0x0313bc (0x9158 bytes) 000262 1780333934.617566 read 0x008459 thru 0x017fd2 (0xfb7a bytes) 000263 1780333934.628393 read 0x00c05a thru 0x013cdd (0x7c84 bytes) 000264 1780333934.630092 mapwrite 0x036e3a thru 0x03996c (0x2b33 bytes) 000265 1780333934.705903 trunc from 0x03996d to 0x01948f (0x204dd bytes) 000267 1780333934.723646 write 0x01bee1 thru 0x02bbed (0xfd0d bytes) 000269 1780333934.727731 write 0x02d41c thru 0x034a42 (0x7627 bytes) 000274 1780333934.733377 trunc from 0x034a43 to 0x00becc (0x28b76 bytes) 000275 1780333934.757301 trunc from 0x00becd to 0x00d686 (0x17ba bytes) 000276 1780333934.774896 write 0x034c29 thru 0x03e328 (0x9700 bytes) 000277 1780333934.778687 write 0x02a613 thru 0x0302ac (0x5c9a bytes) 000278 1780333934.789841 read 0x011a80 thru 0x0173bd (0x593e bytes) 000279 1780333934.798660 mapwrite 0x03016f thru 0x03ffff (0xfe91 bytes) 000280 1780333934.877721 mapwrite 0x039286 thru 0x03ffff (0x6d7a bytes) 000281 1780333934.922822 trunc from 0x040000 to 0x00ced6 (0x33129 bytes) 000285 1780333934.945839 mapread 0x000621 thru 0x00ced6 (0xc8b6 bytes) 000286 1780333934.947563 mapwrite 0x0046bf thru 0x0130ba (0xe9fc bytes) 000290 1780333935.058560 read 0x0089a4 thru 0x0130ba (0xa717 bytes) 000296 1780333935.063580 read 0x00e201 thru 0x00e702 (0x502 bytes) 000297 1780333935.069861 MIRROR_EXTEND to 2 mirrors 000299 1780333935.627503 mapread 0x00d607 thru 0x0130ba (0x5ab4 bytes) 000300 1780333935.673785 MIRROR_EXTEND to 3 mirrors 000301 1780333936.326260 write 0x03ca3e thru 0x03ffff (0x35c2 bytes) 000302 1780333936.421835 read 0x02e044 thru 0x03dd10 (0xfccd bytes) 000310 1780333936.436475 trunc from 0x040000 to 0x0070d2 (0x38f2d bytes) 000311 1780333936.489056 write 0x034502 thru 0x03d3f4 (0x8ef3 bytes) 000312 1780333936.490502 trunc from 0x03d3f5 to 0x01a2fe (0x230f6 bytes) 000313 1780333936.518751 mapread 0x00aca1 thru 0x00c0b8 (0x1418 bytes) 000314 1780333936.550487 read 0x001585 thru 0x010f21 (0xf99d bytes) 000316 1780333936.569046 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1a2ff): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a2ff): Mirror 2: 0x146ca273 (stale) Mirror 3: 0x146ca273 (stale) CRC-32 checksum value for chunk [0, 0x1a2ff): Mirror 1: 0x5ce26250 Mirror 4: 0x5ce26250 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a2ff: skipped 000317 1780333937.912440 MIRROR_RESYNC 4 mirrors 000319 1780333939.235266 mapwrite 0x030206 thru 0x034f27 (0x4d22 bytes) 000321 1780333939.468333 mapwrite 0x011cde thru 0x0169a3 (0x4cc6 bytes) 000322 1780333939.565772 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x34f28): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34f28): Mirror 2: 0x5dccbf90 (stale) Mirror 3: 0x5dccbf90 (stale) Mirror 4: 0x5dccbf90 (stale) CRC-32 checksum value for chunk [0, 0x34f28): Mirror 1: 0xfe460c Mirror 5: 0xfe460c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34f28: skipped 000323 1780333940.687672 read 0x01dd12 thru 0x0221be (0x44ad bytes) 000325 1780333940.721614 read 0x0018c5 thru 0x00f321 (0xda5d bytes) 000328 1780333940.766580 mapread 0x00de02 thru 0x00e11f (0x31e bytes) 000329 1780333940.785725 mapwrite 0x02029b thru 0x026225 (0x5f8b bytes) 000331 1780333941.051478 mapwrite 0x0131fa thru 0x01960f (0x6416 bytes) 000333 1780333941.179931 mapwrite 0x002b7a thru 0x0053ff (0x2886 bytes) 000336 1780333941.283226 write 0x0237c3 thru 0x0335f4 (0xfe32 bytes) 000338 1780333941.295294 trunc from 0x034f28 to 0x02db6a (0x73bd bytes) 000339 1780333941.321179 read 0x0258d5 thru 0x02db6a (0x8296 bytes) 000342 1780333941.324143 mapread 0x00db31 thru 0x015e44 (0x8314 bytes) 000343 1780333941.339646 write 0x038784 thru 0x03ffff (0x787c bytes) 000345 1780333941.343711 write 0x01301b thru 0x019ddf (0x6dc5 bytes) 000346 1780333941.348538 write 0x00b2b3 thru 0x0127e7 (0x7535 bytes) 000348 1780333941.354436 trunc from 0x040000 to 0x0080c2 (0x37f3d bytes) 000349 1780333941.387837 trunc from 0x0080c3 to 0x033a38 (0x2b976 bytes) 000353 1780333941.422597 mapread 0x008541 thru 0x012632 (0xa0f2 bytes) 000355 1780333941.509871 mapwrite 0x005d6a thru 0x01156d (0xb804 bytes) 000356 1780333941.565929 read 0x02d1ed thru 0x03377e (0x6592 bytes) 000357 1780333941.582128 trunc from 0x033a39 to 0x01ecb8 (0x14d80 bytes) 000358 1780333941.599983 mapwrite 0x002df9 thru 0x00e29a (0xb4a2 bytes) 000361 1780333941.685930 mapread 0x011744 thru 0x01ecb8 (0xd575 bytes) 000362 1780333941.687257 write 0x0032f2 thru 0x00be2f (0x8b3e bytes) 000363 1780333941.694695 mapwrite 0x0309c3 thru 0x03fdfb (0xf439 bytes) 000365 1780333941.828570 MIRROR_RESYNC 5 mirrors 000371 1780333942.841791 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) 000373 1780333943.146919 mapwrite 0x00676f thru 0x00897e (0x2210 bytes) 000374 1780333943.319651 mapwrite 0x021888 thru 0x023724 (0x1e9d bytes) 000375 1780333943.385186 MIRROR_RESYNC 4 mirrors 000377 1780333944.240573 read 0x01ad93 thru 0x0288c1 (0xdb2f bytes) 000378 1780333944.278498 trunc from 0x03fdfc to 0x00b289 (0x34b72 bytes) 000379 1780333944.451720 read 0x007b63 thru 0x00b289 (0x3727 bytes) 000384 1780333944.471333 read 0x007769 thru 0x00b289 (0x3b21 bytes) 000385 1780333944.472241 mapwrite 0x036b73 thru 0x03a385 (0x3813 bytes) 000389 1780333944.578850 trunc from 0x03a386 to 0x025282 (0x15103 bytes) 000390 1780333944.597332 mapwrite 0x010610 thru 0x01ad01 (0xa6f2 bytes) 000391 1780333944.667743 trunc from 0x025283 to 0x02f661 (0xa3df bytes) 000393 1780333944.692215 mapread 0x028bb5 thru 0x02a649 (0x1a95 bytes) 000395 1780333944.713758 mapwrite 0x00304c thru 0x003ad1 (0xa86 bytes) 000396 1780333944.753615 write 0x0307e8 thru 0x0384c3 (0x7cdc bytes) 000397 1780333944.754998 mapread 0x022566 thru 0x024636 (0x20d1 bytes) 000399 1780333944.757336 mapread 0x001354 thru 0x003025 (0x1cd2 bytes) 000400 1780333944.759783 trunc from 0x0384c4 to 0x01697a (0x21b49 bytes) 000401 1780333944.776488 mapwrite 0x01aaaf thru 0x023122 (0x8674 bytes) 000402 1780333944.917635 read 0x01ab11 thru 0x023122 (0x8612 bytes) 000403 1780333944.918456 mapread 0x006cbf thru 0x0103ae (0x96f0 bytes) 000404 1780333944.921553 trunc from 0x023123 to 0x023449 (0x327 bytes) 000406 1780333944.939775 mapread 0x00a40f thru 0x01a254 (0xfe46 bytes) 000407 1780333944.948835 mapread 0x01e8f8 thru 0x023449 (0x4b52 bytes) 000409 1780333944.950646 mapread 0x021ee7 thru 0x023449 (0x1563 bytes) 000410 1780333944.953430 write 0x00f9ef thru 0x017ff6 (0x8608 bytes) 000414 1780333944.960513 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2344a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2344a): Mirror 3: 0xc5122a98 (stale) Mirror 4: 0xc5122a98 (stale) Mirror 5: 0xc5122a98 (stale) CRC-32 checksum value for chunk [0, 0x2344a): Mirror 1: 0x173a26d8 Mirror 6: 0x173a26d8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2344a: skipped 000415 1780333945.957122 mapwrite 0x007dc9 thru 0x00c313 (0x454b bytes) 000417 1780333946.157722 mapwrite 0x0298c5 thru 0x02a95f (0x109b bytes) 000419 1780333946.248952 mapwrite 0x02a381 thru 0x034cd2 (0xa952 bytes) 000421 1780333946.356046 write 0x00c88e thru 0x00c9f8 (0x16b bytes) 000422 1780333946.357055 mapread 0x0086cb thru 0x017b46 (0xf47c bytes) 000423 1780333946.369230 mapwrite 0x006601 thru 0x0090fc (0x2afc bytes) 000424 1780333946.421551 write 0x0367eb thru 0x03ffff (0x9815 bytes) 000426 1780333946.424680 mapread 0x016187 thru 0x019175 (0x2fef bytes) 000427 1780333946.426842 write 0x002013 thru 0x006801 (0x47ef bytes) 000428 1780333946.428720 mapread 0x01acab thru 0x01f2ce (0x4624 bytes) 000429 1780333946.443891 MIRROR_RESYNC 5 mirrors 000432 1780333947.424223 write 0x0205a6 thru 0x025192 (0x4bed bytes) 000433 1780333947.495815 write 0x01e689 thru 0x0212d6 (0x2c4e bytes) 000439 1780333947.509026 trunc from 0x040000 to 0x008adf (0x37520 bytes) 000440 1780333947.547318 MIRROR_RESYNC 5 mirrors 000443 1780333948.358299 read 0x000dae thru 0x005dba (0x500d bytes) 000446 1780333948.372320 MIRROR_RESYNC 5 mirrors 000448 1780333948.698392 MIRROR_EXTEND to 6 mirrors 000449 1780333949.410787 trunc from 0x008ae0 to 0x032bf6 (0x2a117 bytes) 000450 1780333949.534113 mapwrite 0x020bc7 thru 0x02b4c5 (0xa8ff bytes) 000451 1780333949.686753 trunc from 0x032bf7 to 0x025954 (0xd2a2 bytes) 000452 1780333949.722592 trunc from 0x025955 to 0x035044 (0xf6f0 bytes) 000453 1780333949.746945 trunc from 0x035045 to 0x01b1e2 (0x19e62 bytes) 000454 1780333949.780437 MIRROR_RESYNC 6 mirrors 000455 1780333951.198950 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) 000457 1780333951.520994 write 0x03b59d thru 0x03ffff (0x4a63 bytes) 000458 1780333951.629235 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x25540a56 (stale) Mirror 5: 0x25540a56 (stale) Mirror 6: 0x25540a56 (stale) Mirror 7: 0x25540a56 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe9273f76 Mirror 8: 0xe9273f76 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000459 1780333952.730107 mapread 0x03edb0 thru 0x03ffff (0x1250 bytes) 000460 1780333952.762235 mapread 0x02f34d thru 0x03248f (0x3143 bytes) 000461 1780333952.789980 mapread 0x00f759 thru 0x012fb0 (0x3858 bytes) 000462 1780333952.823747 trunc from 0x040000 to 0x01e136 (0x21ec9 bytes) truncating to largest ever: 0x3b72a 000463 1780333952.937139 trunc from 0x01e137 to 0x03b729 (0x1d5f3 bytes) 000465 1780333952.962538 read 0x0393e5 thru 0x03b729 (0x2345 bytes) 000467 1780333952.969825 trunc from 0x03b72a to 0x01f375 (0x1c3b4 bytes) 000469 1780333952.995248 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1f376): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f376): Mirror 3: 0x5e64c93d (stale) Mirror 5: 0x5e64c93d (stale) Mirror 6: 0x5e64c93d (stale) Mirror 7: 0x5e64c93d (stale) Mirror 8: 0x5e64c93d (stale) CRC-32 checksum value for chunk [0, 0x1f376): Mirror 1: 0x5e64c93d Mirror 9: 0x5e64c93d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f376: skipped 000470 1780333953.956230 mapwrite 0x03ce1f thru 0x03d088 (0x26a bytes) 000471 1780333954.133236 mapwrite 0x02e15a thru 0x03c91d (0xe7c4 bytes) 000473 1780333954.241523 MIRROR_RESYNC 7 mirrors 000476 1780333955.485701 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) 000480 1780333955.925682 mapwrite 0x007aae thru 0x009dcb (0x231e bytes) 000482 1780333956.164149 write 0x01523a thru 0x01f7b0 (0xa577 bytes) 000484 1780333956.202815 MIRROR_RESYNC 6 mirrors 000485 1780333957.845599 mapread 0x03380c thru 0x03d088 (0x987d bytes) 000486 1780333957.870950 mapread 0x01dc40 thru 0x029283 (0xb644 bytes) 000490 1780333957.908587 MIRROR_EXTEND to 7 mirrors 000491 1780333958.882151 mapread 0x02f0d7 thru 0x039c07 (0xab31 bytes) 000492 1780333958.908472 read 0x0318d5 thru 0x0340a8 (0x27d4 bytes) 000493 1780333958.909151 mapread 0x028906 thru 0x034ad5 (0xc1d0 bytes) 000494 1780333958.916930 trunc from 0x03d089 to 0x00f32b (0x2dd5d bytes) 000495 1780333959.024203 read 0x007d45 thru 0x00f32b (0x75e7 bytes) 000496 1780333959.037922 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf32c): Mirror 5: 0xa4158f22 (stale) Mirror 6: 0xa4158f22 (stale) Mirror 7: 0xa4158f22 (stale) Mirror 9: 0xa4158f22 (stale) Mirror 10: 0xa4158f22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf32c): Mirror 5: 0xa4158f22 (stale) Mirror 6: 0xa4158f22 (stale) Mirror 7: 0xa4158f22 (stale) Mirror 9: 0xa4158f22 (stale) Mirror 10: 0xa4158f22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf32c: skipped 000497 1780333959.460327 trunc from 0x00f32c to 0x0292bf (0x19f94 bytes) 000499 1780333959.490981 write 0x003d7f thru 0x0090c7 (0x5349 bytes) 000500 1780333959.528155 mapwrite 0x01e62f thru 0x026892 (0x8264 bytes) 000502 1780333959.604795 trunc from 0x0292c0 to 0x03286a (0x95ab bytes) 000504 1780333959.649049 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3286b): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3286b): Mirror 5: 0x8a609691 (stale) Mirror 6: 0x8a609691 (stale) Mirror 7: 0x8a609691 (stale) Mirror 9: 0x8a609691 (stale) Mirror 10: 0x8a609691 (stale) CRC-32 checksum value for chunk [0, 0x3286b): Mirror 1: 0x4d72c0d4 Mirror 11: 0x4d72c0d4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3286b: skipped 000505 1780333960.977923 mapread 0x0258fa thru 0x02bc78 (0x637f bytes) 000506 1780333961.026267 read 0x00b0c2 thru 0x0124a4 (0x73e3 bytes) 000507 1780333961.047912 write 0x03e4c2 thru 0x03ffff (0x1b3e bytes) 000510 1780333961.144302 read 0x01d3e0 thru 0x025177 (0x7d98 bytes) 000511 1780333961.166294 mapread 0x010e73 thru 0x0170c8 (0x6256 bytes) 000513 1780333961.175407 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x82cfbc4b (stale) Mirror 7: 0x82cfbc4b (stale) Mirror 9: 0x82cfbc4b (stale) Mirror 10: 0x82cfbc4b (stale) Mirror 11: 0xc483fc06 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x82cfbc4b (stale) Mirror 7: 0x82cfbc4b (stale) Mirror 9: 0x82cfbc4b (stale) Mirror 10: 0x82cfbc4b (stale) Mirror 11: 0xc483fc06 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000516 1780333961.832319 mapread 0x02c094 thru 0x035c3d (0x9baa bytes) 000517 1780333961.853568 mapwrite 0x0102bb thru 0x012d83 (0x2ac9 bytes) 000519 1780333961.940267 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x82cfbc4b (stale) Mirror 7: 0x82cfbc4b (stale) Mirror 10: 0x82cfbc4b (stale) Mirror 11: 0xc483fc06 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x82cfbc4b (stale) Mirror 7: 0x82cfbc4b (stale) Mirror 10: 0x82cfbc4b (stale) Mirror 11: 0xc483fc06 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000521 1780333962.540698 mapread 0x03f50e thru 0x03ffff (0xaf2 bytes) 000523 1780333962.550763 trunc from 0x040000 to 0x014c72 (0x2b38d bytes) 000524 1780333962.579920 trunc from 0x014c73 to 0x00b4f1 (0x9781 bytes) 000525 1780333962.611147 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xb4f2): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb4f2): Mirror 6: 0xfa4a2a71 (stale) Mirror 7: 0xfa4a2a71 (stale) Mirror 10: 0xfa4a2a71 (stale) Mirror 11: 0x6fc61347 (stale) CRC-32 checksum value for chunk [0, 0xb4f2): Mirror 1: 0x6fc61347 Mirror 12: 0x6fc61347 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb4f2: skipped 000526 1780333963.876061 read 0x0057a0 thru 0x00b4f1 (0x5d52 bytes) 000527 1780333963.930082 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0xb4f2): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb4f2): Mirror 6: 0xfa4a2a71 (stale) Mirror 7: 0xfa4a2a71 (stale) Mirror 10: 0xfa4a2a71 (stale) Mirror 11: 0x6fc61347 (stale) CRC-32 checksum value for chunk [0, 0xb4f2): Mirror 1: 0x6fc61347 Mirror 12: 0x6fc61347 Mirror 13: 0x6fc61347 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb4f2: skipped 000528 1780333964.979852 mapwrite 0x0231b8 thru 0x02eff8 (0xbe41 bytes) 000529 1780333965.161115 read 0x018235 thru 0x021473 (0x923f bytes) 000532 1780333965.172275 write 0x0018cf thru 0x008a7b (0x71ad bytes) 000533 1780333965.182843 trunc from 0x02eff9 to 0x03ad3f (0xbd47 bytes) 000535 1780333965.207872 mapread 0x011ecf thru 0x020d59 (0xee8b bytes) 000536 1780333965.218487 trunc from 0x03ad40 to 0x02fd98 (0xafa7 bytes) 000538 1780333965.242742 mapread 0x01f0d5 thru 0x021018 (0x1f44 bytes) 000539 1780333965.243946 mapwrite 0x00246f thru 0x009b47 (0x76d9 bytes) 000542 1780333965.326058 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2fd99): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fd99): Mirror 6: 0x1abf6f7b (stale) Mirror 7: 0x1abf6f7b (stale) Mirror 10: 0x1abf6f7b (stale) Mirror 11: 0xaafe385c (stale) Mirror 12: 0x3c009eb0 (stale) Mirror 13: 0x3c009eb0 (stale) CRC-32 checksum value for chunk [0, 0x2fd99): Mirror 1: 0xe9561547 Mirror 14: 0xe9561547 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fd99: skipped 000543 1780333966.259018 MIRROR_RESYNC 8 mirrors 000544 1780333967.706729 write 0x034df3 thru 0x03e52d (0x973b bytes) 000545 1780333967.782953 mapwrite 0x01b01f thru 0x0295eb (0xe5cd bytes) 000548 1780333967.880040 mapread 0x0000a7 thru 0x00d89e (0xd7f8 bytes) 000551 1780333967.911501 mapread 0x014ab4 thru 0x017dd1 (0x331e bytes) 000554 1780333967.924951 read 0x008c6c thru 0x01130e (0x86a3 bytes) 000556 1780333967.927878 mapwrite 0x02c29f thru 0x03b96a (0xf6cc bytes) 000557 1780333967.993291 mapwrite 0x037e3c thru 0x03ffff (0x81c4 bytes) 000558 1780333968.116238 read 0x0178a0 thru 0x0241f0 (0xc951 bytes) 000559 1780333968.117129 mapread 0x03986a thru 0x03ffff (0x6796 bytes) 000560 1780333968.120759 write 0x003f7f thru 0x0104c4 (0xc546 bytes) 000562 1780333968.125794 trunc from 0x040000 to 0x0052b3 (0x3ad4c bytes) 000563 1780333968.150018 mapwrite 0x02289b thru 0x025bb3 (0x3319 bytes) 000565 1780333968.251492 mapread 0x0021ea thru 0x00e53c (0xc353 bytes) 000566 1780333968.254967 write 0x01b0a9 thru 0x0219d3 (0x692b bytes) 000568 1780333968.257667 mapread 0x01c0da thru 0x01c7b2 (0x6d9 bytes) 000570 1780333968.259277 mapwrite 0x02834b thru 0x0378c0 (0xf576 bytes) 000574 1780333968.358218 mapwrite 0x00bb1d thru 0x00d120 (0x1604 bytes) 000575 1780333968.394447 MIRROR_RESYNC 8 mirrors 000577 1780333970.351993 MIRROR_RESYNC 8 mirrors 000579 1780333971.223243 mapread 0x01343e thru 0x019d72 (0x6935 bytes) 000582 1780333971.278115 MIRROR_EXTEND to 9 mirrors 000583 1780333972.153473 trunc from 0x0378c1 to 0x01f4ca (0x183f6 bytes) 000586 1780333972.302101 read 0x01a000 thru 0x01f4ca (0x54cb bytes) 000587 1780333972.313514 write 0x020cf8 thru 0x02e1ae (0xd4b7 bytes) 000589 1780333972.323926 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e1af): Mirror 6: 0xd346b68 (stale) Mirror 7: 0xd346b68 (stale) Mirror 10: 0xd346b68 (stale) Mirror 11: 0xd346b68 (stale) Mirror 13: 0xd346b68 (stale) Mirror 14: 0xd346b68 (stale) Mirror 15: 0xd346b68 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e1af): Mirror 6: 0xd346b68 (stale) Mirror 7: 0xd346b68 (stale) Mirror 10: 0xd346b68 (stale) Mirror 11: 0xd346b68 (stale) Mirror 13: 0xd346b68 (stale) Mirror 14: 0xd346b68 (stale) Mirror 15: 0xd346b68 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e1af: skipped 000594 1780333973.048962 write 0x02588f thru 0x02d40b (0x7b7d bytes) 000595 1780333973.067874 mapread 0x02770f thru 0x02e1ae (0x6aa0 bytes) 000596 1780333973.081196 MIRROR_RESYNC 8 mirrors 000597 1780333974.932131 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) 000598 1780333975.415228 write 0x039ad6 thru 0x03c504 (0x2a2f bytes) 000600 1780333975.515087 read 0x030665 thru 0x031a6d (0x1409 bytes) 000602 1780333975.525281 trunc from 0x03c505 to 0x00de01 (0x2e703 bytes) 000603 1780333975.549824 mapwrite 0x011881 thru 0x0205cb (0xed4b bytes) 000604 1780333975.752008 read 0x00c31d thru 0x019200 (0xcee4 bytes) 000605 1780333975.753318 mapread 0x007b4f thru 0x00db0a (0x5fbc bytes) 000606 1780333975.805075 MIRROR_RESYNC 7 mirrors 000607 1780333977.347301 write 0x024521 thru 0x02b969 (0x7449 bytes) 000608 1780333977.436242 mapread 0x00c24a thru 0x019a0e (0xd7c5 bytes) 000612 1780333977.482270 MIRROR_RESYNC 7 mirrors 000614 1780333979.219640 MIRROR_RESYNC 7 mirrors 000617 1780333979.946850 read 0x02a20b thru 0x02b969 (0x175f bytes) 000618 1780333979.961121 read 0x019399 thru 0x022089 (0x8cf1 bytes) 000619 1780333979.976911 mapwrite 0x022015 thru 0x02b943 (0x992f bytes) 000620 1780333980.440592 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2b96a): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b96a): Mirror 7: 0x8a09db56 (stale) Mirror 10: 0x8a09db56 (stale) Mirror 11: 0x8a09db56 (stale) Mirror 13: 0x8a09db56 (stale) Mirror 14: 0x8a09db56 (stale) Mirror 15: 0x8a09db56 (stale) CRC-32 checksum value for chunk [0, 0x2b96a): Mirror 1: 0xf801396d Mirror 16: 0xf801396d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b96a: skipped 000621 1780333981.472249 write 0x005503 thru 0x014f77 (0xfa75 bytes) 000623 1780333981.652777 mapread 0x00b6e1 thru 0x013896 (0x81b6 bytes) 000625 1780333981.663626 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2b96a): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b96a): Mirror 7: 0x8a09db56 (stale) Mirror 10: 0x8a09db56 (stale) Mirror 11: 0x8a09db56 (stale) Mirror 13: 0x8a09db56 (stale) Mirror 14: 0x8a09db56 (stale) Mirror 15: 0x8a09db56 (stale) Mirror 16: 0xf801396d (stale) CRC-32 checksum value for chunk [0, 0x2b96a): Mirror 1: 0xff98eff7 Mirror 17: 0xff98eff7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b96a: skipped 000626 1780333983.147111 MIRROR_RESYNC 9 mirrors 000628 1780333984.867929 write 0x00015e thru 0x00e57a (0xe41d bytes) 000633 1780333984.979492 read 0x00fd97 thru 0x01b447 (0xb6b1 bytes) 000635 1780333984.987712 mapread 0x00b925 thru 0x00cca6 (0x1382 bytes) 000636 1780333984.988832 read 0x00eb7d thru 0x00f8d0 (0xd54 bytes) 000637 1780333984.989491 trunc from 0x02b96a to 0x021297 (0xa6d2 bytes) 000641 1780333985.014916 trunc from 0x021298 to 0x037d84 (0x16aed bytes) 000642 1780333985.041901 write 0x003a32 thru 0x01283f (0xee0e bytes) 000643 1780333985.045094 trunc from 0x037d85 to 0x0202ca (0x17aba bytes) 000645 1780333985.061558 write 0x019ff7 thru 0x028a6d (0xea77 bytes) 000646 1780333985.064995 mapwrite 0x015e97 thru 0x01d364 (0x74ce bytes) 000647 1780333985.185959 mapwrite 0x03833d thru 0x03aafa (0x27be bytes) 000648 1780333985.297847 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3aafb): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aafb): Mirror 7: 0x2a81393b (stale) Mirror 10: 0x2a81393b (stale) Mirror 11: 0x2a81393b (stale) Mirror 13: 0x2a81393b (stale) Mirror 14: 0x2a81393b (stale) Mirror 15: 0x2a81393b (stale) Mirror 16: 0x2a81393b (stale) Mirror 17: 0x2a81393b (stale) CRC-32 checksum value for chunk [0, 0x3aafb): Mirror 1: 0xa5dce9d Mirror 18: 0xa5dce9d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aafb: skipped 000650 1780333986.458679 mapwrite 0x028644 thru 0x031505 (0x8ec2 bytes) 000651 1780333986.689118 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3aafb): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aafb): Mirror 7: 0x2a81393b (stale) Mirror 10: 0x2a81393b (stale) Mirror 11: 0x2a81393b (stale) Mirror 13: 0x2a81393b (stale) Mirror 14: 0x2a81393b (stale) Mirror 15: 0x2a81393b (stale) Mirror 16: 0x2a81393b (stale) Mirror 17: 0x2a81393b (stale) Mirror 18: 0xa5dce9d (stale) CRC-32 checksum value for chunk [0, 0x3aafb): Mirror 1: 0xa4ad9dbe Mirror 19: 0xa4ad9dbe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aafb: skipped 000652 1780333987.909211 trunc from 0x03aafb to 0x02372f (0x173cb bytes) 000654 1780333988.087587 mapwrite 0x031b9e thru 0x0366fe (0x4b61 bytes) 000655 1780333988.209975 trunc from 0x0366ff to 0x024422 (0x122dc bytes) 000657 1780333988.237982 mapwrite 0x001125 thru 0x003cb8 (0x2b94 bytes) 000658 1780333988.314779 read 0x015918 thru 0x01c3c4 (0x6aad bytes) 000659 1780333988.325768 read 0x0221fd thru 0x022cef (0xaf3 bytes) 000660 1780333988.335648 mapwrite 0x038b47 thru 0x03fe14 (0x72ce bytes) 000661 1780333988.399137 mapread 0x011dfd thru 0x01d506 (0xb70a bytes) 000662 1780333988.401106 read 0x011993 thru 0x01ed84 (0xd3f2 bytes) 000667 1780333988.405654 write 0x00f0ce thru 0x01d8f5 (0xe828 bytes) 000671 1780333988.409807 mapwrite 0x026b5b thru 0x0337ea (0xcc90 bytes) 000679 1780333988.485522 MIRROR_RESYNC 11 mirrors 000682 1780333991.752906 mapread 0x02771b thru 0x02b51e (0x3e04 bytes) 000683 1780333991.816071 mapwrite 0x03d456 thru 0x03ffff (0x2baa bytes) 000687 1780333992.012256 mapwrite 0x01d1df thru 0x023ed6 (0x6cf8 bytes) 000688 1780333992.121529 trunc from 0x040000 to 0x0375c3 (0x8a3c bytes) 000689 1780333992.153739 write 0x016919 thru 0x01e59b (0x7c83 bytes) 000690 1780333992.155282 read 0x02e0e5 thru 0x036a24 (0x8940 bytes) 000691 1780333992.168710 read 0x0076d5 thru 0x01186f (0xa19b bytes) 000693 1780333992.202225 read 0x01ac0a thru 0x022b84 (0x7f7b bytes) 000694 1780333992.206917 trunc from 0x0375c4 to 0x00dbd5 (0x299ee bytes) 000695 1780333992.244987 trunc from 0x00dbd6 to 0x031fba (0x243e5 bytes) 000696 1780333992.278868 trunc from 0x031fbb to 0x0040ea (0x2ded0 bytes) 000699 1780333992.307849 write 0x006cb4 thru 0x00815f (0x14ac bytes) 000700 1780333992.309408 write 0x0015d0 thru 0x004ea8 (0x38d9 bytes) 000704 1780333992.313534 trunc from 0x008160 to 0x009cbf (0x1b60 bytes) 000705 1780333992.345010 MIRROR_RESYNC 11 mirrors 000707 1780333993.986772 read 0x0026a2 thru 0x0028fd (0x25c bytes) 000710 1780333993.993814 mapread 0x001858 thru 0x007030 (0x57d9 bytes) 000711 1780333994.013995 trunc from 0x009cc0 to 0x037822 (0x2db63 bytes) 000712 1780333994.097984 MIRROR_RESYNC 11 mirrors 000714 1780333995.591275 trunc from 0x037823 to 0x0175a9 (0x20279 bytes) 000717 1780333995.686220 write 0x000d12 thru 0x0036e5 (0x29d4 bytes) 000718 1780333995.696975 read 0x008481 thru 0x0117b5 (0x9335 bytes) 000719 1780333995.707038 trunc from 0x0175aa to 0x03a2f8 (0x22d4f bytes) 000720 1780333995.732674 write 0x03ee94 thru 0x03ffff (0x116c bytes) 000721 1780333995.738503 MIRROR_RESYNC 11 mirrors truncating to largest ever: 0x3ca37 000722 1780333997.499192 trunc from 0x040000 to 0x03ca36 (0x35c9 bytes) 000723 1780333997.674408 mapwrite 0x0345c9 thru 0x03462e (0x66 bytes) 000725 1780333997.746051 read 0x00aeaa thru 0x00b88f (0x9e6 bytes) 000727 1780333997.753556 mapwrite 0x00a6d4 thru 0x017143 (0xca70 bytes) 000728 1780333997.821614 read 0x025d6d thru 0x031950 (0xbbe4 bytes) 000730 1780333997.838874 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3ca37): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ca37): Mirror 7: 0x210f5ac5 (stale) Mirror 10: 0x210f5ac5 (stale) Mirror 11: 0x210f5ac5 (stale) Mirror 13: 0x210f5ac5 (stale) Mirror 14: 0x210f5ac5 (stale) Mirror 15: 0x210f5ac5 (stale) Mirror 16: 0x210f5ac5 (stale) Mirror 17: 0x210f5ac5 (stale) Mirror 18: 0x210f5ac5 (stale) Mirror 19: 0x210f5ac5 (stale) CRC-32 checksum value for chunk [0, 0x3ca37): Mirror 1: 0x148200b5 Mirror 20: 0x148200b5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ca37: skipped 000733 1780333999.225228 MIRROR_RESYNC 12 mirrors 000734 1780334000.922326 mapwrite 0x007d19 thru 0x00bb28 (0x3e10 bytes) 000735 1780334001.088177 read 0x027cae thru 0x0374c8 (0xf81b bytes) 000737 1780334001.099776 write 0x007911 thru 0x011dfa (0xa4ea bytes) 000739 1780334001.111004 MIRROR_RESYNC 12 mirrors 000743 1780334003.969336 read 0x01f04a thru 0x0272a8 (0x825f bytes) 000745 1780334003.981843 trunc from 0x03ca37 to 0x02e696 (0xe3a0 bytes) 000746 1780334004.130251 read 0x0245a7 thru 0x0292f9 (0x4d53 bytes) 000747 1780334004.155805 trunc from 0x02e697 to 0x03551b (0x6e85 bytes) 000749 1780334004.196701 mapwrite 0x03ea47 thru 0x03ffff (0x15b9 bytes) 000750 1780334004.318492 write 0x02eb3b thru 0x03da00 (0xeec6 bytes) 000754 1780334004.336127 mapread 0x00ba3f thru 0x01b7f6 (0xfdb8 bytes) 000755 1780334004.340805 mapwrite 0x02201c thru 0x022aec (0xad1 bytes) 000756 1780334004.432790 mapread 0x00e8fc thru 0x01d354 (0xea59 bytes) 000757 1780334004.434133 mapread 0x010667 thru 0x019172 (0x8b0c bytes) 000758 1780334004.444619 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd387031 (stale) Mirror 10: 0xd387031 (stale) Mirror 11: 0xd387031 (stale) Mirror 13: 0xd387031 (stale) Mirror 14: 0xd387031 (stale) Mirror 15: 0xd387031 (stale) Mirror 16: 0xd387031 (stale) Mirror 17: 0xd387031 (stale) Mirror 18: 0xd387031 (stale) Mirror 19: 0xd387031 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd387031 (stale) Mirror 10: 0xd387031 (stale) Mirror 11: 0xd387031 (stale) Mirror 13: 0xd387031 (stale) Mirror 14: 0xd387031 (stale) Mirror 15: 0xd387031 (stale) Mirror 16: 0xd387031 (stale) Mirror 17: 0xd387031 (stale) Mirror 18: 0xd387031 (stale) Mirror 19: 0xd387031 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000759 1780334005.413508 mapread 0x023c95 thru 0x032428 (0xe794 bytes) 000761 1780334005.483265 trunc from 0x040000 to 0x0083f1 (0x37c0e bytes) 000762 1780334005.531225 MIRROR_RESYNC 11 mirrors 000763 1780334007.743634 read 0x003d1b thru 0x00467d (0x963 bytes) 000766 1780334007.755086 write 0x01628d thru 0x0186be (0x2432 bytes) 000771 1780334007.928328 MIRROR_SPLIT mirror 4 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x186bf): Mirror 7: 0x9475f4d3 (stale) Mirror 10: 0x9475f4d3 (stale) Mirror 11: 0x9475f4d3 (stale) Mirror 14: 0x9475f4d3 (stale) Mirror 15: 0x9475f4d3 (stale) Mirror 16: 0x9475f4d3 (stale) Mirror 17: 0x9475f4d3 (stale) Mirror 18: 0x9475f4d3 (stale) Mirror 19: 0x9475f4d3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x186bf): Mirror 7: 0x9475f4d3 (stale) Mirror 10: 0x9475f4d3 (stale) Mirror 11: 0x9475f4d3 (stale) Mirror 14: 0x9475f4d3 (stale) Mirror 15: 0x9475f4d3 (stale) Mirror 16: 0x9475f4d3 (stale) Mirror 17: 0x9475f4d3 (stale) Mirror 18: 0x9475f4d3 (stale) Mirror 19: 0x9475f4d3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x186bf: skipped 000772 1780334008.706579 trunc from 0x0186bf to 0x01d044 (0x4986 bytes) 000773 1780334008.746192 write 0x028b24 thru 0x034862 (0xbd3f bytes) 000778 1780334008.778211 MIRROR_RESYNC 10 mirrors 000780 1780334011.073791 write 0x02e123 thru 0x02e8e4 (0x7c2 bytes) 000781 1780334011.201627 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x34863): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34863): Mirror 7: 0xdda3bd09 (stale) Mirror 10: 0xdda3bd09 (stale) Mirror 11: 0xdda3bd09 (stale) Mirror 14: 0xdda3bd09 (stale) Mirror 15: 0xdda3bd09 (stale) Mirror 16: 0xdda3bd09 (stale) Mirror 17: 0xdda3bd09 (stale) Mirror 18: 0xdda3bd09 (stale) Mirror 19: 0xdda3bd09 (stale) CRC-32 checksum value for chunk [0, 0x34863): Mirror 1: 0xc47334c4 Mirror 20: 0xc47334c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34863: skipped 000783 1780334012.289173 mapwrite 0x008161 thru 0x0116d9 (0x9579 bytes) 000786 1780334012.526558 read 0x01a408 thru 0x01ba3e (0x1637 bytes) 000787 1780334012.539518 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34863): Mirror 7: 0xdda3bd09 (stale) Mirror 10: 0xdda3bd09 (stale) Mirror 11: 0xdda3bd09 (stale) Mirror 14: 0xdda3bd09 (stale) Mirror 15: 0xdda3bd09 (stale) Mirror 16: 0xdda3bd09 (stale) Mirror 17: 0xdda3bd09 (stale) Mirror 18: 0xdda3bd09 (stale) Mirror 20: 0xc47334c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34863): Mirror 7: 0xdda3bd09 (stale) Mirror 10: 0xdda3bd09 (stale) Mirror 11: 0xdda3bd09 (stale) Mirror 14: 0xdda3bd09 (stale) Mirror 15: 0xdda3bd09 (stale) Mirror 16: 0xdda3bd09 (stale) Mirror 17: 0xdda3bd09 (stale) Mirror 18: 0xdda3bd09 (stale) Mirror 20: 0xc47334c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34863: skipped 000788 1780334013.114699 mapread 0x00cf65 thru 0x00f1ef (0x228b bytes) 000791 1780334013.152937 mapread 0x02df89 thru 0x034862 (0x68da bytes) 000794 1780334013.164222 trunc from 0x034863 to 0x024693 (0x101cf bytes) 000795 1780334013.187369 mapwrite 0x00cd7a thru 0x0109ef (0x3c76 bytes) 000797 1780334013.271487 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24694): Mirror 7: 0xf6b44392 (stale) Mirror 11: 0xf6b44392 (stale) Mirror 14: 0xf6b44392 (stale) Mirror 15: 0xf6b44392 (stale) Mirror 16: 0xf6b44392 (stale) Mirror 17: 0xf6b44392 (stale) Mirror 18: 0xf6b44392 (stale) Mirror 20: 0xf6b44392 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24694): Mirror 7: 0xf6b44392 (stale) Mirror 11: 0xf6b44392 (stale) Mirror 14: 0xf6b44392 (stale) Mirror 15: 0xf6b44392 (stale) Mirror 16: 0xf6b44392 (stale) Mirror 17: 0xf6b44392 (stale) Mirror 18: 0xf6b44392 (stale) Mirror 20: 0xf6b44392 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24694: skipped 000799 1780334013.877060 read 0x000ea5 thru 0x00a6cc (0x9828 bytes) 000801 1780334013.904193 write 0x02ee09 thru 0x035a37 (0x6c2f bytes) 000803 1780334013.911568 mapwrite 0x00c3f3 thru 0x01c273 (0xfe81 bytes) 000805 1780334014.039503 MIRROR_RESYNC 9 mirrors 000807 1780334015.936050 read 0x01978c thru 0x025e02 (0xc677 bytes) 000809 1780334015.952411 MIRROR_EXTEND to 10 mirrors 000810 1780334016.798174 read 0x00c237 thru 0x010b61 (0x492b bytes) 000813 1780334016.811694 trunc from 0x035a38 to 0x0227c6 (0x13271 bytes) 000815 1780334016.928085 read 0x002ec9 thru 0x0062c7 (0x33ff bytes) 000816 1780334016.948435 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x227c7): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x227c7): Mirror 7: 0x8b609e70 (stale) Mirror 11: 0x8b609e70 (stale) Mirror 14: 0x8b609e70 (stale) Mirror 15: 0x8b609e70 (stale) Mirror 16: 0x8b609e70 (stale) Mirror 17: 0x8b609e70 (stale) Mirror 18: 0x8b609e70 (stale) Mirror 20: 0x8b609e70 (stale) Mirror 21: 0x8b609e70 (stale) CRC-32 checksum value for chunk [0, 0x227c7): Mirror 1: 0x8b609e70 Mirror 22: 0x8b609e70 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x227c7: skipped 000818 1780334018.223283 mapwrite 0x01482d thru 0x020f02 (0xc6d6 bytes) 000819 1780334018.559163 mapread 0x00bf1b thru 0x00bf6a (0x50 bytes) 000820 1780334018.578973 mapread 0x012ff1 thru 0x013af5 (0xb05 bytes) 000821 1780334018.579977 write 0x003cde thru 0x005977 (0x1c9a bytes) 000824 1780334018.589834 mapread 0x00485f thru 0x010663 (0xbe05 bytes) 000828 1780334018.601879 trunc from 0x0227c7 to 0x0316c3 (0xeefd bytes) 000829 1780334018.636043 write 0x03de43 thru 0x03ed8c (0xf4a bytes) 000831 1780334018.637822 trunc from 0x03ed8d to 0x03406e (0xad1e bytes) 000834 1780334018.678265 write 0x034ba4 thru 0x038cbd (0x411a bytes) 000836 1780334018.690125 read 0x0341bc thru 0x038cbd (0x4b02 bytes) 000838 1780334018.702756 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38cbe): Mirror 11: 0x5b5f07aa (stale) Mirror 14: 0x5b5f07aa (stale) Mirror 15: 0x5b5f07aa (stale) Mirror 16: 0x5b5f07aa (stale) Mirror 17: 0x5b5f07aa (stale) Mirror 18: 0x5b5f07aa (stale) Mirror 20: 0x5b5f07aa (stale) Mirror 21: 0x5b5f07aa (stale) Mirror 22: 0x74f22b1e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38cbe): Mirror 11: 0x5b5f07aa (stale) Mirror 14: 0x5b5f07aa (stale) Mirror 15: 0x5b5f07aa (stale) Mirror 16: 0x5b5f07aa (stale) Mirror 17: 0x5b5f07aa (stale) Mirror 18: 0x5b5f07aa (stale) Mirror 20: 0x5b5f07aa (stale) Mirror 21: 0x5b5f07aa (stale) Mirror 22: 0x74f22b1e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38cbe: skipped 000839 1780334019.399782 read 0x036a33 thru 0x037bbd (0x118b bytes) 000840 1780334019.412244 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x38cbe): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38cbe): Mirror 11: 0x5b5f07aa (stale) Mirror 14: 0x5b5f07aa (stale) Mirror 15: 0x5b5f07aa (stale) Mirror 16: 0x5b5f07aa (stale) Mirror 17: 0x5b5f07aa (stale) Mirror 18: 0x5b5f07aa (stale) Mirror 20: 0x5b5f07aa (stale) Mirror 21: 0x5b5f07aa (stale) Mirror 22: 0x74f22b1e (stale) CRC-32 checksum value for chunk [0, 0x38cbe): Mirror 1: 0x8f9ef149 Mirror 23: 0x8f9ef149 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38cbe: skipped 000841 1780334020.554760 read 0x012c09 thru 0x016fa3 (0x439b bytes) 000842 1780334020.569582 write 0x022ef9 thru 0x026495 (0x359d bytes) 000846 1780334020.684775 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x38cbe): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38cbe): Mirror 11: 0x5b5f07aa (stale) Mirror 14: 0x5b5f07aa (stale) Mirror 15: 0x5b5f07aa (stale) Mirror 16: 0x5b5f07aa (stale) Mirror 17: 0x5b5f07aa (stale) Mirror 18: 0x5b5f07aa (stale) Mirror 20: 0x5b5f07aa (stale) Mirror 21: 0x5b5f07aa (stale) Mirror 22: 0x74f22b1e (stale) Mirror 23: 0x8f9ef149 (stale) CRC-32 checksum value for chunk [0, 0x38cbe): Mirror 1: 0xd017fbd2 Mirror 24: 0xd017fbd2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38cbe: skipped 000849 1780334022.242819 write 0x03f594 thru 0x03ffff (0xa6c bytes) 000851 1780334022.384533 mapread 0x005fb3 thru 0x00c4a6 (0x64f4 bytes) 000852 1780334022.412430 trunc from 0x040000 to 0x029f2d (0x160d2 bytes) 000854 1780334022.447009 write 0x03dbf4 thru 0x03ffff (0x240c bytes) 000856 1780334022.452501 trunc from 0x040000 to 0x001828 (0x3e7d7 bytes) 000858 1780334022.482992 trunc from 0x001829 to 0x013912 (0x120ea bytes) 000859 1780334022.500698 write 0x00ce22 thru 0x00e641 (0x1820 bytes) 000860 1780334022.517241 MIRROR_RESYNC 12 mirrors 000861 1780334024.521153 read 0x003858 thru 0x0101b5 (0xc95e bytes) 000864 1780334024.542332 trunc from 0x013913 to 0x01a0b0 (0x679e bytes) 000866 1780334024.672061 read 0x013608 thru 0x01a0b0 (0x6aa9 bytes) 000869 1780334024.686193 write 0x02f511 thru 0x0304fe (0xfee bytes) 000871 1780334024.689128 mapwrite 0x001c69 thru 0x01044e (0xe7e6 bytes) 000872 1780334024.783240 write 0x004d17 thru 0x006a0a (0x1cf4 bytes) 000874 1780334024.787179 mapwrite 0x0282e0 thru 0x029eb0 (0x1bd1 bytes) 000875 1780334024.871905 read 0x0137fd thru 0x0161cf (0x29d3 bytes) 000876 1780334024.872805 trunc from 0x0304ff to 0x02fbaa (0x954 bytes) 000880 1780334024.902819 mapwrite 0x007e05 thru 0x017459 (0xf655 bytes) 000882 1780334024.964218 write 0x02ddb3 thru 0x03244c (0x469a bytes) 000883 1780334024.971480 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3244d): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3244d): Mirror 11: 0xbc8d99ae (stale) Mirror 14: 0xbc8d99ae (stale) Mirror 15: 0xbc8d99ae (stale) Mirror 16: 0xbc8d99ae (stale) Mirror 17: 0xbc8d99ae (stale) Mirror 18: 0xbc8d99ae (stale) Mirror 20: 0xbc8d99ae (stale) Mirror 21: 0xbc8d99ae (stale) Mirror 22: 0xbc8d99ae (stale) Mirror 23: 0xbc8d99ae (stale) Mirror 24: 0xbc8d99ae (stale) CRC-32 checksum value for chunk [0, 0x3244d): Mirror 1: 0x6440a416 Mirror 25: 0x6440a416 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3244d: skipped 000884 1780334025.933502 trunc from 0x03244d to 0x024d0b (0xd741 bytes) 000885 1780334026.041049 mapread 0x010ba4 thru 0x0157d7 (0x4c34 bytes) 000888 1780334026.064879 mapread 0x001aa8 thru 0x00ccc8 (0xb221 bytes) 000891 1780334026.076088 mapread 0x01687b thru 0x024721 (0xdea7 bytes) 000892 1780334026.099424 MIRROR_RESYNC 13 mirrors 000897 1780334028.146497 mapread 0x00a487 thru 0x00a76c (0x2e6 bytes) 000898 1780334028.156774 write 0x005062 thru 0x00afae (0x5f4d bytes) 000899 1780334028.256234 mapread 0x011eb5 thru 0x01a578 (0x86c4 bytes) 000900 1780334028.285145 MIRROR_SPLIT mirror 9 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24d0c): Mirror 11: 0x7ab4adf (stale) Mirror 14: 0x7ab4adf (stale) Mirror 15: 0x7ab4adf (stale) Mirror 16: 0x7ab4adf (stale) Mirror 17: 0x7ab4adf (stale) Mirror 18: 0x7ab4adf (stale) Mirror 20: 0x7ab4adf (stale) Mirror 21: 0x7ab4adf (stale) Mirror 23: 0x7ab4adf (stale) Mirror 24: 0x7ab4adf (stale) Mirror 25: 0x7ab4adf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24d0c): Mirror 11: 0x7ab4adf (stale) Mirror 14: 0x7ab4adf (stale) Mirror 15: 0x7ab4adf (stale) Mirror 16: 0x7ab4adf (stale) Mirror 17: 0x7ab4adf (stale) Mirror 18: 0x7ab4adf (stale) Mirror 20: 0x7ab4adf (stale) Mirror 21: 0x7ab4adf (stale) Mirror 23: 0x7ab4adf (stale) Mirror 24: 0x7ab4adf (stale) Mirror 25: 0x7ab4adf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24d0c: skipped 000904 1780334029.027493 write 0x024ffe thru 0x02d9bf (0x89c2 bytes) 000905 1780334029.047908 read 0x00ea84 thru 0x01467d (0x5bfa bytes) 000913 1780334029.110900 trunc from 0x02d9c0 to 0x00b85b (0x22164 bytes) 000914 1780334029.140211 mapwrite 0x02a534 thru 0x02d05c (0x2b29 bytes) 000916 1780334029.356136 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2d05d): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d05d): Mirror 11: 0x40d6c995 (stale) Mirror 14: 0x40d6c995 (stale) Mirror 15: 0x40d6c995 (stale) Mirror 16: 0x40d6c995 (stale) Mirror 17: 0x40d6c995 (stale) Mirror 18: 0x40d6c995 (stale) Mirror 20: 0x40d6c995 (stale) Mirror 21: 0x40d6c995 (stale) Mirror 23: 0x40d6c995 (stale) Mirror 24: 0x40d6c995 (stale) Mirror 25: 0x40d6c995 (stale) CRC-32 checksum value for chunk [0, 0x2d05d): Mirror 1: 0xf7f653f2 Mirror 26: 0xf7f653f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d05d: skipped 000917 1780334031.122841 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2d05d): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d05d): Mirror 11: 0x40d6c995 (stale) Mirror 14: 0x40d6c995 (stale) Mirror 15: 0x40d6c995 (stale) Mirror 16: 0x40d6c995 (stale) Mirror 17: 0x40d6c995 (stale) Mirror 18: 0x40d6c995 (stale) Mirror 20: 0x40d6c995 (stale) Mirror 21: 0x40d6c995 (stale) Mirror 23: 0x40d6c995 (stale) Mirror 24: 0x40d6c995 (stale) Mirror 25: 0x40d6c995 (stale) CRC-32 checksum value for chunk [0, 0x2d05d): Mirror 1: 0xf7f653f2 Mirror 26: 0xf7f653f2 Mirror 27: 0xf7f653f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d05d: skipped 000918 1780334032.554523 mapread 0x0079a9 thru 0x00d939 (0x5f91 bytes) 000919 1780334032.576146 mapwrite 0x02d7a0 thru 0x035128 (0x7989 bytes) 000922 1780334032.781528 mapread 0x01040a thru 0x01bfe5 (0xbbdc bytes) 000923 1780334032.799927 mapwrite 0x00dcf9 thru 0x01b3f1 (0xd6f9 bytes) 000924 1780334032.858857 mapwrite 0x01da87 thru 0x0243d1 (0x694b bytes) truncating to largest ever: 0x3dcc5 000925 1780334032.916250 trunc from 0x035129 to 0x03dcc4 (0x8b9c bytes) 000926 1780334032.942138 mapwrite 0x0316da thru 0x03a27a (0x8ba1 bytes) 000928 1780334033.016272 read 0x00befe thru 0x013989 (0x7a8c bytes) 000929 1780334033.018107 read 0x030729 thru 0x03dcc4 (0xd59c bytes) 000930 1780334033.019129 mapwrite 0x028e85 thru 0x02c7fd (0x3979 bytes) 000931 1780334033.067100 trunc from 0x03dcc5 to 0x018153 (0x25b71 bytes) 000932 1780334033.097192 write 0x01fb73 thru 0x02b0db (0xb569 bytes) 000934 1780334033.107645 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b0dc): Mirror 14: 0x9605d7da (stale) Mirror 15: 0x9605d7da (stale) Mirror 16: 0x9605d7da (stale) Mirror 17: 0x9605d7da (stale) Mirror 18: 0x9605d7da (stale) Mirror 20: 0x9605d7da (stale) Mirror 21: 0x9605d7da (stale) Mirror 23: 0x9605d7da (stale) Mirror 24: 0x9605d7da (stale) Mirror 25: 0x9605d7da (stale) Mirror 26: 0xc31a6f97 (stale) Mirror 27: 0xc31a6f97 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b0dc): Mirror 14: 0x9605d7da (stale) Mirror 15: 0x9605d7da (stale) Mirror 16: 0x9605d7da (stale) Mirror 17: 0x9605d7da (stale) Mirror 18: 0x9605d7da (stale) Mirror 20: 0x9605d7da (stale) Mirror 21: 0x9605d7da (stale) Mirror 23: 0x9605d7da (stale) Mirror 24: 0x9605d7da (stale) Mirror 25: 0x9605d7da (stale) Mirror 26: 0xc31a6f97 (stale) Mirror 27: 0xc31a6f97 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b0dc: skipped 000935 1780334033.992587 trunc from 0x02b0dc to 0x029615 (0x1ac6 bytes) 000936 1780334034.033558 mapwrite 0x00932e thru 0x01197e (0x8651 bytes) 000939 1780334034.266169 read 0x00ed37 thru 0x00ff3e (0x1208 bytes) 000941 1780334034.270859 write 0x00a6e9 thru 0x00d9bb (0x32d3 bytes) 000942 1780334034.274390 mapread 0x015ce1 thru 0x01acbb (0x4fdb bytes) 000944 1780334034.320718 MIRROR_RESYNC 13 mirrors 000945 1780334036.755609 write 0x03ef5e thru 0x03ffff (0x10a2 bytes) 000947 1780334036.824249 MIRROR_RESYNC 13 mirrors 000948 1780334039.284133 trunc from 0x040000 to 0x019768 (0x26897 bytes) 000950 1780334039.391194 trunc from 0x019769 to 0x013838 (0x5f30 bytes) 000951 1780334039.414323 mapread 0x000517 thru 0x00343c (0x2f26 bytes) 000952 1780334039.443669 trunc from 0x013839 to 0x029093 (0x1585b bytes) 000954 1780334039.470636 MIRROR_SPLIT mirror 8 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x160:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29094): Mirror 14: 0x7eda343 (stale) Mirror 15: 0x7eda343 (stale) Mirror 16: 0x7eda343 (stale) Mirror 17: 0x7eda343 (stale) Mirror 18: 0x7eda343 (stale) Mirror 20: 0x7eda343 (stale) Mirror 21: 0x7eda343 (stale) Mirror 24: 0x7eda343 (stale) Mirror 25: 0x7eda343 (stale) Mirror 26: 0x7eda343 (stale) Mirror 27: 0x7eda343 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29094): Mirror 14: 0x7eda343 (stale) Mirror 15: 0x7eda343 (stale) Mirror 16: 0x7eda343 (stale) Mirror 17: 0x7eda343 (stale) Mirror 18: 0x7eda343 (stale) Mirror 20: 0x7eda343 (stale) Mirror 21: 0x7eda343 (stale) Mirror 24: 0x7eda343 (stale) Mirror 25: 0x7eda343 (stale) Mirror 26: 0x7eda343 (stale) Mirror 27: 0x7eda343 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29094: skipped 000955 1780334040.632831 MIRROR_RESYNC 12 mirrors 000956 1780334043.089002 write 0x00393a thru 0x012334 (0xe9fb bytes) 000959 1780334043.270172 trunc from 0x029094 to 0x006558 (0x22b3b bytes) 000963 1780334043.342504 write 0x0136b2 thru 0x0229f1 (0xf340 bytes) 000964 1780334043.353069 read 0x011cb0 thru 0x017b0f (0x5e60 bytes) 000968 1780334043.372924 mapwrite 0x012277 thru 0x01e3d4 (0xc15e bytes) 000971 1780334043.496655 MIRROR_RESYNC 12 mirrors 000972 1780334046.548498 write 0x002752 thru 0x0088c7 (0x6176 bytes) 000973 1780334046.778742 write 0x011a0b thru 0x011c5a (0x250 bytes) 000974 1780334046.802663 mapwrite 0x000309 thru 0x00ae12 (0xab0a bytes) 000977 1780334046.962112 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x229f2): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x229f2): Mirror 14: 0x9f346fa1 (stale) Mirror 15: 0x9f346fa1 (stale) Mirror 16: 0x9f346fa1 (stale) Mirror 17: 0x9f346fa1 (stale) Mirror 18: 0x9f346fa1 (stale) Mirror 20: 0x9f346fa1 (stale) Mirror 21: 0x9f346fa1 (stale) Mirror 24: 0x9f346fa1 (stale) Mirror 25: 0x9f346fa1 (stale) Mirror 26: 0x9f346fa1 (stale) Mirror 27: 0x9f346fa1 (stale) CRC-32 checksum value for chunk [0, 0x229f2): Mirror 1: 0xf9463ed4 Mirror 28: 0xf9463ed4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x229f2: skipped 000978 1780334048.344663 mapwrite 0x02f3cb thru 0x0359aa (0x65e0 bytes) 000983 1780334048.613748 mapwrite 0x006b92 thru 0x00a540 (0x39af bytes) 000987 1780334048.691765 mapwrite 0x0047b7 thru 0x0114aa (0xccf4 bytes) 000988 1780334048.767156 write 0x019cf8 thru 0x021398 (0x76a1 bytes) 000990 1780334048.774687 mapwrite 0x0301b2 thru 0x03642d (0x627c bytes) 000993 1780334048.875568 mapwrite 0x03f6f9 thru 0x03ffff (0x907 bytes) 000994 1780334048.972088 read 0x01b985 thru 0x02a465 (0xeae1 bytes) 000997 1780334048.992183 write 0x019a0b thru 0x023607 (0x9bfd bytes) 000998 1780334048.995881 write 0x03dce5 thru 0x03ffff (0x231b bytes) 000999 1780334048.996940 mapwrite 0x00e8f0 thru 0x00fcf6 (0x1407 bytes) 001000 1780334049.099932 mapread 0x03265e thru 0x03fdf0 (0xd793 bytes) All operations completed A-OK!