== sanity-flr test 70a: flr mode fsx test ================ 03:20:46 (1788852046) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 2047 000001 1788852047.643781 mapwrite 0x0396fd thru 0x03d561 (0x3e65 bytes) 000002 1788852047.687105 mapwrite 0x008cf9 thru 0x0178eb (0xebf3 bytes) 000003 1788852047.732105 punch from 0x0093fa to 0x014523 (0xb12a bytes) fallocating to largest ever: 0xfd99 000004 1788852047.737447 fallocate 0x00cb79 thru 0x00fd98 (0x3220 bytes) 000005 1788852047.741339 read 0x00313e thru 0x005ec6 (0x2d89 bytes) 000006 1788852047.741882 trunc from 0x03d562 to 0x006226 (0x3733b bytes) 000007 1788852047.757135 mapwrite 0x02abdf thru 0x037fd8 (0xd3fa bytes) fallocating to largest ever: 0x2ec47 000008 1788852047.833719 fallocate 0x028881 thru 0x02ec46 (0x63c6 bytes) 000009 1788852047.838188 trunc from 0x00b43b to 0x00e5ad (0x3173 bytes) 000010 1788852047.843585 write 0x03a402 thru 0x03b09a (0xc99 bytes) 000011 1788852047.844976 mapread 0x0339ea thru 0x03b09a (0x76b1 bytes) 000012 1788852047.853704 fallocate 0x01fdb3 thru 0x02de99 (0xe0e7 bytes) zero_range to largest ever: 0x3a5fb 000013 1788852047.864786 trunc from 0x02b8bc to 0x03a5fa (0xed3f bytes) 000015 1788852047.890941 fallocate 0x00fcf5 thru 0x018941 (0x8c4d bytes) 000016 1788852047.897938 mapread 0x011d5d thru 0x0171e1 (0x5485 bytes) 000017 1788852047.921324 MIRROR_EXTEND to 2 mirrors 000018 1788852048.431826 trunc from 0x00348e to 0x004f60 (0x1ad3 bytes) zero_range to largest ever: 0x3b09b 000019 1788852048.461216 trunc from 0x039d78 to 0x03b09a (0x1323 bytes) 000020 1788852048.474399 MIRROR_RESYNC 2 mirrors 000021 1788852049.137586 punch from 0x011dc5 to 0x0205e1 (0xe81d bytes) 000024 1788852049.217337 read 0x010b9c thru 0x01ad83 (0xa1e8 bytes) 000026 1788852049.228991 mapwrite 0x0255f6 thru 0x034b77 (0xf582 bytes) fallocating to largest ever: 0x40000 000027 1788852049.272924 fallocate 0x03f416 thru 0x03ffff (0xbea bytes) 000028 1788852049.291456 read 0x00bc6d thru 0x012e32 (0x71c6 bytes) 000029 1788852049.315557 fallocate 0x0093ee thru 0x01281a (0x942d bytes) 000030 1788852049.322772 write 0x00a2aa thru 0x00a6e8 (0x43f bytes) 000032 1788852049.324696 read 0x02ec69 thru 0x03b09a (0xc432 bytes) 000033 1788852049.328766 MIRROR_RESYNC 2 mirrors 000034 1788852050.193180 MIRROR_RESYNC 2 mirrors 000035 1788852050.627930 trunc from 0x037837 to 0x03b09a (0x3864 bytes) 000036 1788852050.693755 write 0x006cb9 thru 0x00f545 (0x888d bytes) 000037 1788852050.728773 trunc from 0x03b09b to 0x01edba (0x1c2e0 bytes) 000038 1788852050.849358 fallocate 0x022545 thru 0x0284b9 (0x5f75 bytes) 000039 1788852050.860354 trunc from 0x0062c8 to 0x014dce (0xeb07 bytes) 000041 1788852050.897358 mapwrite 0x00dbcf thru 0x00ff7c (0x23ae bytes) 000042 1788852050.997872 trunc from 0x002222 to 0x011d44 (0xfb23 bytes) 000043 1788852051.021167 MIRROR_RESYNC 2 mirrors 000044 1788852051.764854 mapwrite 0x03a394 thru 0x03c9be (0x262b bytes) 000045 1788852051.834050 write 0x02d170 thru 0x033ec7 (0x6d58 bytes) 000046 1788852051.850387 read 0x004f31 thru 0x010a15 (0xbae5 bytes) 000047 1788852051.863455 trunc from 0x03c9bf to 0x022885 (0x1a139 bytes) 000048 1788852051.899491 mapread 0x00f3ce thru 0x014d85 (0x59b8 bytes) 000049 1788852051.913697 punch from 0x0095d8 to 0x01700d (0xda36 bytes) 000050 1788852051.928486 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x22886): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22886): Mirror 2: 0x260ca88c (stale) CRC-32 checksum value for chunk [0, 0x22886): Mirror 1: 0x260ca88c Mirror 3: 0x260ca88c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22886: skipped 000051 1788852052.707946 read 0x0151ee thru 0x01d997 (0x87aa bytes) 000052 1788852052.745173 mapwrite 0x02eda5 thru 0x033a54 (0x4cb0 bytes) 000053 1788852052.885649 mapread 0x022517 thru 0x0246f1 (0x21db bytes) 000054 1788852052.902136 mapread 0x015096 thru 0x01f5fb (0xa566 bytes) 000055 1788852052.937740 punch from 0x009563 to 0x0137a9 (0xa247 bytes) 000056 1788852052.951483 MIRROR_RESYNC 3 mirrors 000057 1788852053.703548 fallocate 0x00f9c6 thru 0x01685f (0x6e9a bytes) 000058 1788852053.732434 trunc from 0x033a55 to 0x0118ce (0x22186 bytes) 000059 1788852053.761786 mapwrite 0x009f5a thru 0x017549 (0xd5f0 bytes) 000060 1788852053.863856 write 0x00332f thru 0x011ca8 (0xe97a bytes) 000061 1788852053.881614 MIRROR_RESYNC 3 mirrors 000063 1788852054.795605 MIRROR_RESYNC 3 mirrors 000064 1788852055.368003 mapread 0x002838 thru 0x00c051 (0x981a bytes) 000066 1788852055.406454 trunc from 0x01754a to 0x024ba2 (0xd659 bytes) 000067 1788852055.489070 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24ba3): Mirror 3: 0xdd8f67a3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24ba3): Mirror 3: 0xdd8f67a3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24ba3: skipped 000068 1788852055.967683 trunc from 0x01551c to 0x01b88f (0x6374 bytes) 000069 1788852055.974412 fallocate 0x00efc7 thru 0x014ec6 (0x5f00 bytes) 000070 1788852055.980716 fallocate 0x00abb7 thru 0x00c962 (0x1dac bytes) 000071 1788852055.991223 mapwrite 0x0346ff thru 0x03fa1e (0xb320 bytes) 000072 1788852056.063427 fallocate 0x03bf2b thru 0x03ffff (0x40d5 bytes) 000073 1788852056.071326 punch from 0x025d54 to 0x0301ad (0xa45a bytes) 000074 1788852056.075731 read 0x0351be thru 0x03fa1e (0xa861 bytes) 000075 1788852056.077754 trunc from 0x03fa1f to 0x0216cd (0x1e351 bytes) 000076 1788852056.113969 punch from 0x0080b9 to 0x00fa8a (0x79d2 bytes) 000077 1788852056.128446 write 0x0330ed thru 0x03d321 (0xa235 bytes) 000078 1788852056.129947 trunc from 0x03d322 to 0x000454 (0x3cecd bytes) 000081 1788852056.187506 fallocate 0x02ef6c thru 0x034297 (0x532c bytes) 000082 1788852056.194481 trunc from 0x019e76 to 0x0265e9 (0xc774 bytes) 000083 1788852056.199701 trunc from 0x00156f to 0x001a26 (0x4b8 bytes) 000084 1788852056.205860 write 0x039605 thru 0x03ffff (0x69fb bytes) 000085 1788852056.208373 write 0x026618 thru 0x0346c0 (0xe0a9 bytes) 000086 1788852056.227379 MIRROR_RESYNC 2 mirrors 000087 1788852056.856682 trunc from 0x040000 to 0x017d3c (0x282c3 bytes) 000088 1788852056.901062 punch from 0x008ae0 to 0x00bdd1 (0x32f2 bytes) 000089 1788852056.905774 read 0x011c81 thru 0x017d3c (0x60bc bytes) 000090 1788852056.916890 mapread 0x00ab0d thru 0x016d7e (0xc272 bytes) 000091 1788852056.933998 fallocate 0x01c1c2 thru 0x02b03a (0xee79 bytes) 000092 1788852056.938919 trunc from 0x00ad21 to 0x00d9e8 (0x2cc8 bytes) 000093 1788852056.943633 trunc from 0x0125af to 0x01b9b4 (0x9406 bytes) 000094 1788852056.948394 write 0x0265e6 thru 0x027fb2 (0x19cd bytes) 000095 1788852056.957615 trunc from 0x015651 to 0x01bb37 (0x64e7 bytes) 000096 1788852056.964710 fallocate 0x01cf18 thru 0x022a9f (0x5b88 bytes) 000097 1788852056.969779 trunc from 0x01e782 to 0x024205 (0x5a84 bytes) 000098 1788852056.978318 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2b03b): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b03b): Mirror 3: 0x1b414e98 (stale) CRC-32 checksum value for chunk [0, 0x2b03b): Mirror 1: 0xd77dc940 Mirror 4: 0xd77dc940 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b03b: skipped 000099 1788852058.041909 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b03b): Mirror 3: 0x1b414e98 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b03b): Mirror 3: 0x1b414e98 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b03b: skipped 000100 1788852058.321837 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000101 1788852058.587206 mapread 0x008932 thru 0x00db39 (0x5208 bytes) 000102 1788852058.625535 trunc from 0x010eec to 0x012244 (0x1359 bytes) 000103 1788852058.651492 trunc from 0x00a9ae to 0x0145aa (0x9bfd bytes) 000104 1788852058.670496 mapread 0x01095d thru 0x01d6bb (0xcd5f bytes) 000105 1788852058.701443 mapread 0x012f93 thru 0x016a0e (0x3a7c bytes) 000106 1788852058.702221 read 0x01ae22 thru 0x022449 (0x7628 bytes) 000107 1788852058.713348 fallocate 0x004332 thru 0x00ff93 (0xbc62 bytes) 000108 1788852058.732615 fallocate 0x0113a0 thru 0x014469 (0x30ca bytes) 000110 1788852058.741069 read 0x012c85 thru 0x0218e9 (0xec65 bytes) 000111 1788852058.742144 mapread 0x02008e thru 0x024f57 (0x4eca bytes) 000112 1788852058.763189 write 0x02cc63 thru 0x03c60f (0xf9ad bytes) 000113 1788852058.785864 fallocate 0x03e578 thru 0x03ffff (0x1a88 bytes) 000114 1788852058.791389 mapread 0x02418f thru 0x024287 (0xf9 bytes) 000115 1788852058.797325 trunc from 0x0305f2 to 0x037b11 (0x7520 bytes) 000116 1788852058.831321 read 0x021f4c thru 0x031d34 (0xfde9 bytes) 000117 1788852058.854310 mapwrite 0x001143 thru 0x00c906 (0xb7c4 bytes) 000118 1788852058.905896 mapread 0x01c2f1 thru 0x02b87c (0xf58c bytes) 000119 1788852058.907856 mapread 0x024811 thru 0x03019b (0xb98b bytes) 000120 1788852058.908926 trunc from 0x03c610 to 0x025b8a (0x16a85 bytes) 000121 1788852058.976731 mapwrite 0x00d800 thru 0x019252 (0xba53 bytes) 000122 1788852059.021963 punch from 0x00154e to 0x00975d (0x8210 bytes) 000123 1788852059.029457 trunc from 0x025b8b to 0x00b234 (0x1a956 bytes) 000125 1788852059.056314 fallocate 0x0259cc thru 0x0292de (0x3913 bytes) 000127 1788852059.079371 MIRROR_EXTEND to 2 mirrors 000129 1788852060.085071 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000130 1788852060.276217 punch from 0x00af1f to 0x00b234 (0x316 bytes) 000131 1788852060.299568 write 0x02de76 thru 0x036abf (0x8c4a bytes) 000132 1788852060.305784 mapread 0x01829e thru 0x026a95 (0xe7f8 bytes) 000133 1788852060.335219 trunc from 0x036ac0 to 0x039f9e (0x34df bytes) 000135 1788852060.352612 mapread 0x01bcb1 thru 0x01da1e (0x1d6e bytes) 000136 1788852060.354116 mapwrite 0x037ed1 thru 0x03ffff (0x812f bytes) 000138 1788852060.440307 write 0x01f75a thru 0x021f80 (0x2827 bytes) 000139 1788852060.442148 trunc from 0x040000 to 0x01270c (0x2d8f3 bytes) 000140 1788852060.468727 write 0x001f9d thru 0x006842 (0x48a6 bytes) 000141 1788852060.491275 MIRROR_EXTEND to 2 mirrors 000144 1788852061.380776 fallocate 0x01c558 thru 0x0227c8 (0x6271 bytes) 000145 1788852061.446715 mapwrite 0x034cc8 thru 0x0391f6 (0x452f bytes) 000146 1788852061.546111 trunc from 0x032792 to 0x033ce1 (0x1550 bytes) 000147 1788852061.558419 trunc from 0x000013 to 0x002031 (0x201f bytes) 000148 1788852061.566436 fallocate 0x008854 thru 0x00952f (0xcdc bytes) 000149 1788852061.572035 trunc from 0x0391f7 to 0x03600b (0x31eb bytes) 000150 1788852061.592512 read 0x02f89a thru 0x031419 (0x1b80 bytes) 000151 1788852061.593191 fallocate 0x02421f thru 0x0289a3 (0x4785 bytes) 000152 1788852061.600589 read 0x000b03 thru 0x007341 (0x683f bytes) 000153 1788852061.617221 trunc from 0x03600c to 0x015086 (0x20f85 bytes) 000155 1788852061.642510 read 0x0038ba thru 0x0042cf (0xa16 bytes) 000156 1788852061.643297 mapwrite 0x00fc2b thru 0x01182c (0x1c02 bytes) 000157 1788852061.667532 MIRROR_RESYNC 2 mirrors 000158 1788852062.579438 MIRROR_RESYNC 2 mirrors 000159 1788852062.899454 read 0x00e597 thru 0x015086 (0x6af0 bytes) 000160 1788852062.912619 write 0x00b51d thru 0x0132b9 (0x7d9d bytes) 000161 1788852062.957576 write 0x02874a thru 0x037489 (0xed40 bytes) 000162 1788852062.964607 MIRROR_RESYNC 2 mirrors 000164 1788852063.835771 read 0x034758 thru 0x037489 (0x2d32 bytes) 000165 1788852063.846595 punch from 0x00671d to 0x0134cc (0xcdb0 bytes) 000166 1788852063.894676 trunc from 0x03748a to 0x03a082 (0x2bf9 bytes) 000167 1788852063.930824 trunc from 0x0015dd to 0x0085a9 (0x6fcd bytes) 000168 1788852063.938406 fallocate 0x0009bf thru 0x0011be (0x800 bytes) 000169 1788852063.948657 punch from 0x00a318 to 0x00c76d (0x2456 bytes) 000170 1788852063.970097 mapwrite 0x00eec7 thru 0x010e80 (0x1fba bytes) 000171 1788852064.038566 MIRROR_RESYNC 2 mirrors 000173 1788852065.124153 fallocate 0x007475 thru 0x010c4e (0x97da bytes) 000174 1788852065.186573 mapread 0x0109a6 thru 0x0176d0 (0x6d2b bytes) 000176 1788852065.227444 mapread 0x027e0d thru 0x033dba (0xbfae bytes) 000177 1788852065.253099 trunc from 0x000187 to 0x00985a (0x96d4 bytes) 000178 1788852065.260095 write 0x00f89a thru 0x0197d3 (0x9f3a bytes) 000179 1788852065.261576 fallocate 0x0068eb thru 0x00ff10 (0x9626 bytes) 000180 1788852065.268286 trunc from 0x02e537 to 0x0305d3 (0x209d bytes) 000181 1788852065.278437 MIRROR_RESYNC 2 mirrors 000182 1788852066.238988 read 0x011e19 thru 0x01348e (0x1676 bytes) 000183 1788852066.256476 punch from 0x01b558 to 0x01f23f (0x3ce8 bytes) 000184 1788852066.338479 mapread 0x02d550 thru 0x03a082 (0xcb33 bytes) 000186 1788852066.392313 punch from 0x020225 to 0x02a313 (0xa0ef bytes) 000187 1788852066.409280 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3a083): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a083): Mirror 2: 0x82e7be1f (stale) CRC-32 checksum value for chunk [0, 0x3a083): Mirror 1: 0x905a5e7c Mirror 3: 0x905a5e7c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a083: skipped 000188 1788852067.524701 trunc from 0x03a083 to 0x01df81 (0x1c101 bytes) 000189 1788852067.594729 trunc from 0x01df82 to 0x022900 (0x497f bytes) 000190 1788852067.618622 MIRROR_RESYNC 3 mirrors 000191 1788852068.416024 mapwrite 0x02f4fc thru 0x034dee (0x58f3 bytes) 000192 1788852068.584819 punch from 0x00c08c to 0x01be3d (0xfdb2 bytes) 000193 1788852068.595914 read 0x01f190 thru 0x02c53e (0xd3af bytes) 000194 1788852068.617736 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x34def): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34def): Mirror 2: 0xf194e17a (stale) Mirror 3: 0xf194e17a (stale) CRC-32 checksum value for chunk [0, 0x34def): Mirror 1: 0xe1865173 Mirror 4: 0xe1865173 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34def: skipped 000195 1788852069.448943 trunc from 0x034def to 0x00e74d (0x266a1 bytes) 000196 1788852069.594764 fallocate 0x02f606 thru 0x035e8a (0x6885 bytes) 000197 1788852069.609121 read 0x00b7d7 thru 0x00e74d (0x2f77 bytes) 000198 1788852069.627053 fallocate 0x02b625 thru 0x035aec (0xa4c8 bytes) 000199 1788852069.634012 trunc from 0x010972 to 0x017b55 (0x71e4 bytes) 000200 1788852069.639393 trunc from 0x035aed to 0x0192a1 (0x1c84b bytes) 000201 1788852069.662506 read 0x00fae6 thru 0x014555 (0x4a70 bytes) 000203 1788852069.674614 trunc from 0x0192a2 to 0x00313a (0x16167 bytes) 000204 1788852069.689937 trunc from 0x001925 to 0x00313a (0x1816 bytes) 000205 1788852069.694712 trunc from 0x00313b to 0x03a521 (0x373e7 bytes) 000206 1788852069.713834 mapread 0x02f7a6 thru 0x039f47 (0xa7a2 bytes) 000207 1788852069.725064 mapwrite 0x0339aa thru 0x0394b6 (0x5b0d bytes) 000208 1788852069.749310 write 0x019c98 thru 0x027073 (0xd3dc bytes) 000209 1788852069.756644 read 0x02723c thru 0x032a7c (0xb841 bytes) 000210 1788852069.757398 read 0x03252e thru 0x03a521 (0x7ff4 bytes) 000211 1788852069.759498 mapwrite 0x0179d7 thru 0x01d05b (0x5685 bytes) 000212 1788852069.788752 write 0x003855 thru 0x00a135 (0x68e1 bytes) 000213 1788852069.790457 trunc from 0x00a4b9 to 0x012089 (0x7bd1 bytes) 000214 1788852069.810057 read 0x031234 thru 0x033789 (0x2556 bytes) 000215 1788852069.811143 mapread 0x02ad7b thru 0x02ecdb (0x3f61 bytes) 000216 1788852069.821471 MIRROR_RESYNC 4 mirrors 000217 1788852071.168433 write 0x013044 thru 0x017f8d (0x4f4a bytes) 000219 1788852071.259633 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a522): Mirror 2: 0x5905a541 (stale) Mirror 3: 0x5905a541 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a522): Mirror 2: 0x5905a541 (stale) Mirror 3: 0x5905a541 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a522: skipped 000220 1788852071.654069 fallocate 0x01f9b1 thru 0x0231d4 (0x3824 bytes) 000221 1788852071.664392 fallocate 0x012405 thru 0x01266c (0x268 bytes) 000222 1788852071.680993 trunc from 0x0319d8 to 0x03a521 (0x8b4a bytes) 000223 1788852071.694602 trunc from 0x03a522 to 0x00016d (0x3a3b4 bytes) 000224 1788852071.722509 trunc from 0x00016e to 0x010e58 (0x10ceb bytes) 000228 1788852071.757007 trunc from 0x010e59 to 0x02ea0e (0x1dbb6 bytes) 000229 1788852071.781476 punch from 0x027fb2 to 0x02ea0e (0x6a5d bytes) 000230 1788852071.800376 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ea0f): Mirror 3: 0x8bd76502 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ea0f): Mirror 3: 0x8bd76502 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ea0f: skipped 000231 1788852072.150424 mapread 0x004283 thru 0x00710c (0x2e8a bytes) 000232 1788852072.178822 mapread 0x01be18 thru 0x02b726 (0xf90f bytes) 000234 1788852072.199418 mapread 0x02cb2f thru 0x02e885 (0x1d57 bytes) 000235 1788852072.205425 punch from 0x00c29a to 0x017e32 (0xbb99 bytes) 000237 1788852072.214596 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2ea0f): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ea0f): Mirror 3: 0x8bd76502 (stale) CRC-32 checksum value for chunk [0, 0x2ea0f): Mirror 1: 0x8d68690a Mirror 4: 0x8d68690a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ea0f: skipped 000238 1788852073.257483 fallocate 0x023066 thru 0x029565 (0x6500 bytes) 000239 1788852073.299042 punch from 0x0034da to 0x0120f8 (0xec1f bytes) 000240 1788852073.311698 mapwrite 0x01c32f thru 0x02c0e9 (0xfdbb bytes) 000241 1788852073.375849 punch from 0x018134 to 0x01ff87 (0x7e54 bytes) 000242 1788852073.384928 trunc from 0x01304b to 0x021915 (0xe8cb bytes) 000243 1788852073.393385 write 0x035c7f thru 0x03add6 (0x5158 bytes) 000245 1788852073.403521 fallocate 0x010dad thru 0x01d913 (0xcb67 bytes) 000246 1788852073.413134 trunc from 0x0358a0 to 0x03add6 (0x5537 bytes) 000247 1788852073.443111 mapwrite 0x006108 thru 0x010576 (0xa46f bytes) 000248 1788852073.475460 fallocate 0x02c135 thru 0x033b8a (0x7a56 bytes) 000249 1788852073.479988 punch from 0x032252 to 0x0393c4 (0x7173 bytes) 000250 1788852073.484956 trunc from 0x02223b to 0x024601 (0x23c7 bytes) 000251 1788852073.489858 fallocate 0x027c5d thru 0x03073a (0x8ade bytes) 000252 1788852073.494639 punch from 0x02ecd0 to 0x03add6 (0xc107 bytes) 000253 1788852073.503981 read 0x00954f thru 0x00dfc7 (0x4a79 bytes) 000254 1788852073.505058 write 0x017257 thru 0x01b8fc (0x46a6 bytes) 000255 1788852073.512689 mapwrite 0x016bbc thru 0x01f8ef (0x8d34 bytes) 000256 1788852073.544671 mapwrite 0x00a303 thru 0x0104a6 (0x61a4 bytes) 000257 1788852073.559616 mapread 0x01b40c thru 0x02591a (0xa50f bytes) 000259 1788852073.561454 mapread 0x02d6e9 thru 0x035f69 (0x8881 bytes) 000260 1788852073.572949 fallocate 0x00b230 thru 0x018bd3 (0xd9a4 bytes) 000261 1788852073.581100 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3add7): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3add7): Mirror 3: 0xb3ce8db6 (stale) Mirror 4: 0x46545e8b (stale) CRC-32 checksum value for chunk [0, 0x3add7): Mirror 1: 0x8c4c9dff Mirror 5: 0x8c4c9dff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3add7: skipped 000262 1788852074.330511 write 0x021b5e thru 0x0292a9 (0x774c bytes) 000263 1788852074.395419 mapwrite 0x031f45 thru 0x03ffff (0xe0bb bytes) 000264 1788852074.485151 mapread 0x002263 thru 0x010552 (0xe2f0 bytes) 000265 1788852074.495057 write 0x0056e3 thru 0x0073f9 (0x1d17 bytes) 000266 1788852074.496564 mapwrite 0x00ee75 thru 0x01da49 (0xebd5 bytes) 000267 1788852074.542075 trunc from 0x040000 to 0x029061 (0x16f9e bytes) 000268 1788852074.564652 punch from 0x0169f4 to 0x016ebb (0x4c8 bytes) 000269 1788852074.579491 read 0x00d137 thru 0x015f6c (0x8e36 bytes) 000270 1788852074.580109 read 0x01a23d thru 0x01a541 (0x305 bytes) 000273 1788852074.581524 trunc from 0x029062 to 0x0258d7 (0x378a bytes) 000275 1788852074.615928 fallocate 0x03704f thru 0x038838 (0x17ea bytes) 000276 1788852074.639178 write 0x03a407 thru 0x03f1e1 (0x4ddb bytes) 000277 1788852074.641623 fallocate 0x013fe0 thru 0x01919a (0x51bb bytes) 000278 1788852074.647897 mapwrite 0x023896 thru 0x0308c6 (0xd031 bytes) 000279 1788852074.702105 trunc from 0x03f1e2 to 0x02b6c0 (0x13b21 bytes) 000280 1788852074.730315 MIRROR_RESYNC 4 mirrors 000281 1788852075.736568 mapread 0x01050e thru 0x01e2b4 (0xdda7 bytes) 000282 1788852075.765209 trunc from 0x02b6c1 to 0x0356e6 (0xa026 bytes) 000283 1788852075.808924 read 0x01c883 thru 0x0297a6 (0xcf24 bytes) 000284 1788852075.820883 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x356e7): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x356e7): Mirror 3: 0x457a75f7 (stale) Mirror 4: 0x457a75f7 (stale) Mirror 5: 0x457a75f7 (stale) CRC-32 checksum value for chunk [0, 0x356e7): Mirror 1: 0x457a75f7 Mirror 6: 0x457a75f7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x356e7: skipped 000285 1788852076.803429 mapwrite 0x0037a4 thru 0x005216 (0x1a73 bytes) 000286 1788852076.978802 trunc from 0x01cb1f to 0x02159b (0x4a7d bytes) 000287 1788852076.989486 mapread 0x017f77 thru 0x021df0 (0x9e7a bytes) 000288 1788852077.019646 fallocate 0x036d87 thru 0x0375d6 (0x850 bytes) 000289 1788852077.029369 fallocate 0x02d526 thru 0x03b772 (0xe24d bytes) 000290 1788852077.044118 punch from 0x02eed4 to 0x032133 (0x3260 bytes) 000291 1788852077.050439 read 0x01128a thru 0x01325b (0x1fd2 bytes) 000292 1788852077.051206 punch from 0x010421 to 0x014982 (0x4562 bytes) 000293 1788852077.062992 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x356e7): Mirror 3: 0x457a75f7 (stale) Mirror 4: 0x457a75f7 (stale) Mirror 6: 0x457a75f7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x356e7): Mirror 3: 0x457a75f7 (stale) Mirror 4: 0x457a75f7 (stale) Mirror 6: 0x457a75f7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x356e7: skipped 000294 1788852077.510148 read 0x02dccb thru 0x0301c7 (0x24fd bytes) 000295 1788852077.517044 trunc from 0x017485 to 0x017ad0 (0x64c bytes) 000296 1788852077.524593 trunc from 0x0356e7 to 0x0148b4 (0x20e32 bytes) 000298 1788852077.560189 fallocate 0x01ddf9 thru 0x027967 (0x9b6f bytes) 000300 1788852077.579052 MIRROR_RESYNC 4 mirrors 000301 1788852078.888560 fallocate 0x02f24b thru 0x03b6ba (0xc470 bytes) 000302 1788852078.938694 trunc from 0x00afa6 to 0x00eccd (0x3d28 bytes) 000303 1788852078.952937 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b6bb): Mirror 3: 0xb3c37391 (stale) Mirror 4: 0xb3c37391 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b6bb): Mirror 3: 0xb3c37391 (stale) Mirror 4: 0xb3c37391 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b6bb: skipped 000306 1788852079.421346 mapwrite 0x020134 thru 0x0265e1 (0x64ae bytes) 000307 1788852079.463559 mapwrite 0x022924 thru 0x02c2e8 (0x99c5 bytes) 000308 1788852079.498047 read 0x008360 thru 0x012dcf (0xaa70 bytes) 000309 1788852079.512052 write 0x01bf67 thru 0x026786 (0xa820 bytes) 000310 1788852079.520176 read 0x02f959 thru 0x03467f (0x4d27 bytes) 000311 1788852079.540644 trunc from 0x03b6bb to 0x003ae5 (0x37bd5 bytes) 000312 1788852079.565296 write 0x03eebe thru 0x03ffff (0x1142 bytes) 000313 1788852079.566488 read 0x0200ff thru 0x025ddf (0x5ce1 bytes) 000314 1788852079.579064 read 0x020e52 thru 0x029464 (0x8613 bytes) 000315 1788852079.579751 write 0x01f95a thru 0x02666a (0x6d11 bytes) 000316 1788852079.591107 read 0x00e809 thru 0x00e929 (0x121 bytes) 000317 1788852079.591895 mapread 0x00d5fc thru 0x00ec03 (0x1608 bytes) 000318 1788852079.593329 read 0x00c3f4 thru 0x01bbe2 (0xf7ef bytes) 000319 1788852079.594539 punch from 0x03f027 to 0x03ffff (0xfd9 bytes) 000320 1788852079.628329 fallocate 0x032bec thru 0x03f9c2 (0xcdd7 bytes) 000321 1788852079.645041 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xdd31d05b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xdd31d05b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000322 1788852079.999724 write 0x01dcd6 thru 0x022d89 (0x50b4 bytes) 000323 1788852080.013313 write 0x03177f thru 0x03be94 (0xa716 bytes) 000324 1788852080.021914 trunc from 0x01afcc to 0x01d06c (0x20a1 bytes) 000325 1788852080.036571 fallocate 0x00f32e thru 0x01e0bd (0xed90 bytes) 000327 1788852080.041605 read 0x00a998 thru 0x00c122 (0x178b bytes) 000328 1788852080.048301 mapread 0x01b8cd thru 0x02aa18 (0xf14c bytes) 000329 1788852080.077633 write 0x022d61 thru 0x02ccb3 (0x9f53 bytes) 000330 1788852080.085189 MIRROR_RESYNC 2 mirrors 000331 1788852080.896378 mapwrite 0x033e18 thru 0x03a67f (0x6868 bytes) 000332 1788852081.012048 punch from 0x0332af to 0x03c0f3 (0x8e45 bytes) 000333 1788852081.040490 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6e3ce830 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x487a14ff Mirror 5: 0x487a14ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000334 1788852082.165747 trunc from 0x003f7b to 0x009506 (0x558c bytes) 000335 1788852082.240205 mapread 0x017dbc thru 0x0263ea (0xe62f bytes) 000337 1788852082.319374 fallocate 0x032d14 thru 0x03ef00 (0xc1ed bytes) 000338 1788852082.325568 mapread 0x01210f thru 0x021117 (0xf009 bytes) 000340 1788852082.327008 write 0x022448 thru 0x0298d9 (0x7492 bytes) 000343 1788852082.342825 write 0x018c7d thru 0x026131 (0xd4b5 bytes) 000344 1788852082.347186 mapwrite 0x01afb6 thru 0x022560 (0x75ab bytes) 000345 1788852082.386456 trunc from 0x016204 to 0x0230b2 (0xceaf bytes) 000346 1788852082.393803 read 0x020e95 thru 0x02b867 (0xa9d3 bytes) 000347 1788852082.410043 trunc from 0x040000 to 0x024254 (0x1bdab bytes) 000348 1788852082.441122 trunc from 0x024255 to 0x01fcea (0x456a bytes) 000349 1788852082.460841 trunc from 0x01fceb to 0x02f4ad (0xf7c3 bytes) 000350 1788852082.491104 mapread 0x02489b thru 0x02c099 (0x77ff bytes) 000351 1788852082.507745 punch from 0x021eab to 0x0284ac (0x6602 bytes) 000352 1788852082.518451 read 0x01bcce thru 0x02032b (0x465e bytes) 000353 1788852082.544274 mapread 0x02625b thru 0x02d3d1 (0x7177 bytes) 000354 1788852082.545166 mapwrite 0x0087c9 thru 0x011884 (0x90bc bytes) 000355 1788852082.573104 trunc from 0x015d33 to 0x01b6bd (0x598b bytes) 000356 1788852082.579172 mapwrite 0x024aab thru 0x034994 (0xfeea bytes) 000357 1788852082.635335 read 0x02dc4d thru 0x031448 (0x37fc bytes) 000358 1788852082.635898 mapread 0x032d31 thru 0x034994 (0x1c64 bytes) 000359 1788852082.636750 mapread 0x029a22 thru 0x02e47b (0x4a5a bytes) 000360 1788852082.643981 MIRROR_RESYNC 3 mirrors 000361 1788852083.606379 punch from 0x0238bb to 0x02e979 (0xb0bf bytes) 000362 1788852083.649152 mapwrite 0x027d22 thru 0x029a92 (0x1d71 bytes) 000363 1788852083.700706 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x34995): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34995): Mirror 4: 0xe96873bd (stale) Mirror 5: 0xe96873bd (stale) CRC-32 checksum value for chunk [0, 0x34995): Mirror 1: 0x1a52ce37 Mirror 6: 0x1a52ce37 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34995: skipped 000364 1788852084.904663 read 0x01a548 thru 0x0235c9 (0x9082 bytes) 000367 1788852084.982199 fallocate 0x00e345 thru 0x01a469 (0xc125 bytes) 000369 1788852085.083402 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x34995): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34995): Mirror 4: 0xe96873bd (stale) Mirror 5: 0xe96873bd (stale) Mirror 6: 0x1a52ce37 (stale) CRC-32 checksum value for chunk [0, 0x34995): Mirror 1: 0x1a52ce37 Mirror 7: 0x1a52ce37 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34995: skipped 000370 1788852086.237543 read 0x0068e0 thru 0x0136a3 (0xcdc4 bytes) 000372 1788852086.268111 fallocate 0x01fcab thru 0x022b6f (0x2ec5 bytes) 000373 1788852086.358764 write 0x03f602 thru 0x03ffff (0x9fe bytes) 000374 1788852086.379256 read 0x013a1d thru 0x0222ef (0xe8d3 bytes) 000375 1788852086.397286 mapread 0x027c9b thru 0x02d4d4 (0x583a bytes) 000376 1788852086.401869 trunc from 0x040000 to 0x0018a9 (0x3e756 bytes) 000377 1788852086.457753 trunc from 0x0010d3 to 0x0018a9 (0x7d7 bytes) 000378 1788852086.474594 trunc from 0x0012e1 to 0x0018a9 (0x5c9 bytes) 000379 1788852086.483038 mapread 0x000090 thru 0x0018a9 (0x181a bytes) 000380 1788852086.498600 mapread 0x001886 thru 0x0018a9 (0x24 bytes) 000381 1788852086.502313 trunc from 0x0015fd to 0x0018a9 (0x2ad bytes) 000382 1788852086.522974 punch from 0x000520 to 0x0018a9 (0x138a bytes) 000383 1788852086.532986 mapread 0x0016f1 thru 0x0018a9 (0x1b9 bytes) 000384 1788852086.548538 punch from 0x00184a to 0x0018a9 (0x60 bytes) 000385 1788852086.556966 read 0x000e24 thru 0x0018a9 (0xa86 bytes) 000386 1788852086.577947 mapread 0x000f11 thru 0x0018a9 (0x999 bytes) 000387 1788852086.580438 punch from 0x000057 to 0x0018a9 (0x1853 bytes) 000388 1788852086.586926 mapread 0x000bf9 thru 0x0018a9 (0xcb1 bytes) 000389 1788852086.610464 write 0x008d73 thru 0x01122d (0x84bb bytes) 000390 1788852086.615198 fallocate 0x0372ca thru 0x03ffff (0x8d36 bytes) 000391 1788852086.624617 trunc from 0x01122e to 0x01ffa8 (0xed7b bytes) 000392 1788852086.672952 fallocate 0x0163e5 thru 0x01a4ca (0x40e6 bytes) 000393 1788852086.710600 MIRROR_RESYNC 5 mirrors 000394 1788852088.624874 trunc from 0x01ffa9 to 0x02ee3b (0xee93 bytes) 000395 1788852088.778334 mapwrite 0x01bf18 thru 0x01ea0c (0x2af5 bytes) 000396 1788852088.828632 write 0x01301b thru 0x01ab34 (0x7b1a bytes) 000397 1788852088.839040 read 0x0172fa thru 0x0212a3 (0x9faa bytes) 000398 1788852088.839772 trunc from 0x02ee3c to 0x01f917 (0xf524 bytes) 000399 1788852088.913347 trunc from 0x01f918 to 0x01d159 (0x27be bytes) 000400 1788852088.964490 mapwrite 0x03e8c7 thru 0x03ffff (0x1739 bytes) 000401 1788852089.133105 read 0x03ec9b thru 0x03ffff (0x1365 bytes) 000402 1788852089.133670 read 0x0380ac thru 0x038324 (0x279 bytes) 000403 1788852089.134164 trunc from 0x02ac5c to 0x03a4ee (0xf893 bytes) 000404 1788852089.141587 punch from 0x0190b5 to 0x023fb5 (0xaf01 bytes) 000406 1788852089.182854 write 0x012221 thru 0x014693 (0x2473 bytes) 000407 1788852089.216444 trunc from 0x03dc54 to 0x03fe72 (0x221f bytes) 000408 1788852089.230793 mapread 0x005116 thru 0x00ca10 (0x78fb bytes) 000409 1788852089.235618 trunc from 0x040000 to 0x023206 (0x1cdf9 bytes) 000410 1788852089.270357 fallocate 0x019f94 thru 0x028ada (0xeb47 bytes) 000411 1788852089.277856 read 0x00f8a4 thru 0x01c362 (0xcabf bytes) 000413 1788852089.281079 read 0x01a3a5 thru 0x01effb (0x4c57 bytes) 000414 1788852089.290546 mapwrite 0x0033a9 thru 0x00e986 (0xb5de bytes) 000415 1788852089.394022 mapwrite 0x03d9dc thru 0x03ffff (0x2624 bytes) 000416 1788852089.503603 write 0x038769 thru 0x03ffff (0x7897 bytes) 000417 1788852089.521129 read 0x039cc5 thru 0x03ffff (0x633b bytes) 000418 1788852089.525011 read 0x029c02 thru 0x032391 (0x8790 bytes) 000419 1788852089.548515 mapwrite 0x03e3cb thru 0x03ffff (0x1c35 bytes) 000420 1788852089.633466 fallocate 0x010a8d thru 0x01623e (0x57b2 bytes) 000421 1788852089.672661 fallocate 0x031fdb thru 0x03ab4b (0x8b71 bytes) 000422 1788852089.680430 trunc from 0x02c927 to 0x02ca54 (0x12e bytes) 000423 1788852089.708193 mapwrite 0x037ab4 thru 0x03ffff (0x854c bytes) 000424 1788852089.781982 mapread 0x02ab44 thru 0x0326e9 (0x7ba6 bytes) 000425 1788852089.831750 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x8f7f5260 (stale) Mirror 6: 0x8f7f5260 (stale) Mirror 7: 0x8f7f5260 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x8f7f5260 (stale) Mirror 6: 0x8f7f5260 (stale) Mirror 7: 0x8f7f5260 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000426 1788852090.625968 MIRROR_RESYNC 4 mirrors 000427 1788852092.072889 punch from 0x019574 to 0x020c4f (0x76dc bytes) 000428 1788852092.134463 trunc from 0x00ac86 to 0x014d24 (0xa09f bytes) 000429 1788852092.160175 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf683ad2c (stale) Mirror 6: 0xf683ad2c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf683ad2c (stale) Mirror 6: 0xf683ad2c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000430 1788852092.680263 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf683ad2c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf683ad2c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000431 1788852093.124929 mapread 0x0161f1 thru 0x0198d9 (0x36e9 bytes) 000432 1788852093.174926 punch from 0x0309dc to 0x036f31 (0x6556 bytes) 000433 1788852093.182628 write 0x028074 thru 0x03405c (0xbfe9 bytes) 000434 1788852093.207520 mapread 0x036a66 thru 0x03ffff (0x959a bytes) 000435 1788852093.224883 write 0x030b6f thru 0x037047 (0x64d9 bytes) 000436 1788852093.226347 mapread 0x00881b thru 0x00ec78 (0x645e bytes) 000437 1788852093.244197 trunc from 0x030cde to 0x03c805 (0xbb28 bytes) 000438 1788852093.262365 trunc from 0x040000 to 0x009add (0x36522 bytes) 000440 1788852093.285666 trunc from 0x009ade to 0x00b618 (0x1b3b bytes) 000441 1788852093.321796 write 0x032219 thru 0x03ba21 (0x9809 bytes) 000443 1788852093.350702 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000444 1788852093.638943 MIRROR_EXTEND to 2 mirrors 000445 1788852094.391146 mapread 0x00dd9d thru 0x015411 (0x7675 bytes) 000446 1788852094.432738 trunc from 0x009637 to 0x00f912 (0x62dc bytes) 000447 1788852094.490658 fallocate 0x038ec1 thru 0x03e204 (0x5344 bytes) 000448 1788852094.497956 trunc from 0x026119 to 0x02b52b (0x5413 bytes) 000450 1788852094.506161 MIRROR_RESYNC 2 mirrors 000451 1788852095.403450 mapread 0x007dca thru 0x00cc02 (0x4e39 bytes) 000452 1788852095.422095 trunc from 0x03ba22 to 0x02eefe (0xcb23 bytes) 000453 1788852095.506051 mapwrite 0x030c1b thru 0x039ff9 (0x93df bytes) 000454 1788852095.593861 fallocate 0x03c81c thru 0x03ffff (0x37e4 bytes) 000455 1788852095.605796 trunc from 0x040000 to 0x02ef28 (0x110d7 bytes) 000456 1788852095.639750 punch from 0x017353 to 0x01f7b2 (0x8460 bytes) 000457 1788852095.646549 read 0x002f2b thru 0x008211 (0x52e7 bytes) 000458 1788852095.659188 mapread 0x01fcbc thru 0x022478 (0x27bd bytes) 000459 1788852095.672022 trunc from 0x020b9a to 0x02baff (0xaf66 bytes) 000460 1788852095.684407 mapwrite 0x0275ca thru 0x029809 (0x2240 bytes) 000461 1788852095.726933 read 0x00933c thru 0x014e3b (0xbb00 bytes) 000462 1788852095.753133 read 0x028af1 thru 0x02ef28 (0x6438 bytes) 000463 1788852095.758185 trunc from 0x02ef29 to 0x017451 (0x17ad7 bytes) 000464 1788852095.781034 trunc from 0x009654 to 0x0125f6 (0x8fa3 bytes) 000465 1788852095.791376 fallocate 0x02afa0 thru 0x037a96 (0xcaf7 bytes) 000466 1788852095.804502 trunc from 0x0346de to 0x037a96 (0x33b9 bytes) 000467 1788852095.814620 fallocate 0x011900 thru 0x021425 (0xfb26 bytes) 000468 1788852095.821580 punch from 0x0028cc to 0x008e63 (0x6598 bytes) 000469 1788852095.827090 write 0x03f541 thru 0x03ffff (0xabf bytes) 000470 1788852095.829543 read 0x0000ee thru 0x00c458 (0xc36b bytes) 000471 1788852095.843037 read 0x0369ef thru 0x03a9c7 (0x3fd9 bytes) 000472 1788852095.844185 trunc from 0x020a5e to 0x026ba6 (0x6149 bytes) 000473 1788852095.849892 trunc from 0x024881 to 0x02888c (0x400c bytes) 000474 1788852095.855073 read 0x03d0dc thru 0x03ffff (0x2f24 bytes) 000475 1788852095.856066 write 0x015b6f thru 0x01806c (0x24fe bytes) 000476 1788852095.865978 MIRROR_RESYNC 2 mirrors 000478 1788852096.876028 read 0x02dabb thru 0x032707 (0x4c4d bytes) 000480 1788852096.892823 mapread 0x010dac thru 0x020515 (0xf76a bytes) 000481 1788852096.945884 read 0x02f552 thru 0x03f403 (0xfeb2 bytes) 000482 1788852096.969590 mapread 0x008aae thru 0x00d51f (0x4a72 bytes) 000483 1788852096.977762 mapread 0x01ffd9 thru 0x0280e5 (0x810d bytes) 000484 1788852096.983791 mapread 0x026320 thru 0x029c83 (0x3964 bytes) 000485 1788852096.987781 punch from 0x0315e3 to 0x034f12 (0x3930 bytes) 000486 1788852097.055454 trunc from 0x00d30e to 0x00f2a0 (0x1f93 bytes) 000487 1788852097.065007 punch from 0x010a09 to 0x01aff7 (0xa5ef bytes) 000488 1788852097.105410 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000490 1788852097.368082 write 0x000f4e thru 0x00e48c (0xd53f bytes) 000492 1788852097.401485 fallocate 0x007a3a thru 0x015520 (0xdae7 bytes) 000493 1788852097.407363 trunc from 0x040000 to 0x0331ac (0xce53 bytes) 000494 1788852097.421009 punch from 0x01a8cf to 0x024d5c (0xa48e bytes) 000495 1788852097.427840 write 0x00a25c thru 0x01321b (0x8fc0 bytes) 000496 1788852097.438068 fallocate 0x018c24 thru 0x021593 (0x8970 bytes) 000497 1788852097.454038 trunc from 0x0331ad to 0x013f1c (0x1f290 bytes) 000498 1788852097.501530 punch from 0x0005a6 to 0x007780 (0x71db bytes) 000499 1788852097.528710 mapread 0x00d881 thru 0x013f1c (0x669c bytes) 000500 1788852097.533838 trunc from 0x013f1d to 0x009ac2 (0xa45a bytes) 000501 1788852097.570019 mapread 0x005dd0 thru 0x009ac2 (0x3cf3 bytes) 000502 1788852097.612503 read 0x009213 thru 0x009ac2 (0x8b0 bytes) 000503 1788852097.613945 punch from 0x006189 to 0x009ac2 (0x393a bytes) 000504 1788852097.637845 MIRROR_EXTEND to 2 mirrors 000505 1788852098.572825 mapwrite 0x037b3a thru 0x03ffff (0x84c6 bytes) 000506 1788852098.767377 read 0x031337 thru 0x03f1f7 (0xdec1 bytes) 000508 1788852098.775641 punch from 0x02976c to 0x031887 (0x811c bytes) 000509 1788852098.783632 write 0x026f52 thru 0x0288df (0x198e bytes) 000510 1788852098.801022 read 0x02a339 thru 0x0376eb (0xd3b3 bytes) 000511 1788852098.846645 read 0x03ed0b thru 0x03ffff (0x12f5 bytes) 000512 1788852098.848066 trunc from 0x040000 to 0x021058 (0x1efa7 bytes) 000514 1788852098.876463 write 0x0072e6 thru 0x016683 (0xf39e bytes) 000517 1788852098.893038 fallocate 0x02c507 thru 0x03a9ab (0xe4a5 bytes) 000518 1788852098.902948 read 0x024f14 thru 0x033c4f (0xed3c bytes) 000519 1788852098.927455 trunc from 0x03a9ac to 0x037053 (0x3958 bytes) 000520 1788852098.946152 mapwrite 0x01f743 thru 0x0285eb (0x8ea9 bytes) 000523 1788852098.979878 read 0x018666 thru 0x026f34 (0xe8cf bytes) 000524 1788852098.986983 MIRROR_RESYNC 2 mirrors 000525 1788852099.946191 punch from 0x0053f9 to 0x008fe1 (0x3be9 bytes) 000526 1788852100.017626 mapwrite 0x01a0c2 thru 0x022563 (0x84a2 bytes) 000527 1788852100.084568 trunc from 0x037054 to 0x028763 (0xe8f0 bytes) 000528 1788852100.114988 mapread 0x0272e4 thru 0x028763 (0x1480 bytes) 000530 1788852100.129068 write 0x00aa4e thru 0x00f07e (0x4631 bytes) 000531 1788852100.148803 write 0x006053 thru 0x00bffe (0x5fac bytes) 000532 1788852100.163335 mapwrite 0x03b1f8 thru 0x03ffff (0x4e08 bytes) 000533 1788852100.238980 punch from 0x01837f to 0x02429d (0xbf1f bytes) 000534 1788852100.248178 punch from 0x017b73 to 0x0242ae (0xc73c bytes) 000535 1788852100.259839 read 0x00d6b0 thru 0x018e4b (0xb79c bytes) 000537 1788852100.286886 trunc from 0x02a85e to 0x03164b (0x6dee bytes) 000538 1788852100.295952 mapwrite 0x026a26 thru 0x0286de (0x1cb9 bytes) 000539 1788852100.322820 trunc from 0x0328b4 to 0x036eb9 (0x4606 bytes) 000540 1788852100.334835 punch from 0x007eb5 to 0x00fec8 (0x8014 bytes) 000541 1788852100.349963 write 0x013edf thru 0x01bb7b (0x7c9d bytes) 000542 1788852100.360793 read 0x01a4c3 thru 0x01fb4d (0x568b bytes) 000543 1788852100.375949 write 0x0351c0 thru 0x03fe27 (0xac68 bytes) 000544 1788852100.377686 fallocate 0x0352e7 thru 0x0383ad (0x30c7 bytes) 000545 1788852100.386209 trunc from 0x040000 to 0x000e76 (0x3f189 bytes) 000546 1788852100.415032 trunc from 0x000413 to 0x000e76 (0xa64 bytes) 000547 1788852100.420182 fallocate 0x001acd thru 0x00a6cc (0x8c00 bytes) 000548 1788852100.431324 MIRROR_RESYNC 2 mirrors 000549 1788852101.004454 mapwrite 0x024f82 thru 0x029417 (0x4496 bytes) 000550 1788852101.165731 trunc from 0x029418 to 0x033fa4 (0xab8d bytes) 000551 1788852101.181891 punch from 0x0318d4 to 0x032715 (0xe42 bytes) 000553 1788852101.192598 MIRROR_RESYNC 2 mirrors 000554 1788852101.823442 mapwrite 0x020c9c thru 0x02b81c (0xab81 bytes) 000555 1788852102.001047 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000556 1788852102.191152 punch from 0x010de3 to 0x01c10c (0xb32a bytes) 000557 1788852102.197025 mapread 0x01247f thru 0x01a761 (0x82e3 bytes) 000558 1788852102.234097 read 0x01555c thru 0x022024 (0xcac9 bytes) 000559 1788852102.243186 punch from 0x031b68 to 0x033fa4 (0x243d bytes) 000562 1788852102.251265 read 0x025e01 thru 0x02ffef (0xa1ef bytes) 000564 1788852102.276481 read 0x03165c thru 0x032929 (0x12ce bytes) 000565 1788852102.277499 trunc from 0x033fa5 to 0x0112f5 (0x22caf bytes) 000567 1788852102.308454 trunc from 0x00ae2d to 0x0112f5 (0x64c9 bytes) 000568 1788852102.320078 read 0x002cbf thru 0x00f5fa (0xc93c bytes) 000569 1788852102.335260 punch from 0x001023 to 0x010382 (0xf360 bytes) 000570 1788852102.343922 trunc from 0x0112f6 to 0x03b3b7 (0x2a0c2 bytes) 000572 1788852102.373351 mapread 0x00e25d thru 0x00e4aa (0x24e bytes) 000574 1788852102.387758 fallocate 0x03b381 thru 0x03ffff (0x4c7f bytes) 000575 1788852102.393051 trunc from 0x03195c to 0x037ca7 (0x634c bytes) 000576 1788852102.398884 punch from 0x014820 to 0x01f307 (0xaae8 bytes) 000577 1788852102.404493 fallocate 0x032ba6 thru 0x03d2f7 (0xa752 bytes) 000578 1788852102.409528 write 0x030e7b thru 0x033a28 (0x2bae bytes) 000579 1788852102.415985 fallocate 0x020fa1 thru 0x02ad9f (0x9dff bytes) 000581 1788852102.421776 write 0x00445e thru 0x010f22 (0xcac5 bytes) 000582 1788852102.438205 MIRROR_EXTEND to 2 mirrors 000583 1788852103.592724 mapwrite 0x008b77 thru 0x00cece (0x4358 bytes) 000584 1788852103.727096 mapread 0x0202ba thru 0x02e8bb (0xe602 bytes) 000585 1788852103.780429 read 0x0193ab thru 0x026de7 (0xda3d bytes) 000586 1788852103.782809 punch from 0x02df52 to 0x03886b (0xa91a bytes) 000587 1788852103.793979 trunc from 0x03b3b8 to 0x037eb9 (0x34fe bytes) 000588 1788852103.845804 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000589 1788852103.993041 MIRROR_EXTEND to 2 mirrors 000590 1788852104.759705 write 0x0154a9 thru 0x01ac96 (0x57ee bytes) 000591 1788852104.809003 mapread 0x00908c thru 0x01022d (0x71a2 bytes) 000592 1788852104.835874 mapread 0x014fcf thru 0x01acc6 (0x5cf8 bytes) 000593 1788852104.844020 write 0x030a7a thru 0x031dc8 (0x134f bytes) 000594 1788852104.855663 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000597 1788852105.001913 mapread 0x012de7 thru 0x020acd (0xdce7 bytes) 000598 1788852105.041741 fallocate 0x00ecb6 thru 0x012365 (0x36b0 bytes) 000599 1788852105.047135 mapwrite 0x028730 thru 0x02e7c4 (0x6095 bytes) 000600 1788852105.082470 punch from 0x01299c to 0x01b251 (0x88b6 bytes) 000601 1788852105.090147 fallocate 0x031c4e thru 0x03efac (0xd35f bytes) 000603 1788852105.097257 mapwrite 0x004fef thru 0x014837 (0xf849 bytes) 000604 1788852105.139195 mapwrite 0x030b8b thru 0x036e4c (0x62c2 bytes) 000605 1788852105.189040 trunc from 0x021a05 to 0x02e727 (0xcd23 bytes) 000606 1788852105.197913 trunc from 0x037eba to 0x00870e (0x2f7ab bytes) 000607 1788852105.238585 read 0x0083d1 thru 0x00870e (0x33e bytes) 000608 1788852105.239180 trunc from 0x00870f to 0x008148 (0x5c6 bytes) 000609 1788852105.263003 mapread 0x003678 thru 0x008148 (0x4ad1 bytes) 000610 1788852105.264396 trunc from 0x008149 to 0x008f11 (0xdc9 bytes) 000611 1788852105.286423 trunc from 0x008f12 to 0x008038 (0xed9 bytes) 000613 1788852105.310257 mapwrite 0x0269f8 thru 0x033ad5 (0xd0de bytes) 000614 1788852105.490011 trunc from 0x033ad6 to 0x025f05 (0xdbd0 bytes) 000615 1788852105.512653 trunc from 0x021ce9 to 0x025f05 (0x421d bytes) 000616 1788852105.518461 read 0x016f8f thru 0x025f05 (0xef77 bytes) 000617 1788852105.551126 read 0x008691 thru 0x014d3a (0xc6aa bytes) 000618 1788852105.552128 read 0x01243d thru 0x018bd0 (0x6794 bytes) 000621 1788852105.555927 mapread 0x01e4fb thru 0x01f17e (0xc84 bytes) 000622 1788852105.561941 MIRROR_EXTEND to 2 mirrors 000623 1788852106.494909 MIRROR_EXTEND to 3 mirrors 000624 1788852107.326273 trunc from 0x025f06 to 0x007280 (0x1ec85 bytes) 000625 1788852107.383308 fallocate 0x018989 thru 0x01d8d0 (0x4f48 bytes) 000626 1788852107.393840 fallocate 0x02e46b thru 0x03d589 (0xf11f bytes) 000627 1788852107.398607 mapwrite 0x03b4ed thru 0x03fe92 (0x49a6 bytes) 000628 1788852107.495162 fallocate 0x02b272 thru 0x02e5c6 (0x3355 bytes) 000629 1788852107.503935 mapread 0x037561 thru 0x03fe92 (0x8932 bytes) 000631 1788852107.512198 trunc from 0x010146 to 0x010c0c (0xac7 bytes) 000632 1788852107.522313 trunc from 0x00f871 to 0x018dfb (0x958b bytes) 000633 1788852107.542947 trunc from 0x03fe93 to 0x009ff7 (0x35e9b bytes) 000634 1788852107.571626 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x9ff8): Mirror 3: 0xa1d3a072 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9ff8): Mirror 3: 0xa1d3a072 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9ff8: skipped 000635 1788852107.919302 fallocate 0x02a36e thru 0x02e034 (0x3cc7 bytes) 000638 1788852107.926190 write 0x02985c thru 0x0389f6 (0xf19b bytes) 000639 1788852107.932585 punch from 0x00f5eb to 0x017421 (0x7e37 bytes) 000641 1788852107.938168 trunc from 0x0389f7 to 0x00374e (0x352a8 bytes) 000642 1788852107.952691 write 0x009543 thru 0x019040 (0xfafe bytes) 000643 1788852107.954524 mapwrite 0x017ddd thru 0x01cdcd (0x4ff1 bytes) 000644 1788852108.011200 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1cdce): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cdce): Mirror 3: 0x5f2f85ff (stale) CRC-32 checksum value for chunk [0, 0x1cdce): Mirror 1: 0x49d19682 Mirror 4: 0x49d19682 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cdce: skipped 000645 1788852108.909337 trunc from 0x00e5ea to 0x010e3f (0x2856 bytes) 000646 1788852108.956748 mapwrite 0x02e3b0 thru 0x0355e3 (0x7234 bytes) 000647 1788852109.085610 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x355e4): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x355e4): Mirror 3: 0x95789726 (stale) Mirror 4: 0xb7cf500a (stale) CRC-32 checksum value for chunk [0, 0x355e4): Mirror 1: 0xa795a20b Mirror 5: 0xa795a20b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x355e4: skipped 000648 1788852110.092598 trunc from 0x0355e4 to 0x027cd0 (0xd913 bytes) 000649 1788852110.151668 mapread 0x006c6e thru 0x0161f1 (0xf584 bytes) 000650 1788852110.190789 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x27cd1): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27cd1): Mirror 3: 0xdaa6535a (stale) Mirror 4: 0x5842105e (stale) Mirror 5: 0xf86b6848 (stale) CRC-32 checksum value for chunk [0, 0x27cd1): Mirror 1: 0xf86b6848 Mirror 6: 0xf86b6848 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27cd1: skipped 000651 1788852111.191804 write 0x0223b4 thru 0x02a989 (0x85d6 bytes) 000652 1788852111.234417 write 0x02ba8c thru 0x031a0c (0x5f81 bytes) 000653 1788852111.235606 trunc from 0x031a0d to 0x011952 (0x200ba bytes) 000654 1788852111.298122 trunc from 0x011953 to 0x039f66 (0x28614 bytes) 000655 1788852111.327307 trunc from 0x018d27 to 0x019ab3 (0xd8d bytes) 000656 1788852111.337020 trunc from 0x039f67 to 0x0138a8 (0x266be bytes) 000658 1788852111.355854 fallocate 0x002cde thru 0x00eb14 (0xbe37 bytes) 000659 1788852111.360176 mapread 0x002cea thru 0x00cd5a (0xa071 bytes) 000660 1788852111.391006 trunc from 0x0138a9 to 0x00db04 (0x5da4 bytes) 000661 1788852111.416267 write 0x006ab3 thru 0x014f90 (0xe4de bytes) 000662 1788852111.423072 read 0x014e59 thru 0x014f90 (0x138 bytes) 000663 1788852111.423703 trunc from 0x014891 to 0x014f90 (0x700 bytes) 000664 1788852111.451960 read 0x00812b thru 0x00eb78 (0x6a4e bytes) 000665 1788852111.452646 write 0x03a78e thru 0x03ffff (0x5872 bytes) 000666 1788852111.453974 punch from 0x009883 to 0x013f8b (0xa709 bytes) 000667 1788852111.463295 mapwrite 0x035fd0 thru 0x037b7b (0x1bac bytes) 000668 1788852111.546430 fallocate 0x002999 thru 0x00979d (0x6e05 bytes) 000669 1788852111.562828 write 0x013dfa thru 0x016295 (0x249c bytes) 000670 1788852111.573432 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xfb4975c1 (stale) Mirror 4: 0xcea5d73d (stale) Mirror 5: 0xa2f2dd47 (stale) Mirror 6: 0xbdb7e4f2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb36894a3 Mirror 7: 0xb36894a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000671 1788852112.532157 MIRROR_RESYNC 6 mirrors 000672 1788852114.384186 read 0x00c34c thru 0x01000b (0x3cc0 bytes) 000673 1788852114.396085 mapread 0x01904c thru 0x020797 (0x774c bytes) 000674 1788852114.417968 trunc from 0x040000 to 0x00dfdd (0x32022 bytes) 000675 1788852114.490117 mapwrite 0x015515 thru 0x023b4b (0xe637 bytes) 000676 1788852114.575446 MIRROR_RESYNC 6 mirrors 000677 1788852115.968935 mapread 0x00adfd thru 0x012f18 (0x811c bytes) 000678 1788852116.005866 read 0x00b753 thru 0x0122db (0x6b89 bytes) 000679 1788852116.006333 mapread 0x00f74c thru 0x01bc8e (0xc543 bytes) 000680 1788852116.020405 fallocate 0x001e36 thru 0x011ba5 (0xfd70 bytes) 000681 1788852116.079941 fallocate 0x02d5e6 thru 0x0353e7 (0x7e02 bytes) 000682 1788852116.089010 fallocate 0x02fd7e thru 0x036f66 (0x71e9 bytes) 000683 1788852116.097149 fallocate 0x0202c6 thru 0x024258 (0x3f93 bytes) 000685 1788852116.111602 write 0x027bcd thru 0x03343f (0xb873 bytes) 000686 1788852116.124585 fallocate 0x0170f8 thru 0x021d73 (0xac7c bytes) 000687 1788852116.130917 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x36f67): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36f67): Mirror 3: 0xbea3fdfe (stale) Mirror 4: 0xbea3fdfe (stale) Mirror 5: 0xbea3fdfe (stale) Mirror 6: 0xbea3fdfe (stale) Mirror 7: 0xbea3fdfe (stale) CRC-32 checksum value for chunk [0, 0x36f67): Mirror 1: 0x3841a278 Mirror 8: 0x3841a278 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36f67: skipped 000688 1788852117.454072 trunc from 0x00e28e to 0x018b57 (0xa8ca bytes) 000689 1788852117.522202 trunc from 0x011c27 to 0x01e422 (0xc7fc bytes) 000690 1788852117.537177 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36f67): Mirror 3: 0xbea3fdfe (stale) Mirror 4: 0xbea3fdfe (stale) Mirror 6: 0xbea3fdfe (stale) Mirror 7: 0xbea3fdfe (stale) Mirror 8: 0x3841a278 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36f67): Mirror 3: 0xbea3fdfe (stale) Mirror 4: 0xbea3fdfe (stale) Mirror 6: 0xbea3fdfe (stale) Mirror 7: 0xbea3fdfe (stale) Mirror 8: 0x3841a278 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36f67: skipped 000691 1788852118.023161 mapwrite 0x00a5d5 thru 0x00b081 (0xaad bytes) 000693 1788852118.044346 read 0x027f27 thru 0x036587 (0xe661 bytes) 000694 1788852118.057385 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36f67): Mirror 4: 0xbea3fdfe (stale) Mirror 6: 0xbea3fdfe (stale) Mirror 7: 0xbea3fdfe (stale) Mirror 8: 0x3841a278 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36f67): Mirror 4: 0xbea3fdfe (stale) Mirror 6: 0xbea3fdfe (stale) Mirror 7: 0xbea3fdfe (stale) Mirror 8: 0x3841a278 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36f67: skipped 000695 1788852118.503541 MIRROR_RESYNC 5 mirrors 000696 1788852120.307427 mapread 0x02e14a thru 0x036f66 (0x8e1d bytes) 000697 1788852120.330876 MIRROR_EXTEND to 6 mirrors 000698 1788852121.340977 mapread 0x006b88 thru 0x016548 (0xf9c1 bytes) 000699 1788852121.384078 MIRROR_EXTEND to 7 mirrors 000700 1788852122.249706 fallocate 0x01c1c5 thru 0x01ed6e (0x2baa bytes) 000701 1788852122.296798 trunc from 0x036f67 to 0x02781b (0xf74b bytes) 000702 1788852122.322885 trunc from 0x01d64d to 0x0251ce (0x7b82 bytes) 000705 1788852122.330169 trunc from 0x02781c to 0x01eb45 (0x8cd6 bytes) 000706 1788852122.347940 mapread 0x010630 thru 0x01eb45 (0xe516 bytes) 000708 1788852122.406746 read 0x008681 thru 0x011591 (0x8f11 bytes) 000711 1788852122.443630 MIRROR_RESYNC 7 mirrors 000712 1788852123.940568 trunc from 0x015df0 to 0x018c16 (0x2e27 bytes) 000713 1788852123.973596 read 0x016bb7 thru 0x01eb45 (0x7f8f bytes) 000714 1788852123.990057 read 0x007f6f thru 0x00ca78 (0x4b0a bytes) 000715 1788852124.006642 read 0x013017 thru 0x01b50f (0x84f9 bytes) 000716 1788852124.012032 MIRROR_RESYNC 7 mirrors 000717 1788852125.452219 mapwrite 0x008f63 thru 0x014572 (0xb610 bytes) 000718 1788852125.572440 mapread 0x01a96e thru 0x01eb45 (0x41d8 bytes) 000719 1788852125.589698 mapread 0x00089a thru 0x0084f8 (0x7c5f bytes) 000720 1788852125.604473 read 0x001ea3 thru 0x00a480 (0x85de bytes) 000721 1788852125.606115 mapwrite 0x011b3d thru 0x01a90c (0x8dd0 bytes) 000723 1788852125.630575 trunc from 0x01eb46 to 0x005376 (0x197cf bytes) 000725 1788852125.653891 trunc from 0x001044 to 0x005376 (0x4333 bytes) 000726 1788852125.660319 mapwrite 0x020a39 thru 0x02797f (0x6f47 bytes) 000727 1788852125.707833 trunc from 0x027980 to 0x0338dd (0xbf5e bytes) 000728 1788852125.720219 read 0x00ab03 thru 0x00c50c (0x1a0a bytes) 000729 1788852125.727628 mapwrite 0x00be71 thru 0x01aeeb (0xf07b bytes) 000730 1788852125.749631 trunc from 0x02c1e3 to 0x02d95f (0x177d bytes) 000731 1788852125.755423 trunc from 0x01f66b to 0x0258d2 (0x6268 bytes) 000732 1788852125.763725 trunc from 0x0338de to 0x02a2f3 (0x95ea bytes) 000733 1788852125.787360 fallocate 0x00bb4c thru 0x018809 (0xccbe bytes) 000734 1788852125.801831 trunc from 0x013cdc to 0x014dab (0x10d0 bytes) 000735 1788852125.812735 write 0x018631 thru 0x019826 (0x11f6 bytes) 000737 1788852125.814539 fallocate 0x038fd7 thru 0x03ffff (0x7029 bytes) 000738 1788852125.821208 trunc from 0x02a2f4 to 0x0191c3 (0x11130 bytes) 000739 1788852125.852501 MIRROR_RESYNC 7 mirrors 000740 1788852127.162291 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) 000741 1788852127.744486 read 0x007080 thru 0x0128e1 (0xb862 bytes) 000743 1788852127.761584 trunc from 0x0191c4 to 0x029e01 (0x10c3e bytes) 000744 1788852127.836597 punch from 0x015bce to 0x022826 (0xcc59 bytes) 000745 1788852127.844094 fallocate 0x016b67 thru 0x01f51a (0x89b4 bytes) 000746 1788852127.855076 trunc from 0x01f81a to 0x027125 (0x790c bytes) 000747 1788852127.861778 mapread 0x00713e thru 0x0083fc (0x12bf bytes) 000748 1788852127.912802 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x29e02): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29e02): Mirror 4: 0x8be25f65 (stale) Mirror 7: 0x8be25f65 (stale) Mirror 8: 0x8be25f65 (stale) Mirror 9: 0x8be25f65 (stale) Mirror 10: 0x8be25f65 (stale) CRC-32 checksum value for chunk [0, 0x29e02): Mirror 1: 0xb726d47b Mirror 11: 0xb726d47b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29e02: skipped 000749 1788852129.054006 trunc from 0x029e02 to 0x03cc95 (0x12e94 bytes) 000750 1788852129.102895 read 0x02b562 thru 0x034074 (0x8b13 bytes) 000751 1788852129.124920 mapread 0x01213a thru 0x017198 (0x505f bytes) 000752 1788852129.152301 read 0x03b088 thru 0x03cc95 (0x1c0e bytes) 000753 1788852129.166531 write 0x0362dd thru 0x036d23 (0xa47 bytes) 000754 1788852129.170392 mapread 0x019aa4 thru 0x027b02 (0xe05f bytes) 000755 1788852129.174822 trunc from 0x03cc96 to 0x01854a (0x2474b bytes) 000757 1788852129.213222 punch from 0x00f14e to 0x012f18 (0x3dcb bytes) 000758 1788852129.221407 write 0x01dc86 thru 0x029085 (0xb400 bytes) 000761 1788852129.231100 mapwrite 0x02f221 thru 0x03b5ed (0xc3cd bytes) 000763 1788852129.362892 MIRROR_RESYNC 7 mirrors 000764 1788852132.202874 trunc from 0x00f4a5 to 0x015115 (0x5c71 bytes) 000765 1788852132.265534 MIRROR_RESYNC 7 mirrors 000766 1788852134.749711 trunc from 0x03b5ee to 0x0274aa (0x14143 bytes) 000767 1788852134.810220 mapwrite 0x02f739 thru 0x034175 (0x4a3d bytes) 000768 1788852134.900901 trunc from 0x034176 to 0x03d52e (0x93b9 bytes) 000769 1788852134.918967 write 0x0273cf thru 0x028991 (0x15c3 bytes) 000770 1788852134.927536 fallocate 0x03655b thru 0x03ffff (0x9aa5 bytes) 000771 1788852134.932860 read 0x01ed60 thru 0x02bfd6 (0xd277 bytes) 000772 1788852134.952165 read 0x031366 thru 0x039182 (0x7e1d bytes) 000773 1788852134.968119 trunc from 0x040000 to 0x03fb89 (0x476 bytes) 000774 1788852135.013015 trunc from 0x03a22f to 0x03fb89 (0x595b bytes) 000775 1788852135.031100 MIRROR_RESYNC 7 mirrors 000776 1788852137.494968 MIRROR_EXTEND to 8 mirrors 000777 1788852138.407096 read 0x03de18 thru 0x03fb89 (0x1d72 bytes) 000778 1788852138.412640 write 0x00d39d thru 0x01b1f2 (0xde56 bytes) 000779 1788852138.492025 punch from 0x0017f3 to 0x004d33 (0x3541 bytes) 000780 1788852138.510838 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3fb8a): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb8a): Mirror 4: 0xd962b892 (stale) Mirror 7: 0xd962b892 (stale) Mirror 8: 0xd962b892 (stale) Mirror 9: 0xd962b892 (stale) Mirror 10: 0xd962b892 (stale) Mirror 11: 0xd962b892 (stale) Mirror 12: 0xd962b892 (stale) CRC-32 checksum value for chunk [0, 0x3fb8a): Mirror 1: 0x1c8b668f Mirror 13: 0x1c8b668f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb8a: skipped 000781 1788852140.013765 read 0x01bce6 thru 0x026c90 (0xafab bytes) 000782 1788852140.051201 trunc from 0x016f99 to 0x024e9e (0xdf06 bytes) 000783 1788852140.132705 fallocate 0x02cfc6 thru 0x03c0b2 (0xf0ed bytes) 000784 1788852140.147125 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3fb8a): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb8a): Mirror 4: 0xd962b892 (stale) Mirror 7: 0xd962b892 (stale) Mirror 8: 0xd962b892 (stale) Mirror 9: 0xd962b892 (stale) Mirror 10: 0xd962b892 (stale) Mirror 11: 0xd962b892 (stale) Mirror 12: 0xd962b892 (stale) Mirror 13: 0x1c8b668f (stale) CRC-32 checksum value for chunk [0, 0x3fb8a): Mirror 1: 0x2c453cce Mirror 14: 0x2c453cce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb8a: skipped 000785 1788852141.555071 mapread 0x02f489 thru 0x0333b0 (0x3f28 bytes) 000786 1788852141.592446 punch from 0x02d494 to 0x03d01f (0xfb8c bytes) 000787 1788852141.634907 read 0x008d10 thru 0x00f56b (0x685c bytes) 000788 1788852141.647574 trunc from 0x0294aa to 0x02acc2 (0x1819 bytes) 000789 1788852141.654028 mapread 0x0354c7 thru 0x039e4f (0x4989 bytes) 000790 1788852141.673793 write 0x0125b9 thru 0x01a115 (0x7b5d bytes) 000791 1788852141.693551 trunc from 0x03fb8a to 0x019584 (0x26605 bytes) 000792 1788852141.729090 write 0x034c3c thru 0x03ffff (0xb3c4 bytes) 000793 1788852141.741991 read 0x017a6f thru 0x018269 (0x7fb bytes) 000794 1788852141.742945 mapwrite 0x03e860 thru 0x03ffff (0x17a0 bytes) 000795 1788852141.786063 fallocate 0x01716e thru 0x01a882 (0x3715 bytes) 000796 1788852141.791800 punch from 0x03a501 to 0x03ffff (0x5aff bytes) 000797 1788852141.801576 mapwrite 0x02f39a thru 0x03cbfd (0xd864 bytes) 000798 1788852141.873868 trunc from 0x031123 to 0x037b7d (0x6a5b bytes) 000799 1788852141.880086 trunc from 0x040000 to 0x02748d (0x18b72 bytes) 000800 1788852141.916595 read 0x0152a1 thru 0x021b45 (0xc8a5 bytes) 000801 1788852141.919402 mapwrite 0x0287c3 thru 0x02ed5f (0x659d bytes) 000802 1788852141.974567 trunc from 0x02ed60 to 0x036d71 (0x8012 bytes) 000803 1788852141.993898 trunc from 0x036c1f to 0x036d71 (0x153 bytes) 000804 1788852141.999554 read 0x00d394 thru 0x01b887 (0xe4f4 bytes) 000805 1788852142.000297 mapread 0x0062d8 thru 0x012581 (0xc2aa bytes) 000806 1788852142.002614 mapread 0x02ab15 thru 0x033f25 (0x9411 bytes) 000807 1788852142.011046 write 0x0197a1 thru 0x02552a (0xbd8a bytes) 000808 1788852142.017625 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x36d72): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36d72): Mirror 4: 0xd8a32535 (stale) Mirror 7: 0xd8a32535 (stale) Mirror 8: 0xd8a32535 (stale) Mirror 9: 0xd8a32535 (stale) Mirror 10: 0xd8a32535 (stale) Mirror 11: 0xd8a32535 (stale) Mirror 12: 0xd8a32535 (stale) Mirror 13: 0x6616b941 (stale) Mirror 14: 0xe8646b56 (stale) CRC-32 checksum value for chunk [0, 0x36d72): Mirror 1: 0x63afa58a Mirror 15: 0x63afa58a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36d72: skipped 000809 1788852143.203893 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x36d72): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36d72): Mirror 4: 0xd8a32535 (stale) Mirror 7: 0xd8a32535 (stale) Mirror 8: 0xd8a32535 (stale) Mirror 9: 0xd8a32535 (stale) Mirror 10: 0xd8a32535 (stale) Mirror 11: 0xd8a32535 (stale) Mirror 12: 0xd8a32535 (stale) Mirror 13: 0x6616b941 (stale) Mirror 14: 0xe8646b56 (stale) CRC-32 checksum value for chunk [0, 0x36d72): Mirror 1: 0x63afa58a Mirror 15: 0x63afa58a Mirror 16: 0x63afa58a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36d72: skipped 000810 1788852144.699220 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x36d72): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36d72): Mirror 4: 0xd8a32535 (stale) Mirror 7: 0xd8a32535 (stale) Mirror 8: 0xd8a32535 (stale) Mirror 9: 0xd8a32535 (stale) Mirror 10: 0xd8a32535 (stale) Mirror 11: 0xd8a32535 (stale) Mirror 12: 0xd8a32535 (stale) Mirror 13: 0x6616b941 (stale) Mirror 14: 0xe8646b56 (stale) CRC-32 checksum value for chunk [0, 0x36d72): Mirror 1: 0x63afa58a Mirror 15: 0x63afa58a Mirror 16: 0x63afa58a Mirror 17: 0x63afa58a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36d72: skipped 000811 1788852145.999569 mapwrite 0x02e1bb thru 0x03c726 (0xe56c bytes) 000812 1788852146.149851 trunc from 0x03c727 to 0x033df0 (0x8936 bytes) 000814 1788852146.176373 trunc from 0x01fd6e to 0x02ada7 (0xb03a bytes) 000815 1788852146.181998 write 0x0388e3 thru 0x03ffff (0x771d bytes) 000816 1788852146.183844 mapread 0x003e29 thru 0x0126ed (0xe8c5 bytes) 000817 1788852146.238761 MIRROR_SPLIT mirror 9 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb332597a (stale) Mirror 7: 0xb332597a (stale) Mirror 8: 0xb332597a (stale) Mirror 9: 0xb332597a (stale) Mirror 10: 0xb332597a (stale) Mirror 11: 0xb332597a (stale) Mirror 12: 0xb332597a (stale) Mirror 13: 0x72d5c250 (stale) Mirror 15: 0xa38bdfac (stale) Mirror 16: 0xa38bdfac (stale) Mirror 17: 0xa38bdfac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb332597a (stale) Mirror 7: 0xb332597a (stale) Mirror 8: 0xb332597a (stale) Mirror 9: 0xb332597a (stale) Mirror 10: 0xb332597a (stale) Mirror 11: 0xb332597a (stale) Mirror 12: 0xb332597a (stale) Mirror 13: 0x72d5c250 (stale) Mirror 15: 0xa38bdfac (stale) Mirror 16: 0xa38bdfac (stale) Mirror 17: 0xa38bdfac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000819 1788852147.108906 read 0x033317 thru 0x03cee0 (0x9bca bytes) 000820 1788852147.115978 read 0x020a0f thru 0x02d1f8 (0xc7ea bytes) 000822 1788852147.125310 trunc from 0x040000 to 0x0128ad (0x2d752 bytes) 000823 1788852147.141081 mapread 0x00228d thru 0x011e6a (0xfbde bytes) 000824 1788852147.149450 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x128ae): Mirror 4: 0x86fb44cb (stale) Mirror 7: 0x86fb44cb (stale) Mirror 8: 0x86fb44cb (stale) Mirror 9: 0x86fb44cb (stale) Mirror 10: 0x86fb44cb (stale) Mirror 11: 0x86fb44cb (stale) Mirror 12: 0x86fb44cb (stale) Mirror 13: 0x5d40722c (stale) Mirror 15: 0x55860d2c (stale) Mirror 17: 0x55860d2c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x128ae): Mirror 4: 0x86fb44cb (stale) Mirror 7: 0x86fb44cb (stale) Mirror 8: 0x86fb44cb (stale) Mirror 9: 0x86fb44cb (stale) Mirror 10: 0x86fb44cb (stale) Mirror 11: 0x86fb44cb (stale) Mirror 12: 0x86fb44cb (stale) Mirror 13: 0x5d40722c (stale) Mirror 15: 0x55860d2c (stale) Mirror 17: 0x55860d2c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x128ae: skipped 000825 1788852147.917813 write 0x0374ca thru 0x03c8a2 (0x53d9 bytes) 000826 1788852147.925004 mapread 0x015c95 thru 0x023e4d (0xe1b9 bytes) 000827 1788852147.951073 trunc from 0x03c8a3 to 0x01c714 (0x2018e bytes) 000828 1788852147.969359 trunc from 0x005009 to 0x00f813 (0xa80b bytes) 000829 1788852147.978831 fallocate 0x010a99 thru 0x01fe44 (0xf3ac bytes) 000830 1788852147.991048 write 0x035a63 thru 0x039160 (0x36fe bytes) 000831 1788852147.993764 trunc from 0x039161 to 0x035b7c (0x35e4 bytes) 000832 1788852148.017666 mapwrite 0x03afca thru 0x03ffff (0x5036 bytes) 000833 1788852148.087735 fallocate 0x02ad20 thru 0x039824 (0xeb05 bytes) 000834 1788852148.098344 trunc from 0x02e849 to 0x03b90a (0xd0c2 bytes) 000835 1788852148.103852 write 0x000a09 thru 0x004cc7 (0x42bf bytes) 000836 1788852148.114715 fallocate 0x03b237 thru 0x03ffff (0x4dc9 bytes) 000837 1788852148.119146 trunc from 0x012353 to 0x019c12 (0x78c0 bytes) 000838 1788852148.124910 write 0x027d0b thru 0x02cda4 (0x509a bytes) 000839 1788852148.136779 write 0x03211b thru 0x0394b2 (0x7398 bytes) 000840 1788852148.165885 mapread 0x00c790 thru 0x01add8 (0xe649 bytes) 000841 1788852148.213515 punch from 0x01befd to 0x0260c2 (0xa1c6 bytes) 000842 1788852148.219279 punch from 0x000421 to 0x00b08e (0xac6e bytes) 000843 1788852148.269736 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb332597a (stale) Mirror 7: 0xb332597a (stale) Mirror 9: 0xb332597a (stale) Mirror 10: 0xb332597a (stale) Mirror 11: 0xb332597a (stale) Mirror 12: 0xb332597a (stale) Mirror 13: 0x72d5c250 (stale) Mirror 15: 0xa38bdfac (stale) Mirror 17: 0xa38bdfac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb332597a (stale) Mirror 7: 0xb332597a (stale) Mirror 9: 0xb332597a (stale) Mirror 10: 0xb332597a (stale) Mirror 11: 0xb332597a (stale) Mirror 12: 0xb332597a (stale) Mirror 13: 0x72d5c250 (stale) Mirror 15: 0xa38bdfac (stale) Mirror 17: 0xa38bdfac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000844 1788852149.000663 fallocate 0x014361 thru 0x01714e (0x2dee bytes) 000846 1788852149.007005 mapread 0x02c2b6 thru 0x037784 (0xb4cf bytes) 000847 1788852149.040001 trunc from 0x040000 to 0x02459a (0x1ba65 bytes) 000848 1788852149.065841 trunc from 0x02459b to 0x00d8cf (0x16ccb bytes) 000849 1788852149.085083 trunc from 0x008543 to 0x00d8cf (0x538d bytes) 000850 1788852149.091157 punch from 0x006c62 to 0x00d8cf (0x6c6e bytes) 000851 1788852149.101741 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd8d0): Mirror 4: 0xb48ce5f7 (stale) Mirror 7: 0xb48ce5f7 (stale) Mirror 9: 0xb48ce5f7 (stale) Mirror 10: 0xb48ce5f7 (stale) Mirror 11: 0xb48ce5f7 (stale) Mirror 12: 0xb48ce5f7 (stale) Mirror 13: 0xe734033c (stale) Mirror 17: 0xe734033c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd8d0): Mirror 4: 0xb48ce5f7 (stale) Mirror 7: 0xb48ce5f7 (stale) Mirror 9: 0xb48ce5f7 (stale) Mirror 10: 0xb48ce5f7 (stale) Mirror 11: 0xb48ce5f7 (stale) Mirror 12: 0xb48ce5f7 (stale) Mirror 13: 0xe734033c (stale) Mirror 17: 0xe734033c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd8d0: skipped 000852 1788852149.765720 trunc from 0x00d8d0 to 0x0149f4 (0x7125 bytes) 000853 1788852149.792436 punch from 0x0028f0 to 0x004804 (0x1f15 bytes) 000854 1788852149.799507 write 0x038e5b thru 0x03d51b (0x46c1 bytes) 000855 1788852149.800971 punch from 0x0149e8 to 0x0231fb (0xe814 bytes) 000856 1788852149.805368 read 0x0363d1 thru 0x03d51b (0x714b bytes) 000858 1788852149.822589 MIRROR_RESYNC 9 mirrors 000859 1788852151.749096 trunc from 0x034172 to 0x0360ae (0x1f3d bytes) 000860 1788852151.793375 fallocate 0x012da8 thru 0x01ee3c (0xc095 bytes) 000861 1788852151.800202 punch from 0x012f68 to 0x013fea (0x1083 bytes) 000862 1788852151.806494 write 0x0010e8 thru 0x00551f (0x4438 bytes) 000863 1788852151.828062 MIRROR_RESYNC 9 mirrors 000864 1788852153.693930 mapread 0x00e624 thru 0x01a4b0 (0xbe8d bytes) 000865 1788852153.735600 mapwrite 0x018278 thru 0x01cbe7 (0x4970 bytes) 000866 1788852153.814988 read 0x00c0cb thru 0x019f6f (0xdea5 bytes) 000867 1788852153.829632 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3d51c): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d51c): Mirror 4: 0x499b70d1 (stale) Mirror 7: 0x499b70d1 (stale) Mirror 9: 0x499b70d1 (stale) Mirror 10: 0x499b70d1 (stale) Mirror 11: 0x499b70d1 (stale) Mirror 12: 0x499b70d1 (stale) Mirror 13: 0x499b70d1 (stale) Mirror 17: 0x499b70d1 (stale) CRC-32 checksum value for chunk [0, 0x3d51c): Mirror 1: 0x414d24a1 Mirror 18: 0x414d24a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d51c: skipped 000868 1788852155.315674 mapwrite 0x02b3f2 thru 0x02f980 (0x458f bytes) 000869 1788852155.462164 punch from 0x0124b7 to 0x0207b1 (0xe2fb bytes) 000870 1788852155.476090 mapread 0x02b201 thru 0x02e4e3 (0x32e3 bytes) 000871 1788852155.483438 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3d51c): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d51c): Mirror 4: 0x499b70d1 (stale) Mirror 7: 0x499b70d1 (stale) Mirror 9: 0x499b70d1 (stale) Mirror 10: 0x499b70d1 (stale) Mirror 11: 0x499b70d1 (stale) Mirror 12: 0x499b70d1 (stale) Mirror 13: 0x499b70d1 (stale) Mirror 17: 0x499b70d1 (stale) Mirror 18: 0x414d24a1 (stale) CRC-32 checksum value for chunk [0, 0x3d51c): Mirror 1: 0x71602385 Mirror 19: 0x71602385 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d51c: skipped 000872 1788852156.478976 fallocate 0x0165ba thru 0x019c17 (0x365e bytes) 000873 1788852156.527510 mapwrite 0x0183ba thru 0x01b105 (0x2d4c bytes) 000874 1788852156.560098 mapread 0x017011 thru 0x019d7d (0x2d6d bytes) 000875 1788852156.561636 punch from 0x018f37 to 0x01d8fc (0x49c6 bytes) 000876 1788852156.575470 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3d51c): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d51c): Mirror 4: 0x499b70d1 (stale) Mirror 7: 0x499b70d1 (stale) Mirror 9: 0x499b70d1 (stale) Mirror 10: 0x499b70d1 (stale) Mirror 11: 0x499b70d1 (stale) Mirror 12: 0x499b70d1 (stale) Mirror 13: 0x499b70d1 (stale) Mirror 17: 0x499b70d1 (stale) Mirror 18: 0x414d24a1 (stale) Mirror 19: 0x71602385 (stale) CRC-32 checksum value for chunk [0, 0x3d51c): Mirror 1: 0xd44ac576 Mirror 20: 0xd44ac576 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d51c: skipped 000877 1788852158.153620 write 0x000789 thru 0x00677f (0x5ff7 bytes) 000878 1788852158.266420 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d51c): Mirror 4: 0x499b70d1 (stale) Mirror 7: 0x499b70d1 (stale) Mirror 9: 0x499b70d1 (stale) Mirror 10: 0x499b70d1 (stale) Mirror 12: 0x499b70d1 (stale) Mirror 13: 0x499b70d1 (stale) Mirror 17: 0x499b70d1 (stale) Mirror 18: 0x414d24a1 (stale) Mirror 19: 0x71602385 (stale) Mirror 20: 0xd44ac576 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d51c): Mirror 4: 0x499b70d1 (stale) Mirror 7: 0x499b70d1 (stale) Mirror 9: 0x499b70d1 (stale) Mirror 10: 0x499b70d1 (stale) Mirror 12: 0x499b70d1 (stale) Mirror 13: 0x499b70d1 (stale) Mirror 17: 0x499b70d1 (stale) Mirror 18: 0x414d24a1 (stale) Mirror 19: 0x71602385 (stale) Mirror 20: 0xd44ac576 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d51c: skipped 000879 1788852158.980050 trunc from 0x03d51c to 0x01cc33 (0x208e8 bytes) 000880 1788852159.003723 read 0x01c431 thru 0x01cc33 (0x803 bytes) 000881 1788852159.010158 mapwrite 0x039644 thru 0x03ffff (0x69bc bytes) 000882 1788852159.080647 write 0x02ecc3 thru 0x03567a (0x69b8 bytes) 000883 1788852159.094592 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2d32d4ea (stale) Mirror 7: 0x2d32d4ea (stale) Mirror 9: 0x2d32d4ea (stale) Mirror 10: 0x2d32d4ea (stale) Mirror 12: 0x2d32d4ea (stale) Mirror 13: 0x2d32d4ea (stale) Mirror 17: 0x2d32d4ea (stale) Mirror 18: 0x9dcfc8c9 (stale) Mirror 19: 0x1de4be67 (stale) Mirror 20: 0x2531ab5f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3bc97fe2 Mirror 21: 0x3bc97fe2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000884 1788852160.465821 MIRROR_SPLIT mirror 7 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2d32d4ea (stale) Mirror 7: 0x2d32d4ea (stale) Mirror 9: 0x2d32d4ea (stale) Mirror 10: 0x2d32d4ea (stale) Mirror 12: 0x2d32d4ea (stale) Mirror 13: 0x2d32d4ea (stale) Mirror 18: 0x9dcfc8c9 (stale) Mirror 19: 0x1de4be67 (stale) Mirror 20: 0x2531ab5f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2d32d4ea (stale) Mirror 7: 0x2d32d4ea (stale) Mirror 9: 0x2d32d4ea (stale) Mirror 10: 0x2d32d4ea (stale) Mirror 12: 0x2d32d4ea (stale) Mirror 13: 0x2d32d4ea (stale) Mirror 18: 0x9dcfc8c9 (stale) Mirror 19: 0x1de4be67 (stale) Mirror 20: 0x2531ab5f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3bc97fe2 Mirror 21: 0x3bc97fe2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000885 1788852161.702820 trunc from 0x0059a2 to 0x0152a1 (0xf900 bytes) 000886 1788852161.794049 fallocate 0x00d64b thru 0x013271 (0x5c27 bytes) 000887 1788852161.808119 trunc from 0x017f83 to 0x01adeb (0x2e69 bytes) 000888 1788852161.829428 read 0x020ea4 thru 0x02da80 (0xcbdd bytes) 000889 1788852161.861334 write 0x020760 thru 0x0218cb (0x116c bytes) 000890 1788852161.868370 punch from 0x0349ad to 0x0357b1 (0xe05 bytes) 000892 1788852161.879485 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2d32d4ea (stale) Mirror 7: 0x2d32d4ea (stale) Mirror 9: 0x2d32d4ea (stale) Mirror 10: 0x2d32d4ea (stale) Mirror 12: 0x2d32d4ea (stale) Mirror 13: 0x2d32d4ea (stale) Mirror 18: 0x9dcfc8c9 (stale) Mirror 19: 0x1de4be67 (stale) Mirror 20: 0x2531ab5f (stale) Mirror 21: 0x3bc97fe2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x90ba13c0 Mirror 22: 0x90ba13c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000894 1788852163.245402 read 0x020598 thru 0x02f5ce (0xf037 bytes) 000895 1788852163.298032 write 0x03db32 thru 0x03ffff (0x24ce bytes) 000897 1788852163.384582 trunc from 0x023cbc to 0x02c077 (0x83bc bytes) 000898 1788852163.397296 read 0x0336d6 thru 0x03bf19 (0x8844 bytes) 000899 1788852163.412454 read 0x02035d thru 0x029604 (0x92a8 bytes) 000900 1788852163.418131 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2d32d4ea (stale) Mirror 7: 0x2d32d4ea (stale) Mirror 9: 0x2d32d4ea (stale) Mirror 10: 0x2d32d4ea (stale) Mirror 12: 0x2d32d4ea (stale) Mirror 13: 0x2d32d4ea (stale) Mirror 18: 0x9dcfc8c9 (stale) Mirror 19: 0x1de4be67 (stale) Mirror 20: 0x2531ab5f (stale) Mirror 21: 0x3bc97fe2 (stale) Mirror 22: 0x90ba13c0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x46a560e4 Mirror 23: 0x46a560e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000902 1788852164.915168 read 0x037fd7 thru 0x03f0c8 (0x70f2 bytes) 000903 1788852164.932735 read 0x0344d8 thru 0x0391cd (0x4cf6 bytes) 000905 1788852164.961277 trunc from 0x040000 to 0x0259ab (0x1a654 bytes) 000906 1788852165.026825 write 0x01ac3e thru 0x02598c (0xad4f bytes) 000907 1788852165.037459 mapwrite 0x027cc0 thru 0x0303d1 (0x8712 bytes) 000908 1788852165.133672 mapwrite 0x01e89a thru 0x02b77c (0xcee3 bytes) 000909 1788852165.179224 read 0x014ddf thru 0x017018 (0x223a bytes) 000910 1788852165.192872 trunc from 0x0303d2 to 0x0182ad (0x18124 bytes) 000911 1788852165.215381 trunc from 0x0182ae to 0x00e4b8 (0x9df5 bytes) 000913 1788852165.248769 mapread 0x00d3a8 thru 0x00e4b8 (0x1111 bytes) 000914 1788852165.250470 read 0x0067d7 thru 0x00db72 (0x739c bytes) 000915 1788852165.253401 punch from 0x00d31a to 0x00e4b8 (0x119f bytes) 000916 1788852165.266317 mapwrite 0x03db38 thru 0x03ffff (0x24c8 bytes) 000917 1788852165.325783 mapread 0x024217 thru 0x029501 (0x52eb bytes) 000919 1788852165.327149 write 0x00b27c thru 0x019c85 (0xea0a bytes) 000920 1788852165.329472 mapread 0x02e328 thru 0x038c6f (0xa948 bytes) 000921 1788852165.330420 read 0x023902 thru 0x02af4f (0x764e bytes) 000922 1788852165.331060 mapread 0x03028a thru 0x037672 (0x73e9 bytes) 000923 1788852165.336667 trunc from 0x010a21 to 0x012f4a (0x252a bytes) 000924 1788852165.361040 trunc from 0x040000 to 0x0076f6 (0x38909 bytes) 000925 1788852165.389760 trunc from 0x0076f7 to 0x01616e (0xea78 bytes) 000926 1788852165.416136 read 0x00fb42 thru 0x01616e (0x662d bytes) 000927 1788852165.434084 trunc from 0x00f4f3 to 0x013350 (0x3e5e bytes) 000928 1788852165.441072 trunc from 0x01616f to 0x02c124 (0x15fb6 bytes) 000929 1788852165.467107 punch from 0x01a8f7 to 0x020996 (0x60a0 bytes) 000931 1788852165.477674 punch from 0x01c2cb to 0x01e89d (0x25d3 bytes) 000932 1788852165.493824 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c125): Mirror 4: 0xc978bebd (stale) Mirror 7: 0xc978bebd (stale) Mirror 9: 0xc978bebd (stale) Mirror 12: 0xc978bebd (stale) Mirror 13: 0xc978bebd (stale) Mirror 18: 0xeee3f35 (stale) Mirror 19: 0x333b3e60 (stale) Mirror 20: 0x4a3251c8 (stale) Mirror 21: 0xd3b8b0e1 (stale) Mirror 22: 0xfbc1fa93 (stale) Mirror 23: 0xfbc1fa93 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c125): Mirror 4: 0xc978bebd (stale) Mirror 7: 0xc978bebd (stale) Mirror 9: 0xc978bebd (stale) Mirror 12: 0xc978bebd (stale) Mirror 13: 0xc978bebd (stale) Mirror 18: 0xeee3f35 (stale) Mirror 19: 0x333b3e60 (stale) Mirror 20: 0x4a3251c8 (stale) Mirror 21: 0xd3b8b0e1 (stale) Mirror 22: 0xfbc1fa93 (stale) Mirror 23: 0xfbc1fa93 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c125: skipped 000933 1788852166.258546 trunc from 0x025881 to 0x02c124 (0x68a4 bytes) 000934 1788852166.266878 write 0x019a2a thru 0x01b22e (0x1805 bytes) 000935 1788852166.286092 fallocate 0x037eb9 thru 0x03ffff (0x8147 bytes) 000936 1788852166.294427 punch from 0x002d5e to 0x0111d1 (0xe474 bytes) 000937 1788852166.299448 mapwrite 0x010e33 thru 0x020ce6 (0xfeb4 bytes) 000938 1788852166.356904 MIRROR_SPLIT mirror 3 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2d32d4ea (stale) Mirror 7: 0x2d32d4ea (stale) Mirror 12: 0x2d32d4ea (stale) Mirror 13: 0x2d32d4ea (stale) Mirror 18: 0x9dcfc8c9 (stale) Mirror 19: 0x1de4be67 (stale) Mirror 20: 0x2531ab5f (stale) Mirror 21: 0x3bc97fe2 (stale) Mirror 22: 0x90ba13c0 (stale) Mirror 23: 0x46a560e4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2d32d4ea (stale) Mirror 7: 0x2d32d4ea (stale) Mirror 12: 0x2d32d4ea (stale) Mirror 13: 0x2d32d4ea (stale) Mirror 18: 0x9dcfc8c9 (stale) Mirror 19: 0x1de4be67 (stale) Mirror 20: 0x2531ab5f (stale) Mirror 21: 0x3bc97fe2 (stale) Mirror 22: 0x90ba13c0 (stale) Mirror 23: 0x46a560e4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000939 1788852167.089297 mapread 0x00fbc4 thru 0x017aa2 (0x7edf bytes) 000940 1788852167.123291 MIRROR_SPLIT mirror 4 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x53:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2d32d4ea (stale) Mirror 7: 0x2d32d4ea (stale) Mirror 12: 0x2d32d4ea (stale) Mirror 18: 0x9dcfc8c9 (stale) Mirror 19: 0x1de4be67 (stale) Mirror 20: 0x2531ab5f (stale) Mirror 21: 0x3bc97fe2 (stale) Mirror 22: 0x90ba13c0 (stale) Mirror 23: 0x46a560e4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2d32d4ea (stale) Mirror 7: 0x2d32d4ea (stale) Mirror 12: 0x2d32d4ea (stale) Mirror 18: 0x9dcfc8c9 (stale) Mirror 19: 0x1de4be67 (stale) Mirror 20: 0x2531ab5f (stale) Mirror 21: 0x3bc97fe2 (stale) Mirror 22: 0x90ba13c0 (stale) Mirror 23: 0x46a560e4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000941 1788852168.049868 fallocate 0x02acbf thru 0x033796 (0x8ad8 bytes) 000942 1788852168.055799 write 0x01b402 thru 0x01cc66 (0x1865 bytes) 000943 1788852168.083386 write 0x0357d2 thru 0x03e1af (0x89de bytes) 000944 1788852168.101695 read 0x03f73c thru 0x03ffff (0x8c4 bytes) 000945 1788852168.111761 mapread 0x03884e thru 0x03ffff (0x77b2 bytes) 000947 1788852168.115726 trunc from 0x0004a1 to 0x004fb9 (0x4b19 bytes) 000949 1788852168.123136 trunc from 0x040000 to 0x02a26b (0x15d94 bytes) 000950 1788852168.139715 trunc from 0x006d93 to 0x014f9d (0xe20b bytes) 000951 1788852168.146020 mapread 0x02635e thru 0x02a26b (0x3f0e bytes) 000952 1788852168.177986 read 0x01a260 thru 0x01b98c (0x172d bytes) 000953 1788852168.191905 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2a26c): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 12: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a26c): Mirror 4: 0x4a9b5969 (stale) Mirror 7: 0x4a9b5969 (stale) Mirror 12: 0x4a9b5969 (stale) Mirror 18: 0xfa565b51 (stale) Mirror 19: 0x4a9b5969 (stale) Mirror 20: 0x65de4eff (stale) Mirror 21: 0xea4a574e (stale) Mirror 22: 0x839a7eeb (stale) Mirror 23: 0x839a7eeb (stale) CRC-32 checksum value for chunk [0, 0x2a26c): Mirror 1: 0xc88f5534 Mirror 24: 0xc88f5534 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a26c: skipped 000954 1788852169.508155 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2a26c): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 12: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a26c): Mirror 4: 0x4a9b5969 (stale) Mirror 7: 0x4a9b5969 (stale) Mirror 12: 0x4a9b5969 (stale) Mirror 18: 0xfa565b51 (stale) Mirror 19: 0x4a9b5969 (stale) Mirror 20: 0x65de4eff (stale) Mirror 21: 0xea4a574e (stale) Mirror 22: 0x839a7eeb (stale) Mirror 23: 0x839a7eeb (stale) CRC-32 checksum value for chunk [0, 0x2a26c): Mirror 1: 0xc88f5534 Mirror 24: 0xc88f5534 Mirror 25: 0xc88f5534 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a26c: skipped 000955 1788852170.664016 mapwrite 0x021b6d thru 0x02bd1e (0xa1b2 bytes) 000956 1788852170.781098 mapread 0x001bba thru 0x006e59 (0x52a0 bytes) 000957 1788852170.799565 MIRROR_RESYNC 12 mirrors 000958 1788852172.820984 mapread 0x020030 thru 0x026e27 (0x6df8 bytes) 000959 1788852172.849907 write 0x01ada1 thru 0x02130a (0x656a bytes) 000960 1788852172.898177 write 0x038e88 thru 0x03ffff (0x7178 bytes) 000962 1788852172.904498 mapread 0x002bae thru 0x00e13d (0xb590 bytes) 000964 1788852172.929050 mapwrite 0x031c9c thru 0x03ffff (0xe364 bytes) 000965 1788852173.002689 fallocate 0x0107f7 thru 0x01166f (0xe79 bytes) 000966 1788852173.032615 MIRROR_RESYNC 12 mirrors 000967 1788852175.748290 read 0x0388da thru 0x03ffff (0x7726 bytes) 000968 1788852175.765371 trunc from 0x040000 to 0x011dbb (0x2e244 bytes) 000969 1788852175.807427 write 0x008ac7 thru 0x00ef4d (0x6487 bytes) 000970 1788852175.815755 punch from 0x006e0e to 0x009708 (0x28fb bytes) 000971 1788852175.831698 trunc from 0x00ae15 to 0x011dbb (0x6fa7 bytes) 000972 1788852175.836463 read 0x0087a3 thru 0x00a22a (0x1a88 bytes) 000973 1788852175.854374 trunc from 0x0019ac to 0x002003 (0x658 bytes) 000974 1788852175.859582 mapread 0x0012a1 thru 0x004dbc (0x3b1c bytes) 000976 1788852175.871268 punch from 0x00c742 to 0x011dbb (0x567a bytes) 000978 1788852175.882460 fallocate 0x02db4e thru 0x035f74 (0x8427 bytes) 000979 1788852175.898950 MIRROR_RESYNC 12 mirrors 000980 1788852178.876956 fallocate 0x0023fd thru 0x00f2bd (0xcec1 bytes) 000981 1788852178.964622 fallocate 0x030702 thru 0x03d86e (0xd16d bytes) 000982 1788852178.988127 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3d86f): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 12: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d86f): Mirror 4: 0x58a3c8bc (stale) Mirror 7: 0x58a3c8bc (stale) Mirror 12: 0x58a3c8bc (stale) Mirror 18: 0x58a3c8bc (stale) Mirror 19: 0x58a3c8bc (stale) Mirror 20: 0x58a3c8bc (stale) Mirror 21: 0x58a3c8bc (stale) Mirror 22: 0x58a3c8bc (stale) Mirror 23: 0x58a3c8bc (stale) Mirror 24: 0x58a3c8bc (stale) Mirror 25: 0x58a3c8bc (stale) CRC-32 checksum value for chunk [0, 0x3d86f): Mirror 1: 0x58a3c8bc Mirror 26: 0x58a3c8bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d86f: skipped 000983 1788852180.690352 fallocate 0x0191f9 thru 0x01b7fb (0x2603 bytes) 000986 1788852180.794588 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3d86f): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 12: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d86f): Mirror 4: 0x58a3c8bc (stale) Mirror 7: 0x58a3c8bc (stale) Mirror 12: 0x58a3c8bc (stale) Mirror 18: 0x58a3c8bc (stale) Mirror 19: 0x58a3c8bc (stale) Mirror 20: 0x58a3c8bc (stale) Mirror 21: 0x58a3c8bc (stale) Mirror 22: 0x58a3c8bc (stale) Mirror 23: 0x58a3c8bc (stale) Mirror 24: 0x58a3c8bc (stale) Mirror 25: 0x58a3c8bc (stale) Mirror 26: 0x58a3c8bc (stale) CRC-32 checksum value for chunk [0, 0x3d86f): Mirror 1: 0x58a3c8bc Mirror 27: 0x58a3c8bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d86f: skipped 000988 1788852182.852305 punch from 0x039f6a to 0x03d33a (0x33d1 bytes) 000989 1788852182.913696 punch from 0x031f43 to 0x03d86e (0xb92c bytes) 000990 1788852182.923460 write 0x038ef9 thru 0x03ffff (0x7107 bytes) 000991 1788852182.936198 mapread 0x024e77 thru 0x02a21f (0x53a9 bytes) 000992 1788852182.965840 mapread 0x02edc5 thru 0x035429 (0x6665 bytes) 000993 1788852182.986714 punch from 0x02fc68 to 0x035486 (0x581f bytes) 000994 1788852182.997132 trunc from 0x015b2c to 0x01dce7 (0x81bc bytes) 000995 1788852183.002452 trunc from 0x009c8b to 0x01298e (0x8d04 bytes) 000996 1788852183.009024 read 0x014c9e thru 0x01bd9e (0x7101 bytes) 000997 1788852183.015999 trunc from 0x040000 to 0x01571d (0x2a8e2 bytes) 000998 1788852183.045062 mapwrite 0x00ec9c thru 0x018b9d (0x9f02 bytes) 000999 1788852183.129057 trunc from 0x0131d1 to 0x018b9d (0x59cd bytes) 001000 1788852183.138389 mapwrite 0x00ee49 thru 0x01a8ae (0xba66 bytes) All operations completed A-OK!