== sanity-flr test 70a: flr mode fsx test ================ 16:24:36 (1784233476) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 3477 skipping zero length punch hole skipping zero size read truncating to largest ever: 0xddbc 000003 1784233478.019273 trunc from 00000000 to 0x00ddbb (0xddbc bytes) 000004 1784233478.036966 write 0x01259e thru 0x0176b9 (0x511c bytes) 000005 1784233478.038617 punch from 0x0104f3 to 0x0176b9 (0x71c7 bytes) 000006 1784233478.058851 mapwrite 0x02753f thru 0x0342f1 (0xcdb3 bytes) 000007 1784233478.113773 mapwrite 0x0054de thru 0x00e5b2 (0x90d5 bytes) 000008 1784233478.141169 punch from 0x00b8a5 to 0x00eb42 (0x329e bytes) truncating to largest ever: 0x3f601 000010 1784233478.147016 trunc from 0x0342f2 to 0x03f600 (0xb30f bytes) 000011 1784233478.167586 write 0x03d69d thru 0x03ffff (0x2963 bytes) 000012 1784233478.172678 mapwrite 0x024e83 thru 0x02a9d1 (0x5b4f bytes) 000013 1784233478.187246 mapread 0x03133c thru 0x03c8e3 (0xb5a8 bytes) 000014 1784233478.198661 mapread 0x028c64 thru 0x02d8d3 (0x4c70 bytes) 000015 1784233478.199743 trunc from 0x040000 to 0x00a522 (0x35add bytes) 000016 1784233478.224136 mapwrite 0x03ab3b thru 0x03caa5 (0x1f6b bytes) 000017 1784233478.266377 trunc from 0x03caa6 to 0x010f40 (0x2bb65 bytes) 000019 1784233478.279829 write 0x01b5b7 thru 0x027ebd (0xc907 bytes) 000020 1784233478.282211 read 0x02498b thru 0x027ebd (0x3533 bytes) 000021 1784233478.282871 mapread 0x009949 thru 0x00c37b (0x2a33 bytes) 000022 1784233478.289442 punch from 0x017bf9 to 0x025563 (0xd96b bytes) 000023 1784233478.298906 trunc from 0x027ebe to 0x02dbac (0x5cef bytes) 000024 1784233478.313002 MIRROR_EXTEND to 2 mirrors 000025 1784233478.784803 mapread 0x024083 thru 0x02dbac (0x9b2a bytes) 000026 1784233478.803736 read 0x01ebd7 thru 0x02a105 (0xb52f bytes) 000027 1784233478.810974 mapwrite 0x01418f thru 0x016d01 (0x2b73 bytes) 000028 1784233478.923193 mapread 0x00e50d thru 0x00e6d2 (0x1c6 bytes) 000029 1784233478.926811 mapwrite 0x021f02 thru 0x025619 (0x3718 bytes) 000030 1784233478.966760 mapwrite 0x032d76 thru 0x03ffff (0xd28a bytes) 000031 1784233479.058724 mapwrite 0x0114ad thru 0x01a072 (0x8bc6 bytes) 000032 1784233479.081924 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb981b5e2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x600dbc35 Mirror 3: 0x600dbc35 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000033 1784233479.830430 fallocate 0x02ece1 thru 0x032b44 (0x3e64 bytes) 000034 1784233479.859342 trunc from 0x040000 to 0x02e963 (0x1169c bytes) 000035 1784233479.902574 trunc from 0x02e964 to 0x035d95 (0x7432 bytes) 000036 1784233479.918202 MIRROR_RESYNC 3 mirrors 000037 1784233480.639588 mapread 0x012baf thru 0x022005 (0xf457 bytes) 000038 1784233480.665413 fallocate 0x0198cc thru 0x022788 (0x8ebd bytes) 000039 1784233480.716780 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x35d96): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35d96): Mirror 2: 0x815b3641 (stale) Mirror 3: 0x815b3641 (stale) CRC-32 checksum value for chunk [0, 0x35d96): Mirror 1: 0x815b3641 Mirror 4: 0x815b3641 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35d96: skipped 000040 1784233481.346715 trunc from 0x008ef0 to 0x013e25 (0xaf36 bytes) 000041 1784233481.371413 mapwrite 0x027607 thru 0x036b6a (0xf564 bytes) 000042 1784233481.436135 fallocate 0x01f966 thru 0x02851a (0x8bb5 bytes) 000043 1784233481.449849 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x36b6b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36b6b): Mirror 2: 0x41483c7f (stale) Mirror 3: 0x41483c7f (stale) Mirror 4: 0x41483c7f (stale) CRC-32 checksum value for chunk [0, 0x36b6b): Mirror 1: 0x2e3e9a90 Mirror 5: 0x2e3e9a90 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36b6b: skipped 000044 1784233482.190968 trunc from 0x036b6b to 0x0168ff (0x2026b bytes) 000045 1784233482.239963 mapwrite 0x017a81 thru 0x0251e6 (0xd766 bytes) 000046 1784233482.293850 MIRROR_RESYNC 5 mirrors 000047 1784233483.202879 trunc from 0x0251e7 to 0x005cd8 (0x1f50e bytes) 000048 1784233483.265086 MIRROR_RESYNC 5 mirrors 000049 1784233484.040657 mapwrite 0x03b354 thru 0x03ffff (0x4cac bytes) 000051 1784233484.133375 trunc from 0x032208 to 0x0386ef (0x64e8 bytes) 000054 1784233484.139959 mapwrite 0x0240e9 thru 0x025ab8 (0x19d0 bytes) 000055 1784233484.163885 read 0x01a2cf thru 0x027ffc (0xdd2e bytes) 000056 1784233484.171795 read 0x02829e thru 0x0314e1 (0x9244 bytes) 000057 1784233484.185956 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1d480e7f (stale) Mirror 4: 0x1d480e7f (stale) Mirror 5: 0x1d480e7f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1d480e7f (stale) Mirror 4: 0x1d480e7f (stale) Mirror 5: 0x1d480e7f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000058 1784233484.487819 trunc from 0x040000 to 0x0282b2 (0x17d4d bytes) 000059 1784233484.511652 read 0x0192e8 thru 0x01b21a (0x1f33 bytes) 000060 1784233484.517795 fallocate 0x0249b6 thru 0x031ad3 (0xd11e bytes) 000061 1784233484.525495 trunc from 0x0282b3 to 0x000983 (0x2792f bytes) 000062 1784233484.539117 trunc from 0x000984 to 0x03cb7c (0x3c1f9 bytes) 000063 1784233484.561927 mapread 0x0093ca thru 0x0180dc (0xed13 bytes) 000064 1784233484.597731 trunc from 0x0339a2 to 0x03424b (0x8aa bytes) 000065 1784233484.605482 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3cb7d): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cb7d): Mirror 3: 0x2650d8a2 (stale) Mirror 4: 0x2650d8a2 (stale) Mirror 5: 0x2650d8a2 (stale) CRC-32 checksum value for chunk [0, 0x3cb7d): Mirror 1: 0x9b5836df Mirror 6: 0x9b5836df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cb7d: skipped 000066 1784233485.160982 fallocate 0x01d0b8 thru 0x02920a (0xc153 bytes) 000067 1784233485.201490 trunc from 0x03a204 to 0x03cb7c (0x2979 bytes) 000068 1784233485.207186 write 0x028ac2 thru 0x02d317 (0x4856 bytes) 000069 1784233485.230060 read 0x00b193 thru 0x014398 (0x9206 bytes) 000070 1784233485.248079 fallocate 0x008cde thru 0x014407 (0xb72a bytes) 000071 1784233485.258357 read 0x020932 thru 0x0240c6 (0x3795 bytes) 000072 1784233485.275589 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cb7d): Mirror 3: 0x2650d8a2 (stale) Mirror 4: 0x2650d8a2 (stale) Mirror 6: 0x9b5836df (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cb7d): Mirror 3: 0x2650d8a2 (stale) Mirror 4: 0x2650d8a2 (stale) Mirror 6: 0x9b5836df (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cb7d: skipped 000073 1784233485.537194 punch from 0x00681e to 0x0089b2 (0x2195 bytes) 000074 1784233485.541686 mapwrite 0x028244 thru 0x0323f8 (0xa1b5 bytes) 000075 1784233485.588237 mapwrite 0x0184b1 thru 0x024d00 (0xc850 bytes) 000076 1784233485.631425 write 0x008b28 thru 0x00fc04 (0x70dd bytes) 000077 1784233485.645237 mapwrite 0x036bc0 thru 0x03ffff (0x9440 bytes) 000078 1784233485.745413 write 0x00722d thru 0x00c5e6 (0x53ba bytes) 000079 1784233485.752153 trunc from 0x008ecb to 0x0150ad (0xc1e3 bytes) 000080 1784233485.767850 MIRROR_RESYNC 4 mirrors 000081 1784233486.739733 trunc from 0x040000 to 0x0022e5 (0x3dd1a bytes) 000082 1784233486.779237 mapread 0x001342 thru 0x0022e5 (0xfa4 bytes) 000083 1784233486.793707 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22e6): Mirror 4: 0x5344c5c5 (stale) Mirror 6: 0x5344c5c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22e6): Mirror 4: 0x5344c5c5 (stale) Mirror 6: 0x5344c5c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22e6: skipped 000084 1784233487.085076 mapwrite 0x0045e8 thru 0x012033 (0xda4c bytes) 000085 1784233487.174712 mapwrite 0x016923 thru 0x023b60 (0xd23e bytes) 000086 1784233487.257579 fallocate 0x02fd19 thru 0x037486 (0x776e bytes) 000087 1784233487.269940 MIRROR_RESYNC 3 mirrors 000088 1784233488.057890 mapwrite 0x01b6a2 thru 0x025188 (0x9ae7 bytes) 000089 1784233488.205464 mapread 0x0109bc thru 0x0160e8 (0x572d bytes) 000090 1784233488.217444 mapwrite 0x02d737 thru 0x03a3e4 (0xccae bytes) 000091 1784233488.306037 read 0x00158e thru 0x0093cc (0x7e3f bytes) 000092 1784233488.325961 mapwrite 0x0093b5 thru 0x013294 (0x9ee0 bytes) 000093 1784233488.361689 write 0x0068b6 thru 0x009df5 (0x3540 bytes) 000095 1784233488.363474 write 0x00df67 thru 0x01148b (0x3525 bytes) 000096 1784233488.371239 write 0x011c0e thru 0x01604a (0x443d bytes) 000097 1784233488.379972 fallocate 0x02572e thru 0x029da6 (0x4679 bytes) 000098 1784233488.388226 fallocate 0x031d8a thru 0x039ba2 (0x7e19 bytes) 000099 1784233488.398008 trunc from 0x00bf44 to 0x00deb0 (0x1f6d bytes) 000100 1784233488.412848 punch from 0x01550f to 0x0193d1 (0x3ec3 bytes) 000101 1784233488.418021 write 0x02d7b7 thru 0x033a76 (0x62c0 bytes) 000104 1784233488.421841 trunc from 0x038821 to 0x03a3e4 (0x1bc4 bytes) 000106 1784233488.428544 trunc from 0x01790e to 0x026f99 (0xf68c bytes) 000107 1784233488.438527 MIRROR_RESYNC 3 mirrors 000108 1784233489.160185 trunc from 0x03a3e5 to 0x0306ca (0x9d1a bytes) 000109 1784233489.203847 write 0x02c961 thru 0x0392c3 (0xc963 bytes) 000110 1784233489.209601 write 0x034cbe thru 0x03a320 (0x5663 bytes) 000111 1784233489.210825 punch from 0x005073 to 0x00cac2 (0x7a50 bytes) 000112 1784233489.214187 write 0x01573e thru 0x0235b3 (0xde76 bytes) 000113 1784233489.222046 mapwrite 0x03ab2e thru 0x03ffff (0x54d2 bytes) 000115 1784233489.260788 read 0x0231b4 thru 0x02e1e0 (0xb02d bytes) 000116 1784233489.267390 mapwrite 0x01dcda thru 0x027f51 (0xa278 bytes) 000118 1784233489.284152 mapread 0x02831f thru 0x02de78 (0x5b5a bytes) 000119 1784233489.285219 fallocate 0x00b92a thru 0x011636 (0x5d0d bytes) 000120 1784233489.298829 punch from 0x00bbdf to 0x00e1b9 (0x25db bytes) 000122 1784233489.305843 punch from 0x02a718 to 0x0373dd (0xccc6 bytes) 000123 1784233489.310147 mapread 0x03b404 thru 0x03c32e (0xf2b bytes) 000125 1784233489.313649 read 0x0385e2 thru 0x03d867 (0x5286 bytes) 000126 1784233489.314259 mapwrite 0x001ea1 thru 0x00e6ce (0xc82e bytes) 000127 1784233489.347981 mapwrite 0x001950 thru 0x00a068 (0x8719 bytes) 000128 1784233489.362874 write 0x000107 thru 0x00f66d (0xf567 bytes) 000129 1784233489.364998 write 0x00ae9f thru 0x0136ee (0x8850 bytes) 000130 1784233489.370446 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x2d854617 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x2d854617 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped fallocating to largest ever: 0x40000 000131 1784233489.670460 fallocate 0x033086 thru 0x03ffff (0xcf7a bytes) 000132 1784233489.689177 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000133 1784233489.803258 fallocate 0x007922 thru 0x008583 (0xc62 bytes) 000134 1784233489.807629 mapwrite 0x002db8 thru 0x003f43 (0x118c bytes) 000135 1784233489.827975 write 0x025312 thru 0x028de6 (0x3ad5 bytes) 000136 1784233489.842350 read 0x030d69 thru 0x039e4d (0x90e5 bytes) 000137 1784233489.852005 punch from 0x019385 to 0x01b4ae (0x212a bytes) 000138 1784233489.856856 fallocate 0x00a3b1 thru 0x00d123 (0x2d73 bytes) 000139 1784233489.862554 fallocate 0x00c7a9 thru 0x01873b (0xbf93 bytes) 000140 1784233489.866957 punch from 0x00dc50 to 0x010f45 (0x32f6 bytes) 000141 1784233489.872812 write 0x03a878 thru 0x03cf4c (0x26d5 bytes) 000142 1784233489.885987 read 0x0349eb thru 0x03ffff (0xb615 bytes) 000143 1784233489.901890 write 0x03ee8f thru 0x03ffff (0x1171 bytes) 000145 1784233489.903991 trunc from 0x024911 to 0x033485 (0xeb75 bytes) 000147 1784233489.917230 read 0x0162a6 thru 0x01f335 (0x9090 bytes) 000148 1784233489.918822 mapwrite 0x0168c1 thru 0x0247c8 (0xdf08 bytes) 000149 1784233489.959736 fallocate 0x0003a1 thru 0x00bff5 (0xbc55 bytes) 000151 1784233489.969227 trunc from 0x040000 to 0x009a2d (0x365d2 bytes) 000152 1784233489.985693 trunc from 0x005123 to 0x009a2d (0x490b bytes) 000153 1784233489.989999 trunc from 0x009a2e to 0x029815 (0x1fde8 bytes) 000154 1784233490.002567 punch from 0x028161 to 0x029815 (0x16b5 bytes) 000155 1784233490.010660 fallocate 0x02363e thru 0x0253ff (0x1dc2 bytes) 000157 1784233490.016090 fallocate 0x031ce2 thru 0x03b315 (0x9634 bytes) 000162 1784233490.023930 read 0x021f55 thru 0x02852a (0x65d6 bytes) 000163 1784233490.031439 trunc from 0x002bdc to 0x00d343 (0xa768 bytes) 000164 1784233490.038973 trunc from 0x029816 to 0x026d7c (0x2a99 bytes) 000165 1784233490.053884 read 0x004af7 thru 0x00f6f4 (0xabfe bytes) 000166 1784233490.060866 mapwrite 0x00ec60 thru 0x01a0c7 (0xb468 bytes) 000167 1784233490.084423 trunc from 0x002e67 to 0x00ef36 (0xc0d0 bytes) 000169 1784233490.092747 mapread 0x021adb thru 0x026d7c (0x52a2 bytes) 000170 1784233490.101763 MIRROR_EXTEND to 2 mirrors 000171 1784233490.550968 fallocate 0x017791 thru 0x023c78 (0xc4e8 bytes) 000172 1784233490.583895 write 0x028967 thru 0x036dfc (0xe496 bytes) 000173 1784233490.590703 mapread 0x0366ab thru 0x036dfc (0x752 bytes) 000174 1784233490.592639 trunc from 0x019ca8 to 0x029230 (0xf589 bytes) 000175 1784233490.610338 trunc from 0x03070a to 0x036dfc (0x66f3 bytes) 000176 1784233490.615716 mapwrite 0x01f553 thru 0x027f74 (0x8a22 bytes) 000177 1784233490.666011 write 0x03aa07 thru 0x03ffff (0x55f9 bytes) 000178 1784233490.667323 trunc from 0x02bd8b to 0x033e09 (0x807f bytes) 000179 1784233490.673383 trunc from 0x040000 to 0x023867 (0x1c798 bytes) 000181 1784233490.740489 trunc from 0x023868 to 0x02100c (0x285b bytes) 000182 1784233490.773863 fallocate 0x03de61 thru 0x03ffff (0x219f bytes) 000183 1784233490.784907 trunc from 0x00a86c to 0x00dc8d (0x3422 bytes) 000184 1784233490.801112 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2100d): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2100d): Mirror 2: 0x8a24f24d (stale) CRC-32 checksum value for chunk [0, 0x2100d): Mirror 1: 0xf506cd43 Mirror 3: 0xf506cd43 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2100d: skipped 000185 1784233491.582750 fallocate 0x03e746 thru 0x03ffff (0x18ba bytes) 000186 1784233491.634154 trunc from 0x040000 to 0x021ea9 (0x1e156 bytes) 000187 1784233491.660945 write 0x037a25 thru 0x03ffff (0x85db bytes) 000188 1784233491.663723 punch from 0x025d41 to 0x02d70b (0x79cb bytes) 000189 1784233491.667240 fallocate 0x01e343 thru 0x02ae1a (0xcad8 bytes) 000191 1784233491.671185 mapread 0x030a11 thru 0x03d549 (0xcb39 bytes) 000192 1784233491.688477 MIRROR_RESYNC 3 mirrors 000193 1784233492.398670 read 0x0385df thru 0x039c86 (0x16a8 bytes) 000194 1784233492.402725 mapread 0x01c0ad thru 0x0228a7 (0x67fb bytes) 000196 1784233492.420458 MIRROR_RESYNC 3 mirrors 000197 1784233492.758840 mapwrite 0x0325cc thru 0x03639e (0x3dd3 bytes) 000198 1784233492.833772 write 0x03c27b thru 0x03ffff (0x3d85 bytes) 000199 1784233492.838801 mapread 0x02d6da thru 0x032f06 (0x582d bytes) 000200 1784233492.840667 trunc from 0x032e66 to 0x03ffff (0xd19a bytes) 000201 1784233492.861020 mapread 0x023b41 thru 0x02c9ac (0x8e6c bytes) 000202 1784233492.873216 mapwrite 0x02e4a4 thru 0x03c175 (0xdcd2 bytes) 000203 1784233492.916873 trunc from 0x040000 to 0x01c777 (0x23888 bytes) 000204 1784233492.961012 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1c778): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c778): Mirror 2: 0x7c583410 (stale) Mirror 3: 0x7c583410 (stale) CRC-32 checksum value for chunk [0, 0x1c778): Mirror 1: 0x7c583410 Mirror 4: 0x7c583410 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c778: skipped 000205 1784233493.533787 punch from 0x0065c6 to 0x0101c3 (0x9bfe bytes) 000206 1784233493.563888 read 0x0186db thru 0x01c777 (0x409d bytes) 000207 1784233493.569433 trunc from 0x0187a3 to 0x01c777 (0x3fd5 bytes) 000208 1784233493.574102 punch from 0x007efa to 0x0123e0 (0xa4e7 bytes) 000209 1784233493.579723 trunc from 0x007b28 to 0x009abf (0x1f98 bytes) 000210 1784233493.585420 trunc from 0x0042b3 to 0x00fe65 (0xbbb3 bytes) 000212 1784233493.590541 fallocate 0x035956 thru 0x037bfe (0x22a9 bytes) 000213 1784233493.594423 punch from 0x002f5f to 0x0099f2 (0x6a94 bytes) 000214 1784233493.598545 trunc from 0x0024a0 to 0x002f30 (0xa91 bytes) 000215 1784233493.603433 punch from 0x0118dd to 0x016971 (0x5095 bytes) 000216 1784233493.608495 trunc from 0x01c778 to 0x02cf45 (0x107ce bytes) 000218 1784233493.624952 read 0x00dade thru 0x00df71 (0x494 bytes) 000219 1784233493.634830 fallocate 0x03470f thru 0x03566d (0xf5f bytes) 000221 1784233493.639915 write 0x005ee3 thru 0x00fb37 (0x9c55 bytes) 000222 1784233493.641822 mapwrite 0x00918c thru 0x00bdcb (0x2c40 bytes) 000224 1784233493.660557 MIRROR_RESYNC 4 mirrors 000225 1784233494.414198 MIRROR_EXTEND to 5 mirrors 000226 1784233494.973253 read 0x00c480 thru 0x0173cf (0xaf50 bytes) 000227 1784233494.978802 write 0x011cef thru 0x015587 (0x3899 bytes) 000228 1784233495.011155 mapread 0x022366 thru 0x02cf45 (0xabe0 bytes) 000229 1784233495.022401 punch from 0x02152f to 0x02b0dd (0x9baf bytes) 000230 1784233495.026132 write 0x02c8a5 thru 0x02dfdd (0x1739 bytes) 000231 1784233495.027140 read 0x024cea thru 0x02797f (0x2c96 bytes) 000233 1784233495.038504 fallocate 0x0103da thru 0x014400 (0x4027 bytes) 000234 1784233495.041480 punch from 0x0226de to 0x02dfdd (0xb900 bytes) 000235 1784233495.061073 write 0x002227 thru 0x00a842 (0x861c bytes) 000238 1784233495.066981 fallocate 0x014a48 thru 0x0214e5 (0xca9e bytes) 000239 1784233495.076875 trunc from 0x02dfde to 0x018365 (0x15c78 bytes) 000240 1784233495.097115 mapread 0x00019b thru 0x002236 (0x209c bytes) 000241 1784233495.098414 punch from 0x014da9 to 0x018365 (0x35bd bytes) 000242 1784233495.102736 read 0x0044d7 thru 0x0141d6 (0xfd00 bytes) 000243 1784233495.111354 mapread 0x000c5d thru 0x009a1b (0x8dbf bytes) 000244 1784233495.114416 trunc from 0x00fc59 to 0x013c29 (0x3fd1 bytes) 000246 1784233495.122847 MIRROR_RESYNC 5 mirrors 000247 1784233495.881987 MIRROR_RESYNC 5 mirrors 000248 1784233496.236391 mapwrite 0x02e932 thru 0x031d88 (0x3457 bytes) 000249 1784233496.303449 mapread 0x01e751 thru 0x022cd1 (0x4581 bytes) 000250 1784233496.314058 trunc from 0x031d89 to 0x025d86 (0xc002 bytes) 000251 1784233496.335820 punch from 0x003fe6 to 0x008fb2 (0x4fcd bytes) 000252 1784233496.343175 fallocate 0x031a40 thru 0x03caf0 (0xb0b1 bytes) 000253 1784233496.347873 mapwrite 0x03c083 thru 0x03ffff (0x3f7d bytes) 000254 1784233496.388019 read 0x00fed2 thru 0x010296 (0x3c5 bytes) 000255 1784233496.417651 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd561cf53 (stale) Mirror 4: 0xd561cf53 (stale) Mirror 5: 0xd561cf53 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd561cf53 (stale) Mirror 4: 0xd561cf53 (stale) Mirror 5: 0xd561cf53 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000256 1784233496.716930 trunc from 0x040000 to 0x02c2f6 (0x13d09 bytes) 000257 1784233496.732073 mapwrite 0x0291d1 thru 0x02acc5 (0x1af5 bytes) 000258 1784233496.761029 trunc from 0x02c2f7 to 0x034732 (0x843c bytes) 000259 1784233496.779287 mapwrite 0x039f45 thru 0x03ffff (0x60bb bytes) 000260 1784233496.822100 mapwrite 0x031e6a thru 0x037844 (0x59db bytes) 000261 1784233496.847551 punch from 0x00c953 to 0x014c53 (0x8301 bytes) 000262 1784233496.867862 MIRROR_RESYNC 4 mirrors 000263 1784233498.071979 trunc from 0x02b8ec to 0x035c71 (0xa386 bytes) 000264 1784233498.090871 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9293a957 (stale) Mirror 5: 0x9293a957 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9293a957 (stale) Mirror 5: 0x9293a957 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000265 1784233498.417380 trunc from 0x040000 to 0x00b8c7 (0x34738 bytes) 000266 1784233498.435428 write 0x03a8d7 thru 0x03ffff (0x5729 bytes) 000267 1784233498.437230 trunc from 0x040000 to 0x029974 (0x1668b bytes) 000268 1784233498.451839 punch from 0x01756a to 0x01d98f (0x6426 bytes) 000270 1784233498.455231 mapwrite 0x03905c thru 0x03ef05 (0x5eaa bytes) 000272 1784233498.488564 write 0x00a608 thru 0x0166fa (0xc0f3 bytes) 000273 1784233498.499735 write 0x0103fa thru 0x018165 (0x7d6c bytes) 000274 1784233498.504735 read 0x03ba08 thru 0x03ef05 (0x34fe bytes) 000275 1784233498.505862 write 0x030ba2 thru 0x031ef8 (0x1357 bytes) 000276 1784233498.516719 read 0x000947 thru 0x00617a (0x5834 bytes) 000277 1784233498.526114 trunc from 0x03ef06 to 0x00cd79 (0x3218c bytes) 000278 1784233498.550071 trunc from 0x001a6c to 0x006002 (0x4597 bytes) 000279 1784233498.555233 trunc from 0x00cd7a to 0x0383c0 (0x2b647 bytes) 000280 1784233498.572778 mapread 0x013b21 thru 0x01b057 (0x7537 bytes) 000281 1784233498.614932 MIRROR_RESYNC 3 mirrors 000282 1784233499.093865 mapread 0x0115af thru 0x018d5f (0x77b1 bytes) 000283 1784233499.113097 fallocate 0x0119c2 thru 0x013ae3 (0x2122 bytes) 000284 1784233499.150681 fallocate 0x034e59 thru 0x03de5a (0x9002 bytes) 000285 1784233499.168496 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3de5b): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de5b): Mirror 4: 0x64105c14 (stale) Mirror 5: 0x64105c14 (stale) CRC-32 checksum value for chunk [0, 0x3de5b): Mirror 1: 0x64105c14 Mirror 6: 0x64105c14 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de5b: skipped 000286 1784233499.792960 trunc from 0x0059b8 to 0x008f80 (0x35c9 bytes) 000287 1784233499.824485 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3de5b): Mirror 5: 0x64105c14 (stale) Mirror 6: 0x64105c14 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de5b): Mirror 5: 0x64105c14 (stale) Mirror 6: 0x64105c14 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de5b: skipped 000289 1784233500.043494 trunc from 0x03c2aa to 0x03de5a (0x1bb1 bytes) 000291 1784233500.049331 write 0x00f653 thru 0x01c7be (0xd16c bytes) 000292 1784233500.070240 fallocate 0x031f40 thru 0x03d260 (0xb321 bytes) 000293 1784233500.074273 trunc from 0x03de5b to 0x03a59a (0x38c0 bytes) 000296 1784233500.107518 write 0x0099cf thru 0x014474 (0xaaa6 bytes) 000297 1784233500.113265 read 0x0229e8 thru 0x02d719 (0xad32 bytes) 000298 1784233500.122054 trunc from 0x01b437 to 0x02af31 (0xfafb bytes) 000299 1784233500.132625 mapwrite 0x00c652 thru 0x012076 (0x5a25 bytes) 000300 1784233500.150914 read 0x020675 thru 0x028f4a (0x88d6 bytes) 000301 1784233500.168068 read 0x02ed29 thru 0x0331ab (0x4483 bytes) 000302 1784233500.169076 fallocate 0x008262 thru 0x00b364 (0x3103 bytes) 000303 1784233500.176108 trunc from 0x03a59b to 0x02b817 (0xed83 bytes) 000304 1784233500.194700 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b818): Mirror 6: 0x208edeb2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b818): Mirror 6: 0x208edeb2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b818: skipped 000305 1784233500.375523 mapwrite 0x029540 thru 0x034ecc (0xb98d bytes) 000306 1784233500.439528 trunc from 0x034ecd to 0x01d247 (0x17c85 bytes) 000307 1784233500.450869 mapread 0x00563a thru 0x00cfa0 (0x7967 bytes) 000308 1784233500.458899 punch from 0x008d34 to 0x00a7f7 (0x1ac4 bytes) 000310 1784233500.462646 mapwrite 0x00e6bc thru 0x01d4a5 (0xedea bytes) 000311 1784233500.509850 fallocate 0x02e463 thru 0x035f70 (0x7b0e bytes) 000312 1784233500.514343 read 0x015be8 thru 0x018070 (0x2489 bytes) 000313 1784233500.515259 write 0x0257f2 thru 0x029a18 (0x4227 bytes) 000314 1784233500.516648 read 0x01e865 thru 0x029a18 (0xb1b4 bytes) 000315 1784233500.524022 mapwrite 0x00b88a thru 0x01a8ef (0xf066 bytes) 000316 1784233500.539836 read 0x0261e2 thru 0x029a18 (0x3837 bytes) 000317 1784233500.540485 punch from 0x018d7e to 0x021198 (0x841b bytes) 000319 1784233500.544467 mapread 0x02419d thru 0x029a18 (0x587c bytes) 000320 1784233500.545263 mapread 0x007d21 thru 0x014046 (0xc326 bytes) 000321 1784233500.546197 mapread 0x00bc1f thru 0x01abad (0xef8f bytes) 000322 1784233500.552585 punch from 0x007af0 to 0x00bfbc (0x44cd bytes) 000323 1784233500.555883 trunc from 0x029a19 to 0x006f61 (0x22ab7 bytes) 000324 1784233500.568383 mapread 0x0006f4 thru 0x006f61 (0x686e bytes) 000325 1784233500.572989 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x6f62): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6f62): Mirror 6: 0xc6c9fa92 (stale) CRC-32 checksum value for chunk [0, 0x6f62): Mirror 1: 0xc6c9fa92 Mirror 7: 0xc6c9fa92 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6f62: skipped 000327 1784233501.089996 trunc from 0x006f62 to 0x03e224 (0x372c3 bytes) 000328 1784233501.131286 mapread 0x01e284 thru 0x02d2b3 (0xf030 bytes) 000329 1784233501.155678 fallocate 0x015b58 thru 0x01661f (0xac8 bytes) 000330 1784233501.160059 write 0x028918 thru 0x029f92 (0x167b bytes) 000331 1784233501.160859 mapread 0x01f22c thru 0x02c4c8 (0xd29d bytes) 000332 1784233501.161764 read 0x003886 thru 0x00d67a (0x9df5 bytes) 000333 1784233501.169631 mapread 0x01842d thru 0x01876f (0x343 bytes) 000334 1784233501.181000 trunc from 0x01fd26 to 0x026e49 (0x7124 bytes) 000335 1784233501.188211 write 0x013fec thru 0x01f7c4 (0xb7d9 bytes) 000336 1784233501.192011 read 0x015478 thru 0x0186d1 (0x325a bytes) 000337 1784233501.193090 read 0x02cca6 thru 0x033c49 (0x6fa4 bytes) 000339 1784233501.204404 trunc from 0x01b6fa to 0x0288d7 (0xd1de bytes) 000340 1784233501.223574 mapwrite 0x019c04 thru 0x01fca9 (0x60a6 bytes) 000341 1784233501.272091 mapwrite 0x00a225 thru 0x01a10a (0xfee6 bytes) 000342 1784233501.295084 mapread 0x00ab49 thru 0x011b44 (0x6ffc bytes) 000343 1784233501.296166 punch from 0x028f37 to 0x037381 (0xe44b bytes) 000344 1784233501.304218 write 0x030556 thru 0x03c8ab (0xc356 bytes) 000345 1784233501.308373 mapread 0x012e1d thru 0x018abf (0x5ca3 bytes) 000346 1784233501.309557 mapwrite 0x00994d thru 0x00cae9 (0x319d bytes) 000347 1784233501.322979 punch from 0x010615 to 0x01ee81 (0xe86d bytes) 000348 1784233501.326506 fallocate 0x01d1dc thru 0x01e934 (0x1759 bytes) 000349 1784233501.329837 punch from 0x00ffba to 0x01651b (0x6562 bytes) 000350 1784233501.341359 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e225): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e225): Mirror 6: 0xd5d0a768 (stale) Mirror 7: 0xf0eea4a3 (stale) CRC-32 checksum value for chunk [0, 0x3e225): Mirror 1: 0x98bb4c03 Mirror 8: 0x98bb4c03 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e225: skipped 000351 1784233501.923925 trunc from 0x018957 to 0x020da5 (0x844f bytes) 000352 1784233501.966441 trunc from 0x007ec1 to 0x0107e4 (0x8924 bytes) 000353 1784233501.977678 read 0x03a922 thru 0x03e224 (0x3903 bytes) 000354 1784233501.985508 write 0x032941 thru 0x038841 (0x5f01 bytes) 000355 1784233501.995436 write 0x03c8f4 thru 0x03df3f (0x164c bytes) 000356 1784233501.996389 punch from 0x014366 to 0x016ec3 (0x2b5e bytes) 000358 1784233502.006494 mapwrite 0x030e8e thru 0x03c5b7 (0xb72a bytes) 000359 1784233502.047214 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e225): Mirror 6: 0xd5d0a768 (stale) Mirror 7: 0xf0eea4a3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e225): Mirror 6: 0xd5d0a768 (stale) Mirror 7: 0xf0eea4a3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e225: skipped 000360 1784233502.278085 mapread 0x01a817 thru 0x021256 (0x6a40 bytes) 000361 1784233502.297287 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e225): Mirror 6: 0xd5d0a768 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e225): Mirror 6: 0xd5d0a768 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e225: skipped 000363 1784233502.454452 punch from 0x00a110 to 0x018d17 (0xec08 bytes) 000364 1784233502.457266 mapread 0x036b14 thru 0x03e224 (0x7711 bytes) 000365 1784233502.473280 punch from 0x034cc7 to 0x03e224 (0x955e bytes) 000366 1784233502.476470 trunc from 0x03e225 to 0x00c674 (0x31bb0 bytes) 000367 1784233502.497367 trunc from 0x00a909 to 0x00c674 (0x1d6c bytes) 000368 1784233502.500388 mapread 0x00bfdb thru 0x00c674 (0x69a bytes) 000369 1784233502.504928 write 0x037418 thru 0x03ae0f (0x39f8 bytes) 000370 1784233502.505869 trunc from 0x03ae10 to 0x01a2e8 (0x20b27 bytes) 000371 1784233502.513559 punch from 0x013b1a to 0x01a2e8 (0x67cf bytes) 000372 1784233502.515974 fallocate 0x0051fc thru 0x00d138 (0x7f3d bytes) 000373 1784233502.518574 read 0x0018da thru 0x004935 (0x305c bytes) 000374 1784233502.521402 punch from 0x00200e to 0x00ae76 (0x8e69 bytes) 000375 1784233502.524506 punch from 0x00ed51 to 0x016a40 (0x7cf0 bytes) 000376 1784233502.527009 read 0x001ce8 thru 0x0086ef (0x6a08 bytes) 000377 1784233502.532663 trunc from 0x01a2e9 to 0x008551 (0x11d97 bytes) 000378 1784233502.539538 trunc from 0x008552 to 0x02c667 (0x24116 bytes) 000379 1784233502.547066 trunc from 0x02c668 to 0x0157c6 (0x16ea1 bytes) 000380 1784233502.556529 punch from 0x01272f to 0x0157c6 (0x3098 bytes) 000381 1784233502.559709 read 0x00c16a thru 0x014848 (0x86df bytes) 000382 1784233502.566609 trunc from 0x014ec1 to 0x0157c6 (0x906 bytes) 000384 1784233502.571679 read 0x0064b0 thru 0x00f915 (0x9466 bytes) 000385 1784233502.572370 trunc from 0x00a9e1 to 0x01120c (0x682c bytes) 000386 1784233502.576094 punch from 0x000b8a to 0x00fdb8 (0xf22f bytes) 000387 1784233502.580925 punch from 0x009b35 to 0x010730 (0x6bfc bytes) 000388 1784233502.585385 punch from 0x002d37 to 0x012650 (0xf91a bytes) 000389 1784233502.589286 fallocate 0x0290c0 thru 0x029f5c (0xe9d bytes) 000390 1784233502.594323 fallocate 0x005e3a thru 0x010220 (0xa3e7 bytes) 000391 1784233502.597966 mapread 0x00cfb2 thru 0x0157c6 (0x8815 bytes) 000393 1784233502.609567 fallocate 0x006b93 thru 0x00e25b (0x76c9 bytes) 000394 1784233502.614968 write 0x002a7c thru 0x011cc4 (0xf249 bytes) 000395 1784233502.616817 read 0x00e725 thru 0x0157c6 (0x70a2 bytes) 000396 1784233502.617806 punch from 0x00afe0 to 0x0157c6 (0xa7e7 bytes) 000397 1784233502.634916 read 0x0052ae thru 0x00fa50 (0xa7a3 bytes) 000398 1784233502.646823 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000399 1784233502.717164 write 0x03923e thru 0x03f8bc (0x667f bytes) 000400 1784233502.721275 mapwrite 0x00c53a thru 0x012199 (0x5c60 bytes) 000402 1784233502.769268 read 0x03c1e4 thru 0x03f8bc (0x36d9 bytes) 000405 1784233502.772633 write 0x0138d8 thru 0x0190f4 (0x581d bytes) 000406 1784233502.778059 punch from 0x02966f to 0x02b59b (0x1f2d bytes) 000407 1784233502.788739 write 0x012aca thru 0x017ec0 (0x53f7 bytes) 000408 1784233502.789902 write 0x01197b thru 0x01e742 (0xcdc8 bytes) 000409 1784233502.796085 trunc from 0x00552f to 0x007036 (0x1b08 bytes) 000410 1784233502.815305 punch from 0x013ca7 to 0x019811 (0x5b6b bytes) 000411 1784233502.828116 read 0x01c7cb thru 0x024abd (0x82f3 bytes) 000412 1784233502.841595 fallocate 0x004632 thru 0x00d40f (0x8dde bytes) 000414 1784233502.855027 write 0x02a5c3 thru 0x039e79 (0xf8b7 bytes) 000415 1784233502.856826 fallocate 0x018885 thru 0x01dd55 (0x54d1 bytes) 000416 1784233502.863741 mapwrite 0x010193 thru 0x0197ad (0x961b bytes) 000417 1784233502.898839 trunc from 0x009330 to 0x00a76a (0x143b bytes) 000418 1784233502.915548 MIRROR_EXTEND to 2 mirrors 000419 1784233503.527594 read 0x00be67 thru 0x01ae32 (0xefcc bytes) 000420 1784233503.541537 read 0x006448 thru 0x015f8f (0xfb48 bytes) 000422 1784233503.563674 read 0x002c13 thru 0x007534 (0x4922 bytes) 000423 1784233503.569246 mapread 0x01c044 thru 0x0202e6 (0x42a3 bytes) 000424 1784233503.580178 mapread 0x007d8e thru 0x008f03 (0x1176 bytes) 000425 1784233503.590976 trunc from 0x03f8bd to 0x01cfc6 (0x228f6 bytes) 000426 1784233503.637158 mapread 0x01bc55 thru 0x01cfc6 (0x1372 bytes) 000427 1784233503.647835 read 0x003216 thru 0x005716 (0x2501 bytes) 000428 1784233503.648878 write 0x02cbd2 thru 0x038620 (0xba4f bytes) 000429 1784233503.651911 mapread 0x026d10 thru 0x031213 (0xa504 bytes) 000430 1784233503.657783 trunc from 0x0385ae to 0x038620 (0x73 bytes) 000431 1784233503.672002 MIRROR_RESYNC 2 mirrors 000432 1784233504.156919 trunc from 0x038621 to 0x00d6b1 (0x2af6f bytes) 000433 1784233504.205210 trunc from 0x00d6b2 to 0x03b98b (0x2e2da bytes) 000434 1784233504.218395 mapread 0x0112f1 thru 0x01961b (0x832b bytes) 000435 1784233504.234403 fallocate 0x00ab5c thru 0x017d0f (0xd1b4 bytes) 000436 1784233504.237915 fallocate 0x027057 thru 0x02cf9c (0x5f46 bytes) 000437 1784233504.242011 punch from 0x026554 to 0x028c2b (0x26d8 bytes) 000438 1784233504.248133 read 0x038f4d thru 0x03b98b (0x2a3f bytes) 000439 1784233504.255558 MIRROR_RESYNC 2 mirrors 000440 1784233504.737796 fallocate 0x02473c thru 0x024e46 (0x70b bytes) 000441 1784233504.776267 MIRROR_RESYNC 2 mirrors 000442 1784233505.312219 write 0x00178e thru 0x00a01d (0x8890 bytes) 000443 1784233505.337439 punch from 0x01abcd to 0x027d89 (0xd1bd bytes) 000444 1784233505.341552 punch from 0x038efa to 0x03b98b (0x2a92 bytes) 000445 1784233505.345219 trunc from 0x03529d to 0x03a92f (0x5693 bytes) 000446 1784233505.349214 punch from 0x01561e to 0x016cac (0x168f bytes) 000447 1784233505.357830 punch from 0x00e385 to 0x010fb8 (0x2c34 bytes) 000448 1784233505.364212 trunc from 0x0132b1 to 0x01fb11 (0xc861 bytes) 000449 1784233505.374474 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b98c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b98c): Mirror 2: 0xa056d068 (stale) CRC-32 checksum value for chunk [0, 0x3b98c): Mirror 1: 0x4802ae63 Mirror 3: 0x4802ae63 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b98c: skipped 000450 1784233506.051437 read 0x03774b thru 0x03b98b (0x4241 bytes) 000451 1784233506.062607 trunc from 0x03b98c to 0x014294 (0x276f7 bytes) 000452 1784233506.115694 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x14295): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14295): Mirror 2: 0x692c57ce (stale) Mirror 3: 0x1a5c9fe5 (stale) CRC-32 checksum value for chunk [0, 0x14295): Mirror 1: 0x1a5c9fe5 Mirror 4: 0x1a5c9fe5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14295: skipped 000453 1784233506.826781 read 0x00be38 thru 0x00c340 (0x509 bytes) 000454 1784233506.835891 mapwrite 0x012ef8 thru 0x01d619 (0xa722 bytes) 000455 1784233506.893836 punch from 0x017909 to 0x01c17e (0x4876 bytes) 000456 1784233506.897264 trunc from 0x01d61a to 0x0367f8 (0x191df bytes) 000458 1784233506.913359 punch from 0x0163cf to 0x0216cc (0xb2fe bytes) 000459 1784233506.925129 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x367f9): Mirror 3: 0x482901ec (stale) Mirror 4: 0x482901ec (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x367f9): Mirror 3: 0x482901ec (stale) Mirror 4: 0x482901ec (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x367f9: skipped 000460 1784233507.190908 fallocate 0x03c174 thru 0x03ffff (0x3e8c bytes) 000463 1784233507.197899 write 0x01fa03 thru 0x0244a2 (0x4aa0 bytes) 000464 1784233507.208720 fallocate 0x026021 thru 0x02808a (0x206a bytes) 000465 1784233507.213310 mapwrite 0x039ba2 thru 0x03ffff (0x645e bytes) 000466 1784233507.251797 punch from 0x019561 to 0x01f5a1 (0x6041 bytes) 000467 1784233507.257596 mapread 0x0176d9 thru 0x018ad3 (0x13fb bytes) 000468 1784233507.271383 read 0x00bb65 thru 0x00d7dc (0x1c78 bytes) 000469 1784233507.275572 fallocate 0x0220ff thru 0x025ced (0x3bef bytes) 000470 1784233507.283459 MIRROR_RESYNC 3 mirrors 000471 1784233507.902429 fallocate 0x02c1c7 thru 0x02e74f (0x2589 bytes) 000472 1784233507.936388 fallocate 0x010640 thru 0x0116fa (0x10bb bytes) 000473 1784233507.941389 punch from 0x003871 to 0x005e70 (0x2600 bytes) 000474 1784233507.945776 trunc from 0x01ab1b to 0x01b31c (0x802 bytes) 000475 1784233507.949250 trunc from 0x040000 to 0x01ade1 (0x2521e bytes) 000476 1784233508.001457 trunc from 0x01ade2 to 0x033da7 (0x18fc6 bytes) 000477 1784233508.014811 punch from 0x02ecd6 to 0x033da7 (0x50d2 bytes) 000478 1784233508.018423 write 0x00a9b7 thru 0x011b98 (0x71e2 bytes) 000479 1784233508.027232 read 0x014ecc thru 0x01d12e (0x8263 bytes) 000480 1784233508.038719 mapread 0x01c69c thru 0x029893 (0xd1f8 bytes) 000481 1784233508.076861 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33da8): Mirror 4: 0x46da01e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33da8): Mirror 4: 0x46da01e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33da8: skipped 000482 1784233508.308756 punch from 0x01316b to 0x017ed6 (0x4d6c bytes) 000483 1784233508.315832 mapread 0x0297db thru 0x033da7 (0xa5cd bytes) 000484 1784233508.327222 trunc from 0x00f039 to 0x0177b8 (0x8780 bytes) 000486 1784233508.331033 trunc from 0x033da8 to 0x03da75 (0x9cce bytes) 000487 1784233508.344409 mapwrite 0x003ced thru 0x00c7d1 (0x8ae5 bytes) 000488 1784233508.369124 mapread 0x00cfda thru 0x0152f7 (0x831e bytes) 000489 1784233508.379432 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000490 1784233508.455629 mapread 0x0163db thru 0x01a114 (0x3d3a bytes) 000492 1784233508.469153 write 0x034dde thru 0x03efaf (0xa1d2 bytes) 000493 1784233508.483935 read 0x0317d4 thru 0x035cf6 (0x4523 bytes) 000494 1784233508.487553 read 0x01db41 thru 0x02d9f8 (0xfeb8 bytes) 000495 1784233508.495551 trunc from 0x03efb0 to 0x0036b6 (0x3b8f9 bytes) 000496 1784233508.509588 trunc from 0x000a70 to 0x0036b6 (0x2c47 bytes) 000497 1784233508.513485 read 0x00200c thru 0x0036b6 (0x16ab bytes) 000498 1784233508.522149 mapwrite 0x00031d thru 0x0098bd (0x95a1 bytes) 000499 1784233508.580547 fallocate 0x03e97a thru 0x03ffff (0x1686 bytes) 000500 1784233508.589271 mapwrite 0x00aebb thru 0x0146c5 (0x980b bytes) 000501 1784233508.627858 mapwrite 0x01ab12 thru 0x028b86 (0xe075 bytes) 000502 1784233508.652118 fallocate 0x007aad thru 0x0134ac (0xba00 bytes) 000503 1784233508.658381 trunc from 0x040000 to 0x01a3eb (0x25c14 bytes) 000504 1784233508.673044 trunc from 0x003c04 to 0x00505b (0x1458 bytes) 000505 1784233508.677886 trunc from 0x019320 to 0x01a3eb (0x10cc bytes) 000506 1784233508.681957 mapread 0x001b04 thru 0x00317b (0x1678 bytes) 000507 1784233508.686094 write 0x035530 thru 0x03e643 (0x9114 bytes) 000508 1784233508.691117 MIRROR_EXTEND to 2 mirrors 000509 1784233509.208139 trunc from 0x03e644 to 0x018d27 (0x2591c bytes) 000510 1784233509.242639 read 0x0134d2 thru 0x018d27 (0x5856 bytes) 000511 1784233509.251100 trunc from 0x018d28 to 0x00825c (0x10acb bytes) 000512 1784233509.267258 punch from 0x00215f to 0x003d0a (0x1bac bytes) 000513 1784233509.271463 mapwrite 0x00dff3 thru 0x01cc04 (0xec12 bytes) 000514 1784233509.348373 read 0x015352 thru 0x017f49 (0x2bf8 bytes) 000516 1784233509.349522 mapread 0x0138b4 thru 0x01cc04 (0x9351 bytes) 000517 1784233509.350677 fallocate 0x03243c thru 0x03ffff (0xdbc4 bytes) 000518 1784233509.358991 trunc from 0x040000 to 0x00b861 (0x3479e bytes) 000519 1784233509.384750 mapwrite 0x00729f thru 0x00c8ba (0x561c bytes) 000520 1784233509.421882 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000521 1784233509.564264 read 0x004616 thru 0x00468e (0x79 bytes) 000522 1784233509.571702 read 0x00663b thru 0x00c8ba (0x6280 bytes) 000523 1784233509.585731 mapwrite 0x03eb42 thru 0x03ffff (0x14be bytes) 000525 1784233509.643894 MIRROR_EXTEND to 2 mirrors 000526 1784233510.083649 fallocate 0x006fa0 thru 0x015b5e (0xebbf bytes) 000528 1784233510.122218 mapwrite 0x011c0f thru 0x015f85 (0x4377 bytes) 000531 1784233510.154586 trunc from 0x017e0b to 0x025b64 (0xdd5a bytes) 000532 1784233510.159406 trunc from 0x0310f0 to 0x032aca (0x19db bytes) 000533 1784233510.165015 read 0x020156 thru 0x0275be (0x7469 bytes) 000534 1784233510.173476 mapwrite 0x02ee42 thru 0x039d05 (0xaec4 bytes) 000535 1784233510.209345 mapread 0x009f97 thru 0x012fbe (0x9028 bytes) 000536 1784233510.217263 mapwrite 0x0043da thru 0x0080d5 (0x3cfc bytes) 000538 1784233510.249135 trunc from 0x03b452 to 0x03c67b (0x122a bytes) 000540 1784233510.259084 fallocate 0x01b93f thru 0x021d86 (0x6448 bytes) 000541 1784233510.266774 write 0x0215de thru 0x023403 (0x1e26 bytes) 000542 1784233510.272946 mapread 0x02ab72 thru 0x0314bc (0x694b bytes) 000543 1784233510.278665 fallocate 0x0112ad thru 0x017c44 (0x6998 bytes) 000544 1784233510.286907 punch from 0x03a073 to 0x03ffff (0x5f8d bytes) 000545 1784233510.298650 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000546 1784233510.443258 MIRROR_EXTEND to 2 mirrors 000547 1784233510.968983 mapread 0x035c8a thru 0x03ffff (0xa376 bytes) 000548 1784233510.999862 write 0x025b03 thru 0x034d61 (0xf25f bytes) 000549 1784233511.035245 read 0x02f285 thru 0x0331c0 (0x3f3c bytes) 000550 1784233511.039034 mapwrite 0x03905a thru 0x03ffff (0x6fa6 bytes) 000551 1784233511.065338 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000552 1784233511.162964 mapread 0x020ec1 thru 0x02a7f3 (0x9933 bytes) 000553 1784233511.181816 write 0x027f8d thru 0x028936 (0x9aa bytes) 000554 1784233511.186946 read 0x01b482 thru 0x02533c (0x9ebb bytes) 000555 1784233511.187994 read 0x0259bc thru 0x030509 (0xab4e bytes) 000556 1784233511.197620 trunc from 0x01d758 to 0x0251c4 (0x7a6d bytes) 000557 1784233511.203361 write 0x03d8db thru 0x03ffff (0x2725 bytes) 000558 1784233511.204817 trunc from 0x004aaa to 0x00f501 (0xaa58 bytes) 000559 1784233511.211909 mapread 0x035e60 thru 0x03cee4 (0x7085 bytes) 000560 1784233511.213583 mapread 0x02b63e thru 0x02f325 (0x3ce8 bytes) 000562 1784233511.215665 trunc from 0x0105dc to 0x0179dd (0x7402 bytes) 000563 1784233511.222335 MIRROR_EXTEND to 2 mirrors 000564 1784233511.580128 punch from 0x0339dd to 0x03b92c (0x7f50 bytes) 000565 1784233511.605766 read 0x036453 thru 0x039346 (0x2ef4 bytes) 000566 1784233511.610720 fallocate 0x039a69 thru 0x03ffff (0x6597 bytes) 000567 1784233511.614810 trunc from 0x0136cf to 0x017888 (0x41ba bytes) 000568 1784233511.619248 mapwrite 0x015493 thru 0x01d357 (0x7ec5 bytes) 000569 1784233511.655874 trunc from 0x040000 to 0x02083b (0x1f7c4 bytes) 000570 1784233511.703549 read 0x0121bb thru 0x0127cd (0x613 bytes) 000571 1784233511.704868 write 0x013a1e thru 0x016580 (0x2b63 bytes) 000572 1784233511.707467 fallocate 0x03fa64 thru 0x03ffff (0x59c bytes) 000573 1784233511.713328 mapread 0x01127f thru 0x01546a (0x41ec bytes) 000574 1784233511.715547 trunc from 0x001d60 to 0x00c0ee (0xa38f bytes) 000575 1784233511.725130 fallocate 0x0289cc thru 0x028c45 (0x27a bytes) 000576 1784233511.729255 mapread 0x0049ec thru 0x008786 (0x3d9b bytes) 000577 1784233511.743621 write 0x007c35 thru 0x00ff56 (0x8322 bytes) 000578 1784233511.746204 fallocate 0x0144e2 thru 0x01eb62 (0xa681 bytes) 000579 1784233511.755128 trunc from 0x004b66 to 0x0135f0 (0xea8b bytes) 000580 1784233511.780216 read 0x03ad3e thru 0x03e41c (0x36df bytes) 000582 1784233511.782520 fallocate 0x025c5b thru 0x02b3c9 (0x576f bytes) 000583 1784233511.787313 punch from 0x01d1ed to 0x01d2e8 (0xfc bytes) 000585 1784233511.793800 mapwrite 0x0335a8 thru 0x03ffff (0xca58 bytes) 000586 1784233511.818738 read 0x0255e7 thru 0x0344d9 (0xeef3 bytes) 000587 1784233511.819516 trunc from 0x040000 to 0x00e89a (0x31765 bytes) 000588 1784233511.837131 trunc from 0x001d0a to 0x00e89a (0xcb91 bytes) 000590 1784233511.846196 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000591 1784233511.968562 mapread 0x0076ee thru 0x00e89a (0x71ad bytes) 000592 1784233511.983002 MIRROR_EXTEND to 2 mirrors 000593 1784233512.450965 fallocate 0x03a6c0 thru 0x03ffff (0x5940 bytes) 000594 1784233512.473763 write 0x03824b thru 0x03d7d5 (0x558b bytes) 000595 1784233512.481174 MIRROR_RESYNC 2 mirrors 000596 1784233512.877130 mapread 0x024168 thru 0x0325c7 (0xe460 bytes) 000597 1784233512.902105 trunc from 0x010308 to 0x01944d (0x9146 bytes) 000598 1784233512.917636 trunc from 0x03d7d6 to 0x00c1ce (0x31607 bytes) 000599 1784233512.931513 trunc from 0x00c1cf to 0x0381e6 (0x2c018 bytes) 000600 1784233512.942001 trunc from 0x0381e7 to 0x038ba7 (0x9c1 bytes) 000601 1784233512.955630 write 0x02c39a thru 0x036b32 (0xa799 bytes) 000602 1784233512.971357 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000603 1784233513.064638 trunc from 0x031df2 to 0x038ba7 (0x6db6 bytes) 000604 1784233513.068879 trunc from 0x038ba8 to 0x034b07 (0x40a0 bytes) 000606 1784233513.087144 punch from 0x00f2ec to 0x012858 (0x356d bytes) 000607 1784233513.091105 trunc from 0x0328b2 to 0x032cc0 (0x40f bytes) 000608 1784233513.094567 trunc from 0x034b08 to 0x02a45f (0xa6a8 bytes) 000610 1784233513.106127 fallocate 0x00a01a thru 0x0162a3 (0xc28a bytes) 000611 1784233513.110971 mapread 0x00e23c thru 0x019562 (0xb327 bytes) 000612 1784233513.137758 write 0x0266e1 thru 0x033122 (0xca42 bytes) 000614 1784233513.145915 write 0x0269b8 thru 0x035679 (0xecc2 bytes) 000615 1784233513.148835 write 0x038e5d thru 0x03f999 (0x6b3d bytes) 000617 1784233513.151150 write 0x00791f thru 0x00c334 (0x4a16 bytes) 000618 1784233513.160978 trunc from 0x01427c to 0x01fa61 (0xb7e6 bytes) 000619 1784233513.167366 trunc from 0x03f99a to 0x02c802 (0x13197 bytes) 000620 1784233513.195910 fallocate 0x006d52 thru 0x015ac7 (0xed76 bytes) 000621 1784233513.201675 write 0x002433 thru 0x00aa32 (0x8600 bytes) 000622 1784233513.217571 mapread 0x005e3e thru 0x007609 (0x17cc bytes) 000623 1784233513.222695 MIRROR_EXTEND to 2 mirrors 000624 1784233513.700803 trunc from 0x01a7d2 to 0x0288c9 (0xe0f8 bytes) 000625 1784233513.736234 fallocate 0x0021ad thru 0x004d94 (0x2be8 bytes) 000627 1784233513.741839 read 0x0264a2 thru 0x02c802 (0x6361 bytes) 000628 1784233513.749469 punch from 0x00536d to 0x0092ff (0x3f93 bytes) 000629 1784233513.753649 read 0x01a33a thru 0x01bdab (0x1a72 bytes) 000630 1784233513.762560 trunc from 0x013f16 to 0x018e78 (0x4f63 bytes) 000631 1784233513.769887 MIRROR_RESYNC 2 mirrors 000632 1784233514.269415 trunc from 0x02c803 to 0x01e075 (0xe78d bytes) 000633 1784233514.312643 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000635 1784233514.466762 read 0x018133 thru 0x01e075 (0x5f43 bytes) 000636 1784233514.475214 fallocate 0x019e3f thru 0x01f439 (0x55fb bytes) 000639 1784233514.482268 mapread 0x016dd0 thru 0x01f439 (0x866a bytes) 000640 1784233514.513281 mapwrite 0x01cdbf thru 0x023da4 (0x6fe6 bytes) 000641 1784233514.557816 trunc from 0x00cfaa to 0x010836 (0x388d bytes) 000642 1784233514.566166 read 0x009d2c thru 0x014026 (0xa2fb bytes) 000645 1784233514.573177 mapread 0x0135bd thru 0x014af8 (0x153c bytes) 000646 1784233514.573990 trunc from 0x023da5 to 0x00ea52 (0x15352 bytes) 000647 1784233514.583438 fallocate 0x010ab0 thru 0x01fab9 (0xf00a bytes) 000649 1784233514.586446 trunc from 0x00ea53 to 0x035b00 (0x270ae bytes) 000650 1784233514.591983 read 0x02a58d thru 0x02bd59 (0x17cd bytes) 000651 1784233514.597275 punch from 0x00d661 to 0x015f7a (0x891a bytes) 000652 1784233514.599500 fallocate 0x00bdfb thru 0x0133a0 (0x75a6 bytes) 000653 1784233514.602831 fallocate 0x02bbc0 thru 0x034496 (0x88d7 bytes) 000654 1784233514.605525 trunc from 0x03114f to 0x035b00 (0x49b2 bytes) 000655 1784233514.610812 punch from 0x004ff2 to 0x0096e6 (0x46f5 bytes) 000656 1784233514.614853 fallocate 0x023c40 thru 0x02616a (0x252b bytes) 000657 1784233514.619104 trunc from 0x035b01 to 0x000a63 (0x3509d bytes) 000659 1784233514.648361 trunc from 0x0002d3 to 0x000a63 (0x791 bytes) 000660 1784233514.654236 mapwrite 0x01b1ea thru 0x0258c7 (0xa6de bytes) 000661 1784233514.758712 trunc from 0x0258c8 to 0x016b7c (0xed4b bytes) 000662 1784233514.777540 mapwrite 0x0187b1 thru 0x020f83 (0x87d3 bytes) 000663 1784233514.836732 trunc from 0x020f84 to 0x03576a (0x147e7 bytes) 000664 1784233514.846897 mapread 0x00d28f thru 0x012c92 (0x5a04 bytes) 000665 1784233514.860038 trunc from 0x03576b to 0x038aa3 (0x3339 bytes) 000667 1784233514.868216 mapwrite 0x0076c1 thru 0x007826 (0x166 bytes) 000668 1784233514.883328 mapwrite 0x03f264 thru 0x03ffff (0xd9c bytes) 000669 1784233514.915115 trunc from 0x019b72 to 0x01e548 (0x49d7 bytes) 000670 1784233514.919533 write 0x013168 thru 0x01f1c0 (0xc059 bytes) 000671 1784233514.923984 read 0x00d4b1 thru 0x011863 (0x43b3 bytes) 000672 1784233514.924702 trunc from 0x003951 to 0x00514c (0x17fc bytes) 000673 1784233514.928518 trunc from 0x040000 to 0x008769 (0x37896 bytes) 000674 1784233514.939003 mapread 0x007a0c thru 0x008769 (0xd5e bytes) 000675 1784233514.961835 MIRROR_EXTEND to 2 mirrors 000676 1784233515.488102 trunc from 0x00876a to 0x026f9a (0x1e831 bytes) 000677 1784233515.543280 read 0x026e16 thru 0x026f9a (0x185 bytes) 000678 1784233515.549792 mapread 0x0263ea thru 0x026f9a (0xbb1 bytes) 000680 1784233515.551127 trunc from 0x026f9b to 0x000c98 (0x26302 bytes) 000681 1784233515.566568 write 0x02d0dc thru 0x032915 (0x583a bytes) 000682 1784233515.567944 fallocate 0x025af5 thru 0x02fd08 (0xa214 bytes) 000683 1784233515.575444 mapread 0x02441f thru 0x026a15 (0x25f7 bytes) 000684 1784233515.591123 fallocate 0x0279ba thru 0x032228 (0xa86f bytes) 000685 1784233515.594578 trunc from 0x032916 to 0x024c3d (0xdcd8 bytes) 000687 1784233515.606271 fallocate 0x035629 thru 0x038cdd (0x36b5 bytes) 000688 1784233515.613440 MIRROR_RESYNC 2 mirrors 000689 1784233515.955259 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000690 1784233516.046014 punch from 0x021cb7 to 0x02b607 (0x9951 bytes) 000691 1784233516.061490 trunc from 0x01fdc9 to 0x02121a (0x1452 bytes) 000693 1784233516.065547 fallocate 0x03e9e8 thru 0x03ffff (0x1618 bytes) 000694 1784233516.070273 fallocate 0x023738 thru 0x02fc0a (0xc4d3 bytes) 000695 1784233516.084572 trunc from 0x038cde to 0x00c8a3 (0x2c43a bytes) 000696 1784233516.115777 punch from 0x004563 to 0x00c8a3 (0x8341 bytes) 000698 1784233516.120672 punch from 0x0082ab to 0x00c8a3 (0x45f9 bytes) 000699 1784233516.124538 mapread 0x000db7 thru 0x0022b7 (0x1501 bytes) 000700 1784233516.136690 read 0x00a1e4 thru 0x00c8a3 (0x26c0 bytes) 000702 1784233516.142399 write 0x0276ff thru 0x030fa7 (0x98a9 bytes) 000703 1784233516.143974 trunc from 0x02db26 to 0x02ec94 (0x116f bytes) 000704 1784233516.160168 trunc from 0x030fa8 to 0x027041 (0x9f66 bytes) 000706 1784233516.171373 punch from 0x01beb1 to 0x027041 (0xb191 bytes) 000707 1784233516.176575 punch from 0x019114 to 0x026ac0 (0xd9ad bytes) 000709 1784233516.181720 trunc from 0x0056c6 to 0x014d47 (0xf682 bytes) 000711 1784233516.196573 punch from 0x00bf1d to 0x01234a (0x642e bytes) 000712 1784233516.201335 trunc from 0x024a71 to 0x027041 (0x25d1 bytes) 000713 1784233516.208188 mapwrite 0x0123e2 thru 0x01e94a (0xc569 bytes) 000714 1784233516.239283 trunc from 0x01ea6a to 0x02181b (0x2db2 bytes) 000715 1784233516.243457 trunc from 0x015e4a to 0x01f739 (0x98f0 bytes) 000717 1784233516.248504 mapwrite 0x014272 thru 0x017b37 (0x38c6 bytes) 000718 1784233516.270772 mapread 0x004426 thru 0x00ed6e (0xa949 bytes) 000719 1784233516.280624 punch from 0x0265f7 to 0x027041 (0xa4b bytes) 000722 1784233516.293316 write 0x00be35 thru 0x00cc54 (0xe20 bytes) 000723 1784233516.297467 read 0x00d14c thru 0x016a09 (0x98be bytes) 000724 1784233516.298385 mapwrite 0x01e7db thru 0x02c026 (0xd84c bytes) 000725 1784233516.360440 MIRROR_EXTEND to 2 mirrors 000726 1784233516.842723 trunc from 0x02c027 to 0x01a2e5 (0x11d41 bytes) 000727 1784233516.892491 write 0x03fdca thru 0x03ffff (0x236 bytes) 000728 1784233516.893564 mapread 0x01682b thru 0x01a8cf (0x40a5 bytes) 000730 1784233516.909512 punch from 0x010cac to 0x014e96 (0x41eb bytes) 000731 1784233516.913081 trunc from 0x010787 to 0x01a5a7 (0x9e21 bytes) 000732 1784233516.921504 MIRROR_RESYNC 2 mirrors 000733 1784233517.360607 MIRROR_RESYNC 2 mirrors 000734 1784233517.558744 punch from 0x03643b to 0x03dbc6 (0x778c bytes) 000735 1784233517.580319 mapread 0x00ade6 thru 0x01344b (0x8666 bytes) 000736 1784233517.597447 mapread 0x022036 thru 0x024d04 (0x2ccf bytes) 000737 1784233517.610035 punch from 0x0162d1 to 0x02316e (0xce9e bytes) 000738 1784233517.617485 punch from 0x03fa14 to 0x03ffff (0x5ec bytes) 000739 1784233517.621766 trunc from 0x02820b to 0x03475e (0xc554 bytes) 000740 1784233517.629430 read 0x00b94d thru 0x0171a2 (0xb856 bytes) 000741 1784233517.632936 write 0x036056 thru 0x03ebe9 (0x8b94 bytes) 000742 1784233517.640215 trunc from 0x040000 to 0x00d166 (0x32e99 bytes) 000743 1784233517.655394 trunc from 0x00d167 to 0x03bcde (0x2eb78 bytes) 000744 1784233517.666264 fallocate 0x018b00 thru 0x01acd9 (0x21da bytes) 000745 1784233517.674709 mapread 0x035516 thru 0x03bcde (0x67c9 bytes) 000747 1784233517.694040 trunc from 0x021a62 to 0x0235ef (0x1b8e bytes) 000748 1784233517.698133 trunc from 0x03b86a to 0x03bcde (0x475 bytes) 000749 1784233517.706438 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3bcdf): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bcdf): Mirror 2: 0x189d55de (stale) CRC-32 checksum value for chunk [0, 0x3bcdf): Mirror 1: 0x189d55de Mirror 3: 0x189d55de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bcdf: skipped 000750 1784233518.186163 trunc from 0x03a65a to 0x03bcde (0x1685 bytes) 000751 1784233518.208777 mapread 0x013864 thru 0x01ff24 (0xc6c1 bytes) 000752 1784233518.241205 mapread 0x02a798 thru 0x033973 (0x91dc bytes) 000753 1784233518.274348 MIRROR_RESYNC 3 mirrors 000754 1784233518.838478 write 0x02623b thru 0x02a5de (0x43a4 bytes) 000755 1784233518.865705 trunc from 0x034d35 to 0x03bcde (0x6faa bytes) 000756 1784233518.874202 fallocate 0x020795 thru 0x0299dc (0x9248 bytes) 000758 1784233518.882187 punch from 0x00ae31 to 0x014d46 (0x9f16 bytes) 000759 1784233518.890926 trunc from 0x03bcdf to 0x00d670 (0x2e66e bytes) 000760 1784233518.910347 write 0x037e4c thru 0x03ffff (0x81b4 bytes) 000761 1784233518.912095 read 0x03e567 thru 0x03ffff (0x1a99 bytes) 000762 1784233518.912579 trunc from 0x015f8b to 0x01e2a2 (0x8318 bytes) 000763 1784233518.916136 trunc from 0x000b21 to 0x00d836 (0xcd16 bytes) 000764 1784233518.921070 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8af5b6d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8af5b6d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000765 1784233519.134983 mapwrite 0x01d504 thru 0x0220a6 (0x4ba3 bytes) 000766 1784233519.157821 read 0x0300f8 thru 0x03294e (0x2857 bytes) 000767 1784233519.163099 trunc from 0x03bb5d to 0x03ffff (0x44a3 bytes) 000768 1784233519.170700 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8af5b6d0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdbcfe24f Mirror 4: 0xdbcfe24f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000769 1784233519.801894 trunc from 0x020362 to 0x02dc65 (0xd904 bytes) 000770 1784233519.835952 mapwrite 0x01b85c thru 0x023146 (0x78eb bytes) 000771 1784233519.901153 trunc from 0x040000 to 0x037830 (0x87cf bytes) 000773 1784233519.942619 mapread 0x0363a2 thru 0x037830 (0x148f bytes) 000774 1784233519.952769 write 0x0285d3 thru 0x034a97 (0xc4c5 bytes) 000775 1784233519.958644 fallocate 0x0066cc thru 0x014f30 (0xe865 bytes) 000777 1784233519.964247 fallocate 0x017402 thru 0x025e7c (0xea7b bytes) 000778 1784233519.968623 trunc from 0x000bb5 to 0x00367c (0x2ac8 bytes) 000779 1784233519.974234 mapread 0x03022f thru 0x035608 (0x53da bytes) 000780 1784233519.976009 trunc from 0x037831 to 0x01502e (0x22802 bytes) 000781 1784233519.993216 read 0x0136b1 thru 0x013fa8 (0x8f8 bytes) 000782 1784233519.999098 trunc from 0x01502f to 0x03ae00 (0x25dd2 bytes) 000783 1784233520.018778 punch from 0x0047d0 to 0x008451 (0x3c82 bytes) 000784 1784233520.023686 trunc from 0x01ce5e to 0x0238c1 (0x6a64 bytes) 000785 1784233520.028141 read 0x024659 thru 0x025d9b (0x1743 bytes) 000786 1784233520.040024 trunc from 0x0285fb to 0x0365da (0xdfe0 bytes) 000787 1784233520.045589 trunc from 0x000683 to 0x00b3e2 (0xad60 bytes) 000788 1784233520.052261 mapwrite 0x02ac5d thru 0x030f61 (0x6305 bytes) 000789 1784233520.118784 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3ae01): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae01): Mirror 3: 0xc1cc87c4 (stale) Mirror 4: 0x462083a2 (stale) CRC-32 checksum value for chunk [0, 0x3ae01): Mirror 1: 0x16805985 Mirror 5: 0x16805985 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae01: skipped 000790 1784233520.717786 mapread 0x016298 thru 0x016c67 (0x9d0 bytes) 000791 1784233520.734878 fallocate 0x03f218 thru 0x03ffff (0xde8 bytes) 000792 1784233520.775227 mapread 0x03a441 thru 0x03ae00 (0x9c0 bytes) 000793 1784233520.786012 fallocate 0x022b2b thru 0x027f01 (0x53d7 bytes) 000794 1784233520.790258 mapread 0x0355dc thru 0x03ae00 (0x5825 bytes) 000795 1784233520.798427 fallocate 0x00eae5 thru 0x01b9c5 (0xcee1 bytes) 000796 1784233520.801782 punch from 0x034f2c to 0x037c63 (0x2d38 bytes) 000797 1784233520.807040 write 0x0262a8 thru 0x02b7e0 (0x5539 bytes) 000798 1784233520.829260 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3ae01): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae01): Mirror 3: 0xc1cc87c4 (stale) Mirror 4: 0x462083a2 (stale) Mirror 5: 0x16805985 (stale) CRC-32 checksum value for chunk [0, 0x3ae01): Mirror 1: 0xc567fc98 Mirror 6: 0xc567fc98 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae01: skipped 000799 1784233521.461512 mapread 0x01ffc2 thru 0x0270df (0x711e bytes) 000800 1784233521.488690 trunc from 0x0217cb to 0x028bf2 (0x7428 bytes) 000801 1784233521.509164 write 0x02ba97 thru 0x03a73d (0xeca7 bytes) 000802 1784233521.521617 mapwrite 0x03cd27 thru 0x03ffff (0x32d9 bytes) 000803 1784233521.560424 trunc from 0x003167 to 0x00c6b7 (0x9551 bytes) 000805 1784233521.569841 mapwrite 0x030c1e thru 0x03ffff (0xf3e2 bytes) 000806 1784233521.598067 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8af5b6d0 (stale) Mirror 4: 0xdbcfe24f (stale) Mirror 5: 0x86eaf8d2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8af5b6d0 (stale) Mirror 4: 0xdbcfe24f (stale) Mirror 5: 0x86eaf8d2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000808 1784233521.875739 MIRROR_RESYNC 4 mirrors 000809 1784233522.454441 write 0x016763 thru 0x01f533 (0x8dd1 bytes) 000810 1784233522.478873 trunc from 0x040000 to 0x003785 (0x3c87a bytes) 000811 1784233522.503581 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3786): Mirror 3: 0x6fe4845b (stale) Mirror 4: 0x6fe4845b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3786): Mirror 3: 0x6fe4845b (stale) Mirror 4: 0x6fe4845b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3786: skipped 000812 1784233522.724968 punch from 0x0026f4 to 0x003785 (0x1092 bytes) 000813 1784233522.728872 trunc from 0x003786 to 0x02200b (0x1e886 bytes) 000815 1784233522.745061 mapread 0x01e215 thru 0x02200b (0x3df7 bytes) 000816 1784233522.768378 trunc from 0x01f51c to 0x02200b (0x2af0 bytes) 000817 1784233522.773434 mapwrite 0x007373 thru 0x0095b7 (0x2245 bytes) 000818 1784233522.809051 trunc from 0x02200c to 0x03b873 (0x19868 bytes) 000819 1784233522.841135 fallocate 0x00a0bb thru 0x0163c4 (0xc30a bytes) 000820 1784233522.846035 trunc from 0x036d96 to 0x03b873 (0x4ade bytes) 000821 1784233522.856441 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3b874): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b874): Mirror 3: 0x7608b105 (stale) Mirror 4: 0x7608b105 (stale) CRC-32 checksum value for chunk [0, 0x3b874): Mirror 1: 0x3344618a Mirror 5: 0x3344618a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b874: skipped 000822 1784233523.517722 mapread 0x00a494 thru 0x018f84 (0xeaf1 bytes) 000824 1784233523.555848 mapwrite 0x008aae thru 0x00bcf9 (0x324c bytes) 000826 1784233523.613781 write 0x01df33 thru 0x028e05 (0xaed3 bytes) 000827 1784233523.623623 punch from 0x035b95 to 0x03b873 (0x5cdf bytes) 000828 1784233523.631517 punch from 0x011062 to 0x0116af (0x64e bytes) 000829 1784233523.634606 trunc from 0x03b874 to 0x018acf (0x22da4 bytes) 000830 1784233523.649200 mapwrite 0x02597c thru 0x02bae9 (0x616e bytes) 000831 1784233523.694625 read 0x023158 thru 0x02b05d (0x7f06 bytes) 000832 1784233523.695385 trunc from 0x01078a to 0x01ae9d (0xa714 bytes) 000833 1784233523.700984 write 0x02d61e thru 0x0357c8 (0x81ab bytes) 000834 1784233523.704220 write 0x03a5cb thru 0x03e6aa (0x40e0 bytes) 000835 1784233523.708571 fallocate 0x031648 thru 0x03a897 (0x9250 bytes) 000836 1784233523.717698 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e6ab): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e6ab): Mirror 3: 0x7c1f91f4 (stale) Mirror 4: 0x7c1f91f4 (stale) Mirror 5: 0x492a8270 (stale) CRC-32 checksum value for chunk [0, 0x3e6ab): Mirror 1: 0x1e580252 Mirror 6: 0x1e580252 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e6ab: skipped 000837 1784233524.551688 read 0x026f31 thru 0x03496b (0xda3b bytes) 000840 1784233524.573538 fallocate 0x03675d thru 0x039584 (0x2e28 bytes) 000841 1784233524.595160 punch from 0x033b1f to 0x039e8c (0x636e bytes) 000842 1784233524.599206 punch from 0x01b56a to 0x029fa3 (0xea3a bytes) 000843 1784233524.602080 fallocate 0x01a4f6 thru 0x02954c (0xf057 bytes) 000844 1784233524.606653 punch from 0x03b222 to 0x03c714 (0x14f3 bytes) 000847 1784233524.610539 fallocate 0x00cbab thru 0x016c93 (0xa0e9 bytes) 000848 1784233524.617215 trunc from 0x03e6ab to 0x014ec4 (0x297e6 bytes) 000849 1784233524.644633 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14ec5): Mirror 4: 0xf65e5851 (stale) Mirror 5: 0x100d8dda (stale) Mirror 6: 0x24666838 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14ec5): Mirror 4: 0xf65e5851 (stale) Mirror 5: 0x100d8dda (stale) Mirror 6: 0x24666838 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14ec5: skipped 000850 1784233524.899197 MIRROR_RESYNC 4 mirrors 000851 1784233525.629719 read 0x014958 thru 0x014ec4 (0x56d bytes) 000852 1784233525.635088 read 0x010cd6 thru 0x014cf9 (0x4024 bytes) 000853 1784233525.646710 read 0x0104fb thru 0x014ec4 (0x49ca bytes) 000854 1784233525.647027 mapread 0x010225 thru 0x014ec4 (0x4ca0 bytes) 000855 1784233525.647455 read 0x005725 thru 0x00e2a0 (0x8b7c bytes) 000856 1784233525.647955 read 0x010417 thru 0x010ae8 (0x6d2 bytes) 000857 1784233525.648205 read 0x000aa5 thru 0x009c4c (0x91a8 bytes) 000858 1784233525.649091 trunc from 0x014ec5 to 0x038037 (0x23173 bytes) 000859 1784233525.688773 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x38038): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38038): Mirror 4: 0xe1bf28eb (stale) Mirror 5: 0xe1bf28eb (stale) Mirror 6: 0xe1bf28eb (stale) CRC-32 checksum value for chunk [0, 0x38038): Mirror 1: 0xe1bf28eb Mirror 7: 0xe1bf28eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38038: skipped 000860 1784233526.360137 trunc from 0x038038 to 0x017d97 (0x202a0 bytes) 000861 1784233526.398711 trunc from 0x00e83f to 0x015c26 (0x73e8 bytes) 000862 1784233526.402762 trunc from 0x008ce1 to 0x00b017 (0x2337 bytes) 000863 1784233526.406873 fallocate 0x02ff79 thru 0x038109 (0x8191 bytes) 000864 1784233526.411574 mapwrite 0x037cac thru 0x0391c2 (0x1517 bytes) 000865 1784233526.463050 read 0x0085e0 thru 0x00e4f1 (0x5f12 bytes) 000866 1784233526.468949 fallocate 0x0279e1 thru 0x02d1bc (0x57dc bytes) 000868 1784233526.476835 trunc from 0x0391c3 to 0x018a13 (0x207af bytes) 000869 1784233526.487021 mapwrite 0x0344a1 thru 0x03ffff (0xbb5f bytes) 000870 1784233526.515428 fallocate 0x0360f9 thru 0x03c0b6 (0x5fbe bytes) 000871 1784233526.518064 fallocate 0x003a09 thru 0x010ebc (0xd4b4 bytes) 000872 1784233526.521998 mapread 0x03449e thru 0x038182 (0x3ce5 bytes) 000873 1784233526.522965 fallocate 0x03093a thru 0x03e093 (0xd75a bytes) 000874 1784233526.526577 write 0x024b89 thru 0x0318a2 (0xcd1a bytes) 000875 1784233526.531269 trunc from 0x023fd8 to 0x026edd (0x2f06 bytes) 000876 1784233526.541040 read 0x02432b thru 0x02cb13 (0x87e9 bytes) 000877 1784233526.555446 trunc from 0x02717a to 0x036194 (0xf01b bytes) 000878 1784233526.560337 punch from 0x012476 to 0x01f53c (0xd0c7 bytes) 000879 1784233526.565184 punch from 0x01ab9a to 0x028a64 (0xdecb bytes) 000880 1784233526.570119 punch from 0x0113c3 to 0x0150e3 (0x3d21 bytes) 000881 1784233526.574914 fallocate 0x03b8b6 thru 0x03ffff (0x474a bytes) 000883 1784233526.581521 mapread 0x011a1f thru 0x01326b (0x184d bytes) 000884 1784233526.600133 punch from 0x02ae27 to 0x02d2d1 (0x24ab bytes) 000885 1784233526.604271 write 0x006198 thru 0x01318c (0xcff5 bytes) 000887 1784233526.606970 trunc from 0x040000 to 0x00f011 (0x30fee bytes) 000888 1784233526.618800 read 0x00b8a0 thru 0x00c40a (0xb6b bytes) 000889 1784233526.619499 trunc from 0x00f012 to 0x00aaee (0x4523 bytes) 000890 1784233526.633972 MIRROR_RESYNC 5 mirrors 000891 1784233527.319632 write 0x015403 thru 0x01f830 (0xa42e bytes) 000892 1784233527.338074 fallocate 0x03dbda thru 0x03ffff (0x2426 bytes) 000893 1784233527.343704 read 0x005fcc thru 0x00b4e6 (0x551b bytes) 000894 1784233527.349743 trunc from 0x0106c6 to 0x011b08 (0x1443 bytes) 000895 1784233527.355334 mapwrite 0x031755 thru 0x03515e (0x3a0a bytes) 000896 1784233527.393625 fallocate 0x03ebc0 thru 0x03ffff (0x1440 bytes) 000897 1784233527.398503 mapread 0x021baa thru 0x0230d9 (0x1530 bytes) 000898 1784233527.405553 read 0x00d69f thru 0x019e80 (0xc7e2 bytes) 000899 1784233527.413550 fallocate 0x016f1a thru 0x016f2a (0x11 bytes) 000901 1784233527.419243 punch from 0x032590 to 0x03d5d3 (0xb044 bytes) 000902 1784233527.426714 MIRROR_RESYNC 5 mirrors 000904 1784233528.327384 punch from 0x03bf62 to 0x03ffff (0x409e bytes) 000906 1784233528.345171 punch from 0x038cf1 to 0x03ffff (0x730f bytes) 000907 1784233528.347854 mapwrite 0x014b56 thru 0x01fc27 (0xb0d2 bytes) 000908 1784233528.373044 mapread 0x0074e5 thru 0x008a2f (0x154b bytes) 000909 1784233528.377512 write 0x030091 thru 0x03a33a (0xa2aa bytes) 000910 1784233528.382789 trunc from 0x040000 to 0x031e5c (0xe1a3 bytes) 000911 1784233528.395682 punch from 0x029de4 to 0x031778 (0x7995 bytes) 000912 1784233528.404812 fallocate 0x020845 thru 0x021bdd (0x1399 bytes) 000913 1784233528.408890 punch from 0x011b1b to 0x013761 (0x1c47 bytes) 000914 1784233528.414448 fallocate 0x030a64 thru 0x031b0b (0x10a8 bytes) 000915 1784233528.424735 MIRROR_RESYNC 5 mirrors 000916 1784233529.315246 MIRROR_EXTEND to 6 mirrors 000917 1784233529.773838 trunc from 0x031e5d to 0x02be12 (0x604a bytes) 000918 1784233529.808922 MIRROR_RESYNC 6 mirrors 000919 1784233530.749970 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000920 1784233530.951162 punch from 0x0248d7 to 0x02be12 (0x753c bytes) 000921 1784233530.981449 trunc from 0x02be13 to 0x01cfb3 (0xee5f bytes) 000922 1784233530.995929 punch from 0x000958 to 0x00af8c (0xa635 bytes) 000923 1784233530.999684 trunc from 0x012305 to 0x01cfb3 (0xacaf bytes) 000924 1784233531.002182 mapwrite 0x01ac22 thru 0x029d83 (0xf162 bytes) 000925 1784233531.034886 trunc from 0x00191d to 0x001fbc (0x6a0 bytes) 000926 1784233531.038967 trunc from 0x029d84 to 0x026185 (0x3bfe bytes) 000927 1784233531.050041 read 0x003755 thru 0x00d9a6 (0xa252 bytes) 000928 1784233531.061690 fallocate 0x0293a5 thru 0x038481 (0xf0dd bytes) 000929 1784233531.068607 write 0x0311e2 thru 0x039049 (0x7e68 bytes) 000930 1784233531.070031 mapread 0x01aaad thru 0x026e37 (0xc38b bytes) 000931 1784233531.071231 mapwrite 0x02c0ae thru 0x035065 (0x8fb8 bytes) 000932 1784233531.095233 trunc from 0x03904a to 0x03d199 (0x4150 bytes) 000933 1784233531.119886 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d19a): Mirror 5: 0x31a09736 (stale) Mirror 6: 0x31a09736 (stale) Mirror 8: 0x31a09736 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d19a): Mirror 5: 0x31a09736 (stale) Mirror 6: 0x31a09736 (stale) Mirror 8: 0x31a09736 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d19a: skipped 000934 1784233531.335388 MIRROR_RESYNC 4 mirrors 000935 1784233532.058204 trunc from 0x010cf6 to 0x017121 (0x642c bytes) 000936 1784233532.084285 fallocate 0x01fc3c thru 0x01fe66 (0x22b bytes) 000937 1784233532.091773 trunc from 0x01ef9c to 0x02af6e (0xbfd3 bytes) 000938 1784233532.096057 mapwrite 0x03684b thru 0x03ffff (0x97b5 bytes) 000939 1784233532.172495 trunc from 0x027343 to 0x02d05b (0x5d19 bytes) 000940 1784233532.180820 mapwrite 0x024106 thru 0x029251 (0x514c bytes) 000942 1784233532.220214 mapread 0x012297 thru 0x01bc31 (0x999b bytes) 000943 1784233532.236771 mapwrite 0x0079ba thru 0x00d683 (0x5cca bytes) 000944 1784233532.267860 fallocate 0x015787 thru 0x01c4e1 (0x6d5b bytes) 000945 1784233532.281960 trunc from 0x03b1e1 to 0x03c6e7 (0x1507 bytes) 000946 1784233532.289958 mapread 0x030323 thru 0x036741 (0x641f bytes) 000947 1784233532.297432 fallocate 0x02dbf0 thru 0x02f369 (0x177a bytes) 000948 1784233532.301047 punch from 0x025554 to 0x033ef9 (0xe9a6 bytes) 000949 1784233532.305335 trunc from 0x040000 to 0x0032e7 (0x3cd18 bytes) 000950 1784233532.318737 trunc from 0x0032e8 to 0x00de64 (0xab7d bytes) 000951 1784233532.333822 read 0x009a17 thru 0x00de64 (0x444e bytes) 000952 1784233532.340778 trunc from 0x00de65 to 0x029a37 (0x1bbd3 bytes) 000953 1784233532.351544 write 0x00ab5d thru 0x014eee (0xa392 bytes) 000954 1784233532.359094 mapread 0x01831a thru 0x023d13 (0xb9fa bytes) 000955 1784233532.372192 mapread 0x02980a thru 0x029a37 (0x22e bytes) 000956 1784233532.374866 mapwrite 0x0191c6 thru 0x01d6f7 (0x4532 bytes) 000957 1784233532.398021 read 0x014fcf thru 0x01bf62 (0x6f94 bytes) 000958 1784233532.398778 write 0x021546 thru 0x02becf (0xa98a bytes) 000959 1784233532.400160 mapwrite 0x02eb7f thru 0x03238e (0x3810 bytes) 000960 1784233532.445872 punch from 0x01ee97 to 0x0290e3 (0xa24d bytes) 000961 1784233532.452124 trunc from 0x03238f to 0x003ca9 (0x2e6e5 bytes) 000962 1784233532.466336 fallocate 0x028e28 thru 0x031d2c (0x8f05 bytes) 000963 1784233532.469479 read 0x02d651 thru 0x031d2c (0x46dc bytes) 000964 1784233532.474469 trunc from 0x030732 to 0x031d2c (0x15fb bytes) 000965 1784233532.477096 fallocate 0x02171b thru 0x02b7e2 (0xa0c8 bytes) 000966 1784233532.483198 MIRROR_RESYNC 4 mirrors 000967 1784233532.965863 trunc from 0x031d2d to 0x00676e (0x2b5be bytes) 000968 1784233533.014649 trunc from 0x0020ff to 0x00474d (0x264f bytes) 000969 1784233533.018443 punch from 0x004e1c to 0x006448 (0x162d bytes) 000970 1784233533.025918 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x676f): Mirror 5: 0xf2cb6751 (stale) Mirror 6: 0xf2cb6751 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x676f): Mirror 5: 0xf2cb6751 (stale) Mirror 6: 0xf2cb6751 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x676f: skipped 000971 1784233533.214249 mapread 0x004bba thru 0x00676e (0x1bb5 bytes) 000972 1784233533.232147 punch from 0x000510 to 0x0024c0 (0x1fb1 bytes) 000973 1784233533.240499 mapwrite 0x031db3 thru 0x034046 (0x2294 bytes) 000974 1784233533.286948 trunc from 0x001084 to 0x00bd55 (0xacd2 bytes) 000975 1784233533.299005 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x34047): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34047): Mirror 5: 0x3f00318a (stale) Mirror 6: 0x3f00318a (stale) CRC-32 checksum value for chunk [0, 0x34047): Mirror 1: 0xe034b6d1 Mirror 7: 0xe034b6d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34047: skipped 000976 1784233533.798990 mapwrite 0x007cb8 thru 0x00b2cf (0x3618 bytes) 000977 1784233533.872373 mapread 0x016897 thru 0x0211b3 (0xa91d bytes) 000978 1784233533.884194 mapread 0x01b22d thru 0x01ee9f (0x3c73 bytes) 000979 1784233533.885161 punch from 0x001e9e to 0x008672 (0x67d5 bytes) 000980 1784233533.889015 write 0x020f8c thru 0x023090 (0x2105 bytes) 000981 1784233533.898466 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34047): Mirror 5: 0x3f00318a (stale) Mirror 7: 0xe034b6d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34047): Mirror 5: 0x3f00318a (stale) Mirror 7: 0xe034b6d1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34047: skipped 000982 1784233534.171818 fallocate 0x0171a7 thru 0x01f0c3 (0x7f1d bytes) 000983 1784233534.178549 trunc from 0x034047 to 0x03f175 (0xb12f bytes) 000984 1784233534.217755 trunc from 0x03f176 to 0x01085f (0x2e916 bytes) 000986 1784233534.227439 punch from 0x002323 to 0x010697 (0xe375 bytes) 000988 1784233534.231775 mapread 0x003697 thru 0x01085f (0xd1c9 bytes) 000989 1784233534.244819 fallocate 0x03aa18 thru 0x03ffff (0x55e8 bytes) 000990 1784233534.249401 trunc from 0x001f8b to 0x006d81 (0x4df7 bytes) 000991 1784233534.253952 trunc from 0x010860 to 0x00e123 (0x273c bytes) 000992 1784233534.268702 mapwrite 0x03101e thru 0x03a454 (0x9437 bytes) 000993 1784233534.320375 mapwrite 0x03d0be thru 0x03ffff (0x2f42 bytes) 000994 1784233534.359419 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x9b7b6ee0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x9b7b6ee0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000995 1784233534.572497 fallocate 0x02ef05 thru 0x031be8 (0x2ce4 bytes) 000997 1784233534.580565 punch from 0x035387 to 0x03a33d (0x4fb7 bytes) 000998 1784233534.584334 fallocate 0x038f60 thru 0x039e8f (0xf30 bytes) 000999 1784233534.588891 trunc from 0x040000 to 0x0256a2 (0x1a95d bytes) 001000 1784233534.610619 write 0x03cb9e thru 0x03ffff (0x3462 bytes) All operations completed A-OK!