== sanity-flr test 70a: flr mode fsx test ================ 02:21:14 (1788330074) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 77 skipping zero length zero range skipping zero size read truncating to largest ever: 0x3fe8e 000003 1788330077.685676 trunc from 00000000 to 0x03fe8d (0x3fe8e bytes) 000004 1788330077.705108 mapwrite 0x0071c3 thru 0x00a883 (0x36c1 bytes) 000005 1788330077.750970 punch from 0x029e48 to 0x0395e6 (0xf79f bytes) 000006 1788330077.756248 trunc from 0x019e51 to 0x0294db (0xf68b bytes) 000007 1788330077.760416 fallocate 0x0322bf thru 0x038fd2 (0x6d14 bytes) 000008 1788330077.765391 punch from 0x01975b to 0x02532d (0xbbd3 bytes) 000009 1788330077.772080 trunc from 0x03fe8e to 0x00a39a (0x35af3 bytes) 000010 1788330077.807108 trunc from 0x00a39b to 0x018cae (0xe914 bytes) 000012 1788330077.838517 punch from 0x000427 to 0x00a19a (0x9d74 bytes) 000014 1788330077.846200 fallocate 0x01b43b thru 0x026f6a (0xbb30 bytes) 000015 1788330077.854883 mapread 0x003f43 thru 0x007d2d (0x3deb bytes) 000016 1788330077.866645 write 0x0286d5 thru 0x02f2b8 (0x6be4 bytes) 000017 1788330077.867883 read 0x028833 thru 0x02f2b8 (0x6a86 bytes) 000018 1788330077.868555 write 0x02d07a thru 0x03c12a (0xf0b1 bytes) 000020 1788330077.871582 trunc from 0x03c12b to 0x02edcb (0xd35f bytes) 000021 1788330077.884711 mapread 0x01f2c6 thru 0x02ced0 (0xdc0b bytes) 000022 1788330077.895191 mapwrite 0x026a6b thru 0x035641 (0xebd7 bytes) 000023 1788330077.948328 mapread 0x01d7e9 thru 0x029594 (0xbdac bytes) 000024 1788330077.949553 trunc from 0x02a9c5 to 0x02e4ac (0x3ae8 bytes) 000026 1788330077.964099 mapread 0x02c6a4 thru 0x035641 (0x8f9e bytes) 000027 1788330077.990588 mapwrite 0x011b0d thru 0x015646 (0x3b3a bytes) 000028 1788330078.040738 mapread 0x005e7b thru 0x00c6f6 (0x687c bytes) 000029 1788330078.041922 read 0x015d3e thru 0x0235e7 (0xd8aa bytes) 000030 1788330078.043982 read 0x00183f thru 0x005224 (0x39e6 bytes) 000031 1788330078.044970 trunc from 0x035642 to 0x0041a6 (0x3149b bytes) 000032 1788330078.076371 write 0x03bd8b thru 0x03ffff (0x4275 bytes) 000033 1788330078.078651 trunc from 0x014677 to 0x022cd6 (0xe660 bytes) 000034 1788330078.086139 mapwrite 0x033394 thru 0x03fd26 (0xc993 bytes) 000035 1788330078.115549 punch from 0x01b74e to 0x01ba10 (0x2c3 bytes) 000036 1788330078.119853 fallocate 0x022f83 thru 0x02ddc0 (0xae3e bytes) 000037 1788330078.124442 mapwrite 0x0119f9 thru 0x01f8f9 (0xdf01 bytes) 000038 1788330078.173036 fallocate 0x036ba3 thru 0x03ae89 (0x42e7 bytes) 000039 1788330078.186976 mapwrite 0x00b9bb thru 0x010a8b (0x50d1 bytes) 000040 1788330078.209567 trunc from 0x00bcd2 to 0x017dfc (0xc12b bytes) 000042 1788330078.227672 mapread 0x030dd1 thru 0x03b296 (0xa4c6 bytes) 000043 1788330078.231821 fallocate 0x016c56 thru 0x0214ab (0xa856 bytes) 000044 1788330078.238640 read 0x00cf32 thru 0x013786 (0x6855 bytes) 000045 1788330078.266605 fallocate 0x00cd83 thru 0x016638 (0x98b6 bytes) 000046 1788330078.275543 write 0x022905 thru 0x0321d3 (0xf8cf bytes) 000047 1788330078.280326 read 0x0150ad thru 0x01d667 (0x85bb bytes) 000048 1788330078.281875 mapwrite 0x0187cb thru 0x0207d1 (0x8007 bytes) 000049 1788330078.325331 mapwrite 0x021cfb thru 0x021da7 (0xad bytes) 000050 1788330078.352165 trunc from 0x040000 to 0x00712b (0x38ed4 bytes) 000053 1788330078.369761 read 0x006173 thru 0x00712b (0xfb9 bytes) 000055 1788330078.371229 read 0x003554 thru 0x00613b (0x2be8 bytes) 000056 1788330078.374531 punch from 0x001608 to 0x00712b (0x5b24 bytes) 000057 1788330078.379731 punch from 0x005a16 to 0x00622d (0x818 bytes) 000059 1788330078.393702 mapwrite 0x01b98b thru 0x021ef1 (0x6567 bytes) 000062 1788330078.531689 read 0x009398 thru 0x017fa5 (0xec0e bytes) 000063 1788330078.533348 trunc from 0x021ef2 to 0x00cf2f (0x14fc2 bytes) 000064 1788330078.572893 trunc from 0x00cf30 to 0x02358b (0x1665c bytes) 000066 1788330078.606925 mapread 0x00a4f5 thru 0x016fb4 (0xcac0 bytes) 000067 1788330078.652209 read 0x018c52 thru 0x02358b (0xa93a bytes) 000068 1788330078.652852 mapwrite 0x033059 thru 0x03a704 (0x76ac bytes) 000069 1788330078.742161 MIRROR_EXTEND to 2 mirrors 000070 1788330079.869543 MIRROR_EXTEND to 3 mirrors 000071 1788330080.743024 write 0x024671 thru 0x0257e0 (0x1170 bytes) 000072 1788330080.786402 punch from 0x00b252 to 0x0166e1 (0xb490 bytes) 000073 1788330080.791851 mapwrite 0x01ce51 thru 0x01e71b (0x18cb bytes) fallocating to largest ever: 0x40000 000074 1788330080.831663 fallocate 0x03a09d thru 0x03ffff (0x5f63 bytes) 000075 1788330080.837263 write 0x035dc4 thru 0x03beea (0x6127 bytes) 000076 1788330080.846655 read 0x01efee thru 0x0201de (0x11f1 bytes) 000078 1788330080.849656 read 0x0117c7 thru 0x015b31 (0x436b bytes) 000079 1788330080.889053 read 0x01584e thru 0x0205f4 (0xada7 bytes) 000080 1788330080.890146 mapread 0x03988b thru 0x03b091 (0x1807 bytes) 000081 1788330080.892148 read 0x0260fe thru 0x02ff15 (0x9e18 bytes) 000084 1788330080.895229 trunc from 0x03beeb to 0x02febe (0xc02c bytes) 000085 1788330080.918208 read 0x00da0d thru 0x00e80f (0xe03 bytes) 000086 1788330080.919600 write 0x03523a thru 0x03ffff (0xadc6 bytes) 000087 1788330080.922231 trunc from 0x036e61 to 0x0390d7 (0x2277 bytes) 000088 1788330080.939988 trunc from 0x027381 to 0x032fff (0xbc7f bytes) 000089 1788330080.951366 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x6e632eb9 (stale) Mirror 3: 0x6e632eb9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1411a069 Mirror 4: 0x1411a069 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000090 1788330082.198880 trunc from 0x02f70e to 0x03eaa0 (0xf393 bytes) 000091 1788330082.242996 trunc from 0x040000 to 0x0122cf (0x2dd30 bytes) 000092 1788330082.271386 mapwrite 0x033588 thru 0x03c270 (0x8ce9 bytes) 000093 1788330082.331393 mapwrite 0x0060e0 thru 0x00e995 (0x88b6 bytes) 000094 1788330082.392340 mapread 0x01742d thru 0x025a30 (0xe604 bytes) 000095 1788330082.433441 mapread 0x039557 thru 0x03c270 (0x2d1a bytes) 000096 1788330082.434364 fallocate 0x020771 thru 0x021f6a (0x17fa bytes) 000097 1788330082.439975 read 0x032f3e thru 0x039430 (0x64f3 bytes) 000098 1788330082.441147 mapwrite 0x014e97 thru 0x01a12a (0x5294 bytes) 000099 1788330082.476997 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c271): Mirror 3: 0x86830d45 (stale) Mirror 4: 0xc54b170e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c271): Mirror 3: 0x86830d45 (stale) Mirror 4: 0xc54b170e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c271: skipped 000103 1788330082.846786 punch from 0x038a4b to 0x03c270 (0x3826 bytes) 000104 1788330082.854894 punch from 0x013384 to 0x01a424 (0x70a1 bytes) 000105 1788330082.863122 trunc from 0x00fb8a to 0x013b2b (0x3fa2 bytes) 000106 1788330082.875305 mapwrite 0x008838 thru 0x01431a (0xbae3 bytes) 000107 1788330082.993821 fallocate 0x01e121 thru 0x0274f4 (0x93d4 bytes) 000108 1788330083.003474 mapwrite 0x0280d8 thru 0x02a95d (0x2886 bytes) 000109 1788330083.032868 write 0x0170c4 thru 0x0187d7 (0x1714 bytes) 000110 1788330083.039263 read 0x0147e0 thru 0x01969a (0x4ebb bytes) 000111 1788330083.040542 trunc from 0x03c271 to 0x02ceef (0xf381 bytes) 000112 1788330083.063056 mapwrite 0x00b197 thru 0x018fbf (0xde29 bytes) 000113 1788330083.085883 mapread 0x003a8c thru 0x004ee2 (0x1457 bytes) 000114 1788330083.092125 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2cef0): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cef0): Mirror 3: 0xf73f4867 (stale) Mirror 4: 0x2bf1f181 (stale) CRC-32 checksum value for chunk [0, 0x2cef0): Mirror 1: 0xbb332f1b Mirror 5: 0xbb332f1b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cef0: skipped 000115 1788330084.190716 mapread 0x028e50 thru 0x02ceef (0x40a0 bytes) 000116 1788330084.245187 mapwrite 0x02efdd thru 0x0309e9 (0x1a0d bytes) 000117 1788330084.365040 punch from 0x003dde to 0x00cc6c (0x8e8f bytes) 000118 1788330084.371961 trunc from 0x025e4b to 0x0309e9 (0xab9f bytes) 000119 1788330084.377045 fallocate 0x01b67c thru 0x02a272 (0xebf7 bytes) 000120 1788330084.386502 MIRROR_RESYNC 4 mirrors 000121 1788330085.479798 write 0x001aea thru 0x0082d3 (0x67ea bytes) 000122 1788330085.535689 trunc from 0x011d43 to 0x01b71d (0x99db bytes) 000123 1788330085.554538 MIRROR_RESYNC 4 mirrors 000124 1788330086.906911 mapwrite 0x003fe8 thru 0x00fedc (0xbef5 bytes) 000125 1788330087.052140 read 0x00743d thru 0x00fd5f (0x8923 bytes) 000126 1788330087.053213 trunc from 0x0083e2 to 0x0084d5 (0xf4 bytes) 000127 1788330087.065811 punch from 0x006d85 to 0x00af1b (0x4197 bytes) 000128 1788330087.102541 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x309ea): Mirror 4: 0x2401892d (stale) Mirror 5: 0x2401892d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x309ea): Mirror 4: 0x2401892d (stale) Mirror 5: 0x2401892d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x309ea: skipped 000130 1788330087.612369 trunc from 0x0309ea to 0x0350dd (0x46f4 bytes) 000131 1788330087.653042 write 0x012273 thru 0x01e6de (0xc46c bytes) 000132 1788330087.665877 read 0x027b43 thru 0x02f8f9 (0x7db7 bytes) 000133 1788330087.674700 mapread 0x00f69a thru 0x018ef0 (0x9857 bytes) 000134 1788330087.699158 read 0x02afd7 thru 0x0350dd (0xa107 bytes) 000135 1788330087.711944 trunc from 0x007eff to 0x00ab15 (0x2c17 bytes) 000136 1788330087.719016 punch from 0x00e23e to 0x0125b8 (0x437b bytes) 000137 1788330087.738290 write 0x029949 thru 0x02d272 (0x392a bytes) 000138 1788330087.740090 punch from 0x00d1df to 0x01a8bc (0xd6de bytes) 000139 1788330087.745086 punch from 0x0316cd to 0x033625 (0x1f59 bytes) 000140 1788330087.750189 read 0x031f2d thru 0x0350dd (0x31b1 bytes) 000141 1788330087.768127 mapread 0x026d28 thru 0x032cf9 (0xbfd2 bytes) 000142 1788330087.769661 punch from 0x00aa22 to 0x00fcc5 (0x52a4 bytes) 000143 1788330087.774931 trunc from 0x00b920 to 0x01632d (0xaa0e bytes) 000144 1788330087.779437 trunc from 0x0350de to 0x008f58 (0x2c185 bytes) 000145 1788330087.807168 MIRROR_RESYNC 3 mirrors 000146 1788330088.693502 read 0x0015aa thru 0x003297 (0x1cee bytes) 000147 1788330088.702991 fallocate 0x0024a8 thru 0x006039 (0x3b92 bytes) 000149 1788330088.736057 trunc from 0x0025db to 0x004316 (0x1d3c bytes) 000150 1788330088.742512 mapread 0x007540 thru 0x008f58 (0x1a19 bytes) 000151 1788330088.751488 fallocate 0x019f2e thru 0x01a538 (0x60b bytes) 000152 1788330088.756220 write 0x01b4d2 thru 0x02a1b2 (0xece1 bytes) 000153 1788330088.758314 punch from 0x00d46c to 0x01a389 (0xcf1e bytes) 000154 1788330088.763716 read 0x01cbaa thru 0x0200a5 (0x34fc bytes) 000155 1788330088.764689 trunc from 0x020563 to 0x025ba1 (0x563f bytes) 000156 1788330088.787221 trunc from 0x0168d1 to 0x01faab (0x91db bytes) 000157 1788330088.797353 trunc from 0x01d460 to 0x0253e0 (0x7f81 bytes) 000158 1788330088.814520 MIRROR_RESYNC 3 mirrors 000159 1788330089.674839 read 0x029915 thru 0x02a1b2 (0x89e bytes) 000160 1788330089.687510 write 0x026ff2 thru 0x028f6d (0x1f7c bytes) 000161 1788330089.750956 write 0x01342a thru 0x01f7c8 (0xc39f bytes) 000162 1788330089.760903 fallocate 0x0142eb thru 0x021aa3 (0xd7b9 bytes) 000163 1788330089.766779 trunc from 0x02a1b3 to 0x016f02 (0x132b0 bytes) 000164 1788330089.789790 fallocate 0x035c29 thru 0x03d991 (0x7d69 bytes) 000165 1788330089.795923 mapread 0x00ed6f thru 0x01811a (0x93ac bytes) 000166 1788330089.814236 mapwrite 0x001922 thru 0x00c195 (0xa874 bytes) 000167 1788330089.858613 fallocate 0x024d5e thru 0x02f4d5 (0xa778 bytes) 000168 1788330089.864149 fallocate 0x030157 thru 0x038c33 (0x8add bytes) 000169 1788330089.869197 mapwrite 0x019758 thru 0x025e5a (0xc703 bytes) 000170 1788330089.908252 write 0x02b008 thru 0x0328e5 (0x78de bytes) 000171 1788330089.924132 fallocate 0x005431 thru 0x0129eb (0xd5bb bytes) 000172 1788330089.929092 mapread 0x03d8b9 thru 0x03d991 (0xd9 bytes) 000173 1788330089.938585 trunc from 0x029609 to 0x0387ad (0xf1a5 bytes) 000174 1788330089.952143 write 0x017411 thru 0x024d9b (0xd98b bytes) 000175 1788330089.954884 punch from 0x007630 to 0x00d17d (0x5b4e bytes) 000176 1788330089.959944 punch from 0x0241eb to 0x02e69a (0xa4b0 bytes) 000177 1788330089.973337 read 0x007c77 thru 0x00e295 (0x661f bytes) 000178 1788330089.983707 fallocate 0x020d42 thru 0x027916 (0x6bd5 bytes) 000179 1788330089.989006 mapwrite 0x005df8 thru 0x00d321 (0x752a bytes) 000180 1788330090.005547 write 0x028de0 thru 0x02e7a3 (0x59c4 bytes) 000181 1788330090.006677 write 0x02ed9c thru 0x039b8d (0xadf2 bytes) 000182 1788330090.007892 punch from 0x025b78 to 0x026d8f (0x1218 bytes) 000183 1788330090.013053 trunc from 0x03d992 to 0x014ef6 (0x28a9b bytes) 000184 1788330090.028878 mapwrite 0x0339a0 thru 0x03fc40 (0xc2a1 bytes) 000185 1788330090.119961 trunc from 0x03fc41 to 0x021fe1 (0x1dc5f bytes) 000186 1788330090.140301 write 0x004cdc thru 0x011a56 (0xcd7b bytes) 000187 1788330090.147325 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x21fe2): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21fe2): Mirror 4: 0x46f1abfc (stale) Mirror 5: 0x46f1abfc (stale) CRC-32 checksum value for chunk [0, 0x21fe2): Mirror 1: 0xba164f5 Mirror 6: 0xba164f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21fe2: skipped 000188 1788330091.219489 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x21fe2): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21fe2): Mirror 4: 0x46f1abfc (stale) Mirror 5: 0x46f1abfc (stale) CRC-32 checksum value for chunk [0, 0x21fe2): Mirror 1: 0xba164f5 Mirror 6: 0xba164f5 Mirror 7: 0xba164f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21fe2: skipped 000189 1788330092.057683 fallocate 0x02da00 thru 0x02f586 (0x1b87 bytes) 000190 1788330092.162361 punch from 0x02ea96 to 0x02f586 (0xaf1 bytes) 000191 1788330092.172148 fallocate 0x00a3f2 thru 0x01725e (0xce6d bytes) 000193 1788330092.178082 write 0x027b6b thru 0x030fb6 (0x944c bytes) 000194 1788330092.192537 write 0x005c12 thru 0x01219e (0xc58d bytes) 000195 1788330092.209185 mapread 0x003299 thru 0x003e78 (0xbe0 bytes) 000196 1788330092.215598 read 0x0164d6 thru 0x01e2e2 (0x7e0d bytes) 000197 1788330092.229883 trunc from 0x00c6c4 to 0x015af1 (0x942e bytes) 000199 1788330092.280380 fallocate 0x031fff thru 0x035122 (0x3124 bytes) 000201 1788330092.299535 mapwrite 0x00148c thru 0x0070e8 (0x5c5d bytes) 000202 1788330092.415816 mapwrite 0x032202 thru 0x03d373 (0xb172 bytes) 000203 1788330092.533209 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d374): Mirror 5: 0xa821d0ce (stale) Mirror 6: 0x8ea5f306 (stale) Mirror 7: 0x8ea5f306 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d374): Mirror 5: 0xa821d0ce (stale) Mirror 6: 0x8ea5f306 (stale) Mirror 7: 0x8ea5f306 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d374: skipped 000204 1788330093.067414 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d374): Mirror 6: 0x8ea5f306 (stale) Mirror 7: 0x8ea5f306 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d374): Mirror 6: 0x8ea5f306 (stale) Mirror 7: 0x8ea5f306 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d374: skipped 000205 1788330093.465596 trunc from 0x01f100 to 0x024b84 (0x5a85 bytes) 000206 1788330093.486601 trunc from 0x035a5d to 0x03d373 (0x7917 bytes) 000207 1788330093.504558 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d374): Mirror 6: 0x8ea5f306 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d374): Mirror 6: 0x8ea5f306 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d374: skipped 000208 1788330093.866988 mapread 0x009d0f thru 0x01004b (0x633d bytes) 000209 1788330093.889126 read 0x0240cc thru 0x02e92b (0xa860 bytes) 000211 1788330093.900990 mapread 0x028638 thru 0x02b3b5 (0x2d7e bytes) 000212 1788330093.902161 trunc from 0x03d374 to 0x0038fe (0x39a75 bytes) 000213 1788330093.922956 read 0x003381 thru 0x0038fe (0x57e bytes) 000214 1788330093.931025 read 0x002d5a thru 0x0038fe (0xba5 bytes) 000215 1788330093.936248 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x38ff): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38ff): Mirror 6: 0x9db4a4eb (stale) CRC-32 checksum value for chunk [0, 0x38ff): Mirror 1: 0x151d6417 Mirror 7: 0x151d6417 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38ff: skipped 000216 1788330094.827943 read 0x0032d0 thru 0x0038fe (0x62f bytes) 000217 1788330094.858575 read 0x001b5c thru 0x0038fe (0x1da3 bytes) 000218 1788330094.876538 write 0x03cb3a thru 0x03ffff (0x34c6 bytes) 000219 1788330094.940825 write 0x036507 thru 0x037653 (0x114d bytes) 000220 1788330094.954738 read 0x021b67 thru 0x023139 (0x15d3 bytes) 000221 1788330094.955535 mapread 0x02d6d9 thru 0x03cff5 (0xf91d bytes) 000222 1788330094.958666 mapwrite 0x0303fc thru 0x03bb40 (0xb745 bytes) 000223 1788330094.985454 read 0x031904 thru 0x0387ed (0x6eea bytes) 000224 1788330095.011666 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xd347eec2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xd347eec2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000225 1788330095.400994 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) 000226 1788330095.586039 MIRROR_EXTEND to 2 mirrors 000227 1788330096.547871 punch from 0x025f3d to 0x02d900 (0x79c4 bytes) 000228 1788330096.615819 fallocate 0x013d09 thru 0x01ac49 (0x6f41 bytes) 000229 1788330096.622743 mapwrite 0x020bb3 thru 0x0277d1 (0x6c1f bytes) 000230 1788330096.671814 trunc from 0x038e05 to 0x03ffff (0x71fb bytes) 000231 1788330096.677841 write 0x015d8d thru 0x021a20 (0xbc94 bytes) 000232 1788330096.709579 read 0x018d5a thru 0x0224c3 (0x976a bytes) 000233 1788330096.710846 write 0x000bee thru 0x00bb78 (0xaf8b bytes) 000234 1788330096.735870 mapwrite 0x0108a4 thru 0x010d50 (0x4ad bytes) 000235 1788330096.820403 trunc from 0x039718 to 0x03ae31 (0x171a bytes) 000237 1788330096.840649 fallocate 0x031ad2 thru 0x0370cd (0x55fc bytes) 000238 1788330096.859006 fallocate 0x022d68 thru 0x0263ed (0x3686 bytes) 000239 1788330096.870663 punch from 0x01976f to 0x028e2f (0xf6c1 bytes) 000240 1788330096.890853 punch from 0x0310a4 to 0x03fa38 (0xe995 bytes) 000241 1788330096.913840 fallocate 0x02bc12 thru 0x030856 (0x4c45 bytes) 000242 1788330096.933512 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x80e81e12 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xeb31d297 Mirror 3: 0xeb31d297 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000243 1788330098.333158 write 0x0293d2 thru 0x02d136 (0x3d65 bytes) 000244 1788330098.411115 write 0x02487c thru 0x02cc03 (0x8388 bytes) 000245 1788330098.421110 read 0x03f815 thru 0x03ffff (0x7eb bytes) 000246 1788330098.431942 read 0x0011b1 thru 0x01010b (0xef5b bytes) 000247 1788330098.459081 fallocate 0x0361e1 thru 0x03cfc9 (0x6de9 bytes) 000248 1788330098.467984 punch from 0x02f80f to 0x03a00c (0xa7fe bytes) 000249 1788330098.498415 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x80e81e12 (stale) Mirror 3: 0xeb31d297 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf63ac226 Mirror 4: 0xf63ac226 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000250 1788330099.946690 mapwrite 0x02775a thru 0x036c07 (0xf4ae bytes) 000251 1788330100.152774 trunc from 0x00ff18 to 0x0103ae (0x497 bytes) 000252 1788330100.173558 punch from 0x01c291 to 0x02230f (0x607f bytes) 000253 1788330100.183743 write 0x00fbbe thru 0x014be3 (0x5026 bytes) 000254 1788330100.224756 trunc from 0x03aa60 to 0x03b425 (0x9c6 bytes) 000255 1788330100.248708 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xeb31d297 (stale) Mirror 4: 0xf63ac226 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xeb31d297 (stale) Mirror 4: 0xf63ac226 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000256 1788330100.690180 read 0x0134c2 thru 0x0230e1 (0xfc20 bytes) 000257 1788330100.732242 fallocate 0x020e19 thru 0x028fcd (0x81b5 bytes) 000258 1788330100.747495 mapread 0x022e58 thru 0x0235ee (0x797 bytes) 000259 1788330100.749595 punch from 0x0000b8 to 0x002fc1 (0x2f0a bytes) 000260 1788330100.760642 punch from 0x00bd4b to 0x01a79d (0xea53 bytes) 000261 1788330100.768516 punch from 0x03d380 to 0x03ffff (0x2c80 bytes) 000262 1788330100.780480 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xeb31d297 (stale) Mirror 4: 0xf63ac226 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9beb98cc Mirror 5: 0x9beb98cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000263 1788330102.310167 read 0x01f902 thru 0x029c03 (0xa302 bytes) 000264 1788330102.341200 mapread 0x03d1fe thru 0x03ffff (0x2e02 bytes) 000265 1788330102.390941 write 0x01ba58 thru 0x01cfdc (0x1585 bytes) 000266 1788330102.474546 MIRROR_RESYNC 4 mirrors 000267 1788330103.988586 mapread 0x02e777 thru 0x02fcfc (0x1586 bytes) 000268 1788330104.000679 mapwrite 0x009e73 thru 0x0162fe (0xc48c bytes) 000269 1788330104.173562 trunc from 0x040000 to 0x02c33b (0x13cc4 bytes) 000270 1788330104.217603 read 0x007e43 thru 0x00bd20 (0x3ede bytes) 000271 1788330104.223168 trunc from 0x02c33c to 0x02fc5d (0x3922 bytes) 000272 1788330104.264594 write 0x00a536 thru 0x00c687 (0x2152 bytes) 000273 1788330104.265693 punch from 0x02d2b1 to 0x02f855 (0x25a5 bytes) 000274 1788330104.273771 read 0x00c4bf thru 0x01883d (0xc37f bytes) 000275 1788330104.274528 mapread 0x013c0e thru 0x0223af (0xe7a2 bytes) 000276 1788330104.301674 trunc from 0x02fc5e to 0x035708 (0x5aab bytes) 000277 1788330104.331831 trunc from 0x035709 to 0x02afb3 (0xa755 bytes) 000278 1788330104.367778 trunc from 0x02afb4 to 0x035862 (0xa8af bytes) 000280 1788330104.407665 mapread 0x01dcf6 thru 0x02b9a3 (0xdcae bytes) 000281 1788330104.428666 punch from 0x02f439 to 0x035862 (0x642a bytes) 000282 1788330104.435223 fallocate 0x018e87 thru 0x01b779 (0x28f3 bytes) 000284 1788330104.442944 trunc from 0x0006c7 to 0x007c6d (0x75a7 bytes) 000285 1788330104.448712 mapread 0x020709 thru 0x02840a (0x7d02 bytes) 000286 1788330104.451233 mapwrite 0x00528c thru 0x012a5d (0xd7d2 bytes) 000287 1788330104.507065 write 0x038b73 thru 0x03ffff (0x748d bytes) 000288 1788330104.508818 trunc from 0x038bc5 to 0x03ffff (0x743b bytes) 000289 1788330104.528815 fallocate 0x00addc thru 0x015e98 (0xb0bd bytes) 000290 1788330104.535404 trunc from 0x02ae7f to 0x02cba8 (0x1d2a bytes) 000291 1788330104.541685 trunc from 0x040000 to 0x02cb2d (0x134d2 bytes) 000292 1788330104.560041 mapwrite 0x01d5d6 thru 0x028d80 (0xb7ab bytes) 000294 1788330104.591422 trunc from 0x02cb2e to 0x03f6f3 (0x12bc6 bytes) 000296 1788330104.607956 write 0x00a8c1 thru 0x00de2c (0x356c bytes) 000298 1788330104.611338 mapread 0x034932 thru 0x03b4a5 (0x6b74 bytes) 000299 1788330104.630464 write 0x016cd8 thru 0x01abb6 (0x3edf bytes) 000300 1788330104.632035 trunc from 0x00142e to 0x00afc7 (0x9b9a bytes) 000301 1788330104.653353 read 0x009328 thru 0x015ec7 (0xcba0 bytes) 000302 1788330104.667706 trunc from 0x03f6f4 to 0x00ee6e (0x30885 bytes) 000303 1788330104.697888 MIRROR_RESYNC 4 mirrors 000304 1788330105.696400 mapread 0x005811 thru 0x008623 (0x2e13 bytes) 000305 1788330105.712917 mapwrite 0x01dcba thru 0x023ec2 (0x6209 bytes) 000306 1788330105.809359 trunc from 0x023ec3 to 0x020138 (0x3d8a bytes) 000307 1788330105.832026 fallocate 0x038df0 thru 0x03ffff (0x7210 bytes) 000308 1788330105.837514 fallocate 0x016982 thru 0x025220 (0xe89f bytes) 000309 1788330105.842479 write 0x006b21 thru 0x008d2a (0x220a bytes) 000310 1788330105.852841 punch from 0x007e7c to 0x009a66 (0x1beb bytes) 000311 1788330105.862236 mapwrite 0x013d6b thru 0x0239f8 (0xfc8e bytes) 000312 1788330105.907489 mapwrite 0x02f7a9 thru 0x032bad (0x3405 bytes) 000313 1788330105.934451 trunc from 0x040000 to 0x02f590 (0x10a6f bytes) 000314 1788330105.962818 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2f591): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f591): Mirror 3: 0x59af7626 (stale) Mirror 4: 0x59af7626 (stale) Mirror 5: 0x59af7626 (stale) CRC-32 checksum value for chunk [0, 0x2f591): Mirror 1: 0x5a1e423 Mirror 6: 0x5a1e423 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f591: skipped 000315 1788330107.081959 punch from 0x027c19 to 0x02eb49 (0x6f31 bytes) 000317 1788330107.123110 read 0x01513d thru 0x01723c (0x2100 bytes) 000318 1788330107.135795 mapread 0x00bb49 thru 0x01b96a (0xfe22 bytes) 000320 1788330107.162418 mapread 0x02af62 thru 0x02f590 (0x462f bytes) 000321 1788330107.186116 mapread 0x0294f3 thru 0x02f590 (0x609e bytes) 000322 1788330107.187157 mapwrite 0x00be61 thru 0x01209d (0x623d bytes) 000323 1788330107.213034 trunc from 0x02f591 to 0x00202b (0x2d565 bytes) 000325 1788330107.239682 punch from 0x0008d7 to 0x00202b (0x1755 bytes) 000326 1788330107.245978 fallocate 0x011ca4 thru 0x016fb4 (0x5311 bytes) 000327 1788330107.255000 mapread 0x00118b thru 0x00202b (0xea1 bytes) 000328 1788330107.261740 read 0x001b76 thru 0x00202b (0x4b6 bytes) 000329 1788330107.262777 trunc from 0x001d97 to 0x00202b (0x295 bytes) 000330 1788330107.267719 trunc from 0x000252 to 0x00202b (0x1dda bytes) 000331 1788330107.272728 punch from 0x000a1b to 0x00202b (0x1611 bytes) 000332 1788330107.278682 read 0x00066d thru 0x00202b (0x19bf bytes) 000333 1788330107.284713 mapwrite 0x02e553 thru 0x031121 (0x2bcf bytes) 000334 1788330107.339161 punch from 0x028b78 to 0x031121 (0x85aa bytes) 000335 1788330107.346537 mapwrite 0x03cd6d thru 0x03ffff (0x3293 bytes) 000336 1788330107.397801 mapwrite 0x003e63 thru 0x00bbd8 (0x7d76 bytes) 000337 1788330107.416914 trunc from 0x040000 to 0x032fb3 (0xd04c bytes) 000338 1788330107.438153 punch from 0x020ae8 to 0x029a21 (0x8f3a bytes) 000339 1788330107.453935 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32fb4): Mirror 3: 0x145c3070 (stale) Mirror 4: 0x145c3070 (stale) Mirror 5: 0x145c3070 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32fb4): Mirror 3: 0x145c3070 (stale) Mirror 4: 0x145c3070 (stale) Mirror 5: 0x145c3070 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32fb4: skipped 000340 1788330107.813083 mapwrite 0x037780 thru 0x03866f (0xef0 bytes) 000341 1788330107.860589 read 0x034026 thru 0x03866f (0x464a bytes) 000343 1788330107.866116 trunc from 0x009b90 to 0x01814f (0xe5c0 bytes) 000344 1788330107.871258 mapread 0x00f21e thru 0x00f783 (0x566 bytes) 000345 1788330107.888841 MIRROR_RESYNC 4 mirrors 000346 1788330109.019561 write 0x03a22d thru 0x03ffff (0x5dd3 bytes) 000347 1788330109.060333 trunc from 0x040000 to 0x029ede (0x16121 bytes) 000348 1788330109.080206 read 0x004ed3 thru 0x00f3ef (0xa51d bytes) 000349 1788330109.097891 mapwrite 0x00e831 thru 0x01c8dc (0xe0ac bytes) 000350 1788330109.166547 fallocate 0x01c33c thru 0x01f217 (0x2edc bytes) 000351 1788330109.174014 trunc from 0x029edf to 0x02cc3a (0x2d5c bytes) 000352 1788330109.189721 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2cc3b): Mirror 3: 0x979ff980 (stale) Mirror 5: 0x979ff980 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cc3b): Mirror 3: 0x979ff980 (stale) Mirror 5: 0x979ff980 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cc3b: skipped 000353 1788330109.557765 write 0x01c628 thru 0x02592a (0x9303 bytes) 000354 1788330109.586750 punch from 0x01d963 to 0x02cb72 (0xf210 bytes) 000355 1788330109.621478 mapread 0x00a6db thru 0x00ad13 (0x639 bytes) 000356 1788330109.630630 punch from 0x013d41 to 0x0160e1 (0x23a1 bytes) 000357 1788330109.636553 trunc from 0x02cc3b to 0x010681 (0x1c5b9 bytes) 000358 1788330109.653069 punch from 0x00f7af to 0x010681 (0xed3 bytes) 000359 1788330109.662479 trunc from 0x0032c8 to 0x00f065 (0xbd9e bytes) 000360 1788330109.667906 punch from 0x00d70b to 0x00df62 (0x858 bytes) 000362 1788330109.678897 mapread 0x000374 thru 0x00e7e3 (0xe470 bytes) 000363 1788330109.698551 trunc from 0x00a5e9 to 0x010681 (0x6099 bytes) 000364 1788330109.703402 trunc from 0x003fa1 to 0x00472a (0x78a bytes) 000365 1788330109.708115 read 0x00dc91 thru 0x010681 (0x29f1 bytes) 000366 1788330109.714076 fallocate 0x01f558 thru 0x023b28 (0x45d1 bytes) 000367 1788330109.718560 trunc from 0x010682 to 0x00aff7 (0x568a bytes) 000368 1788330109.732540 fallocate 0x00e49f thru 0x01abe8 (0xc74a bytes) 000370 1788330109.737914 write 0x02505d thru 0x028f79 (0x3f1d bytes) 000371 1788330109.739904 mapwrite 0x01d499 thru 0x027733 (0xa29b bytes) 000372 1788330109.762902 punch from 0x0242a1 to 0x028f79 (0x4cd9 bytes) 000377 1788330109.769710 write 0x027618 thru 0x02f28c (0x7c75 bytes) 000378 1788330109.778350 mapread 0x007d90 thru 0x00bab7 (0x3d28 bytes) 000379 1788330109.788650 read 0x00d95b thru 0x011b3b (0x41e1 bytes) 000380 1788330109.789222 fallocate 0x01d4e5 thru 0x01e55d (0x1079 bytes) 000381 1788330109.793926 write 0x006043 thru 0x009635 (0x35f3 bytes) 000382 1788330109.796444 trunc from 0x009881 to 0x00c239 (0x29b9 bytes) 000383 1788330109.814529 write 0x03d682 thru 0x03ffff (0x297e bytes) 000384 1788330109.815866 punch from 0x02d9ec to 0x03c2b1 (0xe8c6 bytes) 000385 1788330109.821535 mapread 0x02d1b7 thru 0x03221d (0x5067 bytes) 000386 1788330109.832081 trunc from 0x00a974 to 0x00ca75 (0x2102 bytes) 000387 1788330109.836690 write 0x00b23a thru 0x0178b6 (0xc67d bytes) 000388 1788330109.841912 trunc from 0x040000 to 0x0324f3 (0xdb0c bytes) 000389 1788330109.857051 read 0x001800 thru 0x0093fd (0x7bfe bytes) 000390 1788330109.858875 mapwrite 0x027a7b thru 0x036905 (0xee8b bytes) 000391 1788330109.910126 write 0x03c5b3 thru 0x03ffff (0x3a4d bytes) 000392 1788330109.911373 read 0x024fe3 thru 0x02e2d8 (0x92f6 bytes) 000393 1788330109.912186 mapwrite 0x0252f8 thru 0x025cd6 (0x9df bytes) 000394 1788330109.929170 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3a42145c (stale) Mirror 5: 0x3a42145c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x490b4eb3 Mirror 6: 0x490b4eb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000395 1788330111.260631 write 0x0174b4 thru 0x01ba66 (0x45b3 bytes) 000396 1788330111.314978 trunc from 0x011e8a to 0x013e24 (0x1f9b bytes) 000397 1788330111.320087 mapwrite 0x011f67 thru 0x012d8c (0xe26 bytes) 000398 1788330111.347964 write 0x005f35 thru 0x00e8aa (0x8976 bytes) 000399 1788330111.360408 read 0x00c342 thru 0x00db73 (0x1832 bytes) 000400 1788330111.361031 mapwrite 0x03e800 thru 0x03ffff (0x1800 bytes) 000401 1788330111.388044 fallocate 0x024a53 thru 0x02e384 (0x9932 bytes) 000402 1788330111.393909 fallocate 0x0253cc thru 0x0308a4 (0xb4d9 bytes) 000403 1788330111.406926 write 0x01ab1f thru 0x028a0d (0xdeef bytes) 000404 1788330111.427491 trunc from 0x017547 to 0x01a59e (0x3058 bytes) 000405 1788330111.466327 trunc from 0x040000 to 0x011d26 (0x2e2d9 bytes) 000406 1788330111.494873 fallocate 0x00f4d0 thru 0x0187b6 (0x92e7 bytes) 000407 1788330111.511462 punch from 0x005ca9 to 0x00e2f5 (0x864d bytes) 000408 1788330111.535113 MIRROR_RESYNC 4 mirrors 000409 1788330112.555066 read 0x00e94e thru 0x010f9e (0x2651 bytes) 000410 1788330112.563567 trunc from 0x00f60e to 0x013f0e (0x4901 bytes) 000411 1788330112.626244 trunc from 0x0047e7 to 0x011248 (0xca62 bytes) 000412 1788330112.652703 MIRROR_RESYNC 4 mirrors 000413 1788330113.702479 trunc from 0x0187b7 to 0x01150d (0x72a9 bytes) 000414 1788330113.749172 mapread 0x010225 thru 0x01150d (0x12e9 bytes) 000415 1788330113.771105 fallocate 0x00a292 thru 0x0120d8 (0x7e47 bytes) 000416 1788330113.792122 trunc from 0x01150e to 0x02f3a0 (0x1de93 bytes) 000417 1788330113.831036 trunc from 0x02f3a1 to 0x017b8a (0x17816 bytes) 000418 1788330113.854033 read 0x00af00 thru 0x012b82 (0x7c83 bytes) 000419 1788330113.878763 read 0x0142c9 thru 0x017b8a (0x38c2 bytes) 000420 1788330113.915051 mapread 0x00a690 thru 0x010435 (0x5da6 bytes) 000421 1788330113.916157 read 0x001b94 thru 0x006816 (0x4c83 bytes) 000422 1788330113.916919 fallocate 0x034f99 thru 0x035ab6 (0xb1e bytes) 000423 1788330113.926586 mapwrite 0x0133cb thru 0x01eea0 (0xbad6 bytes) 000424 1788330113.977367 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1eea1): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1eea1): Mirror 3: 0x9270f574 (stale) Mirror 5: 0x9270f574 (stale) Mirror 6: 0x9270f574 (stale) CRC-32 checksum value for chunk [0, 0x1eea1): Mirror 1: 0xe370e6 Mirror 7: 0xe370e6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1eea1: skipped 000425 1788330114.904029 mapread 0x015403 thru 0x01eea0 (0x9a9e bytes) 000426 1788330114.962075 read 0x0169cb thru 0x01bf67 (0x559d bytes) 000427 1788330114.977502 fallocate 0x003371 thru 0x00ae33 (0x7ac3 bytes) 000428 1788330115.039077 write 0x03575a thru 0x03b19f (0x5a46 bytes) 000429 1788330115.050922 trunc from 0x03b1a0 to 0x01afde (0x201c1 bytes) 000433 1788330115.094794 trunc from 0x01afdf to 0x026ad3 (0xbaf5 bytes) 000434 1788330115.124528 trunc from 0x026ad4 to 0x019bb9 (0xcf1a bytes) 000435 1788330115.147090 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x19bba): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19bba): Mirror 3: 0xd4aeddd (stale) Mirror 5: 0xd4aeddd (stale) Mirror 6: 0xd4aeddd (stale) Mirror 7: 0x4552d6f3 (stale) CRC-32 checksum value for chunk [0, 0x19bba): Mirror 1: 0x4552d6f3 Mirror 8: 0x4552d6f3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19bba: skipped 000436 1788330116.294004 trunc from 0x019bba to 0x0237e5 (0x9c2c bytes) 000437 1788330116.342899 trunc from 0x002427 to 0x00a87e (0x8458 bytes) 000438 1788330116.348303 mapread 0x0167db thru 0x01df1e (0x7744 bytes) 000439 1788330116.365253 mapwrite 0x020353 thru 0x02703e (0x6cec bytes) 000440 1788330116.422377 MIRROR_RESYNC 6 mirrors 000441 1788330117.842556 punch from 0x022c99 to 0x02703e (0x43a6 bytes) 000442 1788330117.906687 punch from 0x01892a to 0x01a58d (0x1c64 bytes) 000445 1788330117.916964 fallocate 0x00d870 thru 0x01a555 (0xcce6 bytes) 000446 1788330117.943699 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2703f): Mirror 5: 0x70dc961a (stale) Mirror 6: 0x70dc961a (stale) Mirror 7: 0x70dc961a (stale) Mirror 8: 0x70dc961a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2703f): Mirror 5: 0x70dc961a (stale) Mirror 6: 0x70dc961a (stale) Mirror 7: 0x70dc961a (stale) Mirror 8: 0x70dc961a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2703f: skipped 000447 1788330118.419789 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2703f): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2703f): Mirror 5: 0x70dc961a (stale) Mirror 6: 0x70dc961a (stale) Mirror 7: 0x70dc961a (stale) Mirror 8: 0x70dc961a (stale) CRC-32 checksum value for chunk [0, 0x2703f): Mirror 1: 0x25cfeaba Mirror 9: 0x25cfeaba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2703f: skipped 000448 1788330119.497404 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2703f): Mirror 5: 0x70dc961a (stale) Mirror 6: 0x70dc961a (stale) Mirror 8: 0x70dc961a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2703f): Mirror 5: 0x70dc961a (stale) Mirror 6: 0x70dc961a (stale) Mirror 8: 0x70dc961a (stale) CRC-32 checksum value for chunk [0, 0x2703f): Mirror 1: 0x25cfeaba Mirror 9: 0x25cfeaba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2703f: skipped 000449 1788330120.201720 MIRROR_RESYNC 5 mirrors 000450 1788330121.641541 trunc from 0x02703f to 0x00194b (0x256f3 bytes) 000451 1788330121.696460 trunc from 0x000acb to 0x00194b (0xe81 bytes) 000452 1788330121.702038 trunc from 0x0018c4 to 0x00194b (0x88 bytes) 000453 1788330121.709398 trunc from 0x000ce8 to 0x00194b (0xc64 bytes) 000454 1788330121.715374 mapread 0x001739 thru 0x00194b (0x213 bytes) 000455 1788330121.721492 write 0x01f414 thru 0x026066 (0x6c53 bytes) 000456 1788330121.723373 trunc from 0x026067 to 0x01446d (0x11bf9 bytes) 000457 1788330121.765243 trunc from 0x00db6e to 0x01446d (0x6900 bytes) 000458 1788330121.770861 punch from 0x0026e3 to 0x004ee3 (0x2801 bytes) 000459 1788330121.782720 trunc from 0x01446e to 0x03eb83 (0x2a716 bytes) 000460 1788330121.803302 write 0x0307fd thru 0x039c87 (0x948b bytes) 000461 1788330121.816606 mapread 0x01e441 thru 0x02655a (0x811a bytes) 000462 1788330121.832257 trunc from 0x03eb84 to 0x015861 (0x29322 bytes) 000463 1788330121.852093 trunc from 0x013223 to 0x015861 (0x263f bytes) 000464 1788330121.860799 write 0x02b933 thru 0x036d66 (0xb434 bytes) 000465 1788330121.863923 trunc from 0x002ff8 to 0x0077fc (0x4805 bytes) 000466 1788330121.870115 write 0x000d4c thru 0x00fac2 (0xed77 bytes) 000467 1788330121.883043 punch from 0x023837 to 0x02780f (0x3fd9 bytes) 000468 1788330121.887957 trunc from 0x036d67 to 0x014fa3 (0x21dc3 bytes) 000469 1788330121.925033 write 0x030b8d thru 0x03bc08 (0xb07c bytes) 000470 1788330121.928003 mapwrite 0x02d69d thru 0x038488 (0xadec bytes) 000471 1788330121.964999 mapread 0x00523f thru 0x00b184 (0x5f46 bytes) 000472 1788330121.965916 mapwrite 0x02a372 thru 0x02bb0f (0x179e bytes) 000473 1788330121.978382 write 0x017f1e thru 0x01bac2 (0x3ba5 bytes) 000474 1788330121.987694 read 0x038fc3 thru 0x03bc08 (0x2c46 bytes) 000475 1788330121.988757 punch from 0x03147b to 0x03bc08 (0xa78e bytes) 000476 1788330121.994125 mapwrite 0x01e0db thru 0x028d80 (0xaca6 bytes) 000477 1788330122.025150 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bc09): Mirror 5: 0x8e4362c5 (stale) Mirror 6: 0x8e4362c5 (stale) Mirror 9: 0x8e4362c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc09): Mirror 5: 0x8e4362c5 (stale) Mirror 6: 0x8e4362c5 (stale) Mirror 9: 0x8e4362c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc09: skipped 000478 1788330122.538445 mapread 0x036030 thru 0x03bc08 (0x5bd9 bytes) 000479 1788330122.567324 trunc from 0x014107 to 0x018f68 (0x4e62 bytes) 000480 1788330122.578161 mapwrite 0x031fa9 thru 0x032990 (0x9e8 bytes) 000481 1788330122.599916 mapread 0x018fa3 thru 0x026a41 (0xda9f bytes) 000482 1788330122.621863 trunc from 0x03bc09 to 0x019e0d (0x21dfb bytes) 000483 1788330122.645451 mapread 0x002717 thru 0x010d4e (0xe638 bytes) 000484 1788330122.655372 fallocate 0x029996 thru 0x030afe (0x7169 bytes) 000485 1788330122.661485 punch from 0x012dfc to 0x019e0d (0x7012 bytes) 000486 1788330122.666127 fallocate 0x005bad thru 0x00b2e6 (0x573a bytes) 000487 1788330122.670930 punch from 0x00cce7 to 0x011735 (0x4a4f bytes) 000488 1788330122.679766 MIRROR_RESYNC 4 mirrors 000489 1788330123.663482 fallocate 0x026745 thru 0x031a63 (0xb31f bytes) 000491 1788330123.719563 mapwrite 0x01aec3 thru 0x02600d (0xb14b bytes) 000492 1788330123.830089 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2600e): Mirror 6: 0x48266203 (stale) Mirror 9: 0x48266203 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2600e): Mirror 6: 0x48266203 (stale) Mirror 9: 0x48266203 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2600e: skipped 000494 1788330124.247855 mapread 0x002092 thru 0x0066fa (0x4669 bytes) 000495 1788330124.265053 mapwrite 0x0047f6 thru 0x009daf (0x55ba bytes) 000496 1788330124.281563 trunc from 0x000763 to 0x0032da (0x2b78 bytes) 000497 1788330124.286966 punch from 0x0188fb to 0x0189ff (0x105 bytes) 000498 1788330124.291464 write 0x016546 thru 0x018f30 (0x29eb bytes) 000499 1788330124.321022 mapread 0x012e3e thru 0x017fa2 (0x5165 bytes) 000500 1788330124.344721 trunc from 0x01eca5 to 0x022fb6 (0x4312 bytes) 000501 1788330124.351391 read 0x01b6ca thru 0x01c0db (0xa12 bytes) 000502 1788330124.372434 write 0x014ca0 thru 0x01cf26 (0x8287 bytes) 000503 1788330124.374003 write 0x03de2c thru 0x03ffff (0x21d4 bytes) 000504 1788330124.378976 mapread 0x0091c1 thru 0x0156b4 (0xc4f4 bytes) 000505 1788330124.381820 mapread 0x004fd2 thru 0x00cf97 (0x7fc6 bytes) 000506 1788330124.394315 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xda4fddff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xda4fddff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000507 1788330124.884523 fallocate 0x009a5e thru 0x01917f (0xf722 bytes) 000508 1788330124.889010 read 0x01a9dd thru 0x01b0a7 (0x6cb bytes) 000509 1788330124.895065 mapwrite 0x0092a8 thru 0x00bc15 (0x296e bytes) 000510 1788330124.946448 trunc from 0x03455c to 0x03de18 (0x98bd bytes) 000511 1788330124.953120 punch from 0x00935b to 0x00f1db (0x5e81 bytes) 000512 1788330124.962221 read 0x01fc5e thru 0x024991 (0x4d34 bytes) 000514 1788330124.977131 punch from 0x034f65 to 0x03dae0 (0x8b7c bytes) 000515 1788330124.982856 fallocate 0x00bf7f thru 0x019ee1 (0xdf63 bytes) 000516 1788330124.991127 punch from 0x02e737 to 0x03bd78 (0xd642 bytes) 000517 1788330125.002652 write 0x00b1e7 thru 0x00d344 (0x215e bytes) 000518 1788330125.010646 fallocate 0x015e16 thru 0x01d80b (0x79f6 bytes) 000519 1788330125.024666 mapread 0x030b09 thru 0x033a07 (0x2eff bytes) 000520 1788330125.058250 write 0x00f322 thru 0x015778 (0x6457 bytes) 000521 1788330125.059410 write 0x0144e8 thru 0x01f531 (0xb04a bytes) 000522 1788330125.060640 mapread 0x01d6aa thru 0x0250bd (0x7a14 bytes) 000523 1788330125.061493 fallocate 0x03aa99 thru 0x03ffff (0x5567 bytes) 000524 1788330125.070093 read 0x00a5d0 thru 0x01563e (0xb06f bytes) 000525 1788330125.071062 punch from 0x018c72 to 0x01ed42 (0x60d1 bytes) 000526 1788330125.088606 read 0x00fb61 thru 0x015636 (0x5ad6 bytes) 000527 1788330125.089248 mapwrite 0x0003db thru 0x002c38 (0x285e bytes) 000528 1788330125.116358 MIRROR_RESYNC 2 mirrors 000529 1788330126.018890 read 0x03c105 thru 0x03ffff (0x3efb bytes) 000530 1788330126.024122 trunc from 0x029a39 to 0x038b59 (0xf121 bytes) 000531 1788330126.070458 punch from 0x025388 to 0x026e39 (0x1ab2 bytes) 000532 1788330126.076837 write 0x025959 thru 0x0352c8 (0xf970 bytes) 000533 1788330126.088586 trunc from 0x00c93c to 0x01b321 (0xe9e6 bytes) 000534 1788330126.094438 write 0x03ce40 thru 0x03ffff (0x31c0 bytes) 000535 1788330126.099158 mapread 0x038df5 thru 0x03e126 (0x5332 bytes) 000536 1788330126.120015 trunc from 0x040000 to 0x03bcfc (0x4303 bytes) 000537 1788330126.169230 write 0x03f6f7 thru 0x03ffff (0x909 bytes) 000538 1788330126.170155 write 0x024623 thru 0x027de1 (0x37bf bytes) 000539 1788330126.177408 mapwrite 0x015277 thru 0x0195b1 (0x433b bytes) 000540 1788330126.251562 mapwrite 0x01b4f6 thru 0x025ee9 (0xa9f4 bytes) 000541 1788330126.300006 fallocate 0x021d7b thru 0x0293e0 (0x7666 bytes) 000543 1788330126.317120 fallocate 0x015c12 thru 0x01f456 (0x9845 bytes) 000544 1788330126.332402 write 0x025397 thru 0x027853 (0x24bd bytes) 000546 1788330126.341703 read 0x005055 thru 0x00eedc (0x9e88 bytes) 000547 1788330126.370588 mapread 0x0266e4 thru 0x035b37 (0xf454 bytes) 000548 1788330126.371465 trunc from 0x040000 to 0x02c6cf (0x13930 bytes) 000549 1788330126.426650 write 0x033d83 thru 0x038ed2 (0x5150 bytes) 000550 1788330126.432733 punch from 0x011afe to 0x0136ba (0x1bbd bytes) 000551 1788330126.451114 MIRROR_RESYNC 2 mirrors 000552 1788330127.633120 trunc from 0x038ed3 to 0x00e547 (0x2a98b bytes) 000553 1788330127.674960 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xe548): Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe548): Mirror 9: 0x7481f17a (stale) CRC-32 checksum value for chunk [0, 0xe548): Mirror 1: 0x7481f17a Mirror 10: 0x7481f17a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe548: skipped 000554 1788330128.484161 fallocate 0x024cca thru 0x02a931 (0x5c68 bytes) 000555 1788330128.591332 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe548): Mirror 10: 0x7481f17a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe548): Mirror 10: 0x7481f17a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe548: skipped 000556 1788330129.039093 trunc from 0x008eaf to 0x00d200 (0x4352 bytes) 000558 1788330129.074412 read 0x00504b thru 0x00e547 (0x94fd bytes) 000559 1788330129.088414 write 0x037080 thru 0x03ffff (0x8f80 bytes) 000560 1788330129.095003 mapwrite 0x03c046 thru 0x03ffff (0x3fba bytes) 000561 1788330129.123379 mapread 0x01d49e thru 0x025e12 (0x8975 bytes) 000562 1788330129.150616 punch from 0x0368ff to 0x03ffff (0x9701 bytes) 000563 1788330129.157530 trunc from 0x030d82 to 0x031758 (0x9d7 bytes) 000564 1788330129.161841 read 0x037b30 thru 0x03ffff (0x84d0 bytes) 000565 1788330129.180921 fallocate 0x0289f1 thru 0x02ef4e (0x655e bytes) 000566 1788330129.192553 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x7fbd8746 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe4830e4a Mirror 11: 0xe4830e4a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000567 1788330129.992046 fallocate 0x03b300 thru 0x03ffff (0x4d00 bytes) 000568 1788330130.039974 punch from 0x01247a to 0x01ccab (0xa832 bytes) 000570 1788330130.047197 mapwrite 0x0392b0 thru 0x03e13f (0x4e90 bytes) 000571 1788330130.118057 trunc from 0x040000 to 0x023f05 (0x1c0fa bytes) 000572 1788330130.192182 write 0x00636d thru 0x0160ed (0xfd81 bytes) 000573 1788330130.211225 punch from 0x013ab6 to 0x020681 (0xcbcc bytes) 000574 1788330130.240413 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23f06): Mirror 11: 0x73ebc9e6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23f06): Mirror 11: 0x73ebc9e6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23f06: skipped 000575 1788330130.623543 mapread 0x007337 thru 0x00b0a1 (0x3d6b bytes) 000577 1788330130.649816 trunc from 0x023f06 to 0x01819c (0xbd69 bytes) 000578 1788330130.696993 punch from 0x00e12b to 0x017b4a (0x9a20 bytes) 000579 1788330130.710903 read 0x006e0d thru 0x00d57a (0x676e bytes) 000580 1788330130.711526 trunc from 0x01819d to 0x037c09 (0x1fa6d bytes) 000582 1788330130.744611 punch from 0x0054d6 to 0x011edb (0xca06 bytes) 000583 1788330130.749888 fallocate 0x028760 thru 0x0382d1 (0xfb72 bytes) 000584 1788330130.770367 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x37c0a): Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c0a): Mirror 11: 0x26f1baa8 (stale) CRC-32 checksum value for chunk [0, 0x37c0a): Mirror 1: 0xea4a461c Mirror 12: 0xea4a461c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c0a: skipped 000585 1788330132.193620 mapread 0x02016c thru 0x02c69a (0xc52f bytes) 000586 1788330132.280014 mapwrite 0x018c09 thru 0x023032 (0xa42a bytes) 000587 1788330132.493378 trunc from 0x016374 to 0x022375 (0xc002 bytes) 000588 1788330132.500041 mapread 0x0126bd thru 0x01668f (0x3fd3 bytes) 000589 1788330132.516674 trunc from 0x037c0a to 0x0371a2 (0xa67 bytes) 000590 1788330132.565754 trunc from 0x0254d6 to 0x0324e0 (0xd00b bytes) 000591 1788330132.574232 trunc from 0x0371a3 to 0x01cd2b (0x1a477 bytes) 000593 1788330132.627196 trunc from 0x003a3e to 0x00a8b6 (0x6e79 bytes) 000594 1788330132.638918 write 0x023712 thru 0x03139d (0xdc8c bytes) 000595 1788330132.641579 trunc from 0x021d31 to 0x030127 (0xe3f7 bytes) 000596 1788330132.656755 punch from 0x01427f to 0x019ff8 (0x5d7a bytes) 000597 1788330132.662053 mapwrite 0x0136f8 thru 0x01fed9 (0xc7e2 bytes) 000598 1788330132.704572 punch from 0x018cfc to 0x0231ca (0xa4cf bytes) 000599 1788330132.711686 read 0x02b41c thru 0x02d2fb (0x1ee0 bytes) 000600 1788330132.717998 mapwrite 0x02561f thru 0x03153d (0xbf1f bytes) 000601 1788330132.776065 mapread 0x00d98c thru 0x01a8c6 (0xcf3b bytes) 000602 1788330132.786942 read 0x025796 thru 0x029ecc (0x4737 bytes) 000603 1788330132.788344 mapwrite 0x015dde thru 0x0161cd (0x3f0 bytes) 000604 1788330132.822345 write 0x02550d thru 0x02803d (0x2b31 bytes) 000605 1788330132.823348 write 0x03870e thru 0x03c02d (0x3920 bytes) 000606 1788330132.833342 MIRROR_RESYNC 3 mirrors 000607 1788330133.998560 trunc from 0x004d31 to 0x009f99 (0x5269 bytes) 000608 1788330134.035578 mapread 0x02ccf0 thru 0x03459c (0x78ad bytes) 000609 1788330134.065666 read 0x038a32 thru 0x03c02d (0x35fc bytes) 000610 1788330134.075994 trunc from 0x03c02e to 0x01ccd2 (0x1f35b bytes) 000611 1788330134.130578 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1ccd3): Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ccd3): Mirror 11: 0x3359fbdc (stale) Mirror 12: 0x3359fbdc (stale) CRC-32 checksum value for chunk [0, 0x1ccd3): Mirror 1: 0x3359fbdc Mirror 13: 0x3359fbdc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ccd3: skipped 000612 1788330135.235156 MIRROR_RESYNC 4 mirrors 000613 1788330136.146089 fallocate 0x020407 thru 0x02fc07 (0xf801 bytes) 000614 1788330136.221013 read 0x012070 thru 0x01435e (0x22ef bytes) 000615 1788330136.252215 punch from 0x014b7c to 0x019171 (0x45f6 bytes) 000616 1788330136.265201 trunc from 0x01ccd3 to 0x01087b (0xc457 bytes) 000618 1788330136.374051 read 0x004a66 thru 0x005a70 (0x100b bytes) 000619 1788330136.394566 mapwrite 0x008bdf thru 0x012c68 (0xa08a bytes) 000620 1788330136.450441 fallocate 0x0346e0 thru 0x03ffff (0xb920 bytes) 000621 1788330136.461848 trunc from 0x03be6b to 0x03ffff (0x4195 bytes) 000622 1788330136.479701 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x87211b6e (stale) Mirror 12: 0x87211b6e (stale) Mirror 13: 0x87211b6e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9c35c779 Mirror 14: 0x9c35c779 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000624 1788330137.552722 trunc from 0x040000 to 0x032cdb (0xd324 bytes) 000625 1788330137.638718 fallocate 0x0250b5 thru 0x02ede4 (0x9d30 bytes) 000627 1788330137.645484 trunc from 0x032cdc to 0x01d91d (0x153be bytes) 000628 1788330137.679117 trunc from 0x01d91e to 0x0321e6 (0x148c9 bytes) 000629 1788330137.697134 mapwrite 0x033fbb thru 0x035bbd (0x1c03 bytes) 000631 1788330137.757854 punch from 0x02067a to 0x025aac (0x5433 bytes) 000632 1788330137.765159 trunc from 0x035bbe to 0x01fb16 (0x160a7 bytes) 000633 1788330137.786530 MIRROR_RESYNC 5 mirrors 000634 1788330139.441044 mapwrite 0x007fd2 thru 0x00d85a (0x5889 bytes) 000635 1788330139.555776 trunc from 0x00198e to 0x00da9b (0xc10e bytes) 000636 1788330139.570225 trunc from 0x00ae45 to 0x00fc2c (0x4de8 bytes) 000637 1788330139.580688 punch from 0x0135d9 to 0x01d5a8 (0x9fd0 bytes) 000638 1788330139.589615 read 0x01e289 thru 0x01fb16 (0x188e bytes) 000639 1788330139.599184 trunc from 0x01f2c9 to 0x01fb16 (0x84e bytes) 000640 1788330139.607866 fallocate 0x027fd1 thru 0x02931b (0x134b bytes) 000641 1788330139.618237 trunc from 0x02931c to 0x036325 (0xd00a bytes) 000642 1788330139.663614 mapwrite 0x033741 thru 0x038b0d (0x53cd bytes) 000643 1788330139.721865 mapwrite 0x030b59 thru 0x03965b (0x8b03 bytes) 000644 1788330139.777203 read 0x024042 thru 0x0261cb (0x218a bytes) 000645 1788330139.794401 write 0x00823c thru 0x015601 (0xd3c6 bytes) 000646 1788330139.800922 fallocate 0x005fed thru 0x00bb32 (0x5b46 bytes) 000647 1788330139.808718 fallocate 0x00fe60 thru 0x010d62 (0xf03 bytes) 000648 1788330139.826033 write 0x007be8 thru 0x00953a (0x1953 bytes) 000649 1788330139.832342 mapread 0x02bf72 thru 0x02c9e6 (0xa75 bytes) 000650 1788330139.833260 trunc from 0x03965c to 0x008ee4 (0x30777 bytes) 000651 1788330139.863380 read 0x008e91 thru 0x008ee4 (0x54 bytes) 000652 1788330139.863945 trunc from 0x008ee5 to 0x02a975 (0x21a91 bytes) 000653 1788330139.879719 fallocate 0x03137c thru 0x03de36 (0xcabb bytes) 000654 1788330139.892575 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3de37): Mirror 12: 0x730ba5e7 (stale) Mirror 13: 0x730ba5e7 (stale) Mirror 14: 0x730ba5e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de37): Mirror 12: 0x730ba5e7 (stale) Mirror 13: 0x730ba5e7 (stale) Mirror 14: 0x730ba5e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de37: skipped 000655 1788330140.452815 write 0x00de15 thru 0x00eb0c (0xcf8 bytes) 000656 1788330140.480772 write 0x019219 thru 0x02507e (0xbe66 bytes) 000657 1788330140.500076 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3de37): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de37): Mirror 12: 0x730ba5e7 (stale) Mirror 13: 0x730ba5e7 (stale) Mirror 14: 0x730ba5e7 (stale) CRC-32 checksum value for chunk [0, 0x3de37): Mirror 1: 0x59c35530 Mirror 15: 0x59c35530 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de37: skipped 000658 1788330142.007233 write 0x00ef07 thru 0x017d73 (0x8e6d bytes) 000659 1788330142.082995 write 0x03cd98 thru 0x03ffff (0x3268 bytes) 000660 1788330142.095925 fallocate 0x013454 thru 0x018220 (0x4dcd bytes) 000661 1788330142.130528 MIRROR_RESYNC 5 mirrors 000662 1788330144.726963 fallocate 0x00d270 thru 0x013889 (0x661a bytes) 000664 1788330144.786658 punch from 0x017465 to 0x022cbe (0xb85a bytes) 000665 1788330144.798703 trunc from 0x040000 to 0x01a9a1 (0x2565e bytes) 000666 1788330144.872437 trunc from 0x00bc2c to 0x019be4 (0xdfb9 bytes) 000667 1788330144.880253 trunc from 0x001d05 to 0x00989d (0x7b99 bytes) 000668 1788330144.898936 fallocate 0x009c69 thru 0x014e22 (0xb1ba bytes) 000669 1788330144.911428 trunc from 0x01a9a2 to 0x00d657 (0xd34a bytes) 000670 1788330144.935608 read 0x00ae5e thru 0x00d657 (0x27fa bytes) 000671 1788330144.952905 read 0x000026 thru 0x00707c (0x7057 bytes) 000672 1788330144.963823 trunc from 0x0039f5 to 0x0061e5 (0x27f1 bytes) 000673 1788330144.973512 read 0x00454d thru 0x008cf7 (0x47ab bytes) 000674 1788330144.979484 punch from 0x002c34 to 0x00d4ac (0xa879 bytes) 000675 1788330144.986718 trunc from 0x00626c to 0x00d657 (0x73ec bytes) 000676 1788330144.997063 MIRROR_RESYNC 5 mirrors 000677 1788330146.024716 trunc from 0x00d658 to 0x033cfe (0x266a7 bytes) 000678 1788330146.054441 fallocate 0x03a7fe thru 0x03ffff (0x5802 bytes) 000680 1788330146.062678 fallocate 0x03a2fd thru 0x03ffff (0x5d03 bytes) 000681 1788330146.068496 mapread 0x007d72 thru 0x00df92 (0x6221 bytes) 000682 1788330146.086206 mapread 0x0214cc thru 0x02edd2 (0xd907 bytes) 000683 1788330146.109564 write 0x039c24 thru 0x03ffff (0x63dc bytes) 000684 1788330146.111540 trunc from 0x027bf8 to 0x0297cf (0x1bd8 bytes) 000685 1788330146.117333 write 0x00f345 thru 0x01d9ce (0xe68a bytes) 000686 1788330146.126830 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x754a3a8c (stale) Mirror 13: 0x754a3a8c (stale) Mirror 14: 0x754a3a8c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x754a3a8c (stale) Mirror 13: 0x754a3a8c (stale) Mirror 14: 0x754a3a8c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000687 1788330146.645472 read 0x031cea thru 0x03f63d (0xd954 bytes) 000688 1788330146.665474 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x754a3a8c (stale) Mirror 14: 0x754a3a8c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x754a3a8c (stale) Mirror 14: 0x754a3a8c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000689 1788330146.983172 mapread 0x02f60f thru 0x0371ca (0x7bbc bytes) 000690 1788330147.013856 punch from 0x011cd7 to 0x021a73 (0xfd9d bytes) 000691 1788330147.019914 read 0x003005 thru 0x004068 (0x1064 bytes) 000692 1788330147.032577 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x754a3a8c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x754a3a8c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000693 1788330147.409234 trunc from 0x040000 to 0x018141 (0x27ebe bytes) 000694 1788330147.452504 write 0x00a0c5 thru 0x019c66 (0xfba2 bytes) 000695 1788330147.464998 mapwrite 0x004c44 thru 0x00a881 (0x5c3e bytes) 000696 1788330147.561179 write 0x024f98 thru 0x025b44 (0xbad bytes) 000697 1788330147.562378 mapwrite 0x018c18 thru 0x019525 (0x90e bytes) 000698 1788330147.588711 trunc from 0x002a35 to 0x005e75 (0x3441 bytes) 000699 1788330147.598809 punch from 0x01308d to 0x01642c (0x33a0 bytes) 000700 1788330147.616580 trunc from 0x00968d to 0x012fec (0x9960 bytes) 000701 1788330147.625746 mapread 0x02079d thru 0x025b44 (0x53a8 bytes) 000702 1788330147.643655 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) 000703 1788330147.860666 mapwrite 0x012f73 thru 0x01e60b (0xb699 bytes) 000704 1788330147.955659 trunc from 0x010f73 to 0x0162e4 (0x5372 bytes) 000706 1788330147.977790 read 0x022db7 thru 0x025b44 (0x2d8e bytes) 000707 1788330147.981187 read 0x01cc81 thru 0x0247e3 (0x7b63 bytes) 000708 1788330147.986721 fallocate 0x00d316 thru 0x018974 (0xb65f bytes) 000709 1788330148.007065 mapwrite 0x021e96 thru 0x023302 (0x146d bytes) 000710 1788330148.043378 fallocate 0x0332e1 thru 0x03ce72 (0x9b92 bytes) 000712 1788330148.055872 trunc from 0x007686 to 0x010339 (0x8cb4 bytes) 000713 1788330148.071847 mapread 0x0007d4 thru 0x00d4de (0xcd0b bytes) 000715 1788330148.094943 punch from 0x00da35 to 0x0184a0 (0xaa6c bytes) 000716 1788330148.112868 punch from 0x009fb8 to 0x016df4 (0xce3d bytes) 000717 1788330148.127794 trunc from 0x01bf5b to 0x01e786 (0x282c bytes) 000718 1788330148.150036 mapwrite 0x01ecd8 thru 0x027075 (0x839e bytes) 000719 1788330148.291027 write 0x03983e thru 0x03ffff (0x67c2 bytes) 000720 1788330148.292433 mapread 0x028cf9 thru 0x034a87 (0xbd8f bytes) 000721 1788330148.317663 punch from 0x0179ba to 0x0187f1 (0xe38 bytes) 000722 1788330148.323623 write 0x03a7c2 thru 0x03ffff (0x583e bytes) 000724 1788330148.326838 trunc from 0x040000 to 0x025474 (0x1ab8b bytes) 000725 1788330148.366433 trunc from 0x024a6f to 0x025474 (0xa06 bytes) 000726 1788330148.380986 mapwrite 0x024883 thru 0x02eb1b (0xa299 bytes) 000727 1788330148.510695 fallocate 0x02ce47 thru 0x0304da (0x3694 bytes) 000728 1788330148.515505 write 0x03a721 thru 0x03ffff (0x58df bytes) 000729 1788330148.516886 fallocate 0x023580 thru 0x026b2e (0x35af bytes) 000730 1788330148.521705 trunc from 0x026bdc to 0x02d36d (0x6792 bytes) 000731 1788330148.526061 fallocate 0x02716f thru 0x02e15b (0x6fed bytes) 000732 1788330148.529870 write 0x008b47 thru 0x00d049 (0x4503 bytes) 000733 1788330148.534511 read 0x035b7a thru 0x03a0de (0x4565 bytes) 000734 1788330148.541226 fallocate 0x0141b8 thru 0x01b47a (0x72c3 bytes) 000735 1788330148.545152 punch from 0x03c160 to 0x03c8ab (0x74c bytes) 000737 1788330148.560066 trunc from 0x016633 to 0x01c206 (0x5bd4 bytes) 000739 1788330148.574914 fallocate 0x01aa25 thru 0x02a41d (0xf9f9 bytes) 000740 1788330148.579568 trunc from 0x040000 to 0x00098d (0x3f672 bytes) 000742 1788330148.601633 trunc from 0x000507 to 0x00098d (0x487 bytes) 000743 1788330148.609831 fallocate 0x03950e thru 0x03ffff (0x6af2 bytes) 000744 1788330148.614606 trunc from 0x017c74 to 0x02011b (0x84a8 bytes) 000745 1788330148.618879 trunc from 0x040000 to 0x028f59 (0x170a6 bytes) 000746 1788330148.635757 mapread 0x0185cc thru 0x01b793 (0x31c8 bytes) 000747 1788330148.661149 mapread 0x00e5c4 thru 0x011d1a (0x3757 bytes) 000748 1788330148.685156 mapwrite 0x0339c7 thru 0x03743f (0x3a79 bytes) 000749 1788330148.744431 trunc from 0x003662 to 0x006f44 (0x38e3 bytes) 000750 1788330148.748560 trunc from 0x0155e3 to 0x020d81 (0xb79f bytes) 000751 1788330148.755837 mapread 0x021510 thru 0x024d6a (0x385b bytes) 000755 1788330148.792684 fallocate 0x0306f8 thru 0x037727 (0x7030 bytes) 000756 1788330148.803477 write 0x03e243 thru 0x03ffff (0x1dbd bytes) 000757 1788330148.805136 punch from 0x017912 to 0x020587 (0x8c76 bytes) 000758 1788330148.816877 MIRROR_EXTEND to 2 mirrors 000759 1788330149.894336 read 0x010c5f thru 0x01c51e (0xb8c0 bytes) 000760 1788330149.919457 trunc from 0x00fb18 to 0x01c0c7 (0xc5b0 bytes) 000762 1788330149.959068 trunc from 0x02e0c6 to 0x02e81c (0x757 bytes) 000763 1788330149.964942 mapread 0x03a68e thru 0x03ffff (0x5972 bytes) 000764 1788330149.983064 write 0x0164c1 thru 0x0254ba (0xeffa bytes) 000765 1788330150.001007 trunc from 0x040000 to 0x023a98 (0x1c567 bytes) 000766 1788330150.035866 trunc from 0x010824 to 0x0162b9 (0x5a96 bytes) 000767 1788330150.055492 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) 000768 1788330150.221627 punch from 0x021fa4 to 0x023a98 (0x1af5 bytes) 000769 1788330150.227048 fallocate 0x02cc4b thru 0x036c43 (0x9ff9 bytes) 000770 1788330150.232535 write 0x01bbcb thru 0x02a012 (0xe448 bytes) 000772 1788330150.248589 read 0x026a8b thru 0x02a012 (0x3588 bytes) 000773 1788330150.249675 trunc from 0x0058fd to 0x011308 (0xba0c bytes) 000776 1788330150.273995 fallocate 0x0214b2 thru 0x02a858 (0x93a7 bytes) 000777 1788330150.283733 trunc from 0x01a81c to 0x01b90b (0x10f0 bytes) 000778 1788330150.306903 punch from 0x025ccd to 0x02a858 (0x4b8c bytes) 000779 1788330150.317717 trunc from 0x026b9a to 0x02a858 (0x3cbf bytes) 000780 1788330150.341347 trunc from 0x02a859 to 0x005841 (0x25017 bytes) 000781 1788330150.371830 trunc from 0x005842 to 0x0362fb (0x30aba bytes) 000782 1788330150.387762 mapread 0x00cc50 thru 0x01cae5 (0xfe96 bytes) 000783 1788330150.432703 punch from 0x02d783 to 0x0362fb (0x8b79 bytes) 000784 1788330150.436315 trunc from 0x0362fc to 0x0007aa (0x35b51 bytes) 000785 1788330150.452590 mapread 0x00061f thru 0x0007aa (0x18c bytes) 000786 1788330150.460204 read 0x0003b0 thru 0x0007aa (0x3fb bytes) 000787 1788330150.460821 fallocate 0x01a20f thru 0x022730 (0x8522 bytes) 000788 1788330150.467837 trunc from 0x0007ab to 0x0247ec (0x24042 bytes) 000789 1788330150.487704 fallocate 0x00d9bf thru 0x01a45f (0xcaa1 bytes) 000790 1788330150.497623 punch from 0x021719 to 0x0247ec (0x30d4 bytes) 000792 1788330150.508387 trunc from 0x0247ed to 0x0013a7 (0x23445 bytes) 000793 1788330150.568664 punch from 0x0011cf to 0x0013a7 (0x1d9 bytes) 000794 1788330150.575690 write 0x00adfe thru 0x00ee35 (0x4038 bytes) 000795 1788330150.577658 read 0x000a57 thru 0x00d9e7 (0xcf91 bytes) 000796 1788330150.592197 write 0x004e91 thru 0x005d1c (0xe8c bytes) 000797 1788330150.593570 mapwrite 0x029513 thru 0x02c6e7 (0x31d5 bytes) 000799 1788330150.678330 trunc from 0x009b0d to 0x010528 (0x6a1c bytes) 000800 1788330150.687449 fallocate 0x019a5f thru 0x02236d (0x890f bytes) 000802 1788330150.698817 punch from 0x00ed3f to 0x00ef97 (0x259 bytes) 000804 1788330150.704473 write 0x02f7fe thru 0x03b539 (0xbd3c bytes) 000806 1788330150.707661 trunc from 0x03b53a to 0x0332c9 (0x8270 bytes) 000807 1788330150.732540 trunc from 0x0332ca to 0x02ab14 (0x87b5 bytes) 000808 1788330150.762524 MIRROR_EXTEND to 2 mirrors 000810 1788330152.015972 read 0x009539 thru 0x01646b (0xcf33 bytes) 000811 1788330152.032003 punch from 0x01e640 to 0x022554 (0x3f15 bytes) 000812 1788330152.063855 trunc from 0x02ab15 to 0x00b6ac (0x1f468 bytes) 000813 1788330152.084811 read 0x008b30 thru 0x00b6ac (0x2b7d bytes) 000814 1788330152.096261 fallocate 0x002516 thru 0x010058 (0xdb43 bytes) 000815 1788330152.101092 trunc from 0x006c49 to 0x010058 (0x9410 bytes) 000816 1788330152.105831 write 0x020243 thru 0x02d9a3 (0xd761 bytes) 000817 1788330152.108847 write 0x019d9e thru 0x023d68 (0x9fcb bytes) 000818 1788330152.118448 punch from 0x02c5e6 to 0x02d9a3 (0x13be bytes) 000819 1788330152.133889 trunc from 0x02d9a4 to 0x02b8ae (0x20f5 bytes) 000820 1788330152.149465 punch from 0x00c939 to 0x016468 (0x9b30 bytes) 000821 1788330152.154781 write 0x034ee8 thru 0x038630 (0x3749 bytes) 000822 1788330152.156829 read 0x007636 thru 0x00dd49 (0x6714 bytes) 000823 1788330152.166424 trunc from 0x02b911 to 0x02d866 (0x1f56 bytes) 000824 1788330152.171374 mapwrite 0x02006e thru 0x025990 (0x5923 bytes) 000825 1788330152.188168 mapwrite 0x030e35 thru 0x039d25 (0x8ef1 bytes) 000826 1788330152.225074 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) 000827 1788330152.367154 mapwrite 0x02e133 thru 0x03399f (0x586d bytes) 000828 1788330152.412895 read 0x0239de thru 0x02ae91 (0x74b4 bytes) 000829 1788330152.420868 read 0x01b04e thru 0x027923 (0xc8d6 bytes) 000830 1788330152.437198 mapwrite 0x0094c9 thru 0x0173ff (0xdf37 bytes) 000831 1788330152.478677 write 0x0249f1 thru 0x02dbf8 (0x9208 bytes) 000832 1788330152.496490 punch from 0x011a21 to 0x01eba2 (0xd182 bytes) 000833 1788330152.526762 write 0x02a93b thru 0x032ec1 (0x8587 bytes) 000834 1788330152.537612 trunc from 0x039d26 to 0x00de72 (0x2beb3 bytes) 000835 1788330152.605130 fallocate 0x0236a7 thru 0x0329cd (0xf327 bytes) 000836 1788330152.617523 mapread 0x007e83 thru 0x00de72 (0x5ff0 bytes) 000837 1788330152.621106 trunc from 0x00c6fe to 0x00de72 (0x1775 bytes) 000839 1788330152.632924 punch from 0x008e0a to 0x00d4e1 (0x46d8 bytes) 000840 1788330152.647528 read 0x009156 thru 0x00bc1f (0x2aca bytes) 000841 1788330152.670393 read 0x003646 thru 0x00de72 (0xa82d bytes) 000842 1788330152.671622 write 0x023986 thru 0x026163 (0x27de bytes) 000843 1788330152.673061 mapwrite 0x025680 thru 0x0256ed (0x6e bytes) 000846 1788330152.690236 mapwrite 0x03bdda thru 0x03e368 (0x258f bytes) 000847 1788330152.757741 read 0x03c14c thru 0x03e368 (0x221d bytes) 000848 1788330152.758982 trunc from 0x03e369 to 0x02f7e4 (0xeb84 bytes) 000849 1788330152.785762 fallocate 0x00e570 thru 0x01a602 (0xc093 bytes) 000850 1788330152.790201 trunc from 0x02afba to 0x02e7ef (0x3836 bytes) 000852 1788330152.798116 punch from 0x001931 to 0x00c4b6 (0xab86 bytes) 000853 1788330152.802792 read 0x02bc45 thru 0x02f7e4 (0x3ba0 bytes) 000854 1788330152.829467 read 0x00ad42 thru 0x012202 (0x74c1 bytes) 000855 1788330152.830524 write 0x02042d thru 0x02d1c1 (0xcd95 bytes) 000856 1788330152.834805 write 0x03ceb6 thru 0x03ffff (0x314a bytes) 000857 1788330152.836934 trunc from 0x0370af to 0x03afa3 (0x3ef5 bytes) 000858 1788330152.842744 write 0x00eb0b thru 0x015ede (0x73d4 bytes) 000859 1788330152.845005 trunc from 0x040000 to 0x02866c (0x17993 bytes) 000860 1788330152.868992 mapwrite 0x00ba97 thru 0x0162f5 (0xa85f bytes) 000863 1788330152.900130 fallocate 0x03ded0 thru 0x03ffff (0x2130 bytes) 000864 1788330152.905264 trunc from 0x005c19 to 0x00ed9b (0x9183 bytes) 000865 1788330152.910648 trunc from 0x00457d to 0x00eb78 (0xa5fc bytes) 000866 1788330152.915425 trunc from 0x02866d to 0x03b621 (0x12fb5 bytes) 000868 1788330152.934208 punch from 0x010537 to 0x01357e (0x3048 bytes) 000871 1788330152.947058 MIRROR_EXTEND to 2 mirrors 000872 1788330153.912822 MIRROR_RESYNC 2 mirrors 000873 1788330154.650903 fallocate 0x00c5e2 thru 0x0178d0 (0xb2ef bytes) 000874 1788330154.717749 trunc from 0x03b622 to 0x03b0f0 (0x531 bytes) 000875 1788330154.739109 write 0x03d1df thru 0x03ffff (0x2e21 bytes) 000876 1788330154.740680 punch from 0x007289 to 0x0163aa (0xf122 bytes) 000877 1788330154.746910 mapwrite 0x03d0ad thru 0x03d79c (0x6f0 bytes) 000878 1788330154.761076 punch from 0x033481 to 0x03ffff (0xcb7f bytes) 000880 1788330154.769681 mapread 0x00b5ec thru 0x017512 (0xbf27 bytes) 000881 1788330154.817222 punch from 0x03c772 to 0x03ffff (0x388e bytes) 000882 1788330154.821582 mapread 0x01f2df thru 0x02a3b8 (0xb0da bytes) 000883 1788330154.836653 mapread 0x005f31 thru 0x009c6d (0x3d3d bytes) 000884 1788330154.844756 write 0x01c4ff thru 0x024c99 (0x879b bytes) 000885 1788330154.846507 fallocate 0x020523 thru 0x028410 (0x7eee bytes) 000887 1788330154.851673 read 0x0216c5 thru 0x02f71d (0xe059 bytes) 000888 1788330154.856103 MIRROR_RESYNC 2 mirrors 000889 1788330155.801657 fallocate 0x0011df thru 0x00fbd0 (0xe9f2 bytes) 000890 1788330155.830474 read 0x01119f thru 0x01a10d (0x8f6f bytes) 000891 1788330155.840045 punch from 0x0010bb to 0x007674 (0x65ba bytes) 000892 1788330155.844755 read 0x006adf thru 0x0148f7 (0xde19 bytes) 000893 1788330155.860253 read 0x014e06 thru 0x017c3b (0x2e36 bytes) 000894 1788330155.868845 MIRROR_RESYNC 2 mirrors 000896 1788330156.896994 fallocate 0x016115 thru 0x022459 (0xc345 bytes) 000897 1788330156.934843 fallocate 0x00a949 thru 0x01853c (0xdbf4 bytes) 000898 1788330156.940001 mapread 0x00d9d7 thru 0x011afd (0x4127 bytes) 000899 1788330156.957011 fallocate 0x03f4e1 thru 0x03ffff (0xb1f bytes) 000900 1788330156.962222 read 0x03fccf thru 0x03ffff (0x331 bytes) 000902 1788330156.968611 mapwrite 0x0027e1 thru 0x00cdc4 (0xa5e4 bytes) 000903 1788330156.998563 fallocate 0x038a96 thru 0x03afff (0x256a bytes) 000904 1788330157.003085 mapwrite 0x01d111 thru 0x027531 (0xa421 bytes) 000908 1788330157.037215 mapread 0x025101 thru 0x029828 (0x4728 bytes) 000909 1788330157.038726 write 0x0076fb thru 0x009eff (0x2805 bytes) 000910 1788330157.039838 trunc from 0x00ee7d to 0x0193a4 (0xa528 bytes) 000911 1788330157.045437 mapread 0x01afe5 thru 0x026135 (0xb151 bytes) 000912 1788330157.047024 write 0x00161c thru 0x00495d (0x3342 bytes) 000913 1788330157.048660 read 0x01fe0d thru 0x020c3f (0xe33 bytes) 000914 1788330157.049686 mapwrite 0x00e567 thru 0x012379 (0x3e13 bytes) 000915 1788330157.077158 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfd4da9b3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7d460f01 Mirror 3: 0x7d460f01 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000917 1788330158.071630 trunc from 0x040000 to 0x018d50 (0x272af bytes) 000918 1788330158.180011 punch from 0x003ed0 to 0x010b05 (0xcc36 bytes) 000919 1788330158.190450 fallocate 0x029387 thru 0x039265 (0xfedf bytes) 000920 1788330158.195512 fallocate 0x00cf47 thru 0x015d85 (0x8e3f bytes) 000921 1788330158.212147 mapwrite 0x002718 thru 0x010628 (0xdf11 bytes) 000922 1788330158.275634 trunc from 0x039266 to 0x027001 (0x12264 bytes) 000923 1788330158.320918 mapwrite 0x0398a2 thru 0x03ffff (0x675e bytes) 000924 1788330158.415650 write 0x007183 thru 0x012fed (0xbe6b bytes) 000925 1788330158.426594 punch from 0x002e32 to 0x0038f7 (0xac6 bytes) 000926 1788330158.436722 write 0x000903 thru 0x00119c (0x89a bytes) 000927 1788330158.462832 trunc from 0x040000 to 0x008a72 (0x3758d bytes) 000928 1788330158.489877 punch from 0x002aac to 0x008435 (0x598a bytes) 000929 1788330158.515823 mapread 0x005740 thru 0x008a72 (0x3333 bytes) 000930 1788330158.533681 mapread 0x001e2b thru 0x008a72 (0x6c48 bytes) 000931 1788330158.539157 trunc from 0x008a73 to 0x02ae63 (0x223f1 bytes) 000932 1788330158.589672 mapread 0x003020 thru 0x009bb8 (0x6b99 bytes) 000934 1788330158.604218 read 0x016e56 thru 0x01e5dc (0x7787 bytes) 000935 1788330158.623217 trunc from 0x02ae64 to 0x029341 (0x1b22 bytes) 000936 1788330158.668838 trunc from 0x029342 to 0x01e17c (0xb1c5 bytes) 000937 1788330158.695717 read 0x00cd85 thru 0x018f37 (0xc1b3 bytes) 000938 1788330158.710877 trunc from 0x015643 to 0x0193a4 (0x3d62 bytes) 000939 1788330158.715709 trunc from 0x01e17d to 0x010fea (0xd192 bytes) 000940 1788330158.747921 read 0x00ab18 thru 0x010fea (0x64d3 bytes) 000941 1788330158.750542 trunc from 0x010feb to 0x036b85 (0x25b9b bytes) 000942 1788330158.797682 fallocate 0x00b24d thru 0x00b7a3 (0x557 bytes) 000943 1788330158.808852 mapread 0x023ab8 thru 0x024c01 (0x114a bytes) 000944 1788330158.836570 mapwrite 0x03149a thru 0x032d83 (0x18ea bytes) 000945 1788330158.874963 read 0x017b2e thru 0x019a15 (0x1ee8 bytes) 000946 1788330158.876429 mapread 0x007a37 thru 0x0090ae (0x1678 bytes) 000947 1788330158.883537 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x36b86): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36b86): Mirror 2: 0x2c92a0a4 (stale) Mirror 3: 0xd9e62c0c (stale) CRC-32 checksum value for chunk [0, 0x36b86): Mirror 1: 0x95d6c129 Mirror 4: 0x95d6c129 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36b86: skipped 000948 1788330160.649120 punch from 0x02e454 to 0x036b85 (0x8732 bytes) 000950 1788330160.704652 mapread 0x021f4f thru 0x027c0d (0x5cbf bytes) 000951 1788330160.735047 mapwrite 0x0117e5 thru 0x014e37 (0x3653 bytes) 000953 1788330160.807476 punch from 0x0076e8 to 0x012cb9 (0xb5d2 bytes) 000954 1788330160.824153 punch from 0x026a3b to 0x02e279 (0x783f bytes) 000955 1788330160.845564 MIRROR_RESYNC 4 mirrors 000956 1788330162.556497 trunc from 0x01899e to 0x020dc8 (0x842b bytes) 000957 1788330162.634149 write 0x00a633 thru 0x00e2c9 (0x3c97 bytes) 000958 1788330162.646194 mapread 0x02c259 thru 0x03154a (0x52f2 bytes) 000959 1788330162.699423 fallocate 0x01f1f5 thru 0x0212ee (0x20fa bytes) 000960 1788330162.705261 trunc from 0x036b86 to 0x03e206 (0x7681 bytes) 000961 1788330162.742734 read 0x020571 thru 0x02efa6 (0xea36 bytes) 000962 1788330162.768892 mapread 0x008e10 thru 0x018d0f (0xff00 bytes) 000963 1788330162.800218 punch from 0x0343b5 to 0x03e206 (0x9e52 bytes) 000964 1788330162.803983 trunc from 0x004b8b to 0x013074 (0xe4ea bytes) 000965 1788330162.843010 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x185:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e207): Mirror 2: 0xf4dab619 (stale) Mirror 4: 0xf4dab619 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e207): Mirror 2: 0xf4dab619 (stale) Mirror 4: 0xf4dab619 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e207: skipped 000966 1788330163.221725 trunc from 0x005f7c to 0x00f94c (0x99d1 bytes) 000967 1788330163.225419 fallocate 0x024ae9 thru 0x02ea5d (0x9f75 bytes) 000969 1788330163.230021 mapwrite 0x028ecc thru 0x032cbd (0x9df2 bytes) 000971 1788330163.285795 write 0x015b67 thru 0x024fc2 (0xf45c bytes) 000972 1788330163.298302 trunc from 0x007b24 to 0x013356 (0xb833 bytes) 000973 1788330163.311766 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e207): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e207): Mirror 2: 0xf4dab619 (stale) Mirror 4: 0xf4dab619 (stale) CRC-32 checksum value for chunk [0, 0x3e207): Mirror 1: 0x6c2821f6 Mirror 5: 0x6c2821f6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e207: skipped 000974 1788330164.557211 trunc from 0x03e207 to 0x039489 (0x4d7d bytes) 000975 1788330164.652635 write 0x01777d thru 0x0179a5 (0x229 bytes) 000976 1788330164.658873 read 0x02f1c0 thru 0x030a71 (0x18b2 bytes) 000977 1788330164.665004 read 0x02456c thru 0x027663 (0x30f8 bytes) 000978 1788330164.678813 write 0x01ff07 thru 0x02317c (0x3276 bytes) 000979 1788330164.682113 mapwrite 0x013dc0 thru 0x01ae99 (0x70da bytes) 000980 1788330164.711414 read 0x02084f thru 0x028ecc (0x867e bytes) 000981 1788330164.712297 punch from 0x027fac to 0x0341cb (0xc220 bytes) 000982 1788330164.720785 mapwrite 0x03c748 thru 0x03ffff (0x38b8 bytes) 000983 1788330164.807969 fallocate 0x030f1c thru 0x03cf1a (0xbfff bytes) 000985 1788330164.814542 trunc from 0x040000 to 0x02abc5 (0x1543a bytes) 000988 1788330164.850654 fallocate 0x003de1 thru 0x00f313 (0xb533 bytes) 000989 1788330164.865018 fallocate 0x021d4b thru 0x02d538 (0xb7ee bytes) 000991 1788330164.883053 mapread 0x00827c thru 0x00842a (0x1af bytes) 000992 1788330164.887002 trunc from 0x008644 to 0x011f82 (0x993f bytes) 000994 1788330164.899805 write 0x03f740 thru 0x03ffff (0x8c0 bytes) 000995 1788330164.905165 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xc03a1059 (stale) Mirror 4: 0xc03a1059 (stale) Mirror 5: 0xb67702e0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1bb8d486 Mirror 6: 0x1bb8d486 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000996 1788330165.899892 mapwrite 0x000aad thru 0x007411 (0x6965 bytes) 000997 1788330166.004851 read 0x00c413 thru 0x00ec3a (0x2828 bytes) 000998 1788330166.005760 mapread 0x02ceea thru 0x031c96 (0x4dad bytes) 000999 1788330166.025321 mapwrite 0x0237ac thru 0x02df07 (0xa75c bytes) 001000 1788330166.086592 trunc from 0x007aac to 0x007f6a (0x4bf bytes) All operations completed A-OK!