== sanity-flr test 70a: flr mode fsx test ================ 11:32:10 (1787844730) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 4732 skipping zero length punch hole fallocating to largest ever: 0x2f417 000002 1787844732.555865 fallocate 0x029688 thru 0x02f416 (0x5d8f bytes) 000003 1787844732.563490 punch from 0x0052f6 to 0x00d6eb (0x83f6 bytes) truncating to largest ever: 0x34ff2 000004 1787844732.569965 trunc from 0x02f417 to 0x034ff1 (0x5bdb bytes) 000005 1787844732.585905 trunc from 0x010707 to 0x016cd4 (0x65ce bytes) 000006 1787844732.591060 read 0x02a4f2 thru 0x02e607 (0x4116 bytes) 000007 1787844732.608665 read 0x018221 thru 0x01c455 (0x4235 bytes) 000008 1787844732.639106 MIRROR_EXTEND to 2 mirrors 000009 1787844733.466655 write 0x00039e thru 0x00199e (0x1601 bytes) 000010 1787844733.518691 trunc from 0x01cee1 to 0x020613 (0x3733 bytes) 000011 1787844733.527951 trunc from 0x034ff2 to 0x01d7d1 (0x17820 bytes) 000012 1787844733.561006 trunc from 0x00026f to 0x000619 (0x3ab bytes) 000013 1787844733.579880 mapread 0x00916a thru 0x00f4d4 (0x636b bytes) 000014 1787844733.624378 punch from 0x016beb to 0x01d7d1 (0x6be7 bytes) 000015 1787844733.633318 trunc from 0x0174f4 to 0x01d7d1 (0x62de bytes) 000016 1787844733.644600 trunc from 0x00c9fd to 0x012690 (0x5c94 bytes) 000017 1787844733.658743 fallocate 0x00988d thru 0x016cc1 (0xd435 bytes) 000018 1787844733.665890 read 0x00386d thru 0x0081e9 (0x497d bytes) 000019 1787844733.671967 read 0x0084d3 thru 0x00a46a (0x1f98 bytes) 000020 1787844733.672687 trunc from 0x01d7d2 to 0x003c68 (0x19b69 bytes) 000021 1787844733.695700 mapwrite 0x02179f thru 0x02ab52 (0x93b4 bytes) 000022 1787844733.804970 trunc from 0x0012e0 to 0x006efb (0x5c1c bytes) 000023 1787844733.831363 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2ab53): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ab53): Mirror 2: 0x36411480 (stale) CRC-32 checksum value for chunk [0, 0x2ab53): Mirror 1: 0x41b5c771 Mirror 3: 0x41b5c771 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ab53: skipped 000024 1787844734.765003 read 0x012c27 thru 0x018dd5 (0x61af bytes) 000025 1787844734.780951 trunc from 0x003660 to 0x00aed0 (0x7871 bytes) 000026 1787844734.848868 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ab53): Mirror 2: 0x36411480 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ab53): Mirror 2: 0x36411480 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ab53: skipped 000027 1787844735.157182 mapread 0x01707f thru 0x0230f4 (0xc076 bytes) 000028 1787844735.196596 trunc from 0x017c66 to 0x024a4e (0xcde9 bytes) 000029 1787844735.204426 trunc from 0x019ffe to 0x0218e2 (0x78e5 bytes) 000030 1787844735.209995 read 0x020c9f thru 0x0229ea (0x1d4c bytes) 000032 1787844735.217477 trunc from 0x02ab53 to 0x006ffe (0x23b54 bytes) 000033 1787844735.254176 punch from 0x006243 to 0x006ffe (0xdbc bytes) 000034 1787844735.269491 mapread 0x006bc1 thru 0x006ffe (0x43e bytes) truncating to largest ever: 0x3d2b6 000035 1787844735.299995 trunc from 0x006fff to 0x03d2b5 (0x362b7 bytes) 000036 1787844735.374039 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) 000037 1787844735.530742 write 0x00b4e6 thru 0x00d392 (0x1ead bytes) 000038 1787844735.543765 fallocate 0x02a6a8 thru 0x032a5a (0x83b3 bytes) 000039 1787844735.549289 read 0x00815a thru 0x008337 (0x1de bytes) 000040 1787844735.555533 fallocate 0x00d9f8 thru 0x01c138 (0xe741 bytes) 000041 1787844735.560963 punch from 0x0350bc to 0x035683 (0x5c8 bytes) 000042 1787844735.567299 trunc from 0x03d2b6 to 0x03bdaf (0x1506 bytes) 000043 1787844735.601696 trunc from 0x01e3ee to 0x026e12 (0x8a25 bytes) 000044 1787844735.612606 fallocate 0x01c70a thru 0x01dc46 (0x153d bytes) 000045 1787844735.626063 trunc from 0x03bdb0 to 0x008277 (0x33b38 bytes) 000046 1787844735.657276 mapwrite 0x0386d8 thru 0x03ffff (0x7928 bytes) 000048 1787844735.727515 mapread 0x007146 thru 0x00d592 (0x644d bytes) 000049 1787844735.737118 trunc from 0x02858b to 0x02db89 (0x55ff bytes) 000050 1787844735.748606 mapwrite 0x016642 thru 0x01f3b9 (0x8d78 bytes) 000051 1787844735.807419 mapwrite 0x0223c9 thru 0x02aedf (0x8b17 bytes) 000052 1787844735.865967 fallocate 0x0040e0 thru 0x0101ff (0xc120 bytes) 000053 1787844735.884272 fallocate 0x02ce2d thru 0x03ac70 (0xde44 bytes) 000054 1787844735.897888 fallocate 0x02b8c4 thru 0x0331f7 (0x7934 bytes) 000055 1787844735.916085 punch from 0x01da92 to 0x022bfb (0x516a bytes) 000056 1787844735.927305 read 0x01ddd5 thru 0x0202a5 (0x24d1 bytes) 000058 1787844735.967449 mapread 0x00987f thru 0x00a2ca (0xa4c bytes) 000059 1787844735.971142 mapread 0x025eda thru 0x034f95 (0xf0bc bytes) 000060 1787844735.974549 mapread 0x0283a9 thru 0x02a713 (0x236b bytes) 000062 1787844735.979155 mapwrite 0x035206 thru 0x03ffff (0xadfa bytes) 000063 1787844736.009826 fallocate 0x02d23b thru 0x034077 (0x6e3d bytes) 000064 1787844736.026360 mapread 0x00261c thru 0x0031e5 (0xbca bytes) 000065 1787844736.031430 mapwrite 0x03bd1c thru 0x03ffff (0x42e4 bytes) 000066 1787844736.079570 mapread 0x020f0b thru 0x029fee (0x90e4 bytes) 000067 1787844736.082623 trunc from 0x022a85 to 0x024f50 (0x24cc bytes) 000068 1787844736.096327 mapwrite 0x02375b thru 0x023f42 (0x7e8 bytes) 000069 1787844736.141309 write 0x027109 thru 0x029b9a (0x2a92 bytes) 000070 1787844736.147013 trunc from 0x040000 to 0x032828 (0xd7d7 bytes) 000071 1787844736.166657 trunc from 0x02dfc9 to 0x032828 (0x4860 bytes) 000072 1787844736.178806 write 0x02f57f thru 0x0319a8 (0x242a bytes) 000073 1787844736.216016 write 0x013f16 thru 0x01e3ce (0xa4b9 bytes) truncating to largest ever: 0x3e3ad 000074 1787844736.219507 trunc from 0x032829 to 0x03e3ac (0xbb84 bytes) 000076 1787844736.269136 trunc from 0x01c565 to 0x024fc9 (0x8a65 bytes) 000077 1787844736.302185 mapread 0x033fcb thru 0x034f47 (0xf7d bytes) 000078 1787844736.328008 trunc from 0x03e3ad to 0x0266f5 (0x17cb7 bytes) 000079 1787844736.382278 read 0x010676 thru 0x018763 (0x80ee bytes) 000080 1787844736.383639 trunc from 0x0266f6 to 0x0311ab (0xaab6 bytes) 000083 1787844736.432178 trunc from 0x01f4a8 to 0x025922 (0x647b bytes) 000084 1787844736.443156 trunc from 0x019840 to 0x01ecd9 (0x549a bytes) 000085 1787844736.450619 trunc from 0x01047a to 0x01d7e9 (0xd370 bytes) 000086 1787844736.470077 MIRROR_EXTEND to 2 mirrors 000087 1787844737.675860 mapwrite 0x009345 thru 0x00e1ac (0x4e68 bytes) 000089 1787844737.781050 trunc from 0x010726 to 0x01fc16 (0xf4f1 bytes) 000090 1787844737.794222 trunc from 0x0311ac to 0x037c08 (0x6a5d bytes) 000091 1787844737.874108 fallocate 0x0261f1 thru 0x02e79b (0x85ab bytes) 000092 1787844737.888025 trunc from 0x01cc0a to 0x01e52a (0x1921 bytes) 000093 1787844737.894954 fallocate 0x021d86 thru 0x027d1d (0x5f98 bytes) 000094 1787844737.914577 write 0x00f51d thru 0x0111e5 (0x1cc9 bytes) 000095 1787844737.923946 mapread 0x0106f9 thru 0x01557c (0x4e84 bytes) 000096 1787844737.975135 punch from 0x00a8bc to 0x00f5a0 (0x4ce5 bytes) 000097 1787844738.018819 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) 000098 1787844738.237965 write 0x027727 thru 0x02fa93 (0x836d bytes) 000099 1787844738.256008 read 0x013f51 thru 0x01db2c (0x9bdc bytes) 000100 1787844738.275410 trunc from 0x037c09 to 0x0141d7 (0x23a31 bytes) 000101 1787844738.301327 fallocate 0x021270 thru 0x0279e0 (0x6771 bytes) 000102 1787844738.307510 mapread 0x01dad8 thru 0x0279e0 (0x9f09 bytes) 000103 1787844738.351659 write 0x01b384 thru 0x01c0d5 (0xd52 bytes) 000104 1787844738.353943 punch from 0x015911 to 0x015e4b (0x53b bytes) fallocating to largest ever: 0x40000 000105 1787844738.360816 fallocate 0x039e51 thru 0x03ffff (0x61af bytes) 000106 1787844738.366530 punch from 0x02d5d6 to 0x035376 (0x7da1 bytes) 000107 1787844738.371615 punch from 0x02cb70 to 0x038c22 (0xc0b3 bytes) 000109 1787844738.380636 trunc from 0x01348f to 0x020687 (0xd1f9 bytes) 000110 1787844738.421979 write 0x03edb7 thru 0x03ffe3 (0x122d bytes) 000111 1787844738.434369 trunc from 0x026301 to 0x028893 (0x2593 bytes) 000112 1787844738.455296 mapread 0x033f81 thru 0x034e82 (0xf02 bytes) 000113 1787844738.490792 read 0x02e53c thru 0x030254 (0x1d19 bytes) 000114 1787844738.492816 mapwrite 0x0208e0 thru 0x02848b (0x7bac bytes) 000117 1787844738.583699 punch from 0x03a9a8 to 0x03bcc0 (0x1319 bytes) 000118 1787844738.599667 trunc from 0x03bcb7 to 0x03ffff (0x4349 bytes) 000119 1787844738.608815 mapread 0x00fd2f thru 0x01f4c1 (0xf793 bytes) 000120 1787844738.610048 trunc from 0x02b577 to 0x032ef3 (0x797d bytes) 000121 1787844738.645531 mapread 0x02b990 thru 0x03771a (0xbd8b bytes) 000122 1787844738.695165 write 0x01dc10 thru 0x01f3f3 (0x17e4 bytes) 000123 1787844738.696569 write 0x0266ef thru 0x02ba7e (0x5390 bytes) 000124 1787844738.699334 trunc from 0x040000 to 0x0080ff (0x37f00 bytes) 000125 1787844738.718502 trunc from 0x008100 to 0x0014df (0x6c20 bytes) 000126 1787844738.736834 read 0x00043f thru 0x0014df (0x10a1 bytes) 000127 1787844738.737617 fallocate 0x03c5be thru 0x03ffff (0x3a42 bytes) 000128 1787844738.755815 mapread 0x000517 thru 0x0014df (0xfc9 bytes) 000129 1787844738.763959 mapread 0x0013ab thru 0x0014df (0x135 bytes) 000130 1787844738.765521 write 0x02131c thru 0x0257c4 (0x44a9 bytes) 000131 1787844738.801994 MIRROR_EXTEND to 2 mirrors 000132 1787844739.650015 trunc from 0x0257c5 to 0x001360 (0x24464 bytes) 000133 1787844739.750898 MIRROR_RESYNC 2 mirrors 000134 1787844740.341300 mapwrite 0x024702 thru 0x03399a (0xf299 bytes) 000135 1787844740.486626 fallocate 0x034e13 thru 0x03ffff (0xb1ed bytes) 000136 1787844740.497449 trunc from 0x025ce0 to 0x0316c8 (0xb9e9 bytes) 000137 1787844740.508589 punch from 0x00d1f0 to 0x01b7e9 (0xe5fa bytes) 000138 1787844740.515748 mapwrite 0x026976 thru 0x03494a (0xdfd5 bytes) 000139 1787844740.566140 trunc from 0x016c13 to 0x0254da (0xe8c8 bytes) 000140 1787844740.577718 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) 000143 1787844740.738325 trunc from 0x040000 to 0x029b64 (0x1649b bytes) 000144 1787844740.760752 write 0x00444d thru 0x0132d0 (0xee84 bytes) 000145 1787844740.772489 mapwrite 0x01753c thru 0x0210b2 (0x9b77 bytes) 000146 1787844740.809991 punch from 0x027b88 to 0x029b64 (0x1fdd bytes) 000147 1787844740.816528 write 0x02998e thru 0x02cfcc (0x363f bytes) 000148 1787844740.822363 mapwrite 0x02f069 thru 0x03543a (0x63d2 bytes) 000150 1787844740.866622 punch from 0x00a203 to 0x013242 (0x9040 bytes) 000151 1787844740.873165 read 0x01a6a9 thru 0x0228a3 (0x81fb bytes) 000152 1787844740.879314 write 0x02e94b thru 0x03b193 (0xc849 bytes) 000153 1787844740.882090 write 0x036afc thru 0x03a5bc (0x3ac1 bytes) 000154 1787844740.883236 mapwrite 0x00dcaf thru 0x011fa8 (0x42fa bytes) 000156 1787844740.913280 mapread 0x00ef22 thru 0x015855 (0x6934 bytes) 000158 1787844740.914829 mapwrite 0x01ae9f thru 0x02963d (0xe79f bytes) 000159 1787844740.950575 fallocate 0x0160c5 thru 0x016121 (0x5d bytes) 000162 1787844740.957447 write 0x03affe thru 0x03df39 (0x2f3c bytes) 000163 1787844740.958459 punch from 0x006457 to 0x0091a0 (0x2d4a bytes) 000164 1787844740.964724 mapread 0x0305c5 thru 0x03df39 (0xd975 bytes) 000165 1787844740.965708 read 0x007f83 thru 0x01009c (0x811a bytes) 000166 1787844740.984983 fallocate 0x013fb9 thru 0x021f6d (0xdfb5 bytes) 000167 1787844740.991366 mapread 0x01f2d7 thru 0x022c34 (0x395e bytes) 000168 1787844740.992592 mapread 0x018543 thru 0x01933e (0xdfc bytes) 000170 1787844740.997919 punch from 0x008d3e to 0x0133a6 (0xa669 bytes) 000172 1787844741.004162 read 0x030bdf thru 0x03df39 (0xd35b bytes) 000173 1787844741.004882 read 0x03cd99 thru 0x03df39 (0x11a1 bytes) 000175 1787844741.016862 punch from 0x028fea to 0x02cd89 (0x3da0 bytes) 000177 1787844741.038261 trunc from 0x03df3a to 0x02f2a3 (0xec96 bytes) 000179 1787844741.086659 write 0x02715b thru 0x0303db (0x9281 bytes) 000180 1787844741.091730 mapwrite 0x01af38 thru 0x01f85b (0x4924 bytes) 000181 1787844741.145261 read 0x01f108 thru 0x021f76 (0x2e6f bytes) 000182 1787844741.145924 mapwrite 0x019c36 thru 0x025361 (0xb72c bytes) 000183 1787844741.180141 read 0x018e3f thru 0x024156 (0xb318 bytes) 000185 1787844741.184760 trunc from 0x0303dc to 0x0199ea (0x169f1 bytes) 000186 1787844741.221166 trunc from 0x000545 to 0x00590c (0x53c8 bytes) 000187 1787844741.227140 trunc from 0x0049b9 to 0x004d69 (0x3b1 bytes) 000188 1787844741.247021 fallocate 0x00d1fa thru 0x01caf8 (0xf8ff bytes) 000190 1787844741.267090 mapwrite 0x009b19 thru 0x0137bd (0x9ca5 bytes) 000191 1787844741.334111 punch from 0x003e7b to 0x011762 (0xd8e8 bytes) 000192 1787844741.355961 MIRROR_EXTEND to 2 mirrors 000193 1787844742.422402 mapwrite 0x01355d thru 0x0171e5 (0x3c89 bytes) 000194 1787844742.617925 write 0x020cbf thru 0x02681f (0x5b61 bytes) 000195 1787844742.639903 mapread 0x02579a thru 0x02681f (0x1086 bytes) 000196 1787844742.647568 trunc from 0x0211b5 to 0x02681f (0x566b bytes) 000197 1787844742.688460 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) 000199 1787844742.937137 MIRROR_EXTEND to 2 mirrors 000200 1787844744.181793 fallocate 0x03ecb8 thru 0x03ffff (0x1348 bytes) 000201 1787844744.247773 fallocate 0x015a76 thru 0x01748d (0x1a18 bytes) 000202 1787844744.254843 read 0x00d596 thru 0x018dcd (0xb838 bytes) 000203 1787844744.272851 fallocate 0x00963e thru 0x016461 (0xce24 bytes) 000205 1787844744.281299 fallocate 0x008325 thru 0x015db2 (0xda8e bytes) 000206 1787844744.291283 trunc from 0x024517 to 0x02e1a6 (0x9c90 bytes) 000209 1787844744.299775 trunc from 0x040000 to 0x00c8d2 (0x3372d bytes) 000210 1787844744.330061 trunc from 0x003d5c to 0x0049a5 (0xc4a bytes) 000211 1787844744.336674 mapread 0x0070a9 thru 0x00c8d2 (0x582a bytes) 000214 1787844744.359872 trunc from 0x00c8d3 to 0x0082db (0x45f7 bytes) 000215 1787844744.387181 read 0x0053fb thru 0x0082db (0x2ee1 bytes) 000216 1787844744.387976 mapwrite 0x016a82 thru 0x021cc7 (0xb246 bytes) 000218 1787844744.459486 fallocate 0x021634 thru 0x02ac96 (0x9663 bytes) 000219 1787844744.471696 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) 000221 1787844744.670781 write 0x01f945 thru 0x02eddf (0xf49b bytes) 000222 1787844744.687125 write 0x00047f thru 0x0071ae (0x6d30 bytes) 000223 1787844744.699821 write 0x0352d1 thru 0x03fafb (0xa82b bytes) 000224 1787844744.702479 mapwrite 0x0113c3 thru 0x012124 (0xd62 bytes) 000225 1787844744.738309 trunc from 0x0113d8 to 0x019ad7 (0x8700 bytes) 000226 1787844744.743464 trunc from 0x03fafc to 0x03c4d3 (0x3628 bytes) 000227 1787844744.764974 punch from 0x021c87 to 0x029d56 (0x80d0 bytes) 000228 1787844744.771262 read 0x0040c4 thru 0x00fd76 (0xbcb3 bytes) 000229 1787844744.782075 fallocate 0x00b1da thru 0x00e192 (0x2fb9 bytes) 000231 1787844744.787441 read 0x02cf63 thru 0x02e376 (0x1414 bytes) 000232 1787844744.788845 mapread 0x015b19 thru 0x01c806 (0x6cee bytes) 000233 1787844744.801421 mapwrite 0x024554 thru 0x02926d (0x4d1a bytes) 000234 1787844744.820377 read 0x027769 thru 0x02e16c (0x6a04 bytes) 000235 1787844744.821499 trunc from 0x03c4d4 to 0x00afc4 (0x3150f bytes) 000236 1787844744.859449 MIRROR_EXTEND to 2 mirrors 000237 1787844745.824750 trunc from 0x00922e to 0x00afc4 (0x1d97 bytes) 000238 1787844745.893105 trunc from 0x00afc5 to 0x00a093 (0xf31 bytes) 000239 1787844745.926990 trunc from 0x005842 to 0x00a093 (0x4852 bytes) 000240 1787844745.936669 trunc from 0x00a094 to 0x02b9af (0x2191c bytes) 000241 1787844745.969663 punch from 0x0052e7 to 0x0093d2 (0x40ec bytes) 000242 1787844745.976941 mapwrite 0x026280 thru 0x02ff13 (0x9c94 bytes) 000243 1787844746.031065 read 0x020f6c thru 0x02f04c (0xe0e1 bytes) 000244 1787844746.038773 mapwrite 0x014d41 thru 0x017d4f (0x300f bytes) 000245 1787844746.063464 write 0x00a0fe thru 0x00f2de (0x51e1 bytes) 000246 1787844746.070424 fallocate 0x0043ba thru 0x00e457 (0xa09e bytes) 000247 1787844746.080776 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2ff14): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ff14): Mirror 2: 0x68a43d5d (stale) CRC-32 checksum value for chunk [0, 0x2ff14): Mirror 1: 0x68fa5fb2 Mirror 3: 0x68fa5fb2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ff14: skipped 000249 1787844747.265132 mapwrite 0x01ff45 thru 0x026181 (0x623d bytes) 000250 1787844747.404459 mapwrite 0x01eb37 thru 0x02d60e (0xead8 bytes) 000251 1787844747.530704 mapread 0x0298c9 thru 0x02ff13 (0x664b bytes) 000252 1787844747.532952 mapwrite 0x022567 thru 0x02deb1 (0xb94b bytes) 000253 1787844747.598786 trunc from 0x01cfaf to 0x023ff2 (0x7044 bytes) 000254 1787844747.635371 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ff14): Mirror 3: 0x68fa5fb2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ff14): Mirror 3: 0x68fa5fb2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ff14: skipped 000255 1787844748.029755 mapwrite 0x030647 thru 0x03ad43 (0xa6fd bytes) 000256 1787844748.186133 fallocate 0x01f55b thru 0x0261e6 (0x6c8c bytes) 000257 1787844748.194808 trunc from 0x03ad44 to 0x01fc46 (0x1b0fd bytes) 000258 1787844748.218445 punch from 0x018460 to 0x01cc6f (0x4810 bytes) 000259 1787844748.225988 write 0x023db9 thru 0x025b67 (0x1daf bytes) 000260 1787844748.227968 punch from 0x00412c to 0x007c2c (0x3b01 bytes) 000261 1787844748.235346 write 0x035cfd thru 0x0370b5 (0x13b9 bytes) 000262 1787844748.236472 punch from 0x02655a to 0x0359af (0xf456 bytes) 000263 1787844748.256642 mapwrite 0x03d174 thru 0x03ffff (0x2e8c bytes) 000264 1787844748.308493 punch from 0x010f24 to 0x013199 (0x2276 bytes) 000265 1787844748.315108 read 0x03bb64 thru 0x03ffff (0x449c bytes) 000266 1787844748.316142 trunc from 0x040000 to 0x03d1b9 (0x2e46 bytes) 000267 1787844748.335676 fallocate 0x008779 thru 0x00bc19 (0x34a1 bytes) 000268 1787844748.344650 punch from 0x015355 to 0x01b915 (0x65c1 bytes) 000269 1787844748.353165 fallocate 0x006832 thru 0x012a81 (0xc250 bytes) 000270 1787844748.359034 punch from 0x0225a7 to 0x022a0a (0x464 bytes) 000271 1787844748.367311 mapread 0x00565b thru 0x00e001 (0x89a7 bytes) 000272 1787844748.380710 write 0x00dc53 thru 0x01338f (0x573d bytes) 000274 1787844748.399674 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d1ba): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d1ba): Mirror 3: 0x796416fb (stale) CRC-32 checksum value for chunk [0, 0x3d1ba): Mirror 1: 0xbb995aa9 Mirror 4: 0xbb995aa9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d1ba: skipped 000275 1787844749.895005 trunc from 0x03d1ba to 0x035fdf (0x71da bytes) 000276 1787844749.950773 trunc from 0x035fe0 to 0x01ec8b (0x17354 bytes) 000278 1787844749.971722 write 0x01201d thru 0x01258b (0x56f bytes) 000279 1787844749.977605 mapwrite 0x024437 thru 0x02b274 (0x6e3e bytes) 000280 1787844750.049654 write 0x00b056 thru 0x00e344 (0x32ef bytes) 000281 1787844750.067434 read 0x00c98f thru 0x01ace7 (0xe359 bytes) 000282 1787844750.078404 trunc from 0x00b3bf to 0x0126e2 (0x7324 bytes) 000283 1787844750.099290 punch from 0x021be9 to 0x022317 (0x72f bytes) 000284 1787844750.107177 mapread 0x0014f2 thru 0x00b558 (0xa067 bytes) 000285 1787844750.121158 mapwrite 0x02de43 thru 0x03698d (0x8b4b bytes) 000286 1787844750.189757 mapread 0x02c796 thru 0x03698d (0xa1f8 bytes) 000287 1787844750.191041 mapread 0x0165f7 thru 0x0213f0 (0xadfa bytes) 000288 1787844750.208289 trunc from 0x018988 to 0x02877e (0xfdf7 bytes) 000289 1787844750.218837 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3698e): Mirror 4: 0x4b67e605 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3698e): Mirror 4: 0x4b67e605 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3698e: skipped 000290 1787844750.518148 read 0x033697 thru 0x03698d (0x32f7 bytes) 000291 1787844750.524535 trunc from 0x03698e to 0x019ced (0x1cca0 bytes) 000292 1787844750.549948 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x19cee): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19cee): Mirror 4: 0xe9087b1b (stale) CRC-32 checksum value for chunk [0, 0x19cee): Mirror 1: 0xf27e70df Mirror 5: 0xf27e70df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19cee: skipped 000293 1787844751.276259 mapread 0x00c79b thru 0x00f50b (0x2d71 bytes) 000294 1787844751.301418 mapwrite 0x005964 thru 0x01502f (0xf6cc bytes) 000295 1787844751.430183 read 0x003591 thru 0x00a87b (0x72eb bytes) 000296 1787844751.430831 mapwrite 0x03cdef thru 0x03ffff (0x3211 bytes) 000297 1787844751.510833 fallocate 0x032eca thru 0x03c914 (0x9a4b bytes) 000298 1787844751.516016 write 0x00c219 thru 0x01722d (0xb015 bytes) 000299 1787844751.518597 punch from 0x03fe0c to 0x03ffff (0x1f4 bytes) 000300 1787844751.523688 mapwrite 0x0174c9 thru 0x01f6b2 (0x81ea bytes) 000301 1787844751.559242 fallocate 0x01cff9 thru 0x024a56 (0x7a5e bytes) 000302 1787844751.569599 read 0x00fb4e thru 0x01c88f (0xcd42 bytes) 000303 1787844751.570183 trunc from 0x040000 to 0x034403 (0xbbfc bytes) 000304 1787844751.599527 mapread 0x027cda thru 0x029622 (0x1949 bytes) 000305 1787844751.619566 trunc from 0x034404 to 0x00e81d (0x25be6 bytes) 000306 1787844751.691111 fallocate 0x015abd thru 0x01946f (0x39b3 bytes) 000308 1787844751.726522 punch from 0x015667 to 0x01946f (0x3e09 bytes) 000309 1787844751.741324 mapwrite 0x03fa75 thru 0x03ffff (0x58b bytes) 000310 1787844751.827277 punch from 0x01056d to 0x0193be (0x8e52 bytes) 000311 1787844751.835630 mapwrite 0x012234 thru 0x01b546 (0x9313 bytes) 000312 1787844751.965707 trunc from 0x040000 to 0x00dc85 (0x3237a bytes) 000314 1787844751.986946 trunc from 0x00dc86 to 0x02b346 (0x1d6c1 bytes) 000315 1787844752.033154 fallocate 0x01ad81 thru 0x01f3eb (0x466b bytes) 000316 1787844752.041822 read 0x0112f6 thru 0x016817 (0x5522 bytes) 000317 1787844752.063537 trunc from 0x02b347 to 0x0337fa (0x84b4 bytes) 000318 1787844752.099601 MIRROR_RESYNC 3 mirrors 000319 1787844752.911961 fallocate 0x001ee0 thru 0x00d6bd (0xb7de bytes) 000320 1787844752.964531 MIRROR_RESYNC 3 mirrors 000321 1787844753.890917 punch from 0x021de7 to 0x02fc14 (0xde2e bytes) 000322 1787844753.956158 trunc from 0x0337fb to 0x02fd38 (0x3ac2 bytes) 000323 1787844753.986029 trunc from 0x00526b to 0x0119b5 (0xc74b bytes) 000324 1787844753.996671 mapwrite 0x0189cd thru 0x01e8cc (0x5f00 bytes) 000325 1787844754.042383 trunc from 0x02fd39 to 0x027573 (0x87c5 bytes) 000326 1787844754.084469 MIRROR_RESYNC 3 mirrors 000327 1787844754.965783 trunc from 0x009c5a to 0x015d30 (0xc0d7 bytes) 000328 1787844755.010643 fallocate 0x03988b thru 0x03f3ac (0x5b22 bytes) 000329 1787844755.016403 mapread 0x027497 thru 0x027573 (0xdd bytes) 000330 1787844755.024059 mapread 0x016a9a thru 0x02525f (0xe7c6 bytes) 000331 1787844755.048113 fallocate 0x008d82 thru 0x00ce68 (0x40e7 bytes) 000332 1787844755.053684 trunc from 0x004d6a to 0x011304 (0xc59b bytes) 000333 1787844755.060598 read 0x00b1a0 thru 0x00e8ec (0x374d bytes) 000334 1787844755.068150 write 0x017ec5 thru 0x01cbd3 (0x4d0f bytes) 000335 1787844755.069588 punch from 0x01e4b8 to 0x02741f (0x8f68 bytes) 000336 1787844755.076647 punch from 0x0266ad to 0x027573 (0xec7 bytes) 000337 1787844755.081650 punch from 0x025e27 to 0x027573 (0x174d bytes) 000338 1787844755.086622 fallocate 0x03526b thru 0x037204 (0x1f9a bytes) 000340 1787844755.097609 mapwrite 0x00d2a0 thru 0x012d45 (0x5aa6 bytes) 000341 1787844755.131978 read 0x017a26 thru 0x01f79f (0x7d7a bytes) 000342 1787844755.142655 fallocate 0x0061bd thru 0x014170 (0xdfb4 bytes) 000343 1787844755.147323 mapread 0x028825 thru 0x032b43 (0xa31f bytes) 000344 1787844755.149609 fallocate 0x022399 thru 0x028100 (0x5d68 bytes) 000345 1787844755.160142 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37205): Mirror 5: 0x13351efe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37205): Mirror 5: 0x13351efe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37205: skipped 000346 1787844755.479745 trunc from 0x02b629 to 0x02c194 (0xb6c bytes) 000348 1787844755.488480 punch from 0x02f509 to 0x037204 (0x7cfc bytes) 000349 1787844755.494587 read 0x0024fb thru 0x00c6bf (0xa1c5 bytes) 000350 1787844755.510622 fallocate 0x03b9d1 thru 0x03ffff (0x462f bytes) 000351 1787844755.517344 trunc from 0x037205 to 0x009ef5 (0x2d30f bytes) 000352 1787844755.545965 mapwrite 0x005580 thru 0x00d6ef (0x8170 bytes) 000353 1787844755.599454 mapwrite 0x027da7 thru 0x037417 (0xf671 bytes) 000354 1787844755.668616 mapread 0x01be28 thru 0x01ccac (0xe85 bytes) 000355 1787844755.681010 read 0x01005e thru 0x01ebfd (0xeba0 bytes) 000356 1787844755.695266 MIRROR_RESYNC 2 mirrors 000357 1787844756.296642 fallocate 0x00f5d3 thru 0x017168 (0x7b96 bytes) 000358 1787844756.335331 trunc from 0x0208bd to 0x029b92 (0x92d6 bytes) 000360 1787844756.343660 write 0x033abe thru 0x03ffff (0xc542 bytes) 000361 1787844756.351428 fallocate 0x03fc7e thru 0x03ffff (0x382 bytes) 000362 1787844756.358044 write 0x00f89e thru 0x0192ae (0x9a11 bytes) 000363 1787844756.369463 mapwrite 0x00d7a6 thru 0x018044 (0xa89f bytes) 000364 1787844756.409391 trunc from 0x003301 to 0x00412e (0xe2e bytes) 000365 1787844756.419621 MIRROR_RESYNC 2 mirrors 000366 1787844757.334357 MIRROR_EXTEND to 3 mirrors 000367 1787844758.276611 trunc from 0x0346f1 to 0x03908e (0x499e bytes) 000368 1787844758.332377 write 0x00fd48 thru 0x017784 (0x7a3d bytes) 000369 1787844758.367663 mapread 0x03aea1 thru 0x03ffff (0x515f bytes) 000370 1787844758.446457 read 0x03281f thru 0x033fa7 (0x1789 bytes) 000371 1787844758.458881 mapwrite 0x03dede thru 0x03ffff (0x2122 bytes) 000372 1787844758.531308 MIRROR_RESYNC 3 mirrors 000373 1787844759.911550 write 0x014ad5 thru 0x01a4a4 (0x59d0 bytes) 000374 1787844759.974785 trunc from 0x040000 to 0x024818 (0x1b7e7 bytes) 000375 1787844759.998624 punch from 0x00285c to 0x00c540 (0x9ce5 bytes) 000376 1787844760.006499 fallocate 0x00a749 thru 0x01789d (0xd155 bytes) 000377 1787844760.012768 write 0x022273 thru 0x02ce24 (0xabb2 bytes) 000378 1787844760.019589 mapread 0x013c11 thru 0x018bb9 (0x4fa9 bytes) 000379 1787844760.028547 write 0x001f52 thru 0x0023c1 (0x470 bytes) 000380 1787844760.045062 mapread 0x00fc4f thru 0x01712f (0x74e1 bytes) 000381 1787844760.070391 trunc from 0x01925e to 0x01bf90 (0x2d33 bytes) 000382 1787844760.117598 mapread 0x012c43 thru 0x014c06 (0x1fc4 bytes) 000383 1787844760.119030 read 0x01bf6a thru 0x029bde (0xdc75 bytes) 000384 1787844760.135369 fallocate 0x034231 thru 0x0350d2 (0xea2 bytes) 000385 1787844760.142012 mapread 0x00021b thru 0x00c0ba (0xbea0 bytes) 000386 1787844760.155544 trunc from 0x02ce25 to 0x033b9d (0x6d79 bytes) 000387 1787844760.184159 trunc from 0x030b0c to 0x033b9d (0x3092 bytes) 000388 1787844760.193354 fallocate 0x023b0f thru 0x030f7a (0xd46c bytes) 000389 1787844760.198915 punch from 0x00d476 to 0x0157dc (0x8367 bytes) 000391 1787844760.206852 fallocate 0x03b05c thru 0x03ffff (0x4fa4 bytes) 000392 1787844760.213728 mapwrite 0x03f896 thru 0x03ffff (0x76a bytes) 000393 1787844760.245810 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xb1556b8a (stale) Mirror 6: 0xb1556b8a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x13f90f62 Mirror 7: 0x13f90f62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000394 1787844761.556149 fallocate 0x01f2d4 thru 0x026cee (0x7a1b bytes) 000395 1787844761.616168 mapwrite 0x01ee06 thru 0x02e53c (0xf737 bytes) 000396 1787844761.679869 trunc from 0x040000 to 0x009d08 (0x362f7 bytes) 000397 1787844761.736858 trunc from 0x009d09 to 0x036f29 (0x2d221 bytes) 000399 1787844761.773457 trunc from 0x02d2be to 0x036f29 (0x9c6c bytes) 000400 1787844761.778950 trunc from 0x036f2a to 0x00367d (0x338ac bytes) 000401 1787844761.815842 fallocate 0x013bf4 thru 0x016a61 (0x2e6e bytes) 000402 1787844761.824692 punch from 0x00eb6c to 0x016a61 (0x7ef6 bytes) 000403 1787844761.833925 punch from 0x0096ca to 0x01538b (0xbcc2 bytes) 000404 1787844761.839706 mapwrite 0x00812b thru 0x017017 (0xeeed bytes) 000405 1787844761.922241 mapwrite 0x00a9a9 thru 0x01287c (0x7ed4 bytes) 000406 1787844761.945873 mapwrite 0x012fa6 thru 0x02212a (0xf185 bytes) 000407 1787844762.011541 trunc from 0x00ceb6 to 0x01ca91 (0xfbdc bytes) 000408 1787844762.018475 trunc from 0x018154 to 0x02212a (0x9fd7 bytes) 000409 1787844762.024760 mapwrite 0x02a1c2 thru 0x02f246 (0x5085 bytes) 000410 1787844762.070079 trunc from 0x02f247 to 0x02898e (0x68b8 bytes) 000411 1787844762.090806 mapread 0x00790a thru 0x009244 (0x193b bytes) 000412 1787844762.093082 trunc from 0x0145d5 to 0x020cc4 (0xc6f0 bytes) 000414 1787844762.101853 trunc from 0x02898f to 0x0158b6 (0x130d8 bytes) 000415 1787844762.125798 trunc from 0x0158b7 to 0x011b4b (0x3d6b bytes) 000416 1787844762.148660 read 0x001107 thru 0x001f6e (0xe68 bytes) 000417 1787844762.149738 mapwrite 0x021625 thru 0x02f203 (0xdbdf bytes) 000418 1787844762.211375 mapread 0x01faa4 thru 0x027826 (0x7d83 bytes) 000419 1787844762.218696 MIRROR_RESYNC 4 mirrors 000420 1787844763.675096 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) 000421 1787844764.137674 mapwrite 0x02903d thru 0x02bc2d (0x2bf1 bytes) 000422 1787844764.329621 trunc from 0x02f204 to 0x0097b3 (0x25a50 bytes) 000423 1787844764.392460 fallocate 0x01392c thru 0x0155d2 (0x1ca7 bytes) 000425 1787844764.409167 read 0x009614 thru 0x0097b3 (0x1a0 bytes) 000426 1787844764.416982 trunc from 0x0097b4 to 0x00642d (0x3386 bytes) 000427 1787844764.465607 read 0x003aa1 thru 0x00642d (0x298d bytes) 000428 1787844764.479857 read 0x004fec thru 0x005409 (0x41e bytes) 000429 1787844764.480444 mapread 0x0033c8 thru 0x00642d (0x3066 bytes) 000430 1787844764.481294 write 0x03058d thru 0x03d50e (0xcf82 bytes) 000431 1787844764.489181 trunc from 0x023790 to 0x02c2a2 (0x8b13 bytes) 000432 1787844764.502952 punch from 0x03b38f to 0x03d50e (0x2180 bytes) 000434 1787844764.541762 mapread 0x02ac06 thru 0x02b340 (0x73b bytes) 000435 1787844764.587729 trunc from 0x03d50f to 0x0129b5 (0x2ab59 bytes) 000436 1787844764.631676 trunc from 0x0129b6 to 0x00a218 (0x879d bytes) 000439 1787844764.679311 MIRROR_RESYNC 3 mirrors 000440 1787844765.475169 trunc from 0x003dec to 0x0061bb (0x23d0 bytes) 000441 1787844765.514040 write 0x02c651 thru 0x03bd73 (0xf723 bytes) 000442 1787844765.518784 fallocate 0x016e9e thru 0x01f58f (0x86f2 bytes) 000443 1787844765.524492 punch from 0x00d6f8 to 0x015d81 (0x868a bytes) 000444 1787844765.529100 mapwrite 0x008dbc thru 0x00d6aa (0x48ef bytes) 000445 1787844765.575033 mapread 0x024d9c thru 0x02ad50 (0x5fb5 bytes) 000446 1787844765.593124 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3bd74): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd74): Mirror 6: 0x5ab77927 (stale) Mirror 7: 0x5ab77927 (stale) CRC-32 checksum value for chunk [0, 0x3bd74): Mirror 1: 0xdb41893e Mirror 8: 0xdb41893e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd74: skipped 000447 1787844766.704854 MIRROR_RESYNC 4 mirrors 000448 1787844767.768401 read 0x01c1ba thru 0x020e64 (0x4cab bytes) 000449 1787844767.777308 trunc from 0x000320 to 0x00a501 (0xa1e2 bytes) 000450 1787844767.832469 mapread 0x00e693 thru 0x01c13c (0xdaaa bytes) 000451 1787844767.903756 write 0x03310d thru 0x0399e6 (0x68da bytes) 000452 1787844767.916623 fallocate 0x03123d thru 0x03edfa (0xdbbe bytes) 000453 1787844767.931136 mapwrite 0x01cd2f thru 0x02555e (0x8830 bytes) 000454 1787844767.974947 mapwrite 0x008655 thru 0x01040c (0x7db8 bytes) 000455 1787844768.020856 write 0x015fd2 thru 0x01ca7f (0x6aae bytes) 000457 1787844768.027364 read 0x004d39 thru 0x005c8e (0xf56 bytes) 000458 1787844768.029342 write 0x016991 thru 0x017574 (0xbe4 bytes) 000459 1787844768.031066 mapread 0x0254da thru 0x0286a3 (0x31ca bytes) 000460 1787844768.036912 MIRROR_RESYNC 4 mirrors 000461 1787844769.316030 fallocate 0x030530 thru 0x03a006 (0x9ad7 bytes) 000462 1787844769.356881 mapwrite 0x00f505 thru 0x01a593 (0xb08f bytes) 000463 1787844769.415975 mapwrite 0x024e13 thru 0x02d262 (0x8450 bytes) 000464 1787844769.461740 mapread 0x01bec9 thru 0x025ce6 (0x9e1e bytes) 000465 1787844769.464328 read 0x01aedd thru 0x01ba67 (0xb8b bytes) 000466 1787844769.465885 read 0x01057e thru 0x0108ad (0x330 bytes) 000467 1787844769.467309 mapwrite 0x0244a9 thru 0x030a82 (0xc5da bytes) 000468 1787844769.506945 fallocate 0x01db2e thru 0x02cdf6 (0xf2c9 bytes) 000470 1787844769.517795 punch from 0x0209d0 to 0x02688f (0x5ec0 bytes) 000471 1787844769.529726 mapwrite 0x0129b5 thru 0x01391b (0xf67 bytes) 000472 1787844769.548953 punch from 0x00363e to 0x010648 (0xd00b bytes) 000473 1787844769.556644 mapread 0x0362f0 thru 0x03a897 (0x45a8 bytes) 000474 1787844769.580325 write 0x0323b0 thru 0x03ddd0 (0xba21 bytes) 000475 1787844769.589565 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3ddd1): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ddd1): Mirror 6: 0xba07f880 (stale) Mirror 7: 0xba07f880 (stale) Mirror 8: 0xba07f880 (stale) CRC-32 checksum value for chunk [0, 0x3ddd1): Mirror 1: 0x4476b06b Mirror 9: 0x4476b06b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ddd1: skipped 000476 1787844771.376687 read 0x016dda thru 0x021b7c (0xada3 bytes) 000477 1787844771.399063 punch from 0x0347aa to 0x03cf93 (0x87ea bytes) 000479 1787844771.467887 MIRROR_RESYNC 5 mirrors 000480 1787844773.662356 trunc from 0x032159 to 0x03ade5 (0x8c8d bytes) 000481 1787844773.787614 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ddd1): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ddd1): Mirror 6: 0xe81b42d (stale) Mirror 7: 0xe81b42d (stale) Mirror 8: 0xe81b42d (stale) Mirror 9: 0xe81b42d (stale) CRC-32 checksum value for chunk [0, 0x3ddd1): Mirror 1: 0xfd06a67a Mirror 10: 0xfd06a67a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ddd1: skipped 000483 1787844775.300682 fallocate 0x03ca33 thru 0x03ffff (0x35cd bytes) 000484 1787844775.353220 read 0x00ec83 thru 0x01bbb9 (0xcf37 bytes) 000485 1787844775.365674 mapwrite 0x011c5f thru 0x01ed46 (0xd0e8 bytes) 000486 1787844775.431847 mapread 0x02f3ad thru 0x03ccf0 (0xd944 bytes) 000487 1787844775.464013 trunc from 0x040000 to 0x0270b2 (0x18f4d bytes) 000488 1787844775.498848 read 0x00f883 thru 0x01be6c (0xc5ea bytes) 000489 1787844775.499965 trunc from 0x001d85 to 0x00cbc5 (0xae41 bytes) 000490 1787844775.515930 fallocate 0x001439 thru 0x002bbb (0x1783 bytes) 000492 1787844775.527726 trunc from 0x00ffea to 0x0120ca (0x20e1 bytes) 000493 1787844775.534967 mapread 0x016957 thru 0x020b24 (0xa1ce bytes) 000494 1787844775.542752 trunc from 0x00e83b to 0x0117a7 (0x2f6d bytes) 000495 1787844775.557146 trunc from 0x0270b3 to 0x017023 (0x1008f bytes) 000496 1787844775.586855 mapwrite 0x038634 thru 0x03a8d6 (0x22a3 bytes) 000497 1787844775.640986 write 0x03397b thru 0x03f579 (0xbbff bytes) 000498 1787844775.643999 fallocate 0x01d54b thru 0x02135c (0x3e12 bytes) 000499 1787844775.649843 trunc from 0x03f57a to 0x016661 (0x28f18 bytes) 000500 1787844775.673734 read 0x003cd5 thru 0x00d7aa (0x9ad6 bytes) 000501 1787844775.674531 mapread 0x012f86 thru 0x016661 (0x36dc bytes) 000502 1787844775.676400 mapread 0x004bf3 thru 0x00ff55 (0xb363 bytes) 000503 1787844775.677696 mapwrite 0x00880d thru 0x00d18b (0x497f bytes) 000504 1787844775.695001 mapwrite 0x008a9d thru 0x008e57 (0x3bb bytes) 000505 1787844775.712775 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16662): Mirror 6: 0xaae2089e (stale) Mirror 7: 0xaae2089e (stale) Mirror 9: 0xaae2089e (stale) Mirror 10: 0xaae2089e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16662): Mirror 6: 0xaae2089e (stale) Mirror 7: 0xaae2089e (stale) Mirror 9: 0xaae2089e (stale) Mirror 10: 0xaae2089e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16662: skipped 000506 1787844776.257339 trunc from 0x00508a to 0x007a6a (0x29e1 bytes) 000507 1787844776.263873 trunc from 0x0148a2 to 0x016661 (0x1dc0 bytes) 000508 1787844776.270778 punch from 0x00147e to 0x00d0a1 (0xbc24 bytes) 000510 1787844776.285703 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16662): Mirror 6: 0xaae2089e (stale) Mirror 9: 0xaae2089e (stale) Mirror 10: 0xaae2089e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16662): Mirror 6: 0xaae2089e (stale) Mirror 9: 0xaae2089e (stale) Mirror 10: 0xaae2089e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16662: skipped 000511 1787844776.692982 mapread 0x004e7c thru 0x00aa49 (0x5bce bytes) 000512 1787844776.765255 trunc from 0x00b062 to 0x016661 (0xb600 bytes) 000513 1787844776.775950 mapwrite 0x00422d thru 0x00cb71 (0x8945 bytes) 000514 1787844776.847547 MIRROR_RESYNC 4 mirrors 000515 1787844778.014616 punch from 0x012d70 to 0x016661 (0x38f2 bytes) 000516 1787844778.061073 trunc from 0x010533 to 0x012867 (0x2335 bytes) 000517 1787844778.067811 write 0x03d661 thru 0x03ffff (0x299f bytes) 000518 1787844778.069736 trunc from 0x026aa8 to 0x033308 (0xc861 bytes) 000519 1787844778.076054 trunc from 0x040000 to 0x000205 (0x3fdfa bytes) 000520 1787844778.109005 fallocate 0x02e02c thru 0x031a7d (0x3a52 bytes) 000521 1787844778.114023 trunc from 0x010185 to 0x0193c7 (0x9243 bytes) 000522 1787844778.118994 write 0x03ed6b thru 0x03ffff (0x1295 bytes) 000523 1787844778.120241 trunc from 0x011a10 to 0x01865e (0x6c4f bytes) 000524 1787844778.124932 mapread 0x03e08d thru 0x03ffff (0x1f73 bytes) 000525 1787844778.126864 trunc from 0x003f16 to 0x005546 (0x1631 bytes) 000527 1787844778.132945 write 0x029cd1 thru 0x02ad95 (0x10c5 bytes) 000528 1787844778.142781 trunc from 0x022fe4 to 0x0238bd (0x8da bytes) 000529 1787844778.147877 punch from 0x015511 to 0x022e02 (0xd8f2 bytes) 000530 1787844778.152957 mapwrite 0x00f7ac thru 0x01f770 (0xffc5 bytes) 000531 1787844778.206424 mapread 0x009aa5 thru 0x009c25 (0x181 bytes) 000532 1787844778.215385 write 0x02b567 thru 0x038684 (0xd11e bytes) 000533 1787844778.234094 trunc from 0x03cd29 to 0x03ffff (0x32d7 bytes) 000535 1787844778.240120 write 0x035ddd thru 0x03ffff (0xa223 bytes) 000536 1787844778.241966 read 0x009f15 thru 0x0176f0 (0xd7dc bytes) 000537 1787844778.242907 read 0x03c2c6 thru 0x03ffff (0x3d3a bytes) 000539 1787844778.244281 write 0x00cb43 thru 0x00e607 (0x1ac5 bytes) 000540 1787844778.246154 mapwrite 0x022862 thru 0x0273b5 (0x4b54 bytes) 000541 1787844778.286596 trunc from 0x0006f3 to 0x00833f (0x7c4d bytes) 000542 1787844778.292002 punch from 0x021d9a to 0x022ffc (0x1263 bytes) 000543 1787844778.297644 mapwrite 0x0034e2 thru 0x012734 (0xf253 bytes) 000544 1787844778.344875 trunc from 0x040000 to 0x0373c0 (0x8c3f bytes) 000545 1787844778.362596 read 0x009dfe thru 0x00fdf4 (0x5ff7 bytes) 000546 1787844778.363246 read 0x036369 thru 0x0373c0 (0x1058 bytes) 000547 1787844778.364114 trunc from 0x0373c1 to 0x03c6b7 (0x52f7 bytes) 000548 1787844778.387373 trunc from 0x03360b to 0x03652e (0x2f24 bytes) 000550 1787844778.398409 read 0x01eade thru 0x026749 (0x7c6c bytes) 000551 1787844778.409631 mapwrite 0x01a528 thru 0x01d92a (0x3403 bytes) 000552 1787844778.432905 mapread 0x01474d thru 0x022048 (0xd8fc bytes) 000553 1787844778.434814 write 0x028fdd thru 0x02d7eb (0x480f bytes) 000554 1787844778.437339 mapwrite 0x034c78 thru 0x03b777 (0x6b00 bytes) 000555 1787844778.479370 mapwrite 0x031457 thru 0x037b84 (0x672e bytes) 000556 1787844778.524367 fallocate 0x032e2d thru 0x0337c1 (0x995 bytes) 000557 1787844778.538833 read 0x00ce70 thru 0x0124d6 (0x5667 bytes) 000558 1787844778.542075 punch from 0x039c7d to 0x03c6b7 (0x2a3b bytes) 000559 1787844778.564597 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c6b8): Mirror 9: 0x2399b210 (stale) Mirror 10: 0x2399b210 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c6b8): Mirror 9: 0x2399b210 (stale) Mirror 10: 0x2399b210 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c6b8: skipped 000560 1787844779.288081 trunc from 0x028c9c to 0x035953 (0xccb8 bytes) 000561 1787844779.306645 mapread 0x02538f thru 0x03314a (0xddbc bytes) 000563 1787844779.358927 trunc from 0x03c6b8 to 0x025a8c (0x16c2b bytes) 000564 1787844779.378343 trunc from 0x025a8d to 0x032d7a (0xd2ee bytes) 000565 1787844779.394792 read 0x003c2c thru 0x008a11 (0x4de6 bytes) 000566 1787844779.404874 trunc from 0x032d7b to 0x0115fc (0x2177e bytes) 000567 1787844779.424689 fallocate 0x00d28e thru 0x01b061 (0xddd4 bytes) 000568 1787844779.431492 trunc from 0x00d7fc to 0x0115fc (0x3e01 bytes) 000569 1787844779.440438 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x115fd): Mirror 10: 0x4552fd6e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x115fd): Mirror 10: 0x4552fd6e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x115fd: skipped 000570 1787844779.753655 mapread 0x009c73 thru 0x0115fc (0x798a bytes) 000571 1787844779.773870 punch from 0x005d2e to 0x01096b (0xac3e bytes) 000572 1787844779.779080 trunc from 0x0115fd to 0x03bb77 (0x2a57b bytes) 000573 1787844779.807078 fallocate 0x030e14 thru 0x035561 (0x474e bytes) 000574 1787844779.818508 MIRROR_RESYNC 2 mirrors 000576 1787844780.829754 mapwrite 0x030cde thru 0x038969 (0x7c8c bytes) 000577 1787844780.964185 punch from 0x0108e7 to 0x0134d0 (0x2bea bytes) 000578 1787844780.970836 trunc from 0x00448b to 0x004c6a (0x7e0 bytes) 000579 1787844780.977066 mapwrite 0x003a79 thru 0x0056a8 (0x1c30 bytes) 000580 1787844781.014805 trunc from 0x03bb78 to 0x01bc34 (0x1ff43 bytes) 000581 1787844781.050059 punch from 0x002ef7 to 0x00f353 (0xc45d bytes) 000582 1787844781.057431 punch from 0x0094e8 to 0x015bd3 (0xc6ec bytes) 000583 1787844781.062882 mapwrite 0x00cd3a thru 0x01154a (0x4811 bytes) 000584 1787844781.102607 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1bc35): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bc35): Mirror 10: 0x6782c87d (stale) CRC-32 checksum value for chunk [0, 0x1bc35): Mirror 1: 0xb83c1da8 Mirror 11: 0xb83c1da8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bc35: skipped 000585 1787844782.191648 MIRROR_RESYNC 3 mirrors 000586 1787844783.239040 mapwrite 0x0249d3 thru 0x0259b2 (0xfe0 bytes) 000587 1787844783.318522 MIRROR_RESYNC 3 mirrors 000589 1787844784.025745 trunc from 0x0259b3 to 0x02fb35 (0xa183 bytes) 000590 1787844784.092446 mapread 0x00ffd5 thru 0x016b5c (0x6b88 bytes) 000591 1787844784.110784 fallocate 0x013028 thru 0x01f0a8 (0xc081 bytes) 000593 1787844784.116334 mapread 0x008789 thru 0x00e7d1 (0x6049 bytes) 000594 1787844784.127433 write 0x01e685 thru 0x02d386 (0xed02 bytes) 000595 1787844784.139615 punch from 0x017057 to 0x01b092 (0x403c bytes) 000596 1787844784.145080 trunc from 0x02fb36 to 0x01ee4e (0x10ce7 bytes) 000597 1787844784.164606 trunc from 0x007080 to 0x00c8e5 (0x5866 bytes) 000599 1787844784.171485 trunc from 0x01d60a to 0x01ee4e (0x1845 bytes) 000600 1787844784.189356 MIRROR_RESYNC 3 mirrors 000601 1787844785.277975 punch from 0x019402 to 0x01ee4e (0x5a4d bytes) 000602 1787844785.319151 punch from 0x01b8ca to 0x01ee4e (0x3585 bytes) 000603 1787844785.327499 fallocate 0x020426 thru 0x02b206 (0xade1 bytes) 000604 1787844785.335743 fallocate 0x0106f6 thru 0x012f0c (0x2817 bytes) 000605 1787844785.344389 punch from 0x00f3cc to 0x01215b (0x2d90 bytes) 000606 1787844785.352495 mapread 0x011127 thru 0x01434a (0x3224 bytes) 000607 1787844785.383950 punch from 0x009a8b to 0x0105a4 (0x6b1a bytes) 000608 1787844785.393967 trunc from 0x0178f2 to 0x01ee4e (0x755d bytes) 000609 1787844785.404133 trunc from 0x008a0a to 0x011250 (0x8847 bytes) 000610 1787844785.411897 trunc from 0x01d990 to 0x01ee4e (0x14bf bytes) 000611 1787844785.417513 mapwrite 0x018006 thru 0x026c23 (0xec1e bytes) 000612 1787844785.580387 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x26c24): Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26c24): Mirror 10: 0xddeced76 (stale) Mirror 11: 0xddeced76 (stale) CRC-32 checksum value for chunk [0, 0x26c24): Mirror 1: 0x95d049e3 Mirror 12: 0x95d049e3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26c24: skipped 000613 1787844786.548598 trunc from 0x0033b0 to 0x005d32 (0x2983 bytes) 000614 1787844786.594696 mapwrite 0x0377ba thru 0x03cdee (0x5635 bytes) 000615 1787844786.659697 trunc from 0x03cdef to 0x02214f (0x1ac9f bytes) 000616 1787844786.680411 read 0x0010d2 thru 0x00a8b0 (0x97df bytes) 000618 1787844786.692398 read 0x016f56 thru 0x02214f (0xb1fa bytes) 000619 1787844786.702120 fallocate 0x00b32e thru 0x015153 (0x9e26 bytes) 000620 1787844786.706905 fallocate 0x0013a0 thru 0x00efe8 (0xdc49 bytes) 000621 1787844786.711849 write 0x037253 thru 0x03c965 (0x5713 bytes) 000622 1787844786.713362 trunc from 0x024be2 to 0x025e78 (0x1297 bytes) 000623 1787844786.718592 mapread 0x0069c9 thru 0x015044 (0xe67c bytes) 000624 1787844786.720588 mapwrite 0x007cc2 thru 0x013603 (0xb942 bytes) 000626 1787844786.741662 mapread 0x01c5e1 thru 0x027bd6 (0xb5f6 bytes) 000627 1787844786.752437 mapread 0x0007f2 thru 0x01060e (0xfe1d bytes) 000628 1787844786.753536 mapread 0x02de86 thru 0x037e44 (0x9fbf bytes) 000629 1787844786.755076 trunc from 0x013b26 to 0x013d29 (0x204 bytes) 000630 1787844786.760082 punch from 0x01c3a1 to 0x01e292 (0x1ef2 bytes) 000631 1787844786.764675 trunc from 0x031a1b to 0x03b3e2 (0x99c8 bytes) 000632 1787844786.771006 mapread 0x020854 thru 0x026e9e (0x664b bytes) 000633 1787844786.772094 trunc from 0x03c966 to 0x031480 (0xb4e5 bytes) 000634 1787844786.792055 write 0x01a42b thru 0x020a97 (0x666d bytes) 000637 1787844786.795112 trunc from 0x0284cb to 0x031480 (0x8fb6 bytes) 000638 1787844786.800539 trunc from 0x027e9c to 0x02ff4b (0x80b0 bytes) 000639 1787844786.805978 fallocate 0x0320d7 thru 0x03cf66 (0xae90 bytes) 000640 1787844786.810517 trunc from 0x02aeba to 0x02bf2a (0x1071 bytes) 000641 1787844786.815373 fallocate 0x011402 thru 0x01f83b (0xe43a bytes) 000642 1787844786.820333 write 0x01eba3 thru 0x0225e9 (0x3a47 bytes) 000643 1787844786.826095 mapread 0x024b97 thru 0x027ff2 (0x345c bytes) 000645 1787844786.836933 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x31481): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31481): Mirror 10: 0x243b5016 (stale) Mirror 11: 0x243b5016 (stale) Mirror 12: 0xb5609c92 (stale) CRC-32 checksum value for chunk [0, 0x31481): Mirror 1: 0xdaa9b574 Mirror 13: 0xdaa9b574 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31481: skipped 000646 1787844788.149673 mapwrite 0x01c773 thru 0x0232b2 (0x6b40 bytes) 000647 1787844788.272400 mapwrite 0x0135d1 thru 0x01a378 (0x6da8 bytes) 000648 1787844788.305536 read 0x00c84f thru 0x0167e7 (0x9f99 bytes) 000649 1787844788.306640 mapread 0x0170fd thru 0x0211e7 (0xa0eb bytes) 000650 1787844788.308764 fallocate 0x00ebef thru 0x01069e (0x1ab0 bytes) 000651 1787844788.317007 read 0x028fd4 thru 0x031480 (0x84ad bytes) 000652 1787844788.341326 mapwrite 0x010a44 thru 0x012a95 (0x2052 bytes) 000653 1787844788.359693 fallocate 0x02f653 thru 0x03dd64 (0xe712 bytes) 000654 1787844788.370247 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dd65): Mirror 10: 0x2129b154 (stale) Mirror 11: 0x2129b154 (stale) Mirror 13: 0x8bd4bf4a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd65): Mirror 10: 0x2129b154 (stale) Mirror 11: 0x2129b154 (stale) Mirror 13: 0x8bd4bf4a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd65: skipped 000655 1787844788.761984 punch from 0x010d79 to 0x014ef2 (0x417a bytes) 000656 1787844788.769664 write 0x030695 thru 0x0331da (0x2b46 bytes) 000657 1787844788.788771 punch from 0x00e967 to 0x015a73 (0x710d bytes) 000658 1787844788.794967 punch from 0x0369e0 to 0x03dd64 (0x7385 bytes) 000660 1787844788.802505 mapwrite 0x013e60 thru 0x0141df (0x380 bytes) 000661 1787844788.842901 trunc from 0x03dd65 to 0x01e83f (0x1f525 bytes) 000663 1787844788.860037 mapread 0x0157cb thru 0x015a81 (0x2b7 bytes) 000664 1787844788.886530 fallocate 0x00b6ae thru 0x018e36 (0xd789 bytes) 000665 1787844788.901380 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1e840): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e840): Mirror 10: 0x28105fc (stale) Mirror 11: 0x28105fc (stale) Mirror 13: 0x5d53dbc8 (stale) CRC-32 checksum value for chunk [0, 0x1e840): Mirror 1: 0x14364b4c Mirror 14: 0x14364b4c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e840: skipped 000667 1787844789.918847 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1e840): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e840): Mirror 10: 0x28105fc (stale) Mirror 11: 0x28105fc (stale) Mirror 13: 0x5d53dbc8 (stale) CRC-32 checksum value for chunk [0, 0x1e840): Mirror 1: 0x14364b4c Mirror 14: 0x14364b4c Mirror 15: 0x14364b4c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e840: skipped 000668 1787844790.798065 read 0x00d89e thru 0x01bb80 (0xe2e3 bytes) 000669 1787844790.813338 mapwrite 0x031702 thru 0x034790 (0x308f bytes) 000670 1787844790.908320 mapwrite 0x027e0a thru 0x02e6cf (0x68c6 bytes) 000671 1787844790.973689 mapread 0x00f450 thru 0x01100e (0x1bbf bytes) 000672 1787844791.012447 punch from 0x010cf6 to 0x01d587 (0xc892 bytes) 000673 1787844791.021460 fallocate 0x024d48 thru 0x029aae (0x4d67 bytes) 000674 1787844791.029184 fallocate 0x02164d thru 0x030291 (0xec45 bytes) 000675 1787844791.038113 fallocate 0x0324a4 thru 0x03cf32 (0xaa8f bytes) 000676 1787844791.045671 read 0x010eab thru 0x010f47 (0x9d bytes) 000677 1787844791.084326 trunc from 0x007b14 to 0x012fad (0xb49a bytes) 000678 1787844791.091354 punch from 0x013320 to 0x014693 (0x1374 bytes) 000679 1787844791.105908 mapread 0x01f180 thru 0x02cd60 (0xdbe1 bytes) 000680 1787844791.107093 read 0x01e5ba thru 0x022ffd (0x4a44 bytes) 000681 1787844791.114142 mapwrite 0x02788b thru 0x032037 (0xa7ad bytes) 000682 1787844791.158595 fallocate 0x01e45b thru 0x02ca20 (0xe5c6 bytes) 000683 1787844791.168021 write 0x02c64f thru 0x02fa9d (0x344f bytes) 000684 1787844791.169716 punch from 0x0096e5 to 0x015dd0 (0xc6ec bytes) 000685 1787844791.175718 mapread 0x01021e thru 0x012faa (0x2d8d bytes) 000686 1787844791.202751 mapread 0x004623 thru 0x00b340 (0x6d1e bytes) 000687 1787844791.207239 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3cf33): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cf33): Mirror 10: 0x328b44c3 (stale) Mirror 11: 0x328b44c3 (stale) Mirror 13: 0x79a91471 (stale) Mirror 14: 0xf48c766d (stale) Mirror 15: 0xf48c766d (stale) CRC-32 checksum value for chunk [0, 0x3cf33): Mirror 1: 0xd776cc0e Mirror 16: 0xd776cc0e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cf33: skipped 000688 1787844792.369622 punch from 0x02517d to 0x025c42 (0xac6 bytes) 000689 1787844792.430113 mapwrite 0x02537e thru 0x02e21b (0x8e9e bytes) 000690 1787844792.480544 mapread 0x014277 thru 0x017236 (0x2fc0 bytes) 000691 1787844792.493328 write 0x03ff3f thru 0x03ffff (0xc1 bytes) 000692 1787844792.500859 trunc from 0x040000 to 0x034d4a (0xb2b5 bytes) 000693 1787844792.554584 punch from 0x007ab7 to 0x00cf70 (0x54ba bytes) 000694 1787844792.561584 trunc from 0x034d4b to 0x024102 (0x10c48 bytes) 000695 1787844792.580549 punch from 0x01610d to 0x024102 (0xdff6 bytes) 000696 1787844792.586741 write 0x02f574 thru 0x030796 (0x1223 bytes) 000697 1787844792.588169 fallocate 0x027e39 thru 0x036543 (0xe70b bytes) 000698 1787844792.601339 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30797): Mirror 10: 0x32157e21 (stale) Mirror 11: 0x32157e21 (stale) Mirror 13: 0xbe08175e (stale) Mirror 15: 0xa54ef94d (stale) Mirror 16: 0x70d48bad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30797): Mirror 10: 0x32157e21 (stale) Mirror 11: 0x32157e21 (stale) Mirror 13: 0xbe08175e (stale) Mirror 15: 0xa54ef94d (stale) Mirror 16: 0x70d48bad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30797: skipped 000699 1787844793.063537 trunc from 0x030797 to 0x002bfc (0x2db9a bytes) 000700 1787844793.086791 fallocate 0x00cf15 thru 0x010cba (0x3da6 bytes) 000701 1787844793.095789 punch from 0x0010b8 to 0x002bfc (0x1b45 bytes) 000702 1787844793.101084 trunc from 0x000a03 to 0x002bfc (0x21fa bytes) 000703 1787844793.108146 read 0x001efe thru 0x002bfc (0xcff bytes) 000704 1787844793.115343 write 0x01fdae thru 0x0288c0 (0x8b13 bytes) 000705 1787844793.118674 mapwrite 0x0109fb thru 0x01523b (0x4841 bytes) 000706 1787844793.164401 mapwrite 0x016e2b thru 0x017fa7 (0x117d bytes) 000707 1787844793.177603 trunc from 0x0288c1 to 0x02603d (0x2883 bytes) 000708 1787844793.199441 trunc from 0x02603e to 0x023f03 (0x213a bytes) 000709 1787844793.217152 mapwrite 0x0145f2 thru 0x01c732 (0x8141 bytes) 000710 1787844793.244806 trunc from 0x023f04 to 0x01bb8d (0x8376 bytes) 000711 1787844793.260631 punch from 0x00d90f to 0x01bb8d (0xe27f bytes) 000712 1787844793.269622 mapwrite 0x003438 thru 0x0048b9 (0x1482 bytes) 000713 1787844793.298957 mapread 0x010ffe thru 0x01bb8d (0xab90 bytes) 000715 1787844793.318645 mapread 0x00ad4f thru 0x00fb05 (0x4db7 bytes) 000716 1787844793.320504 mapread 0x014c63 thru 0x01bb8d (0x6f2b bytes) 000718 1787844793.322904 trunc from 0x01bb8e to 0x03b48d (0x1f900 bytes) 000719 1787844793.342651 read 0x002671 thru 0x0080ea (0x5a7a bytes) 000720 1787844793.343853 mapread 0x031f4a thru 0x03b48d (0x9544 bytes) 000721 1787844793.356525 punch from 0x02334b to 0x02a322 (0x6fd8 bytes) 000722 1787844793.369678 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b48e): Mirror 10: 0xa1ecf8c4 (stale) Mirror 13: 0xcec186cd (stale) Mirror 15: 0x28ec9bc0 (stale) Mirror 16: 0x2d96177e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b48e): Mirror 10: 0xa1ecf8c4 (stale) Mirror 13: 0xcec186cd (stale) Mirror 15: 0x28ec9bc0 (stale) Mirror 16: 0x2d96177e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b48e: skipped 000723 1787844793.756525 trunc from 0x00831a to 0x009225 (0xf0c bytes) 000724 1787844793.767152 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3b48e): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b48e): Mirror 10: 0xa1ecf8c4 (stale) Mirror 13: 0xcec186cd (stale) Mirror 15: 0x28ec9bc0 (stale) Mirror 16: 0x2d96177e (stale) CRC-32 checksum value for chunk [0, 0x3b48e): Mirror 1: 0x43937ac Mirror 17: 0x43937ac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b48e: skipped 000725 1787844794.816561 mapwrite 0x023f56 thru 0x0284e0 (0x458b bytes) 000726 1787844794.920728 mapread 0x032cf2 thru 0x032f17 (0x226 bytes) 000727 1787844794.932170 trunc from 0x01b468 to 0x025a66 (0xa5ff bytes) 000728 1787844794.947669 MIRROR_RESYNC 6 mirrors 000729 1787844796.789139 write 0x023157 thru 0x02d09e (0x9f48 bytes) 000730 1787844796.857159 mapread 0x033e10 thru 0x0363b3 (0x25a4 bytes) 000731 1787844796.909227 fallocate 0x03d585 thru 0x03ffff (0x2a7b bytes) 000732 1787844796.914094 mapread 0x028d5c thru 0x02d679 (0x491e bytes) 000733 1787844796.916541 trunc from 0x00495b to 0x008ba6 (0x424c bytes) 000734 1787844796.928373 trunc from 0x002314 to 0x0110d6 (0xedc3 bytes) 000735 1787844796.940447 MIRROR_RESYNC 6 mirrors 000736 1787844798.676702 read 0x00d648 thru 0x018473 (0xae2c bytes) 000737 1787844798.691147 trunc from 0x038a19 to 0x03b48d (0x2a75 bytes) 000738 1787844798.742683 mapwrite 0x037a07 thru 0x03cf47 (0x5541 bytes) 000739 1787844798.844608 read 0x02c6bd thru 0x035bfc (0x9540 bytes) 000740 1787844798.855127 write 0x001d10 thru 0x00fee0 (0xe1d1 bytes) 000741 1787844798.857421 mapread 0x011660 thru 0x01713a (0x5adb bytes) 000742 1787844798.858493 write 0x02bae2 thru 0x0384b9 (0xc9d8 bytes) 000743 1787844798.860486 read 0x014ab1 thru 0x018969 (0x3eb9 bytes) 000744 1787844798.861364 mapwrite 0x0066ff thru 0x009c2e (0x3530 bytes) 000745 1787844798.901910 mapwrite 0x01264b thru 0x01f5ef (0xcfa5 bytes) 000746 1787844798.932134 mapwrite 0x00b413 thru 0x0122a0 (0x6e8e bytes) 000747 1787844798.952372 trunc from 0x014fa6 to 0x01a6c3 (0x571e bytes) 000748 1787844798.965550 MIRROR_RESYNC 6 mirrors 000749 1787844800.565284 read 0x0009d3 thru 0x00e8d4 (0xdf02 bytes) 000750 1787844800.593447 read 0x01b378 thru 0x01c9d3 (0x165c bytes) 000751 1787844800.611927 mapwrite 0x0284db thru 0x030726 (0x824c bytes) 000752 1787844800.796183 mapwrite 0x02b5e5 thru 0x03851b (0xcf37 bytes) 000754 1787844800.894183 read 0x02e172 thru 0x033bd0 (0x5a5f bytes) 000755 1787844800.903506 MIRROR_RESYNC 6 mirrors 000756 1787844802.851884 trunc from 0x03cf48 to 0x0388d6 (0x4671 bytes) 000757 1787844802.967164 trunc from 0x01b142 to 0x01f5b0 (0x446f bytes) 000758 1787844802.984428 write 0x03e26b thru 0x03ffff (0x1d95 bytes) 000760 1787844802.990960 mapread 0x0148da thru 0x01d539 (0x8c60 bytes) 000761 1787844803.028445 read 0x01cec6 thru 0x01e005 (0x1140 bytes) 000762 1787844803.036635 MIRROR_RESYNC 6 mirrors 000763 1787844805.607422 write 0x02b900 thru 0x03780d (0xbf0e bytes) 000766 1787844805.712672 mapread 0x039dd8 thru 0x03b5f9 (0x1822 bytes) 000767 1787844805.802877 write 0x022e70 thru 0x031c05 (0xed96 bytes) 000768 1787844805.866034 mapread 0x01dc45 thru 0x01f6a4 (0x1a60 bytes) 000769 1787844805.893015 fallocate 0x01bbd8 thru 0x0207bc (0x4be5 bytes) 000770 1787844805.909310 mapread 0x01f5f7 thru 0x020c3d (0x1647 bytes) 000771 1787844805.916280 write 0x01677a thru 0x023e41 (0xd6c8 bytes) 000772 1787844805.925706 fallocate 0x0283fd thru 0x02a15e (0x1d62 bytes) 000773 1787844805.937645 mapwrite 0x00dd79 thru 0x01330c (0x5594 bytes) 000774 1787844806.017610 trunc from 0x040000 to 0x03b3ec (0x4c13 bytes) 000775 1787844806.046404 mapwrite 0x033e40 thru 0x03ffff (0xc1c0 bytes) 000776 1787844806.161102 read 0x030e1d thru 0x038eed (0x80d1 bytes) 000777 1787844806.163393 write 0x004dd7 thru 0x011895 (0xcabf bytes) 000778 1787844806.178414 fallocate 0x011425 thru 0x01666e (0x524a bytes) 000779 1787844806.194087 read 0x01ec27 thru 0x02af89 (0xc363 bytes) 000780 1787844806.199718 trunc from 0x040000 to 0x0072b4 (0x38d4b bytes) 000781 1787844806.240907 punch from 0x006b56 to 0x0072b4 (0x75f bytes) 000782 1787844806.282254 punch from 0x003212 to 0x00714e (0x3f3d bytes) 000783 1787844806.291586 mapread 0x00361a thru 0x0072b4 (0x3c9b bytes) 000784 1787844806.339093 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x72b5): Mirror 10: 0x29609df (stale) Mirror 13: 0x29609df (stale) Mirror 16: 0x29609df (stale) Mirror 17: 0x29609df (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x72b5): Mirror 10: 0x29609df (stale) Mirror 13: 0x29609df (stale) Mirror 16: 0x29609df (stale) Mirror 17: 0x29609df (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x72b5: skipped 000785 1787844807.079858 write 0x01a78b thru 0x025624 (0xae9a bytes) 000786 1787844807.095793 mapread 0x01ec14 thru 0x0202b4 (0x16a1 bytes) 000787 1787844807.096721 punch from 0x00c70f to 0x00d273 (0xb65 bytes) 000789 1787844807.112309 trunc from 0x01a838 to 0x01ae5b (0x624 bytes) 000790 1787844807.162096 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25625): Mirror 13: 0x15bd4cbd (stale) Mirror 16: 0x15bd4cbd (stale) Mirror 17: 0x15bd4cbd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25625): Mirror 13: 0x15bd4cbd (stale) Mirror 16: 0x15bd4cbd (stale) Mirror 17: 0x15bd4cbd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25625: skipped 000791 1787844807.545070 write 0x02a0be thru 0x030686 (0x65c9 bytes) 000792 1787844807.552971 trunc from 0x02482d to 0x02fdba (0xb58e bytes) 000793 1787844807.570512 trunc from 0x030687 to 0x00370c (0x2cf7a bytes) 000794 1787844807.597828 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x370d): Mirror 16: 0xf14ab944 (stale) Mirror 17: 0xf14ab944 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x370d): Mirror 16: 0xf14ab944 (stale) Mirror 17: 0xf14ab944 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x370d: skipped 000795 1787844808.060650 write 0x0390c0 thru 0x03c9d8 (0x3919 bytes) 000796 1787844808.066367 read 0x02260b thru 0x02aeab (0x88a1 bytes) 000797 1787844808.083064 mapread 0x0262eb thru 0x030181 (0x9e97 bytes) 000798 1787844808.124666 punch from 0x01a60a to 0x01aaed (0x4e4 bytes) 000800 1787844808.135092 trunc from 0x0338a3 to 0x03c9d8 (0x9136 bytes) 000802 1787844808.165837 trunc from 0x03c9d9 to 0x0346e4 (0x82f4 bytes) 000803 1787844808.199679 write 0x015ed0 thru 0x017383 (0x14b4 bytes) 000804 1787844808.215698 mapread 0x0052b3 thru 0x00b8a9 (0x65f7 bytes) 000805 1787844808.226028 write 0x001fcf thru 0x010d1b (0xed4d bytes) 000806 1787844808.228481 punch from 0x015b81 to 0x016370 (0x7f0 bytes) 000807 1787844808.265443 punch from 0x020be5 to 0x029c99 (0x90b5 bytes) 000809 1787844808.294572 read 0x025979 thru 0x0308a4 (0xaf2c bytes) 000810 1787844808.331514 punch from 0x01ede0 to 0x01fb6d (0xd8e bytes) 000811 1787844808.343674 mapwrite 0x00aad2 thru 0x01103c (0x656b bytes) 000812 1787844808.389323 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x346e5): Mirror 16: 0xbf981e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x346e5): Mirror 16: 0xbf981e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x346e5: skipped 000813 1787844808.930735 MIRROR_RESYNC 2 mirrors 000814 1787844810.034447 trunc from 0x0346e5 to 0x039774 (0x5090 bytes) 000816 1787844810.129303 mapwrite 0x027359 thru 0x029e09 (0x2ab1 bytes) 000817 1787844810.209978 trunc from 0x02879f to 0x02f160 (0x69c2 bytes) 000820 1787844810.237605 mapread 0x004394 thru 0x00e622 (0xa28f bytes) 000821 1787844810.263828 punch from 0x00a07e to 0x01869d (0xe620 bytes) 000822 1787844810.272643 read 0x02218d thru 0x027ee6 (0x5d5a bytes) 000823 1787844810.277940 mapwrite 0x01e209 thru 0x02dea6 (0xfc9e bytes) 000824 1787844810.371103 fallocate 0x0147a0 thru 0x01a2d9 (0x5b3a bytes) 000825 1787844810.379395 mapwrite 0x03db32 thru 0x03ffff (0x24ce bytes) 000826 1787844810.484066 read 0x02f291 thru 0x031f67 (0x2cd7 bytes) 000828 1787844810.489179 mapwrite 0x00d02b thru 0x01aed0 (0xdea6 bytes) 000829 1787844810.547970 MIRROR_RESYNC 2 mirrors 000830 1787844811.946622 trunc from 0x040000 to 0x03abc7 (0x5438 bytes) 000831 1787844812.032050 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) 000832 1787844812.253735 punch from 0x023f7a to 0x02fc4a (0xbcd1 bytes) 000833 1787844812.270303 punch from 0x029df6 to 0x032a6d (0x8c78 bytes) 000836 1787844812.288954 mapread 0x034bdb thru 0x03abc7 (0x5fed bytes) 000837 1787844812.349326 read 0x034163 thru 0x03abc7 (0x6a65 bytes) 000838 1787844812.351095 mapwrite 0x00323f thru 0x009d9c (0x6b5e bytes) 000839 1787844812.439675 trunc from 0x031b71 to 0x03650f (0x499f bytes) 000840 1787844812.448011 punch from 0x038d84 to 0x03abc7 (0x1e44 bytes) 000841 1787844812.461598 punch from 0x038297 to 0x03abc7 (0x2931 bytes) 000842 1787844812.474275 trunc from 0x037d92 to 0x03abc7 (0x2e36 bytes) 000843 1787844812.485867 trunc from 0x0045d0 to 0x00c3f8 (0x7e29 bytes) 000844 1787844812.494171 write 0x01a8e9 thru 0x01f87a (0x4f92 bytes) 000845 1787844812.510902 punch from 0x02b77a to 0x03231a (0x6ba1 bytes) 000846 1787844812.517292 write 0x00c49e thru 0x01469d (0x8200 bytes) 000847 1787844812.528187 fallocate 0x03493b thru 0x03fbdb (0xb2a1 bytes) 000848 1787844812.533301 trunc from 0x03fbdc to 0x03ad0d (0x4ece bytes) 000849 1787844812.564962 trunc from 0x011153 to 0x0199ae (0x885c bytes) 000850 1787844812.615578 mapread 0x001270 thru 0x006928 (0x56b9 bytes) 000851 1787844812.670635 mapwrite 0x003b91 thru 0x00c34f (0x87bf bytes) 000852 1787844812.749852 fallocate 0x001bd2 thru 0x00477c (0x2bab bytes) 000853 1787844812.768713 punch from 0x007ff5 to 0x016efc (0xef08 bytes) 000855 1787844812.781605 mapread 0x021e34 thru 0x02252e (0x6fb bytes) 000856 1787844812.804425 fallocate 0x00fe86 thru 0x0116ab (0x1826 bytes) 000857 1787844812.818759 trunc from 0x03ad0e to 0x00bd76 (0x2ef97 bytes) 000858 1787844812.849070 punch from 0x001c88 to 0x001f30 (0x2a9 bytes) 000859 1787844812.861720 fallocate 0x0187a7 thru 0x01d884 (0x50de bytes) 000861 1787844812.873035 punch from 0x00a265 to 0x0195d2 (0xf36e bytes) 000862 1787844812.890067 trunc from 0x01d885 to 0x036d73 (0x194ef bytes) 000863 1787844812.936048 write 0x003629 thru 0x00618c (0x2b64 bytes) 000864 1787844812.938098 trunc from 0x036d74 to 0x00af95 (0x2bdde bytes) 000865 1787844812.967984 trunc from 0x00ae3f to 0x00af95 (0x157 bytes) 000866 1787844812.973582 fallocate 0x032881 thru 0x033014 (0x794 bytes) 000867 1787844812.978839 mapread 0x0078c3 thru 0x0096d2 (0x1e10 bytes) 000868 1787844812.993262 punch from 0x00143d to 0x003537 (0x20fb bytes) 000869 1787844813.006348 punch from 0x0043d2 to 0x00699a (0x25c9 bytes) 000870 1787844813.018495 MIRROR_EXTEND to 2 mirrors 000871 1787844814.058101 mapwrite 0x02483b thru 0x02b4dc (0x6ca2 bytes) 000872 1787844814.265593 trunc from 0x00127b to 0x00c489 (0xb20f bytes) 000873 1787844814.275578 trunc from 0x02b4dd to 0x01059d (0x1af3f bytes) 000875 1787844814.315165 trunc from 0x01059e to 0x039169 (0x28bcc bytes) 000876 1787844814.344874 mapwrite 0x0211af thru 0x026a25 (0x5877 bytes) 000877 1787844814.436656 MIRROR_RESYNC 2 mirrors 000878 1787844815.182125 read 0x038374 thru 0x039169 (0xdf6 bytes) 000879 1787844815.188896 trunc from 0x03916a to 0x02f15b (0xa00e bytes) 000880 1787844815.287854 trunc from 0x02a426 to 0x02f15b (0x4d36 bytes) 000881 1787844815.302971 mapwrite 0x039233 thru 0x03ffff (0x6dcd bytes) 000882 1787844815.397691 read 0x01f064 thru 0x02600f (0x6fac bytes) 000884 1787844815.411294 write 0x0268fe thru 0x02b867 (0x4f6a bytes) 000885 1787844815.416594 trunc from 0x040000 to 0x01cf85 (0x2307a bytes) 000886 1787844815.459712 mapread 0x012357 thru 0x01973e (0x73e8 bytes) 000887 1787844815.460856 fallocate 0x027230 thru 0x028a01 (0x17d2 bytes) 000889 1787844815.477287 punch from 0x00aee6 to 0x019c03 (0xed1e bytes) 000890 1787844815.495274 trunc from 0x01cf86 to 0x00142b (0x1bb5a bytes) 000891 1787844815.574709 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x142c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x142c): Mirror 2: 0x51975ed (stale) CRC-32 checksum value for chunk [0, 0x142c): Mirror 1: 0x51975ed Mirror 3: 0x51975ed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x142c: skipped 000892 1787844816.999142 punch from 0x000220 to 0x00142b (0x120c bytes) 000893 1787844817.089113 mapwrite 0x033407 thru 0x03eaec (0xb6e6 bytes) 000894 1787844817.179559 mapread 0x022112 thru 0x02a182 (0x8071 bytes) 000895 1787844817.190707 trunc from 0x01289b to 0x016840 (0x3fa6 bytes) 000896 1787844817.196543 fallocate 0x012ab1 thru 0x018881 (0x5dd1 bytes) 000897 1787844817.202119 read 0x00930a thru 0x00cb53 (0x384a bytes) 000898 1787844817.209488 fallocate 0x003003 thru 0x003d2e (0xd2c bytes) 000899 1787844817.216116 write 0x0117e1 thru 0x0143a4 (0x2bc4 bytes) 000900 1787844817.227885 trunc from 0x03eaed to 0x038ccd (0x5e1f bytes) 000901 1787844817.249533 mapread 0x035ca8 thru 0x038ccd (0x3026 bytes) 000902 1787844817.255670 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x38cce): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38cce): Mirror 2: 0x9bb04dc3 (stale) Mirror 3: 0xc987e7fe (stale) CRC-32 checksum value for chunk [0, 0x38cce): Mirror 1: 0x5b7fa0c3 Mirror 4: 0x5b7fa0c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38cce: skipped 000903 1787844818.348763 trunc from 0x001b4e to 0x005010 (0x34c3 bytes) 000904 1787844818.392448 mapwrite 0x020a02 thru 0x02bce9 (0xb2e8 bytes) 000905 1787844818.448254 mapwrite 0x00643f thru 0x00d06f (0x6c31 bytes) 000906 1787844818.483552 mapwrite 0x015e67 thru 0x01a036 (0x41d0 bytes) 000907 1787844818.514020 MIRROR_RESYNC 4 mirrors 000908 1787844820.158829 mapwrite 0x024a92 thru 0x02a52f (0x5a9e bytes) 000910 1787844820.276824 mapread 0x03823e thru 0x038ccd (0xa90 bytes) 000911 1787844820.321910 trunc from 0x016e45 to 0x020003 (0x91bf bytes) 000912 1787844820.349086 mapwrite 0x01816b thru 0x01e3c5 (0x625b bytes) 000913 1787844820.396798 trunc from 0x038cce to 0x004ba9 (0x34124 bytes) 000914 1787844820.421560 punch from 0x00327a to 0x004ba9 (0x1930 bytes) 000915 1787844820.433466 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x4baa): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4baa): Mirror 2: 0x15833df6 (stale) Mirror 3: 0x15833df6 (stale) Mirror 4: 0x15833df6 (stale) CRC-32 checksum value for chunk [0, 0x4baa): Mirror 1: 0x15833df6 Mirror 5: 0x15833df6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4baa: skipped 000917 1787844821.490650 trunc from 0x0038f2 to 0x004ba9 (0x12b8 bytes) 000918 1787844821.548093 mapread 0x00149e thru 0x002bd9 (0x173c bytes) 000919 1787844821.565331 mapread 0x003010 thru 0x004ba9 (0x1b9a bytes) 000920 1787844821.576188 write 0x019f1f thru 0x0244a3 (0xa585 bytes) 000921 1787844821.588873 fallocate 0x00293a thru 0x003517 (0xbde bytes) 000923 1787844821.601034 fallocate 0x00ee4d thru 0x018b74 (0x9d28 bytes) 000924 1787844821.607503 read 0x020c18 thru 0x0244a3 (0x388c bytes) 000925 1787844821.608677 read 0x023a24 thru 0x0244a3 (0xa80 bytes) 000926 1787844821.609349 trunc from 0x00bb4c to 0x00e83b (0x2cf0 bytes) 000927 1787844821.625318 trunc from 0x016405 to 0x01717c (0xd78 bytes) 000928 1787844821.642341 fallocate 0x02e93a thru 0x02f765 (0xe2c bytes) 000929 1787844821.656559 punch from 0x012069 to 0x014ee3 (0x2e7b bytes) 000930 1787844821.666569 trunc from 0x0244a4 to 0x00bf8e (0x18515 bytes) 000931 1787844821.753836 write 0x036d59 thru 0x03ffff (0x92a7 bytes) 000932 1787844821.763692 write 0x02202a thru 0x02b216 (0x91ed bytes) 000933 1787844821.780233 mapwrite 0x019ae4 thru 0x020538 (0x6a55 bytes) 000934 1787844821.813042 mapread 0x030ac1 thru 0x03b1fe (0xa73e bytes) 000935 1787844821.814029 write 0x00ed76 thru 0x010de6 (0x2071 bytes) 000936 1787844821.824159 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x44925bd0 (stale) Mirror 3: 0x44925bd0 (stale) Mirror 4: 0x44925bd0 (stale) Mirror 5: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x737d39ae Mirror 6: 0x737d39ae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000937 1787844823.738700 fallocate 0x033fee thru 0x03ffff (0xc012 bytes) 000938 1787844823.851031 read 0x03dc5c thru 0x03ffff (0x23a4 bytes) 000939 1787844823.868697 trunc from 0x01159a to 0x0118d8 (0x33f bytes) 000940 1787844823.895895 mapread 0x032a14 thru 0x03a092 (0x767f bytes) 000941 1787844823.970052 mapwrite 0x03d5d4 thru 0x03ffff (0x2a2c bytes) 000942 1787844824.019094 write 0x021230 thru 0x02de1f (0xcbf0 bytes) 000943 1787844824.040030 mapwrite 0x01978a thru 0x01bc80 (0x24f7 bytes) 000944 1787844824.096119 write 0x01c4d2 thru 0x0241ed (0x7d1c bytes) 000946 1787844824.103818 mapwrite 0x023fa8 thru 0x02c499 (0x84f2 bytes) 000947 1787844824.165990 mapwrite 0x02df83 thru 0x0329be (0x4a3c bytes) 000948 1787844824.211612 fallocate 0x014468 thru 0x01806b (0x3c04 bytes) 000949 1787844824.223819 mapread 0x0231b2 thru 0x02d4cb (0xa31a bytes) 000950 1787844824.225702 trunc from 0x0391be to 0x03f766 (0x65a9 bytes) 000952 1787844824.233510 read 0x0198b5 thru 0x01ba83 (0x21cf bytes) 000953 1787844824.234246 trunc from 0x006d36 to 0x00aa9d (0x3d68 bytes) 000954 1787844824.238222 fallocate 0x02eefb thru 0x02fd4b (0xe51 bytes) 000955 1787844824.242156 fallocate 0x006d73 thru 0x00ebb4 (0x7e42 bytes) 000956 1787844824.247051 trunc from 0x040000 to 0x01c7d6 (0x23829 bytes) 000957 1787844824.294094 write 0x031fae thru 0x0384ab (0x64fe bytes) 000958 1787844824.296463 mapread 0x0233c7 thru 0x03102f (0xdc69 bytes) 000959 1787844824.309925 trunc from 0x0384ac to 0x03d835 (0x538a bytes) 000960 1787844824.341929 fallocate 0x00722d thru 0x0154e6 (0xe2ba bytes) 000961 1787844824.359545 trunc from 0x03d836 to 0x013202 (0x2a633 bytes) 000962 1787844824.385301 mapread 0x00315a thru 0x007eb1 (0x4d58 bytes) 000963 1787844824.387039 trunc from 0x013203 to 0x00fe30 (0x33d2 bytes) 000964 1787844824.444418 trunc from 0x00d27e to 0x00fe30 (0x2bb3 bytes) 000965 1787844824.458976 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xfe31): Mirror 3: 0xe29d0512 (stale) Mirror 4: 0xe29d0512 (stale) Mirror 5: 0xe0fd03c7 (stale) Mirror 6: 0x545d261e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfe31): Mirror 3: 0xe29d0512 (stale) Mirror 4: 0xe29d0512 (stale) Mirror 5: 0xe0fd03c7 (stale) Mirror 6: 0x545d261e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfe31: skipped 000967 1787844825.027729 read 0x007535 thru 0x00762d (0xf9 bytes) 000968 1787844825.039067 mapread 0x007940 thru 0x00fe30 (0x84f1 bytes) 000969 1787844825.082807 write 0x03169b thru 0x037422 (0x5d88 bytes) 000970 1787844825.089798 punch from 0x019f97 to 0x028867 (0xe8d1 bytes) 000971 1787844825.095341 fallocate 0x03dd61 thru 0x03ffff (0x229f bytes) 000972 1787844825.100697 write 0x00d2b2 thru 0x01759b (0xa2ea bytes) 000973 1787844825.115557 read 0x0183c4 thru 0x021757 (0x9394 bytes) 000974 1787844825.137871 mapwrite 0x03f2e7 thru 0x03ffff (0xd19 bytes) 000975 1787844825.218386 mapwrite 0x000e13 thru 0x00c549 (0xb737 bytes) 000976 1787844825.258257 mapwrite 0x011c5c thru 0x01cfe5 (0xb38a bytes) 000977 1787844825.310051 fallocate 0x003587 thru 0x008e45 (0x58bf bytes) 000978 1787844825.321933 read 0x0209d9 thru 0x023dac (0x33d4 bytes) 000979 1787844825.324659 mapwrite 0x0256d4 thru 0x02a400 (0x4d2d bytes) 000980 1787844825.376349 mapwrite 0x03145e thru 0x03201e (0xbc1 bytes) 000981 1787844825.423369 read 0x008295 thru 0x008f54 (0xcc0 bytes) 000982 1787844825.423918 punch from 0x01a48a to 0x01cab2 (0x2629 bytes) 000983 1787844825.434273 trunc from 0x0377e2 to 0x03ffff (0x881e bytes) 000984 1787844825.446538 punch from 0x01d511 to 0x0270c2 (0x9bb2 bytes) 000985 1787844825.469947 punch from 0x01380a to 0x01c538 (0x8d2f bytes) 000987 1787844825.493653 fallocate 0x02bb24 thru 0x0370fa (0xb5d7 bytes) 000988 1787844825.501977 fallocate 0x028574 thru 0x028ba2 (0x62f bytes) 000990 1787844825.531014 mapwrite 0x036e9e thru 0x03b229 (0x438c bytes) 000991 1787844825.604530 write 0x01f8c6 thru 0x02f41b (0xfb56 bytes) 000992 1787844825.617149 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x44925bd0 (stale) Mirror 5: 0xe20eea22 (stale) Mirror 6: 0x737d39ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x44925bd0 (stale) Mirror 5: 0xe20eea22 (stale) Mirror 6: 0x737d39ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000993 1787844826.396678 write 0x02ebe4 thru 0x031938 (0x2d55 bytes) 000994 1787844826.427714 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xe20eea22 (stale) Mirror 6: 0x737d39ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xe20eea22 (stale) Mirror 6: 0x737d39ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000995 1787844826.757636 trunc from 0x040000 to 0x019232 (0x26dcd bytes) 000996 1787844826.825788 trunc from 0x014576 to 0x017818 (0x32a3 bytes) 000997 1787844826.838114 write 0x00aea3 thru 0x0184ba (0xd618 bytes) 000998 1787844826.863542 trunc from 0x019233 to 0x025f98 (0xcd66 bytes) 000999 1787844826.911988 read 0x018cab thru 0x025c56 (0xcfac bytes) All operations completed A-OK!