== sanity-flr test 70a: flr mode fsx test ================ 03:34:29 (1788593669) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 3671 skipping zero size read fallocating to largest ever: 0x252e0 000002 1788593671.533189 fallocate 0x018bef thru 0x0252df (0xc6f1 bytes) 000003 1788593671.551653 MIRROR_EXTEND to 2 mirrors skipping zero size read skipping zero length zero range 000006 1788593671.931249 mapwrite 0x01dbb5 thru 0x02477d (0x6bc9 bytes) fallocating to largest ever: 0x2cc73 000007 1788593672.046950 fallocate 0x020ca6 thru 0x02cc72 (0xbfcd bytes) 000008 1788593672.053733 trunc from 0x02477e to 0x027408 (0x2c8b bytes) 000009 1788593672.082709 read 0x012da9 thru 0x018bd7 (0x5e2f bytes) 000010 1788593672.094956 punch from 0x0017df to 0x00aa3b (0x925d bytes) 000012 1788593672.100195 trunc from 0x019727 to 0x026804 (0xd0de bytes) 000013 1788593672.110149 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) fallocating to largest ever: 0x3f745 000014 1788593672.290633 fallocate 0x0359a4 thru 0x03f744 (0x9da1 bytes) 000015 1788593672.301699 trunc from 0x027409 to 0x00f008 (0x18400 bytes) 000016 1788593672.346036 read 0x00aee3 thru 0x00f008 (0x4126 bytes) 000018 1788593672.367316 write 0x0247ce thru 0x02ba4d (0x7280 bytes) 000019 1788593672.376691 trunc from 0x002da5 to 0x00613b (0x3397 bytes) 000020 1788593672.385990 write 0x00938e thru 0x015930 (0xc5a3 bytes) 000021 1788593672.397498 punch from 0x008031 to 0x01782f (0xf7ff bytes) 000022 1788593672.429712 write 0x031c0f thru 0x031fc2 (0x3b4 bytes) 000023 1788593672.430820 read 0x012021 thru 0x0188a3 (0x6883 bytes) fallocating to largest ever: 0x40000 000025 1788593672.461272 fallocate 0x03fb74 thru 0x03ffff (0x48c bytes) 000026 1788593672.482620 trunc from 0x040000 to 0x03953d (0x6ac2 bytes) 000027 1788593672.515890 punch from 0x00916b to 0x01446c (0xb302 bytes) 000028 1788593672.523859 write 0x00a36f thru 0x00ecc2 (0x4954 bytes) 000029 1788593672.551486 MIRROR_EXTEND to 2 mirrors 000030 1788593673.664564 read 0x033dd2 thru 0x03953d (0x576c bytes) 000031 1788593673.705946 mapwrite 0x00ae3f thru 0x00c52e (0x16f0 bytes) 000032 1788593673.911949 write 0x0030b5 thru 0x00e3b0 (0xb2fc bytes) 000034 1788593673.933406 read 0x00da4e thru 0x01b422 (0xd9d5 bytes) 000035 1788593673.944454 write 0x007b0b thru 0x00c52b (0x4a21 bytes) 000036 1788593673.945648 write 0x02e8f1 thru 0x03448c (0x5b9c bytes) 000037 1788593673.958066 trunc from 0x0104da to 0x010fd5 (0xafc bytes) 000038 1788593673.967222 mapwrite 0x005406 thru 0x00d822 (0x841d bytes) 000039 1788593674.036384 trunc from 0x03953e to 0x01d649 (0x1bef4 bytes) 000040 1788593674.076726 punch from 0x000764 to 0x00e173 (0xda10 bytes) 000041 1788593674.084568 punch from 0x0047da to 0x013898 (0xf0bf bytes) 000042 1788593674.094868 mapread 0x009c33 thru 0x01182f (0x7bfd bytes) 000043 1788593674.211708 trunc from 0x01d64a to 0x013ec8 (0x9781 bytes) 000044 1788593674.247741 mapread 0x005f88 thru 0x012c44 (0xccbd bytes) 000045 1788593674.304379 trunc from 0x00049a to 0x00f1de (0xed45 bytes) 000046 1788593674.314881 punch from 0x00fff7 to 0x013ec8 (0x3ed2 bytes) 000047 1788593674.366294 read 0x00a7d6 thru 0x010aa1 (0x62cc bytes) 000048 1788593674.389560 mapwrite 0x03b5b9 thru 0x03be39 (0x881 bytes) 000049 1788593674.468967 MIRROR_RESYNC 2 mirrors 000051 1788593675.213088 trunc from 0x03be3a to 0x018096 (0x23da3 bytes) 000052 1788593675.286785 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) 000053 1788593675.466790 fallocate 0x00a5b6 thru 0x018f1e (0xe969 bytes) 000054 1788593675.475540 write 0x023f46 thru 0x027f8d (0x4048 bytes) 000055 1788593675.482879 read 0x01b945 thru 0x0217e4 (0x5ea0 bytes) 000056 1788593675.498013 mapread 0x010479 thru 0x01d87f (0xd407 bytes) 000057 1788593675.549346 mapwrite 0x005c4b thru 0x00a343 (0x46f9 bytes) 000058 1788593675.581027 mapread 0x007b2d thru 0x014202 (0xc6d6 bytes) 000059 1788593675.582835 fallocate 0x033cc5 thru 0x03bbe4 (0x7f20 bytes) 000060 1788593675.588056 trunc from 0x027f8e to 0x00dc2e (0x1a35f bytes) 000061 1788593675.605899 mapwrite 0x01bfb2 thru 0x02ba15 (0xfa64 bytes) 000062 1788593675.701251 punch from 0x0213f5 to 0x027e76 (0x6a82 bytes) 000063 1788593675.707823 read 0x018cf1 thru 0x01b1a1 (0x24b1 bytes) 000064 1788593675.708648 trunc from 0x02ba16 to 0x02ad64 (0xcb1 bytes) 000065 1788593675.732213 punch from 0x01577f to 0x01911b (0x399d bytes) 000066 1788593675.740615 mapread 0x02891b thru 0x02ad64 (0x244a bytes) 000067 1788593675.742787 mapwrite 0x02a8c6 thru 0x02bdd9 (0x1514 bytes) 000069 1788593675.786357 mapwrite 0x030974 thru 0x036593 (0x5c20 bytes) 000070 1788593675.829582 trunc from 0x036594 to 0x02b69c (0xaef7 bytes) 000071 1788593675.849733 mapwrite 0x023ae0 thru 0x02a7b7 (0x6cd8 bytes) 000072 1788593675.868463 punch from 0x01fd7f to 0x02701b (0x729d bytes) 000073 1788593675.875834 mapread 0x00f5bd thru 0x017947 (0x838b bytes) 000076 1788593675.882822 punch from 0x011044 to 0x0166fb (0x56b8 bytes) 000077 1788593675.888396 fallocate 0x01cfc0 thru 0x027e6c (0xaead bytes) 000078 1788593675.894027 mapread 0x021e7e thru 0x02b69c (0x981f bytes) 000079 1788593675.933383 trunc from 0x0113e2 to 0x01b7ee (0xa40d bytes) 000080 1788593675.944560 punch from 0x007331 to 0x007d41 (0xa11 bytes) 000081 1788593675.953790 trunc from 0x013526 to 0x01ecbe (0xb799 bytes) 000082 1788593675.960896 write 0x010bfe thru 0x014c7c (0x407f bytes) 000083 1788593675.967759 fallocate 0x036d0a thru 0x03ffff (0x92f6 bytes) 000084 1788593675.973794 read 0x000649 thru 0x00cc37 (0xc5ef bytes) 000085 1788593676.002588 write 0x03ddeb thru 0x03ffff (0x2215 bytes) 000086 1788593676.004201 mapwrite 0x013fd7 thru 0x015046 (0x1070 bytes) 000089 1788593676.049078 trunc from 0x02528e to 0x02a0c3 (0x4e36 bytes) 000090 1788593676.054639 mapwrite 0x02df40 thru 0x03115d (0x321e bytes) 000091 1788593676.084578 mapwrite 0x0305f5 thru 0x03a72d (0xa139 bytes) 000092 1788593676.105908 write 0x037593 thru 0x03ffff (0x8a6d bytes) 000093 1788593676.114872 MIRROR_EXTEND to 2 mirrors 000094 1788593677.130345 mapread 0x016e65 thru 0x020b37 (0x9cd3 bytes) 000095 1788593677.183892 read 0x0349bf thru 0x03ffff (0xb641 bytes) 000096 1788593677.209285 punch from 0x000869 to 0x00216e (0x1906 bytes) 000097 1788593677.290702 punch from 0x00506f to 0x012ba8 (0xdb3a bytes) 000098 1788593677.301783 mapwrite 0x01d67d thru 0x0219d6 (0x435a bytes) 000099 1788593677.386606 mapread 0x012d5d thru 0x018a26 (0x5cca bytes) 000100 1788593677.399306 fallocate 0x02a86b thru 0x035433 (0xabc9 bytes) 000101 1788593677.407913 trunc from 0x040000 to 0x03fd6e (0x291 bytes) 000102 1788593677.510317 mapwrite 0x0184e8 thru 0x01d42f (0x4f48 bytes) 000103 1788593677.531360 mapwrite 0x01c3a9 thru 0x01f24e (0x2ea6 bytes) 000104 1788593677.549051 mapwrite 0x00ec99 thru 0x012142 (0x34aa bytes) 000106 1788593677.587713 write 0x00e2dc thru 0x0197b5 (0xb4da bytes) 000107 1788593677.590553 write 0x036df0 thru 0x037798 (0x9a9 bytes) 000108 1788593677.620088 trunc from 0x017f15 to 0x0257eb (0xd8d7 bytes) 000109 1788593677.672864 punch from 0x0084e0 to 0x011cb0 (0x97d1 bytes) 000111 1788593677.686346 read 0x01d94b thru 0x02b933 (0xdfe9 bytes) 000112 1788593677.717044 read 0x03b74a thru 0x03fd6e (0x4625 bytes) 000114 1788593677.724068 fallocate 0x023fe8 thru 0x02fa78 (0xba91 bytes) 000115 1788593677.741011 trunc from 0x03fd6f to 0x00cf31 (0x32e3d bytes) 000116 1788593677.799260 trunc from 0x00cf32 to 0x03ed47 (0x31e16 bytes) 000117 1788593677.817524 write 0x01a908 thru 0x01f5bf (0x4cb8 bytes) 000118 1788593677.837360 write 0x018314 thru 0x024258 (0xbf45 bytes) 000119 1788593677.839779 trunc from 0x000420 to 0x008a77 (0x8658 bytes) 000120 1788593677.849934 write 0x013aec thru 0x01e6da (0xabef bytes) 000121 1788593677.851233 trunc from 0x03ed48 to 0x01d076 (0x21cd1 bytes) 000122 1788593677.872059 punch from 0x00954d to 0x011edc (0x8990 bytes) 000123 1788593677.892050 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) 000124 1788593678.090397 trunc from 0x01d077 to 0x010bea (0xc48c bytes) 000125 1788593678.130827 mapwrite 0x03081d thru 0x03f0b4 (0xe898 bytes) 000127 1788593678.244037 punch from 0x003126 to 0x00b37c (0x8257 bytes) 000129 1788593678.261885 write 0x0081f9 thru 0x01202f (0x9e37 bytes) 000130 1788593678.272783 write 0x0241d5 thru 0x0317fa (0xd626 bytes) 000131 1788593678.279167 read 0x0146d7 thru 0x015d37 (0x1661 bytes) 000132 1788593678.284512 mapread 0x020c24 thru 0x0294fa (0x88d7 bytes) 000134 1788593678.300523 punch from 0x025af7 to 0x02fb8f (0xa099 bytes) 000135 1788593678.319057 trunc from 0x0251c3 to 0x02efc1 (0x9dff bytes) 000137 1788593678.325166 read 0x017247 thru 0x0243e7 (0xd1a1 bytes) 000138 1788593678.345344 write 0x0273e3 thru 0x028cc6 (0x18e4 bytes) 000139 1788593678.348429 punch from 0x0098ec to 0x0130a2 (0x97b7 bytes) 000140 1788593678.354538 write 0x0106ef thru 0x014934 (0x4246 bytes) 000141 1788593678.364891 trunc from 0x03f0b5 to 0x03b2a6 (0x3e0e bytes) 000142 1788593678.387079 trunc from 0x02b968 to 0x0332b2 (0x794b bytes) 000143 1788593678.393327 punch from 0x0352ed to 0x03b2a6 (0x5fba bytes) 000144 1788593678.399528 read 0x022a1d thru 0x0296d4 (0x6cb8 bytes) 000145 1788593678.400589 fallocate 0x012759 thru 0x014a8f (0x2337 bytes) 000146 1788593678.407028 read 0x037192 thru 0x03b2a6 (0x4115 bytes) 000147 1788593678.420736 mapread 0x02f3f6 thru 0x03b2a6 (0xbeb1 bytes) 000148 1788593678.422209 read 0x02407c thru 0x030fc3 (0xcf48 bytes) 000149 1788593678.425859 mapread 0x0379b3 thru 0x03b2a6 (0x38f4 bytes) 000150 1788593678.427593 fallocate 0x033294 thru 0x03f2cf (0xc03c bytes) 000151 1788593678.439584 trunc from 0x0303aa to 0x03b2a6 (0xaefd bytes) 000152 1788593678.446931 fallocate 0x006069 thru 0x0060e7 (0x7f bytes) 000153 1788593678.459849 read 0x00f975 thru 0x019b84 (0xa210 bytes) 000154 1788593678.460540 trunc from 0x008121 to 0x00d866 (0x5746 bytes) 000155 1788593678.468966 trunc from 0x03b2a7 to 0x00265c (0x38c4a bytes) 000157 1788593678.498911 punch from 0x0017b5 to 0x00265c (0xea8 bytes) 000158 1788593678.509402 punch from 0x000486 to 0x00265c (0x21d7 bytes) 000159 1788593678.519667 fallocate 0x001cee thru 0x0095b2 (0x78c5 bytes) 000160 1788593678.526758 write 0x03bc3e thru 0x03fa6b (0x3e2e bytes) 000161 1788593678.533883 write 0x011d9f thru 0x01ee19 (0xd07b bytes) 000163 1788593678.562085 trunc from 0x03fa6c to 0x03178c (0xe2df bytes) 000164 1788593678.586462 trunc from 0x03178d to 0x00f35a (0x22432 bytes) 000165 1788593678.614896 MIRROR_EXTEND to 2 mirrors 000167 1788593679.638490 mapread 0x00b5da thru 0x00f35a (0x3d81 bytes) 000168 1788593679.692397 MIRROR_EXTEND to 3 mirrors 000169 1788593680.517239 trunc from 0x003538 to 0x0064d2 (0x2f9b bytes) 000170 1788593680.680500 trunc from 0x00f35b to 0x016366 (0x700c bytes) 000171 1788593680.715275 mapread 0x0035f3 thru 0x00f684 (0xc092 bytes) 000172 1788593680.758989 read 0x00305d thru 0x00a732 (0x76d6 bytes) 000173 1788593680.759853 write 0x010839 thru 0x01cd43 (0xc50b bytes) 000174 1788593680.782589 write 0x0380e8 thru 0x03a658 (0x2571 bytes) 000175 1788593680.786147 mapread 0x025a71 thru 0x034531 (0xeac1 bytes) 000176 1788593680.835525 trunc from 0x02cb52 to 0x02f8e2 (0x2d91 bytes) 000177 1788593680.846270 trunc from 0x03a659 to 0x009abb (0x30b9d bytes) 000178 1788593680.867201 punch from 0x00021a to 0x0077c4 (0x75ab bytes) 000179 1788593680.874894 mapread 0x0076e6 thru 0x009abb (0x23d6 bytes) 000180 1788593680.890263 write 0x02aa53 thru 0x02b1d2 (0x780 bytes) 000181 1788593680.892517 mapwrite 0x01911d thru 0x0289db (0xf8bf bytes) 000182 1788593680.953166 trunc from 0x01a106 to 0x02619a (0xc095 bytes) 000183 1788593680.961184 read 0x017be0 thru 0x0187b1 (0xbd2 bytes) 000184 1788593680.962082 trunc from 0x02b1d3 to 0x02e451 (0x327f bytes) 000185 1788593680.983036 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2e452): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e452): Mirror 2: 0x395739b7 (stale) Mirror 3: 0x395739b7 (stale) CRC-32 checksum value for chunk [0, 0x2e452): Mirror 1: 0xb4d8ce93 Mirror 4: 0xb4d8ce93 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e452: skipped 000186 1788593682.480203 fallocate 0x036446 thru 0x037a5f (0x161a bytes) 000187 1788593682.530632 MIRROR_RESYNC 4 mirrors 000188 1788593684.133908 MIRROR_EXTEND to 5 mirrors 000189 1788593685.218459 mapwrite 0x02720a thru 0x035960 (0xe757 bytes) 000190 1788593685.367817 trunc from 0x0219c0 to 0x031573 (0xfbb4 bytes) 000191 1788593685.376393 trunc from 0x037a60 to 0x00ea2a (0x29035 bytes) 000192 1788593685.439588 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xea2b): Mirror 2: 0x4e505672 (stale) Mirror 3: 0x4e505672 (stale) Mirror 5: 0x4e505672 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xea2b): Mirror 2: 0x4e505672 (stale) Mirror 3: 0x4e505672 (stale) Mirror 5: 0x4e505672 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xea2b: skipped 000193 1788593685.936888 fallocate 0x00fbb4 thru 0x01382b (0x3c78 bytes) 000194 1788593685.944350 write 0x03ef5e thru 0x03ffff (0x10a2 bytes) 000195 1788593685.952880 mapwrite 0x01723b thru 0x024f01 (0xdcc7 bytes) 000196 1788593686.007961 trunc from 0x040000 to 0x02f3bd (0x10c42 bytes) 000197 1788593686.038067 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f3be): Mirror 2: 0x78636e29 (stale) Mirror 3: 0x78636e29 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f3be): Mirror 2: 0x78636e29 (stale) Mirror 3: 0x78636e29 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f3be: skipped 000198 1788593686.555543 read 0x0180ff thru 0x026113 (0xe015 bytes) 000199 1788593686.570735 mapwrite 0x028b4d thru 0x030512 (0x79c6 bytes) 000200 1788593686.636068 mapwrite 0x029b0d thru 0x02ee8a (0x537e bytes) 000201 1788593686.670887 MIRROR_RESYNC 3 mirrors 000203 1788593687.801664 trunc from 0x030513 to 0x028796 (0x7d7c bytes) 000204 1788593687.874058 read 0x022e9f thru 0x028796 (0x58f8 bytes) 000205 1788593687.893061 mapread 0x01623f thru 0x025571 (0xf333 bytes) 000207 1788593687.948292 punch from 0x011584 to 0x014986 (0x3403 bytes) 000208 1788593687.953364 trunc from 0x01015a to 0x0149c2 (0x4869 bytes) 000209 1788593687.957929 mapread 0x00c505 thru 0x012ce3 (0x67df bytes) 000210 1788593687.969430 mapread 0x025d05 thru 0x028796 (0x2a92 bytes) 000211 1788593687.971062 read 0x011009 thru 0x01a377 (0x936f bytes) 000212 1788593687.971917 punch from 0x0178c3 to 0x01ade7 (0x3525 bytes) 000213 1788593687.977484 trunc from 0x028797 to 0x03a24b (0x11ab5 bytes) 000214 1788593688.025833 mapwrite 0x0064f9 thru 0x00a012 (0x3b1a bytes) 000215 1788593688.063287 fallocate 0x016b2a thru 0x025e6a (0xf341 bytes) 000216 1788593688.074488 trunc from 0x00c690 to 0x01871c (0xc08d bytes) 000217 1788593688.080947 punch from 0x027d77 to 0x0347a0 (0xca2a bytes) 000218 1788593688.090911 trunc from 0x0017f4 to 0x00ff6e (0xe77b bytes) 000219 1788593688.101632 punch from 0x0002d3 to 0x00f104 (0xee32 bytes) 000220 1788593688.116315 MIRROR_RESYNC 3 mirrors 000221 1788593689.092890 mapread 0x02bb55 thru 0x032dbc (0x7268 bytes) 000222 1788593689.123082 read 0x019105 thru 0x01a24a (0x1146 bytes) 000224 1788593689.128303 trunc from 0x01e442 to 0x029cd7 (0xb896 bytes) 000226 1788593689.181429 fallocate 0x027412 thru 0x02a22a (0x2e19 bytes) 000227 1788593689.190945 read 0x0023df thru 0x011b9b (0xf7bd bytes) 000228 1788593689.222753 punch from 0x027123 to 0x02e53e (0x741c bytes) 000230 1788593689.228990 fallocate 0x01a0f1 thru 0x020a1d (0x692d bytes) 000231 1788593689.241959 MIRROR_RESYNC 3 mirrors 000232 1788593690.259397 punch from 0x030c4e to 0x0357aa (0x4b5d bytes) 000233 1788593690.314347 trunc from 0x03a24c to 0x039e7c (0x3cf bytes) 000234 1788593690.347075 trunc from 0x039e7d to 0x014d36 (0x25146 bytes) 000235 1788593690.381611 fallocate 0x01d312 thru 0x023a8b (0x677a bytes) 000236 1788593690.399504 mapwrite 0x01c5ea thru 0x02b78c (0xf1a3 bytes) 000237 1788593690.584416 write 0x02aaf6 thru 0x032402 (0x790d bytes) 000238 1788593690.589068 mapread 0x02c66d thru 0x032402 (0x5d96 bytes) 000239 1788593690.590200 trunc from 0x032403 to 0x02c184 (0x627e bytes) 000240 1788593690.628769 trunc from 0x019886 to 0x01a234 (0x9af bytes) 000241 1788593690.634582 trunc from 0x02c185 to 0x0000ba (0x2c0ca bytes) 000242 1788593690.668155 trunc from 0x0000bb to 0x00829c (0x81e2 bytes) 000243 1788593690.706406 punch from 0x005245 to 0x00829c (0x3058 bytes) 000244 1788593690.714765 read 0x002c7b thru 0x00829c (0x5622 bytes) 000245 1788593690.732759 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x829d): Mirror 3: 0x9b8c1837 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x829d): Mirror 3: 0x9b8c1837 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x829d: skipped 000246 1788593691.082360 fallocate 0x020289 thru 0x022a06 (0x277e bytes) 000248 1788593691.094064 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x829d): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x829d): Mirror 3: 0x9b8c1837 (stale) CRC-32 checksum value for chunk [0, 0x829d): Mirror 1: 0x9b8c1837 Mirror 4: 0x9b8c1837 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x829d: skipped 000249 1788593692.028196 mapwrite 0x02c178 thru 0x0315b5 (0x543e bytes) 000250 1788593692.180350 trunc from 0x0145ef to 0x01b3d8 (0x6dea bytes) 000251 1788593692.187065 mapwrite 0x015e74 thru 0x01c15d (0x62ea bytes) 000252 1788593692.214484 trunc from 0x02a8f2 to 0x0315b5 (0x6cc4 bytes) 000253 1788593692.220894 trunc from 0x0007a1 to 0x00bcdf (0xb53f bytes) 000254 1788593692.228071 trunc from 0x0081cc to 0x00dd06 (0x5b3b bytes) 000255 1788593692.235153 mapread 0x013a1f thru 0x01455a (0xb3c bytes) 000256 1788593692.236228 punch from 0x00f60f to 0x017708 (0x80fa bytes) 000257 1788593692.243119 mapwrite 0x0330ba thru 0x035da6 (0x2ced bytes) 000258 1788593692.330879 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x35da7): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35da7): Mirror 3: 0x797f77c4 (stale) Mirror 4: 0xdedf5741 (stale) CRC-32 checksum value for chunk [0, 0x35da7): Mirror 1: 0x373eae4a Mirror 5: 0x373eae4a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35da7: skipped 000259 1788593693.390732 fallocate 0x00abed thru 0x00dfe7 (0x33fb bytes) 000260 1788593693.466993 punch from 0x01b015 to 0x02349d (0x8489 bytes) 000261 1788593693.476914 mapwrite 0x00ed79 thru 0x01cc12 (0xde9a bytes) 000262 1788593693.579710 fallocate 0x00608a thru 0x00bf8e (0x5f05 bytes) 000263 1788593693.590076 punch from 0x01471c to 0x01f251 (0xab36 bytes) 000264 1788593693.597062 trunc from 0x035da7 to 0x02a28c (0xbb1a bytes) 000265 1788593693.654874 mapwrite 0x011b2f thru 0x01a4d2 (0x89a4 bytes) 000266 1788593693.727237 read 0x02507c thru 0x02a28c (0x5211 bytes) 000267 1788593693.767337 trunc from 0x016239 to 0x0245ae (0xe376 bytes) 000268 1788593693.775690 mapread 0x022097 thru 0x028bdc (0x6b46 bytes) 000269 1788593693.798924 mapwrite 0x016751 thru 0x01d09f (0x694f bytes) 000270 1788593693.840830 trunc from 0x02a28d to 0x01f955 (0xa937 bytes) 000271 1788593693.859446 trunc from 0x01f956 to 0x01b55f (0x43f6 bytes) 000272 1788593693.877029 trunc from 0x0137c8 to 0x01b55f (0x7d98 bytes) 000273 1788593693.885255 fallocate 0x00722d thru 0x01078b (0x955f bytes) 000274 1788593693.893295 mapread 0x014348 thru 0x014939 (0x5f2 bytes) 000275 1788593693.904269 read 0x0061e6 thru 0x00edcf (0x8bea bytes) 000276 1788593693.916994 punch from 0x00b185 to 0x01a83a (0xf6b6 bytes) 000277 1788593693.922950 mapwrite 0x0365af thru 0x03ffff (0x9a51 bytes) 000278 1788593693.971317 write 0x01378d thru 0x01a76f (0x6fe3 bytes) 000279 1788593694.001298 trunc from 0x03a502 to 0x03ffff (0x5afe bytes) 000280 1788593694.008229 fallocate 0x033b8c thru 0x03c15b (0x85d0 bytes) 000281 1788593694.013552 read 0x0282ea thru 0x037775 (0xf48c bytes) 000282 1788593694.014587 punch from 0x01a84c to 0x01d9b4 (0x3169 bytes) 000283 1788593694.029259 trunc from 0x040000 to 0x020829 (0x1f7d6 bytes) 000284 1788593694.054574 mapwrite 0x014318 thru 0x01d218 (0x8f01 bytes) 000285 1788593694.110642 fallocate 0x039419 thru 0x03ffff (0x6be7 bytes) 000286 1788593694.115528 punch from 0x010ee6 to 0x020829 (0xf944 bytes) 000287 1788593694.121083 trunc from 0x02082a to 0x031b7b (0x11352 bytes) 000288 1788593694.140876 trunc from 0x031b7c to 0x005570 (0x2c60b bytes) 000289 1788593694.176746 trunc from 0x005571 to 0x036b1b (0x315ab bytes) 000290 1788593694.198066 trunc from 0x000ece to 0x00e3be (0xd4f1 bytes) 000291 1788593694.205879 punch from 0x01e633 to 0x01e7a0 (0x16e bytes) 000292 1788593694.212912 fallocate 0x02a269 thru 0x0396c4 (0xf45c bytes) 000293 1788593694.218576 write 0x02ff3c thru 0x033796 (0x385b bytes) 000294 1788593694.252520 punch from 0x024771 to 0x024d1b (0x5ab bytes) 000295 1788593694.263017 write 0x016e12 thru 0x01b76e (0x495d bytes) 000296 1788593694.278583 trunc from 0x0066fa to 0x0069a3 (0x2aa bytes) 000297 1788593694.301409 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36b1c): Mirror 3: 0x8a02b462 (stale) Mirror 4: 0x748eb4ed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36b1c): Mirror 3: 0x8a02b462 (stale) Mirror 4: 0x748eb4ed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36b1c: skipped 000298 1788593694.756267 mapread 0x00965f thru 0x00be7b (0x281d bytes) 000299 1788593694.815697 fallocate 0x0304e6 thru 0x03d199 (0xccb4 bytes) 000300 1788593694.832343 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x36b1c): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36b1c): Mirror 3: 0x8a02b462 (stale) Mirror 4: 0x748eb4ed (stale) CRC-32 checksum value for chunk [0, 0x36b1c): Mirror 1: 0xceb50549 Mirror 5: 0xceb50549 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36b1c: skipped 000301 1788593695.926572 trunc from 0x022b12 to 0x02e2f7 (0xb7e6 bytes) 000302 1788593695.969286 mapwrite 0x035f34 thru 0x038da9 (0x2e76 bytes) 000303 1788593696.051326 trunc from 0x00f6b3 to 0x01b8d2 (0xc220 bytes) 000305 1788593696.059014 trunc from 0x02c4de to 0x030971 (0x4494 bytes) 000306 1788593696.068731 write 0x034def thru 0x037123 (0x2335 bytes) 000307 1788593696.071037 punch from 0x00b754 to 0x00cba4 (0x1451 bytes) 000308 1788593696.076081 mapread 0x00c717 thru 0x013572 (0x6e5c bytes) 000309 1788593696.091371 write 0x003cc3 thru 0x0063db (0x2719 bytes) 000310 1788593696.098295 mapread 0x0151e8 thru 0x01fec7 (0xace0 bytes) 000311 1788593696.116053 punch from 0x014826 to 0x01e937 (0xa112 bytes) 000312 1788593696.122604 fallocate 0x035cbb thru 0x03bffc (0x6342 bytes) 000313 1788593696.129267 punch from 0x0336df to 0x038da9 (0x56cb bytes) 000314 1788593696.145371 trunc from 0x0012ff to 0x00a9de (0x96e0 bytes) 000315 1788593696.154593 mapread 0x0238fb thru 0x032f79 (0xf67f bytes) 000317 1788593696.181776 mapwrite 0x00e6bb thru 0x011c9d (0x35e3 bytes) 000318 1788593696.199695 mapwrite 0x01d007 thru 0x02524a (0x8244 bytes) 000319 1788593696.227814 punch from 0x03464e to 0x038da9 (0x475c bytes) 000320 1788593696.233158 mapread 0x002945 thru 0x00d649 (0xad05 bytes) 000321 1788593696.243143 mapread 0x016e25 thru 0x01a343 (0x351f bytes) 000322 1788593696.244691 mapread 0x02554c thru 0x027940 (0x23f5 bytes) 000323 1788593696.245962 trunc from 0x038daa to 0x000751 (0x38658 bytes) 000324 1788593696.273168 punch from 0x0001ca to 0x000751 (0x588 bytes) 000325 1788593696.278872 trunc from 0x000184 to 0x000751 (0x5ce bytes) 000326 1788593696.284596 write 0x02cfe6 thru 0x030974 (0x398f bytes) 000327 1788593696.285848 fallocate 0x031ab1 thru 0x03dbab (0xc0fb bytes) 000328 1788593696.295806 punch from 0x028fe3 to 0x02a6e5 (0x1703 bytes) 000329 1788593696.302662 trunc from 0x03dbac to 0x0293e7 (0x147c4 bytes) 000330 1788593696.322564 trunc from 0x0293e8 to 0x00348f (0x25f58 bytes) 000331 1788593696.343594 trunc from 0x0001c4 to 0x00348f (0x32cc bytes) 000332 1788593696.352574 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3490): Mirror 3: 0x4c06606d (stale) Mirror 5: 0x4c06606d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3490): Mirror 3: 0x4c06606d (stale) Mirror 5: 0x4c06606d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3490: skipped 000333 1788593696.707441 fallocate 0x03d2ad thru 0x03ffff (0x2d53 bytes) 000334 1788593696.727555 MIRROR_RESYNC 3 mirrors 000335 1788593697.573462 MIRROR_RESYNC 3 mirrors 000336 1788593697.993560 trunc from 0x003490 to 0x0378e7 (0x34458 bytes) 000338 1788593698.040503 punch from 0x01ba68 to 0x01f437 (0x39d0 bytes) 000339 1788593698.047230 fallocate 0x005461 thru 0x0110b3 (0xbc53 bytes) 000340 1788593698.052613 fallocate 0x030952 thru 0x03cb63 (0xc212 bytes) 000341 1788593698.058479 fallocate 0x03923e thru 0x03ffff (0x6dc2 bytes) 000342 1788593698.063474 mapwrite 0x004252 thru 0x00a7ce (0x657d bytes) 000343 1788593698.098770 read 0x0267c1 thru 0x02b524 (0x4d64 bytes) 000344 1788593698.112842 punch from 0x02ac6b to 0x0391ae (0xe544 bytes) 000345 1788593698.119992 mapread 0x0019ad thru 0x003f09 (0x255d bytes) 000346 1788593698.121398 trunc from 0x040000 to 0x031b1c (0xe4e3 bytes) 000347 1788593698.152561 trunc from 0x00d3c1 to 0x013096 (0x5cd6 bytes) 000348 1788593698.175038 punch from 0x013516 to 0x0149ee (0x14d9 bytes) 000349 1788593698.180327 trunc from 0x031b1d to 0x02e452 (0x36ca bytes) 000351 1788593698.207022 trunc from 0x02e453 to 0x00afe3 (0x2346f bytes) 000352 1788593698.243882 fallocate 0x019793 thru 0x0239f8 (0xa266 bytes) 000353 1788593698.251147 punch from 0x014283 to 0x01803d (0x3dbb bytes) 000354 1788593698.264109 fallocate 0x024fc9 thru 0x030c14 (0xbc4c bytes) 000355 1788593698.270801 punch from 0x02141d to 0x02573f (0x4323 bytes) 000356 1788593698.280913 punch from 0x02f34a to 0x030c14 (0x18cb bytes) 000357 1788593698.292930 write 0x01f25f thru 0x02b36e (0xc110 bytes) 000358 1788593698.322690 fallocate 0x0386da thru 0x03f144 (0x6a6b bytes) 000359 1788593698.338976 punch from 0x0009ab to 0x00df96 (0xd5ec bytes) 000360 1788593698.348176 mapread 0x01a1c2 thru 0x023da8 (0x9be7 bytes) 000361 1788593698.372520 trunc from 0x01a3f3 to 0x029384 (0xef92 bytes) 000362 1788593698.394774 read 0x00f7f3 thru 0x017fe2 (0x87f0 bytes) 000363 1788593698.411893 punch from 0x00a240 to 0x00bacb (0x188c bytes) 000364 1788593698.417044 fallocate 0x0195fb thru 0x022213 (0x8c19 bytes) 000365 1788593698.422356 read 0x0034f1 thru 0x0060d9 (0x2be9 bytes) 000366 1788593698.426425 punch from 0x029e69 to 0x030c14 (0x6dac bytes) 000367 1788593698.432570 write 0x02a7ad thru 0x02f70f (0x4f63 bytes) 000368 1788593698.456529 read 0x018442 thru 0x021a7d (0x963c bytes) 000369 1788593698.457380 trunc from 0x030c15 to 0x03f0dc (0xe4c8 bytes) 000370 1788593698.487457 trunc from 0x00a6d2 to 0x0182a3 (0xdbd2 bytes) 000373 1788593698.496638 mapread 0x03061b thru 0x0364c0 (0x5ea6 bytes) 000374 1788593698.531238 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f0dd): Mirror 3: 0xe8e6c43d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f0dd): Mirror 3: 0xe8e6c43d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f0dd: skipped 000375 1788593698.883365 trunc from 0x03f0dd to 0x012fc6 (0x2c116 bytes) 000376 1788593698.918350 fallocate 0x001dca thru 0x004ef7 (0x312e bytes) 000377 1788593698.928505 trunc from 0x00eaf7 to 0x012fc6 (0x44d0 bytes) 000378 1788593698.942849 mapwrite 0x0056cb thru 0x00c5e4 (0x6f1a bytes) 000379 1788593698.998948 punch from 0x00a917 to 0x012fc6 (0x86b0 bytes) 000380 1788593699.004078 punch from 0x00a19a to 0x01059a (0x6401 bytes) 000381 1788593699.010511 trunc from 0x0050af to 0x012fc6 (0xdf18 bytes) 000382 1788593699.016567 read 0x00d7b4 thru 0x012fc6 (0x5813 bytes) 000383 1788593699.031611 mapwrite 0x00515d thru 0x013570 (0xe414 bytes) 000384 1788593699.134362 read 0x009fe1 thru 0x00a11c (0x13c bytes) 000385 1788593699.134977 trunc from 0x004091 to 0x0117fc (0xd76c bytes) 000387 1788593699.143613 mapread 0x01016e thru 0x013570 (0x3403 bytes) 000388 1788593699.165174 trunc from 0x002860 to 0x0104f9 (0xdc9a bytes) 000389 1788593699.176714 trunc from 0x0029ee to 0x012728 (0xfd3b bytes) 000390 1788593699.186213 mapwrite 0x029fab thru 0x0396bc (0xf712 bytes) 000391 1788593699.256406 read 0x0310c4 thru 0x0396bc (0x85f9 bytes) 000392 1788593699.257055 mapwrite 0x009a4c thru 0x00d3e1 (0x3996 bytes) 000393 1788593699.306689 trunc from 0x02eddd to 0x036ac0 (0x7ce4 bytes) 000394 1788593699.313193 trunc from 0x000d36 to 0x00af75 (0xa240 bytes) 000395 1788593699.328732 fallocate 0x01cbfd thru 0x020027 (0x342b bytes) 000396 1788593699.336681 trunc from 0x0396bd to 0x02b177 (0xe545 bytes) 000397 1788593699.368301 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) 000398 1788593699.592129 mapwrite 0x00d293 thru 0x01cf0d (0xfc7b bytes) 000400 1788593699.674175 mapwrite 0x0272a9 thru 0x02a3b8 (0x3110 bytes) 000401 1788593699.727185 punch from 0x011bdb to 0x01ba54 (0x9e7a bytes) 000402 1788593699.739612 write 0x02012b thru 0x02c999 (0xc86f bytes) 000403 1788593699.750207 mapwrite 0x01e57b thru 0x02d7af (0xf235 bytes) 000404 1788593699.866912 read 0x02bab6 thru 0x02d7af (0x1cfa bytes) 000405 1788593699.867877 write 0x01c094 thru 0x01fda0 (0x3d0d bytes) 000406 1788593699.871567 mapwrite 0x02a8aa thru 0x031e71 (0x75c8 bytes) 000407 1788593699.920148 trunc from 0x031e72 to 0x001ffb (0x2fe76 bytes) 000408 1788593699.944919 write 0x01851c thru 0x01e97a (0x645f bytes) 000409 1788593699.946226 write 0x02ead7 thru 0x033dc8 (0x52f2 bytes) 000410 1788593699.950705 mapread 0x01d649 thru 0x02bb3e (0xe4f6 bytes) 000411 1788593699.967922 trunc from 0x033637 to 0x033dc8 (0x792 bytes) 000412 1788593699.988706 mapwrite 0x01b87c thru 0x0292a0 (0xda25 bytes) 000414 1788593700.010656 mapwrite 0x014280 thru 0x01d99d (0x971e bytes) 000415 1788593700.050042 mapwrite 0x01b1ef thru 0x022393 (0x71a5 bytes) 000416 1788593700.070925 fallocate 0x02ec14 thru 0x02f69b (0xa88 bytes) 000417 1788593700.076163 write 0x02e7c7 thru 0x0316c0 (0x2efa bytes) 000418 1788593700.078425 trunc from 0x028343 to 0x02ebca (0x6888 bytes) 000419 1788593700.092721 punch from 0x0038a2 to 0x005328 (0x1a87 bytes) 000421 1788593700.099077 read 0x01786f thru 0x01e40b (0x6b9d bytes) 000422 1788593700.099896 trunc from 0x02cd49 to 0x0331a9 (0x6461 bytes) 000424 1788593700.107730 punch from 0x01afe0 to 0x0265ea (0xb60b bytes) 000426 1788593700.115689 mapread 0x0066af thru 0x0154b0 (0xee02 bytes) 000427 1788593700.131786 write 0x022ff8 thru 0x03298c (0xf995 bytes) 000428 1788593700.134714 mapread 0x01127d thru 0x0211d3 (0xff57 bytes) 000430 1788593700.137856 write 0x018e3b thru 0x024d89 (0xbf4f bytes) 000431 1788593700.140416 mapread 0x01e61d thru 0x0255fb (0x6fdf bytes) 000432 1788593700.142202 mapwrite 0x00e5f2 thru 0x019bc9 (0xb5d8 bytes) 000434 1788593700.175623 write 0x02c5ec thru 0x0331ee (0x6c03 bytes) 000435 1788593700.176818 read 0x030b8a thru 0x032311 (0x1788 bytes) 000436 1788593700.179065 mapwrite 0x0086fa thru 0x00d778 (0x507f bytes) 000437 1788593700.209881 read 0x01e478 thru 0x02b9d9 (0xd562 bytes) 000438 1788593700.215915 write 0x014637 thru 0x01ae51 (0x681b bytes) 000439 1788593700.219332 read 0x00b905 thru 0x00dea6 (0x25a2 bytes) 000440 1788593700.220449 trunc from 0x033dc9 to 0x01479d (0x1f62b bytes) 000442 1788593700.243256 trunc from 0x003333 to 0x008fd2 (0x5ca0 bytes) 000443 1788593700.249538 mapread 0x00967b thru 0x013cc7 (0xa64d bytes) 000444 1788593700.250905 trunc from 0x01479e to 0x015795 (0xff8 bytes) 000445 1788593700.270494 mapread 0x013bd4 thru 0x015795 (0x1bc2 bytes) 000446 1788593700.281897 punch from 0x008b3d to 0x00f68e (0x6b52 bytes) 000447 1788593700.288612 trunc from 0x015303 to 0x015795 (0x493 bytes) 000448 1788593700.298838 MIRROR_EXTEND to 2 mirrors 000449 1788593701.091948 mapread 0x0144ed thru 0x015795 (0x12a9 bytes) 000450 1788593701.131448 read 0x007f26 thru 0x011f8c (0xa067 bytes) 000451 1788593701.149621 trunc from 0x00cf88 to 0x015795 (0x880e bytes) 000452 1788593701.230556 mapread 0x0026f3 thru 0x00cb23 (0xa431 bytes) 000453 1788593701.250366 trunc from 0x015796 to 0x020659 (0xaec4 bytes) 000454 1788593701.317162 trunc from 0x005c9f to 0x00e816 (0x8b78 bytes) 000455 1788593701.322819 mapread 0x002e88 thru 0x007324 (0x449d bytes) 000456 1788593701.348543 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) 000457 1788593701.613250 trunc from 0x02065a to 0x03ef64 (0x1e90b bytes) 000458 1788593701.641786 punch from 0x027d19 to 0x03291d (0xac05 bytes) 000459 1788593701.649265 punch from 0x028d5a to 0x02fb5a (0x6e01 bytes) 000460 1788593701.655195 fallocate 0x034ece thru 0x03ffff (0xb132 bytes) 000461 1788593701.669768 MIRROR_EXTEND to 2 mirrors 000462 1788593702.374032 trunc from 0x007895 to 0x016d05 (0xf471 bytes) 000463 1788593702.433068 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) 000464 1788593702.588967 punch from 0x0134e9 to 0x014c83 (0x179b bytes) 000465 1788593702.596255 write 0x0030a8 thru 0x0072f7 (0x4250 bytes) 000466 1788593702.621370 fallocate 0x018cc0 thru 0x01fe5f (0x71a0 bytes) 000467 1788593702.633219 mapread 0x038c11 thru 0x03d630 (0x4a20 bytes) 000468 1788593702.679461 trunc from 0x03dbce to 0x03ffff (0x2432 bytes) 000469 1788593702.694878 mapwrite 0x00049b thru 0x00aeca (0xaa30 bytes) 000470 1788593702.766635 write 0x03cda0 thru 0x03ffff (0x3260 bytes) 000471 1788593702.768351 mapread 0x021b49 thru 0x02cf0f (0xb3c7 bytes) 000472 1788593702.791826 punch from 0x020025 to 0x026e9c (0x6e78 bytes) 000473 1788593702.796412 write 0x0244fe thru 0x02dccf (0x97d2 bytes) 000474 1788593702.803669 trunc from 0x040000 to 0x01ce53 (0x231ac bytes) 000476 1788593702.820342 trunc from 0x01449d to 0x01ce53 (0x89b7 bytes) 000477 1788593702.825690 punch from 0x0004f9 to 0x0037e3 (0x32eb bytes) 000478 1788593702.831911 trunc from 0x01ce54 to 0x017c31 (0x5222 bytes) 000479 1788593702.849548 mapwrite 0x00658b thru 0x00bfcd (0x5a43 bytes) 000480 1788593702.867174 mapread 0x0036f5 thru 0x006f7d (0x3889 bytes) 000481 1788593702.877427 read 0x0083a2 thru 0x017c31 (0xf890 bytes) 000482 1788593702.895842 MIRROR_EXTEND to 2 mirrors 000483 1788593703.696524 read 0x00ec5b thru 0x012b98 (0x3f3e bytes) 000484 1788593703.709839 mapread 0x004f6a thru 0x0078e9 (0x2980 bytes) 000485 1788593703.735015 mapwrite 0x027f91 thru 0x02a756 (0x27c6 bytes) 000486 1788593703.862833 punch from 0x0201dd to 0x022945 (0x2769 bytes) 000488 1788593703.884189 mapread 0x01a488 thru 0x027769 (0xd2e2 bytes) 000489 1788593703.916819 read 0x007aba thru 0x011948 (0x9e8f bytes) 000490 1788593703.930195 trunc from 0x01f6aa to 0x02580d (0x6164 bytes) 000491 1788593703.942372 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2a757): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a757): Mirror 2: 0xc5458713 (stale) CRC-32 checksum value for chunk [0, 0x2a757): Mirror 1: 0x95d207b3 Mirror 3: 0x95d207b3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a757: skipped 000492 1788593705.231197 fallocate 0x036973 thru 0x03b427 (0x4ab5 bytes) 000493 1788593705.273851 mapread 0x034cfe thru 0x039c76 (0x4f79 bytes) 000494 1788593705.300662 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b428): Mirror 2: 0x6f8584d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b428): Mirror 2: 0x6f8584d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b428: skipped 000495 1788593705.717401 trunc from 0x03b428 to 0x0176a9 (0x23d7e bytes) 000496 1788593705.753000 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) 000497 1788593705.917811 punch from 0x0147b9 to 0x0176a9 (0x2ef1 bytes) 000498 1788593705.925001 fallocate 0x02e2a4 thru 0x03d58f (0xf2ec bytes) 000499 1788593705.936040 trunc from 0x00ca62 to 0x016a6c (0xa00b bytes) 000501 1788593705.943848 mapread 0x003757 thru 0x003b81 (0x42b bytes) 000502 1788593705.950074 punch from 0x002432 to 0x00243c (0xb bytes) 000503 1788593705.956410 read 0x005064 thru 0x0058df (0x87c bytes) 000504 1788593705.962487 mapread 0x0129c4 thru 0x0176a9 (0x4ce6 bytes) 000505 1788593705.979056 punch from 0x00b2e0 to 0x00dce8 (0x2a09 bytes) 000506 1788593705.984825 mapread 0x00ef15 thru 0x0176a9 (0x8795 bytes) 000507 1788593705.986191 write 0x00d6e8 thru 0x0125dd (0x4ef6 bytes) 000508 1788593705.996905 mapread 0x0064bf thru 0x0129bd (0xc4ff bytes) 000509 1788593706.009986 punch from 0x00e904 to 0x0176a9 (0x8da6 bytes) 000510 1788593706.030540 read 0x00aa61 thru 0x015edd (0xb47d bytes) 000511 1788593706.047849 mapread 0x0156b1 thru 0x0176a9 (0x1ff9 bytes) 000513 1788593706.051066 trunc from 0x00a7b1 to 0x00dc60 (0x34b0 bytes) 000514 1788593706.061033 write 0x03fd74 thru 0x03ffff (0x28c bytes) 000515 1788593706.063132 punch from 0x03f474 to 0x03ffff (0xb8c bytes) 000516 1788593706.082900 trunc from 0x040000 to 0x02be3c (0x141c3 bytes) 000517 1788593706.111195 mapread 0x029901 thru 0x029ed4 (0x5d4 bytes) 000518 1788593706.130278 read 0x005fee thru 0x00b2f2 (0x5305 bytes) 000519 1788593706.142343 mapwrite 0x0077f1 thru 0x009ebc (0x26cc bytes) 000520 1788593706.180926 trunc from 0x02be3d to 0x00e128 (0x1dd14 bytes) 000521 1788593706.199412 write 0x000eb6 thru 0x0023fa (0x1545 bytes) 000522 1788593706.200599 trunc from 0x00845c to 0x00e128 (0x5ccd bytes) 000523 1788593706.210933 punch from 0x0011c5 to 0x00ca19 (0xb855 bytes) 000524 1788593706.227298 write 0x035488 thru 0x03c497 (0x7010 bytes) 000525 1788593706.229798 fallocate 0x01705e thru 0x01db37 (0x6ada bytes) 000526 1788593706.235056 fallocate 0x03ceee thru 0x03ffff (0x3112 bytes) 000527 1788593706.246422 fallocate 0x03585e thru 0x03b773 (0x5f16 bytes) 000529 1788593706.278017 mapread 0x0036c2 thru 0x00d02a (0x9969 bytes) 000531 1788593706.404505 trunc from 0x03a578 to 0x03c31f (0x1da8 bytes) 000532 1788593706.439727 mapwrite 0x005e77 thru 0x015ce6 (0xfe70 bytes) 000533 1788593706.590195 trunc from 0x031a82 to 0x0347ec (0x2d6b bytes) 000534 1788593706.596630 mapread 0x0124e5 thru 0x018fff (0x6b1b bytes) 000535 1788593706.614836 punch from 0x008d71 to 0x009ecd (0x115d bytes) 000536 1788593706.621060 mapread 0x01c552 thru 0x01cfd8 (0xa87 bytes) 000538 1788593706.630985 mapwrite 0x00fa60 thru 0x010e5d (0x13fe bytes) 000539 1788593706.652469 write 0x00067e thru 0x00fe7b (0xf7fe bytes) 000541 1788593706.657462 write 0x00881a thru 0x00e888 (0x606f bytes) 000543 1788593706.660722 punch from 0x0176e4 to 0x01b6f5 (0x4012 bytes) 000544 1788593706.665536 trunc from 0x03c498 to 0x00e3dc (0x2e0bb bytes) 000545 1788593706.697976 punch from 0x0073f4 to 0x00b021 (0x3c2e bytes) 000546 1788593706.729746 trunc from 0x00e3dd to 0x0161c1 (0x7de5 bytes) 000547 1788593706.752015 write 0x003c8b thru 0x009e05 (0x617b bytes) 000548 1788593706.762800 trunc from 0x0161c2 to 0x03af62 (0x24da1 bytes) 000549 1788593706.805457 trunc from 0x0242d9 to 0x02f87f (0xb5a7 bytes) 000550 1788593706.817048 mapwrite 0x01e180 thru 0x0215b4 (0x3435 bytes) 000551 1788593706.873168 MIRROR_EXTEND to 2 mirrors 000553 1788593708.063631 write 0x01e39c thru 0x021844 (0x34a9 bytes) 000555 1788593708.128759 mapread 0x0206c3 thru 0x02f04a (0xe988 bytes) 000556 1788593708.180914 punch from 0x039213 to 0x039e1b (0xc09 bytes) 000557 1788593708.189191 write 0x0190cb thru 0x01f6c7 (0x65fd bytes) 000558 1788593708.196860 mapwrite 0x010008 thru 0x015225 (0x521e bytes) 000559 1788593708.236861 read 0x032bcc thru 0x03af62 (0x8397 bytes) 000560 1788593708.255316 mapwrite 0x0134ef thru 0x020477 (0xcf89 bytes) 000561 1788593708.284230 write 0x01071c thru 0x0171c2 (0x6aa7 bytes) 000562 1788593708.287466 trunc from 0x0127c6 to 0x01aadc (0x8317 bytes) 000563 1788593708.300714 punch from 0x0095df to 0x0130ac (0x9ace bytes) 000564 1788593708.306497 mapread 0x018d17 thru 0x02436e (0xb658 bytes) 000565 1788593708.317367 write 0x025297 thru 0x02ff40 (0xacaa bytes) 000566 1788593708.323902 read 0x02d1be thru 0x03431f (0x7162 bytes) 000567 1788593708.324923 mapwrite 0x03ae0f thru 0x03ffff (0x51f1 bytes) 000569 1788593708.382243 write 0x0044c9 thru 0x004910 (0x448 bytes) 000570 1788593708.384005 punch from 0x003e4f to 0x00eff1 (0xb1a3 bytes) 000571 1788593708.399036 fallocate 0x02fbaa thru 0x03a16c (0xa5c3 bytes) 000572 1788593708.419784 mapread 0x00bcec thru 0x01275a (0x6a6f bytes) 000573 1788593708.475321 mapread 0x01a3bb thru 0x022746 (0x838c bytes) 000574 1788593708.480574 mapread 0x02ab98 thru 0x030708 (0x5b71 bytes) 000575 1788593708.483390 trunc from 0x040000 to 0x02b22c (0x14dd3 bytes) 000576 1788593708.527786 trunc from 0x001356 to 0x00696b (0x5616 bytes) 000577 1788593708.540467 punch from 0x00c382 to 0x014f28 (0x8ba7 bytes) 000578 1788593708.551989 mapwrite 0x026fe9 thru 0x02f287 (0x829f bytes) 000580 1788593708.657138 trunc from 0x01de3e to 0x028836 (0xa9f9 bytes) 000581 1788593708.668234 punch from 0x028735 to 0x028f10 (0x7dc bytes) 000582 1788593708.679346 read 0x0102f4 thru 0x01f71f (0xf42c bytes) 000583 1788593708.709830 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) 000584 1788593708.887521 read 0x028882 thru 0x02f287 (0x6a06 bytes) 000587 1788593708.901889 trunc from 0x0249a4 to 0x02dc57 (0x92b4 bytes) 000588 1788593708.914832 write 0x01f485 thru 0x025b0e (0x668a bytes) 000589 1788593708.952485 fallocate 0x01130b thru 0x020e49 (0xfb3f bytes) 000591 1788593708.964562 punch from 0x0274c0 to 0x02f287 (0x7dc8 bytes) 000592 1788593708.973917 fallocate 0x030f93 thru 0x0318fa (0x968 bytes) 000593 1788593708.981136 mapwrite 0x02c94f thru 0x038ba1 (0xc253 bytes) 000594 1788593709.050025 punch from 0x01d26f to 0x026898 (0x962a bytes) 000595 1788593709.059637 write 0x0198c9 thru 0x019c85 (0x3bd bytes) 000596 1788593709.066949 write 0x000dfc thru 0x00b4f2 (0xa6f7 bytes) 000597 1788593709.087084 write 0x0132b0 thru 0x01cf65 (0x9cb6 bytes) 000598 1788593709.115369 mapread 0x00761a thru 0x015e09 (0xe7f0 bytes) 000600 1788593709.146871 mapwrite 0x005c83 thru 0x0108be (0xac3c bytes) 000601 1788593709.210297 MIRROR_EXTEND to 2 mirrors 000602 1788593710.157763 MIRROR_RESYNC 2 mirrors 000603 1788593710.612013 read 0x032ca9 thru 0x038ba1 (0x5ef9 bytes) 000604 1788593710.626074 write 0x017be2 thru 0x0270e4 (0xf503 bytes) 000605 1788593710.715392 trunc from 0x038ba2 to 0x00cef7 (0x2bcaa bytes) 000606 1788593710.774330 trunc from 0x00629f to 0x00cef7 (0x6c59 bytes) 000607 1788593710.781439 fallocate 0x01f0cb thru 0x0281ad (0x90e3 bytes) 000609 1788593710.790411 fallocate 0x02b715 thru 0x03b5a2 (0xfe8e bytes) 000610 1788593710.799207 write 0x02d689 thru 0x03c2dc (0xec54 bytes) 000611 1788593710.805006 read 0x0272fc thru 0x02c18c (0x4e91 bytes) 000612 1788593710.823353 trunc from 0x03c2dd to 0x030952 (0xb98a bytes) 000613 1788593710.843940 trunc from 0x030953 to 0x001cca (0x2ec88 bytes) 000614 1788593710.865317 read 0x00049b thru 0x001cca (0x1830 bytes) 000615 1788593710.871872 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1ccb): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ccb): Mirror 2: 0x2af4831 (stale) CRC-32 checksum value for chunk [0, 0x1ccb): Mirror 1: 0x2af4831 Mirror 3: 0x2af4831 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ccb: skipped 000616 1788593711.795086 write 0x01e437 thru 0x01ea23 (0x5ed bytes) 000617 1788593711.841013 trunc from 0x01ea24 to 0x02e3f7 (0xf9d4 bytes) 000618 1788593711.872174 fallocate 0x0016f4 thru 0x0061a6 (0x4ab3 bytes) 000619 1788593711.876492 mapread 0x0274e5 thru 0x02e3f7 (0x6f13 bytes) 000621 1788593711.905748 trunc from 0x0205b4 to 0x026395 (0x5de2 bytes) 000622 1788593711.911704 write 0x013b2a thru 0x01bd53 (0x822a bytes) 000623 1788593711.924812 read 0x008348 thru 0x00b487 (0x3140 bytes) 000624 1788593711.934195 punch from 0x01b764 to 0x022710 (0x6fad bytes) 000625 1788593711.951912 punch from 0x02946b to 0x02e3f7 (0x4f8d bytes) 000626 1788593711.958519 write 0x020900 thru 0x025ebb (0x55bc bytes) 000627 1788593711.972553 mapwrite 0x03611d thru 0x03ffff (0x9ee3 bytes) 000628 1788593712.041729 fallocate 0x01d1a2 thru 0x029d82 (0xcbe1 bytes) 000629 1788593712.062624 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8d1bc5a4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8d1bc5a4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000630 1788593712.556671 mapwrite 0x02c857 thru 0x02f881 (0x302b bytes) 000631 1788593712.629352 mapwrite 0x02967d thru 0x0323f4 (0x8d78 bytes) 000632 1788593712.659911 write 0x027e85 thru 0x032a34 (0xabb0 bytes) 000633 1788593712.666835 trunc from 0x040000 to 0x01a5c1 (0x25a3e bytes) 000634 1788593712.701209 write 0x03201a thru 0x03c3cd (0xa3b4 bytes) 000635 1788593712.703940 trunc from 0x01aba1 to 0x01d33f (0x279f bytes) 000636 1788593712.712188 trunc from 0x03c3ce to 0x026e67 (0x15566 bytes) 000637 1788593712.734798 punch from 0x0162eb to 0x024c33 (0xe949 bytes) 000638 1788593712.743910 mapwrite 0x021251 thru 0x02a624 (0x93d4 bytes) 000639 1788593712.819257 mapwrite 0x002fb2 thru 0x008781 (0x57d0 bytes) 000641 1788593712.868221 trunc from 0x02a625 to 0x000d09 (0x2991b bytes) 000642 1788593712.895954 fallocate 0x026a64 thru 0x029522 (0x2abf bytes) 000643 1788593712.905168 punch from 0x016142 to 0x0232dd (0xd19c bytes) 000644 1788593712.913887 trunc from 0x029523 to 0x002703 (0x26e1f bytes) 000645 1788593712.936677 trunc from 0x001760 to 0x002703 (0xfa4 bytes) 000646 1788593712.949368 fallocate 0x02f13d thru 0x0333db (0x429f bytes) 000647 1788593712.961407 trunc from 0x0004f5 to 0x002703 (0x220f bytes) 000648 1788593712.982348 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) 000649 1788593713.183440 mapread 0x000af9 thru 0x002703 (0x1c0b bytes) 000650 1788593713.204810 fallocate 0x02d305 thru 0x03ba87 (0xe783 bytes) 000651 1788593713.215422 trunc from 0x002704 to 0x00666d (0x3f6a bytes) 000652 1788593713.253996 write 0x0132ca thru 0x018315 (0x504c bytes) 000654 1788593713.263628 trunc from 0x018316 to 0x020f61 (0x8c4c bytes) 000656 1788593713.290445 mapread 0x00c505 thru 0x01a942 (0xe43e bytes) 000657 1788593713.324271 punch from 0x01dbc2 to 0x020f61 (0x33a0 bytes) 000658 1788593713.329497 mapwrite 0x0365e9 thru 0x03869a (0x20b2 bytes) 000660 1788593713.380453 write 0x0266e4 thru 0x02d9fe (0x731b bytes) 000662 1788593713.393908 write 0x025d75 thru 0x029459 (0x36e5 bytes) 000663 1788593713.400349 write 0x032736 thru 0x0367cd (0x4098 bytes) 000664 1788593713.403923 fallocate 0x026c52 thru 0x027f94 (0x1343 bytes) 000666 1788593713.412900 trunc from 0x03869b to 0x002b5c (0x35b3e bytes) 000667 1788593713.436613 trunc from 0x002b5d to 0x015849 (0x12ced bytes) 000668 1788593713.450725 fallocate 0x0155de thru 0x020876 (0xb299 bytes) 000669 1788593713.457854 punch from 0x00d92a to 0x015849 (0x7f20 bytes) 000670 1788593713.462869 mapread 0x002fcf thru 0x00f650 (0xc682 bytes) 000671 1788593713.477768 trunc from 0x005b0a to 0x010e2f (0xb326 bytes) 000672 1788593713.483891 punch from 0x002ee0 to 0x0107a9 (0xd8ca bytes) 000673 1788593713.488764 mapread 0x008627 thru 0x015849 (0xd223 bytes) 000674 1788593713.504491 read 0x0145d0 thru 0x015849 (0x127a bytes) 000676 1788593713.505746 read 0x00f741 thru 0x013e16 (0x46d6 bytes) 000677 1788593713.506764 punch from 0x00a7c7 to 0x00d2dc (0x2b16 bytes) 000678 1788593713.513671 trunc from 0x012312 to 0x015849 (0x3538 bytes) 000679 1788593713.519160 trunc from 0x01584a to 0x01fd7a (0xa531 bytes) 000680 1788593713.536370 read 0x00b752 thru 0x01a10d (0xe9bc bytes) 000681 1788593713.550234 write 0x00097b thru 0x008bef (0x8275 bytes) 000682 1788593713.553240 trunc from 0x01fd7b to 0x0134a6 (0xc8d4 bytes) 000683 1788593713.572761 mapread 0x003ff4 thru 0x00ed86 (0xad93 bytes) 000684 1788593713.573940 trunc from 0x0134a7 to 0x0138e4 (0x43e bytes) 000686 1788593713.592212 fallocate 0x037ea3 thru 0x03ffff (0x815d bytes) 000687 1788593713.598291 trunc from 0x00cb2a to 0x0138e4 (0x6dbb bytes) 000688 1788593713.603469 trunc from 0x0138e5 to 0x016451 (0x2b6d bytes) 000689 1788593713.621885 fallocate 0x018580 thru 0x025dac (0xd82d bytes) 000690 1788593713.627435 trunc from 0x00f5df to 0x01319d (0x3bbf bytes) 000692 1788593713.633389 punch from 0x000066 to 0x00a178 (0xa113 bytes) 000693 1788593713.646922 punch from 0x01643c to 0x016451 (0x16 bytes) 000694 1788593713.652300 punch from 0x004dae to 0x007705 (0x2958 bytes) 000695 1788593713.657781 trunc from 0x016452 to 0x00b4fb (0xaf56 bytes) 000696 1788593713.674835 write 0x0275a1 thru 0x033a80 (0xc4e0 bytes) 000697 1788593713.678484 mapwrite 0x030081 thru 0x03f834 (0xf7b4 bytes) 000699 1788593713.733732 mapwrite 0x038294 thru 0x03ffff (0x7d6c bytes) 000700 1788593713.770885 write 0x017272 thru 0x023285 (0xc014 bytes) 000701 1788593713.779054 read 0x00d22a thru 0x0198e0 (0xc6b7 bytes) 000702 1788593713.803868 write 0x01b287 thru 0x01cd89 (0x1b03 bytes) 000704 1788593713.805391 mapwrite 0x0065ba thru 0x00d8d5 (0x731c bytes) 000705 1788593713.832635 mapwrite 0x0081c7 thru 0x00c960 (0x479a bytes) 000706 1788593713.851226 mapread 0x0251c5 thru 0x033ed6 (0xed12 bytes) 000707 1788593713.852737 punch from 0x029975 to 0x034558 (0xabe4 bytes) 000709 1788593713.861272 read 0x0096a8 thru 0x0115eb (0x7f44 bytes) 000710 1788593713.862157 trunc from 0x040000 to 0x001557 (0x3eaa8 bytes) 000711 1788593713.879218 write 0x023dfa thru 0x02a230 (0x6437 bytes) 000712 1788593713.881011 trunc from 0x000048 to 0x008756 (0x870f bytes) 000713 1788593713.886993 mapread 0x0038d0 thru 0x012fc0 (0xf6f1 bytes) 000714 1788593713.903892 read 0x01ba22 thru 0x02099b (0x4f7a bytes) 000715 1788593713.904933 mapwrite 0x025f46 thru 0x02f415 (0x94d0 bytes) 000716 1788593713.972756 trunc from 0x02f416 to 0x014849 (0x1abcc bytes) 000717 1788593713.993410 fallocate 0x01ae3e thru 0x01fe11 (0x4fd4 bytes) 000718 1788593713.999368 trunc from 0x00baa7 to 0x01319f (0x76f9 bytes) 000719 1788593714.005875 punch from 0x00f183 to 0x014849 (0x56c7 bytes) 000720 1788593714.011491 trunc from 0x000d6d to 0x002c3f (0x1ed3 bytes) 000721 1788593714.017459 mapread 0x009de5 thru 0x00c627 (0x2843 bytes) 000722 1788593714.029700 write 0x01c83f thru 0x01d163 (0x925 bytes) 000723 1788593714.031615 trunc from 0x01bbae to 0x01d163 (0x15b6 bytes) 000724 1788593714.042421 fallocate 0x03aca2 thru 0x03ffff (0x535e bytes) 000725 1788593714.052182 read 0x010dfe thru 0x016a99 (0x5c9c bytes) 000726 1788593714.069545 mapread 0x0355b3 thru 0x037aa6 (0x24f4 bytes) 000727 1788593714.070595 mapread 0x000643 thru 0x0070e5 (0x6aa3 bytes) 000728 1788593714.071542 trunc from 0x038325 to 0x03f833 (0x750f bytes) 000730 1788593714.082413 mapwrite 0x03579e thru 0x0358b7 (0x11a bytes) 000731 1788593714.108253 read 0x008dc6 thru 0x01027f (0x74ba bytes) 000733 1788593714.112860 punch from 0x022fa5 to 0x029be3 (0x6c3f bytes) 000734 1788593714.122918 read 0x02aa58 thru 0x03568c (0xac35 bytes) 000735 1788593714.125468 write 0x00496e thru 0x006860 (0x1ef3 bytes) 000737 1788593714.137894 punch from 0x031445 to 0x0317ca (0x386 bytes) 000738 1788593714.144883 fallocate 0x00467c thru 0x00cd1f (0x86a4 bytes) 000740 1788593714.159400 trunc from 0x006938 to 0x00b3de (0x4aa7 bytes) 000741 1788593714.178567 mapwrite 0x020e91 thru 0x027675 (0x67e5 bytes) 000742 1788593714.222001 punch from 0x004a13 to 0x00eb42 (0xa130 bytes) 000743 1788593714.228369 read 0x0066e2 thru 0x00bd48 (0x5667 bytes) 000744 1788593714.238035 fallocate 0x01c11c thru 0x01d597 (0x147c bytes) 000745 1788593714.243635 fallocate 0x0040c6 thru 0x00b6d2 (0x760d bytes) 000746 1788593714.251173 write 0x03a31d thru 0x03ffff (0x5ce3 bytes) 000747 1788593714.255368 mapread 0x02c819 thru 0x030870 (0x4058 bytes) 000748 1788593714.260916 trunc from 0x02d10d to 0x034d5f (0x7c53 bytes) 000749 1788593714.268320 read 0x036a7d thru 0x03ffff (0x9583 bytes) 000750 1788593714.270847 mapread 0x0241ed thru 0x02a2a5 (0x60b9 bytes) 000751 1788593714.272670 trunc from 0x040000 to 0x02efc1 (0x1103e bytes) 000752 1788593714.298300 fallocate 0x03c944 thru 0x03ffff (0x36bc bytes) 000753 1788593714.303628 read 0x00433e thru 0x01136e (0xd031 bytes) 000754 1788593714.304913 punch from 0x0144b8 to 0x022e1e (0xe967 bytes) 000755 1788593714.310796 mapwrite 0x029e6a thru 0x03737c (0xd513 bytes) 000756 1788593714.359207 trunc from 0x011cf0 to 0x016ed8 (0x51e9 bytes) 000758 1788593714.365437 read 0x016dc4 thru 0x01b249 (0x4486 bytes) 000759 1788593714.375038 punch from 0x02c2b5 to 0x0329f0 (0x673c bytes) 000761 1788593714.381597 punch from 0x031d5e to 0x033cd4 (0x1f77 bytes) 000762 1788593714.386918 fallocate 0x0003cf thru 0x007c94 (0x78c6 bytes) 000763 1788593714.392341 mapwrite 0x017da6 thru 0x01e54c (0x67a7 bytes) 000764 1788593714.415183 trunc from 0x01d6f3 to 0x02434a (0x6c58 bytes) 000765 1788593714.420649 mapwrite 0x031f11 thru 0x03ffff (0xe0ef bytes) 000766 1788593714.475325 write 0x010958 thru 0x0197ce (0x8e77 bytes) 000767 1788593714.482069 MIRROR_EXTEND to 2 mirrors 000769 1788593715.480213 MIRROR_EXTEND to 3 mirrors 000770 1788593716.593415 mapwrite 0x017250 thru 0x023cd7 (0xca88 bytes) 000771 1788593716.702061 MIRROR_RESYNC 3 mirrors 000772 1788593718.044298 write 0x01bc9d thru 0x024b19 (0x8e7d bytes) 000773 1788593718.125747 trunc from 0x040000 to 0x008908 (0x376f7 bytes) 000774 1788593718.176088 trunc from 0x0077fe to 0x008908 (0x110b bytes) 000775 1788593718.196311 fallocate 0x00ef96 thru 0x0159d2 (0x6a3d bytes) 000776 1788593718.205005 mapwrite 0x017892 thru 0x021f5c (0xa6cb bytes) 000777 1788593718.361404 mapread 0x0201c5 thru 0x021f5c (0x1d98 bytes) 000778 1788593718.362948 trunc from 0x0012c1 to 0x002493 (0x11d3 bytes) 000779 1788593718.374665 trunc from 0x0179b2 to 0x018786 (0xdd5 bytes) 000780 1788593718.383000 write 0x02ad62 thru 0x0375bf (0xc85e bytes) 000781 1788593718.388762 trunc from 0x0375c0 to 0x03ca45 (0x5486 bytes) 000782 1788593718.417976 write 0x0034d2 thru 0x012c4a (0xf779 bytes) 000783 1788593718.430863 fallocate 0x015c0e thru 0x018d13 (0x3106 bytes) 000784 1788593718.443438 mapread 0x0019b2 thru 0x00e087 (0xc6d6 bytes) 000785 1788593718.454125 trunc from 0x03ca46 to 0x03ba7b (0xfca bytes) 000786 1788593718.485952 punch from 0x026702 to 0x030f79 (0xa878 bytes) 000788 1788593718.540546 punch from 0x031f74 to 0x03aebb (0x8f48 bytes) 000789 1788593718.546394 punch from 0x03b1e3 to 0x03ba7b (0x899 bytes) 000790 1788593718.555060 fallocate 0x039bc9 thru 0x03e8cd (0x4d05 bytes) 000791 1788593718.566503 write 0x004638 thru 0x005f23 (0x18ec bytes) 000792 1788593718.568023 mapwrite 0x00f59a thru 0x01625a (0x6cc1 bytes) 000793 1788593718.613429 mapwrite 0x03bc13 thru 0x03e19a (0x2588 bytes) 000794 1788593718.656502 trunc from 0x03e8ce to 0x0067a2 (0x3812b bytes) 000795 1788593718.682216 MIRROR_RESYNC 3 mirrors 000796 1788593719.660032 MIRROR_EXTEND to 4 mirrors 000797 1788593720.753653 punch from 0x003242 to 0x003879 (0x638 bytes) 000798 1788593720.818785 mapread 0x000ee4 thru 0x0067a2 (0x58bf bytes) 000799 1788593720.846791 mapwrite 0x00c5a0 thru 0x0154b3 (0x8f14 bytes) 000800 1788593720.937989 trunc from 0x0154b4 to 0x00b248 (0xa26b bytes) 000801 1788593720.978836 trunc from 0x004da4 to 0x00b248 (0x64a5 bytes) 000802 1788593720.993075 mapwrite 0x029d39 thru 0x02a5dd (0x8a5 bytes) 000803 1788593721.050619 read 0x00362c thru 0x00b53c (0x7f11 bytes) 000804 1788593721.061701 read 0x01b414 thru 0x024ca3 (0x9890 bytes) 000805 1788593721.082448 write 0x0351f3 thru 0x036261 (0x106f bytes) 000806 1788593721.084049 read 0x010c69 thru 0x01e7d8 (0xdb70 bytes) 000807 1788593721.085745 read 0x02c9f4 thru 0x0301a3 (0x37b0 bytes) 000809 1788593721.098565 mapwrite 0x035420 thru 0x03e2dd (0x8ebe bytes) 000810 1788593721.162537 trunc from 0x00a570 to 0x010a2f (0x64c0 bytes) 000811 1788593721.172007 read 0x037050 thru 0x03b519 (0x44ca bytes) 000812 1788593721.173071 mapread 0x03348b thru 0x036698 (0x320e bytes) 000814 1788593721.177066 punch from 0x019341 to 0x01e0c2 (0x4d82 bytes) 000815 1788593721.188333 MIRROR_RESYNC 4 mirrors 000816 1788593723.033855 trunc from 0x03e2de to 0x020c9a (0x1d643 bytes) 000817 1788593723.145991 punch from 0x01627f to 0x01dabe (0x7840 bytes) 000818 1788593723.153508 write 0x036fd5 thru 0x03ffff (0x902b bytes) 000819 1788593723.156732 read 0x01fe7a thru 0x02db4a (0xdcd1 bytes) 000820 1788593723.166507 punch from 0x02f9f9 to 0x03ca65 (0xd06d bytes) 000821 1788593723.188818 trunc from 0x02b4b7 to 0x030bf6 (0x5740 bytes) 000822 1788593723.196687 trunc from 0x037a1b to 0x03ffff (0x85e5 bytes) 000823 1788593723.203297 trunc from 0x03b383 to 0x03ffff (0x4c7d bytes) 000824 1788593723.209005 mapwrite 0x01494c thru 0x01bb59 (0x720e bytes) 000825 1788593723.272026 mapwrite 0x0292ae thru 0x033564 (0xa2b7 bytes) 000826 1788593723.324038 punch from 0x008ccc to 0x00f343 (0x6678 bytes) 000827 1788593723.333867 fallocate 0x01722e thru 0x021077 (0x9e4a bytes) 000828 1788593723.347072 mapwrite 0x00bebf thru 0x00cbd4 (0xd16 bytes) 000829 1788593723.381972 mapread 0x00fd9b thru 0x01aac0 (0xad26 bytes) 000830 1788593723.383043 write 0x014ab8 thru 0x01f228 (0xa771 bytes) 000831 1788593723.391224 trunc from 0x040000 to 0x025d15 (0x1a2ea bytes) 000832 1788593723.420496 trunc from 0x025d16 to 0x025cd1 (0x44 bytes) 000833 1788593723.448223 trunc from 0x004262 to 0x00fae3 (0xb882 bytes) 000834 1788593723.454708 read 0x015a0b thru 0x021276 (0xb86c bytes) 000835 1788593723.466195 read 0x002bcf thru 0x012543 (0xf975 bytes) 000836 1788593723.488726 trunc from 0x025cd2 to 0x0162fc (0xf9d5 bytes) 000837 1788593723.530229 punch from 0x00308b to 0x0064c0 (0x3436 bytes) 000838 1788593723.559768 MIRROR_RESYNC 4 mirrors 000839 1788593724.669853 mapread 0x003b5e thru 0x0129ec (0xee8f bytes) 000840 1788593724.704588 write 0x007630 thru 0x013c9b (0xc66c bytes) 000841 1788593724.782810 write 0x025989 thru 0x02c85a (0x6ed2 bytes) 000842 1788593724.801869 MIRROR_RESYNC 4 mirrors 000843 1788593726.550480 read 0x007b15 thru 0x0112fe (0x97ea bytes) 000844 1788593726.566486 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) 000845 1788593727.108698 MIRROR_RESYNC 3 mirrors 000846 1788593727.844669 trunc from 0x004fd4 to 0x00fcd3 (0xad00 bytes) 000847 1788593727.911086 fallocate 0x01800e thru 0x01df04 (0x5ef7 bytes) 000848 1788593727.917983 punch from 0x01a877 to 0x02582f (0xafb9 bytes) 000849 1788593727.929281 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c85b): Mirror 4: 0xfcdd5375 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c85b): Mirror 4: 0xfcdd5375 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c85b: skipped 000850 1788593728.338939 mapread 0x006a72 thru 0x00e8f9 (0x7e88 bytes) 000851 1788593728.392635 mapread 0x016fc8 thru 0x024f85 (0xdfbe bytes) 000853 1788593728.427837 trunc from 0x02c85b to 0x02ba85 (0xdd5 bytes) 000854 1788593728.472419 read 0x0184ef thru 0x01ffa8 (0x7aba bytes) 000855 1788593728.473220 mapread 0x010424 thru 0x01e973 (0xe550 bytes) 000856 1788593728.475980 mapwrite 0x035d67 thru 0x03ffff (0xa299 bytes) 000857 1788593728.533774 write 0x010323 thru 0x0116c2 (0x13a0 bytes) 000858 1788593728.535454 punch from 0x03e939 to 0x03ffff (0x16c7 bytes) 000859 1788593728.542851 trunc from 0x011308 to 0x01d7d0 (0xc4c9 bytes) 000860 1788593728.553697 mapwrite 0x01cc5b thru 0x027ce4 (0xb08a bytes) 000861 1788593728.591853 fallocate 0x01ff1d thru 0x02c30a (0xc3ee bytes) 000862 1788593728.598554 mapread 0x00d11f thru 0x01b577 (0xe459 bytes) 000863 1788593728.613697 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd52907da (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x44bd4f83 Mirror 5: 0x44bd4f83 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000864 1788593730.023324 fallocate 0x006f73 thru 0x0115eb (0xa679 bytes) 000865 1788593730.075714 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd52907da (stale) Mirror 5: 0x44bd4f83 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x44bd4f83 Mirror 6: 0x44bd4f83 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000866 1788593731.360792 trunc from 0x02eb59 to 0x0341d7 (0x567f bytes) 000867 1788593731.410346 trunc from 0x040000 to 0x02dd7e (0x12281 bytes) 000868 1788593731.444928 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2dd7f): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dd7f): Mirror 4: 0xd482659d (stale) Mirror 5: 0x5894420a (stale) Mirror 6: 0x5894420a (stale) CRC-32 checksum value for chunk [0, 0x2dd7f): Mirror 1: 0x5894420a Mirror 7: 0x5894420a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dd7f: skipped 000869 1788593732.600865 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2dd7f): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dd7f): Mirror 4: 0xd482659d (stale) Mirror 5: 0x5894420a (stale) Mirror 6: 0x5894420a (stale) CRC-32 checksum value for chunk [0, 0x2dd7f): Mirror 1: 0x5894420a Mirror 7: 0x5894420a Mirror 8: 0x5894420a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dd7f: skipped 000870 1788593734.084768 trunc from 0x01bd51 to 0x01d6b7 (0x1967 bytes) 000871 1788593734.205638 fallocate 0x003343 thru 0x00d697 (0xa355 bytes) 000872 1788593734.215427 trunc from 0x023fa0 to 0x027b97 (0x3bf8 bytes) 000874 1788593734.245694 MIRROR_RESYNC 6 mirrors 000875 1788593737.178338 MIRROR_EXTEND to 7 mirrors 000877 1788593738.826165 mapwrite 0x00ed94 thru 0x016a7a (0x7ce7 bytes) 000878 1788593739.027658 mapread 0x004c10 thru 0x005c04 (0xff5 bytes) 000880 1788593739.054573 write 0x004249 thru 0x012643 (0xe3fb bytes) 000881 1788593739.067565 mapread 0x00a679 thru 0x013aff (0x9487 bytes) 000882 1788593739.078410 mapread 0x01ac66 thru 0x02860d (0xd9a8 bytes) 000883 1788593739.104735 punch from 0x02b3e1 to 0x02dd7e (0x299e bytes) 000884 1788593739.112199 write 0x01d3da thru 0x021a85 (0x46ac bytes) 000885 1788593739.120224 mapread 0x02ce1d thru 0x02dd7e (0xf62 bytes) 000886 1788593739.142758 trunc from 0x009c40 to 0x012de3 (0x91a4 bytes) 000887 1788593739.183748 write 0x02c180 thru 0x037053 (0xaed4 bytes) 000888 1788593739.185785 fallocate 0x00e83b thru 0x01c9c7 (0xe18d bytes) 000889 1788593739.200768 read 0x016870 thru 0x01af65 (0x46f6 bytes) 000890 1788593739.204153 read 0x024351 thru 0x034061 (0xfd11 bytes) 000891 1788593739.205985 read 0x027d5c thru 0x02f696 (0x793b bytes) 000892 1788593739.210422 read 0x0094b7 thru 0x011e85 (0x89cf bytes) 000894 1788593739.229251 read 0x0292ba thru 0x037053 (0xdd9a bytes) 000895 1788593739.241743 MIRROR_RESYNC 7 mirrors 000896 1788593742.107923 trunc from 0x019b47 to 0x01a559 (0xa13 bytes) 000897 1788593742.165311 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x37054): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37054): Mirror 4: 0xfc3f2491 (stale) Mirror 5: 0xfc3f2491 (stale) Mirror 6: 0xfc3f2491 (stale) Mirror 7: 0xfc3f2491 (stale) Mirror 8: 0xfc3f2491 (stale) Mirror 9: 0xfc3f2491 (stale) CRC-32 checksum value for chunk [0, 0x37054): Mirror 1: 0xfc3f2491 Mirror 10: 0xfc3f2491 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37054: skipped 000898 1788593743.493345 read 0x025cd6 thru 0x027f87 (0x22b2 bytes) 000899 1788593743.511044 read 0x00fe3c thru 0x018a13 (0x8bd8 bytes) 000900 1788593743.551490 punch from 0x004394 to 0x00c5da (0x8247 bytes) 000901 1788593743.622901 read 0x0213e3 thru 0x02f425 (0xe043 bytes) 000902 1788593743.634046 punch from 0x010a64 to 0x012321 (0x18be bytes) 000903 1788593743.645933 MIRROR_RESYNC 8 mirrors 000904 1788593747.031851 read 0x005f55 thru 0x00f51a (0x95c6 bytes) 000905 1788593747.045512 mapwrite 0x0118a1 thru 0x01639c (0x4afc bytes) 000906 1788593747.192749 write 0x02ee16 thru 0x035b03 (0x6cee bytes) 000909 1788593747.213845 trunc from 0x037054 to 0x004af8 (0x3255b bytes) 000911 1788593747.247478 mapread 0x000a09 thru 0x002c55 (0x224d bytes) 000913 1788593747.273740 trunc from 0x004af9 to 0x00ae6a (0x6372 bytes) 000914 1788593747.305064 read 0x004f92 thru 0x0062e5 (0x1354 bytes) 000915 1788593747.316907 trunc from 0x008dbd to 0x00ae6a (0x20ae bytes) 000916 1788593747.322716 trunc from 0x003161 to 0x00a2c0 (0x7160 bytes) 000918 1788593747.352186 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0xae6b): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xae6b): Mirror 4: 0x7ace47a (stale) Mirror 5: 0x7ace47a (stale) Mirror 6: 0x7ace47a (stale) Mirror 7: 0x7ace47a (stale) Mirror 8: 0x7ace47a (stale) Mirror 9: 0x7ace47a (stale) Mirror 10: 0x7ace47a (stale) CRC-32 checksum value for chunk [0, 0xae6b): Mirror 1: 0xeb855788 Mirror 11: 0xeb855788 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xae6b: skipped 000920 1788593748.453487 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xae6b): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xae6b): Mirror 4: 0x7ace47a (stale) Mirror 5: 0x7ace47a (stale) Mirror 6: 0x7ace47a (stale) Mirror 7: 0x7ace47a (stale) Mirror 8: 0x7ace47a (stale) Mirror 9: 0x7ace47a (stale) Mirror 10: 0x7ace47a (stale) CRC-32 checksum value for chunk [0, 0xae6b): Mirror 1: 0xeb855788 Mirror 11: 0xeb855788 Mirror 12: 0xeb855788 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xae6b: skipped 000921 1788593749.444069 mapread 0x00abac thru 0x00ae6a (0x2bf bytes) 000922 1788593749.453924 write 0x02b08e thru 0x0394cf (0xe442 bytes) 000923 1788593749.508774 mapwrite 0x01a77e thru 0x01e984 (0x4207 bytes) 000924 1788593749.545623 mapread 0x01cdc4 thru 0x027943 (0xab80 bytes) 000925 1788593749.555257 trunc from 0x0091ac to 0x011f37 (0x8d8c bytes) 000926 1788593749.560264 trunc from 0x009510 to 0x016e6a (0xd95b bytes) 000927 1788593749.565505 mapread 0x00ee2e thru 0x0146a9 (0x587c bytes) 000928 1788593749.576915 read 0x02fd31 thru 0x03478b (0x4a5b bytes) 000929 1788593749.577604 mapread 0x00ac1a thru 0x00b658 (0xa3f bytes) 000930 1788593749.578835 write 0x028e25 thru 0x03329e (0xa47a bytes) 000931 1788593749.585433 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x394d0): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x394d0): Mirror 4: 0x1868f199 (stale) Mirror 5: 0x1868f199 (stale) Mirror 6: 0x1868f199 (stale) Mirror 7: 0x1868f199 (stale) Mirror 8: 0x1868f199 (stale) Mirror 9: 0x1868f199 (stale) Mirror 10: 0x1868f199 (stale) Mirror 11: 0x8d998b9d (stale) Mirror 12: 0x8d998b9d (stale) CRC-32 checksum value for chunk [0, 0x394d0): Mirror 1: 0x270c3655 Mirror 13: 0x270c3655 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x394d0: skipped 000933 1788593751.083289 read 0x017dec thru 0x0247dd (0xc9f2 bytes) 000934 1788593751.114047 write 0x028b0a thru 0x03452f (0xba26 bytes) 000935 1788593751.176648 mapread 0x0152f5 thru 0x01ace1 (0x59ed bytes) 000937 1788593751.196716 write 0x017460 thru 0x0255c3 (0xe164 bytes) 000938 1788593751.203519 read 0x007f18 thru 0x00f78b (0x7874 bytes) 000939 1788593751.212936 mapread 0x02c8ff thru 0x0394cf (0xcbd1 bytes) 000940 1788593751.214781 trunc from 0x0394d0 to 0x00d3e1 (0x2c0ee bytes) 000941 1788593751.237769 mapread 0x005181 thru 0x00d3e1 (0x8261 bytes) 000942 1788593751.240180 fallocate 0x022c8f thru 0x02924d (0x65bf bytes) 000943 1788593751.248714 punch from 0x003228 to 0x00d3e1 (0xa1ba bytes) 000944 1788593751.253971 fallocate 0x0333e6 thru 0x03668a (0x32a5 bytes) 000945 1788593751.259548 write 0x032670 thru 0x03afb5 (0x8946 bytes) 000946 1788593751.267724 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3afb6): Mirror 4: 0x1c5ae25 (stale) Mirror 5: 0x1c5ae25 (stale) Mirror 6: 0x1c5ae25 (stale) Mirror 7: 0x1c5ae25 (stale) Mirror 8: 0x1c5ae25 (stale) Mirror 9: 0x1c5ae25 (stale) Mirror 10: 0x1c5ae25 (stale) Mirror 11: 0x784669b8 (stale) Mirror 13: 0x859d1fe3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afb6): Mirror 4: 0x1c5ae25 (stale) Mirror 5: 0x1c5ae25 (stale) Mirror 6: 0x1c5ae25 (stale) Mirror 7: 0x1c5ae25 (stale) Mirror 8: 0x1c5ae25 (stale) Mirror 9: 0x1c5ae25 (stale) Mirror 10: 0x1c5ae25 (stale) Mirror 11: 0x784669b8 (stale) Mirror 13: 0x859d1fe3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afb6: skipped 000947 1788593751.881807 write 0x039f1c thru 0x03a44f (0x534 bytes) 000948 1788593751.898914 read 0x034034 thru 0x03afb5 (0x6f82 bytes) 000949 1788593751.909941 fallocate 0x0187dc thru 0x01d40c (0x4c31 bytes) 000950 1788593751.916316 fallocate 0x00cd4a thru 0x015896 (0x8b4d bytes) 000951 1788593751.923114 mapwrite 0x011153 thru 0x01d027 (0xbed5 bytes) 000952 1788593751.999895 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3afb6): Mirror 4: 0x1c5ae25 (stale) Mirror 5: 0x1c5ae25 (stale) Mirror 6: 0x1c5ae25 (stale) Mirror 8: 0x1c5ae25 (stale) Mirror 9: 0x1c5ae25 (stale) Mirror 10: 0x1c5ae25 (stale) Mirror 11: 0x784669b8 (stale) Mirror 13: 0x859d1fe3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afb6): Mirror 4: 0x1c5ae25 (stale) Mirror 5: 0x1c5ae25 (stale) Mirror 6: 0x1c5ae25 (stale) Mirror 8: 0x1c5ae25 (stale) Mirror 9: 0x1c5ae25 (stale) Mirror 10: 0x1c5ae25 (stale) Mirror 11: 0x784669b8 (stale) Mirror 13: 0x859d1fe3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afb6: skipped 000953 1788593752.551373 trunc from 0x031aa6 to 0x03a425 (0x8980 bytes) 000954 1788593752.561330 trunc from 0x03afb6 to 0x02366e (0x17947 bytes) 000955 1788593752.583545 mapread 0x005496 thru 0x00db67 (0x86d2 bytes) 000956 1788593752.608247 mapread 0x012ae3 thru 0x017cca (0x51e8 bytes) 000958 1788593752.620361 mapwrite 0x00156a thru 0x0083ea (0x6e81 bytes) 000959 1788593752.646135 fallocate 0x02a819 thru 0x033c17 (0x93ff bytes) 000960 1788593752.653627 punch from 0x002477 to 0x0090f3 (0x6c7d bytes) 000963 1788593752.661206 write 0x021ba1 thru 0x02b495 (0x98f5 bytes) 000964 1788593752.673734 read 0x023da8 thru 0x027269 (0x34c2 bytes) 000965 1788593752.674702 fallocate 0x01ca4a thru 0x023695 (0x6c4c bytes) 000966 1788593752.679602 trunc from 0x033c18 to 0x00b0a7 (0x28b70 bytes) 000967 1788593752.698067 write 0x01323b thru 0x018589 (0x534f bytes) 000968 1788593752.699562 fallocate 0x0043fa thru 0x00d845 (0x944c bytes) 000969 1788593752.705357 punch from 0x010f73 to 0x018589 (0x7617 bytes) 000970 1788593752.729469 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1858a): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1858a): Mirror 4: 0x3a484cd (stale) Mirror 5: 0x3a484cd (stale) Mirror 6: 0x3a484cd (stale) Mirror 8: 0x3a484cd (stale) Mirror 9: 0x3a484cd (stale) Mirror 10: 0x3a484cd (stale) Mirror 11: 0x5c58a341 (stale) Mirror 13: 0x5c58a341 (stale) CRC-32 checksum value for chunk [0, 0x1858a): Mirror 1: 0x2e1816f9 Mirror 14: 0x2e1816f9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1858a: skipped 000972 1788593754.198600 read 0x0063d6 thru 0x01108e (0xacb9 bytes) 000973 1788593754.216894 mapread 0x013180 thru 0x0165d2 (0x3453 bytes) 000974 1788593754.251500 fallocate 0x01cf5b thru 0x0202cb (0x3371 bytes) 000975 1788593754.340263 punch from 0x000a8d to 0x0082da (0x784e bytes) 000976 1788593754.359217 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x202cc): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x202cc): Mirror 4: 0x2bdcb04 (stale) Mirror 5: 0x2bdcb04 (stale) Mirror 6: 0x2bdcb04 (stale) Mirror 8: 0x2bdcb04 (stale) Mirror 9: 0x2bdcb04 (stale) Mirror 10: 0x2bdcb04 (stale) Mirror 11: 0x75ac43a (stale) Mirror 13: 0x59d83691 (stale) Mirror 14: 0xfb909491 (stale) CRC-32 checksum value for chunk [0, 0x202cc): Mirror 1: 0x75ac43a Mirror 15: 0x75ac43a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x202cc: skipped 000977 1788593755.836698 punch from 0x00d6b0 to 0x01c80a (0xf15b bytes) 000978 1788593755.892583 punch from 0x013903 to 0x01ca9a (0x9198 bytes) 000979 1788593755.898863 fallocate 0x0263fb thru 0x0280fb (0x1d01 bytes) 000980 1788593755.904922 trunc from 0x006220 to 0x00d16a (0x6f4b bytes) 000981 1788593755.910059 fallocate 0x02c746 thru 0x035dec (0x96a7 bytes) 000982 1788593755.916060 mapread 0x010a53 thru 0x01c9f2 (0xbfa0 bytes) 000983 1788593755.942836 punch from 0x007103 to 0x0121e9 (0xb0e7 bytes) 000984 1788593755.948090 trunc from 0x035ded to 0x02780d (0xe5df bytes) 000985 1788593755.970891 punch from 0x01eee5 to 0x02780d (0x8929 bytes) 000986 1788593755.976605 trunc from 0x02780e to 0x0342df (0xcad2 bytes) 000989 1788593756.004787 MIRROR_RESYNC 11 mirrors 000990 1788593757.966459 mapread 0x0080cc thru 0x0176dc (0xf611 bytes) 000991 1788593758.024081 read 0x0111ca thru 0x011545 (0x37c bytes) 000992 1788593758.024539 read 0x00142f thru 0x006bca (0x579c bytes) 000993 1788593758.048600 mapread 0x00a414 thru 0x0122ea (0x7ed7 bytes) 000995 1788593758.058444 punch from 0x02fe69 to 0x0342df (0x4477 bytes) 000996 1788593758.112498 trunc from 0x021bcb to 0x027111 (0x5547 bytes) 000997 1788593758.119842 trunc from 0x01f104 to 0x023daf (0x4cac bytes) 000998 1788593758.125956 mapwrite 0x01551a thru 0x01bc0d (0x66f4 bytes) 000999 1788593758.184819 mapwrite 0x009e22 thru 0x01859b (0xe77a bytes) 001000 1788593758.283952 punch from 0x00a28c to 0x00f5a7 (0x531c bytes) All operations completed A-OK!