== sanity-flr test 70a: flr mode fsx test ================ 18:57:43 (1787785063) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 5065 skipping zero size read skipping zero size read truncating to largest ever: 0x229e7 000006 1787785065.471944 trunc from 00000000 to 0x0229e6 (0x229e7 bytes) 000007 1787785065.491273 trunc from 0x01ab79 to 0x01cfcb (0x2453 bytes) 000008 1787785065.496167 mapread 0x0058ad thru 0x00977b (0x3ecf bytes) 000009 1787785065.520367 punch from 0x00edaa to 0x019845 (0xaa9c bytes) 000010 1787785065.529713 read 0x01b0c7 thru 0x0229e6 (0x7920 bytes) 000011 1787785065.540729 fallocate 0x00e600 thru 0x01404a (0x5a4b bytes) 000012 1787785065.548777 trunc from 0x01b1f8 to 0x0229e6 (0x77ef bytes) 000014 1787785065.556761 write 0x018852 thru 0x01e9a1 (0x6150 bytes) 000015 1787785065.567678 mapread 0x0030aa thru 0x00735b (0x42b2 bytes) 000017 1787785065.569128 write 0x02aeeb thru 0x0313d1 (0x64e7 bytes) 000018 1787785065.572387 write 0x030379 thru 0x035e3d (0x5ac5 bytes) 000019 1787785065.574204 read 0x00d7cd thru 0x01861a (0xae4e bytes) truncating to largest ever: 0x3d1e7 000020 1787785065.592237 trunc from 0x035e3e to 0x03d1e6 (0x73a9 bytes) 000021 1787785065.607359 trunc from 0x0155da to 0x0174b7 (0x1ede bytes) 000022 1787785065.612379 mapwrite 0x02ae72 thru 0x033159 (0x82e8 bytes) 000023 1787785065.644160 read 0x01460e thru 0x017261 (0x2c54 bytes) 000024 1787785065.663352 write 0x0324a8 thru 0x03ffff (0xdb58 bytes) 000025 1787785065.666043 write 0x012586 thru 0x01f146 (0xcbc1 bytes) 000026 1787785065.674338 mapwrite 0x025533 thru 0x026ad4 (0x15a2 bytes) 000027 1787785065.697318 trunc from 0x0068af to 0x011714 (0xae66 bytes) 000028 1787785065.702857 trunc from 0x000f3e to 0x002f90 (0x2053 bytes) 000030 1787785065.707922 fallocate 0x00f3de thru 0x012cd9 (0x38fc bytes) 000032 1787785065.713873 read 0x03bca1 thru 0x03ffff (0x435f bytes) 000033 1787785065.714809 punch from 0x01952f to 0x01d3b3 (0x3e85 bytes) 000034 1787785065.719922 write 0x01c841 thru 0x01d991 (0x1151 bytes) 000035 1787785065.734378 trunc from 0x040000 to 0x021ed0 (0x1e12f bytes) 000036 1787785065.753602 read 0x019f8f thru 0x01aa37 (0xaa9 bytes) 000037 1787785065.754826 write 0x02f1a7 thru 0x02fbe2 (0xa3c bytes) 000038 1787785065.759690 MIRROR_EXTEND to 2 mirrors 000039 1787785066.720860 write 0x00a5a8 thru 0x00a8b7 (0x310 bytes) 000040 1787785066.787364 punch from 0x01b033 to 0x029031 (0xdfff bytes) 000041 1787785066.792804 write 0x016561 thru 0x016efb (0x99b bytes) 000042 1787785066.799149 write 0x03dfe8 thru 0x03ffff (0x2018 bytes) 000043 1787785066.800585 read 0x018bee thru 0x025978 (0xcd8b bytes) 000045 1787785066.826813 MIRROR_RESYNC 2 mirrors 000047 1787785067.782274 punch from 0x0361c6 to 0x03fb27 (0x9962 bytes) 000048 1787785067.817126 fallocate 0x0177a6 thru 0x018fed (0x1848 bytes) 000049 1787785067.823724 punch from 0x00804b to 0x00de7e (0x5e34 bytes) zero_range to largest ever: 0x40000 000050 1787785067.829213 trunc from 0x03a912 to 0x03ffff (0x56ee bytes) 000051 1787785067.839084 trunc from 0x040000 to 0x017af7 (0x28508 bytes) 000052 1787785067.870872 mapwrite 0x031d04 thru 0x036629 (0x4926 bytes) 000053 1787785067.936101 write 0x01a55c thru 0x01c1ba (0x1c5f bytes) 000054 1787785067.945617 read 0x00252d thru 0x00ac66 (0x873a bytes) 000055 1787785067.956758 fallocate 0x017ab5 thru 0x0222ba (0xa806 bytes) 000056 1787785067.962079 read 0x02097d thru 0x0286c3 (0x7d47 bytes) 000057 1787785067.977966 trunc from 0x014432 to 0x0167b9 (0x2388 bytes) 000058 1787785067.995268 mapwrite 0x034b0d thru 0x039fe7 (0x54db bytes) 000059 1787785068.054914 trunc from 0x0126d7 to 0x01cb19 (0xa443 bytes) 000060 1787785068.075947 mapwrite 0x000f9e thru 0x00b94e (0xa9b1 bytes) 000061 1787785068.108684 trunc from 0x014ae7 to 0x0195e7 (0x4b01 bytes) 000062 1787785068.115750 trunc from 0x00b231 to 0x018a74 (0xd844 bytes) 000063 1787785068.123143 trunc from 0x039fe8 to 0x0291d4 (0x10e13 bytes) 000064 1787785068.152096 MIRROR_RESYNC 2 mirrors 000065 1787785068.944643 trunc from 0x01ca0f to 0x0291d4 (0xc7c6 bytes) 000066 1787785068.977236 mapread 0x014551 thru 0x018d1b (0x47cb bytes) 000067 1787785068.995837 mapread 0x02891b thru 0x0291d4 (0x8ba bytes) 000068 1787785069.005239 read 0x01e5a7 thru 0x028c67 (0xa6c1 bytes) 000069 1787785069.009777 read 0x021f3d thru 0x026c75 (0x4d39 bytes) 000070 1787785069.013768 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x291d5): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x291d5): Mirror 2: 0x5cb7ff2a (stale) CRC-32 checksum value for chunk [0, 0x291d5): Mirror 1: 0x5cb7ff2a Mirror 3: 0x5cb7ff2a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x291d5: skipped 000071 1787785069.822151 punch from 0x000dee to 0x008492 (0x76a5 bytes) 000072 1787785069.866171 fallocate 0x017a70 thru 0x021e91 (0xa422 bytes) 000073 1787785069.872271 trunc from 0x0291d5 to 0x0266dd (0x2af7 bytes) 000074 1787785069.900678 mapread 0x022e15 thru 0x02351e (0x70a bytes) 000075 1787785069.914005 trunc from 0x00ad8b to 0x014a6b (0x9ce1 bytes) 000076 1787785069.927790 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x266de): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x266de): Mirror 2: 0x9036a507 (stale) Mirror 3: 0x9036a507 (stale) CRC-32 checksum value for chunk [0, 0x266de): Mirror 1: 0xe4aa6f6c Mirror 4: 0xe4aa6f6c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x266de: skipped 000077 1787785070.667359 mapread 0x021388 thru 0x0266dd (0x5356 bytes) 000078 1787785070.683369 read 0x01e949 thru 0x0213ec (0x2aa4 bytes) 000079 1787785070.684296 fallocate 0x0329d9 thru 0x03ffff (0xd627 bytes) 000080 1787785070.716820 mapwrite 0x028ade thru 0x034bfe (0xc121 bytes) 000081 1787785070.768480 mapwrite 0x020268 thru 0x02e3e3 (0xe17c bytes) 000082 1787785070.833554 read 0x022097 thru 0x02b2a5 (0x920f bytes) 000083 1787785070.834211 mapwrite 0x03be1d thru 0x03ffff (0x41e3 bytes) 000085 1787785070.912253 trunc from 0x019242 to 0x027fa1 (0xed60 bytes) 000088 1787785070.920094 trunc from 0x040000 to 0x0059c6 (0x3a639 bytes) 000089 1787785070.946348 trunc from 0x0050f5 to 0x0059c6 (0x8d2 bytes) 000090 1787785070.954825 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x59c7): Mirror 3: 0x664a2fda (stale) Mirror 4: 0xcced7803 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x59c7): Mirror 3: 0x664a2fda (stale) Mirror 4: 0xcced7803 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x59c7: skipped 000091 1787785071.340124 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x59c7): Mirror 4: 0xcced7803 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x59c7): Mirror 4: 0xcced7803 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x59c7: skipped 000092 1787785071.518275 trunc from 0x002bea to 0x0059c6 (0x2ddd bytes) 000093 1787785071.522653 trunc from 0x0059c7 to 0x000db1 (0x4c15 bytes) 000094 1787785071.541763 write 0x014d40 thru 0x01bf7a (0x723b bytes) 000095 1787785071.543119 trunc from 0x01bf7b to 0x03a1ae (0x1e234 bytes) 000097 1787785071.576349 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3a1af): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a1af): Mirror 4: 0x8563005b (stale) CRC-32 checksum value for chunk [0, 0x3a1af): Mirror 1: 0x8f2c29a7 Mirror 5: 0x8f2c29a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a1af: skipped 000098 1787785072.454014 trunc from 0x001eff to 0x01153f (0xf641 bytes) 000099 1787785072.500146 trunc from 0x03a1af to 0x01f662 (0x1ab4c bytes) 000100 1787785072.522297 trunc from 0x01f663 to 0x02328e (0x3c2c bytes) 000101 1787785072.536634 trunc from 0x02328f to 0x006a13 (0x1c87b bytes) 000102 1787785072.549726 trunc from 0x006a14 to 0x007dba (0x13a7 bytes) 000103 1787785072.562157 write 0x024957 thru 0x02ec85 (0xa32f bytes) 000104 1787785072.563625 punch from 0x022197 to 0x02ec85 (0xcaef bytes) 000106 1787785072.582212 MIRROR_RESYNC 3 mirrors 000109 1787785073.360238 write 0x030a09 thru 0x037e36 (0x742e bytes) 000110 1787785073.401112 fallocate 0x00f786 thru 0x01e0cf (0xe94a bytes) 000111 1787785073.410610 fallocate 0x0244a8 thru 0x032fd0 (0xeb29 bytes) 000112 1787785073.415134 trunc from 0x037e37 to 0x01d6f6 (0x1a740 bytes) 000113 1787785073.431321 fallocate 0x01567b thru 0x01a8f0 (0x5276 bytes) 000114 1787785073.437146 mapwrite 0x00fcf4 thru 0x01e6da (0xe9e7 bytes) 000115 1787785073.497121 trunc from 0x01e6db to 0x008316 (0x163c4 bytes) 000116 1787785073.512989 write 0x0335c1 thru 0x03ffff (0xca3f bytes) 000117 1787785073.518150 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe20eea22 (stale) Mirror 5: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x603dea3b Mirror 6: 0x603dea3b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000119 1787785074.403314 mapread 0x029b0e thru 0x02d59e (0x3a91 bytes) 000120 1787785074.437813 mapwrite 0x0312f3 thru 0x03ffff (0xed0d bytes) 000121 1787785074.544697 read 0x02ccb3 thru 0x039c81 (0xcfcf bytes) 000122 1787785074.545819 trunc from 0x040000 to 0x037c9b (0x8364 bytes) 000123 1787785074.576703 punch from 0x0364e4 to 0x036673 (0x190 bytes) 000124 1787785074.582172 write 0x02b585 thru 0x030a01 (0x547d bytes) 000125 1787785074.593405 read 0x007243 thru 0x012bdb (0xb999 bytes) 000126 1787785074.611368 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x37c9c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c9c): Mirror 4: 0x22be109e (stale) Mirror 5: 0x22be109e (stale) Mirror 6: 0x2d8135dc (stale) CRC-32 checksum value for chunk [0, 0x37c9c): Mirror 1: 0x7a1cdef5 Mirror 7: 0x7a1cdef5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c9c: skipped 000127 1787785075.470259 mapread 0x0135f6 thru 0x01b81f (0x822a bytes) 000128 1787785075.493437 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37c9c): Mirror 4: 0x22be109e (stale) Mirror 6: 0x2d8135dc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c9c): Mirror 4: 0x22be109e (stale) Mirror 6: 0x2d8135dc (stale) CRC-32 checksum value for chunk [0, 0x37c9c): Mirror 1: 0x7a1cdef5 Mirror 7: 0x7a1cdef5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c9c: skipped 000129 1787785075.892775 read 0x024a8c thru 0x0334bb (0xea30 bytes) 000130 1787785075.904110 trunc from 0x037c9c to 0x03d944 (0x5ca9 bytes) 000131 1787785076.048302 punch from 0x01de00 to 0x02608d (0x828e bytes) 000132 1787785076.069856 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d945): Mirror 4: 0xd53ce195 (stale) Mirror 6: 0x51e0f178 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d945): Mirror 4: 0xd53ce195 (stale) Mirror 6: 0x51e0f178 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d945: skipped 000133 1787785076.405315 mapread 0x02cbc6 thru 0x039797 (0xcbd2 bytes) 000134 1787785076.437324 write 0x00aa68 thru 0x016ded (0xc386 bytes) 000135 1787785076.452150 fallocate 0x03d159 thru 0x03ffff (0x2ea7 bytes) 000136 1787785076.457317 mapread 0x0082cc thru 0x015ebb (0xdbf0 bytes) 000137 1787785076.471126 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe20eea22 (stale) Mirror 6: 0x603dea3b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5f7efe92 Mirror 7: 0x5f7efe92 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000138 1787785077.516744 punch from 0x016c55 to 0x01dc4e (0x6ffa bytes) 000139 1787785077.559901 trunc from 0x01bd6a to 0x0287d9 (0xca70 bytes) 000140 1787785077.565381 mapwrite 0x0200ce thru 0x022816 (0x2749 bytes) 000141 1787785077.610871 trunc from 0x02df1d to 0x03aa33 (0xcb17 bytes) 000142 1787785077.621850 mapread 0x02b205 thru 0x02ca96 (0x1892 bytes) 000143 1787785077.645106 read 0x039bdf thru 0x03ffff (0x6421 bytes) 000145 1787785077.660298 read 0x00df48 thru 0x01398c (0x5a45 bytes) 000146 1787785077.678052 mapread 0x02c1e7 thru 0x039aa5 (0xd8bf bytes) 000147 1787785077.679739 read 0x007eb0 thru 0x012d0d (0xae5e bytes) 000148 1787785077.682134 mapread 0x030c83 thru 0x03b5a4 (0xa922 bytes) 000149 1787785077.687315 read 0x02ca98 thru 0x034b0e (0x8077 bytes) 000150 1787785077.694710 trunc from 0x03b921 to 0x03ffff (0x46df bytes) 000151 1787785077.701260 write 0x00df1c thru 0x016425 (0x850a bytes) 000152 1787785077.719791 MIRROR_RESYNC 4 mirrors 000154 1787785079.172575 MIRROR_RESYNC 4 mirrors 000155 1787785079.670170 read 0x03e7cd thru 0x03ffff (0x1833 bytes) 000156 1787785079.685634 punch from 0x01acb2 to 0x01d27d (0x25cc bytes) 000157 1787785079.766270 punch from 0x03b828 to 0x03ffff (0x47d8 bytes) 000158 1787785079.775756 punch from 0x00b6f3 to 0x00edae (0x36bc bytes) 000159 1787785079.783547 MIRROR_RESYNC 4 mirrors 000160 1787785081.101937 mapread 0x000521 thru 0x009a55 (0x9535 bytes) 000161 1787785081.126163 mapread 0x017357 thru 0x01ef3e (0x7be8 bytes) 000162 1787785081.139911 read 0x038ac8 thru 0x03ffff (0x7538 bytes) 000164 1787785081.150594 mapread 0x030266 thru 0x03dc9e (0xda39 bytes) 000165 1787785081.164334 trunc from 0x00aa49 to 0x01877c (0xdd34 bytes) 000166 1787785081.239237 mapread 0x00d870 thru 0x01cc0b (0xf39c bytes) 000167 1787785081.263758 write 0x004b51 thru 0x013242 (0xe6f2 bytes) 000168 1787785081.270794 read 0x032d6a thru 0x03e876 (0xbb0d bytes) 000169 1787785081.296732 mapread 0x00eff9 thru 0x01682e (0x7836 bytes) 000170 1787785081.297869 trunc from 0x040000 to 0x015d83 (0x2a27c bytes) 000171 1787785081.369552 trunc from 0x00e10e to 0x015d83 (0x7c76 bytes) 000172 1787785081.398007 trunc from 0x01338f to 0x015d83 (0x29f5 bytes) 000173 1787785081.408084 write 0x03b5da thru 0x03ffff (0x4a26 bytes) 000174 1787785081.431095 MIRROR_RESYNC 4 mirrors 000175 1787785082.887631 trunc from 0x029d5b to 0x035b33 (0xbdd9 bytes) 000177 1787785082.933642 read 0x03f350 thru 0x03ffff (0xcb0 bytes) 000178 1787785082.938400 trunc from 0x02c7c8 to 0x02d9b7 (0x11f0 bytes) 000179 1787785082.948077 punch from 0x024027 to 0x02432e (0x308 bytes) 000180 1787785082.958123 trunc from 0x014fb3 to 0x019aee (0x4b3c bytes) 000181 1787785082.970625 trunc from 0x040000 to 0x02a23d (0x15dc2 bytes) 000182 1787785083.003359 read 0x025fcd thru 0x028991 (0x29c5 bytes) 000183 1787785083.017852 write 0x01d6e2 thru 0x029cc6 (0xc5e5 bytes) 000184 1787785083.020622 read 0x026a92 thru 0x02942a (0x2999 bytes) 000185 1787785083.022069 fallocate 0x01036a thru 0x0111f3 (0xe8a bytes) 000186 1787785083.027700 trunc from 0x02a23e to 0x01b1f5 (0xf048 bytes) 000187 1787785083.043812 trunc from 0x01b1f6 to 0x001d9a (0x1945b bytes) 000188 1787785083.065278 fallocate 0x01f987 thru 0x02f331 (0xf9ab bytes) 000189 1787785083.071298 trunc from 0x000eec to 0x001d9a (0xeaf bytes) 000190 1787785083.080715 trunc from 0x0001f0 to 0x001d9a (0x1bab bytes) 000191 1787785083.092214 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1d9b): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d9b): Mirror 4: 0x9e6116e9 (stale) Mirror 6: 0x9e6116e9 (stale) Mirror 7: 0x9e6116e9 (stale) CRC-32 checksum value for chunk [0, 0x1d9b): Mirror 1: 0x9e6116e9 Mirror 8: 0x9e6116e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d9b: skipped 000192 1787785083.861073 trunc from 0x000625 to 0x001d9a (0x1776 bytes) 000193 1787785083.896034 punch from 0x000863 to 0x001d9a (0x1538 bytes) 000194 1787785083.899840 punch from 0x000ffb to 0x001d9a (0xda0 bytes) 000195 1787785083.905122 trunc from 0x00116a to 0x001d9a (0xc31 bytes) 000196 1787785083.910523 read 0x000d56 thru 0x001d9a (0x1045 bytes) 000198 1787785083.923234 read 0x000606 thru 0x001d9a (0x1795 bytes) 000199 1787785083.930036 mapread 0x001ac5 thru 0x001d9a (0x2d6 bytes) 000200 1787785083.944502 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1d9b): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d9b): Mirror 4: 0x9e6116e9 (stale) Mirror 6: 0x9e6116e9 (stale) Mirror 7: 0x9e6116e9 (stale) Mirror 8: 0x9e6116e9 (stale) CRC-32 checksum value for chunk [0, 0x1d9b): Mirror 1: 0x9e6116e9 Mirror 9: 0x9e6116e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d9b: skipped 000201 1787785084.781215 trunc from 0x001d9b to 0x0193f6 (0x1765c bytes) 000202 1787785084.850063 punch from 0x0004f4 to 0x002db0 (0x28bd bytes) 000203 1787785084.857139 punch from 0x007ada to 0x00ad29 (0x3250 bytes) 000204 1787785084.864022 trunc from 0x0193f7 to 0x00e808 (0xabee bytes) 000205 1787785084.887218 trunc from 0x00e809 to 0x01557a (0x6d72 bytes) 000206 1787785084.918558 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1557b): Mirror 4: 0x5b54d55d (stale) Mirror 6: 0x5b54d55d (stale) Mirror 7: 0x5b54d55d (stale) Mirror 8: 0xdbe5f365 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1557b): Mirror 4: 0x5b54d55d (stale) Mirror 6: 0x5b54d55d (stale) Mirror 7: 0x5b54d55d (stale) Mirror 8: 0xdbe5f365 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1557b: skipped 000207 1787785085.351330 trunc from 0x01557b to 0x018d58 (0x37de bytes) 000209 1787785085.373936 mapwrite 0x00f3db thru 0x018fa7 (0x9bcd bytes) 000210 1787785085.508364 read 0x013048 thru 0x018fa7 (0x5f60 bytes) 000211 1787785085.509913 fallocate 0x01f10f thru 0x020972 (0x1864 bytes) 000213 1787785085.516284 mapread 0x008b47 thru 0x014f48 (0xc402 bytes) 000214 1787785085.532851 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18fa8): Mirror 4: 0xa3224555 (stale) Mirror 6: 0xa3224555 (stale) Mirror 7: 0xa3224555 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18fa8): Mirror 4: 0xa3224555 (stale) Mirror 6: 0xa3224555 (stale) Mirror 7: 0xa3224555 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18fa8: skipped 000215 1787785085.874800 trunc from 0x018fa8 to 0x03b040 (0x22099 bytes) 000216 1787785085.893638 trunc from 0x03a9d5 to 0x03b040 (0x66c bytes) 000217 1787785085.898301 mapwrite 0x036e55 thru 0x038a79 (0x1c25 bytes) 000218 1787785085.924042 trunc from 0x03b041 to 0x00d5db (0x2da65 bytes) 000219 1787785085.941845 MIRROR_RESYNC 4 mirrors 000221 1787785086.562997 write 0x03de5c thru 0x03ffff (0x21a4 bytes) 000222 1787785086.596649 mapwrite 0x033f93 thru 0x03e2ff (0xa36d bytes) 000223 1787785086.630320 mapread 0x01ea63 thru 0x02b44c (0xc9ea bytes) 000225 1787785086.660743 mapwrite 0x02c618 thru 0x039bb9 (0xd5a2 bytes) 000228 1787785086.703710 trunc from 0x040000 to 0x0055ba (0x3aa45 bytes) 000231 1787785086.727234 punch from 0x00537e to 0x0055ba (0x23d bytes) 000232 1787785086.731084 mapwrite 0x017815 thru 0x021995 (0xa181 bytes) 000234 1787785086.790243 MIRROR_RESYNC 4 mirrors 000235 1787785087.432200 mapwrite 0x023e20 thru 0x02d585 (0x9766 bytes) 000236 1787785087.499215 punch from 0x01ca30 to 0x02a354 (0xd925 bytes) 000237 1787785087.503780 read 0x010fa8 thru 0x011951 (0x9aa bytes) 000238 1787785087.507616 write 0x02ed58 thru 0x036ec4 (0x816d bytes) 000239 1787785087.508893 trunc from 0x01eb45 to 0x020999 (0x1e55 bytes) 000240 1787785087.513478 trunc from 0x0319b3 to 0x036ec4 (0x5512 bytes) 000241 1787785087.524208 punch from 0x007fab to 0x0169c5 (0xea1b bytes) 000242 1787785087.527628 write 0x0308b5 thru 0x039b86 (0x92d2 bytes) 000243 1787785087.533017 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x39b87): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39b87): Mirror 4: 0x84a10526 (stale) Mirror 6: 0x84a10526 (stale) Mirror 7: 0x84a10526 (stale) CRC-32 checksum value for chunk [0, 0x39b87): Mirror 1: 0x43bab88c Mirror 8: 0x43bab88c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39b87: skipped 000244 1787785088.320633 read 0x015f18 thru 0x019229 (0x3312 bytes) 000245 1787785088.351977 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x39b87): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39b87): Mirror 4: 0x84a10526 (stale) Mirror 6: 0x84a10526 (stale) Mirror 7: 0x84a10526 (stale) CRC-32 checksum value for chunk [0, 0x39b87): Mirror 1: 0x43bab88c Mirror 8: 0x43bab88c Mirror 9: 0x43bab88c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39b87: skipped 000246 1787785089.241917 punch from 0x0204b5 to 0x028da0 (0x88ec bytes) 000247 1787785089.308603 trunc from 0x01ad18 to 0x02754c (0xc835 bytes) 000249 1787785089.328157 fallocate 0x0171cb thru 0x01a03a (0x2e70 bytes) 000250 1787785089.335625 trunc from 0x008253 to 0x00a9f0 (0x279e bytes) 000251 1787785089.345964 mapwrite 0x015028 thru 0x023a79 (0xea52 bytes) 000252 1787785089.432740 read 0x0375c0 thru 0x0395f0 (0x2031 bytes) 000253 1787785089.439276 mapread 0x0381d7 thru 0x039b86 (0x19b0 bytes) 000254 1787785089.440595 mapwrite 0x022f3d thru 0x03007d (0xd141 bytes) 000255 1787785089.476193 mapread 0x035f34 thru 0x039b86 (0x3c53 bytes) 000256 1787785089.483227 punch from 0x00e3a4 to 0x01b0af (0xcd0c bytes) 000257 1787785089.488668 mapwrite 0x00acb5 thru 0x0120c7 (0x7413 bytes) 000258 1787785089.509935 mapread 0x00688a thru 0x00e058 (0x77cf bytes) 000259 1787785089.510804 fallocate 0x03f7a5 thru 0x03ffff (0x85b bytes) 000261 1787785089.516438 trunc from 0x039b87 to 0x015165 (0x24a21 bytes) 000262 1787785089.545862 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x15166): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15166): Mirror 4: 0x59ca392 (stale) Mirror 6: 0x59ca392 (stale) Mirror 7: 0x59ca392 (stale) Mirror 8: 0x59ca392 (stale) Mirror 9: 0x59ca392 (stale) CRC-32 checksum value for chunk [0, 0x15166): Mirror 1: 0x90f756a8 Mirror 10: 0x90f756a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15166: skipped 000263 1787785090.315756 punch from 0x00b2fc to 0x00c1b7 (0xebc bytes) 000264 1787785090.402502 write 0x0334a0 thru 0x03ffff (0xcb60 bytes) 000265 1787785090.417522 MIRROR_RESYNC 7 mirrors 000266 1787785091.950149 trunc from 0x01e388 to 0x01f318 (0xf91 bytes) 000267 1787785091.996400 trunc from 0x005a66 to 0x010b58 (0xb0f3 bytes) 000268 1787785092.002159 trunc from 0x0326d0 to 0x03ffff (0xd930 bytes) 000269 1787785092.009648 trunc from 0x040000 to 0x0293a2 (0x16c5d bytes) 000271 1787785092.041395 mapwrite 0x0087e3 thru 0x011463 (0x8c81 bytes) 000272 1787785092.074022 punch from 0x0077ca to 0x00b1c7 (0x39fe bytes) 000273 1787785092.082785 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x293a3): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x293a3): Mirror 4: 0x4a8115da (stale) Mirror 6: 0x4a8115da (stale) Mirror 7: 0x4a8115da (stale) Mirror 8: 0x4a8115da (stale) Mirror 9: 0x4a8115da (stale) Mirror 10: 0x4a8115da (stale) CRC-32 checksum value for chunk [0, 0x293a3): Mirror 1: 0x1f095e4a Mirror 11: 0x1f095e4a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x293a3: skipped 000274 1787785093.282193 read 0x008ee4 thru 0x015b66 (0xcc83 bytes) 000275 1787785093.296576 write 0x01c605 thru 0x0258b6 (0x92b2 bytes) 000276 1787785093.352864 punch from 0x00a27e to 0x01728b (0xd00e bytes) 000277 1787785093.357266 trunc from 0x002d6f to 0x00a188 (0x741a bytes) 000278 1787785093.362803 fallocate 0x007f4a thru 0x017c1a (0xfcd1 bytes) 000279 1787785093.366450 read 0x0031fd thru 0x00dcfb (0xaaff bytes) 000280 1787785093.373736 mapread 0x0244a7 thru 0x0293a2 (0x4efc bytes) 000281 1787785093.376073 mapwrite 0x036073 thru 0x03ffff (0x9f8d bytes) 000282 1787785093.474476 fallocate 0x02eba6 thru 0x03d2ee (0xe749 bytes) 000283 1787785093.479774 mapwrite 0x0122be thru 0x0169fc (0x473f bytes) 000284 1787785093.497017 write 0x01d7bc thru 0x02730c (0x9b51 bytes) 000286 1787785093.500027 punch from 0x036d3d to 0x03f75a (0x8a1e bytes) 000287 1787785093.506300 punch from 0x02e3d0 to 0x0370b0 (0x8ce1 bytes) 000288 1787785093.514066 punch from 0x026b1b to 0x0316a3 (0xab89 bytes) 000289 1787785093.538390 write 0x019a24 thru 0x028071 (0xe64e bytes) 000290 1787785093.547567 punch from 0x0380b2 to 0x03ffff (0x7f4e bytes) 000291 1787785093.553204 write 0x02223a thru 0x031117 (0xeede bytes) 000292 1787785093.563746 mapwrite 0x014f2e thru 0x024ced (0xfdc0 bytes) 000293 1787785093.596803 fallocate 0x01d932 thru 0x028a3b (0xb10a bytes) 000294 1787785093.604095 trunc from 0x040000 to 0x0378f6 (0x8709 bytes) 000295 1787785093.630103 mapwrite 0x0102cb thru 0x0155fa (0x5330 bytes) 000296 1787785093.669399 punch from 0x02b98b to 0x02c290 (0x906 bytes) 000297 1787785093.677724 punch from 0x027104 to 0x03070e (0x960b bytes) 000298 1787785093.685138 mapwrite 0x03f3d4 thru 0x03ffff (0xc2c bytes) 000299 1787785093.725146 mapread 0x02dd41 thru 0x033345 (0x5605 bytes) 000300 1787785093.754800 trunc from 0x02444f to 0x0333f4 (0xefa6 bytes) 000301 1787785093.760938 fallocate 0x021729 thru 0x023da5 (0x267d bytes) 000303 1787785093.766929 mapread 0x012cb5 thru 0x014604 (0x1950 bytes) 000304 1787785093.768086 fallocate 0x03f627 thru 0x03fdab (0x785 bytes) 000305 1787785093.777100 mapread 0x0123ec thru 0x01465c (0x2271 bytes) 000306 1787785093.778230 trunc from 0x040000 to 0x00f2c8 (0x30d37 bytes) 000307 1787785093.805179 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf2c9): Mirror 4: 0x6a319f35 (stale) Mirror 6: 0x6a319f35 (stale) Mirror 8: 0x6a319f35 (stale) Mirror 9: 0x6a319f35 (stale) Mirror 10: 0x6a319f35 (stale) Mirror 11: 0x7d12e112 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf2c9): Mirror 4: 0x6a319f35 (stale) Mirror 6: 0x6a319f35 (stale) Mirror 8: 0x6a319f35 (stale) Mirror 9: 0x6a319f35 (stale) Mirror 10: 0x6a319f35 (stale) Mirror 11: 0x7d12e112 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf2c9: skipped 000308 1787785094.198852 read 0x00872e thru 0x00f2c8 (0x6b9b bytes) 000309 1787785094.205542 trunc from 0x00f2c9 to 0x02b4cd (0x1c205 bytes) 000310 1787785094.239574 write 0x01aefa thru 0x0255bd (0xa6c4 bytes) 000311 1787785094.259255 mapwrite 0x023341 thru 0x02f4c5 (0xc185 bytes) 000312 1787785094.321692 mapwrite 0x0193d8 thru 0x024850 (0xb479 bytes) 000314 1787785094.350587 write 0x00d6cc thru 0x00f68f (0x1fc4 bytes) 000315 1787785094.352927 mapread 0x01c20f thru 0x0277bd (0xb5af bytes) 000316 1787785094.354155 fallocate 0x0274d5 thru 0x030e8b (0x99b7 bytes) 000317 1787785094.359643 trunc from 0x00289b to 0x0061a6 (0x390c bytes) 000318 1787785094.363687 mapread 0x01cb51 thru 0x026f97 (0xa447 bytes) 000320 1787785094.366045 read 0x02b8e2 thru 0x030e8b (0x55aa bytes) 000321 1787785094.378176 trunc from 0x01168b to 0x014257 (0x2bcd bytes) 000322 1787785094.382704 trunc from 0x01adc6 to 0x02ad41 (0xff7c bytes) 000324 1787785094.391047 punch from 0x01fba9 to 0x02b27f (0xb6d7 bytes) 000325 1787785094.395895 trunc from 0x030e8c to 0x03570c (0x4881 bytes) 000327 1787785094.414945 trunc from 0x03570d to 0x00f0af (0x2665d bytes) 000328 1787785094.437849 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf0b0): Mirror 6: 0xa751ef4c (stale) Mirror 8: 0xa751ef4c (stale) Mirror 9: 0xa751ef4c (stale) Mirror 10: 0xa751ef4c (stale) Mirror 11: 0xaf0c55c2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf0b0): Mirror 6: 0xa751ef4c (stale) Mirror 8: 0xa751ef4c (stale) Mirror 9: 0xa751ef4c (stale) Mirror 10: 0xa751ef4c (stale) Mirror 11: 0xaf0c55c2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf0b0: skipped 000329 1787785094.932872 mapwrite 0x01b888 thru 0x024332 (0x8aab bytes) 000330 1787785095.014202 MIRROR_RESYNC 6 mirrors 000331 1787785096.361709 mapread 0x00f1f2 thru 0x00fc8f (0xa9e bytes) 000332 1787785096.370226 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) 000333 1787785096.716745 mapwrite 0x01a924 thru 0x02a6dd (0xfdba bytes) 000334 1787785096.905040 mapread 0x004496 thru 0x007653 (0x31be bytes) 000335 1787785096.929619 MIRROR_RESYNC 5 mirrors 000336 1787785098.112049 write 0x01356b thru 0x01a68c (0x7122 bytes) 000337 1787785098.157154 mapwrite 0x00bf63 thru 0x013592 (0x7630 bytes) 000338 1787785098.213028 punch from 0x019567 to 0x01d922 (0x43bc bytes) 000339 1787785098.218241 trunc from 0x0224c4 to 0x023325 (0xe62 bytes) 000340 1787785098.227043 read 0x011f5d thru 0x013896 (0x193a bytes) 000341 1787785098.227627 write 0x01fde3 thru 0x02dd21 (0xdf3f bytes) 000342 1787785098.249887 write 0x034d3c thru 0x036742 (0x1a07 bytes) 000343 1787785098.253992 punch from 0x028d92 to 0x032d0d (0x9f7c bytes) 000344 1787785098.286007 punch from 0x01090a to 0x01c447 (0xbb3e bytes) 000345 1787785098.298726 trunc from 0x01a0a5 to 0x02178f (0x76eb bytes) 000347 1787785098.308394 mapread 0x02dc8f thru 0x0315ee (0x3960 bytes) 000348 1787785098.323593 fallocate 0x039cae thru 0x03ffff (0x6352 bytes) 000350 1787785098.344866 trunc from 0x02ce1d to 0x036742 (0x9926 bytes) 000351 1787785098.359466 trunc from 0x026b0f to 0x0291e9 (0x26db bytes) 000352 1787785098.369102 trunc from 0x036743 to 0x02c25b (0xa4e7 bytes) 000353 1787785098.443771 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2c25c): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c25c): Mirror 6: 0xb5d38987 (stale) Mirror 8: 0xb5d38987 (stale) Mirror 9: 0xb5d38987 (stale) Mirror 10: 0xb5d38987 (stale) CRC-32 checksum value for chunk [0, 0x2c25c): Mirror 1: 0x4f7df554 Mirror 11: 0x4f7df554 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c25c: skipped 000354 1787785099.600786 write 0x008b19 thru 0x016b01 (0xdfe9 bytes) 000355 1787785099.646177 punch from 0x0100db to 0x01c856 (0xc77c bytes) 000357 1787785099.660092 write 0x0374ff thru 0x03fef2 (0x89f4 bytes) 000358 1787785099.661388 trunc from 0x002f43 to 0x00fdac (0xce6a bytes) 000359 1787785099.666560 fallocate 0x018de0 thru 0x01f906 (0x6b27 bytes) 000360 1787785099.670991 write 0x030c12 thru 0x031a95 (0xe84 bytes) 000361 1787785099.679607 read 0x012431 thru 0x01354c (0x111c bytes) 000363 1787785099.685658 trunc from 0x03fef3 to 0x03057f (0xf973 bytes) 000364 1787785099.707057 punch from 0x02c9b1 to 0x03057f (0x3bcf bytes) 000366 1787785099.716925 read 0x0251f0 thru 0x02c334 (0x7145 bytes) 000367 1787785099.725268 read 0x01cfab thru 0x028cf3 (0xbd49 bytes) 000368 1787785099.727676 trunc from 0x030234 to 0x03057f (0x34c bytes) 000369 1787785099.732898 trunc from 0x030580 to 0x0051d8 (0x2b3a7 bytes) 000370 1787785099.749067 fallocate 0x007713 thru 0x007906 (0x1f4 bytes) 000371 1787785099.754760 fallocate 0x0166c9 thru 0x0225e9 (0xbf21 bytes) 000372 1787785099.759698 mapread 0x002cd3 thru 0x007906 (0x4c34 bytes) 000373 1787785099.766267 trunc from 0x007907 to 0x00e325 (0x6a1f bytes) 000374 1787785099.782726 punch from 0x0086d2 to 0x00e325 (0x5c54 bytes) 000375 1787785099.791198 mapwrite 0x02e830 thru 0x031eed (0x36be bytes) 000377 1787785099.834746 write 0x00abd1 thru 0x013e17 (0x9247 bytes) 000378 1787785099.841135 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x31eee): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31eee): Mirror 6: 0xad243036 (stale) Mirror 8: 0xad243036 (stale) Mirror 9: 0xad243036 (stale) Mirror 10: 0xad243036 (stale) Mirror 11: 0x786fec8d (stale) CRC-32 checksum value for chunk [0, 0x31eee): Mirror 1: 0x7361b786 Mirror 12: 0x7361b786 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31eee: skipped 000379 1787785100.950145 punch from 0x022ae4 to 0x02f8d5 (0xcdf2 bytes) 000380 1787785101.013139 trunc from 0x031eee to 0x033f57 (0x206a bytes) 000381 1787785101.052489 mapread 0x0021e4 thru 0x00aed7 (0x8cf4 bytes) 000382 1787785101.082671 write 0x003fa3 thru 0x00fb07 (0xbb65 bytes) 000383 1787785101.084026 trunc from 0x033332 to 0x033f57 (0xc26 bytes) 000384 1787785101.089111 read 0x01da1b thru 0x025646 (0x7c2c bytes) 000385 1787785101.098608 fallocate 0x02638f thru 0x02c327 (0x5f99 bytes) 000388 1787785101.104656 fallocate 0x02e4bc thru 0x03117d (0x2cc2 bytes) 000389 1787785101.110148 mapread 0x02e325 thru 0x02f073 (0xd4f bytes) 000390 1787785101.123673 mapwrite 0x009ea4 thru 0x011b12 (0x7c6f bytes) 000391 1787785101.150701 trunc from 0x0144c5 to 0x02418b (0xfcc7 bytes) 000392 1787785101.155312 write 0x03ccb9 thru 0x03ffff (0x3347 bytes) 000393 1787785101.156396 read 0x0050c6 thru 0x0085d4 (0x350f bytes) 000394 1787785101.156937 trunc from 0x040000 to 0x0090c8 (0x36f37 bytes) 000395 1787785101.176634 trunc from 0x0090c9 to 0x03cedc (0x33e14 bytes) 000396 1787785101.195011 trunc from 0x03cedd to 0x02fc71 (0xd26b bytes) 000397 1787785101.207850 trunc from 0x02fc72 to 0x00dbb0 (0x220c1 bytes) 000398 1787785101.222684 write 0x009fa1 thru 0x0132bc (0x931c bytes) 000399 1787785101.225211 trunc from 0x00bfc9 to 0x0132bc (0x72f4 bytes) 000400 1787785101.240919 fallocate 0x008ffb thru 0x00a871 (0x1877 bytes) 000401 1787785101.245279 punch from 0x00bd95 to 0x00dec9 (0x2135 bytes) 000402 1787785101.250905 mapwrite 0x03ae70 thru 0x03fac3 (0x4c54 bytes) 000403 1787785101.310168 punch from 0x03e41f to 0x03fac3 (0x16a5 bytes) 000405 1787785101.325955 mapread 0x02b0bc thru 0x02eadc (0x3a21 bytes) 000406 1787785101.329635 punch from 0x009f9b to 0x017a72 (0xdad8 bytes) 000407 1787785101.355454 MIRROR_RESYNC 7 mirrors 000408 1787785103.079151 mapread 0x025061 thru 0x031b93 (0xcb33 bytes) 000409 1787785103.108584 read 0x0313ae thru 0x0373ed (0x6040 bytes) 000410 1787785103.109600 punch from 0x03ab96 to 0x03fac3 (0x4f2e bytes) 000411 1787785103.155945 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fac4): Mirror 6: 0x1244e6e6 (stale) Mirror 8: 0x1244e6e6 (stale) Mirror 9: 0x1244e6e6 (stale) Mirror 11: 0x1244e6e6 (stale) Mirror 12: 0x1244e6e6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fac4): Mirror 6: 0x1244e6e6 (stale) Mirror 8: 0x1244e6e6 (stale) Mirror 9: 0x1244e6e6 (stale) Mirror 11: 0x1244e6e6 (stale) Mirror 12: 0x1244e6e6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fac4: skipped 000413 1787785103.543720 punch from 0x005dd6 to 0x008116 (0x2341 bytes) 000414 1787785103.548457 mapread 0x0331cd thru 0x03fac3 (0xc8f7 bytes) 000416 1787785103.570000 trunc from 0x001345 to 0x008f47 (0x7c03 bytes) 000418 1787785103.576508 fallocate 0x016c45 thru 0x017f82 (0x133e bytes) 000419 1787785103.581522 write 0x037f34 thru 0x03e30f (0x63dc bytes) 000420 1787785103.589951 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fac4): Mirror 6: 0x1244e6e6 (stale) Mirror 8: 0x1244e6e6 (stale) Mirror 11: 0x1244e6e6 (stale) Mirror 12: 0x1244e6e6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fac4): Mirror 6: 0x1244e6e6 (stale) Mirror 8: 0x1244e6e6 (stale) Mirror 11: 0x1244e6e6 (stale) Mirror 12: 0x1244e6e6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fac4: skipped 000421 1787785104.063568 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3fac4): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fac4): Mirror 6: 0x1244e6e6 (stale) Mirror 8: 0x1244e6e6 (stale) Mirror 11: 0x1244e6e6 (stale) Mirror 12: 0x1244e6e6 (stale) CRC-32 checksum value for chunk [0, 0x3fac4): Mirror 1: 0xaa8a53e7 Mirror 13: 0xaa8a53e7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fac4: skipped 000423 1787785105.070284 fallocate 0x018229 thru 0x01f9c2 (0x779a bytes) 000424 1787785105.103695 write 0x004b12 thru 0x013653 (0xeb42 bytes) 000425 1787785105.120063 write 0x00750b thru 0x009d7e (0x2874 bytes) 000427 1787785105.121610 fallocate 0x01a3da thru 0x022ca1 (0x88c8 bytes) 000428 1787785105.129321 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fac4): Mirror 8: 0x1244e6e6 (stale) Mirror 11: 0x1244e6e6 (stale) Mirror 12: 0x1244e6e6 (stale) Mirror 13: 0xaa8a53e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fac4): Mirror 8: 0x1244e6e6 (stale) Mirror 11: 0x1244e6e6 (stale) Mirror 12: 0x1244e6e6 (stale) Mirror 13: 0xaa8a53e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fac4: skipped 000429 1787785105.569636 trunc from 0x005ed2 to 0x00f3e4 (0x9513 bytes) 000430 1787785105.574326 trunc from 0x004ad4 to 0x005044 (0x571 bytes) 000431 1787785105.581333 MIRROR_RESYNC 5 mirrors 000432 1787785106.714568 trunc from 0x0151d6 to 0x0158f0 (0x71b bytes) 000433 1787785106.746812 mapwrite 0x032e8f thru 0x03e525 (0xb697 bytes) 000434 1787785106.782349 read 0x009f20 thru 0x00b721 (0x1802 bytes) 000435 1787785106.786666 mapwrite 0x01808c thru 0x024ebc (0xce31 bytes) 000436 1787785106.816590 mapwrite 0x029755 thru 0x029ee7 (0x793 bytes) 000437 1787785106.828684 trunc from 0x022810 to 0x0228fb (0xec bytes) 000438 1787785106.833051 trunc from 0x0247e2 to 0x031879 (0xd098 bytes) 000439 1787785106.838570 fallocate 0x02feae thru 0x03c3dc (0xc52f bytes) 000440 1787785106.843646 mapread 0x01fa79 thru 0x0222b9 (0x2841 bytes) 000441 1787785106.853687 punch from 0x03a177 to 0x03fac3 (0x594d bytes) 000442 1787785106.859717 read 0x004a9a thru 0x00977f (0x4ce6 bytes) 000443 1787785106.870403 punch from 0x036f7d to 0x03d336 (0x63ba bytes) 000444 1787785106.876156 mapread 0x02a23a thru 0x02f1bd (0x4f84 bytes) 000445 1787785106.877714 trunc from 0x01a92b to 0x0248bd (0x9f93 bytes) 000446 1787785106.883277 trunc from 0x03fac4 to 0x00e4b8 (0x3160b bytes) 000447 1787785106.912965 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xe4b9): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe4b9): Mirror 8: 0x52301f3b (stale) Mirror 11: 0x52301f3b (stale) Mirror 12: 0x52301f3b (stale) Mirror 13: 0x52301f3b (stale) CRC-32 checksum value for chunk [0, 0xe4b9): Mirror 1: 0x52301f3b Mirror 14: 0x52301f3b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe4b9: skipped 000448 1787785107.761391 fallocate 0x027405 thru 0x02f908 (0x8504 bytes) 000449 1787785107.813603 mapwrite 0x00ff2a thru 0x011057 (0x112e bytes) 000450 1787785107.843872 mapwrite 0x029c3a thru 0x02e0e3 (0x44aa bytes) 000451 1787785107.871913 fallocate 0x00195a thru 0x003069 (0x1710 bytes) 000452 1787785107.877174 punch from 0x0002cf to 0x00555b (0x528d bytes) 000453 1787785107.885142 trunc from 0x02cf3a to 0x02f908 (0x29cf bytes) 000454 1787785107.894047 trunc from 0x0036d2 to 0x00c350 (0x8c7f bytes) 000455 1787785107.909541 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2f909): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f909): Mirror 8: 0xddf5d974 (stale) Mirror 11: 0xddf5d974 (stale) Mirror 12: 0xddf5d974 (stale) Mirror 13: 0xddf5d974 (stale) Mirror 14: 0xf79b4e16 (stale) CRC-32 checksum value for chunk [0, 0x2f909): Mirror 1: 0x89c755e0 Mirror 15: 0x89c755e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f909: skipped 000456 1787785108.626048 mapwrite 0x03fec4 thru 0x03ffff (0x13c bytes) 000457 1787785108.682611 MIRROR_RESYNC 7 mirrors 000458 1787785110.666175 punch from 0x03be6f to 0x03ffff (0x4191 bytes) 000459 1787785110.722842 mapread 0x025ec2 thru 0x029da5 (0x3ee4 bytes) 000460 1787785110.755663 mapwrite 0x01b89b thru 0x028d3a (0xd4a0 bytes) 000461 1787785110.791073 read 0x01aa01 thru 0x01dc76 (0x3276 bytes) 000462 1787785110.792184 trunc from 0x020b2b to 0x02b37f (0xa855 bytes) 000463 1787785110.797076 fallocate 0x005502 thru 0x0066d7 (0x11d6 bytes) 000464 1787785110.802222 write 0x01ed94 thru 0x024072 (0x52df bytes) 000465 1787785110.829579 read 0x007afe thru 0x00c82d (0x4d30 bytes) 000466 1787785110.886701 punch from 0x00bfba to 0x01bdb6 (0xfdfd bytes) 000467 1787785110.892757 mapwrite 0x01bb45 thru 0x02b848 (0xfd04 bytes) 000469 1787785110.918727 write 0x024ebc thru 0x033702 (0xe847 bytes) 000471 1787785110.921777 mapread 0x03dfd7 thru 0x03e70b (0x735 bytes) 000472 1787785110.922735 trunc from 0x040000 to 0x02058a (0x1fa75 bytes) 000473 1787785110.940172 mapwrite 0x02ec8b thru 0x0351c1 (0x6537 bytes) 000474 1787785111.010468 punch from 0x0113e8 to 0x0115fc (0x215 bytes) 000475 1787785111.014485 trunc from 0x0351c2 to 0x003105 (0x320bc bytes) 000477 1787785111.033796 trunc from 0x001325 to 0x003105 (0x1de1 bytes) 000478 1787785111.039274 write 0x02e16a thru 0x02e4f4 (0x38b bytes) 000480 1787785111.040865 mapread 0x02deba thru 0x02e4f4 (0x63b bytes) 000481 1787785111.045858 write 0x002af2 thru 0x00eec9 (0xc3d8 bytes) 000484 1787785111.057499 trunc from 0x02e4f5 to 0x01a101 (0x143f3 bytes) 000485 1787785111.075163 punch from 0x002c80 to 0x008408 (0x5789 bytes) 000486 1787785111.088120 mapread 0x01267a thru 0x01a101 (0x7a88 bytes) 000487 1787785111.123019 trunc from 0x01a102 to 0x00f945 (0xa7bc bytes) 000488 1787785111.139180 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf946): Mirror 8: 0x4f07862 (stale) Mirror 12: 0x4f07862 (stale) Mirror 13: 0x4f07862 (stale) Mirror 14: 0x4f07862 (stale) Mirror 15: 0x4f07862 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf946): Mirror 8: 0x4f07862 (stale) Mirror 12: 0x4f07862 (stale) Mirror 13: 0x4f07862 (stale) Mirror 14: 0x4f07862 (stale) Mirror 15: 0x4f07862 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf946: skipped 000490 1787785111.437940 mapread 0x00f323 thru 0x00f4f2 (0x1d0 bytes) 000491 1787785111.443815 read 0x00f2ce thru 0x00f945 (0x678 bytes) 000492 1787785111.444527 read 0x006e6a thru 0x0080ba (0x1251 bytes) 000493 1787785111.458681 trunc from 0x00f946 to 0x023dfd (0x144b8 bytes) 000494 1787785111.476096 mapwrite 0x02b535 thru 0x0360f5 (0xabc1 bytes) 000496 1787785111.514125 trunc from 0x017c94 to 0x0226bc (0xaa29 bytes) 000497 1787785111.518633 trunc from 0x008db3 to 0x009788 (0x9d6 bytes) 000498 1787785111.523392 write 0x009a38 thru 0x009ae3 (0xac bytes) 000499 1787785111.528263 write 0x01bade thru 0x02692f (0xae52 bytes) 000500 1787785111.532584 mapread 0x00febb thru 0x01c816 (0xc95c bytes) 000501 1787785111.547550 fallocate 0x004405 thru 0x0099ac (0x55a8 bytes) 000502 1787785111.551884 punch from 0x02da8e to 0x0331a5 (0x5718 bytes) 000503 1787785111.556489 mapread 0x00030a thru 0x008536 (0x822d bytes) 000504 1787785111.561834 read 0x01e124 thru 0x02d865 (0xf742 bytes) 000505 1787785111.569272 trunc from 0x00b812 to 0x0152b6 (0x9aa5 bytes) 000506 1787785111.574159 mapread 0x019162 thru 0x01c9d1 (0x3870 bytes) 000507 1787785111.575471 fallocate 0x0033aa thru 0x00689f (0x34f6 bytes) 000508 1787785111.580967 fallocate 0x013745 thru 0x01cce6 (0x95a2 bytes) 000509 1787785111.585601 write 0x01c220 thru 0x0257c8 (0x95a9 bytes) 000510 1787785111.587874 trunc from 0x011680 to 0x01f6a0 (0xe021 bytes) 000512 1787785111.602926 punch from 0x0230e0 to 0x0275dc (0x44fd bytes) 000513 1787785111.609287 trunc from 0x0360f6 to 0x00e5c2 (0x27b33 bytes) 000514 1787785111.627054 mapwrite 0x024fa8 thru 0x02dbd3 (0x8c2c bytes) 000515 1787785111.751020 trunc from 0x02a8ef to 0x02dbd3 (0x32e5 bytes) 000516 1787785111.755075 read 0x019f38 thru 0x01a0c3 (0x18c bytes) 000517 1787785111.762970 fallocate 0x02673e thru 0x02e841 (0x8104 bytes) 000518 1787785111.766749 write 0x00ed4f thru 0x017664 (0x8916 bytes) 000520 1787785111.769383 write 0x00769d thru 0x00c525 (0x4e89 bytes) 000522 1787785111.771628 trunc from 0x014cd1 to 0x024735 (0xfa65 bytes) 000523 1787785111.787341 trunc from 0x02dbd4 to 0x003924 (0x2a2af bytes) 000524 1787785111.805376 trunc from 0x000e63 to 0x003924 (0x2ac2 bytes) 000525 1787785111.810624 punch from 0x0024ab to 0x003924 (0x147a bytes) 000526 1787785111.814491 trunc from 0x0017bf to 0x003924 (0x2166 bytes) 000528 1787785111.819765 read 0x000608 thru 0x003924 (0x331d bytes) 000529 1787785111.826794 fallocate 0x03e91c thru 0x03ffff (0x16e4 bytes) 000530 1787785111.833574 mapwrite 0x018a6d thru 0x0192f0 (0x884 bytes) 000531 1787785111.871130 mapread 0x0038fa thru 0x004791 (0xe98 bytes) 000532 1787785111.872567 trunc from 0x007bfd to 0x00af2a (0x332e bytes) 000533 1787785111.877207 punch from 0x00b228 to 0x00ed87 (0x3b60 bytes) 000534 1787785111.881306 mapread 0x00bf09 thru 0x00cb21 (0xc19 bytes) 000535 1787785111.890850 trunc from 0x0192f1 to 0x026a58 (0xd768 bytes) 000536 1787785111.905953 trunc from 0x007870 to 0x00af40 (0x36d1 bytes) 000537 1787785111.924860 mapwrite 0x038049 thru 0x03ffff (0x7fb7 bytes) 000538 1787785112.015626 fallocate 0x01271e thru 0x017b24 (0x5407 bytes) 000540 1787785112.022030 write 0x01def0 thru 0x029f12 (0xc023 bytes) 000541 1787785112.023359 write 0x0321ef thru 0x036eda (0x4cec bytes) 000543 1787785112.027064 mapwrite 0x03c632 thru 0x03ed4c (0x271b bytes) 000544 1787785112.045695 trunc from 0x034b23 to 0x03ffff (0xb4dd bytes) 000546 1787785112.056430 read 0x0299c9 thru 0x02dd58 (0x4390 bytes) 000547 1787785112.057470 fallocate 0x035603 thru 0x039b84 (0x4582 bytes) 000548 1787785112.062878 trunc from 0x040000 to 0x0136ca (0x2c935 bytes) 000549 1787785112.079315 mapread 0x0110e1 thru 0x0136ca (0x25ea bytes) 000550 1787785112.085329 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x136cb): Mirror 8: 0x64b07d84 (stale) Mirror 12: 0x64b07d84 (stale) Mirror 13: 0x64b07d84 (stale) Mirror 15: 0x64b07d84 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x136cb): Mirror 8: 0x64b07d84 (stale) Mirror 12: 0x64b07d84 (stale) Mirror 13: 0x64b07d84 (stale) Mirror 15: 0x64b07d84 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x136cb: skipped 000551 1787785112.456897 fallocate 0x0157c7 thru 0x01ad77 (0x55b1 bytes) 000552 1787785112.476239 MIRROR_RESYNC 5 mirrors 000553 1787785113.487696 write 0x016ec2 thru 0x022eee (0xc02d bytes) 000554 1787785113.525476 fallocate 0x013d9b thru 0x0198e2 (0x5b48 bytes) 000555 1787785113.530659 trunc from 0x022eef to 0x01cce4 (0x620a bytes) 000556 1787785113.546311 write 0x0091bf thru 0x0144bc (0xb2fe bytes) 000557 1787785113.555954 punch from 0x016fdc to 0x018f44 (0x1f69 bytes) 000558 1787785113.568657 trunc from 0x00b8d1 to 0x01733b (0xba6b bytes) 000560 1787785113.575020 mapwrite 0x02199f thru 0x027d3e (0x63a0 bytes) 000561 1787785113.618825 mapread 0x0217f8 thru 0x027d3e (0x6547 bytes) 000562 1787785113.619839 read 0x00c465 thru 0x019028 (0xcbc4 bytes) 000563 1787785113.629006 write 0x00c0e4 thru 0x0196fc (0xd619 bytes) 000564 1787785113.631874 write 0x00009c thru 0x0032d3 (0x3238 bytes) 000565 1787785113.639786 fallocate 0x01f1ca thru 0x025bab (0x69e2 bytes) 000566 1787785113.645489 fallocate 0x0115d3 thru 0x0138a3 (0x22d1 bytes) 000567 1787785113.649942 trunc from 0x027d3f to 0x001a57 (0x262e7 bytes) 000568 1787785113.673036 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1a58): Mirror 8: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a58): Mirror 8: 0x5ec19d8f (stale) Mirror 12: 0x5ec19d8f (stale) Mirror 13: 0x5ec19d8f (stale) Mirror 15: 0x5ec19d8f (stale) CRC-32 checksum value for chunk [0, 0x1a58): Mirror 1: 0xb5b9524e Mirror 16: 0xb5b9524e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a58: skipped 000569 1787785114.439602 read 0x00086d thru 0x0014f5 (0xc89 bytes) 000570 1787785114.445543 fallocate 0x024bfc thru 0x026731 (0x1b36 bytes) 000571 1787785114.486666 mapread 0x0017df thru 0x001a57 (0x279 bytes) 000572 1787785114.495070 write 0x032712 thru 0x03ffff (0xd8ee bytes) 000573 1787785114.501087 trunc from 0x030d06 to 0x034428 (0x3723 bytes) 000574 1787785114.523139 mapread 0x03fd79 thru 0x03ffff (0x287 bytes) 000575 1787785114.523986 punch from 0x016f70 to 0x0264c0 (0xf551 bytes) 000576 1787785114.530043 fallocate 0x03b505 thru 0x03ffff (0x4afb bytes) 000577 1787785114.533623 trunc from 0x040000 to 0x01d985 (0x2267a bytes) 000578 1787785114.574376 trunc from 0x003bc5 to 0x012053 (0xe48f bytes) 000579 1787785114.579962 mapread 0x01c0b8 thru 0x01d985 (0x18ce bytes) 000580 1787785114.599024 read 0x01d94f thru 0x01d985 (0x37 bytes) 000581 1787785114.599678 trunc from 0x01d986 to 0x011154 (0xc831 bytes) 000583 1787785114.618308 mapread 0x003478 thru 0x00d177 (0x9d00 bytes) 000584 1787785114.624851 mapwrite 0x036691 thru 0x03f90b (0x927b bytes) 000585 1787785114.707648 read 0x01dac2 thru 0x0257e9 (0x7d28 bytes) 000586 1787785114.709569 trunc from 0x03f90c to 0x03c8fb (0x3010 bytes) 000587 1787785114.739455 trunc from 0x023ba6 to 0x025016 (0x1471 bytes) 000588 1787785114.748505 mapwrite 0x0223a6 thru 0x026bdf (0x483a bytes) 000589 1787785114.785584 trunc from 0x009782 to 0x018028 (0xe8a7 bytes) 000590 1787785114.789863 mapread 0x021c74 thru 0x02c16c (0xa4f9 bytes) 000592 1787785114.794923 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c8fc): Mirror 8: 0x70ddad1d (stale) Mirror 12: 0x70ddad1d (stale) Mirror 13: 0x70ddad1d (stale) Mirror 16: 0xf08ff45f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c8fc): Mirror 8: 0x70ddad1d (stale) Mirror 12: 0x70ddad1d (stale) Mirror 13: 0x70ddad1d (stale) Mirror 16: 0xf08ff45f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c8fc: skipped 000593 1787785115.114604 write 0x036405 thru 0x03c4fa (0x60f6 bytes) 000594 1787785115.129524 punch from 0x03bd08 to 0x03c8fb (0xbf4 bytes) 000596 1787785115.159640 punch from 0x018490 to 0x021bbf (0x9730 bytes) 000597 1787785115.165956 mapwrite 0x013443 thru 0x014265 (0xe23 bytes) 000598 1787785115.213613 fallocate 0x00342d thru 0x006c2a (0x37fe bytes) 000600 1787785115.220716 punch from 0x01e641 to 0x02471e (0x60de bytes) 000601 1787785115.234317 trunc from 0x03c8fc to 0x025c9c (0x16c5f bytes) 000602 1787785115.266642 mapread 0x01b275 thru 0x01d32c (0x20b8 bytes) 000603 1787785115.298833 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x25c9d): Mirror 8: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25c9d): Mirror 8: 0x14165925 (stale) Mirror 12: 0x14165925 (stale) Mirror 13: 0x14165925 (stale) Mirror 16: 0x6e552013 (stale) CRC-32 checksum value for chunk [0, 0x25c9d): Mirror 1: 0xbd1f506b Mirror 17: 0xbd1f506b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25c9d: skipped 000604 1787785116.212608 trunc from 0x005d7b to 0x006a50 (0xcd6 bytes) 000606 1787785116.248010 mapwrite 0x034748 thru 0x03ffff (0xb8b8 bytes) 000607 1787785116.332394 mapwrite 0x00a8de thru 0x00bbeb (0x130e bytes) 000608 1787785116.352478 trunc from 0x033e8b to 0x03841f (0x4595 bytes) 000609 1787785116.357843 punch from 0x025fe1 to 0x033ec9 (0xdee9 bytes) 000610 1787785116.361803 write 0x01233f thru 0x020d22 (0xe9e4 bytes) 000611 1787785116.367029 write 0x0203e7 thru 0x0215a8 (0x11c2 bytes) 000612 1787785116.372791 fallocate 0x01e9b0 thru 0x01fb9b (0x11ec bytes) 000613 1787785116.376673 write 0x032d1f thru 0x03e9da (0xbcbc bytes) 000614 1787785116.381943 mapread 0x01850c thru 0x020c1d (0x8712 bytes) 000615 1787785116.383933 trunc from 0x040000 to 0x02ee29 (0x111d6 bytes) 000616 1787785116.413836 fallocate 0x025252 thru 0x030063 (0xae12 bytes) 000617 1787785116.419549 trunc from 0x0053b3 to 0x00a0c4 (0x4d12 bytes) 000618 1787785116.423998 read 0x01ea4f thru 0x026e3b (0x83ed bytes) 000619 1787785116.430335 punch from 0x00a637 to 0x018030 (0xd9fa bytes) 000620 1787785116.449664 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ee2a): Mirror 8: 0xb51c821 (stale) Mirror 13: 0xb51c821 (stale) Mirror 16: 0x65299293 (stale) Mirror 17: 0x8afb4ba6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ee2a): Mirror 8: 0xb51c821 (stale) Mirror 13: 0xb51c821 (stale) Mirror 16: 0x65299293 (stale) Mirror 17: 0x8afb4ba6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ee2a: skipped 000621 1787785117.015661 mapread 0x006beb thru 0x008b28 (0x1f3e bytes) 000622 1787785117.077572 mapwrite 0x034268 thru 0x03bd22 (0x7abb bytes) 000623 1787785117.196963 mapread 0x032813 thru 0x03bd22 (0x9510 bytes) 000624 1787785117.203688 punch from 0x020b50 to 0x028900 (0x7db1 bytes) 000626 1787785117.221768 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bd23): Mirror 8: 0xa793d640 (stale) Mirror 16: 0xf5ff28cf (stale) Mirror 17: 0x16a6ddb0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd23): Mirror 8: 0xa793d640 (stale) Mirror 16: 0xf5ff28cf (stale) Mirror 17: 0x16a6ddb0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd23: skipped 000627 1787785117.572373 mapwrite 0x024117 thru 0x02a1e6 (0x60d0 bytes) 000628 1787785117.613675 punch from 0x0174a5 to 0x0238af (0xc40b bytes) 000629 1787785117.619232 punch from 0x022bfe to 0x02b54b (0x894e bytes) 000630 1787785117.623021 read 0x011eb6 thru 0x021743 (0xf88e bytes) 000631 1787785117.641024 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bd23): Mirror 8: 0xa793d640 (stale) Mirror 17: 0x16a6ddb0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd23): Mirror 8: 0xa793d640 (stale) Mirror 17: 0x16a6ddb0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd23: skipped 000632 1787785117.920402 punch from 0x033254 to 0x03bd22 (0x8acf bytes) 000633 1787785117.931664 trunc from 0x00325f to 0x00f956 (0xc6f8 bytes) 000635 1787785117.937536 punch from 0x000d4d to 0x0072c7 (0x657b bytes) 000637 1787785117.942458 punch from 0x0196c8 to 0x01fe70 (0x67a9 bytes) 000638 1787785117.950255 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bd23): Mirror 17: 0x16a6ddb0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd23): Mirror 17: 0x16a6ddb0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd23: skipped 000639 1787785118.325141 write 0x002e22 thru 0x006e90 (0x406f bytes) 000640 1787785118.382147 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) 000641 1787785118.615625 trunc from 0x03bd23 to 0x0216f8 (0x1a62a bytes) 000642 1787785118.648489 punch from 0x009f2a to 0x0175b0 (0xd687 bytes) 000643 1787785118.653400 write 0x032702 thru 0x03ffff (0xd8fe bytes) 000645 1787785118.659134 fallocate 0x0215fe thru 0x0302a7 (0xecaa bytes) 000647 1787785118.675246 mapwrite 0x02f5d2 thru 0x036922 (0x7351 bytes) 000648 1787785118.728702 write 0x019a27 thru 0x027359 (0xd933 bytes) 000649 1787785118.745794 trunc from 0x040000 to 0x020d66 (0x1f299 bytes) 000650 1787785118.763788 trunc from 0x00c7fd to 0x012c31 (0x6435 bytes) 000652 1787785118.771030 fallocate 0x039779 thru 0x03ffff (0x6887 bytes) 000653 1787785118.775325 write 0x03a5da thru 0x03ffff (0x5a26 bytes) 000655 1787785118.779271 read 0x026cea thru 0x026e5f (0x176 bytes) 000656 1787785118.784313 punch from 0x0250ff to 0x0329ab (0xd8ad bytes) 000657 1787785118.788976 read 0x012436 thru 0x01a8b9 (0x8484 bytes) 000658 1787785118.799589 write 0x001e00 thru 0x002d57 (0xf58 bytes) 000659 1787785118.800436 mapwrite 0x022e23 thru 0x02e36c (0xb54a bytes) 000661 1787785118.819603 mapwrite 0x015e38 thru 0x017ffc (0x21c5 bytes) 000662 1787785118.835329 read 0x039fe6 thru 0x03e5d1 (0x45ec bytes) 000663 1787785118.835934 write 0x029af5 thru 0x037076 (0xd582 bytes) 000664 1787785118.837260 punch from 0x00080e to 0x00f39e (0xeb91 bytes) 000666 1787785118.845135 mapread 0x023765 thru 0x025a42 (0x22de bytes) 000668 1787785118.848209 write 0x014433 thru 0x014788 (0x356 bytes) 000669 1787785118.849553 mapread 0x023104 thru 0x02d3ef (0xa2ec bytes) 000670 1787785118.850821 write 0x029906 thru 0x02c474 (0x2b6f bytes) 000671 1787785118.861839 MIRROR_EXTEND to 2 mirrors 000672 1787785119.673563 mapread 0x00a195 thru 0x00e229 (0x4095 bytes) 000673 1787785119.693372 trunc from 0x0022f7 to 0x00c9f1 (0xa6fb bytes) 000674 1787785119.748326 trunc from 0x031335 to 0x037b0b (0x67d7 bytes) 000675 1787785119.760680 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) 000677 1787785119.881594 trunc from 0x01173d to 0x013b31 (0x23f5 bytes) 000678 1787785119.885654 trunc from 0x008fb1 to 0x0146e7 (0xb737 bytes) 000680 1787785119.892225 fallocate 0x03dfd9 thru 0x03eb44 (0xb6c bytes) 000681 1787785119.897790 write 0x03446e thru 0x03ffff (0xbb92 bytes) 000682 1787785119.909125 read 0x0320ac thru 0x037798 (0x56ed bytes) 000683 1787785119.913295 read 0x00b0a0 thru 0x01613f (0xb0a0 bytes) 000685 1787785119.933794 MIRROR_EXTEND to 2 mirrors 000686 1787785120.612474 punch from 0x00346b to 0x003b64 (0x6fa bytes) 000687 1787785120.653038 trunc from 0x03815f to 0x03ffff (0x7ea1 bytes) 000688 1787785120.659397 read 0x02fd93 thru 0x03668f (0x68fd bytes) 000689 1787785120.671752 write 0x0189ac thru 0x0284c5 (0xfb1a bytes) 000690 1787785120.691689 fallocate 0x012303 thru 0x01980a (0x7508 bytes) 000691 1787785120.698738 mapread 0x0153eb thru 0x0167ec (0x1402 bytes) 000692 1787785120.710068 mapwrite 0x01aa80 thru 0x025daf (0xb330 bytes) 000693 1787785120.729026 trunc from 0x02b843 to 0x0336b1 (0x7e6f bytes) 000694 1787785120.737237 MIRROR_RESYNC 2 mirrors 000695 1787785121.346564 MIRROR_EXTEND to 3 mirrors 000696 1787785122.041376 mapwrite 0x03df3c thru 0x03ffff (0x20c4 bytes) 000698 1787785122.133624 punch from 0x020f6b to 0x02d575 (0xc60b bytes) 000699 1787785122.137840 read 0x0182bc thru 0x0262fb (0xe040 bytes) 000700 1787785122.163768 fallocate 0x029730 thru 0x030cf4 (0x75c5 bytes) 000701 1787785122.190863 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf6c386cc (stale) Mirror 3: 0xf6c386cc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8a108cb5 Mirror 4: 0x8a108cb5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000702 1787785123.383868 trunc from 0x029452 to 0x02a1a4 (0xd53 bytes) 000703 1787785123.469255 mapread 0x037b01 thru 0x03ffff (0x84ff bytes) 000704 1787785123.509101 mapwrite 0x01a475 thru 0x0204e7 (0x6073 bytes) 000705 1787785123.546394 mapread 0x030a8f thru 0x035536 (0x4aa8 bytes) 000706 1787785123.562679 trunc from 0x0383a9 to 0x03f210 (0x6e68 bytes) 000707 1787785123.567570 mapwrite 0x00249a thru 0x008fda (0x6b41 bytes) 000708 1787785123.593719 read 0x008b2b thru 0x01293c (0x9e12 bytes) 000709 1787785123.604640 mapread 0x011168 thru 0x0162d8 (0x5171 bytes) 000710 1787785123.607450 trunc from 0x040000 to 0x00ea24 (0x315db bytes) 000711 1787785123.700608 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xea25): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xea25): Mirror 2: 0xa6d684b (stale) Mirror 3: 0xa6d684b (stale) Mirror 4: 0xa6d684b (stale) CRC-32 checksum value for chunk [0, 0xea25): Mirror 1: 0xbd384196 Mirror 5: 0xbd384196 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xea25: skipped 000712 1787785124.594841 write 0x001ca7 thru 0x00c579 (0xa8d3 bytes) 000713 1787785124.704169 trunc from 0x00ea25 to 0x02cd82 (0x1e35e bytes) 000714 1787785124.742552 punch from 0x0042f0 to 0x00f02d (0xad3e bytes) 000715 1787785124.755247 mapwrite 0x018cae thru 0x026087 (0xd3da bytes) 000717 1787785124.840566 write 0x01be51 thru 0x01d0c2 (0x1272 bytes) 000718 1787785124.841518 mapwrite 0x02dc46 thru 0x03bbcb (0xdf86 bytes) 000719 1787785124.948022 mapread 0x025654 thru 0x02960d (0x3fba bytes) 000720 1787785124.959204 MIRROR_RESYNC 5 mirrors 000721 1787785126.457038 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) 000722 1787785126.730700 punch from 0x032de1 to 0x03bbcb (0x8deb bytes) 000723 1787785126.788337 mapread 0x00f390 thru 0x01bb72 (0xc7e3 bytes) 000724 1787785126.816260 trunc from 0x03bbcc to 0x02e77a (0xd451 bytes) 000725 1787785126.837717 trunc from 0x02e77b to 0x025c3b (0x8b3f bytes) 000726 1787785126.859024 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x25c3c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25c3c): Mirror 2: 0x32aa2cb1 (stale) Mirror 3: 0x32aa2cb1 (stale) Mirror 5: 0x32aa2cb1 (stale) CRC-32 checksum value for chunk [0, 0x25c3c): Mirror 1: 0x32aa2cb1 Mirror 6: 0x32aa2cb1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25c3c: skipped 000727 1787785127.721783 trunc from 0x025c3c to 0x01f02d (0x6c0e bytes) 000728 1787785127.791786 fallocate 0x013b2f thru 0x02374d (0xfc1f bytes) 000729 1787785127.803610 punch from 0x00f132 to 0x0133ec (0x42bb bytes) 000730 1787785127.808454 trunc from 0x013b02 to 0x01c836 (0x8d35 bytes) 000731 1787785127.835568 trunc from 0x01f02e to 0x02a453 (0xb426 bytes) 000732 1787785127.886319 punch from 0x018867 to 0x01e950 (0x60ea bytes) 000733 1787785127.913274 MIRROR_RESYNC 5 mirrors 000736 1787785129.042552 trunc from 0x023a3d to 0x0293d8 (0x599c bytes) 000737 1787785129.126979 trunc from 0x02a454 to 0x03b675 (0x11222 bytes) 000738 1787785129.152890 write 0x01dbde thru 0x01fe79 (0x229c bytes) 000739 1787785129.183285 trunc from 0x02934a to 0x02a129 (0xde0 bytes) 000740 1787785129.196275 write 0x01147b thru 0x017597 (0x611d bytes) 000743 1787785129.242312 MIRROR_RESYNC 5 mirrors 000744 1787785131.091994 trunc from 0x03b676 to 0x01995e (0x21d17 bytes) 000745 1787785131.147060 fallocate 0x030ec7 thru 0x03cbd3 (0xbd0d bytes) 000746 1787785131.153462 mapwrite 0x025b04 thru 0x025e76 (0x373 bytes) 000747 1787785131.189360 fallocate 0x03892f thru 0x03a150 (0x1822 bytes) 000748 1787785131.196264 fallocate 0x03364e thru 0x034c69 (0x161c bytes) 000749 1787785131.201489 trunc from 0x018419 to 0x01c9b3 (0x459b bytes) 000750 1787785131.206227 write 0x00e22c thru 0x018829 (0xa5fe bytes) 000751 1787785131.215725 trunc from 0x03cbd4 to 0x027e65 (0x14d6e bytes) 000752 1787785131.241477 mapwrite 0x009876 thru 0x01383e (0x9fc9 bytes) 000753 1787785131.272953 write 0x022171 thru 0x022340 (0x1d0 bytes) 000754 1787785131.278887 punch from 0x0130bc to 0x022081 (0xefc6 bytes) 000755 1787785131.290447 punch from 0x0154cc to 0x01558c (0xc1 bytes) 000756 1787785131.296333 fallocate 0x015205 thru 0x025151 (0xff4d bytes) 000758 1787785131.311358 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x27e66): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27e66): Mirror 2: 0x10eea9ec (stale) Mirror 3: 0x10eea9ec (stale) Mirror 5: 0x10eea9ec (stale) Mirror 6: 0x10eea9ec (stale) CRC-32 checksum value for chunk [0, 0x27e66): Mirror 1: 0x1dfd2932 Mirror 7: 0x1dfd2932 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27e66: skipped 000759 1787785132.201257 mapwrite 0x03904d thru 0x03ffff (0x6fb3 bytes) 000760 1787785132.364571 write 0x032ce2 thru 0x03caf7 (0x9e16 bytes) 000761 1787785132.403850 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x6e104776 (stale) Mirror 3: 0x6e104776 (stale) Mirror 5: 0x6e104776 (stale) Mirror 6: 0x6e104776 (stale) Mirror 7: 0x1d224874 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xafa69e15 Mirror 8: 0xafa69e15 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000762 1787785133.693926 read 0x029507 thru 0x035617 (0xc111 bytes) 000763 1787785133.701839 fallocate 0x00728d thru 0x00da85 (0x67f9 bytes) 000764 1787785133.740275 mapwrite 0x03b078 thru 0x03ffff (0x4f88 bytes) 000765 1787785133.782889 read 0x03bd67 thru 0x03ffff (0x4299 bytes) 000766 1787785133.784011 mapread 0x00503f thru 0x00c38d (0x734f bytes) 000767 1787785133.796153 mapwrite 0x01a03b thru 0x01ce3c (0x2e02 bytes) 000768 1787785133.815844 punch from 0x03be33 to 0x03ffff (0x41cd bytes) 000769 1787785133.825800 read 0x01f804 thru 0x028e09 (0x9606 bytes) 000770 1787785133.826404 read 0x02a27e thru 0x0354f6 (0xb279 bytes) 000771 1787785133.826992 mapwrite 0x00c0dd thru 0x00d7fe (0x1722 bytes) 000772 1787785133.854047 write 0x01b795 thru 0x01e34f (0x2bbb bytes) 000774 1787785133.866333 punch from 0x01cee4 to 0x022ff9 (0x6116 bytes) 000776 1787785133.884527 mapread 0x03f013 thru 0x03ffff (0xfed bytes) 000777 1787785133.905304 fallocate 0x001dc9 thru 0x008b9a (0x6dd2 bytes) 000778 1787785133.914090 punch from 0x031cf9 to 0x037ebc (0x61c4 bytes) 000779 1787785133.921879 trunc from 0x040000 to 0x006880 (0x3977f bytes) 000781 1787785133.953770 trunc from 0x006881 to 0x0226d8 (0x1be58 bytes) 000782 1787785133.975778 write 0x028c2b thru 0x0364ea (0xd8c0 bytes) 000783 1787785133.982835 punch from 0x01662c to 0x01be30 (0x5805 bytes) 000784 1787785133.990830 mapread 0x02d23c thru 0x0364ea (0x92af bytes) 000785 1787785133.993891 mapwrite 0x03d99a thru 0x03ffff (0x2666 bytes) 000786 1787785134.109205 read 0x01f005 thru 0x02ae3e (0xbe3a bytes) 000787 1787785134.127253 punch from 0x00710d to 0x00e73f (0x7633 bytes) 000788 1787785134.131273 punch from 0x012f3d to 0x01b512 (0x85d6 bytes) 000789 1787785134.136652 trunc from 0x040000 to 0x018b25 (0x274da bytes) 000790 1787785134.161362 fallocate 0x025087 thru 0x0266e0 (0x165a bytes) 000791 1787785134.185967 MIRROR_RESYNC 7 mirrors 000792 1787785135.452302 mapwrite 0x036ec2 thru 0x03ffff (0x913e bytes) 000793 1787785135.541521 punch from 0x013b66 to 0x018b58 (0x4ff3 bytes) 000794 1787785135.550313 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x659ea605 (stale) Mirror 3: 0x659ea605 (stale) Mirror 5: 0x659ea605 (stale) Mirror 6: 0x659ea605 (stale) Mirror 8: 0x659ea605 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x659ea605 (stale) Mirror 3: 0x659ea605 (stale) Mirror 5: 0x659ea605 (stale) Mirror 6: 0x659ea605 (stale) Mirror 8: 0x659ea605 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000795 1787785135.898346 trunc from 0x035e5c to 0x03ab66 (0x4d0b bytes) 000796 1787785135.910357 mapwrite 0x02d6f4 thru 0x037543 (0x9e50 bytes) 000798 1787785135.955508 mapwrite 0x02b6bd thru 0x02ca4b (0x138f bytes) 000799 1787785135.969505 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x659ea605 (stale) Mirror 5: 0x659ea605 (stale) Mirror 6: 0x659ea605 (stale) Mirror 8: 0x659ea605 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x659ea605 (stale) Mirror 5: 0x659ea605 (stale) Mirror 6: 0x659ea605 (stale) Mirror 8: 0x659ea605 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000800 1787785136.399556 mapwrite 0x009ff4 thru 0x018784 (0xe791 bytes) 000801 1787785136.488951 trunc from 0x040000 to 0x03de0a (0x21f5 bytes) 000802 1787785136.515322 write 0x035814 thru 0x03ffff (0xa7ec bytes) 000803 1787785136.527872 read 0x02ee9e thru 0x03a980 (0xbae3 bytes) 000805 1787785136.539397 punch from 0x03a5bf to 0x03b158 (0xb9a bytes) 000806 1787785136.561291 trunc from 0x03fefe to 0x03ffff (0x102 bytes) 000807 1787785136.565398 mapwrite 0x028d92 thru 0x0350b2 (0xc321 bytes) 000808 1787785136.622202 trunc from 0x0296e5 to 0x029cf0 (0x60c bytes) 000809 1787785136.643780 mapread 0x000556 thru 0x0009e6 (0x491 bytes) 000810 1787785136.653262 write 0x013ac8 thru 0x017666 (0x3b9f bytes) 000811 1787785136.654751 fallocate 0x02d8bd thru 0x03b020 (0xd764 bytes) 000812 1787785136.658761 punch from 0x03cc29 to 0x03ffff (0x33d7 bytes) 000814 1787785136.667888 mapwrite 0x0258ad thru 0x02f08b (0x97df bytes) 000815 1787785136.726869 trunc from 0x040000 to 0x03caad (0x3552 bytes) 000816 1787785136.746648 MIRROR_RESYNC 5 mirrors 000817 1787785137.915905 trunc from 0x032517 to 0x03a695 (0x817f bytes) 000818 1787785137.947491 mapwrite 0x013eae thru 0x01f4be (0xb611 bytes) 000819 1787785138.006334 mapwrite 0x00eed5 thru 0x01dc0c (0xed38 bytes) 000820 1787785138.029639 punch from 0x006c3c to 0x01397d (0xcd42 bytes) 000821 1787785138.035125 write 0x00081f thru 0x00beb0 (0xb692 bytes) 000822 1787785138.044963 punch from 0x02cbcb to 0x037b2f (0xaf65 bytes) 000823 1787785138.049400 trunc from 0x033ba2 to 0x03a2d5 (0x6734 bytes) 000824 1787785138.054160 write 0x00fd9c thru 0x01682d (0x6a92 bytes) 000825 1787785138.060166 fallocate 0x03633f thru 0x03ffff (0x9cc1 bytes) 000826 1787785138.065711 punch from 0x035bca to 0x03ea56 (0x8e8d bytes) 000827 1787785138.073519 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x80761c4e (stale) Mirror 5: 0x80761c4e (stale) Mirror 8: 0x80761c4e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x80761c4e (stale) Mirror 5: 0x80761c4e (stale) Mirror 8: 0x80761c4e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000828 1787785138.367363 read 0x01dd21 thru 0x02d6b8 (0xf998 bytes) 000829 1787785138.385232 fallocate 0x032db0 thru 0x03ffff (0xd250 bytes) 000830 1787785138.389823 trunc from 0x02dd1a to 0x035e4a (0x8131 bytes) 000831 1787785138.397157 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x80761c4e (stale) Mirror 8: 0x80761c4e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x80761c4e (stale) Mirror 8: 0x80761c4e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000833 1787785138.711169 trunc from 0x040000 to 0x0041b4 (0x3be4b bytes) 000834 1787785138.736890 mapwrite 0x03c855 thru 0x03d1fe (0x9aa bytes) 000835 1787785138.776030 punch from 0x0022b7 to 0x004dff (0x2b49 bytes) 000836 1787785138.783857 trunc from 0x03d1ff to 0x002776 (0x3aa88 bytes) 000837 1787785138.801190 read 0x000d18 thru 0x002776 (0x1a5f bytes) 000838 1787785138.808350 read 0x0026d6 thru 0x002776 (0xa1 bytes) 000839 1787785138.809087 mapwrite 0x0277b6 thru 0x03037f (0x8bca bytes) 000840 1787785138.848503 fallocate 0x00a5a0 thru 0x00d09d (0x2afe bytes) 000841 1787785138.853362 mapread 0x013a49 thru 0x015cda (0x2292 bytes) 000842 1787785138.855288 mapwrite 0x00efa8 thru 0x0176d3 (0x872c bytes) 000843 1787785138.868531 fallocate 0x032837 thru 0x03ed6a (0xc534 bytes) 000844 1787785138.872394 trunc from 0x030380 to 0x01bab8 (0x148c7 bytes) 000845 1787785138.888309 write 0x00bad8 thru 0x013653 (0x7b7c bytes) 000846 1787785138.889736 fallocate 0x036507 thru 0x038e3d (0x2937 bytes) 000847 1787785138.894544 trunc from 0x038e3e to 0x016efd (0x21f40 bytes) 000848 1787785138.911389 punch from 0x00fefb to 0x016efd (0x7003 bytes) 000849 1787785138.922905 trunc from 0x016efe to 0x00adc5 (0xc138 bytes) 000850 1787785138.947396 mapwrite 0x024347 thru 0x029ce3 (0x599d bytes) 000851 1787785139.015861 punch from 0x00286b to 0x0036a2 (0xe38 bytes) 000852 1787785139.021287 trunc from 0x002684 to 0x00be30 (0x97ad bytes) 000854 1787785139.027075 write 0x0082cf thru 0x0121dd (0x9f0f bytes) 000855 1787785139.035920 mapread 0x010b01 thru 0x011741 (0xc41 bytes) 000856 1787785139.037298 mapread 0x016c3a thru 0x01747c (0x843 bytes) 000857 1787785139.049506 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x29ce4): Mirror 5: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29ce4): Mirror 5: 0xe403eeb5 (stale) Mirror 8: 0xe403eeb5 (stale) CRC-32 checksum value for chunk [0, 0x29ce4): Mirror 1: 0xa1e423d4 Mirror 9: 0xa1e423d4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29ce4: skipped 000858 1787785139.909311 mapwrite 0x035da8 thru 0x03fa65 (0x9cbe bytes) 000859 1787785140.030546 punch from 0x004082 to 0x00e9b5 (0xa934 bytes) 000860 1787785140.037253 punch from 0x0276c4 to 0x029347 (0x1c84 bytes) 000861 1787785140.047780 trunc from 0x03fa66 to 0x027f9b (0x17aca bytes) 000862 1787785140.070312 punch from 0x004fe5 to 0x01213a (0xd156 bytes) 000863 1787785140.077025 write 0x027136 thru 0x034b6e (0xda39 bytes) 000864 1787785140.090491 MIRROR_RESYNC 4 mirrors 000865 1787785141.035226 write 0x01cbac thru 0x02597e (0x8dd3 bytes) 000866 1787785141.069602 mapread 0x0270de thru 0x02854d (0x1470 bytes) 000867 1787785141.079790 mapread 0x028868 thru 0x034b6e (0xc307 bytes) 000868 1787785141.094027 write 0x024540 thru 0x025da3 (0x1864 bytes) 000869 1787785141.095452 mapwrite 0x02b93d thru 0x035457 (0x9b1b bytes) 000870 1787785141.135107 trunc from 0x027ce2 to 0x030c1f (0x8f3e bytes) 000871 1787785141.144279 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35458): Mirror 8: 0x52e565fc (stale) Mirror 9: 0x52e565fc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35458): Mirror 8: 0x52e565fc (stale) Mirror 9: 0x52e565fc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35458: skipped 000872 1787785141.380502 trunc from 0x02d567 to 0x035457 (0x7ef1 bytes) 000873 1787785141.384939 write 0x00afed thru 0x016a53 (0xba67 bytes) 000874 1787785141.399977 trunc from 0x035458 to 0x0070eb (0x2e36c bytes) 000875 1787785141.417066 trunc from 0x004d50 to 0x0070eb (0x239c bytes) 000877 1787785141.421584 punch from 0x005983 to 0x0070eb (0x1769 bytes) 000879 1787785141.425812 trunc from 0x0070ec to 0x039862 (0x32777 bytes) 000881 1787785141.439222 write 0x000790 thru 0x0073d8 (0x6c49 bytes) 000882 1787785141.448141 fallocate 0x026c10 thru 0x02ffcb (0x93bc bytes) 000883 1787785141.452014 punch from 0x02be67 to 0x02c76f (0x909 bytes) 000884 1787785141.459282 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x39863): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39863): Mirror 8: 0x811469c0 (stale) Mirror 9: 0x811469c0 (stale) CRC-32 checksum value for chunk [0, 0x39863): Mirror 1: 0x1c18e465 Mirror 10: 0x1c18e465 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39863: skipped 000885 1787785142.078933 mapwrite 0x034860 thru 0x036d85 (0x2526 bytes) 000886 1787785142.214688 read 0x00e321 thru 0x00e810 (0x4f0 bytes) 000887 1787785142.223339 punch from 0x00fa0c to 0x016f59 (0x754e bytes) 000888 1787785142.229097 read 0x0033b9 thru 0x01076e (0xd3b6 bytes) 000889 1787785142.258037 write 0x03f763 thru 0x03ffff (0x89d bytes) 000890 1787785142.267791 punch from 0x0179d9 to 0x021496 (0x9abe bytes) 000891 1787785142.276855 read 0x03a4c1 thru 0x03ffff (0x5b3f bytes) 000892 1787785142.302858 fallocate 0x02e0fc thru 0x034491 (0x6396 bytes) 000893 1787785142.317077 read 0x0026cf thru 0x00f7d1 (0xd103 bytes) 000894 1787785142.317812 read 0x014af7 thru 0x0193af (0x48b9 bytes) 000895 1787785142.318339 punch from 0x030a3b to 0x03a3d6 (0x999c bytes) 000897 1787785142.328673 fallocate 0x003465 thru 0x009477 (0x6013 bytes) 000898 1787785142.339077 trunc from 0x00a82d to 0x014ed5 (0xa6a9 bytes) 000899 1787785142.354117 mapread 0x03a26c thru 0x03ffff (0x5d94 bytes) 000900 1787785142.367198 MIRROR_RESYNC 4 mirrors 000901 1787785142.990846 MIRROR_EXTEND to 5 mirrors 000903 1787785143.611251 mapwrite 0x0211d8 thru 0x0296aa (0x84d3 bytes) 000904 1787785143.732356 fallocate 0x011942 thru 0x013a47 (0x2106 bytes) 000905 1787785143.747983 fallocate 0x0396cf thru 0x03bdf2 (0x2724 bytes) 000906 1787785143.753280 mapwrite 0x01379e thru 0x01479e (0x1001 bytes) 000907 1787785143.802998 trunc from 0x040000 to 0x034d77 (0xb288 bytes) 000908 1787785143.840656 read 0x01546c thru 0x01ed61 (0x98f6 bytes) 000909 1787785143.841279 punch from 0x029c0a to 0x030077 (0x646e bytes) 000910 1787785143.848670 mapwrite 0x034e6c thru 0x036fd5 (0x216a bytes) 000911 1787785143.897929 mapwrite 0x022ab9 thru 0x02d8e2 (0xae2a bytes) 000912 1787785143.931004 mapread 0x028bce thru 0x033f23 (0xb356 bytes) 000913 1787785143.939041 MIRROR_RESYNC 5 mirrors 000914 1787785145.160756 fallocate 0x03ae6f thru 0x03ffff (0x5191 bytes) 000915 1787785145.196363 fallocate 0x021e7a thru 0x02a045 (0x81cc bytes) 000916 1787785145.200816 trunc from 0x028244 to 0x028661 (0x41e bytes) 000917 1787785145.204780 write 0x03522f thru 0x0366da (0x14ac bytes) 000918 1787785145.212375 mapread 0x016e75 thru 0x0198f1 (0x2a7d bytes) 000919 1787785145.227125 trunc from 0x040000 to 0x030a91 (0xf56e bytes) 000921 1787785145.244375 trunc from 0x030a92 to 0x005e55 (0x2ac3c bytes) 000922 1787785145.257927 read 0x004614 thru 0x005e55 (0x1842 bytes) 000923 1787785145.263213 mapread 0x0025f5 thru 0x005e55 (0x3861 bytes) 000924 1787785145.268610 read 0x001140 thru 0x001ff0 (0xeb1 bytes) 000925 1787785145.272760 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x5e56): Mirror 9: 0xd86664f3 (stale) Mirror 10: 0xd86664f3 (stale) Mirror 11: 0xd86664f3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5e56): Mirror 9: 0xd86664f3 (stale) Mirror 10: 0xd86664f3 (stale) Mirror 11: 0xd86664f3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5e56: skipped 000926 1787785145.522564 mapwrite 0x005b2b thru 0x00d900 (0x7dd6 bytes) 000927 1787785145.623258 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd901): Mirror 10: 0xab8ccf14 (stale) Mirror 11: 0xab8ccf14 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd901): Mirror 10: 0xab8ccf14 (stale) Mirror 11: 0xab8ccf14 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd901: skipped 000928 1787785146.009216 read 0x004acd thru 0x00d900 (0x8e34 bytes) 000929 1787785146.021215 read 0x001fbe thru 0x00d900 (0xb943 bytes) 000930 1787785146.028846 punch from 0x0092de to 0x00d900 (0x4623 bytes) 000931 1787785146.036870 fallocate 0x028bf9 thru 0x029162 (0x56a bytes) 000932 1787785146.046977 MIRROR_RESYNC 3 mirrors 000933 1787785146.744316 punch from 0x00b26f to 0x00d900 (0x2692 bytes) 000934 1787785146.812965 fallocate 0x020f5e thru 0x0241e3 (0x3286 bytes) 000935 1787785146.818990 read 0x00d359 thru 0x00d900 (0x5a8 bytes) 000936 1787785146.831117 MIRROR_RESYNC 3 mirrors 000937 1787785147.525299 mapwrite 0x00a91f thru 0x0131c8 (0x88aa bytes) 000938 1787785147.633465 write 0x025cec thru 0x030d60 (0xb075 bytes) 000939 1787785147.636039 punch from 0x0033b0 to 0x01213b (0xed8c bytes) 000940 1787785147.647504 mapwrite 0x00c961 thru 0x019053 (0xc6f3 bytes) 000941 1787785147.694200 mapwrite 0x02c8cb thru 0x033d2d (0x7463 bytes) 000942 1787785147.756864 punch from 0x0335de to 0x033d2d (0x750 bytes) 000943 1787785147.763603 trunc from 0x01350c to 0x018993 (0x5488 bytes) 000944 1787785147.773140 mapread 0x030abd thru 0x033d2d (0x3271 bytes) 000946 1787785147.780217 write 0x0247cc thru 0x02bd1a (0x754f bytes) 000947 1787785147.790167 fallocate 0x03cad3 thru 0x03ffff (0x352d bytes) 000948 1787785147.797788 punch from 0x027f12 to 0x02d07a (0x5169 bytes) 000949 1787785147.813010 read 0x0079f6 thru 0x00c88f (0x4e9a bytes) 000951 1787785147.817394 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xbdb6586d (stale) Mirror 11: 0xbdb6586d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb97453bb Mirror 12: 0xb97453bb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000952 1787785148.607459 fallocate 0x037483 thru 0x038a23 (0x15a1 bytes) 000953 1787785148.647387 trunc from 0x040000 to 0x036307 (0x9cf8 bytes) 000954 1787785148.671867 punch from 0x02b89c to 0x0327be (0x6f23 bytes) 000955 1787785148.682692 MIRROR_RESYNC 4 mirrors 000956 1787785150.049917 trunc from 0x036308 to 0x00eaf2 (0x27815 bytes) 000957 1787785150.088384 fallocate 0x0305b7 thru 0x0393b9 (0x8e03 bytes) 000958 1787785150.093563 read 0x000720 thru 0x007c11 (0x74f2 bytes) 000959 1787785150.101076 fallocate 0x021d4a thru 0x0298ae (0x7b65 bytes) 000960 1787785150.105666 fallocate 0x030d6f thru 0x032b3d (0x1dcf bytes) 000962 1787785150.110262 mapread 0x02d729 thru 0x032b3d (0x5415 bytes) 000963 1787785150.129115 write 0x007f37 thru 0x009ef2 (0x1fbc bytes) 000964 1787785150.133488 punch from 0x031dbe to 0x032b3d (0xd80 bytes) 000965 1787785150.136831 mapwrite 0x0290c3 thru 0x033f6f (0xaead bytes) 000966 1787785150.170711 write 0x016a31 thru 0x0250b8 (0xe688 bytes) 000967 1787785150.183824 mapwrite 0x00cf21 thru 0x01aa1b (0xdafb bytes) 000969 1787785150.234254 MIRROR_RESYNC 4 mirrors 000970 1787785150.882923 mapwrite 0x005ff6 thru 0x00f2d4 (0x92df bytes) 000971 1787785150.955940 punch from 0x01cac8 to 0x029313 (0xc84c bytes) 000972 1787785150.960352 trunc from 0x033f70 to 0x019364 (0x1ac0b bytes) 000973 1787785150.992159 trunc from 0x00f230 to 0x019364 (0xa135 bytes) 000974 1787785150.999138 mapread 0x00d8b3 thru 0x0147b4 (0x6f02 bytes) 000976 1787785151.007736 mapread 0x00210c thru 0x01058a (0xe47f bytes) 000977 1787785151.009730 trunc from 0x011a03 to 0x01281a (0xe18 bytes) 000978 1787785151.015465 trunc from 0x019365 to 0x023adf (0xa77b bytes) 000979 1787785151.031651 fallocate 0x018adf thru 0x0239f7 (0xaf19 bytes) 000980 1787785151.040265 fallocate 0x01f217 thru 0x020801 (0x15eb bytes) 000981 1787785151.050542 mapread 0x0075b3 thru 0x00bdad (0x47fb bytes) 000982 1787785151.054816 punch from 0x009bc7 to 0x010d72 (0x71ac bytes) 000983 1787785151.061573 mapread 0x0107ec thru 0x019911 (0x9126 bytes) 000984 1787785151.093261 trunc from 0x023ae0 to 0x015910 (0xe1cf bytes) 000985 1787785151.113893 write 0x029362 thru 0x02aed2 (0x1b71 bytes) 000986 1787785151.115364 trunc from 0x022dd4 to 0x02aed2 (0x80ff bytes) 000987 1787785151.123649 write 0x019a59 thru 0x025c81 (0xc229 bytes) 000988 1787785151.131931 trunc from 0x013f5c to 0x021c82 (0xdd27 bytes) 000989 1787785151.143360 mapwrite 0x028e9e thru 0x02ff58 (0x70bb bytes) 000990 1787785151.195368 fallocate 0x0000ea thru 0x00f6a9 (0xf5c0 bytes) 000991 1787785151.207776 punch from 0x0117af to 0x0154a5 (0x3cf7 bytes) 000992 1787785151.211751 read 0x014b97 thru 0x022168 (0xd5d2 bytes) 000993 1787785151.262495 trunc from 0x00d23b to 0x01c97f (0xf745 bytes) 000994 1787785151.271979 write 0x01e192 thru 0x02832d (0xa19c bytes) 000995 1787785151.276350 write 0x02a31c thru 0x031a3e (0x7723 bytes) 000996 1787785151.287233 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x43:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31a3f): Mirror 10: 0x70808e1e (stale) Mirror 11: 0x70808e1e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31a3f): Mirror 10: 0x70808e1e (stale) Mirror 11: 0x70808e1e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31a3f: skipped 000997 1787785151.673360 mapread 0x0212b1 thru 0x02ef8d (0xdcdd bytes) 000998 1787785151.711454 trunc from 0x00f3bf to 0x0192c4 (0x9f06 bytes) 000999 1787785151.721042 MIRROR_RESYNC 3 mirrors All operations completed A-OK!