== sanity-flr test 70a: flr mode fsx test ================ 10:14:54 (1789049694) Seed set to 9696 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000003 1789049696.623153 write 0x02221c thru 0x02e41d (0xc202 bytes) 000006 1789049696.627924 mapwrite 0x01c551 thru 0x0250a3 (0x8b53 bytes) 000008 1789049696.744855 write 0x0312d2 thru 0x034b03 (0x3832 bytes) 000009 1789049696.746504 punch from 0x001672 to 0x00d194 (0xbb23 bytes) 000011 1789049696.759758 punch from 0x00f6fd to 0x00ffaa (0x8ae bytes) 000014 1789049696.766704 punch from 0x0281f7 to 0x02c34d (0x4157 bytes) 000015 1789049696.771399 punch from 0x007a03 to 0x00a792 (0x2d90 bytes) 000018 1789049696.777233 mapwrite 0x020117 thru 0x0213e8 (0x12d2 bytes) 000021 1789049696.812411 punch from 0x017cc1 to 0x0211d5 (0x9515 bytes) 000022 1789049696.817785 read 0x0116d9 thru 0x01e7e4 (0xd10c bytes) 000023 1789049696.828574 punch from 0x0131a7 to 0x0143c0 (0x121a bytes) 000024 1789049696.832961 mapwrite 0x021552 thru 0x02406a (0x2b19 bytes) 000026 1789049696.896548 mapwrite 0x0052ff thru 0x00e100 (0x8e02 bytes) truncating to largest ever: 0x1c533 000028 1789049696.964517 trunc from 0x034b04 to 0x01c532 (0x185d1 bytes) 000029 1789049696.987976 MIRROR_EXTEND to 2 mirrors 000030 1789049698.032398 read 0x007a9f thru 0x00bba4 (0x4106 bytes) 000033 1789049698.116577 write 0x028882 thru 0x02f252 (0x69d1 bytes) 000034 1789049698.222215 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2f253): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f253): Mirror 2: 0xf333d171 (stale) CRC-32 checksum value for chunk [0, 0x2f253): Mirror 1: 0xb54b9a62 Mirror 3: 0xb54b9a62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f253: skipped 000036 1789049699.553051 trunc from 0x02f253 to 0x00cb6d (0x226e5 bytes) 000037 1789049699.710639 punch from 0x009745 to 0x00b127 (0x19e3 bytes) 000038 1789049699.717649 punch from 0x000f5c to 0x00a175 (0x921a bytes) 000039 1789049699.722317 mapwrite 0x01a0e3 thru 0x02333b (0x9259 bytes) 000040 1789049699.807881 write 0x012d89 thru 0x020dbd (0xe035 bytes) 000042 1789049699.814552 punch from 0x01cee2 to 0x02333b (0x645a bytes) 000043 1789049699.830275 MIRROR_RESYNC 3 mirrors 000044 1789049700.758182 trunc from 0x02333c to 0x003d25 (0x1f616 bytes) 000046 1789049700.820675 mapwrite 0x0275e9 thru 0x031d88 (0xa7a0 bytes) 000047 1789049700.893197 mapwrite 0x02459a thru 0x02a592 (0x5ff9 bytes) 000050 1789049700.937695 read 0x02e943 thru 0x031d88 (0x3446 bytes) 000053 1789049700.939775 trunc from 0x031d89 to 0x011dd4 (0x1ffb4 bytes) truncating to largest ever: 0x32791 000055 1789049700.956206 trunc from 0x011dd5 to 0x032790 (0x209bc bytes) 000056 1789049700.973007 mapread 0x00f777 thru 0x015989 (0x6213 bytes) 000057 1789049700.990770 mapwrite 0x022801 thru 0x025488 (0x2c88 bytes) 000058 1789049701.044458 read 0x01bd93 thru 0x02715a (0xb3c8 bytes) 000059 1789049701.045219 read 0x0238f2 thru 0x027609 (0x3d18 bytes) 000060 1789049701.049194 punch from 0x029b8e to 0x032790 (0x8c03 bytes) 000061 1789049701.058119 trunc from 0x032791 to 0x032596 (0x1fa bytes) 000064 1789049701.113759 MIRROR_RESYNC 3 mirrors 000065 1789049702.059812 mapread 0x0234f0 thru 0x032596 (0xf0a7 bytes) 000066 1789049702.125201 punch from 0x01ee56 to 0x02b434 (0xc5df bytes) 000068 1789049702.260843 mapread 0x000431 thru 0x00ea84 (0xe654 bytes) 000069 1789049702.278945 punch from 0x020c87 to 0x0308dc (0xfc56 bytes) 000070 1789049702.287291 trunc from 0x032597 to 0x00f737 (0x22e5f bytes) 000071 1789049702.321456 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xf738): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf738): Mirror 2: 0x8c5ff9fb (stale) Mirror 3: 0x8c5ff9fb (stale) CRC-32 checksum value for chunk [0, 0xf738): Mirror 1: 0x8c5ff9fb Mirror 4: 0x8c5ff9fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf738: skipped 000072 1789049703.267721 mapwrite 0x03602e thru 0x03f42c (0x93ff bytes) 000073 1789049703.433360 punch from 0x009f56 to 0x0103bb (0x6466 bytes) 000075 1789049703.447810 mapwrite 0x00a7b4 thru 0x016dda (0xc627 bytes) 000076 1789049703.541332 write 0x022ed9 thru 0x0325c8 (0xf6f0 bytes) 000079 1789049703.553935 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f42d): Mirror 2: 0x9cdeb45d (stale) Mirror 4: 0x45f7b58 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f42d): Mirror 2: 0x9cdeb45d (stale) Mirror 4: 0x45f7b58 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f42d: skipped 000082 1789049703.947729 mapwrite 0x01e4d1 thru 0x02c8ba (0xe3ea bytes) 000083 1789049704.063735 read 0x0198bc thru 0x0262ad (0xc9f2 bytes) 000085 1789049704.065456 mapwrite 0x031acf thru 0x03d770 (0xbca2 bytes) 000086 1789049704.124861 write 0x000215 thru 0x001924 (0x1710 bytes) 000087 1789049704.140309 mapwrite 0x038c5f thru 0x03a9b8 (0x1d5a bytes) 000088 1789049704.210826 trunc from 0x03f42d to 0x01f6aa (0x1fd82 bytes) 000089 1789049704.261654 mapread 0x018f4e thru 0x01f6aa (0x675d bytes) 000090 1789049704.285786 read 0x00665b thru 0x00dbdf (0x7585 bytes) 000091 1789049704.301804 mapwrite 0x034f97 thru 0x03ffff (0xb069 bytes) 000092 1789049704.442885 read 0x000a54 thru 0x008d17 (0x82c4 bytes) 000093 1789049704.443479 mapread 0x031034 thru 0x03a06f (0x903c bytes) 000096 1789049704.447374 punch from 0x00d741 to 0x018888 (0xb148 bytes) 000097 1789049704.453912 mapwrite 0x03a39c thru 0x03b801 (0x1466 bytes) 000098 1789049704.523828 punch from 0x025183 to 0x031fe7 (0xce65 bytes) 000100 1789049704.529769 mapwrite 0x035998 thru 0x03e595 (0x8bfe bytes) 000104 1789049704.589319 punch from 0x0127f6 to 0x020ccb (0xe4d6 bytes) 000105 1789049704.594570 read 0x039708 thru 0x03a018 (0x911 bytes) 000106 1789049704.595201 punch from 0x035d5e to 0x03c3f3 (0x6696 bytes) 000108 1789049704.599984 punch from 0x02b593 to 0x03698f (0xb3fd bytes) 000109 1789049704.604793 trunc from 0x040000 to 0x00ac38 (0x353c7 bytes) 000110 1789049704.623232 punch from 0x005259 to 0x00ac38 (0x59e0 bytes) 000112 1789049704.628820 trunc from 0x00ac39 to 0x01ae83 (0x1024b bytes) 000113 1789049704.667769 read 0x006c6e thru 0x0098d2 (0x2c65 bytes) 000114 1789049704.689252 write 0x02562e thru 0x02aa2d (0x5400 bytes) 000115 1789049704.697945 read 0x00dca4 thru 0x01bfee (0xe34b bytes) 000116 1789049704.717839 mapread 0x00ec3c thru 0x01443a (0x57ff bytes) 000117 1789049704.719678 mapwrite 0x02643a thru 0x02f772 (0x9339 bytes) 000118 1789049704.793151 write 0x0078ea thru 0x010f0c (0x9623 bytes) 000119 1789049704.794472 punch from 0x01de16 to 0x0203bb (0x25a6 bytes) 000120 1789049704.809498 mapwrite 0x018c8a thru 0x023007 (0xa37e bytes) 000121 1789049704.939266 write 0x037cfe thru 0x03b2b0 (0x35b3 bytes) 000122 1789049704.940480 mapwrite 0x0046ba thru 0x006384 (0x1ccb bytes) 000123 1789049704.985937 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b2b1): Mirror 4: 0x7ed02ce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b2b1): Mirror 4: 0x7ed02ce (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b2b1: skipped 000124 1789049705.284640 trunc from 0x03b2b1 to 0x0314cf (0x9de1 bytes) 000125 1789049705.300978 mapwrite 0x03360a thru 0x03566b (0x2062 bytes) 000126 1789049705.383521 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) 000127 1789049705.513669 read 0x01c396 thru 0x028c3c (0xc8a7 bytes) truncating to largest ever: 0x32ecb 000128 1789049705.528747 trunc from 0x03566c to 0x032eca (0x27a1 bytes) 000129 1789049705.559189 read 0x02559d thru 0x027516 (0x1f7a bytes) 000131 1789049705.560340 mapwrite 0x01591e thru 0x023cb9 (0xe39c bytes) 000132 1789049705.638304 mapread 0x023ae0 thru 0x02b734 (0x7c55 bytes) 000134 1789049705.639861 write 0x01adde thru 0x0268f0 (0xbb13 bytes) 000137 1789049705.644547 mapwrite 0x01bf59 thru 0x02411a (0x81c2 bytes) 000139 1789049705.699986 punch from 0x00c8b5 to 0x016bb3 (0xa2ff bytes) 000140 1789049705.705330 punch from 0x009937 to 0x00ec0f (0x52d9 bytes) 000141 1789049705.710425 mapwrite 0x028a70 thru 0x02a183 (0x1714 bytes) 000142 1789049705.752031 mapwrite 0x00e571 thru 0x0102bd (0x1d4d bytes) truncating to largest ever: 0x3a6d0 000144 1789049705.804232 trunc from 0x032ecb to 0x03a6cf (0x7805 bytes) 000146 1789049705.822417 write 0x022d82 thru 0x025d44 (0x2fc3 bytes) 000150 1789049705.826516 trunc from 0x03a6d0 to 0x00e0a6 (0x2c629 bytes) 000151 1789049705.844513 read 0x00568a thru 0x00e0a6 (0x8a1d bytes) 000152 1789049705.855340 punch from 0x003db9 to 0x0095dc (0x5824 bytes) 000153 1789049705.861244 trunc from 0x00e0a7 to 0x010deb (0x2d45 bytes) 000154 1789049705.877539 punch from 0x008c09 to 0x00d4d8 (0x48d0 bytes) 000155 1789049705.884123 mapwrite 0x033ac5 thru 0x03ffff (0xc53b bytes) 000156 1789049706.005818 MIRROR_EXTEND to 2 mirrors 000158 1789049706.893141 write 0x004571 thru 0x00709b (0x2b2b bytes) 000161 1789049707.013794 punch from 0x01c43d to 0x020ebc (0x4a80 bytes) 000162 1789049707.055944 MIRROR_RESYNC 2 mirrors 000163 1789049707.962985 MIRROR_EXTEND to 3 mirrors 000164 1789049709.022422 trunc from 0x040000 to 0x00f910 (0x306ef bytes) 000165 1789049709.146487 read 0x006c2f thru 0x00f910 (0x8ce2 bytes) 000166 1789049709.167015 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xf911): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf911): Mirror 2: 0x3380b778 (stale) Mirror 3: 0x3380b778 (stale) CRC-32 checksum value for chunk [0, 0xf911): Mirror 1: 0x3380b778 Mirror 4: 0x3380b778 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf911: skipped 000168 1789049710.335985 mapwrite 0x0104a5 thru 0x01436f (0x3ecb bytes) 000169 1789049710.554083 read 0x0065e8 thru 0x009607 (0x3020 bytes) 000170 1789049710.562414 punch from 0x000efb to 0x00b2c6 (0xa3cc bytes) 000171 1789049710.571561 trunc from 0x014370 to 0x005f9f (0xe3d0 bytes) 000172 1789049710.595651 write 0x00c9d4 thru 0x0141f6 (0x7823 bytes) 000173 1789049710.598419 read 0x014081 thru 0x0141f6 (0x176 bytes) 000174 1789049710.599635 read 0x003d99 thru 0x00bcb2 (0x7f1a bytes) 000175 1789049710.613217 write 0x024c26 thru 0x02e1b8 (0x9593 bytes) 000176 1789049710.615445 trunc from 0x02e1b9 to 0x016662 (0x17b56 bytes) 000178 1789049710.636553 read 0x008f43 thru 0x010f33 (0x7ff1 bytes) 000180 1789049710.637917 punch from 0x0107d5 to 0x013f28 (0x3754 bytes) 000182 1789049710.658992 write 0x01a06a thru 0x027d30 (0xdcc7 bytes) 000186 1789049710.663494 mapwrite 0x01c7f2 thru 0x027c31 (0xb440 bytes) 000187 1789049710.715411 read 0x024275 thru 0x027d30 (0x3abc bytes) 000188 1789049710.724344 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27d31): Mirror 2: 0x3b02f0a7 (stale) Mirror 3: 0x3b02f0a7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27d31): Mirror 2: 0x3b02f0a7 (stale) Mirror 3: 0x3b02f0a7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27d31: skipped 000189 1789049711.058021 write 0x02b232 thru 0x0302b3 (0x5082 bytes) 000190 1789049711.061174 write 0x035d56 thru 0x03e89b (0x8b46 bytes) 000192 1789049711.063458 trunc from 0x03e89c to 0x024d6b (0x19b30 bytes) 000193 1789049711.084422 mapwrite 0x00f510 thru 0x00ffa1 (0xa92 bytes) 000194 1789049711.182990 punch from 0x003dce to 0x00a545 (0x6778 bytes) 000195 1789049711.189820 mapwrite 0x005a93 thru 0x0089db (0x2f49 bytes) 000196 1789049711.280086 read 0x0139ff thru 0x02056b (0xcb6d bytes) 000197 1789049711.297869 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x24d6c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24d6c): Mirror 2: 0x57e7406a (stale) Mirror 3: 0x57e7406a (stale) CRC-32 checksum value for chunk [0, 0x24d6c): Mirror 1: 0x67f45b7 Mirror 4: 0x67f45b7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24d6c: skipped 000198 1789049712.299779 punch from 0x00264b to 0x005697 (0x304d bytes) 000201 1789049712.430101 write 0x00b3a4 thru 0x00c920 (0x157d bytes) 000202 1789049712.443442 mapwrite 0x0358d2 thru 0x03ebc9 (0x92f8 bytes) 000205 1789049712.584930 trunc from 0x03ebca to 0x00f83e (0x2f38b bytes) 000206 1789049712.606223 write 0x030805 thru 0x03eee5 (0xe6e1 bytes) 000208 1789049712.611060 punch from 0x00482a to 0x008e17 (0x45ee bytes) 000209 1789049712.633652 mapread 0x010a67 thru 0x01f4e6 (0xea80 bytes) 000210 1789049712.663724 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3eee6): Mirror 3: 0x5056b53 (stale) Mirror 4: 0x21e83a08 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eee6): Mirror 3: 0x5056b53 (stale) Mirror 4: 0x21e83a08 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eee6: skipped 000212 1789049713.117346 mapread 0x00965b thru 0x01793a (0xe2e0 bytes) 000214 1789049713.143550 punch from 0x015db9 to 0x023cc5 (0xdf0d bytes) 000215 1789049713.148533 read 0x0140f3 thru 0x02118f (0xd09d bytes) 000216 1789049713.155877 mapread 0x021241 thru 0x02a91a (0x96da bytes) 000217 1789049713.166458 mapread 0x007380 thru 0x012393 (0xb014 bytes) 000218 1789049713.167736 mapread 0x0360a5 thru 0x03c106 (0x6062 bytes) 000221 1789049713.178558 trunc from 0x03eee6 to 0x039729 (0x57bc bytes) 000223 1789049713.204550 mapwrite 0x01fbf5 thru 0x02cb4a (0xcf56 bytes) 000224 1789049713.270218 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3972a): Mirror 4: 0x988940e1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3972a): Mirror 4: 0x988940e1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3972a: skipped 000225 1789049713.610729 punch from 0x0231fb to 0x02326a (0x70 bytes) 000226 1789049713.616678 write 0x00d04c thru 0x00e1d4 (0x1189 bytes) 000227 1789049713.637441 MIRROR_RESYNC 2 mirrors 000228 1789049714.478814 write 0x038cb0 thru 0x03ffff (0x7350 bytes) 000229 1789049714.577242 mapwrite 0x003d10 thru 0x00de2e (0xa11f bytes) 000231 1789049714.684769 mapwrite 0x01f5a3 thru 0x023d64 (0x47c2 bytes) 000233 1789049714.814239 read 0x01f035 thru 0x02dd3c (0xed08 bytes) 000236 1789049714.825714 mapread 0x03f210 thru 0x03ffff (0xdf0 bytes) 000238 1789049714.827776 write 0x034522 thru 0x039d6d (0x584c bytes) 000239 1789049714.836538 punch from 0x00ca0f to 0x015cf4 (0x92e6 bytes) 000240 1789049714.853174 mapwrite 0x026ec6 thru 0x02eb6b (0x7ca6 bytes) 000241 1789049714.939665 read 0x010621 thru 0x013e0f (0x37ef bytes) 000242 1789049714.957220 mapwrite 0x037524 thru 0x03ffff (0x8adc bytes) 000243 1789049715.044943 write 0x0299d0 thru 0x030337 (0x6968 bytes) 000244 1789049715.047968 trunc from 0x040000 to 0x020b46 (0x1f4b9 bytes) 000245 1789049715.077803 punch from 0x007360 to 0x0169f6 (0xf697 bytes) 000246 1789049715.087767 trunc from 0x020b47 to 0x02a1e9 (0x96a3 bytes) 000250 1789049715.116293 mapwrite 0x03643e thru 0x03a1dd (0x3da0 bytes) 000251 1789049715.234668 mapwrite 0x02dcab thru 0x038460 (0xa7b6 bytes) 000252 1789049715.345964 read 0x031699 thru 0x0364e6 (0x4e4e bytes) 000253 1789049715.352160 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) 000255 1789049715.549114 MIRROR_EXTEND to 2 mirrors 000256 1789049716.624161 write 0x00e02e thru 0x015427 (0x73fa bytes) 000259 1789049716.756509 trunc from 0x03a1de to 0x0104e6 (0x29cf7 bytes) 000260 1789049716.789243 mapwrite 0x019f76 thru 0x01cc28 (0x2cb3 bytes) 000261 1789049716.894557 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1cc29): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cc29): Mirror 2: 0x58dd638b (stale) CRC-32 checksum value for chunk [0, 0x1cc29): Mirror 1: 0x891659dd Mirror 3: 0x891659dd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cc29: skipped 000262 1789049717.887185 mapread 0x00a9d2 thru 0x0153d2 (0xaa01 bytes) 000263 1789049717.919369 mapwrite 0x0282f8 thru 0x02d9bb (0x56c4 bytes) 000265 1789049718.065362 mapread 0x02601a thru 0x028099 (0x2080 bytes) 000266 1789049718.066324 mapread 0x01e244 thru 0x01f111 (0xece bytes) 000267 1789049718.076831 mapread 0x004e63 thru 0x00b700 (0x689e bytes) 000269 1789049718.092458 read 0x02d79b thru 0x02d9bb (0x221 bytes) 000271 1789049718.093786 trunc from 0x02d9bc to 0x00d09e (0x2091d bytes) 000272 1789049718.125823 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd09f): Mirror 2: 0xb50acecb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd09f): Mirror 2: 0xb50acecb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd09f: skipped 000275 1789049718.383629 mapwrite 0x0187a6 thru 0x027ed8 (0xf733 bytes) 000279 1789049718.503520 mapread 0x004a8d thru 0x012d15 (0xe289 bytes) 000281 1789049718.524525 mapwrite 0x000682 thru 0x006b91 (0x6510 bytes) 000283 1789049718.581297 mapwrite 0x031390 thru 0x034be8 (0x3859 bytes) 000285 1789049718.651578 mapread 0x028a7c thru 0x033a84 (0xb009 bytes) 000286 1789049718.662107 mapwrite 0x005f8b thru 0x00db8b (0x7c01 bytes) 000287 1789049718.727812 read 0x02ca07 thru 0x034be8 (0x81e2 bytes) 000289 1789049718.728913 punch from 0x027ce4 to 0x031110 (0x942d bytes) 000292 1789049718.736704 read 0x02fcf2 thru 0x034be8 (0x4ef7 bytes) 000293 1789049718.756502 trunc from 0x034be9 to 0x009081 (0x2bb67 bytes) 000295 1789049718.788547 mapwrite 0x01c800 thru 0x02493f (0x8140 bytes) 000297 1789049718.909932 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x24940): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24940): Mirror 2: 0x2a8b396a (stale) CRC-32 checksum value for chunk [0, 0x24940): Mirror 1: 0x120d512a Mirror 3: 0x120d512a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24940: skipped 000299 1789049719.845873 trunc from 0x024940 to 0x037f34 (0x135f5 bytes) 000300 1789049719.930237 mapread 0x00d305 thru 0x015b92 (0x888e bytes) 000301 1789049719.957918 mapread 0x01b2a2 thru 0x01fd17 (0x4a76 bytes) 000306 1789049719.975453 mapwrite 0x0228d0 thru 0x02d9d2 (0xb103 bytes) 000307 1789049720.068514 write 0x01b8d5 thru 0x02619c (0xa8c8 bytes) 000309 1789049720.071239 mapread 0x019d17 thru 0x01af01 (0x11eb bytes) 000310 1789049720.073056 trunc from 0x037f35 to 0x039f2d (0x1ff9 bytes) 000311 1789049720.095727 mapread 0x00e01a thru 0x016974 (0x895b bytes) 000313 1789049720.099666 read 0x02ad34 thru 0x02cefe (0x21cb bytes) 000314 1789049720.100479 mapwrite 0x007ce0 thru 0x01098b (0x8cac bytes) 000315 1789049720.169033 punch from 0x032a8c to 0x039f2d (0x74a2 bytes) 000316 1789049720.175470 punch from 0x00db9f to 0x014c06 (0x7068 bytes) 000317 1789049720.181362 trunc from 0x039f2e to 0x01837d (0x21bb0 bytes) 000319 1789049720.216728 mapread 0x006d96 thru 0x00f093 (0x82fe bytes) 000320 1789049720.267564 MIRROR_RESYNC 3 mirrors 000321 1789049721.265884 write 0x00c61e thru 0x010474 (0x3e57 bytes) 000322 1789049721.406200 write 0x01226a thru 0x0151e5 (0x2f7c bytes) 000323 1789049721.427887 read 0x014566 thru 0x01611d (0x1bb8 bytes) 000324 1789049721.433371 punch from 0x003a50 to 0x00cbaf (0x9160 bytes) 000325 1789049721.451093 mapread 0x0057ab thru 0x0085fe (0x2e54 bytes) 000326 1789049721.469980 trunc from 0x01837e to 0x01c45c (0x40df bytes) 000327 1789049721.488037 read 0x00f88d thru 0x018489 (0x8bfd bytes) 000331 1789049721.501547 trunc from 0x01c45d to 0x00eb48 (0xd914 bytes) 000332 1789049721.518504 punch from 0x00d518 to 0x00eb48 (0x1631 bytes) 000334 1789049721.528235 mapread 0x0023a5 thru 0x00c27b (0x9ed7 bytes) 000336 1789049721.530764 read 0x0062c9 thru 0x00eb48 (0x8880 bytes) 000337 1789049721.537022 read 0x0055f6 thru 0x0063f4 (0xdff bytes) 000338 1789049721.537857 mapread 0x00aec9 thru 0x00eb48 (0x3c80 bytes) 000339 1789049721.539683 mapwrite 0x002587 thru 0x00b9fc (0x9476 bytes) 000341 1789049721.597051 mapread 0x00b972 thru 0x00eb48 (0x31d7 bytes) 000342 1789049721.598108 trunc from 0x00eb49 to 0x00a8b4 (0x4294 bytes) 000343 1789049721.615060 write 0x00ccd0 thru 0x010a4a (0x3d7b bytes) truncating to largest ever: 0x3d3ce 000345 1789049721.617852 trunc from 0x010a4b to 0x03d3cd (0x2c983 bytes) 000346 1789049721.631459 read 0x01fc7e thru 0x028084 (0x8407 bytes) 000347 1789049721.646500 trunc from 0x03d3ce to 0x03483e (0x8b8f bytes) 000348 1789049721.663200 punch from 0x000bf3 to 0x00e95e (0xdd6c bytes) 000349 1789049721.676636 punch from 0x00a3a0 to 0x013c67 (0x98c8 bytes) 000352 1789049721.682326 read 0x008227 thru 0x01384e (0xb628 bytes) 000353 1789049721.691881 mapread 0x01aee4 thru 0x0240d3 (0x91f0 bytes) 000354 1789049721.693131 mapread 0x0128fc thru 0x01be81 (0x9586 bytes) 000355 1789049721.694033 mapread 0x00e7d5 thru 0x01c805 (0xe031 bytes) 000356 1789049721.699684 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3483f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3483f): Mirror 2: 0x2e3afeb8 (stale) Mirror 3: 0x2e3afeb8 (stale) CRC-32 checksum value for chunk [0, 0x3483f): Mirror 1: 0xe7031b82 Mirror 4: 0xe7031b82 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3483f: skipped 000359 1789049723.019005 mapread 0x00506a thru 0x0058ce (0x865 bytes) 000360 1789049723.045262 write 0x023928 thru 0x02b3ae (0x7a87 bytes) 000361 1789049723.153861 punch from 0x003ba3 to 0x012581 (0xe9df bytes) 000363 1789049723.171810 trunc from 0x03483f to 0x013191 (0x216ad bytes) 000364 1789049723.201715 MIRROR_RESYNC 4 mirrors 000366 1789049724.555075 mapwrite 0x02b6f3 thru 0x033d70 (0x867e bytes) 000369 1789049724.786223 write 0x012c5c thru 0x01bbc3 (0x8f68 bytes) 000370 1789049724.799650 read 0x023d49 thru 0x03204b (0xe303 bytes) 000371 1789049724.805317 trunc from 0x033d71 to 0x036a29 (0x2cb9 bytes) 000372 1789049724.838414 mapread 0x017b14 thru 0x0181b9 (0x6a6 bytes) 000374 1789049724.856119 MIRROR_RESYNC 4 mirrors 000376 1789049726.013021 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) 000378 1789049726.403327 MIRROR_RESYNC 3 mirrors 000379 1789049726.856945 mapread 0x02a5fe thru 0x036a29 (0xc42c bytes) 000382 1789049726.891077 mapread 0x02e151 thru 0x0336b4 (0x5564 bytes) 000384 1789049726.893396 mapwrite 0x00e7a9 thru 0x010819 (0x2071 bytes) 000386 1789049727.098976 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36a2a): Mirror 4: 0xa3abf340 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36a2a): Mirror 4: 0xa3abf340 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36a2a: skipped 000387 1789049727.476568 mapwrite 0x036b86 thru 0x03ffff (0x947a bytes) 000390 1789049727.612003 punch from 0x03b50e to 0x03ffff (0x4af2 bytes) 000391 1789049727.617972 mapwrite 0x03bb5e thru 0x03ffff (0x44a2 bytes) 000392 1789049727.688648 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1de5e6c9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6222d69 Mirror 5: 0x6222d69 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000393 1789049728.673139 mapwrite 0x03d30e thru 0x03ffff (0x2cf2 bytes) 000396 1789049728.965042 mapread 0x01ccd3 thru 0x0205de (0x390c bytes) 000397 1789049728.982225 write 0x0021d8 thru 0x00fd14 (0xdb3d bytes) 000398 1789049729.005648 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1de5e6c9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1de5e6c9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000399 1789049729.332345 read 0x00964c thru 0x016518 (0xcecd bytes) 000400 1789049729.347293 trunc from 0x040000 to 0x03b930 (0x46cf bytes) 000402 1789049729.379770 punch from 0x0053f8 to 0x00a87f (0x5488 bytes) 000403 1789049729.388987 write 0x01b0ac thru 0x01b31b (0x270 bytes) 000404 1789049729.396508 punch from 0x02c6bf to 0x02fd6c (0x36ae bytes) 000407 1789049729.407849 punch from 0x018279 to 0x01ebd8 (0x6960 bytes) 000408 1789049729.417051 read 0x033229 thru 0x038000 (0x4dd8 bytes) 000409 1789049729.437691 mapwrite 0x0330da thru 0x03cf86 (0x9ead bytes) 000411 1789049729.561204 mapwrite 0x023dc4 thru 0x032d9c (0xefd9 bytes) 000412 1789049729.625080 mapread 0x03351e thru 0x038fec (0x5acf bytes) 000413 1789049729.626641 punch from 0x01a13e to 0x01d4a0 (0x3363 bytes) truncating to largest ever: 0x3db95 000415 1789049729.632200 trunc from 0x03cf87 to 0x03db94 (0xc0e bytes) 000416 1789049729.647939 trunc from 0x03db95 to 0x0066fb (0x37499 bytes) 000418 1789049729.668175 mapwrite 0x01a9b2 thru 0x02279b (0x7dea bytes) 000419 1789049729.798537 read 0x01570a thru 0x01ec87 (0x957e bytes) 000420 1789049729.807449 mapwrite 0x023be3 thru 0x02eb43 (0xaf61 bytes) 000421 1789049729.881993 mapread 0x022497 thru 0x029e45 (0x79af bytes) 000422 1789049729.887205 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) 000424 1789049730.057644 write 0x010379 thru 0x0141c4 (0x3e4c bytes) 000425 1789049730.087661 mapread 0x01fedf thru 0x023b38 (0x3c5a bytes) 000426 1789049730.129489 trunc from 0x02eb44 to 0x025617 (0x952c bytes) 000427 1789049730.146768 read 0x011512 thru 0x01599c (0x448b bytes) 000428 1789049730.165340 MIRROR_EXTEND to 2 mirrors 000429 1789049730.867179 mapwrite 0x009730 thru 0x0167ca (0xd09b bytes) 000430 1789049731.142296 trunc from 0x025618 to 0x0306a0 (0xb089 bytes) 000431 1789049731.168080 punch from 0x008ac2 to 0x012da5 (0xa2e4 bytes) 000432 1789049731.186410 read 0x02235b thru 0x0306a0 (0xe346 bytes) 000434 1789049731.198716 write 0x00dc5e thru 0x011445 (0x37e8 bytes) 000435 1789049731.215947 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x306a1): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x306a1): Mirror 2: 0xcbc2e3b1 (stale) CRC-32 checksum value for chunk [0, 0x306a1): Mirror 1: 0x48690b87 Mirror 3: 0x48690b87 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x306a1: skipped 000436 1789049732.080078 punch from 0x02a7db to 0x0306a0 (0x5ec6 bytes) 000437 1789049732.208432 trunc from 0x0306a1 to 0x0183ad (0x182f3 bytes) 000438 1789049732.249402 mapread 0x00a7a5 thru 0x0173e5 (0xcc41 bytes) 000439 1789049732.292082 MIRROR_RESYNC 3 mirrors 000440 1789049733.271535 trunc from 0x0183ae to 0x01c484 (0x40d7 bytes) 000441 1789049733.380003 mapwrite 0x000cee thru 0x00f9cb (0xecde bytes) 000442 1789049733.537349 mapread 0x00446f thru 0x00f353 (0xaee5 bytes) 000444 1789049733.541333 write 0x02c3f1 thru 0x036e1f (0xaa2f bytes) 000446 1789049733.545577 write 0x01750f thru 0x025fd0 (0xeac2 bytes) 000447 1789049733.561015 punch from 0x003605 to 0x008379 (0x4d75 bytes) 000448 1789049733.579148 read 0x01cd25 thru 0x024a80 (0x7d5c bytes) 000449 1789049733.580964 read 0x02bbbe thru 0x031cfc (0x613f bytes) 000453 1789049733.607520 punch from 0x0104c8 to 0x01f41a (0xef53 bytes) 000455 1789049733.618180 read 0x01c7db thru 0x02281f (0x6045 bytes) 000456 1789049733.634655 trunc from 0x036e20 to 0x02bc5a (0xb1c5 bytes) 000458 1789049733.680169 write 0x00e51e thru 0x01d870 (0xf353 bytes) 000459 1789049733.684531 read 0x018cfd thru 0x022279 (0x957d bytes) 000461 1789049733.686148 write 0x015a60 thru 0x017061 (0x1602 bytes) 000464 1789049733.691116 read 0x00707c thru 0x00c03e (0x4fc3 bytes) 000465 1789049733.693140 read 0x010e9d thru 0x016dc4 (0x5f28 bytes) 000467 1789049733.695006 punch from 0x026951 to 0x02bc5a (0x530a bytes) 000468 1789049733.720821 MIRROR_RESYNC 3 mirrors 000469 1789049734.782362 mapread 0x024fd4 thru 0x02500b (0x38 bytes) 000470 1789049734.805691 trunc from 0x02bc5b to 0x009807 (0x22453 bytes) 000471 1789049734.923569 trunc from 0x009808 to 0x019b8c (0x10385 bytes) 000474 1789049734.950511 write 0x03259e thru 0x039747 (0x71aa bytes) 000475 1789049734.956520 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x39748): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39748): Mirror 2: 0x5108b836 (stale) Mirror 3: 0x5108b836 (stale) CRC-32 checksum value for chunk [0, 0x39748): Mirror 1: 0xe663c019 Mirror 4: 0xe663c019 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39748: skipped 000478 1789049736.082242 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39748): Mirror 3: 0x5108b836 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39748): Mirror 3: 0x5108b836 (stale) CRC-32 checksum value for chunk [0, 0x39748): Mirror 1: 0xe663c019 Mirror 4: 0xe663c019 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39748: skipped 000479 1789049736.510138 read 0x000134 thru 0x005b44 (0x5a11 bytes) 000480 1789049736.526980 write 0x026e81 thru 0x02d095 (0x6215 bytes) 000481 1789049736.621211 punch from 0x003072 to 0x003832 (0x7c1 bytes) 000483 1789049736.634028 punch from 0x032344 to 0x035186 (0x2e43 bytes) 000484 1789049736.641308 mapread 0x031614 thru 0x033cd6 (0x26c3 bytes) 000485 1789049736.673209 mapread 0x031c16 thru 0x036894 (0x4c7f bytes) truncating to largest ever: 0x3df12 000486 1789049736.674067 trunc from 0x039748 to 0x03df11 (0x47ca bytes) 000487 1789049736.702565 trunc from 0x03df12 to 0x027845 (0x166cc bytes) 000488 1789049736.718949 mapwrite 0x005402 thru 0x0137c6 (0xe3c5 bytes) 000490 1789049736.817338 punch from 0x01cd85 to 0x027845 (0xaac1 bytes) 000491 1789049736.829438 trunc from 0x027846 to 0x01c952 (0xaef3 bytes) 000494 1789049736.867097 punch from 0x00f849 to 0x01c952 (0xd10a bytes) 000496 1789049736.897015 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c953): Mirror 3: 0x4ec6f457 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c953): Mirror 3: 0x4ec6f457 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c953: skipped 000497 1789049737.291727 read 0x013b04 thru 0x016534 (0x2a31 bytes) 000498 1789049737.298325 mapread 0x014243 thru 0x01c952 (0x8710 bytes) 000499 1789049737.316499 write 0x018c92 thru 0x0275e1 (0xe950 bytes) 000502 1789049737.320130 read 0x0212c4 thru 0x021a13 (0x750 bytes) 000504 1789049737.321314 trunc from 0x0275e2 to 0x032cbc (0xb6db bytes) 000505 1789049737.362338 write 0x01ce06 thru 0x02a35f (0xd55a bytes) 000507 1789049737.375768 MIRROR_RESYNC 2 mirrors 000508 1789049738.784698 mapwrite 0x002fe8 thru 0x0046e5 (0x16fe bytes) 000509 1789049738.976626 read 0x001241 thru 0x009380 (0x8140 bytes) 000510 1789049738.977262 trunc from 0x032cbd to 0x016371 (0x1c94b bytes) 000512 1789049739.009110 write 0x025676 thru 0x03316e (0xdaf9 bytes) 000514 1789049739.014796 punch from 0x016a6e to 0x025a0c (0xef9f bytes) 000515 1789049739.036959 read 0x010896 thru 0x013001 (0x276c bytes) 000516 1789049739.046058 punch from 0x019fe6 to 0x01ab5c (0xb77 bytes) 000517 1789049739.051260 trunc from 0x03316f to 0x02c29d (0x6ed1 bytes) 000518 1789049739.077957 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2c29e): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c29e): Mirror 3: 0x52335fb9 (stale) CRC-32 checksum value for chunk [0, 0x2c29e): Mirror 1: 0xef618f64 Mirror 4: 0xef618f64 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c29e: skipped 000519 1789049740.305771 mapread 0x007317 thru 0x00efdc (0x7cc6 bytes) 000520 1789049740.325250 MIRROR_RESYNC 3 mirrors 000523 1789049741.213468 write 0x03345a thru 0x03cce4 (0x988b bytes) 000524 1789049741.307557 write 0x029e16 thru 0x0302d1 (0x64bc bytes) 000525 1789049741.332255 mapread 0x01dcb2 thru 0x01fc66 (0x1fb5 bytes) 000527 1789049741.375794 write 0x019cee thru 0x01d3e7 (0x36fa bytes) 000528 1789049741.377060 trunc from 0x03cce5 to 0x015606 (0x276de bytes) 000529 1789049741.396329 write 0x026637 thru 0x026ed2 (0x89c bytes) 000530 1789049741.398017 write 0x00d5e2 thru 0x01b289 (0xdca8 bytes) 000531 1789049741.409089 mapread 0x007798 thru 0x01071c (0x8f85 bytes) 000538 1789049741.420222 mapwrite 0x01473d thru 0x0229fb (0xe2bf bytes) 000539 1789049741.472649 mapwrite 0x016b67 thru 0x01d4a1 (0x693b bytes) 000540 1789049741.515368 punch from 0x00386a to 0x00caf7 (0x928e bytes) truncating to largest ever: 0x3eb65 000543 1789049741.521963 trunc from 0x026ed3 to 0x03eb64 (0x17c92 bytes) 000544 1789049741.542330 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3eb65): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb65): Mirror 3: 0xe2ba104f (stale) Mirror 4: 0xe2ba104f (stale) CRC-32 checksum value for chunk [0, 0x3eb65): Mirror 1: 0x2bac752 Mirror 5: 0x2bac752 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb65: skipped 000545 1789049742.766037 trunc from 0x03eb65 to 0x013615 (0x2b54f bytes) 000547 1789049742.922913 MIRROR_RESYNC 4 mirrors 000548 1789049743.929460 read 0x00f854 thru 0x013615 (0x3dc2 bytes) 000549 1789049743.937990 mapread 0x0008fd thru 0x00deca (0xd5ce bytes) 000550 1789049743.983820 mapread 0x0016bc thru 0x00532a (0x3c6f bytes) 000553 1789049743.990885 trunc from 0x013616 to 0x02176d (0xe158 bytes) 000554 1789049744.108058 write 0x0279c2 thru 0x03724e (0xf88d bytes) 000555 1789049744.113908 punch from 0x00bc75 to 0x011a79 (0x5e05 bytes) 000556 1789049744.144546 mapwrite 0x008870 thru 0x014c5d (0xc3ee bytes) 000557 1789049744.341879 trunc from 0x03724f to 0x006349 (0x30f05 bytes) 000559 1789049744.409882 punch from 0x003e5e to 0x006349 (0x24ec bytes) 000560 1789049744.417997 read 0x0027fc thru 0x006349 (0x3b4e bytes) 000562 1789049744.433734 mapread 0x0030a9 thru 0x006349 (0x32a1 bytes) 000563 1789049744.441526 read 0x005837 thru 0x006349 (0xb13 bytes) 000564 1789049744.445769 mapwrite 0x00da96 thru 0x011672 (0x3bdd bytes) 000569 1789049744.566544 punch from 0x002681 to 0x007863 (0x51e3 bytes) 000570 1789049744.572791 mapread 0x010e53 thru 0x011672 (0x820 bytes) 000571 1789049744.574410 mapwrite 0x03fe34 thru 0x03ffff (0x1cc bytes) 000572 1789049744.644704 mapwrite 0x00dcb3 thru 0x01add9 (0xd127 bytes) 000573 1789049744.683187 mapread 0x03fa86 thru 0x03ffff (0x57a bytes) 000575 1789049744.684684 mapwrite 0x018ebd thru 0x01a679 (0x17bd bytes) 000576 1789049744.719015 read 0x00473b thru 0x0085fa (0x3ec0 bytes) 000577 1789049744.730191 mapwrite 0x031563 thru 0x03c0ed (0xab8b bytes) 000579 1789049744.827392 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1a5322a4 (stale) Mirror 4: 0x1a5322a4 (stale) Mirror 5: 0x1a5322a4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa8831af4 Mirror 6: 0xa8831af4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000580 1789049745.933945 mapread 0x005109 thru 0x0146a5 (0xf59d bytes) 000581 1789049746.021936 mapwrite 0x02114b thru 0x0304bf (0xf375 bytes) 000584 1789049746.404922 mapread 0x0233b3 thru 0x02d4ab (0xa0f9 bytes) 000585 1789049746.427022 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1a5322a4 (stale) Mirror 4: 0x1a5322a4 (stale) Mirror 6: 0xa8831af4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1a5322a4 (stale) Mirror 4: 0x1a5322a4 (stale) Mirror 6: 0xa8831af4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000586 1789049747.177361 trunc from 0x040000 to 0x007a13 (0x385ec bytes) 000587 1789049747.198371 write 0x0011ee thru 0x00b518 (0xa32b bytes) 000589 1789049747.212704 punch from 0x0028d7 to 0x00ab70 (0x829a bytes) 000592 1789049747.238528 read 0x003438 thru 0x00684e (0x3417 bytes) 000594 1789049747.265940 MIRROR_RESYNC 4 mirrors 000595 1789049748.257169 trunc from 0x00b519 to 0x02faaa (0x24592 bytes) 000596 1789049748.323276 read 0x00710f thru 0x00c678 (0x556a bytes) 000597 1789049748.333844 trunc from 0x02faab to 0x019711 (0x16399 bytes) 000598 1789049748.352458 punch from 0x018a68 to 0x019711 (0xcaa bytes) 000599 1789049748.358367 write 0x015274 thru 0x023b94 (0xe921 bytes) 000600 1789049748.364082 mapwrite 0x01c56a thru 0x0206da (0x4171 bytes) 000601 1789049748.426371 trunc from 0x023b95 to 0x001ce8 (0x21eac bytes) 000602 1789049748.454762 write 0x002220 thru 0x011489 (0xf26a bytes) 000603 1789049748.458448 write 0x00432a thru 0x010335 (0xc00c bytes) 000605 1789049748.482238 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1148a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1148a): Mirror 3: 0xcc1b2696 (stale) Mirror 4: 0xcc1b2696 (stale) Mirror 6: 0xcc1b2696 (stale) CRC-32 checksum value for chunk [0, 0x1148a): Mirror 1: 0x53f5b94b Mirror 7: 0x53f5b94b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1148a: skipped 000607 1789049749.608317 mapwrite 0x005696 thru 0x014e56 (0xf7c1 bytes) 000608 1789049749.892685 mapwrite 0x0166d7 thru 0x02120e (0xab38 bytes) 000609 1789049750.202940 read 0x01c475 thru 0x02120e (0x4d9a bytes) 000611 1789049750.204570 mapwrite 0x01b630 thru 0x01e1de (0x2baf bytes) 000612 1789049750.281933 read 0x0148f2 thru 0x0209eb (0xc0fa bytes) 000613 1789049750.282920 write 0x018059 thru 0x0206e7 (0x868f bytes) 000614 1789049750.284765 punch from 0x018a75 to 0x01d292 (0x481e bytes) 000616 1789049750.298065 write 0x004baf thru 0x009257 (0x46a9 bytes) 000617 1789049750.299110 punch from 0x009385 to 0x018099 (0xed15 bytes) 000618 1789049750.328847 read 0x013a20 thru 0x01a41f (0x6a00 bytes) 000619 1789049750.339137 mapwrite 0x01430a thru 0x0184f5 (0x41ec bytes) 000620 1789049750.391846 trunc from 0x02120f to 0x001a2c (0x1f7e2 bytes) 000621 1789049750.406327 mapwrite 0x037f04 thru 0x03ffff (0x80fc bytes) 000622 1789049750.498194 write 0x0091da thru 0x011773 (0x859a bytes) 000623 1789049750.519405 read 0x00ce22 thru 0x01b539 (0xe718 bytes) 000624 1789049750.529942 trunc from 0x040000 to 0x03204e (0xdfb1 bytes) 000625 1789049750.546301 punch from 0x030e1f to 0x03204e (0x1230 bytes) 000626 1789049750.560716 punch from 0x00ae85 to 0x017ed1 (0xd04d bytes) 000628 1789049750.565164 read 0x01a490 thru 0x01dd28 (0x3899 bytes) 000629 1789049750.566846 punch from 0x01e899 to 0x02e531 (0xfc99 bytes) 000630 1789049750.571454 punch from 0x002597 to 0x00d274 (0xacde bytes) 000632 1789049750.576974 write 0x02dc0b thru 0x03d60e (0xfa04 bytes) 000633 1789049750.587725 mapread 0x00c32a thru 0x00cf14 (0xbeb bytes) 000635 1789049750.589181 mapwrite 0x018a62 thru 0x01c24a (0x37e9 bytes) 000636 1789049750.671279 trunc from 0x03d60f to 0x007f8e (0x35680 bytes) 000638 1789049750.693941 write 0x003607 thru 0x00c6b6 (0x90b0 bytes) 000639 1789049750.706430 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xc6b7): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc6b7): Mirror 3: 0x125e67d7 (stale) Mirror 4: 0x125e67d7 (stale) Mirror 6: 0x125e67d7 (stale) Mirror 7: 0xf03f8290 (stale) CRC-32 checksum value for chunk [0, 0xc6b7): Mirror 1: 0xdafc117d Mirror 8: 0xdafc117d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc6b7: skipped 000640 1789049751.859161 punch from 0x000fa2 to 0x00c6b6 (0xb715 bytes) 000641 1789049752.046926 trunc from 0x00c6b7 to 0x032a5c (0x263a6 bytes) 000642 1789049752.095309 mapread 0x01cdb2 thru 0x02a7a7 (0xd9f6 bytes) 000644 1789049752.142543 read 0x02f9e0 thru 0x03269d (0x2cbe bytes) 000646 1789049752.149415 punch from 0x01686e to 0x020553 (0x9ce6 bytes) 000650 1789049752.158354 trunc from 0x032a5d to 0x01d427 (0x15635 bytes) 000651 1789049752.180065 mapread 0x019f5d thru 0x01d427 (0x34cb bytes) 000652 1789049752.197486 punch from 0x006cd5 to 0x007c25 (0xf51 bytes) 000653 1789049752.205523 mapread 0x002ac5 thru 0x00b4a2 (0x89de bytes) 000654 1789049752.221905 mapread 0x01adde thru 0x01d3b8 (0x25db bytes) 000655 1789049752.228691 MIRROR_RESYNC 6 mirrors 000656 1789049753.971168 trunc from 0x01d428 to 0x01599c (0x7a8b bytes) 000657 1789049754.076548 write 0x0200c6 thru 0x02235d (0x2298 bytes) 000659 1789049754.080405 mapwrite 0x01e4c1 thru 0x021c39 (0x3779 bytes) 000660 1789049754.155978 mapread 0x0195f9 thru 0x01d7d4 (0x41dc bytes) 000663 1789049754.171385 mapwrite 0x00e955 thru 0x01036c (0x1a18 bytes) 000664 1789049754.300965 write 0x027af5 thru 0x0334d2 (0xb9de bytes) 000666 1789049754.305958 read 0x0106bb thru 0x01a305 (0x9c4b bytes) 000667 1789049754.306795 mapread 0x00ff61 thru 0x0150df (0x517f bytes) 000669 1789049754.315159 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x334d3): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x334d3): Mirror 3: 0xe226088d (stale) Mirror 4: 0xe226088d (stale) Mirror 6: 0xe226088d (stale) Mirror 7: 0xe226088d (stale) Mirror 8: 0xe226088d (stale) CRC-32 checksum value for chunk [0, 0x334d3): Mirror 1: 0x9ff7471 Mirror 9: 0x9ff7471 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x334d3: skipped 000671 1789049755.376642 mapread 0x030891 thru 0x0334d2 (0x2c42 bytes) 000672 1789049755.436338 punch from 0x023d80 to 0x0323ef (0xe670 bytes) 000673 1789049755.524365 read 0x01c6c4 thru 0x0219ed (0x532a bytes) 000675 1789049755.535659 read 0x00685d thru 0x010671 (0x9e15 bytes) 000677 1789049755.549830 mapwrite 0x0059a2 thru 0x00ef23 (0x9582 bytes) 000679 1789049755.596138 mapwrite 0x00bccd thru 0x0136a2 (0x79d6 bytes) 000680 1789049755.638796 trunc from 0x0334d3 to 0x008c66 (0x2a86c bytes) 000681 1789049755.656782 mapwrite 0x034648 thru 0x03e073 (0x9a2c bytes) 000683 1789049755.777407 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e074): Mirror 4: 0x5a431ac7 (stale) Mirror 6: 0x5a431ac7 (stale) Mirror 7: 0x5a431ac7 (stale) Mirror 8: 0x5a431ac7 (stale) Mirror 9: 0xb2b490c2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e074): Mirror 4: 0x5a431ac7 (stale) Mirror 6: 0x5a431ac7 (stale) Mirror 7: 0x5a431ac7 (stale) Mirror 8: 0x5a431ac7 (stale) Mirror 9: 0xb2b490c2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e074: skipped 000684 1789049756.288756 write 0x01ce90 thru 0x0287a5 (0xb916 bytes) 000685 1789049756.299033 mapread 0x006817 thru 0x00bf46 (0x5730 bytes) 000686 1789049756.317359 read 0x025438 thru 0x03027e (0xae47 bytes) 000688 1789049756.327010 mapwrite 0x0051c9 thru 0x014f9c (0xfdd4 bytes) 000689 1789049756.386798 punch from 0x02408f to 0x02b371 (0x72e3 bytes) 000692 1789049756.392797 write 0x02aaa6 thru 0x02e1e8 (0x3743 bytes) 000693 1789049756.397078 read 0x01411c thru 0x0166bb (0x25a0 bytes) 000697 1789049756.400039 mapread 0x029256 thru 0x0325a3 (0x934e bytes) 000698 1789049756.412679 MIRROR_RESYNC 6 mirrors 000699 1789049757.992028 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) 000700 1789049758.491821 mapread 0x012e4d thru 0x01b8e8 (0x8a9c bytes) 000701 1789049758.524813 trunc from 0x03e074 to 0x03c2b6 (0x1dbd bytes) 000702 1789049758.634197 write 0x032166 thru 0x03ffff (0xde9a bytes) 000703 1789049758.639661 punch from 0x02f272 to 0x03b402 (0xc191 bytes) 000705 1789049758.655383 write 0x00b253 thru 0x01ac96 (0xfa44 bytes) 000707 1789049758.668085 punch from 0x01c322 to 0x02b2f0 (0xefcf bytes) 000708 1789049758.684175 read 0x02de6d thru 0x039eba (0xc04e bytes) 000709 1789049758.698935 read 0x019306 thru 0x01bce9 (0x29e4 bytes) 000710 1789049758.709965 trunc from 0x040000 to 0x02f32f (0x10cd0 bytes) 000712 1789049758.734385 read 0x002d52 thru 0x0120e9 (0xf398 bytes) 000713 1789049758.735498 read 0x01ab2c thru 0x0279be (0xce93 bytes) 000715 1789049758.737441 trunc from 0x02f330 to 0x01f347 (0xffe8 bytes) 000716 1789049758.752804 mapread 0x002f7a thru 0x009f00 (0x6f87 bytes) 000717 1789049758.757350 write 0x03fcd3 thru 0x03ffff (0x32d bytes) 000718 1789049758.764807 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x511a6bdc (stale) Mirror 6: 0x511a6bdc (stale) Mirror 7: 0x511a6bdc (stale) Mirror 8: 0x511a6bdc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbfe0cd0f Mirror 9: 0xbfe0cd0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000720 1789049759.718267 punch from 0x001ea7 to 0x00869c (0x67f6 bytes) 000721 1789049759.826365 mapread 0x03d613 thru 0x03ffff (0x29ed bytes) 000723 1789049759.858196 trunc from 0x040000 to 0x01f653 (0x209ac bytes) 000724 1789049759.885788 read 0x005c64 thru 0x01213c (0xc4d9 bytes) 000725 1789049759.909237 read 0x002147 thru 0x007131 (0x4feb bytes) 000726 1789049759.922376 write 0x0109f2 thru 0x019dd8 (0x93e7 bytes) 000727 1789049759.924976 mapread 0x00841a thru 0x010429 (0x8010 bytes) 000730 1789049759.928720 write 0x00f20a thru 0x01c6c0 (0xd4b7 bytes) 000731 1789049759.930086 write 0x02af37 thru 0x030ab0 (0x5b7a bytes) 000732 1789049759.931932 write 0x018ba4 thru 0x0213cd (0x882a bytes) 000735 1789049759.940854 mapwrite 0x002100 thru 0x008991 (0x6892 bytes) 000736 1789049760.001859 read 0x0177ac thru 0x01f102 (0x7957 bytes) 000737 1789049760.002504 mapwrite 0x01b084 thru 0x021a95 (0x6a12 bytes) 000739 1789049760.066904 punch from 0x00f942 to 0x019f2a (0xa5e9 bytes) 000741 1789049760.078172 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x30ab1): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30ab1): Mirror 4: 0x9e690950 (stale) Mirror 6: 0x9e690950 (stale) Mirror 7: 0x9e690950 (stale) Mirror 8: 0x9e690950 (stale) Mirror 9: 0xda28e2c5 (stale) CRC-32 checksum value for chunk [0, 0x30ab1): Mirror 1: 0x835dc79 Mirror 10: 0x835dc79 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30ab1: skipped 000742 1789049761.299090 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x30ab1): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30ab1): Mirror 4: 0x9e690950 (stale) Mirror 6: 0x9e690950 (stale) Mirror 7: 0x9e690950 (stale) Mirror 8: 0x9e690950 (stale) Mirror 9: 0xda28e2c5 (stale) CRC-32 checksum value for chunk [0, 0x30ab1): Mirror 1: 0x835dc79 Mirror 10: 0x835dc79 Mirror 11: 0x835dc79 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30ab1: skipped 000744 1789049762.568427 mapread 0x024c38 thru 0x030ab0 (0xbe79 bytes) 000745 1789049762.624996 punch from 0x01daf7 to 0x0230ec (0x55f6 bytes) 000746 1789049762.784242 punch from 0x011de6 to 0x0195e9 (0x7804 bytes) 000747 1789049762.793099 punch from 0x00d8b7 to 0x015df4 (0x853e bytes) 000752 1789049762.813536 trunc from 0x030ab1 to 0x03597f (0x4ecf bytes) 000754 1789049762.879531 trunc from 0x035980 to 0x005bfb (0x2fd84 bytes) 000755 1789049762.940845 punch from 0x003a82 to 0x005bfb (0x217a bytes) 000756 1789049762.952663 read 0x004d4b thru 0x005bfb (0xeb1 bytes) 000757 1789049762.968952 mapwrite 0x004840 thru 0x00ada2 (0x6563 bytes) 000760 1789049763.136948 trunc from 0x00ada3 to 0x00c14c (0x13aa bytes) 000761 1789049763.157010 read 0x007f62 thru 0x00c14c (0x41eb bytes) 000762 1789049763.169958 mapread 0x00587e thru 0x00c14c (0x68cf bytes) 000763 1789049763.171127 mapwrite 0x02a5ed thru 0x03859a (0xdfae bytes) 000765 1789049763.263285 mapwrite 0x0006dd thru 0x004abf (0x43e3 bytes) 000767 1789049763.302214 read 0x0313e7 thru 0x0328b2 (0x14cc bytes) 000768 1789049763.303175 read 0x006a85 thru 0x006baa (0x126 bytes) 000772 1789049763.304709 mapread 0x00ec91 thru 0x0136f0 (0x4a60 bytes) 000774 1789049763.305884 write 0x01a60b thru 0x01fe25 (0x581b bytes) 000775 1789049763.307903 write 0x02c41a thru 0x03c3fd (0xffe4 bytes) 000776 1789049763.310020 punch from 0x01953c to 0x022b1c (0x95e1 bytes) 000777 1789049763.323173 read 0x0064a5 thru 0x014446 (0xdfa2 bytes) 000780 1789049763.324784 trunc from 0x03c3fe to 0x026961 (0x15a9c bytes) 000781 1789049763.339765 mapread 0x001f05 thru 0x00d826 (0xb922 bytes) 000783 1789049763.341844 mapwrite 0x007d83 thru 0x013f49 (0xc1c7 bytes) 000784 1789049763.394173 punch from 0x012e83 to 0x016efa (0x4078 bytes) 000786 1789049763.402847 write 0x03d317 thru 0x03ffff (0x2ce9 bytes) 000787 1789049763.405329 write 0x0357b3 thru 0x03b5bc (0x5e0a bytes) 000788 1789049763.418983 write 0x031f63 thru 0x033bdf (0x1c7d bytes) 000789 1789049763.421439 trunc from 0x040000 to 0x0138d3 (0x2c72c bytes) 000790 1789049763.442485 write 0x001c53 thru 0x00aae7 (0x8e95 bytes) 000792 1789049763.447250 read 0x001423 thru 0x00a8f9 (0x94d7 bytes) 000793 1789049763.447982 trunc from 0x0138d4 to 0x02b314 (0x17a41 bytes) 000795 1789049763.470034 read 0x017a7d thru 0x020513 (0x8a97 bytes) 000796 1789049763.510330 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2b315): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b315): Mirror 4: 0xf8b21d94 (stale) Mirror 6: 0xf8b21d94 (stale) Mirror 7: 0xf8b21d94 (stale) Mirror 8: 0xf8b21d94 (stale) Mirror 9: 0xdabfbd6c (stale) Mirror 10: 0xafa8ed96 (stale) Mirror 11: 0xafa8ed96 (stale) CRC-32 checksum value for chunk [0, 0x2b315): Mirror 1: 0xe53dc835 Mirror 12: 0xe53dc835 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b315: skipped 000797 1789049764.827283 mapread 0x026b02 thru 0x02b314 (0x4813 bytes) 000798 1789049764.856920 write 0x01436c thru 0x01cf3c (0x8bd1 bytes) 000799 1789049764.998986 trunc from 0x02b315 to 0x025a98 (0x587c bytes) 000800 1789049765.070698 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x25a99): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25a99): Mirror 4: 0x97d56e64 (stale) Mirror 6: 0x97d56e64 (stale) Mirror 7: 0x97d56e64 (stale) Mirror 8: 0x97d56e64 (stale) Mirror 9: 0x2f9fd590 (stale) Mirror 10: 0xe4bbc5ce (stale) Mirror 11: 0xe4bbc5ce (stale) Mirror 12: 0x7fafb331 (stale) CRC-32 checksum value for chunk [0, 0x25a99): Mirror 1: 0x1fe13301 Mirror 13: 0x1fe13301 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25a99: skipped 000803 1789049766.547746 write 0x0072f3 thru 0x014b18 (0xd826 bytes) 000804 1789049766.671388 punch from 0x017305 to 0x02514f (0xde4b bytes) 000805 1789049766.690812 mapwrite 0x030f15 thru 0x038e12 (0x7efe bytes) 000806 1789049766.797402 mapwrite 0x0181cc thru 0x023d5a (0xbb8f bytes) 000807 1789049766.883088 read 0x02c221 thru 0x02cbb5 (0x995 bytes) 000808 1789049766.883681 mapread 0x00108d thru 0x00424e (0x31c2 bytes) 000810 1789049766.897946 read 0x003b6a thru 0x012e3c (0xf2d3 bytes) 000812 1789049766.899963 trunc from 0x038e13 to 0x01f51f (0x198f3 bytes) 000813 1789049766.932198 punch from 0x01a2a4 to 0x01f51f (0x527c bytes) 000814 1789049766.953138 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x1f520): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f520): Mirror 4: 0x7095cc3f (stale) Mirror 6: 0x7095cc3f (stale) Mirror 7: 0x7095cc3f (stale) Mirror 8: 0x7095cc3f (stale) Mirror 9: 0xeb878ef2 (stale) Mirror 10: 0x994d5e82 (stale) Mirror 11: 0x994d5e82 (stale) Mirror 12: 0xa2fe68dd (stale) Mirror 13: 0x3ab52d81 (stale) CRC-32 checksum value for chunk [0, 0x1f520): Mirror 1: 0xe60c690d Mirror 14: 0xe60c690d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f520: skipped 000817 1789049768.535157 punch from 0x012567 to 0x01d185 (0xac1f bytes) 000821 1789049768.728993 mapread 0x00346a thru 0x00d92b (0xa4c2 bytes) 000822 1789049768.761747 read 0x009dd6 thru 0x015b7a (0xbda5 bytes) 000824 1789049768.790271 mapwrite 0x0045fc thru 0x008bc8 (0x45cd bytes) 000825 1789049768.849022 mapread 0x004f6d thru 0x011efc (0xcf90 bytes) 000826 1789049768.851287 trunc from 0x01f520 to 0x024fcd (0x5aae bytes) 000827 1789049768.889269 write 0x000fc8 thru 0x0010dc (0x115 bytes) 000829 1789049768.918679 mapread 0x00e60c thru 0x00f336 (0xd2b bytes) 000831 1789049768.922837 mapread 0x009d83 thru 0x019c7a (0xfef8 bytes) 000835 1789049768.946157 mapread 0x010a70 thru 0x014261 (0x37f2 bytes) 000838 1789049768.958222 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x24fce): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24fce): Mirror 4: 0x7486a287 (stale) Mirror 6: 0x7486a287 (stale) Mirror 7: 0x7486a287 (stale) Mirror 8: 0x7486a287 (stale) Mirror 9: 0x94bc4a06 (stale) Mirror 10: 0x26b0bc24 (stale) Mirror 11: 0x26b0bc24 (stale) Mirror 12: 0x4cd28931 (stale) Mirror 13: 0xb483f9b1 (stale) Mirror 14: 0xec9a21d2 (stale) CRC-32 checksum value for chunk [0, 0x24fce): Mirror 1: 0xc8548e2c Mirror 15: 0xc8548e2c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24fce: skipped 000839 1789049771.155672 mapread 0x01fb38 thru 0x0246de (0x4ba7 bytes) 000842 1789049771.240086 mapread 0x00fe81 thru 0x012e67 (0x2fe7 bytes) 000845 1789049771.322839 write 0x03ba07 thru 0x03ffff (0x45f9 bytes) 000849 1789049771.581927 MIRROR_RESYNC 12 mirrors 000851 1789049773.562684 mapwrite 0x03e1ee thru 0x03ffff (0x1e12 bytes) 000852 1789049773.781490 trunc from 0x040000 to 0x01de09 (0x221f6 bytes) 000854 1789049773.842766 mapread 0x014f0e thru 0x01871c (0x380f bytes) 000855 1789049773.864905 trunc from 0x01de0a to 0x01627e (0x7b8b bytes) 000856 1789049773.889803 punch from 0x007467 to 0x00ce78 (0x5a12 bytes) 000859 1789049773.917613 MIRROR_RESYNC 12 mirrors 000860 1789049775.948407 mapwrite 0x00a4c2 thru 0x0101c4 (0x5d03 bytes) 000862 1789049776.271799 MIRROR_RESYNC 12 mirrors 000863 1789049779.472115 read 0x00a87f thru 0x00d197 (0x2919 bytes) 000864 1789049779.487035 read 0x00fb51 thru 0x01330b (0x37bb bytes) 000867 1789049779.527210 MIRROR_RESYNC 12 mirrors 000869 1789049780.278283 mapwrite 0x001bbe thru 0x001ecf (0x312 bytes) 000870 1789049780.555566 mapwrite 0x0293db thru 0x02c9f1 (0x3617 bytes) 000871 1789049780.700358 read 0x0177b1 thru 0x02013c (0x898c bytes) 000872 1789049780.716990 read 0x009cbc thru 0x00ffb5 (0x62fa bytes) 000874 1789049780.728491 punch from 0x019cf9 to 0x01bc5f (0x1f67 bytes) 000875 1789049780.736919 read 0x00078f thru 0x0072eb (0x6b5d bytes) 000876 1789049780.737568 trunc from 0x02c9f2 to 0x01f9c0 (0xd031 bytes) 000877 1789049780.785738 punch from 0x01deee to 0x01f9c0 (0x1ad3 bytes) 000881 1789049780.801701 write 0x026326 thru 0x0281f1 (0x1ecc bytes) 000882 1789049780.813243 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x281f2): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x281f2): Mirror 4: 0x5d0cd160 (stale) Mirror 6: 0x5d0cd160 (stale) Mirror 7: 0x5d0cd160 (stale) Mirror 8: 0x5d0cd160 (stale) Mirror 9: 0x5d0cd160 (stale) Mirror 10: 0x5d0cd160 (stale) Mirror 11: 0x5d0cd160 (stale) Mirror 12: 0x5d0cd160 (stale) Mirror 13: 0x5d0cd160 (stale) Mirror 14: 0x5d0cd160 (stale) Mirror 15: 0x5d0cd160 (stale) CRC-32 checksum value for chunk [0, 0x281f2): Mirror 1: 0x4aa129a8 Mirror 16: 0x4aa129a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x281f2: skipped 000884 1789049782.897546 write 0x01a032 thru 0x01bc64 (0x1c33 bytes) 000885 1789049783.147759 write 0x01a5de thru 0x026fed (0xca10 bytes) 000886 1789049783.167281 write 0x01f808 thru 0x023f57 (0x4750 bytes) 000890 1789049783.173189 mapread 0x02012b thru 0x02542d (0x5303 bytes) 000892 1789049783.174745 read 0x00871c thru 0x00d8df (0x51c4 bytes) 000893 1789049783.195211 write 0x027b0a thru 0x0318f4 (0x9deb bytes) 000894 1789049783.205399 read 0x008a79 thru 0x016523 (0xdaab bytes) 000896 1789049783.220129 trunc from 0x0318f5 to 0x019a0d (0x17ee7 bytes) 000900 1789049783.291058 MIRROR_RESYNC 13 mirrors 000901 1789049786.162340 punch from 0x015147 to 0x019a0d (0x48c7 bytes) 000902 1789049786.253352 write 0x0122da thru 0x01dec7 (0xbbee bytes) 000904 1789049786.261309 mapwrite 0x002a39 thru 0x00b64e (0x8c16 bytes) 000905 1789049786.359050 trunc from 0x01dec8 to 0x036682 (0x187bb bytes) 000906 1789049786.383641 read 0x013a4d thru 0x015b80 (0x2134 bytes) 000907 1789049786.390224 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x36683): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36683): Mirror 4: 0xdf4c6a4b (stale) Mirror 6: 0xdf4c6a4b (stale) Mirror 7: 0xdf4c6a4b (stale) Mirror 8: 0xdf4c6a4b (stale) Mirror 9: 0xdf4c6a4b (stale) Mirror 10: 0xdf4c6a4b (stale) Mirror 11: 0xdf4c6a4b (stale) Mirror 12: 0xdf4c6a4b (stale) Mirror 13: 0xdf4c6a4b (stale) Mirror 14: 0xdf4c6a4b (stale) Mirror 15: 0xdf4c6a4b (stale) Mirror 16: 0xdf4c6a4b (stale) CRC-32 checksum value for chunk [0, 0x36683): Mirror 1: 0x4880d9ea Mirror 17: 0x4880d9ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36683: skipped 000910 1789049787.996435 write 0x00665a thru 0x008918 (0x22bf bytes) 000913 1789049788.226868 trunc from 0x036683 to 0x0332f3 (0x338f bytes) 000914 1789049788.291476 trunc from 0x0332f4 to 0x003df1 (0x2f502 bytes) 000915 1789049788.336144 mapread 0x002154 thru 0x003df1 (0x1c9e bytes) 000917 1789049788.352082 mapwrite 0x02eda6 thru 0x03b8bb (0xcb16 bytes) 000918 1789049788.516154 mapwrite 0x033539 thru 0x03f27b (0xbd43 bytes) 000921 1789049788.608104 read 0x00b10f thru 0x015eba (0xadac bytes) 000922 1789049788.620083 mapwrite 0x02fced thru 0x0394fc (0x9810 bytes) 000923 1789049788.694431 mapread 0x00252e thru 0x0071b4 (0x4c87 bytes) 000924 1789049788.707195 punch from 0x02018e to 0x022a10 (0x2883 bytes) 000925 1789049788.712334 mapwrite 0x02fc24 thru 0x0307f4 (0xbd1 bytes) 000927 1789049788.791777 write 0x00ed83 thru 0x01224a (0x34c8 bytes) 000928 1789049788.793418 mapread 0x014374 thru 0x016cad (0x293a bytes) 000929 1789049788.809795 MIRROR_SPLIT mirror 8 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f27c): Mirror 4: 0xdbc9d2b1 (stale) Mirror 6: 0xdbc9d2b1 (stale) Mirror 7: 0xdbc9d2b1 (stale) Mirror 8: 0xdbc9d2b1 (stale) Mirror 9: 0xdbc9d2b1 (stale) Mirror 10: 0xdbc9d2b1 (stale) Mirror 11: 0xdbc9d2b1 (stale) Mirror 13: 0xdbc9d2b1 (stale) Mirror 14: 0xdbc9d2b1 (stale) Mirror 15: 0xdbc9d2b1 (stale) Mirror 16: 0xdbc9d2b1 (stale) Mirror 17: 0xaa97ea69 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f27c): Mirror 4: 0xdbc9d2b1 (stale) Mirror 6: 0xdbc9d2b1 (stale) Mirror 7: 0xdbc9d2b1 (stale) Mirror 8: 0xdbc9d2b1 (stale) Mirror 9: 0xdbc9d2b1 (stale) Mirror 10: 0xdbc9d2b1 (stale) Mirror 11: 0xdbc9d2b1 (stale) Mirror 13: 0xdbc9d2b1 (stale) Mirror 14: 0xdbc9d2b1 (stale) Mirror 15: 0xdbc9d2b1 (stale) Mirror 16: 0xdbc9d2b1 (stale) Mirror 17: 0xaa97ea69 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f27c: skipped 000930 1789049789.548109 trunc from 0x03f27c to 0x00d95a (0x31921 bytes) 000932 1789049789.572355 read 0x003b70 thru 0x00848f (0x4920 bytes) 000933 1789049789.583280 read 0x00cb9c thru 0x00d95a (0xdbf bytes) 000934 1789049789.593719 read 0x00c9f4 thru 0x00d95a (0xf67 bytes) 000935 1789049789.594850 trunc from 0x00d95b to 0x034a60 (0x27106 bytes) 000936 1789049789.622944 punch from 0x008ca2 to 0x01498d (0xbcec bytes) 000939 1789049789.632341 read 0x01eb8f thru 0x029daa (0xb21c bytes) 000941 1789049789.655141 read 0x017b96 thru 0x01b7fd (0x3c68 bytes) 000942 1789049789.656179 trunc from 0x034a61 to 0x009a4f (0x2b011 bytes) 000943 1789049789.673935 trunc from 0x009a50 to 0x0036a9 (0x63a6 bytes) 000944 1789049789.695257 write 0x02ace4 thru 0x038f76 (0xe293 bytes) 000946 1789049789.703165 mapread 0x007027 thru 0x015fec (0xefc6 bytes) 000947 1789049789.712539 mapread 0x012c32 thru 0x02065f (0xda2e bytes) 000950 1789049789.719536 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ae:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38f77): Mirror 4: 0x56e0e164 (stale) Mirror 6: 0x56e0e164 (stale) Mirror 7: 0x56e0e164 (stale) Mirror 9: 0x56e0e164 (stale) Mirror 10: 0x56e0e164 (stale) Mirror 11: 0x56e0e164 (stale) Mirror 13: 0x56e0e164 (stale) Mirror 14: 0x56e0e164 (stale) Mirror 15: 0x56e0e164 (stale) Mirror 16: 0x56e0e164 (stale) Mirror 17: 0xa37e876 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38f77): Mirror 4: 0x56e0e164 (stale) Mirror 6: 0x56e0e164 (stale) Mirror 7: 0x56e0e164 (stale) Mirror 9: 0x56e0e164 (stale) Mirror 10: 0x56e0e164 (stale) Mirror 11: 0x56e0e164 (stale) Mirror 13: 0x56e0e164 (stale) Mirror 14: 0x56e0e164 (stale) Mirror 15: 0x56e0e164 (stale) Mirror 16: 0x56e0e164 (stale) Mirror 17: 0xa37e876 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38f77: skipped 000951 1789049790.417216 MIRROR_RESYNC 12 mirrors 000952 1789049792.473659 mapwrite 0x030846 thru 0x03c0d9 (0xb894 bytes) 000954 1789049792.674498 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3c0da): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c0da): Mirror 4: 0xb5f785b4 (stale) Mirror 6: 0xb5f785b4 (stale) Mirror 7: 0xb5f785b4 (stale) Mirror 9: 0xb5f785b4 (stale) Mirror 10: 0xb5f785b4 (stale) Mirror 11: 0xb5f785b4 (stale) Mirror 13: 0xb5f785b4 (stale) Mirror 14: 0xb5f785b4 (stale) Mirror 15: 0xb5f785b4 (stale) Mirror 16: 0xb5f785b4 (stale) Mirror 17: 0xb5f785b4 (stale) CRC-32 checksum value for chunk [0, 0x3c0da): Mirror 1: 0x984fa6ce Mirror 18: 0x984fa6ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c0da: skipped 000955 1789049793.721548 write 0x038ca3 thru 0x03d379 (0x46d7 bytes) 000956 1789049793.826275 punch from 0x00134d to 0x00d44d (0xc101 bytes) 000958 1789049793.843129 write 0x01bfa3 thru 0x0267eb (0xa849 bytes) 000959 1789049793.853286 read 0x00f69a thru 0x019849 (0xa1b0 bytes) 000961 1789049793.868539 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3d37a): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d37a): Mirror 4: 0xf5c0f6ef (stale) Mirror 6: 0xf5c0f6ef (stale) Mirror 7: 0xf5c0f6ef (stale) Mirror 9: 0xf5c0f6ef (stale) Mirror 10: 0xf5c0f6ef (stale) Mirror 11: 0xf5c0f6ef (stale) Mirror 13: 0xf5c0f6ef (stale) Mirror 14: 0xf5c0f6ef (stale) Mirror 15: 0xf5c0f6ef (stale) Mirror 16: 0xf5c0f6ef (stale) Mirror 17: 0xf5c0f6ef (stale) Mirror 18: 0x66fed4 (stale) CRC-32 checksum value for chunk [0, 0x3d37a): Mirror 1: 0xada4c127 Mirror 19: 0xada4c127 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d37a: skipped 000963 1789049795.319782 mapread 0x011328 thru 0x017d11 (0x69ea bytes) 000965 1789049795.358218 MIRROR_RESYNC 14 mirrors 000966 1789049797.473811 MIRROR_RESYNC 14 mirrors 000968 1789049798.515575 punch from 0x0140ad to 0x014c97 (0xbeb bytes) 000970 1789049798.687816 mapwrite 0x014134 thru 0x01b1a4 (0x7071 bytes) 000971 1789049798.818508 read 0x01b1f6 thru 0x01e04f (0x2e5a bytes) 000973 1789049798.819806 mapread 0x02ccb1 thru 0x034260 (0x75b0 bytes) 000978 1789049798.841442 read 0x01c994 thru 0x0280bd (0xb72a bytes) 000979 1789049798.854525 punch from 0x004fa3 to 0x00b96f (0x69cd bytes) 000980 1789049798.866801 MIRROR_RESYNC 14 mirrors 000983 1789049801.283164 mapwrite 0x01adb3 thru 0x01d5d5 (0x2823 bytes) 000985 1789049801.539062 punch from 0x026442 to 0x0319f4 (0xb5b3 bytes) 000986 1789049801.549914 read 0x031e31 thru 0x03d379 (0xb549 bytes) 000987 1789049801.561902 mapwrite 0x01e7c1 thru 0x02afff (0xc83f bytes) 000988 1789049801.666988 read 0x03b514 thru 0x03d379 (0x1e66 bytes) 000989 1789049801.667545 trunc from 0x03d37a to 0x02ee10 (0xe569 bytes) 000990 1789049801.714495 punch from 0x01656b to 0x023a8a (0xd520 bytes) 000991 1789049801.735226 mapread 0x0138b2 thru 0x016370 (0x2abf bytes) 000992 1789049801.775348 punch from 0x018ba5 to 0x02072a (0x7b86 bytes) 000994 1789049801.790894 mapread 0x00e229 thru 0x0104b1 (0x2289 bytes) 000996 1789049801.803281 trunc from 0x02ee11 to 0x03d655 (0xe845 bytes) 000997 1789049801.823181 mapread 0x00173c thru 0x003d09 (0x25ce bytes) 000998 1789049801.829134 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3d656): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d656): Mirror 4: 0x1abffe7f (stale) Mirror 6: 0x1abffe7f (stale) Mirror 7: 0x1abffe7f (stale) Mirror 9: 0x1abffe7f (stale) Mirror 10: 0x1abffe7f (stale) Mirror 11: 0x1abffe7f (stale) Mirror 13: 0x1abffe7f (stale) Mirror 14: 0x1abffe7f (stale) Mirror 15: 0x1abffe7f (stale) Mirror 16: 0x1abffe7f (stale) Mirror 17: 0x1abffe7f (stale) Mirror 18: 0x1abffe7f (stale) Mirror 19: 0x1abffe7f (stale) CRC-32 checksum value for chunk [0, 0x3d656): Mirror 1: 0x100d2426 Mirror 20: 0x100d2426 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d656: skipped 000999 1789049803.187214 mapwrite 0x00da3b thru 0x0177b8 (0x9d7e bytes) All operations completed A-OK!