== sanity-flr test 70a: flr mode fsx test ================ 09:15:41 (1789996541) Seed set to 6542 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero length punch hole truncating to largest ever: 0x146a3 000006 1789996542.613796 trunc from 00000000 to 0x0146a2 (0x146a3 bytes) 000009 1789996542.622490 mapread 0x0059f9 thru 0x007ecc (0x24d4 bytes) truncating to largest ever: 0x1585a 000010 1789996542.636056 trunc from 0x0146a3 to 0x015859 (0x11b7 bytes) truncating to largest ever: 0x18a5d 000016 1789996542.644241 trunc from 0x01585a to 0x018a5c (0x3203 bytes) 000018 1789996542.653596 punch from 0x01258d to 0x015e59 (0x38cd bytes) 000020 1789996542.656663 write 0x03d99b thru 0x03ffff (0x2665 bytes) 000022 1789996542.658079 read 0x015f5e thru 0x01b72c (0x57cf bytes) 000023 1789996542.661328 write 0x006bd7 thru 0x00e7a8 (0x7bd2 bytes) truncating to largest ever: 0x2a520 000024 1789996542.662419 trunc from 0x040000 to 0x02a51f (0x15ae0 bytes) truncating to largest ever: 0x3e139 000025 1789996542.673893 trunc from 0x02a520 to 0x03e138 (0x13c19 bytes) 000030 1789996542.685412 trunc from 0x03e139 to 0x0012ff (0x3ce39 bytes) 000031 1789996542.689947 read 0x0007a1 thru 0x0012ff (0xb5f bytes) 000033 1789996542.692053 read 0x000a1f thru 0x0012ff (0x8e1 bytes) 000034 1789996542.692458 mapread 0x000b37 thru 0x0012ff (0x7c9 bytes) 000036 1789996542.693420 trunc from 0x001300 to 0x037418 (0x36119 bytes) 000037 1789996542.702795 read 0x02f8c1 thru 0x037418 (0x7b58 bytes) 000038 1789996542.707618 write 0x015e87 thru 0x018aa3 (0x2c1d bytes) 000039 1789996542.708340 punch from 0x0023db to 0x0084e3 (0x6109 bytes) 000040 1789996542.713753 mapread 0x0092ce thru 0x00d2d5 (0x4008 bytes) 000042 1789996542.714983 trunc from 0x037419 to 0x00b044 (0x2c3d4 bytes) 000044 1789996542.722007 trunc from 0x00b045 to 0x01a4a1 (0xf45d bytes) 000045 1789996542.731225 write 0x03a5f0 thru 0x03ffff (0x5a10 bytes) 000046 1789996542.732326 read 0x033195 thru 0x036642 (0x34ae bytes) 000047 1789996542.740750 mapwrite 0x01b86d thru 0x0260b7 (0xa84b bytes) 000048 1789996542.763873 write 0x03b0ef thru 0x03f0a9 (0x3fbb bytes) 000050 1789996542.765042 mapread 0x015b17 thru 0x015de4 (0x2ce bytes) 000053 1789996542.771695 MIRROR_EXTEND to 2 mirrors 000054 1789996543.033325 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) 000056 1789996543.071367 mapwrite 0x014143 thru 0x01f204 (0xb0c2 bytes) 000057 1789996543.094488 write 0x029aca thru 0x0379af (0xdee6 bytes) 000058 1789996543.099933 write 0x009af3 thru 0x00a05d (0x56b bytes) 000059 1789996543.102719 read 0x01bfc9 thru 0x01c59b (0x5d3 bytes) 000060 1789996543.103078 trunc from 0x040000 to 0x037a25 (0x85da bytes) 000061 1789996543.116116 mapwrite 0x017400 thru 0x022b1b (0xb71c bytes) 000062 1789996543.137980 MIRROR_EXTEND to 2 mirrors 000063 1789996543.366866 MIRROR_EXTEND to 3 mirrors 000064 1789996543.607637 mapwrite 0x018c37 thru 0x021012 (0x83dc bytes) 000065 1789996543.680061 write 0x03b6eb thru 0x03ec44 (0x355a bytes) 000066 1789996543.680887 write 0x032932 thru 0x0379e1 (0x50b0 bytes) 000067 1789996543.684690 mapwrite 0x03c505 thru 0x03ffff (0x3afb bytes) 000069 1789996543.725783 trunc from 0x040000 to 0x029a7a (0x16585 bytes) 000071 1789996543.736484 write 0x03f37a thru 0x03ffff (0xc86 bytes) 000072 1789996543.737358 trunc from 0x040000 to 0x0200b9 (0x1ff46 bytes) truncating to largest ever: 0x3e30a 000073 1789996543.743684 trunc from 0x0200ba to 0x03e309 (0x1e250 bytes) 000074 1789996543.750961 punch from 0x028821 to 0x02d8dd (0x50bd bytes) 000075 1789996543.755719 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e30a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e30a): Mirror 2: 0x1148e15f (stale) Mirror 3: 0x1148e15f (stale) CRC-32 checksum value for chunk [0, 0x3e30a): Mirror 1: 0x3630bd2b Mirror 4: 0x3630bd2b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e30a: skipped 000077 1789996544.104228 mapwrite 0x025144 thru 0x034a95 (0xf952 bytes) 000078 1789996544.184425 punch from 0x02f9ff to 0x030d08 (0x130a bytes) 000079 1789996544.185984 read 0x0143f0 thru 0x020876 (0xc487 bytes) 000080 1789996544.188871 punch from 0x006b6a to 0x013299 (0xc730 bytes) 000081 1789996544.190379 read 0x036fec thru 0x039938 (0x294d bytes) 000082 1789996544.193263 mapwrite 0x0179ac thru 0x0232db (0xb930 bytes) 000086 1789996544.206656 punch from 0x01a3f8 to 0x01bb70 (0x1779 bytes) 000087 1789996544.208348 punch from 0x031760 to 0x031e0f (0x6b0 bytes) 000088 1789996544.209662 write 0x00cf24 thru 0x01ce5b (0xff38 bytes) 000089 1789996544.210612 read 0x0229ed thru 0x02b6cd (0x8ce1 bytes) 000092 1789996544.211663 trunc from 0x03e30a to 0x002adc (0x3b82d bytes) 000093 1789996544.220525 trunc from 0x002add to 0x029c0d (0x27131 bytes) 000094 1789996544.223992 punch from 0x008642 to 0x00f1d6 (0x6b95 bytes) 000095 1789996544.225161 mapwrite 0x03a9c5 thru 0x03d801 (0x2e3d bytes) 000096 1789996544.243195 punch from 0x002d42 to 0x010a2b (0xdcea bytes) 000097 1789996544.245039 punch from 0x035e18 to 0x0390f8 (0x32e1 bytes) 000099 1789996544.247214 mapwrite 0x033362 thru 0x03df48 (0xabe7 bytes) 000100 1789996544.278124 MIRROR_RESYNC 4 mirrors 000101 1789996544.572667 MIRROR_EXTEND to 5 mirrors 000102 1789996544.766749 write 0x028f29 thru 0x0384af (0xf587 bytes) 000103 1789996544.793174 read 0x0184b5 thru 0x01cc43 (0x478f bytes) 000105 1789996544.796657 punch from 0x004ef0 to 0x00a68a (0x579b bytes) 000106 1789996544.800922 read 0x0049cf thru 0x00a78e (0x5dc0 bytes) 000108 1789996544.806751 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3df49): Mirror 3: 0xf88485f2 (stale) Mirror 4: 0xf88485f2 (stale) Mirror 5: 0xf88485f2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3df49): Mirror 3: 0xf88485f2 (stale) Mirror 4: 0xf88485f2 (stale) Mirror 5: 0xf88485f2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3df49: skipped 000109 1789996544.896894 write 0x03521c thru 0x03dab6 (0x889b bytes) 000110 1789996544.899982 mapread 0x0319f2 thru 0x0354b6 (0x3ac5 bytes) 000111 1789996544.904603 read 0x03a348 thru 0x03d9f9 (0x36b2 bytes) 000112 1789996544.904937 read 0x010a76 thru 0x01a918 (0x9ea3 bytes) 000113 1789996544.909089 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3df49): Mirror 3: 0xf88485f2 (stale) Mirror 5: 0xf88485f2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3df49): Mirror 3: 0xf88485f2 (stale) Mirror 5: 0xf88485f2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3df49: skipped 000114 1789996544.994977 write 0x02925e thru 0x03121b (0x7fbe bytes) 000115 1789996544.998021 read 0x02b1eb thru 0x03880c (0xd622 bytes) 000117 1789996545.000870 read 0x001df5 thru 0x00d4b1 (0xb6bd bytes) 000118 1789996545.003974 read 0x01f08b thru 0x025471 (0x63e7 bytes) 000119 1789996545.004328 write 0x03cebe thru 0x03ffff (0x3142 bytes) 000120 1789996545.004944 mapread 0x0107a3 thru 0x0133d3 (0x2c31 bytes) 000121 1789996545.005605 read 0x0123db thru 0x015524 (0x314a bytes) 000124 1789996545.006799 mapwrite 0x01a159 thru 0x028b76 (0xea1e bytes) 000126 1789996545.021075 mapwrite 0x03eed8 thru 0x03ffff (0x1128 bytes) 000128 1789996545.032122 read 0x02e9d9 thru 0x02f585 (0xbad bytes) 000129 1789996545.032471 trunc from 0x040000 to 0x012fb4 (0x2d04b bytes) 000130 1789996545.041072 mapwrite 0x017c6c thru 0x022a4f (0xade4 bytes) 000131 1789996545.062119 mapread 0x01fa4e thru 0x022a4f (0x3002 bytes) 000133 1789996545.063067 write 0x021553 thru 0x02c71e (0xb1cc bytes) 000134 1789996545.064244 mapwrite 0x017939 thru 0x019f56 (0x261e bytes) 000135 1789996545.078242 mapread 0x00b587 thru 0x00d399 (0x1e13 bytes) 000136 1789996545.078869 write 0x01a0f4 thru 0x01c400 (0x230d bytes) 000137 1789996545.080925 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c71f): Mirror 5: 0xfb6889bc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c71f): Mirror 5: 0xfb6889bc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c71f: skipped 000138 1789996545.158940 mapread 0x00bcf5 thru 0x00f972 (0x3c7e bytes) 000139 1789996545.164781 trunc from 0x02c71f to 0x01bd03 (0x10a1b bytes) 000141 1789996545.170148 write 0x010130 thru 0x01f6af (0xf580 bytes) 000142 1789996545.171615 trunc from 0x01f6b0 to 0x01dd57 (0x1958 bytes) 000143 1789996545.176786 trunc from 0x01dd58 to 0x024f76 (0x721f bytes) 000145 1789996545.181726 mapread 0x014ab1 thru 0x02302a (0xe57a bytes) 000147 1789996545.187104 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x24f77): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24f77): Mirror 5: 0xfc1c8623 (stale) CRC-32 checksum value for chunk [0, 0x24f77): Mirror 1: 0x6c544750 Mirror 6: 0x6c544750 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24f77: skipped 000148 1789996545.445398 read 0x01749d thru 0x0241f7 (0xcd5b bytes) 000149 1789996545.450331 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x24f77): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24f77): Mirror 5: 0xfc1c8623 (stale) CRC-32 checksum value for chunk [0, 0x24f77): Mirror 1: 0x6c544750 Mirror 6: 0x6c544750 Mirror 7: 0x6c544750 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24f77: skipped 000152 1789996545.689558 mapread 0x00ca09 thru 0x018886 (0xbe7e bytes) 000153 1789996545.700248 write 0x031049 thru 0x03ffff (0xefb7 bytes) 000154 1789996545.722295 read 0x003495 thru 0x00dd7f (0xa8eb bytes) 000156 1789996545.727145 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x83bc555a (stale) Mirror 7: 0x4d4ad437 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x83bc555a (stale) Mirror 7: 0x4d4ad437 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000157 1789996545.819702 read 0x03382e thru 0x03e51b (0xacee bytes) 000158 1789996545.823023 mapwrite 0x02703f thru 0x0294ad (0x246f bytes) 000159 1789996545.849680 mapread 0x030ddb thru 0x032d2d (0x1f53 bytes) 000160 1789996545.854315 MIRROR_RESYNC 3 mirrors 000161 1789996546.311204 write 0x027f38 thru 0x02c30c (0x43d5 bytes) 000162 1789996546.336425 mapwrite 0x02e497 thru 0x037527 (0x9091 bytes) 000163 1789996546.360751 MIRROR_RESYNC 3 mirrors 000164 1789996546.634312 punch from 0x014b54 to 0x014d4b (0x1f8 bytes) 000167 1789996546.656974 mapwrite 0x032b26 thru 0x03ffff (0xd4da bytes) 000168 1789996546.677456 trunc from 0x040000 to 0x00887c (0x37783 bytes) 000169 1789996546.692801 trunc from 0x00887d to 0x0049cd (0x3eaf bytes) 000170 1789996546.699463 trunc from 0x0049ce to 0x019883 (0x14eb6 bytes) 000171 1789996546.704852 write 0x025199 thru 0x030dd8 (0xbc40 bytes) 000172 1789996546.706261 write 0x0214d3 thru 0x02c56a (0xb098 bytes) 000173 1789996546.708868 punch from 0x0105fb to 0x010772 (0x178 bytes) 000174 1789996546.715468 mapread 0x00a7a9 thru 0x00e1c1 (0x3a19 bytes) 000177 1789996546.720084 mapread 0x0287ff thru 0x030dd8 (0x85da bytes) 000179 1789996546.721009 punch from 0x021a46 to 0x027571 (0x5b2c bytes) 000181 1789996546.725944 mapread 0x02ff33 thru 0x030dd8 (0xea6 bytes) 000183 1789996546.728595 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x30dd9): Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30dd9): Mirror 5: 0x8ee9ec7e (stale) Mirror 7: 0x8ee9ec7e (stale) CRC-32 checksum value for chunk [0, 0x30dd9): Mirror 1: 0xcae7eab Mirror 8: 0xcae7eab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30dd9: skipped 000184 1789996547.050458 read 0x022d66 thru 0x02874c (0x59e7 bytes) 000185 1789996547.057619 mapwrite 0x032872 thru 0x03a3f4 (0x7b83 bytes) 000186 1789996547.125520 mapwrite 0x01ec41 thru 0x0252ee (0x66ae bytes) 000187 1789996547.144820 write 0x02049f thru 0x024687 (0x41e9 bytes) 000188 1789996547.145653 read 0x0297d0 thru 0x031b77 (0x83a8 bytes) 000190 1789996547.150695 punch from 0x032b09 to 0x038c31 (0x6129 bytes) 000191 1789996547.154375 punch from 0x02ab34 to 0x02f9dc (0x4ea9 bytes) 000192 1789996547.155825 write 0x00ae44 thru 0x0157c8 (0xa985 bytes) 000193 1789996547.156590 mapread 0x013f5e thru 0x0198ba (0x595d bytes) 000196 1789996547.159828 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a3f5): Mirror 7: 0x63173e3 (stale) Mirror 8: 0x379a38bf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a3f5): Mirror 7: 0x63173e3 (stale) Mirror 8: 0x379a38bf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a3f5: skipped 000197 1789996547.258731 trunc from 0x03a3f5 to 0x01355f (0x26e95 bytes) 000199 1789996547.268740 read 0x002b68 thru 0x012062 (0xf4fb bytes) 000200 1789996547.271938 punch from 0x0020b2 to 0x00fa38 (0xd987 bytes) 000201 1789996547.274055 punch from 0x002079 to 0x00254a (0x4d2 bytes) 000202 1789996547.276072 mapwrite 0x01a30a thru 0x02064a (0x6341 bytes) 000204 1789996547.308676 mapwrite 0x01abb0 thru 0x01b6cd (0xb1e bytes) 000205 1789996547.320207 mapwrite 0x01904b thru 0x01ef1f (0x5ed5 bytes) 000206 1789996547.332071 mapread 0x00f9c4 thru 0x013a73 (0x40b0 bytes) 000209 1789996547.336206 read 0x01125e thru 0x01f2be (0xe061 bytes) 000212 1789996547.337696 punch from 0x00fa67 to 0x013fd9 (0x4573 bytes) 000213 1789996547.339955 trunc from 0x02064b to 0x0114e2 (0xf168 bytes) 000215 1789996547.344819 mapwrite 0x03c2e7 thru 0x03ffff (0x3d19 bytes) 000217 1789996547.383828 MIRROR_RESYNC 3 mirrors 000219 1789996547.682352 write 0x0388d4 thru 0x03ffff (0x772c bytes) 000220 1789996547.717467 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x9e69f274 (stale) Mirror 8: 0x9e69f274 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfd8615cb Mirror 9: 0xfd8615cb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000221 1789996548.054182 read 0x01e769 thru 0x01fad1 (0x1369 bytes) 000222 1789996548.072348 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9e69f274 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9e69f274 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfd8615cb Mirror 9: 0xfd8615cb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000223 1789996548.297022 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9e69f274 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9e69f274 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000226 1789996548.395724 MIRROR_RESYNC 2 mirrors 000227 1789996548.640710 write 0x02b4b7 thru 0x037df3 (0xc93d bytes) 000229 1789996548.657777 trunc from 0x040000 to 0x022b28 (0x1d4d7 bytes) 000230 1789996548.662809 write 0x00f071 thru 0x0146ef (0x567f bytes) 000232 1789996548.666478 trunc from 0x022b29 to 0x03b873 (0x18d4b bytes) 000233 1789996548.672634 MIRROR_RESYNC 2 mirrors 000234 1789996548.876725 trunc from 0x03b874 to 0x0132d2 (0x285a1 bytes) 000236 1789996548.900657 write 0x02eef5 thru 0x03704a (0x8156 bytes) 000237 1789996548.901648 trunc from 0x03704b to 0x009f1b (0x2d12f bytes) 000238 1789996548.907919 mapwrite 0x004abb thru 0x00d27c (0x87c2 bytes) 000239 1789996548.931696 read 0x00ad14 thru 0x00d27c (0x2569 bytes) 000240 1789996548.932266 trunc from 0x00d27d to 0x00ba2c (0x1850 bytes) 000241 1789996548.938249 trunc from 0x00ba2d to 0x019cfe (0xe2d2 bytes) 000242 1789996548.945480 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) 000243 1789996548.980914 read 0x00bc9a thru 0x00cc3f (0xfa6 bytes) 000245 1789996548.983300 read 0x00db14 thru 0x019cfe (0xc1eb bytes) 000248 1789996548.986758 write 0x03edc8 thru 0x03ffff (0x1238 bytes) 000249 1789996548.987333 write 0x00b1e1 thru 0x014981 (0x97a1 bytes) 000250 1789996548.987980 read 0x0361f1 thru 0x03b8ce (0x56de bytes) 000251 1789996548.990479 read 0x02068c thru 0x023ec1 (0x3836 bytes) 000252 1789996548.992330 MIRROR_EXTEND to 2 mirrors 000253 1789996549.227227 trunc from 0x040000 to 0x0381cf (0x7e30 bytes) 000254 1789996549.256107 trunc from 0x0381d0 to 0x02e734 (0x9a9b bytes) 000255 1789996549.265842 mapwrite 0x031ad2 thru 0x0356e2 (0x3c11 bytes) 000256 1789996549.291420 mapwrite 0x00a598 thru 0x016c8b (0xc6f4 bytes) 000257 1789996549.309765 mapwrite 0x0216d4 thru 0x02a5a3 (0x8ed0 bytes) 000258 1789996549.329599 punch from 0x029e9b to 0x02cff3 (0x3159 bytes) 000259 1789996549.331723 trunc from 0x0356e3 to 0x02dae2 (0x7c00 bytes) 000260 1789996549.336552 read 0x02c1b6 thru 0x02dae2 (0x192d bytes) 000262 1789996549.340837 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) 000264 1789996549.384319 mapread 0x010389 thru 0x010749 (0x3c1 bytes) 000267 1789996549.387978 read 0x00ff95 thru 0x0131e0 (0x324c bytes) 000268 1789996549.390654 write 0x004f30 thru 0x013e69 (0xef3a bytes) 000270 1789996549.393209 write 0x007fc0 thru 0x017842 (0xf883 bytes) 000273 1789996549.396286 punch from 0x01df53 to 0x02379d (0x584b bytes) 000274 1789996549.400133 mapwrite 0x010eee thru 0x01b20b (0xa31e bytes) 000275 1789996549.417384 read 0x01c091 thru 0x021546 (0x54b6 bytes) 000276 1789996549.417980 read 0x00c94c thru 0x0140a9 (0x775e bytes) 000278 1789996549.418865 mapwrite 0x003d68 thru 0x0081a7 (0x4440 bytes) 000279 1789996549.435835 trunc from 0x02dae3 to 0x009917 (0x241cb bytes) 000281 1789996549.441726 trunc from 0x009918 to 0x00eaf4 (0x51dd bytes) 000283 1789996549.446640 write 0x02aefd thru 0x02f930 (0x4a34 bytes) 000284 1789996549.447718 mapread 0x02dcf2 thru 0x02f930 (0x1c3f bytes) 000285 1789996549.448470 mapwrite 0x009a37 thru 0x00e4be (0x4a88 bytes) 000287 1789996549.471347 read 0x022a53 thru 0x024551 (0x1aff bytes) 000289 1789996549.475186 read 0x00da2b thru 0x01c55c (0xeb32 bytes) 000294 1789996549.477912 read 0x007ae2 thru 0x00dc08 (0x6127 bytes) 000296 1789996549.479187 read 0x00e7cf thru 0x01bf33 (0xd765 bytes) 000298 1789996549.480157 mapread 0x0235c5 thru 0x02d2dd (0x9d19 bytes) 000299 1789996549.481007 read 0x006f45 thru 0x00c440 (0x54fc bytes) 000303 1789996549.482863 mapread 0x00f8be thru 0x016cb5 (0x73f8 bytes) 000305 1789996549.484069 punch from 0x013377 to 0x022087 (0xed11 bytes) 000306 1789996549.486338 punch from 0x021194 to 0x02f930 (0xe79d bytes) 000309 1789996549.489066 mapwrite 0x01427a thru 0x017923 (0x36aa bytes) 000310 1789996549.506419 write 0x00a642 thru 0x00aded (0x7ac bytes) 000312 1789996549.509800 MIRROR_EXTEND to 2 mirrors 000313 1789996549.750549 mapwrite 0x03fe26 thru 0x03ffff (0x1da bytes) 000314 1789996549.809691 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) 000315 1789996549.855795 write 0x032de1 thru 0x03ba16 (0x8c36 bytes) 000316 1789996549.859387 write 0x03e4f7 thru 0x03ffff (0x1b09 bytes) 000317 1789996549.861497 mapread 0x0345ca thru 0x03d413 (0x8e4a bytes) 000318 1789996549.864165 trunc from 0x040000 to 0x036d61 (0x929e bytes) 000320 1789996549.869118 mapread 0x00f548 thru 0x0191b3 (0x9c6c bytes) 000321 1789996549.875383 mapwrite 0x01db49 thru 0x027e18 (0xa2d0 bytes) 000324 1789996549.896028 mapwrite 0x00b0cb thru 0x010689 (0x55bf bytes) 000326 1789996549.911681 write 0x0208a1 thru 0x02918a (0x88ea bytes) 000327 1789996549.912756 mapwrite 0x019772 thru 0x0278ae (0xe13d bytes) 000328 1789996549.930511 MIRROR_EXTEND to 2 mirrors 000329 1789996550.201851 mapwrite 0x00eb70 thru 0x012622 (0x3ab3 bytes) 000330 1789996550.254436 read 0x0109e8 thru 0x017ce8 (0x7301 bytes) 000332 1789996550.255474 punch from 0x0226d1 to 0x02a776 (0x80a6 bytes) 000334 1789996550.263850 mapwrite 0x02d6dc thru 0x0316c6 (0x3feb bytes) 000335 1789996550.289015 punch from 0x028b15 to 0x0337be (0xacaa bytes) 000336 1789996550.294894 mapwrite 0x00dc8d thru 0x01091f (0x2c93 bytes) 000337 1789996550.310984 read 0x00479c thru 0x0107d4 (0xc039 bytes) 000338 1789996550.315080 mapwrite 0x036fdf thru 0x03e718 (0x773a bytes) 000339 1789996550.351329 mapwrite 0x022115 thru 0x0262c2 (0x41ae bytes) 000340 1789996550.366422 trunc from 0x03e719 to 0x00f784 (0x2ef94 bytes) 000342 1789996550.374171 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) 000344 1789996550.426073 read 0x000ee5 thru 0x00e41a (0xd536 bytes) 000345 1789996550.429749 mapread 0x006eaf thru 0x00c826 (0x5978 bytes) 000346 1789996550.430613 read 0x006c67 thru 0x00f784 (0x8b1e bytes) 000348 1789996550.442438 MIRROR_EXTEND to 2 mirrors 000349 1789996550.650759 write 0x027b5e thru 0x030647 (0x8aea bytes) 000351 1789996550.672224 mapread 0x007ba2 thru 0x00d00d (0x546c bytes) 000352 1789996550.677920 read 0x02727c thru 0x02a5ed (0x3372 bytes) 000353 1789996550.678487 mapread 0x01b362 thru 0x02709f (0xbd3e bytes) 000356 1789996550.684286 punch from 0x0290c1 to 0x030647 (0x7587 bytes) 000357 1789996550.688886 read 0x01a5c3 thru 0x0286c9 (0xe107 bytes) 000358 1789996550.689539 punch from 0x00b3ca to 0x0163c5 (0xaffc bytes) 000359 1789996550.691676 punch from 0x02e273 to 0x030647 (0x23d5 bytes) 000360 1789996550.693735 punch from 0x02d376 to 0x030647 (0x32d2 bytes) 000363 1789996550.696770 mapread 0x02e17e thru 0x030647 (0x24ca bytes) 000366 1789996550.702788 mapread 0x006354 thru 0x00929f (0x2f4c bytes) 000368 1789996550.703891 read 0x0183f3 thru 0x01e0c9 (0x5cd7 bytes) 000370 1789996550.704763 punch from 0x021f3f to 0x02232c (0x3ee bytes) 000371 1789996550.707407 mapread 0x009690 thru 0x00a008 (0x979 bytes) 000372 1789996550.708298 write 0x0043a0 thru 0x010b4f (0xc7b0 bytes) 000375 1789996550.710857 punch from 0x0130f5 to 0x013a8f (0x99b bytes) 000376 1789996550.720971 trunc from 0x030648 to 0x034e41 (0x47fa bytes) 000377 1789996550.744554 mapread 0x01daa9 thru 0x023f68 (0x64c0 bytes) 000379 1789996550.752394 trunc from 0x034e42 to 0x020918 (0x14529 bytes) 000380 1789996550.768293 write 0x021ed7 thru 0x022709 (0x833 bytes) 000381 1789996550.769796 punch from 0x019c26 to 0x022709 (0x8ae4 bytes) 000382 1789996550.779058 MIRROR_RESYNC 2 mirrors 000383 1789996551.011158 read 0x00b74b thru 0x019a86 (0xe33c bytes) 000384 1789996551.019224 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) 000385 1789996551.060311 mapread 0x005f76 thru 0x011141 (0xb1cc bytes) 000386 1789996551.072997 write 0x013ecd thru 0x01e407 (0xa53b bytes) 000388 1789996551.079827 write 0x022e45 thru 0x02681a (0x39d6 bytes) 000389 1789996551.081831 read 0x024694 thru 0x02681a (0x2187 bytes) 000390 1789996551.082264 mapwrite 0x03193f thru 0x031f97 (0x659 bytes) 000394 1789996551.111426 write 0x017102 thru 0x01f341 (0x8240 bytes) 000395 1789996551.112539 mapwrite 0x0210cf thru 0x0229ef (0x1921 bytes) 000396 1789996551.141209 punch from 0x00298e to 0x00e456 (0xbac9 bytes) 000399 1789996551.145610 MIRROR_EXTEND to 2 mirrors 000400 1789996551.391082 write 0x01fe23 thru 0x0298af (0x9a8d bytes) 000401 1789996551.426297 punch from 0x02a986 to 0x031f97 (0x7612 bytes) 000402 1789996551.434650 read 0x00efa3 thru 0x012575 (0x35d3 bytes) 000403 1789996551.437280 mapread 0x011ad2 thru 0x01f4be (0xd9ed bytes) 000404 1789996551.443732 punch from 0x008a1f to 0x01878c (0xfd6e bytes) 000405 1789996551.445594 mapread 0x01daba thru 0x0203a5 (0x28ec bytes) 000406 1789996551.446247 mapread 0x013799 thru 0x01aef8 (0x7760 bytes) 000407 1789996551.449355 punch from 0x02296e to 0x02b262 (0x88f5 bytes) 000408 1789996551.450966 read 0x008402 thru 0x00b62e (0x322d bytes) 000409 1789996551.455380 mapread 0x004648 thru 0x013d67 (0xf720 bytes) 000411 1789996551.456710 read 0x0004a1 thru 0x0061c3 (0x5d23 bytes) 000412 1789996551.457023 trunc from 0x031f98 to 0x02c87c (0x571b bytes) 000413 1789996551.467840 mapread 0x018415 thru 0x023031 (0xac1d bytes) 000414 1789996551.468670 mapread 0x005dac thru 0x0065c8 (0x81d bytes) 000415 1789996551.469148 write 0x0014bc thru 0x0021c4 (0xd09 bytes) 000419 1789996551.470739 read 0x022611 thru 0x028469 (0x5e59 bytes) 000420 1789996551.471271 trunc from 0x02c87d to 0x03c199 (0xf91d bytes) 000421 1789996551.476020 read 0x03b462 thru 0x03c199 (0xd38 bytes) 000422 1789996551.479037 write 0x029710 thru 0x02f52f (0x5e20 bytes) 000423 1789996551.479963 trunc from 0x03c19a to 0x0189c9 (0x237d0 bytes) 000428 1789996551.486037 write 0x0257e3 thru 0x03105c (0xb87a bytes) 000429 1789996551.486973 trunc from 0x03105d to 0x007282 (0x29dda bytes) 000431 1789996551.493891 write 0x0033c9 thru 0x0040c7 (0xcff bytes) 000432 1789996551.494766 trunc from 0x007283 to 0x032a23 (0x2b7a1 bytes) 000433 1789996551.501697 punch from 0x012bc0 to 0x01e515 (0xb956 bytes) 000434 1789996551.507221 MIRROR_RESYNC 2 mirrors 000436 1789996551.867890 read 0x00b547 thru 0x00e514 (0x2fce bytes) 000437 1789996551.870982 punch from 0x01b85f to 0x021d29 (0x64cb bytes) 000438 1789996551.907671 read 0x011a16 thru 0x017e5f (0x644a bytes) 000439 1789996551.914925 read 0x017407 thru 0x0241bb (0xcdb5 bytes) 000441 1789996551.915664 write 0x0056a7 thru 0x011409 (0xbd63 bytes) 000444 1789996551.917307 mapread 0x01f895 thru 0x02f05e (0xf7ca bytes) 000445 1789996551.918177 punch from 0x00147e to 0x00155e (0xe1 bytes) 000446 1789996551.923221 mapwrite 0x02fcb3 thru 0x035bce (0x5f1c bytes) 000447 1789996551.960714 punch from 0x00f6a8 to 0x01161e (0x1f77 bytes) 000448 1789996551.962716 write 0x039dba thru 0x03ffff (0x6246 bytes) 000451 1789996551.964316 read 0x032454 thru 0x03fd32 (0xd8df bytes) 000455 1789996551.968658 punch from 0x03bbd0 to 0x03ffff (0x4430 bytes) 000456 1789996551.973352 mapwrite 0x0396a2 thru 0x03ffff (0x695e bytes) 000458 1789996552.000912 mapwrite 0x005fc5 thru 0x006533 (0x56f bytes) 000460 1789996552.018324 punch from 0x01c9e3 to 0x02ae0c (0xe42a bytes) 000461 1789996552.020513 trunc from 0x040000 to 0x018749 (0x278b6 bytes) 000462 1789996552.026208 mapwrite 0x02d748 thru 0x02e060 (0x919 bytes) 000463 1789996552.064624 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) 000464 1789996552.118866 mapwrite 0x01e0a6 thru 0x02bdc7 (0xdd22 bytes) 000465 1789996552.147247 mapread 0x00538f thru 0x00fd27 (0xa999 bytes) 000466 1789996552.150377 mapwrite 0x00333c thru 0x00e8bf (0xb584 bytes) 000467 1789996552.164969 punch from 0x00a5bc to 0x0183eb (0xde30 bytes) 000469 1789996552.167227 mapread 0x0250ed thru 0x02e060 (0x8f74 bytes) 000470 1789996552.167851 mapwrite 0x022469 thru 0x0246a0 (0x2238 bytes) 000471 1789996552.180875 write 0x00162b thru 0x007717 (0x60ed bytes) 000472 1789996552.181912 trunc from 0x02e061 to 0x01c257 (0x11e09 bytes) 000474 1789996552.190441 read 0x01701e thru 0x01b3fa (0x43dd bytes) 000476 1789996552.193618 write 0x0009a5 thru 0x005c70 (0x52cc bytes) 000477 1789996552.196491 read 0x00ed81 thru 0x01c257 (0xd4d7 bytes) 000478 1789996552.199938 write 0x00f832 thru 0x019f99 (0xa768 bytes) 000480 1789996552.201725 read 0x0189b6 thru 0x01af09 (0x2554 bytes) 000481 1789996552.202037 write 0x03c779 thru 0x03ffff (0x3887 bytes) 000483 1789996552.202954 read 0x031312 thru 0x035c06 (0x48f5 bytes) 000486 1789996552.207586 punch from 0x014ef0 to 0x02098a (0xba9b bytes) 000488 1789996552.213509 mapwrite 0x03fab7 thru 0x03ffff (0x549 bytes) 000489 1789996552.229641 read 0x015ff0 thru 0x0256bd (0xf6ce bytes) 000491 1789996552.236329 write 0x01feaa thru 0x021ce7 (0x1e3e bytes) 000492 1789996552.239062 MIRROR_EXTEND to 2 mirrors 000496 1789996552.553838 mapwrite 0x0085a6 thru 0x00e941 (0x639c bytes) 000497 1789996552.621382 read 0x004824 thru 0x00a8f3 (0x60d0 bytes) 000498 1789996552.621851 trunc from 0x040000 to 0x0302d4 (0xfd2b bytes) 000499 1789996552.642609 mapread 0x01fe50 thru 0x02c467 (0xc618 bytes) 000500 1789996552.655592 write 0x016347 thru 0x01ead4 (0x878e bytes) 000504 1789996552.662352 MIRROR_RESYNC 2 mirrors 000505 1789996552.942968 read 0x003765 thru 0x0126d5 (0xef71 bytes) 000506 1789996552.950275 punch from 0x005eb9 to 0x013c89 (0xddd1 bytes) 000507 1789996552.979646 mapwrite 0x03f32a thru 0x03f8db (0x5b2 bytes) 000508 1789996553.009044 punch from 0x02fbef to 0x038b23 (0x8f35 bytes) 000510 1789996553.012684 punch from 0x02a9aa to 0x02d6de (0x2d35 bytes) 000512 1789996553.015546 trunc from 0x03f8dc to 0x032594 (0xd347 bytes) 000513 1789996553.020933 write 0x011312 thru 0x02109e (0xfd8d bytes) 000515 1789996553.031485 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) 000517 1789996553.091522 mapwrite 0x02068e thru 0x03054b (0xfebe bytes) 000518 1789996553.129876 write 0x022320 thru 0x0251ef (0x2ed0 bytes) 000521 1789996553.132046 write 0x03d816 thru 0x03ffff (0x27ea bytes) 000523 1789996553.133180 trunc from 0x040000 to 0x020006 (0x1fff9 bytes) 000524 1789996553.146814 read 0x0097e9 thru 0x00f553 (0x5d6b bytes) 000525 1789996553.151639 trunc from 0x020007 to 0x01da19 (0x25ed bytes) 000527 1789996553.159141 mapwrite 0x025b0b thru 0x031640 (0xbb36 bytes) 000528 1789996553.222293 trunc from 0x031641 to 0x00b9ff (0x25c41 bytes) 000531 1789996553.237114 mapread 0x0050ad thru 0x006d7d (0x1cd1 bytes) 000532 1789996553.243937 read 0x00abc4 thru 0x00b9ff (0xe3c bytes) 000533 1789996553.244495 read 0x005845 thru 0x00b9ff (0x61bb bytes) 000537 1789996553.246785 punch from 0x009e31 to 0x00b9ff (0x1bcf bytes) 000538 1789996553.250133 mapwrite 0x009a78 thru 0x010595 (0x6b1e bytes) 000540 1789996553.284858 read 0x00c21e thru 0x010595 (0x4378 bytes) 000542 1789996553.285822 trunc from 0x010596 to 0x019b0e (0x9579 bytes) 000543 1789996553.293045 trunc from 0x019b0f to 0x017a1d (0x20f1 bytes) 000545 1789996553.298877 write 0x022e14 thru 0x02b337 (0x8524 bytes) 000547 1789996553.300310 mapwrite 0x037eac thru 0x03e359 (0x64ae bytes) 000548 1789996553.328591 read 0x0022fe thru 0x009811 (0x7514 bytes) 000551 1789996553.329675 read 0x0293b6 thru 0x02e57e (0x51c9 bytes) 000552 1789996553.330016 read 0x014e96 thru 0x01dba2 (0x8d0d bytes) 000553 1789996553.330332 write 0x03b8d3 thru 0x03ffff (0x472d bytes) 000558 1789996553.332165 mapread 0x02bf70 thru 0x02f336 (0x33c7 bytes) 000560 1789996553.332948 write 0x013497 thru 0x01869a (0x5204 bytes) 000561 1789996553.333544 trunc from 0x040000 to 0x038244 (0x7dbb bytes) 000562 1789996553.338996 read 0x032cbd thru 0x038244 (0x5588 bytes) 000564 1789996553.340204 punch from 0x022236 to 0x028fd2 (0x6d9d bytes) 000569 1789996553.351495 write 0x01fb74 thru 0x0210e6 (0x1573 bytes) 000570 1789996553.352309 punch from 0x01a099 to 0x022868 (0x87d0 bytes) 000571 1789996553.356843 read 0x01b997 thru 0x021440 (0x5aaa bytes) 000574 1789996553.363001 punch from 0x029a01 to 0x036c25 (0xd225 bytes) 000576 1789996553.365611 trunc from 0x038245 to 0x017021 (0x21223 bytes) 000577 1789996553.373001 mapwrite 0x020d21 thru 0x022679 (0x1959 bytes) 000578 1789996553.395286 trunc from 0x02267a to 0x034022 (0x119a9 bytes) 000579 1789996553.403276 write 0x012a29 thru 0x01f52d (0xcb05 bytes) 000580 1789996553.406222 punch from 0x01e58c to 0x02c34e (0xddc3 bytes) 000582 1789996553.410839 punch from 0x024b13 to 0x030821 (0xbd0f bytes) 000584 1789996553.412757 mapwrite 0x00bcac thru 0x00fe80 (0x41d5 bytes) 000585 1789996553.427613 mapwrite 0x03292b thru 0x037ca1 (0x5377 bytes) 000586 1789996553.457931 MIRROR_EXTEND to 2 mirrors 000587 1789996553.737319 read 0x002268 thru 0x008911 (0x66aa bytes) 000588 1789996553.742735 punch from 0x010d23 to 0x013057 (0x2335 bytes) 000589 1789996553.771513 punch from 0x036572 to 0x037ca1 (0x1730 bytes) 000590 1789996553.773687 trunc from 0x037ca2 to 0x0080a1 (0x2fc00 bytes) 000591 1789996553.800211 punch from 0x000bc7 to 0x0080a1 (0x74db bytes) 000592 1789996553.803932 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x80a2): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x80a2): Mirror 2: 0x78825348 (stale) CRC-32 checksum value for chunk [0, 0x80a2): Mirror 1: 0x2f8a582d Mirror 3: 0x2f8a582d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x80a2: skipped 000593 1789996554.391254 mapread 0x0049d3 thru 0x0080a1 (0x36cf bytes) 000595 1789996554.423976 punch from 0x00493e to 0x0080a1 (0x3764 bytes) 000596 1789996554.458708 punch from 0x003f2a to 0x0080a1 (0x4178 bytes) 000597 1789996554.460765 punch from 0x0070b0 to 0x0080a1 (0xff2 bytes) 000598 1789996554.462591 trunc from 0x0080a2 to 0x037969 (0x2f8c8 bytes) 000599 1789996554.469532 write 0x03ae9a thru 0x03ffff (0x5166 bytes) 000601 1789996554.470791 mapwrite 0x00461f thru 0x013806 (0xf1e8 bytes) 000603 1789996554.518661 write 0x029cbb thru 0x02db29 (0x3e6f bytes) 000604 1789996554.527921 trunc from 0x040000 to 0x0168f3 (0x2970c bytes) 000605 1789996554.535800 trunc from 0x0168f4 to 0x02089d (0x9faa bytes) 000607 1789996554.555110 write 0x0081a4 thru 0x00bc72 (0x3acf bytes) 000608 1789996554.556461 read 0x00c20e thru 0x015fe6 (0x9dd9 bytes) 000610 1789996554.559922 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2089e): Mirror 3: 0xf0042bbb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2089e): Mirror 3: 0xf0042bbb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2089e: skipped 000611 1789996554.704287 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) 000613 1789996554.762858 mapread 0x000bac thru 0x00141f (0x874 bytes) 000614 1789996554.766242 mapwrite 0x0259c8 thru 0x032faf (0xd5e8 bytes) 000615 1789996554.790628 trunc from 0x032fb0 to 0x011058 (0x21f57 bytes) 000617 1789996554.795634 read 0x00ed1f thru 0x011058 (0x233a bytes) 000622 1789996554.799141 mapwrite 0x00cafc thru 0x012209 (0x570e bytes) 000623 1789996554.821121 read 0x011c4c thru 0x012209 (0x5be bytes) 000624 1789996554.821526 mapwrite 0x018f64 thru 0x020607 (0x76a4 bytes) 000625 1789996554.850278 mapread 0x0177b4 thru 0x01a100 (0x294d bytes) 000627 1789996554.851396 mapwrite 0x03640d thru 0x03ffff (0x9bf3 bytes) 000628 1789996554.876680 write 0x0363f3 thru 0x03c5fc (0x620a bytes) 000629 1789996554.877667 read 0x0209a1 thru 0x02bc24 (0xb284 bytes) 000632 1789996554.879027 read 0x009103 thru 0x013c3b (0xab39 bytes) 000633 1789996554.879542 read 0x008640 thru 0x00936b (0xd2c bytes) 000634 1789996554.880031 write 0x0066e2 thru 0x00fe19 (0x9738 bytes) 000635 1789996554.881007 punch from 0x02c50a to 0x035b56 (0x964d bytes) 000637 1789996554.886131 mapwrite 0x006b1a thru 0x009a7e (0x2f65 bytes) 000638 1789996554.898544 punch from 0x008f04 to 0x00a9ee (0x1aeb bytes) 000639 1789996554.900633 write 0x00e9ff thru 0x015996 (0x6f98 bytes) 000640 1789996554.901371 read 0x024b42 thru 0x02cb41 (0x8000 bytes) 000641 1789996554.904129 punch from 0x001faf to 0x0089fd (0x6a4f bytes) 000642 1789996554.908488 punch from 0x01a5ea to 0x025304 (0xad1b bytes) 000643 1789996554.910623 trunc from 0x040000 to 0x038af8 (0x7507 bytes) 000644 1789996554.915892 write 0x011e18 thru 0x01e97d (0xcb66 bytes) 000645 1789996554.918826 mapread 0x01fef5 thru 0x02a630 (0xa73c bytes) 000646 1789996554.930733 write 0x01d535 thru 0x025f00 (0x89cc bytes) 000649 1789996554.932286 mapread 0x013a8d thru 0x01a3c5 (0x6939 bytes) 000650 1789996554.932880 mapread 0x0290f4 thru 0x037ebf (0xedcc bytes) 000651 1789996554.933519 write 0x0184aa thru 0x01f3e7 (0x6f3e bytes) 000652 1789996554.934751 punch from 0x01a4ef to 0x028b3f (0xe651 bytes) 000653 1789996554.940646 write 0x037f66 thru 0x03ffff (0x809a bytes) 000654 1789996554.941512 mapwrite 0x00b4e4 thru 0x01150e (0x602b bytes) 000655 1789996554.960094 read 0x038824 thru 0x03960f (0xdec bytes) 000656 1789996554.960483 mapwrite 0x00a629 thru 0x013596 (0x8f6e bytes) 000657 1789996554.976537 mapwrite 0x03d109 thru 0x03ffff (0x2ef7 bytes) 000660 1789996554.996993 mapwrite 0x03e799 thru 0x03ffff (0x1867 bytes) 000661 1789996555.017838 punch from 0x02e010 to 0x039950 (0xb941 bytes) 000663 1789996555.022127 trunc from 0x040000 to 0x03788d (0x8772 bytes) 000665 1789996555.029370 mapread 0x012616 thru 0x021b25 (0xf510 bytes) 000666 1789996555.034231 mapwrite 0x00af12 thru 0x00f49f (0x458e bytes) 000668 1789996555.059745 mapwrite 0x0328c7 thru 0x03ffff (0xd739 bytes) 000670 1789996555.093873 punch from 0x02c3d8 to 0x02f360 (0x2f89 bytes) 000671 1789996555.097535 MIRROR_EXTEND to 2 mirrors 000672 1789996555.378321 MIRROR_RESYNC 2 mirrors 000673 1789996555.528884 trunc from 0x040000 to 0x0252a6 (0x1ad59 bytes) 000675 1789996555.580365 trunc from 0x0252a7 to 0x02ed71 (0x9acb bytes) 000676 1789996555.586544 write 0x031c2b thru 0x03bb87 (0x9f5d bytes) 000677 1789996555.589826 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) 000678 1789996555.636996 mapread 0x02b1e1 thru 0x031e1c (0x6c3c bytes) 000679 1789996555.643483 read 0x00b947 thru 0x0161d6 (0xa890 bytes) 000680 1789996555.646622 read 0x01ad06 thru 0x01e61a (0x3915 bytes) 000684 1789996555.651371 read 0x0332bb thru 0x03bb87 (0x88cd bytes) 000685 1789996555.651926 mapwrite 0x007865 thru 0x00bb26 (0x42c2 bytes) 000688 1789996555.675888 trunc from 0x03bb88 to 0x033729 (0x845e bytes) 000689 1789996555.682201 write 0x03529a thru 0x03df75 (0x8cdc bytes) 000691 1789996555.683727 write 0x01cbf6 thru 0x02c3d3 (0xf7de bytes) 000692 1789996555.684850 punch from 0x0343ee to 0x038189 (0x3d9c bytes) 000693 1789996555.692825 write 0x034ea8 thru 0x03ffff (0xb158 bytes) 000694 1789996555.697177 write 0x0211ed thru 0x025f81 (0x4d95 bytes) 000695 1789996555.698008 punch from 0x02409d to 0x028815 (0x4779 bytes) 000698 1789996555.707840 punch from 0x02e2da to 0x02ee37 (0xb5e bytes) 000699 1789996555.710308 trunc from 0x040000 to 0x031757 (0xe8a8 bytes) 000700 1789996555.715806 mapread 0x011904 thru 0x01fd67 (0xe464 bytes) 000702 1789996555.716844 mapwrite 0x005035 thru 0x00d9e0 (0x89ac bytes) 000704 1789996555.736188 mapread 0x026682 thru 0x031757 (0xb0d6 bytes) 000705 1789996555.743084 punch from 0x0013b5 to 0x006cf8 (0x5944 bytes) 000706 1789996555.745103 mapread 0x02a67f thru 0x02f1d9 (0x4b5b bytes) 000707 1789996555.745906 mapread 0x0271c3 thru 0x027cd7 (0xb15 bytes) 000709 1789996555.747324 write 0x038aa5 thru 0x03ffff (0x755b bytes) 000710 1789996555.748368 mapread 0x01e4d2 thru 0x028a9c (0xa5cb bytes) 000711 1789996555.752175 read 0x0038c9 thru 0x012312 (0xea4a bytes) 000712 1789996555.755207 write 0x000115 thru 0x004030 (0x3f1c bytes) 000714 1789996555.756619 write 0x037488 thru 0x03b91c (0x4495 bytes) 000717 1789996555.758681 mapread 0x028028 thru 0x02dab6 (0x5a8f bytes) 000719 1789996555.760307 write 0x00b167 thru 0x013b36 (0x89d0 bytes) 000721 1789996555.762285 mapwrite 0x03db25 thru 0x03ffff (0x24db bytes) 000722 1789996555.782872 write 0x004453 thru 0x007463 (0x3011 bytes) 000728 1789996555.786161 trunc from 0x040000 to 0x01ab72 (0x2548d bytes) 000729 1789996555.793591 mapwrite 0x010273 thru 0x018529 (0x82b7 bytes) 000730 1789996555.812865 read 0x0158cb thru 0x01a1d4 (0x490a bytes) 000732 1789996555.813792 punch from 0x012442 to 0x01ab72 (0x8731 bytes) 000733 1789996555.816304 mapread 0x00a56e thru 0x00b048 (0xadb bytes) 000734 1789996555.817164 mapread 0x00fbe7 thru 0x01a7d4 (0xabee bytes) 000735 1789996555.820582 trunc from 0x01ab73 to 0x02287e (0x7d0c bytes) 000737 1789996555.825997 punch from 0x015bd3 to 0x016d90 (0x11be bytes) 000738 1789996555.829195 write 0x0344ec thru 0x03fff7 (0xbb0c bytes) 000739 1789996555.830114 punch from 0x010e57 to 0x013db1 (0x2f5b bytes) 000741 1789996555.835121 trunc from 0x03fff8 to 0x00d338 (0x32cbf bytes) 000742 1789996555.840185 trunc from 0x00d339 to 0x012bf2 (0x58ba bytes) 000743 1789996555.848303 read 0x006013 thru 0x012bf2 (0xcbe0 bytes) 000744 1789996555.851817 punch from 0x0068cd to 0x012bf2 (0xc326 bytes) 000747 1789996555.860125 write 0x00a6d9 thru 0x0165b0 (0xbed8 bytes) 000748 1789996555.865773 punch from 0x0002d9 to 0x00fa8d (0xf7b5 bytes) 000749 1789996555.878001 trunc from 0x0165b1 to 0x003545 (0x1306b bytes) 000750 1789996555.891729 trunc from 0x003546 to 0x034fdc (0x31a97 bytes) 000751 1789996555.901599 trunc from 0x034fdd to 0x00e56f (0x26a6d bytes) 000752 1789996555.909462 punch from 0x00d79c to 0x00e56f (0xdd4 bytes) 000755 1789996555.915790 MIRROR_EXTEND to 2 mirrors 000757 1789996556.221133 write 0x0277fb thru 0x02e42e (0x6c34 bytes) 000758 1789996556.245152 mapread 0x005ad1 thru 0x009fad (0x44dd bytes) 000759 1789996556.252685 trunc from 0x02e42f to 0x01fe41 (0xe5ed bytes) 000760 1789996556.262782 trunc from 0x01fe42 to 0x01d2ed (0x2b54 bytes) 000761 1789996556.268192 mapwrite 0x02c107 thru 0x034e2d (0x8d27 bytes) 000762 1789996556.294956 trunc from 0x034e2e to 0x02cb31 (0x82fc bytes) 000763 1789996556.302865 trunc from 0x02cb32 to 0x028969 (0x41c8 bytes) 000764 1789996556.309199 punch from 0x00d52f to 0x00f7bf (0x2291 bytes) 000765 1789996556.311304 write 0x01915e thru 0x025933 (0xc7d6 bytes) 000766 1789996556.318916 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2896a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2896a): Mirror 2: 0xc0845408 (stale) CRC-32 checksum value for chunk [0, 0x2896a): Mirror 1: 0x149ef20a Mirror 3: 0x149ef20a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2896a: skipped 000767 1789996556.717928 write 0x031d0b thru 0x03ffff (0xe2f5 bytes) 000768 1789996556.741741 read 0x03f5a8 thru 0x03ffff (0xa58 bytes) 000769 1789996556.745382 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x6b74765f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x6b74765f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000770 1789996556.855838 trunc from 0x040000 to 0x0229a5 (0x1d65a bytes) 000772 1789996556.860725 read 0x021cf6 thru 0x0224ad (0x7b8 bytes) 000773 1789996556.862902 write 0x0177a1 thru 0x0219fd (0xa25d bytes) 000774 1789996556.864831 write 0x02c48e thru 0x034a5b (0x85ce bytes) 000775 1789996556.865622 trunc from 0x034a5c to 0x0161a1 (0x1e8ba bytes) 000776 1789996556.870365 mapread 0x00fe33 thru 0x0161a1 (0x636f bytes) 000777 1789996556.876998 punch from 0x000e92 to 0x00183e (0x9ad bytes) 000778 1789996556.879518 punch from 0x00cfe6 to 0x0161a1 (0x91bc bytes) 000780 1789996556.886004 read 0x00532f thru 0x007c5a (0x292c bytes) 000781 1789996556.897025 trunc from 0x0161a2 to 0x0303b4 (0x1a213 bytes) 000782 1789996556.905708 mapwrite 0x0087bc thru 0x01242b (0x9c70 bytes) 000783 1789996556.942902 read 0x01bac3 thru 0x02a403 (0xe941 bytes) 000784 1789996556.949739 trunc from 0x0303b5 to 0x0233d5 (0xcfdf bytes) 000787 1789996556.966614 mapwrite 0x021150 thru 0x021c98 (0xb49 bytes) 000789 1789996556.990037 write 0x017671 thru 0x01e940 (0x72d0 bytes) 000790 1789996556.991058 mapread 0x00ca4f thru 0x010af3 (0x40a5 bytes) 000791 1789996556.993808 MIRROR_RESYNC 2 mirrors 000792 1789996557.281113 write 0x036d0c thru 0x03ffff (0x92f4 bytes) 000793 1789996557.303435 write 0x027164 thru 0x02ce69 (0x5d06 bytes) 000794 1789996557.307322 trunc from 0x040000 to 0x02fbb2 (0x1044d bytes) 000795 1789996557.313858 mapwrite 0x0350a9 thru 0x03ffff (0xaf57 bytes) 000796 1789996557.346159 mapread 0x0395bf thru 0x03ffff (0x6a41 bytes) 000797 1789996557.347032 punch from 0x000126 to 0x008778 (0x8653 bytes) 000799 1789996557.350056 punch from 0x0261b9 to 0x034ea0 (0xece8 bytes) 000800 1789996557.356860 punch from 0x00a664 to 0x0109f9 (0x6396 bytes) 000801 1789996557.359555 mapwrite 0x03ac2e thru 0x03ffff (0x53d2 bytes) 000803 1789996557.378220 mapwrite 0x00414f thru 0x01277e (0xe630 bytes) 000804 1789996557.407183 read 0x018053 thru 0x01d88c (0x583a bytes) 000805 1789996557.409731 punch from 0x031418 to 0x03ff82 (0xeb6b bytes) 000806 1789996557.412782 mapwrite 0x018153 thru 0x01bab6 (0x3964 bytes) 000807 1789996557.428193 mapwrite 0x00654a thru 0x00c0fd (0x5bb4 bytes) 000809 1789996557.448928 mapread 0x023e7b thru 0x02a950 (0x6ad6 bytes) 000810 1789996557.452948 write 0x02e9c7 thru 0x03ac38 (0xc272 bytes) 000811 1789996557.456854 read 0x010a99 thru 0x01a902 (0x9e6a bytes) 000813 1789996557.457737 mapwrite 0x01626d thru 0x024f62 (0xecf6 bytes) 000815 1789996557.493946 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) 000816 1789996557.580040 write 0x030a8e thru 0x0346cc (0x3c3f bytes) 000817 1789996557.585701 punch from 0x001d1e to 0x002a7d (0xd60 bytes) 000821 1789996557.592437 punch from 0x02cdf3 to 0x030dad (0x3fbb bytes) 000822 1789996557.596035 MIRROR_EXTEND to 2 mirrors 000823 1789996557.946905 write 0x024128 thru 0x025694 (0x156d bytes) 000825 1789996557.974380 read 0x002092 thru 0x01178a (0xf6f9 bytes) 000828 1789996557.978456 mapwrite 0x025d86 thru 0x032df4 (0xd06f bytes) 000830 1789996558.005578 punch from 0x002efb to 0x010dcc (0xded2 bytes) 000831 1789996558.007640 trunc from 0x040000 to 0x03d9cf (0x2630 bytes) 000832 1789996558.018648 mapread 0x0068c8 thru 0x01387e (0xcfb7 bytes) 000833 1789996558.025156 read 0x00ecb0 thru 0x0125a0 (0x38f1 bytes) 000835 1789996558.026239 mapread 0x00aff5 thru 0x018d68 (0xdd74 bytes) 000836 1789996558.026980 write 0x00c1aa thru 0x01513e (0x8f95 bytes) 000837 1789996558.027797 write 0x02111e thru 0x0225c7 (0x14aa bytes) 000839 1789996558.028773 write 0x030e6e thru 0x03805d (0x71f0 bytes) 000841 1789996558.029844 read 0x03a893 thru 0x03d03c (0x27aa bytes) 000842 1789996558.034848 trunc from 0x03d9d0 to 0x02143b (0x1c594 bytes) 000843 1789996558.049823 mapread 0x00a169 thru 0x0118b4 (0x774c bytes) 000844 1789996558.050705 punch from 0x001a57 to 0x00d463 (0xba0d bytes) 000845 1789996558.059836 trunc from 0x02143c to 0x013ed1 (0xd56a bytes) 000846 1789996558.081347 MIRROR_RESYNC 2 mirrors 000847 1789996558.404127 read 0x00ece9 thru 0x013ed1 (0x51e9 bytes) 000848 1789996558.409735 write 0x025f49 thru 0x0281a7 (0x225f bytes) 000849 1789996558.435136 mapread 0x0142d7 thru 0x01e347 (0xa071 bytes) 000850 1789996558.446254 punch from 0x019318 to 0x02109f (0x7d88 bytes) 000851 1789996558.452961 mapread 0x01b3b3 thru 0x023718 (0x8366 bytes) 000852 1789996558.456884 trunc from 0x0281a8 to 0x016faf (0x111f8 bytes) 000853 1789996558.473800 mapwrite 0x028a8d thru 0x0374b9 (0xea2d bytes) 000854 1789996558.507056 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) 000855 1789996558.552291 write 0x00633b thru 0x0128af (0xc575 bytes) 000858 1789996558.558214 mapread 0x021fc2 thru 0x027137 (0x5176 bytes) 000859 1789996558.565488 punch from 0x007f58 to 0x008575 (0x61e bytes) 000860 1789996558.576438 MIRROR_EXTEND to 2 mirrors 000861 1789996558.862050 trunc from 0x0374ba to 0x032c92 (0x4827 bytes) 000862 1789996558.896241 read 0x01a344 thru 0x028cfd (0xe9ba bytes) 000863 1789996558.900170 mapread 0x032581 thru 0x032c92 (0x712 bytes) 000864 1789996558.903147 read 0x0027b4 thru 0x0092b5 (0x6b02 bytes) 000866 1789996558.914380 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x56a:0x0]: Invalid argument (22) 000869 1789996558.983801 read 0x0225f3 thru 0x02a2a4 (0x7cb2 bytes) 000870 1789996558.990285 punch from 0x022da9 to 0x0232fa (0x552 bytes) 000871 1789996558.993020 write 0x03ba45 thru 0x03ccdd (0x1299 bytes) 000872 1789996558.993946 mapwrite 0x02e634 thru 0x038476 (0x9e43 bytes) 000873 1789996559.025090 write 0x039103 thru 0x03ffff (0x6efd bytes) 000875 1789996559.028693 mapwrite 0x00d431 thru 0x01d08d (0xfc5d bytes) 000876 1789996559.067290 trunc from 0x040000 to 0x013b0d (0x2c4f2 bytes) 000877 1789996559.079108 write 0x00c403 thru 0x0139b3 (0x75b1 bytes) 000878 1789996559.080323 punch from 0x0030e0 to 0x012471 (0xf392 bytes) 000879 1789996559.086516 mapwrite 0x02ec77 thru 0x02f108 (0x492 bytes) 000880 1789996559.122486 punch from 0x02b139 to 0x02f108 (0x3fd0 bytes) 000881 1789996559.136232 punch from 0x01d2bc to 0x027c86 (0xa9cb bytes) 000883 1789996559.141234 mapwrite 0x02c0ab thru 0x038762 (0xc6b8 bytes) 000884 1789996559.188808 mapread 0x015de6 thru 0x016830 (0xa4b bytes) 000885 1789996559.193030 punch from 0x011b1a to 0x017399 (0x5880 bytes) 000886 1789996559.198289 mapwrite 0x02611b thru 0x031e51 (0xbd37 bytes) 000889 1789996559.215733 write 0x00706f thru 0x011873 (0xa805 bytes) 000890 1789996559.220029 mapread 0x0044da thru 0x007b7b (0x36a2 bytes) 000891 1789996559.223221 read 0x0368e4 thru 0x038762 (0x1e7f bytes) 000892 1789996559.223731 punch from 0x012243 to 0x01ab2a (0x88e8 bytes) 000893 1789996559.228071 mapread 0x01299c thru 0x0227da (0xfe3f bytes) 000894 1789996559.233712 read 0x009402 thru 0x00dc49 (0x4848 bytes) 000895 1789996559.237687 MIRROR_EXTEND to 2 mirrors 000896 1789996559.552817 mapwrite 0x0241d8 thru 0x025bc4 (0x19ed bytes) 000897 1789996559.651737 trunc from 0x038763 to 0x016a27 (0x21d3b bytes) 000898 1789996559.664856 write 0x02054b thru 0x028695 (0x814b bytes) 000901 1789996559.666874 write 0x00534b thru 0x00fd75 (0xaa2b bytes) 000902 1789996559.670109 mapwrite 0x03dc48 thru 0x03ffff (0x23b8 bytes) 000903 1789996559.696917 read 0x03b127 thru 0x03ffff (0x4ed9 bytes) 000904 1789996559.703206 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1974c2b9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x740365c8 Mirror 3: 0x740365c8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000905 1789996560.054443 read 0x015f1e thru 0x01f886 (0x9969 bytes) 000906 1789996560.066665 punch from 0x01a3ff to 0x01d542 (0x3144 bytes) 000907 1789996560.104852 mapwrite 0x03da8f thru 0x03ffff (0x2571 bytes) 000908 1789996560.134977 write 0x00a894 thru 0x01983e (0xefab bytes) 000910 1789996560.147581 mapwrite 0x007ef9 thru 0x01793b (0xfa43 bytes) 000911 1789996560.184663 MIRROR_RESYNC 3 mirrors 000913 1789996560.621522 trunc from 0x040000 to 0x009fa0 (0x3605f bytes) 000914 1789996560.665175 write 0x01f3a3 thru 0x020945 (0x15a3 bytes) 000915 1789996560.666115 mapwrite 0x03c3c2 thru 0x03ffff (0x3c3e bytes) 000916 1789996560.712024 mapwrite 0x01649e thru 0x01b27f (0x4de2 bytes) 000917 1789996560.740747 read 0x01fb85 thru 0x0245d2 (0x4a4e bytes) 000918 1789996560.744177 mapread 0x015b57 thru 0x0229e3 (0xce8d bytes) 000919 1789996560.745143 mapwrite 0x03504a thru 0x03ffff (0xafb6 bytes) 000920 1789996560.770157 read 0x02e0d6 thru 0x0300b6 (0x1fe1 bytes) 000922 1789996560.771179 mapread 0x008ddb thru 0x01171a (0x8940 bytes) 000923 1789996560.776027 mapwrite 0x00e035 thru 0x012569 (0x4535 bytes) 000925 1789996560.793440 MIRROR_RESYNC 3 mirrors 000928 1789996561.127609 read 0x0307aa thru 0x03ffff (0xf856 bytes) 000929 1789996561.130679 trunc from 0x040000 to 0x029cb7 (0x16348 bytes) 000930 1789996561.153415 MIRROR_RESYNC 3 mirrors 000931 1789996561.463087 mapread 0x001fb3 thru 0x005dba (0x3e08 bytes) 000934 1789996561.468312 write 0x03ad3c thru 0x03ffff (0x52c4 bytes) 000935 1789996561.483262 read 0x03af74 thru 0x03f819 (0x48a6 bytes) 000936 1789996561.483771 write 0x032699 thru 0x03b114 (0x8a7c bytes) 000937 1789996561.487772 MIRROR_RESYNC 3 mirrors 000938 1789996561.780634 punch from 0x013e96 to 0x020cea (0xce55 bytes) 000939 1789996561.800265 trunc from 0x040000 to 0x011d45 (0x2e2ba bytes) 000942 1789996561.814255 read 0x008557 thru 0x011d45 (0x97ef bytes) 000943 1789996561.818766 trunc from 0x011d46 to 0x00ccee (0x5057 bytes) 000944 1789996561.825266 trunc from 0x00ccef to 0x02b29a (0x1e5ac bytes) 000946 1789996561.830842 mapread 0x01ee4d thru 0x020847 (0x19fb bytes) 000948 1789996561.841045 read 0x003663 thru 0x00cd94 (0x9732 bytes) 000949 1789996561.848216 read 0x02798f thru 0x02b29a (0x390c bytes) 000950 1789996561.848922 mapwrite 0x03f07f thru 0x03ffff (0xf81 bytes) 000951 1789996561.887115 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x782b1fb3 (stale) Mirror 3: 0x782b1fb3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x14242084 Mirror 4: 0x14242084 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000952 1789996562.254003 mapread 0x016f41 thru 0x018852 (0x1912 bytes) 000953 1789996562.268044 write 0x000918 thru 0x007aec (0x71d5 bytes) 000954 1789996562.299586 read 0x027e60 thru 0x037d0e (0xfeaf bytes) 000956 1789996562.303822 mapwrite 0x01cfb6 thru 0x02aaeb (0xdb36 bytes) 000957 1789996562.329531 MIRROR_RESYNC 4 mirrors 000958 1789996562.840183 MIRROR_RESYNC 4 mirrors 000959 1789996562.998435 mapwrite 0x0007b9 thru 0x003c43 (0x348b bytes) 000960 1789996563.071806 read 0x01e7f3 thru 0x023fa3 (0x57b1 bytes) 000961 1789996563.075338 punch from 0x006520 to 0x007b4d (0x162e bytes) 000962 1789996563.077550 mapread 0x03ebad thru 0x03ffff (0x1453 bytes) 000963 1789996563.081079 read 0x039341 thru 0x03e20f (0x4ecf bytes) 000965 1789996563.082236 write 0x0352f2 thru 0x03ffff (0xad0e bytes) 000967 1789996563.089546 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3e9f69a (stale) Mirror 3: 0x3e9f69a (stale) Mirror 4: 0x3e9f69a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3f0f9709 Mirror 5: 0x3f0f9709 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000968 1789996563.511892 mapwrite 0x01d7d0 thru 0x01f360 (0x1b91 bytes) 000969 1789996563.573231 punch from 0x003047 to 0x009a50 (0x6a0a bytes) 000970 1789996563.574839 punch from 0x002c04 to 0x008ff7 (0x63f4 bytes) 000971 1789996563.576254 mapread 0x0028bb thru 0x00d781 (0xaec7 bytes) 000972 1789996563.579164 punch from 0x00b6cd to 0x01aa8f (0xf3c3 bytes) 000973 1789996563.582523 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3e9f69a (stale) Mirror 3: 0x3e9f69a (stale) Mirror 4: 0x3e9f69a (stale) Mirror 5: 0x3f0f9709 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfd6ae056 Mirror 6: 0xfd6ae056 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000974 1789996564.010425 trunc from 0x040000 to 0x00e165 (0x31e9a bytes) 000975 1789996564.062147 trunc from 0x00e166 to 0x00fa40 (0x18db bytes) 000976 1789996564.072811 mapread 0x0088ad thru 0x00fa40 (0x7194 bytes) 000977 1789996564.081124 punch from 0x00a663 to 0x00fa40 (0x53de bytes) 000978 1789996564.083699 write 0x01e543 thru 0x01f236 (0xcf4 bytes) 000980 1789996564.085016 mapread 0x01bdd9 thru 0x01f236 (0x345e bytes) 000981 1789996564.089636 write 0x01b295 thru 0x0286c7 (0xd433 bytes) 000982 1789996564.091040 read 0x013129 thru 0x01ed0c (0xbbe4 bytes) 000983 1789996564.093785 mapwrite 0x02f7fb thru 0x030c18 (0x141e bytes) 000985 1789996564.144090 mapwrite 0x02c2a8 thru 0x02c68f (0x3e8 bytes) 000987 1789996564.170933 trunc from 0x030c19 to 0x026b7b (0xa09d bytes) 000988 1789996564.183215 read 0x001f8e thru 0x00b849 (0x98bc bytes) 000989 1789996564.187899 read 0x003cf8 thru 0x008b45 (0x4e4e bytes) 000990 1789996564.188470 mapread 0x0180a3 thru 0x01b8d1 (0x382f bytes) 000991 1789996564.191157 MIRROR_RESYNC 6 mirrors 000994 1789996564.905271 read 0x002dc7 thru 0x00589b (0x2ad5 bytes) 000996 1789996564.907445 punch from 0x01caa4 to 0x026b7b (0xa0d8 bytes) 000998 1789996564.934131 write 0x001c4a thru 0x010365 (0xe71c bytes) 000999 1789996564.938475 mapread 0x00ba27 thru 0x016423 (0xa9fd bytes) All operations completed A-OK!