== sanity-flr test 70a: flr mode fsx test ================ 14:47:02 (1788461222) Seed set to 1224 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero length punch hole 000003 1788461224.482634 write 0x02c98c thru 0x03a0d3 (0xd748 bytes) truncating to largest ever: 0x2a4ae 000004 1788461224.485941 trunc from 0x03a0d4 to 0x02a4ad (0xfc26 bytes) 000006 1788461224.505350 write 0x001295 thru 0x0076ac (0x6418 bytes) 000011 1788461224.523356 MIRROR_EXTEND to 2 mirrors 000012 1788461225.603564 mapread 0x008e48 thru 0x00db8c (0x4d45 bytes) 000013 1788461225.629545 punch from 0x022204 to 0x02a4ad (0x82aa bytes) 000014 1788461225.705454 write 0x01c729 thru 0x0241f2 (0x7aca bytes) truncating to largest ever: 0x3ddfc 000015 1788461225.718663 trunc from 0x02a4ae to 0x03ddfb (0x1394e bytes) 000017 1788461225.758922 trunc from 0x03ddfc to 0x038154 (0x5ca7 bytes) 000018 1788461225.782449 read 0x0294b9 thru 0x02a1b1 (0xcf9 bytes) 000019 1788461225.792845 punch from 0x0341a5 to 0x038154 (0x3fb0 bytes) 000020 1788461225.812500 write 0x022b30 thru 0x032524 (0xf9f5 bytes) 000021 1788461225.820522 trunc from 0x038155 to 0x03babf (0x396b bytes) 000024 1788461225.836792 mapread 0x007407 thru 0x007fdf (0xbd9 bytes) 000025 1788461225.858389 mapread 0x03a659 thru 0x03babf (0x1467 bytes) 000027 1788461225.873876 mapwrite 0x020e69 thru 0x02a877 (0x9a0f bytes) 000028 1788461225.967223 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) 000029 1788461226.181105 read 0x00a89a thru 0x00c32b (0x1a92 bytes) 000030 1788461226.186246 punch from 0x00d846 to 0x0170b7 (0x9872 bytes) 000031 1788461226.196454 write 0x014b29 thru 0x022e04 (0xe2dc bytes) 000032 1788461226.224282 trunc from 0x03bac0 to 0x00076f (0x3b350 bytes) 000033 1788461226.254000 write 0x00a744 thru 0x00fbb4 (0x5471 bytes) 000034 1788461226.258045 write 0x0258f8 thru 0x027caf (0x23b8 bytes) 000035 1788461226.262875 read 0x0196c5 thru 0x025474 (0xbdb0 bytes) 000036 1788461226.280021 mapread 0x02194c thru 0x027caf (0x6364 bytes) 000037 1788461226.281417 punch from 0x0062c2 to 0x006462 (0x1a1 bytes) 000038 1788461226.294322 trunc from 0x027cb0 to 0x039f5b (0x122ac bytes) 000039 1788461226.310390 trunc from 0x039f5c to 0x030a27 (0x9534 bytes) 000040 1788461226.329468 mapread 0x019bdb thru 0x01f24d (0x5673 bytes) 000041 1788461226.330633 mapwrite 0x01b69c thru 0x029f3b (0xe8a0 bytes) 000042 1788461226.401628 trunc from 0x030a28 to 0x039ec5 (0x949e bytes) 000043 1788461226.416340 punch from 0x02ec50 to 0x039ec5 (0xb276 bytes) 000045 1788461226.428477 punch from 0x00dabb to 0x017237 (0x977d bytes) 000047 1788461226.440317 punch from 0x01f94f to 0x02be22 (0xc4d4 bytes) 000048 1788461226.445451 mapwrite 0x018809 thru 0x02454e (0xbd46 bytes) 000049 1788461226.640703 mapwrite 0x01eede thru 0x026a04 (0x7b27 bytes) 000051 1788461226.745009 write 0x0174bb thru 0x0273c1 (0xff07 bytes) 000052 1788461226.755937 mapread 0x02750f thru 0x02a80f (0x3301 bytes) 000053 1788461226.778673 punch from 0x005a5c to 0x007871 (0x1e16 bytes) 000055 1788461226.804642 punch from 0x039950 to 0x039ec5 (0x576 bytes) 000056 1788461226.811517 write 0x02aa00 thru 0x031060 (0x6661 bytes) 000057 1788461226.815509 mapread 0x0248c2 thru 0x033962 (0xf0a1 bytes) 000058 1788461226.821939 mapread 0x026c09 thru 0x02aedc (0x42d4 bytes) 000059 1788461226.823547 trunc from 0x039ec6 to 0x017316 (0x22baf bytes) 000063 1788461226.867972 mapwrite 0x00e17f thru 0x017ff9 (0x9e7b bytes) 000064 1788461227.017783 read 0x006c2f thru 0x00a144 (0x3516 bytes) 000065 1788461227.049813 read 0x003234 thru 0x005126 (0x1ef3 bytes) 000067 1788461227.052352 write 0x0235c5 thru 0x0238aa (0x2e6 bytes) 000068 1788461227.056968 read 0x0216a5 thru 0x0221f4 (0xb50 bytes) 000071 1788461227.071353 mapwrite 0x02ae05 thru 0x02fc85 (0x4e81 bytes) 000072 1788461227.170631 write 0x0260dc thru 0x0307e6 (0xa70b bytes) 000073 1788461227.172201 mapread 0x028817 thru 0x0307e6 (0x7fd0 bytes) 000074 1788461227.173468 write 0x00efbf thru 0x019461 (0xa4a3 bytes) 000075 1788461227.174994 read 0x006194 thru 0x00aa99 (0x4906 bytes) 000077 1788461227.176455 mapread 0x0079e5 thru 0x015b03 (0xe11f bytes) 000078 1788461227.177524 trunc from 0x0307e7 to 0x033be8 (0x3402 bytes) 000085 1788461227.201955 mapwrite 0x00e6a7 thru 0x01b2b4 (0xcc0e bytes) 000086 1788461227.236006 trunc from 0x033be9 to 0x01fb08 (0x140e0 bytes) 000087 1788461227.257482 read 0x00f062 thru 0x01436c (0x530b bytes) 000088 1788461227.258387 trunc from 0x01fb09 to 0x032057 (0x1254f bytes) 000089 1788461227.279727 mapwrite 0x011d16 thru 0x01af20 (0x920b bytes) 000091 1788461227.344719 mapread 0x01c7d0 thru 0x01ed4a (0x257b bytes) 000093 1788461227.347221 punch from 0x011318 to 0x01eb65 (0xd84e bytes) 000094 1788461227.355588 MIRROR_EXTEND to 2 mirrors 000095 1788461227.916419 write 0x03d0e1 thru 0x03ffff (0x2f1f bytes) 000098 1788461227.960236 mapread 0x021395 thru 0x02d351 (0xbfbd bytes) 000099 1788461227.980514 read 0x00472c thru 0x00d5e4 (0x8eb9 bytes) 000100 1788461227.989374 write 0x019200 thru 0x01a181 (0xf82 bytes) 000101 1788461227.996638 mapwrite 0x0203b8 thru 0x024192 (0x3ddb bytes) 000102 1788461228.042877 write 0x00bd8c thru 0x00e46c (0x26e1 bytes) 000103 1788461228.055138 write 0x01a118 thru 0x02163d (0x7526 bytes) 000105 1788461228.056844 mapread 0x02c35d thru 0x03abe2 (0xe886 bytes) 000106 1788461228.087572 read 0x02a1b6 thru 0x03034c (0x6197 bytes) 000107 1788461228.088140 write 0x027792 thru 0x028693 (0xf02 bytes) 000108 1788461228.088957 write 0x037dcf thru 0x03e415 (0x6647 bytes) 000109 1788461228.090270 mapread 0x0079a9 thru 0x009d22 (0x237a bytes) 000110 1788461228.091091 punch from 0x0192ec to 0x01c083 (0x2d98 bytes) 000112 1788461228.105898 mapwrite 0x00692a thru 0x0131af (0xc886 bytes) 000113 1788461228.162771 mapread 0x03a550 thru 0x03ffff (0x5ab0 bytes) 000114 1788461228.164068 write 0x02a08e thru 0x032695 (0x8608 bytes) 000115 1788461228.168731 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4c52f492 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x56ca98e9 Mirror 3: 0x56ca98e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000116 1788461229.199835 write 0x00f20f thru 0x0195be (0xa3b0 bytes) 000117 1788461229.310953 trunc from 0x040000 to 0x01e0bf (0x21f40 bytes) 000119 1788461229.385397 write 0x0388f5 thru 0x03ffff (0x770b bytes) 000121 1788461229.391293 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x56ca98e9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x56ca98e9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000122 1788461229.738607 punch from 0x00aeb9 to 0x01832a (0xd472 bytes) 000123 1788461229.752922 trunc from 0x040000 to 0x033c23 (0xc3dc bytes) 000124 1788461229.779752 write 0x03742a thru 0x037b5a (0x731 bytes) 000126 1788461229.783749 write 0x033fc8 thru 0x03a18c (0x61c5 bytes) 000127 1788461229.810169 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3a18d): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a18d): Mirror 3: 0x7c084d03 (stale) CRC-32 checksum value for chunk [0, 0x3a18d): Mirror 1: 0xf93fa77e Mirror 4: 0xf93fa77e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a18d: skipped 000128 1788461230.950595 write 0x038cba thru 0x03a11d (0x1464 bytes) 000129 1788461231.031990 trunc from 0x03a18d to 0x02b2cf (0xeebd bytes) 000130 1788461231.057314 MIRROR_RESYNC 3 mirrors 000131 1788461231.958586 mapread 0x02aa24 thru 0x02b2cf (0x8ac bytes) 000132 1788461231.987131 write 0x007b0a thru 0x016c20 (0xf117 bytes) 000133 1788461232.071764 mapwrite 0x03c650 thru 0x03ffff (0x39b0 bytes) 000134 1788461232.169805 mapwrite 0x00b5a9 thru 0x0178a1 (0xc2f9 bytes) 000135 1788461232.223886 mapwrite 0x02c4a8 thru 0x030469 (0x3fc2 bytes) 000137 1788461232.347218 punch from 0x0334c7 to 0x03a57d (0x70b7 bytes) 000138 1788461232.358677 punch from 0x030081 to 0x03c798 (0xc718 bytes) 000140 1788461232.374552 trunc from 0x040000 to 0x01fce9 (0x20316 bytes) 000141 1788461232.415642 trunc from 0x01fcea to 0x001e34 (0x1deb5 bytes) 000144 1788461232.451914 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e35): Mirror 3: 0x9ea9fbb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e35): Mirror 3: 0x9ea9fbb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e35: skipped 000145 1788461232.680823 mapwrite 0x007cdf thru 0x00ad57 (0x3079 bytes) 000146 1788461232.758312 read 0x006a35 thru 0x00ad57 (0x4323 bytes) 000147 1788461232.759479 write 0x0176eb thru 0x01cc45 (0x555b bytes) 000148 1788461232.768199 mapwrite 0x030e79 thru 0x036e39 (0x5fc1 bytes) 000149 1788461232.842993 punch from 0x0101b3 to 0x01f83a (0xf688 bytes) 000150 1788461232.853411 mapwrite 0x01d3eb thru 0x029438 (0xc04e bytes) 000152 1788461232.900410 trunc from 0x036e3a to 0x01de89 (0x18fb0 bytes) 000153 1788461232.934496 write 0x0044f5 thru 0x00fa42 (0xb54e bytes) 000155 1788461232.940350 read 0x00fd6d thru 0x01b25e (0xb4f2 bytes) 000158 1788461232.947455 trunc from 0x01de8a to 0x02bd6a (0xdee1 bytes) 000159 1788461232.965204 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) 000160 1788461233.158940 mapread 0x004890 thru 0x00873d (0x3eae bytes) 000163 1788461233.180585 mapread 0x006134 thru 0x00ab99 (0x4a66 bytes) 000164 1788461233.181658 read 0x002e11 thru 0x004e39 (0x2029 bytes) 000165 1788461233.182427 mapread 0x01f082 thru 0x026129 (0x70a8 bytes) 000166 1788461233.197465 mapread 0x0081e9 thru 0x00b5df (0x33f7 bytes) 000167 1788461233.198315 punch from 0x0108db to 0x015a24 (0x514a bytes) 000168 1788461233.202549 mapwrite 0x008c21 thru 0x012f05 (0xa2e5 bytes) 000170 1788461233.261289 write 0x03e015 thru 0x03f9a9 (0x1995 bytes) 000171 1788461233.262347 trunc from 0x03f9aa to 0x03ab4e (0x4e5b bytes) 000172 1788461233.284175 trunc from 0x03ab4f to 0x01b6a9 (0x1f4a5 bytes) 000177 1788461233.304630 MIRROR_EXTEND to 2 mirrors 000178 1788461234.069037 punch from 0x0058e0 to 0x00ad17 (0x5438 bytes) truncating to largest ever: 0x3ec60 000180 1788461234.195440 trunc from 0x01b6aa to 0x03ec5f (0x235b6 bytes) 000181 1788461234.216186 trunc from 0x03ec60 to 0x018397 (0x268c8 bytes) 000185 1788461234.231599 trunc from 0x018398 to 0x005091 (0x13306 bytes) 000186 1788461234.261381 mapwrite 0x02fa7d thru 0x036a33 (0x6fb7 bytes) 000189 1788461234.390906 mapwrite 0x03b37e thru 0x03f88b (0x450e bytes) 000190 1788461234.510446 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) 000191 1788461234.701790 punch from 0x00b749 to 0x00c393 (0xc4b bytes) 000192 1788461234.710833 punch from 0x01c861 to 0x01ff52 (0x36f2 bytes) 000193 1788461234.718926 read 0x0087d3 thru 0x010b7f (0x83ad bytes) 000195 1788461234.738660 mapwrite 0x02a417 thru 0x02d43e (0x3028 bytes) 000196 1788461234.896308 punch from 0x00afc8 to 0x01346b (0x84a4 bytes) 000198 1788461234.911405 trunc from 0x03f88c to 0x0374cb (0x83c0 bytes) 000199 1788461234.927374 read 0x0144b5 thru 0x0184b7 (0x4003 bytes) 000201 1788461234.940115 read 0x017add thru 0x01dea1 (0x63c5 bytes) 000203 1788461234.941908 read 0x01980e thru 0x02065d (0x6e50 bytes) 000205 1788461234.954193 mapread 0x02c454 thru 0x02cb36 (0x6e3 bytes) 000209 1788461234.962963 punch from 0x00654f to 0x00d573 (0x7025 bytes) 000210 1788461234.970394 mapread 0x02fc51 thru 0x035ba6 (0x5f56 bytes) 000211 1788461234.971348 mapwrite 0x0014da thru 0x00ef5c (0xda83 bytes) 000214 1788461235.165587 mapwrite 0x02adcc thru 0x02b6cc (0x901 bytes) 000215 1788461235.279566 mapwrite 0x01b71e thru 0x01c871 (0x1154 bytes) 000218 1788461235.435026 write 0x003c3f thru 0x00674c (0x2b0e bytes) 000219 1788461235.435937 read 0x029c66 thru 0x030fbe (0x7359 bytes) 000220 1788461235.448937 MIRROR_EXTEND to 2 mirrors 000224 1788461236.188880 MIRROR_RESYNC 2 mirrors 000226 1788461236.624612 mapwrite 0x014098 thru 0x020e8d (0xcdf6 bytes) 000227 1788461236.803542 punch from 0x036465 to 0x0374cb (0x1067 bytes) 000228 1788461236.820069 MIRROR_RESYNC 2 mirrors 000230 1788461237.596635 read 0x001c70 thru 0x00d2cc (0xb65d bytes) 000231 1788461237.614243 trunc from 0x0374cc to 0x027eb1 (0xf61a bytes) 000236 1788461237.767019 mapwrite 0x01d161 thru 0x024930 (0x77d0 bytes) 000237 1788461237.962874 punch from 0x01b572 to 0x025aae (0xa53d bytes) 000238 1788461237.998242 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x27eb2): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27eb2): Mirror 2: 0x6dc4088 (stale) CRC-32 checksum value for chunk [0, 0x27eb2): Mirror 1: 0xf4f965c8 Mirror 3: 0xf4f965c8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27eb2: skipped 000239 1788461239.242422 mapwrite 0x02077b thru 0x022bf5 (0x247b bytes) 000240 1788461239.686449 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27eb2): Mirror 3: 0xf4f965c8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27eb2): Mirror 3: 0xf4f965c8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27eb2: skipped 000241 1788461240.282855 write 0x03a303 thru 0x03ffff (0x5cfd bytes) 000244 1788461240.310504 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) 000245 1788461240.536911 punch from 0x016dab to 0x01d2ff (0x6555 bytes) 000246 1788461240.548163 mapread 0x01a11f thru 0x02711b (0xcffd bytes) 000247 1788461240.608774 read 0x011260 thru 0x0135f7 (0x2398 bytes) 000248 1788461240.643625 punch from 0x01dca8 to 0x021348 (0x36a1 bytes) 000251 1788461240.651608 mapwrite 0x0245b7 thru 0x0296bb (0x5105 bytes) 000254 1788461240.783797 mapwrite 0x00fc3f thru 0x017657 (0x7a19 bytes) 000255 1788461240.926000 read 0x029a19 thru 0x030f0a (0x74f2 bytes) 000256 1788461240.937331 punch from 0x008118 to 0x011c67 (0x9b50 bytes) 000258 1788461240.943012 mapwrite 0x030cb9 thru 0x033ae7 (0x2e2f bytes) 000259 1788461241.012065 write 0x03c79d thru 0x03ffff (0x3863 bytes) 000260 1788461241.013098 read 0x037573 thru 0x03ffff (0x8a8d bytes) 000261 1788461241.014040 mapread 0x0179e0 thru 0x019218 (0x1839 bytes) 000262 1788461241.014908 mapread 0x03c6b3 thru 0x03ffff (0x394d bytes) 000268 1788461241.018724 punch from 0x0215e7 to 0x031449 (0xfe63 bytes) 000269 1788461241.028049 write 0x00bc87 thru 0x01a55b (0xe8d5 bytes) 000270 1788461241.035599 mapwrite 0x0236f3 thru 0x02f5f0 (0xbefe bytes) 000271 1788461241.082290 write 0x024442 thru 0x02e2aa (0x9e69 bytes) 000273 1788461241.083921 trunc from 0x040000 to 0x036560 (0x9a9f bytes) 000274 1788461241.118293 trunc from 0x036561 to 0x02ff3e (0x6622 bytes) 000276 1788461241.145573 mapread 0x002d9d thru 0x00b608 (0x886c bytes) 000278 1788461241.147333 mapread 0x01c509 thru 0x026bf0 (0xa6e8 bytes) 000281 1788461241.152098 punch from 0x012863 to 0x01f708 (0xcea6 bytes) 000283 1788461241.166338 mapread 0x02a78d thru 0x02ff3e (0x57b2 bytes) 000285 1788461241.167596 write 0x00d2d2 thru 0x012362 (0x5091 bytes) 000286 1788461241.173583 read 0x00cc3b thru 0x0124b7 (0x587d bytes) 000290 1788461241.175848 read 0x006547 thru 0x00a97d (0x4437 bytes) 000291 1788461241.177301 mapwrite 0x01fc7b thru 0x02b78d (0xbb13 bytes) 000293 1788461241.279716 trunc from 0x02ff3f to 0x02f1e9 (0xd55 bytes) 000295 1788461241.322845 MIRROR_EXTEND to 2 mirrors 000296 1788461242.485725 read 0x00bbe5 thru 0x00be2d (0x249 bytes) 000298 1788461242.500363 read 0x000e5c thru 0x00ddd8 (0xcf7d bytes) 000299 1788461242.611758 write 0x004b30 thru 0x0078d9 (0x2daa bytes) 000300 1788461242.808667 mapread 0x022156 thru 0x02f1e9 (0xd094 bytes) 000301 1788461242.970519 punch from 0x01626a to 0x01d120 (0x6eb7 bytes) 000302 1788461243.004378 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) 000303 1788461243.242154 write 0x02876e thru 0x02e88c (0x611f bytes) 000305 1788461243.260559 mapwrite 0x02e5f1 thru 0x036e81 (0x8891 bytes) 000306 1788461243.453318 write 0x0316a0 thru 0x03b8b2 (0xa213 bytes) 000307 1788461243.465040 MIRROR_EXTEND to 2 mirrors 000308 1788461244.472103 write 0x02a640 thru 0x02ee7f (0x4840 bytes) 000310 1788461244.641492 mapwrite 0x0322f6 thru 0x03f053 (0xcd5e bytes) 000313 1788461244.759902 mapwrite 0x0359c2 thru 0x03f1fe (0x983d bytes) 000315 1788461244.834731 trunc from 0x03f1ff to 0x009094 (0x3616a bytes) 000316 1788461244.856201 trunc from 0x009095 to 0x02df89 (0x24ef5 bytes) 000317 1788461244.883377 mapwrite 0x01fd16 thru 0x022a53 (0x2d3e bytes) 000318 1788461244.966835 mapwrite 0x019f2e thru 0x02680f (0xc8e2 bytes) 000319 1788461245.065582 mapwrite 0x01feb2 thru 0x02a165 (0xa2b4 bytes) 000320 1788461245.132339 mapread 0x0249ac thru 0x02c526 (0x7b7b bytes) 000321 1788461245.134105 trunc from 0x02df8a to 0x007914 (0x26675 bytes) 000323 1788461245.178236 trunc from 0x007915 to 0x02b952 (0x2403e bytes) 000324 1788461245.222546 mapread 0x0164a6 thru 0x01ffba (0x9b15 bytes) 000325 1788461245.278082 mapread 0x01638f thru 0x01fa62 (0x96d4 bytes) 000327 1788461245.279504 mapread 0x01dc67 thru 0x021762 (0x3afc bytes) 000331 1788461245.295370 mapread 0x0003a9 thru 0x00f88f (0xf4e7 bytes) 000334 1788461245.313084 read 0x01e937 thru 0x02b952 (0xd01c bytes) 000335 1788461245.319570 mapwrite 0x020034 thru 0x028646 (0x8613 bytes) 000336 1788461245.372134 write 0x02fce2 thru 0x03948c (0x97ab bytes) 000337 1788461245.373520 punch from 0x0357fc to 0x03948c (0x3c91 bytes) 000338 1788461245.382506 trunc from 0x03948d to 0x013854 (0x25c38 bytes) 000340 1788461245.406376 punch from 0x011f99 to 0x013854 (0x18bc bytes) 000342 1788461245.416395 read 0x0036ee thru 0x010df9 (0xd70c bytes) 000344 1788461245.423155 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) 000345 1788461245.620105 MIRROR_EXTEND to 2 mirrors 000347 1788461246.465026 read 0x000216 thru 0x00d1ee (0xcfd9 bytes) 000348 1788461246.484351 mapread 0x006ecd thru 0x00df12 (0x7046 bytes) 000349 1788461246.485873 write 0x00bb13 thru 0x013437 (0x7925 bytes) 000350 1788461246.598200 read 0x00323c thru 0x00ce95 (0x9c5a bytes) 000351 1788461246.616920 mapwrite 0x007f41 thru 0x01283a (0xa8fa bytes) 000352 1788461246.700351 write 0x0255e6 thru 0x026075 (0xa90 bytes) 000353 1788461246.701891 punch from 0x009de5 to 0x012a85 (0x8ca1 bytes) 000354 1788461246.723978 write 0x015a73 thru 0x0191a5 (0x3733 bytes) 000355 1788461246.746857 mapwrite 0x01125c thru 0x016d47 (0x5aec bytes) 000357 1788461246.903652 punch from 0x021528 to 0x026075 (0x4b4e bytes) 000358 1788461246.918973 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) 000359 1788461247.194765 mapread 0x00a0fe thru 0x00c633 (0x2536 bytes) 000360 1788461247.256730 read 0x004b7d thru 0x00b4aa (0x692e bytes) 000361 1788461247.263304 punch from 0x01a598 to 0x026075 (0xbade bytes) 000363 1788461247.281209 trunc from 0x026076 to 0x031a5e (0xb9e9 bytes) 000364 1788461247.325240 read 0x02a443 thru 0x02a91d (0x4db bytes) 000365 1788461247.351773 write 0x016fad thru 0x02291b (0xb96f bytes) 000366 1788461247.354554 write 0x0078c4 thru 0x016f20 (0xf65d bytes) 000367 1788461247.362734 write 0x028f38 thru 0x032bfe (0x9cc7 bytes) 000368 1788461247.365955 read 0x020ad4 thru 0x02d2c2 (0xc7ef bytes) 000370 1788461247.368345 mapread 0x0049a6 thru 0x00da05 (0x9060 bytes) 000371 1788461247.371140 punch from 0x021421 to 0x02befe (0xaade bytes) 000372 1788461247.382136 trunc from 0x032bff to 0x03aa5d (0x7e5f bytes) 000373 1788461247.399744 write 0x03c5f7 thru 0x03ffff (0x3a09 bytes) 000377 1788461247.407555 mapwrite 0x0265b0 thru 0x035b25 (0xf576 bytes) 000378 1788461247.527355 mapread 0x02c443 thru 0x02db7c (0x173a bytes) 000379 1788461247.528283 mapwrite 0x004e95 thru 0x00bf93 (0x70ff bytes) 000380 1788461247.646601 mapread 0x0197e7 thru 0x026eb6 (0xd6d0 bytes) 000381 1788461247.647573 trunc from 0x040000 to 0x00159c (0x3ea63 bytes) 000382 1788461247.663983 read 0x000664 thru 0x001156 (0xaf3 bytes) 000383 1788461247.665727 punch from 0x0006bc to 0x00159c (0xee1 bytes) 000384 1788461247.672859 read 0x000bab thru 0x00159c (0x9f2 bytes) 000387 1788461247.688763 MIRROR_EXTEND to 2 mirrors 000389 1788461248.787305 read 0x000e48 thru 0x00159c (0x755 bytes) 000390 1788461248.804869 mapwrite 0x006d66 thru 0x00a747 (0x39e2 bytes) 000391 1788461249.049853 write 0x021a6a thru 0x030cfb (0xf292 bytes) 000393 1788461249.053471 trunc from 0x030cfc to 0x0370b0 (0x63b5 bytes) 000394 1788461249.079407 mapread 0x0307f4 thru 0x032c2c (0x2439 bytes) 000395 1788461249.087669 mapwrite 0x034eef thru 0x03ffff (0xb111 bytes) 000397 1788461249.202834 mapread 0x01402f thru 0x01a761 (0x6733 bytes) 000398 1788461249.228357 write 0x00a00b thru 0x01743b (0xd431 bytes) 000399 1788461249.238983 MIRROR_RESYNC 2 mirrors 000400 1788461250.748288 mapwrite 0x027b8f thru 0x034e08 (0xd27a bytes) 000401 1788461251.025502 mapread 0x034cb2 thru 0x035d72 (0x10c1 bytes) 000402 1788461251.027335 trunc from 0x040000 to 0x028eb9 (0x17146 bytes) 000403 1788461251.070062 write 0x03838f thru 0x03ffff (0x7c71 bytes) 000404 1788461251.071495 write 0x007d37 thru 0x016bb0 (0xee7a bytes) 000405 1788461251.096501 punch from 0x006fd4 to 0x015433 (0xe460 bytes) 000406 1788461251.131612 trunc from 0x040000 to 0x00d7bc (0x32843 bytes) 000408 1788461251.161224 punch from 0x001544 to 0x00722d (0x5cea bytes) 000409 1788461251.169284 mapwrite 0x03f84b thru 0x03ffff (0x7b5 bytes) 000411 1788461251.234611 mapwrite 0x037b4f thru 0x03ffff (0x84b1 bytes) 000412 1788461251.277916 punch from 0x02a796 to 0x030ab3 (0x631e bytes) 000413 1788461251.286768 read 0x03b35a thru 0x03ffff (0x4ca6 bytes) 000414 1788461251.287396 punch from 0x016c5d to 0x0242f5 (0xd699 bytes) 000415 1788461251.294233 mapwrite 0x029bd3 thru 0x02caa0 (0x2ece bytes) 000416 1788461251.392159 MIRROR_RESYNC 2 mirrors 000417 1788461252.513212 write 0x004de0 thru 0x0100c9 (0xb2ea bytes) 000419 1788461252.583949 read 0x01b0cb thru 0x01f03f (0x3f75 bytes) 000420 1788461252.589604 write 0x0164c9 thru 0x0202b1 (0x9de9 bytes) 000422 1788461252.597630 mapread 0x03b754 thru 0x03ffff (0x48ac bytes) 000423 1788461252.611006 mapwrite 0x00c95c thru 0x00f107 (0x27ac bytes) 000424 1788461252.700958 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x35727759 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x318f72d6 Mirror 3: 0x318f72d6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000425 1788461253.503738 punch from 0x009016 to 0x016abe (0xdaa9 bytes) 000426 1788461253.646381 mapwrite 0x01d1af thru 0x0264e5 (0x9337 bytes) 000427 1788461253.849547 mapread 0x021803 thru 0x022463 (0xc61 bytes) 000428 1788461253.850323 mapread 0x035944 thru 0x03ffff (0xa6bc bytes) 000429 1788461253.880087 mapwrite 0x0241d4 thru 0x026244 (0x2071 bytes) 000430 1788461253.995773 trunc from 0x040000 to 0x03396b (0xc694 bytes) 000432 1788461254.042110 trunc from 0x03396c to 0x001200 (0x3276b bytes) 000433 1788461254.075654 write 0x02e967 thru 0x03dc3d (0xf2d7 bytes) 000434 1788461254.094166 mapread 0x03638c thru 0x03cf9a (0x6c0f bytes) 000435 1788461254.104610 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dc3e): Mirror 3: 0xf0008bb4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc3e): Mirror 3: 0xf0008bb4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc3e: skipped 000436 1788461254.613771 mapread 0x0124a1 thru 0x012a28 (0x588 bytes) 000437 1788461254.624788 punch from 0x01bcdf to 0x02a93f (0xec61 bytes) 000438 1788461254.660046 write 0x03c069 thru 0x03d913 (0x18ab bytes) 000440 1788461254.708653 read 0x032365 thru 0x03dc3d (0xb8d9 bytes) 000441 1788461254.735021 write 0x000960 thru 0x008398 (0x7a39 bytes) 000442 1788461254.775030 mapread 0x01c56b thru 0x0238ba (0x7350 bytes) 000443 1788461254.828040 read 0x017bed thru 0x01a522 (0x2936 bytes) 000444 1788461254.829203 punch from 0x01733b to 0x020dfa (0x9ac0 bytes) 000445 1788461254.881064 mapwrite 0x016f12 thru 0x021528 (0xa617 bytes) 000446 1788461255.004428 punch from 0x02d27f to 0x033508 (0x628a bytes) 000447 1788461255.014753 read 0x00a2db thru 0x019db4 (0xfada bytes) 000448 1788461255.016043 punch from 0x03cc9f to 0x03dc3d (0xf9f bytes) 000451 1788461255.024471 write 0x029b57 thru 0x032fb0 (0x945a bytes) 000452 1788461255.039154 write 0x02addd thru 0x03917e (0xe3a2 bytes) 000453 1788461255.049301 mapwrite 0x013427 thru 0x0210f5 (0xdccf bytes) 000454 1788461255.121212 mapwrite 0x03c9c5 thru 0x03ffff (0x363b bytes) 000455 1788461255.250885 write 0x022c02 thru 0x02d7f2 (0xabf1 bytes) 000456 1788461255.253675 punch from 0x038c28 to 0x03ffff (0x73d8 bytes) 000457 1788461255.302067 read 0x00d17b thru 0x00dab0 (0x936 bytes) 000459 1788461255.303038 mapread 0x00501d thru 0x00e258 (0x923c bytes) 000460 1788461255.303880 punch from 0x028f10 to 0x03292f (0x9a20 bytes) 000461 1788461255.310691 mapwrite 0x009580 thru 0x00e95e (0x53df bytes) 000462 1788461255.419154 write 0x00ac61 thru 0x00ba41 (0xde1 bytes) 000463 1788461255.420023 read 0x02b93d thru 0x02db4a (0x220e bytes) 000464 1788461255.479803 MIRROR_RESYNC 2 mirrors 000465 1788461256.529858 mapread 0x03dbe6 thru 0x03e0a8 (0x4c3 bytes) 000466 1788461256.538803 punch from 0x00e0b7 to 0x012935 (0x487f bytes) 000467 1788461256.605146 mapwrite 0x02859c thru 0x029f73 (0x19d8 bytes) 000468 1788461256.726136 read 0x02de8b thru 0x035c79 (0x7def bytes) 000471 1788461256.762317 MIRROR_RESYNC 2 mirrors 000473 1788461257.458787 write 0x02fdbe thru 0x0317ce (0x1a11 bytes) 000475 1788461257.518569 write 0x0363c4 thru 0x039969 (0x35a6 bytes) 000476 1788461257.525758 read 0x00fe80 thru 0x016b78 (0x6cf9 bytes) 000478 1788461257.532055 read 0x03800f thru 0x03ffff (0x7ff1 bytes) 000479 1788461257.539571 mapread 0x03dbdf thru 0x03ffff (0x2421 bytes) 000480 1788461257.540341 read 0x02a0e2 thru 0x02afde (0xefd bytes) 000481 1788461257.543516 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3c7546eb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb1b1ad42 Mirror 4: 0xb1b1ad42 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000482 1788461258.198615 mapread 0x005b99 thru 0x0108c3 (0xad2b bytes) 000483 1788461258.223338 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3c7546eb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb1b1ad42 Mirror 4: 0xb1b1ad42 Mirror 5: 0xb1b1ad42 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000484 1788461258.872455 mapread 0x017bc7 thru 0x0188e5 (0xd1f bytes) 000485 1788461258.886713 write 0x034907 thru 0x03a79d (0x5e97 bytes) 000487 1788461258.960837 mapwrite 0x035591 thru 0x03ffff (0xaa6f bytes) 000489 1788461259.022212 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3c7546eb (stale) Mirror 4: 0xb1b1ad42 (stale) Mirror 5: 0xb1b1ad42 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa10a9af4 Mirror 6: 0xa10a9af4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000490 1788461259.996383 read 0x00de89 thru 0x017f01 (0xa079 bytes) 000491 1788461260.009598 read 0x00edd6 thru 0x017a95 (0x8cc0 bytes) 000492 1788461260.017342 write 0x02222a thru 0x0267cd (0x45a4 bytes) 000494 1788461260.108018 mapwrite 0x02ef4b thru 0x0328c3 (0x3979 bytes) 000495 1788461260.154372 punch from 0x012e72 to 0x01d24c (0xa3db bytes) 000497 1788461260.160064 write 0x024ca3 thru 0x02f84d (0xabab bytes) 000499 1788461260.162838 mapwrite 0x01bc62 thru 0x02653a (0xa8d9 bytes) 000500 1788461260.314132 trunc from 0x040000 to 0x02a5c6 (0x15a39 bytes) 000504 1788461260.358328 punch from 0x00b811 to 0x01823d (0xca2d bytes) 000505 1788461260.377478 read 0x0058c0 thru 0x006ff7 (0x1738 bytes) 000506 1788461260.378750 mapwrite 0x03b271 thru 0x03ffff (0x4d8f bytes) 000508 1788461260.503056 MIRROR_RESYNC 5 mirrors 000510 1788461261.860644 mapread 0x0160ca thru 0x0197f2 (0x3729 bytes) 000512 1788461261.879899 write 0x01f1ee thru 0x028cd2 (0x9ae5 bytes) 000513 1788461261.967737 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7b4a27ec (stale) Mirror 4: 0x7b4a27ec (stale) Mirror 5: 0x7b4a27ec (stale) Mirror 6: 0x7b4a27ec (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcbb05155 Mirror 7: 0xcbb05155 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000514 1788461262.907558 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7b4a27ec (stale) Mirror 4: 0x7b4a27ec (stale) Mirror 5: 0x7b4a27ec (stale) Mirror 6: 0x7b4a27ec (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcbb05155 Mirror 7: 0xcbb05155 Mirror 8: 0xcbb05155 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000516 1788461263.895367 mapread 0x02fd79 thru 0x034678 (0x4900 bytes) 000518 1788461263.920066 mapread 0x0376fa thru 0x03abcd (0x34d4 bytes) 000521 1788461263.933112 trunc from 0x040000 to 0x0290d0 (0x16f2f bytes) 000523 1788461264.048001 mapwrite 0x01fb5d thru 0x0234a9 (0x394d bytes) 000529 1788461264.123618 trunc from 0x0290d1 to 0x001c98 (0x27438 bytes) 000530 1788461264.146183 read 0x000a38 thru 0x001c98 (0x1261 bytes) 000531 1788461264.156365 read 0x0000b9 thru 0x001c98 (0x1be0 bytes) 000532 1788461264.160047 trunc from 0x001c99 to 0x0191d5 (0x1753d bytes) 000533 1788461264.185022 mapwrite 0x02fe29 thru 0x03289a (0x2a72 bytes) 000534 1788461264.281897 read 0x01e3a4 thru 0x023d16 (0x5973 bytes) 000536 1788461264.290578 mapread 0x0052d7 thru 0x011356 (0xc080 bytes) 000537 1788461264.292537 read 0x001a72 thru 0x0049b3 (0x2f42 bytes) 000538 1788461264.293999 mapread 0x031822 thru 0x03289a (0x1079 bytes) 000540 1788461264.299008 write 0x034ff5 thru 0x03ffff (0xb00b bytes) 000541 1788461264.302204 trunc from 0x040000 to 0x0123a2 (0x2dc5d bytes) 000543 1788461264.324909 write 0x00bfe2 thru 0x01b1a5 (0xf1c4 bytes) 000545 1788461264.327904 punch from 0x0047ef to 0x0072a3 (0x2ab5 bytes) 000546 1788461264.365913 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1b1a6): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b1a6): Mirror 3: 0xa33ba5f3 (stale) Mirror 4: 0xa33ba5f3 (stale) Mirror 5: 0xa33ba5f3 (stale) Mirror 6: 0xa33ba5f3 (stale) Mirror 7: 0xa33ba5f3 (stale) Mirror 8: 0xa33ba5f3 (stale) CRC-32 checksum value for chunk [0, 0x1b1a6): Mirror 1: 0x7c167ecf Mirror 9: 0x7c167ecf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b1a6: skipped 000547 1788461265.277553 mapread 0x012057 thru 0x01b1a5 (0x914f bytes) 000550 1788461265.302098 write 0x03558a thru 0x03ffff (0xaa76 bytes) 000553 1788461265.401358 read 0x02bb93 thru 0x03521d (0x968b bytes) 000554 1788461265.416405 read 0x018b4b thru 0x01b136 (0x25ec bytes) 000555 1788461265.429197 mapread 0x00b9a8 thru 0x010dd9 (0x5432 bytes) 000556 1788461265.430598 mapwrite 0x03b542 thru 0x03ffff (0x4abe bytes) 000557 1788461265.500325 read 0x00453a thru 0x00e9f7 (0xa4be bytes) 000558 1788461265.507774 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7b4a27ec (stale) Mirror 4: 0x7b4a27ec (stale) Mirror 5: 0x7b4a27ec (stale) Mirror 6: 0x7b4a27ec (stale) Mirror 7: 0xcbb05155 (stale) Mirror 8: 0xcbb05155 (stale) Mirror 9: 0x459d66e4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x30c947e1 Mirror 10: 0x30c947e1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000559 1788461266.665548 write 0x0152af thru 0x018921 (0x3673 bytes) 000561 1788461266.758044 read 0x022e49 thru 0x027c5b (0x4e13 bytes) 000563 1788461266.773038 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7b4a27ec (stale) Mirror 4: 0x7b4a27ec (stale) Mirror 5: 0x7b4a27ec (stale) Mirror 6: 0x7b4a27ec (stale) Mirror 8: 0xcbb05155 (stale) Mirror 9: 0x459d66e4 (stale) Mirror 10: 0x30c947e1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7b4a27ec (stale) Mirror 4: 0x7b4a27ec (stale) Mirror 5: 0x7b4a27ec (stale) Mirror 6: 0x7b4a27ec (stale) Mirror 8: 0xcbb05155 (stale) Mirror 9: 0x459d66e4 (stale) Mirror 10: 0x30c947e1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000566 1788461267.219169 MIRROR_RESYNC 8 mirrors 000568 1788461269.402278 write 0x01d475 thru 0x01e281 (0xe0d bytes) 000570 1788461269.522036 write 0x024953 thru 0x02ae38 (0x64e6 bytes) 000571 1788461269.534116 punch from 0x038f52 to 0x03ffff (0x70ae bytes) 000572 1788461269.555118 write 0x0366e1 thru 0x03aa4f (0x436f bytes) 000573 1788461269.566134 write 0x03d93a thru 0x03ff07 (0x25ce bytes) 000574 1788461269.583904 MIRROR_RESYNC 8 mirrors 000575 1788461271.101402 mapread 0x02b6a1 thru 0x03b52a (0xfe8a bytes) 000576 1788461271.173394 mapwrite 0x02aba8 thru 0x035ae7 (0xaf40 bytes) 000578 1788461271.339811 trunc from 0x040000 to 0x034c12 (0xb3ed bytes) 000579 1788461271.376697 punch from 0x025b77 to 0x02c523 (0x69ad bytes) 000581 1788461271.387990 mapwrite 0x01467a thru 0x019095 (0x4a1c bytes) 000582 1788461271.526238 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x34c13): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34c13): Mirror 3: 0x82aa56ab (stale) Mirror 4: 0x82aa56ab (stale) Mirror 5: 0x82aa56ab (stale) Mirror 6: 0x82aa56ab (stale) Mirror 8: 0x82aa56ab (stale) Mirror 9: 0x82aa56ab (stale) Mirror 10: 0x82aa56ab (stale) CRC-32 checksum value for chunk [0, 0x34c13): Mirror 1: 0xf1a70662 Mirror 11: 0xf1a70662 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34c13: skipped 000583 1788461272.328304 MIRROR_RESYNC 9 mirrors 000586 1788461273.520767 trunc from 0x034c13 to 0x03db83 (0x8f71 bytes) 000587 1788461273.654239 trunc from 0x03db84 to 0x0396e7 (0x449c bytes) 000588 1788461273.674427 mapwrite 0x022e75 thru 0x02e18d (0xb319 bytes) 000589 1788461273.746797 mapread 0x03118d thru 0x0396e7 (0x855b bytes) 000591 1788461273.757311 read 0x030a0a thru 0x03163f (0xc36 bytes) 000592 1788461273.763137 MIRROR_RESYNC 9 mirrors 000593 1788461275.304766 punch from 0x01d35b to 0x01e42d (0x10d3 bytes) 000594 1788461275.387377 punch from 0x002f83 to 0x008c8f (0x5d0d bytes) 000595 1788461275.394025 trunc from 0x0396e8 to 0x001bf5 (0x37af2 bytes) 000597 1788461275.440228 punch from 0x000a00 to 0x000bec (0x1ed bytes) 000598 1788461275.445905 read 0x000c1d thru 0x001bf5 (0xfd9 bytes) 000599 1788461275.452546 read 0x001126 thru 0x001bf5 (0xad0 bytes) 000601 1788461275.454242 punch from 0x0019d5 to 0x001bf5 (0x221 bytes) 000602 1788461275.458830 mapwrite 0x03b923 thru 0x03ffff (0x46dd bytes) 000603 1788461275.589333 write 0x01bb84 thru 0x0275d7 (0xba54 bytes) 000604 1788461275.598155 MIRROR_RESYNC 9 mirrors 000605 1788461277.490945 write 0x034f47 thru 0x03ffff (0xb0b9 bytes) 000606 1788461277.597675 trunc from 0x040000 to 0x01c3d8 (0x23c27 bytes) 000607 1788461277.632827 mapread 0x004b15 thru 0x00b5ba (0x6aa6 bytes) 000609 1788461277.660244 mapwrite 0x030eda thru 0x03ffff (0xf126 bytes) 000611 1788461277.767898 punch from 0x007652 to 0x00eff9 (0x79a8 bytes) 000612 1788461277.791690 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x16fe1dc0 (stale) Mirror 5: 0x16fe1dc0 (stale) Mirror 6: 0x16fe1dc0 (stale) Mirror 8: 0x16fe1dc0 (stale) Mirror 9: 0x16fe1dc0 (stale) Mirror 10: 0x16fe1dc0 (stale) Mirror 11: 0x16fe1dc0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x16fe1dc0 (stale) Mirror 5: 0x16fe1dc0 (stale) Mirror 6: 0x16fe1dc0 (stale) Mirror 8: 0x16fe1dc0 (stale) Mirror 9: 0x16fe1dc0 (stale) Mirror 10: 0x16fe1dc0 (stale) Mirror 11: 0x16fe1dc0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000614 1788461278.216394 read 0x037775 thru 0x03ffff (0x888b bytes) 000615 1788461278.224949 read 0x017aea thru 0x01ad45 (0x325c bytes) 000616 1788461278.235100 mapread 0x01170f thru 0x01e265 (0xcb57 bytes) 000617 1788461278.236220 read 0x02b164 thru 0x02b8f5 (0x792 bytes) 000618 1788461278.240194 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x16fe1dc0 (stale) Mirror 5: 0x16fe1dc0 (stale) Mirror 6: 0x16fe1dc0 (stale) Mirror 8: 0x16fe1dc0 (stale) Mirror 9: 0x16fe1dc0 (stale) Mirror 10: 0x16fe1dc0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x16fe1dc0 (stale) Mirror 5: 0x16fe1dc0 (stale) Mirror 6: 0x16fe1dc0 (stale) Mirror 8: 0x16fe1dc0 (stale) Mirror 9: 0x16fe1dc0 (stale) Mirror 10: 0x16fe1dc0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000619 1788461278.801738 punch from 0x020d53 to 0x027cba (0x6f68 bytes) 000620 1788461278.808589 write 0x0181f4 thru 0x01b9eb (0x37f8 bytes) 000621 1788461278.823525 write 0x033b64 thru 0x03e229 (0xa6c6 bytes) 000623 1788461278.852577 mapread 0x037661 thru 0x03d721 (0x60c1 bytes) 000624 1788461278.853492 trunc from 0x040000 to 0x016a78 (0x29587 bytes) 000625 1788461278.874635 mapread 0x0094be thru 0x016a78 (0xd5bb bytes) 000627 1788461278.918372 write 0x003f08 thru 0x00f7e1 (0xb8da bytes) 000629 1788461278.929224 mapread 0x0109b1 thru 0x016a78 (0x60c8 bytes) 000630 1788461278.930671 mapwrite 0x005f38 thru 0x010999 (0xaa62 bytes) 000632 1788461279.011914 trunc from 0x016a79 to 0x01b762 (0x4cea bytes) 000635 1788461279.045525 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1b763): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b763): Mirror 4: 0x36ffcbd7 (stale) Mirror 5: 0x36ffcbd7 (stale) Mirror 6: 0x36ffcbd7 (stale) Mirror 8: 0x36ffcbd7 (stale) Mirror 9: 0x36ffcbd7 (stale) Mirror 10: 0x36ffcbd7 (stale) CRC-32 checksum value for chunk [0, 0x1b763): Mirror 1: 0x27301139 Mirror 11: 0x27301139 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b763: skipped 000636 1788461280.364625 mapwrite 0x02d1a5 thru 0x034270 (0x70cc bytes) 000638 1788461280.653983 read 0x0313b0 thru 0x032c0c (0x185d bytes) 000639 1788461280.654784 read 0x01d42c thru 0x0205e4 (0x31b9 bytes) 000640 1788461280.689644 mapwrite 0x00a687 thru 0x0172ee (0xcc68 bytes) 000641 1788461280.821227 trunc from 0x034271 to 0x00dd5b (0x26515 bytes) 000644 1788461280.850709 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0xdd5c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdd5c): Mirror 4: 0x93f1ce1f (stale) Mirror 5: 0x93f1ce1f (stale) Mirror 6: 0x93f1ce1f (stale) Mirror 8: 0x93f1ce1f (stale) Mirror 9: 0x93f1ce1f (stale) Mirror 10: 0x93f1ce1f (stale) Mirror 11: 0x3351cd05 (stale) CRC-32 checksum value for chunk [0, 0xdd5c): Mirror 1: 0x2bf8c827 Mirror 12: 0x2bf8c827 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdd5c: skipped 000645 1788461282.192849 mapread 0x000309 thru 0x0025e1 (0x22d9 bytes) 000646 1788461282.242622 trunc from 0x00dd5c to 0x009164 (0x4bf7 bytes) 000648 1788461282.424778 mapread 0x006a02 thru 0x009164 (0x2763 bytes) 000649 1788461282.471348 read 0x0028cf thru 0x009022 (0x6754 bytes) 000650 1788461282.472225 mapread 0x0035b0 thru 0x00486c (0x12bd bytes) 000651 1788461282.475696 read 0x003254 thru 0x009164 (0x5f11 bytes) 000652 1788461282.477314 punch from 0x002695 to 0x00548a (0x2df6 bytes) 000656 1788461282.500709 punch from 0x003943 to 0x009164 (0x5822 bytes) 000658 1788461282.511567 punch from 0x005050 to 0x009164 (0x4115 bytes) 000659 1788461282.523312 write 0x0358cb thru 0x03cacb (0x7201 bytes) 000661 1788461282.529375 punch from 0x020bf6 to 0x0304c1 (0xf8cc bytes) 000662 1788461282.570768 mapread 0x0177ce thru 0x01f188 (0x79bb bytes) 000663 1788461282.598162 write 0x02bd3e thru 0x03198b (0x5c4e bytes) 000664 1788461282.603158 read 0x01b787 thru 0x021430 (0x5caa bytes) 000666 1788461282.605843 trunc from 0x03cacc to 0x02e17f (0xe94c bytes) 000667 1788461282.656510 read 0x02abc1 thru 0x02c824 (0x1c64 bytes) 000670 1788461282.658054 trunc from 0x02e180 to 0x021486 (0xccf9 bytes) 000672 1788461282.693458 trunc from 0x021487 to 0x009ca4 (0x177e2 bytes) 000673 1788461282.723038 write 0x003bc2 thru 0x00d573 (0x99b2 bytes) 000674 1788461282.727837 trunc from 0x00d574 to 0x0214dc (0x13f69 bytes) 000675 1788461282.751140 mapread 0x005ba0 thru 0x014eec (0xf34d bytes) 000676 1788461282.766822 trunc from 0x0214dd to 0x018df7 (0x86e5 bytes) 000677 1788461282.777118 trunc from 0x018df8 to 0x001b18 (0x172df bytes) 000679 1788461282.807690 MIRROR_RESYNC 9 mirrors 000680 1788461284.247832 trunc from 0x001b19 to 0x00b807 (0x9cef bytes) 000681 1788461284.406911 mapwrite 0x00c19a thru 0x00e91a (0x2781 bytes) 000682 1788461284.502053 punch from 0x009e76 to 0x00e91a (0x4aa5 bytes) 000683 1788461284.507938 mapwrite 0x0291fe thru 0x0293e4 (0x1e7 bytes) 000686 1788461284.578101 trunc from 0x0293e5 to 0x008246 (0x2119e bytes) 000687 1788461284.594024 punch from 0x004225 to 0x00809f (0x3e7b bytes) 000689 1788461284.600419 mapread 0x00377b thru 0x0074f8 (0x3d7e bytes) 000691 1788461284.614001 trunc from 0x008247 to 0x01b0f5 (0x12eaf bytes) 000694 1788461284.633446 mapwrite 0x00f75e thru 0x01ec3f (0xf4e2 bytes) 000695 1788461284.858972 punch from 0x00334e to 0x0114b2 (0xe165 bytes) 000698 1788461284.873444 write 0x02a340 thru 0x02dee5 (0x3ba6 bytes) 000699 1788461284.876156 mapread 0x000515 thru 0x001eb6 (0x19a2 bytes) 000700 1788461284.902222 punch from 0x025ebc to 0x02dee5 (0x802a bytes) 000702 1788461284.920710 punch from 0x0178d3 to 0x0231f5 (0xb923 bytes) 000703 1788461284.932419 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2dee6): Mirror 4: 0x7c825059 (stale) Mirror 5: 0x7c825059 (stale) Mirror 6: 0x7c825059 (stale) Mirror 8: 0x7c825059 (stale) Mirror 9: 0x7c825059 (stale) Mirror 10: 0x7c825059 (stale) Mirror 11: 0x7c825059 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dee6): Mirror 4: 0x7c825059 (stale) Mirror 5: 0x7c825059 (stale) Mirror 6: 0x7c825059 (stale) Mirror 8: 0x7c825059 (stale) Mirror 9: 0x7c825059 (stale) Mirror 10: 0x7c825059 (stale) Mirror 11: 0x7c825059 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dee6: skipped 000705 1788461285.360715 mapwrite 0x00ebf7 thru 0x0183c3 (0x97cd bytes) 000706 1788461285.432527 trunc from 0x02dee6 to 0x027c81 (0x6264 bytes) 000707 1788461285.447942 punch from 0x0011ba to 0x00372d (0x2574 bytes) 000708 1788461285.453110 mapread 0x024f4e thru 0x027c81 (0x2d34 bytes) 000710 1788461285.463788 mapread 0x01a3f0 thru 0x027c81 (0xd892 bytes) 000712 1788461285.470973 mapread 0x001fb2 thru 0x00395d (0x19ac bytes) 000714 1788461285.480087 punch from 0x025fe1 to 0x027c81 (0x1ca1 bytes) 000716 1788461285.485233 write 0x00b7a6 thru 0x018c0a (0xd465 bytes) 000718 1788461285.486881 punch from 0x01c380 to 0x027c81 (0xb902 bytes) 000719 1788461285.510446 trunc from 0x027c82 to 0x00424f (0x23a32 bytes) 000720 1788461285.531045 trunc from 0x004250 to 0x019505 (0x152b6 bytes) 000721 1788461285.555935 punch from 0x00109e to 0x001bd3 (0xb36 bytes) 000722 1788461285.567459 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x19506): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19506): Mirror 4: 0x4d7bcc26 (stale) Mirror 5: 0x4d7bcc26 (stale) Mirror 6: 0x4d7bcc26 (stale) Mirror 8: 0x4d7bcc26 (stale) Mirror 9: 0x4d7bcc26 (stale) Mirror 10: 0x4d7bcc26 (stale) Mirror 11: 0x4d7bcc26 (stale) CRC-32 checksum value for chunk [0, 0x19506): Mirror 1: 0x6c247076 Mirror 12: 0x6c247076 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19506: skipped 000723 1788461286.865744 MIRROR_RESYNC 9 mirrors 000724 1788461288.619700 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) 000725 1788461289.135602 trunc from 0x019506 to 0x01f61b (0x6116 bytes) 000726 1788461289.244429 mapread 0x01d4c1 thru 0x01f61b (0x215b bytes) 000727 1788461289.262871 punch from 0x00288d to 0x00437d (0x1af1 bytes) 000728 1788461289.270114 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f61c): Mirror 4: 0x6287b3e8 (stale) Mirror 5: 0x6287b3e8 (stale) Mirror 6: 0x6287b3e8 (stale) Mirror 10: 0x6287b3e8 (stale) Mirror 11: 0x6287b3e8 (stale) Mirror 12: 0x6287b3e8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f61c): Mirror 4: 0x6287b3e8 (stale) Mirror 5: 0x6287b3e8 (stale) Mirror 6: 0x6287b3e8 (stale) Mirror 10: 0x6287b3e8 (stale) Mirror 11: 0x6287b3e8 (stale) Mirror 12: 0x6287b3e8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f61c: skipped 000729 1788461289.776180 read 0x002dd9 thru 0x0118ec (0xeb14 bytes) 000730 1788461289.797905 MIRROR_RESYNC 7 mirrors 000731 1788461291.464013 punch from 0x0052d0 to 0x005ba5 (0x8d6 bytes) 000733 1788461291.559240 write 0x02d635 thru 0x03347f (0x5e4b bytes) 000738 1788461291.575756 punch from 0x00560d to 0x00f5d5 (0x9fc9 bytes) 000741 1788461291.597958 punch from 0x003b5b to 0x00bb0a (0x7fb0 bytes) 000742 1788461291.603801 punch from 0x01b92b to 0x01cba4 (0x127a bytes) 000743 1788461291.609982 mapread 0x016596 thru 0x01833b (0x1da6 bytes) 000745 1788461291.633241 trunc from 0x033480 to 0x03dd25 (0xa8a6 bytes) 000746 1788461291.656846 write 0x006020 thru 0x00bca8 (0x5c89 bytes) 000748 1788461291.671029 write 0x0108ca thru 0x014679 (0x3db0 bytes) 000749 1788461291.677190 read 0x009548 thru 0x00d2f0 (0x3da9 bytes) 000750 1788461291.677826 punch from 0x02af6f to 0x033aef (0x8b81 bytes) 000751 1788461291.694689 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3dd26): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd26): Mirror 4: 0x7a9d92cf (stale) Mirror 5: 0x7a9d92cf (stale) Mirror 6: 0x7a9d92cf (stale) Mirror 10: 0x7a9d92cf (stale) Mirror 11: 0x7a9d92cf (stale) Mirror 12: 0x7a9d92cf (stale) CRC-32 checksum value for chunk [0, 0x3dd26): Mirror 1: 0x52eb15e5 Mirror 13: 0x52eb15e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd26: skipped 000752 1788461293.061135 trunc from 0x03dd26 to 0x00f188 (0x2eb9d bytes) 000753 1788461293.220003 read 0x00bc9d thru 0x00f188 (0x34ec bytes) 000754 1788461293.233172 mapread 0x00ca27 thru 0x00f188 (0x2762 bytes) 000755 1788461293.243758 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0xf189): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf189): Mirror 4: 0xf1be7dfe (stale) Mirror 5: 0xf1be7dfe (stale) Mirror 6: 0xf1be7dfe (stale) Mirror 10: 0xf1be7dfe (stale) Mirror 11: 0xf1be7dfe (stale) Mirror 12: 0xf1be7dfe (stale) Mirror 13: 0xad3a20be (stale) CRC-32 checksum value for chunk [0, 0xf189): Mirror 1: 0xad3a20be Mirror 14: 0xad3a20be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf189: skipped 000757 1788461294.094431 read 0x003b29 thru 0x00d305 (0x97dd bytes) 000758 1788461294.108520 trunc from 0x00f189 to 0x0049fe (0xa78a bytes) 000760 1788461294.307803 mapread 0x001644 thru 0x0049fe (0x33bb bytes) 000761 1788461294.336016 mapwrite 0x029d95 thru 0x02a295 (0x501 bytes) 000762 1788461294.426115 mapread 0x015a2f thru 0x01a4fc (0x4ace bytes) 000763 1788461294.442867 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a296): Mirror 4: 0xe04f7fea (stale) Mirror 5: 0xe04f7fea (stale) Mirror 10: 0xe04f7fea (stale) Mirror 11: 0xe04f7fea (stale) Mirror 12: 0xe04f7fea (stale) Mirror 13: 0xedda93f3 (stale) Mirror 14: 0x97fb37e2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a296): Mirror 4: 0xe04f7fea (stale) Mirror 5: 0xe04f7fea (stale) Mirror 10: 0xe04f7fea (stale) Mirror 11: 0xe04f7fea (stale) Mirror 12: 0xe04f7fea (stale) Mirror 13: 0xedda93f3 (stale) Mirror 14: 0x97fb37e2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a296: skipped 000764 1788461294.903226 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a296): Mirror 4: 0xe04f7fea (stale) Mirror 5: 0xe04f7fea (stale) Mirror 10: 0xe04f7fea (stale) Mirror 11: 0xe04f7fea (stale) Mirror 12: 0xe04f7fea (stale) Mirror 14: 0x97fb37e2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a296): Mirror 4: 0xe04f7fea (stale) Mirror 5: 0xe04f7fea (stale) Mirror 10: 0xe04f7fea (stale) Mirror 11: 0xe04f7fea (stale) Mirror 12: 0xe04f7fea (stale) Mirror 14: 0x97fb37e2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a296: skipped 000765 1788461295.372440 read 0x00de9e thru 0x01b7c6 (0xd929 bytes) 000768 1788461295.385674 mapwrite 0x022c75 thru 0x032505 (0xf891 bytes) 000769 1788461295.477138 punch from 0x0187c9 to 0x01fddd (0x7615 bytes) 000770 1788461295.490661 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x32506): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32506): Mirror 4: 0x99c77120 (stale) Mirror 5: 0x99c77120 (stale) Mirror 10: 0x99c77120 (stale) Mirror 11: 0x99c77120 (stale) Mirror 12: 0x99c77120 (stale) Mirror 14: 0x39143c1c (stale) CRC-32 checksum value for chunk [0, 0x32506): Mirror 1: 0x94a0bb46 Mirror 15: 0x94a0bb46 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32506: skipped 000772 1788461296.481444 mapwrite 0x00a846 thru 0x00c05a (0x1815 bytes) 000775 1788461296.609010 punch from 0x005ce6 to 0x0097f9 (0x3b14 bytes) 000777 1788461296.614715 mapwrite 0x02ed3d thru 0x03e00c (0xf2d0 bytes) 000779 1788461296.766782 punch from 0x0280e1 to 0x034ac6 (0xc9e6 bytes) 000780 1788461296.790918 mapread 0x0307e6 thru 0x03bf4c (0xb767 bytes) 000781 1788461296.805246 punch from 0x02a1d7 to 0x038725 (0xe54f bytes) 000782 1788461296.823866 MIRROR_RESYNC 8 mirrors 000783 1788461298.964397 mapwrite 0x00be0d thru 0x0169e2 (0xabd6 bytes) 000785 1788461299.182353 punch from 0x00344b to 0x00658a (0x3140 bytes) 000789 1788461299.190746 read 0x002ff6 thru 0x01057c (0xd587 bytes) 000790 1788461299.199503 write 0x030d47 thru 0x031eb4 (0x116e bytes) 000791 1788461299.208819 mapwrite 0x00d9c1 thru 0x013572 (0x5bb2 bytes) 000792 1788461299.248896 mapwrite 0x03e8e8 thru 0x03f919 (0x1032 bytes) 000794 1788461299.303447 read 0x02ae47 thru 0x036034 (0xb1ee bytes) 000795 1788461299.310972 punch from 0x013124 to 0x016e93 (0x3d70 bytes) 000796 1788461299.315334 trunc from 0x03f91a to 0x028e32 (0x16ae7 bytes) 000797 1788461299.333190 write 0x03b594 thru 0x03f686 (0x40f3 bytes) 000798 1788461299.337862 punch from 0x010bb9 to 0x01c4d1 (0xb919 bytes) 000799 1788461299.376442 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f687): Mirror 5: 0x56372a7f (stale) Mirror 10: 0x56372a7f (stale) Mirror 11: 0x56372a7f (stale) Mirror 12: 0x56372a7f (stale) Mirror 14: 0x56372a7f (stale) Mirror 15: 0x56372a7f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f687): Mirror 5: 0x56372a7f (stale) Mirror 10: 0x56372a7f (stale) Mirror 11: 0x56372a7f (stale) Mirror 12: 0x56372a7f (stale) Mirror 14: 0x56372a7f (stale) Mirror 15: 0x56372a7f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f687: skipped 000800 1788461300.014162 write 0x004b60 thru 0x00c512 (0x79b3 bytes) 000802 1788461300.024398 mapread 0x0298bc thru 0x0308d7 (0x701c bytes) 000803 1788461300.044340 punch from 0x00d0de to 0x018c71 (0xbb94 bytes) 000804 1788461300.070160 mapread 0x011db8 thru 0x0210fa (0xf343 bytes) 000805 1788461300.091091 read 0x02735d thru 0x0324d5 (0xb179 bytes) 000806 1788461300.092305 trunc from 0x03f687 to 0x00ab61 (0x34b25 bytes) 000808 1788461300.135245 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xab62): Mirror 5: 0xeca22769 (stale) Mirror 10: 0xeca22769 (stale) Mirror 11: 0xeca22769 (stale) Mirror 12: 0xeca22769 (stale) Mirror 15: 0xeca22769 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xab62): Mirror 5: 0xeca22769 (stale) Mirror 10: 0xeca22769 (stale) Mirror 11: 0xeca22769 (stale) Mirror 12: 0xeca22769 (stale) Mirror 15: 0xeca22769 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xab62: skipped 000809 1788461300.627923 mapwrite 0x0178be thru 0x022230 (0xa973 bytes) 000810 1788461300.803915 write 0x032b7d thru 0x03eb2c (0xbfb0 bytes) 000811 1788461300.817161 mapread 0x01911d thru 0x027eba (0xed9e bytes) 000812 1788461300.825302 punch from 0x0278b2 to 0x02e1d4 (0x6923 bytes) 000813 1788461300.867942 read 0x0397d8 thru 0x03d848 (0x4071 bytes) 000814 1788461300.868651 write 0x00ab43 thru 0x00c224 (0x16e2 bytes) 000816 1788461300.913384 trunc from 0x03eb2d to 0x03a42b (0x4701 bytes) 000817 1788461300.952901 read 0x03100d thru 0x03a42b (0x941f bytes) 000819 1788461300.977351 trunc from 0x03a42c to 0x036453 (0x3fd8 bytes) 000820 1788461301.028430 read 0x01b395 thru 0x028533 (0xd19f bytes) 000824 1788461301.043710 mapwrite 0x00e075 thru 0x011ae1 (0x3a6d bytes) 000827 1788461301.157466 mapread 0x009cbb thru 0x013a3f (0x9d85 bytes) 000828 1788461301.158408 read 0x0346ee thru 0x036453 (0x1d66 bytes) 000829 1788461301.158917 trunc from 0x036454 to 0x0050ba (0x31399 bytes) 000831 1788461301.228636 mapwrite 0x019a6a thru 0x0260eb (0xc682 bytes) 000832 1788461301.381003 punch from 0x006838 to 0x01383d (0xd006 bytes) 000834 1788461301.396699 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x260ec): Mirror 5: 0xbbaeaf16 (stale) Mirror 10: 0xbbaeaf16 (stale) Mirror 11: 0xbbaeaf16 (stale) Mirror 12: 0xbbaeaf16 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x260ec): Mirror 5: 0xbbaeaf16 (stale) Mirror 10: 0xbbaeaf16 (stale) Mirror 11: 0xbbaeaf16 (stale) Mirror 12: 0xbbaeaf16 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x260ec: skipped 000837 1788461301.895497 MIRROR_RESYNC 5 mirrors 000840 1788461303.330937 write 0x02fc8b thru 0x03c31f (0xc695 bytes) 000841 1788461303.392394 read 0x00c42c thru 0x0137ec (0x73c1 bytes) 000842 1788461303.402711 mapread 0x0055d7 thru 0x0063e1 (0xe0b bytes) 000845 1788461303.420241 trunc from 0x03c320 to 0x0023f4 (0x39f2b bytes) 000846 1788461303.447536 punch from 0x001130 to 0x0023f4 (0x12c5 bytes) 000847 1788461303.452871 punch from 0x002344 to 0x0023f4 (0xb1 bytes) 000849 1788461303.464776 write 0x033924 thru 0x03e419 (0xaaf6 bytes) 000851 1788461303.466937 write 0x015660 thru 0x025539 (0xfeda bytes) 000852 1788461303.498856 punch from 0x03a1fe to 0x03e419 (0x421c bytes) 000855 1788461303.515830 mapread 0x007045 thru 0x01067b (0x9637 bytes) 000857 1788461303.527751 punch from 0x01985d to 0x0284dd (0xec81 bytes) 000858 1788461303.533194 mapread 0x01dae3 thru 0x02bcd2 (0xe1f0 bytes) 000859 1788461303.552653 trunc from 0x03e41a to 0x0206bc (0x1dd5d bytes) 000862 1788461303.568038 punch from 0x02032e to 0x0206bc (0x38f bytes) 000863 1788461303.573063 trunc from 0x0206bd to 0x02e955 (0xe299 bytes) 000864 1788461303.587135 punch from 0x00a97d to 0x01a8e1 (0xff65 bytes) 000865 1788461303.593904 mapwrite 0x000c94 thru 0x002d7b (0x20e8 bytes) 000866 1788461303.689703 MIRROR_RESYNC 5 mirrors 000868 1788461304.731705 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) 000869 1788461305.131716 punch from 0x02e3a1 to 0x02e955 (0x5b5 bytes) 000871 1788461305.219751 write 0x00a95e thru 0x019fc1 (0xf664 bytes) 000872 1788461305.251632 write 0x024bf7 thru 0x0265d1 (0x19db bytes) 000874 1788461305.267971 read 0x009734 thru 0x00b775 (0x2042 bytes) 000875 1788461305.273970 write 0x031983 thru 0x03fd72 (0xe3f0 bytes) 000876 1788461305.279785 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3fd73): Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fd73): Mirror 5: 0x67f624c8 (stale) Mirror 10: 0x67f624c8 (stale) Mirror 11: 0x67f624c8 (stale) CRC-32 checksum value for chunk [0, 0x3fd73): Mirror 1: 0x73fa64c5 Mirror 12: 0x73fa64c5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fd73: skipped 000877 1788461306.377032 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3fd73): Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fd73): Mirror 5: 0x67f624c8 (stale) Mirror 10: 0x67f624c8 (stale) Mirror 11: 0x67f624c8 (stale) CRC-32 checksum value for chunk [0, 0x3fd73): Mirror 1: 0x73fa64c5 Mirror 12: 0x73fa64c5 Mirror 13: 0x73fa64c5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fd73: skipped 000878 1788461307.532937 mapread 0x039ad1 thru 0x039f50 (0x480 bytes) 000879 1788461307.542948 mapwrite 0x02e719 thru 0x0361b3 (0x7a9b bytes) 000880 1788461307.869744 trunc from 0x03fd73 to 0x009e18 (0x35f5a bytes) 000881 1788461307.962777 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x9e19): Mirror 5: 0x8e0dedd0 (stale) Mirror 10: 0x8e0dedd0 (stale) Mirror 12: 0x8e0dedd0 (stale) Mirror 13: 0x8e0dedd0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9e19): Mirror 5: 0x8e0dedd0 (stale) Mirror 10: 0x8e0dedd0 (stale) Mirror 12: 0x8e0dedd0 (stale) Mirror 13: 0x8e0dedd0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9e19: skipped 000884 1788461308.314018 mapwrite 0x02b67e thru 0x031451 (0x5dd4 bytes) 000885 1788461308.398638 write 0x00b01a thru 0x018e86 (0xde6d bytes) 000886 1788461308.411461 read 0x0144ed thru 0x02000a (0xbb1e bytes) 000888 1788461308.426861 mapwrite 0x013264 thru 0x01922d (0x5fca bytes) 000889 1788461308.500593 mapwrite 0x0119e5 thru 0x01d402 (0xba1e bytes) 000890 1788461308.579592 punch from 0x00d2fa to 0x0184ab (0xb1b2 bytes) 000892 1788461308.589540 punch from 0x000887 to 0x004078 (0x37f2 bytes) 000893 1788461308.605013 write 0x0110e9 thru 0x011ba8 (0xac0 bytes) 000894 1788461308.612361 punch from 0x02f472 to 0x031451 (0x1fe0 bytes) 000895 1788461308.628587 write 0x015bf4 thru 0x017f6b (0x2378 bytes) 000896 1788461308.658477 write 0x03b362 thru 0x03ffff (0x4c9e bytes) 000897 1788461308.660984 trunc from 0x040000 to 0x017d3c (0x282c3 bytes) 000898 1788461308.697490 read 0x0061d5 thru 0x00df60 (0x7d8c bytes) 000899 1788461308.719616 write 0x035be4 thru 0x03ffff (0xa41c bytes) 000900 1788461308.732177 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x45b27161 (stale) Mirror 10: 0x45b27161 (stale) Mirror 12: 0x6d459c34 (stale) Mirror 13: 0x6d459c34 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x120c91dc Mirror 14: 0x120c91dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000901 1788461309.877734 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x45b27161 (stale) Mirror 10: 0x45b27161 (stale) Mirror 12: 0x6d459c34 (stale) Mirror 13: 0x6d459c34 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x45b27161 (stale) Mirror 10: 0x45b27161 (stale) Mirror 12: 0x6d459c34 (stale) Mirror 13: 0x6d459c34 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000902 1788461310.184464 mapwrite 0x01f087 thru 0x02b041 (0xbfbb bytes) 000903 1788461310.336105 MIRROR_RESYNC 5 mirrors 000904 1788461311.360961 write 0x00c14d thru 0x011a4a (0x58fe bytes) 000905 1788461311.461335 write 0x01fdaf thru 0x022ca5 (0x2ef7 bytes) 000907 1788461311.488503 trunc from 0x040000 to 0x037972 (0x868d bytes) 000908 1788461311.586955 trunc from 0x037973 to 0x02e2c4 (0x96ae bytes) 000910 1788461311.623958 write 0x003b6c thru 0x007d29 (0x41be bytes) 000912 1788461311.666656 trunc from 0x02e2c5 to 0x01767f (0x16c45 bytes) 000913 1788461311.732910 trunc from 0x017680 to 0x02bdf8 (0x14779 bytes) 000915 1788461311.771933 mapwrite 0x0276bb thru 0x028439 (0xd7f bytes) 000917 1788461311.902017 mapwrite 0x01234a thru 0x0156af (0x3366 bytes) 000918 1788461311.964424 punch from 0x008c62 to 0x00cf3d (0x42dc bytes) 000920 1788461311.970685 mapread 0x01f292 thru 0x02bdf8 (0xcb67 bytes) 000921 1788461311.985806 punch from 0x01af1d to 0x024716 (0x97fa bytes) 000922 1788461311.991341 mapread 0x0076c7 thru 0x00c32c (0x4c66 bytes) 000923 1788461312.001314 mapwrite 0x02e92e thru 0x03a360 (0xba33 bytes) 000924 1788461312.100105 mapwrite 0x001bd4 thru 0x009856 (0x7c83 bytes) 000927 1788461312.155987 mapread 0x00a0cd thru 0x017cfc (0xdc30 bytes) 000928 1788461312.158157 mapread 0x024c9b thru 0x03486a (0xfbd0 bytes) 000930 1788461312.169740 trunc from 0x03a361 to 0x00573a (0x34c26 bytes) 000931 1788461312.197907 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x573b): Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x573b): Mirror 5: 0x8d66ab5c (stale) Mirror 10: 0x8d66ab5c (stale) Mirror 12: 0x8d66ab5c (stale) Mirror 13: 0x8d66ab5c (stale) CRC-32 checksum value for chunk [0, 0x573b): Mirror 1: 0x4fb77b2b Mirror 14: 0x4fb77b2b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x573b: skipped 000932 1788461313.170498 read 0x003493 thru 0x00573a (0x22a8 bytes) 000933 1788461313.182936 mapwrite 0x008dd6 thru 0x0158c2 (0xcaed bytes) 000937 1788461313.319589 write 0x01ecb2 thru 0x02d7c0 (0xeb0f bytes) 000938 1788461313.322902 write 0x01eb58 thru 0x029c84 (0xb12d bytes) 000939 1788461313.325031 mapwrite 0x0279a4 thru 0x037910 (0xff6d bytes) 000940 1788461313.443722 read 0x014435 thru 0x016fba (0x2b86 bytes) 000941 1788461313.459486 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x37911): Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37911): Mirror 5: 0x975531ac (stale) Mirror 10: 0x975531ac (stale) Mirror 12: 0x975531ac (stale) Mirror 13: 0x975531ac (stale) Mirror 14: 0x662d7fbb (stale) CRC-32 checksum value for chunk [0, 0x37911): Mirror 1: 0xbcd4d846 Mirror 15: 0xbcd4d846 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37911: skipped 000943 1788461314.404246 mapread 0x01a915 thru 0x02a491 (0xfb7d bytes) 000944 1788461314.459694 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x37911): Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37911): Mirror 5: 0x975531ac (stale) Mirror 10: 0x975531ac (stale) Mirror 12: 0x975531ac (stale) Mirror 13: 0x975531ac (stale) Mirror 14: 0x662d7fbb (stale) CRC-32 checksum value for chunk [0, 0x37911): Mirror 1: 0xbcd4d846 Mirror 15: 0xbcd4d846 Mirror 16: 0xbcd4d846 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37911: skipped 000945 1788461315.455406 mapread 0x02b2b0 thru 0x02f615 (0x4366 bytes) 000947 1788461315.478612 write 0x02cc29 thru 0x037d92 (0xb16a bytes) 000948 1788461315.661571 punch from 0x021199 to 0x024c99 (0x3b01 bytes) 000949 1788461315.690388 trunc from 0x037d93 to 0x036c28 (0x116a bytes) 000950 1788461315.726428 mapwrite 0x01c3b4 thru 0x02834e (0xbf9b bytes) 000951 1788461315.804772 mapread 0x034e59 thru 0x036c28 (0x1dd0 bytes) 000952 1788461315.805840 mapwrite 0x014412 thru 0x01ff3a (0xbb29 bytes) 000953 1788461315.851187 read 0x002430 thru 0x00b917 (0x94e8 bytes) 000955 1788461315.858281 read 0x01d132 thru 0x0278e4 (0xa7b3 bytes) 000956 1788461315.858861 mapread 0x030322 thru 0x036c28 (0x6907 bytes) 000957 1788461315.859711 read 0x00edb3 thru 0x01da9e (0xecec bytes) 000959 1788461315.867741 mapread 0x00e1f5 thru 0x00f09b (0xea7 bytes) 000963 1788461315.874947 punch from 0x023558 to 0x02e93c (0xb3e5 bytes) 000965 1788461315.881768 read 0x02ca3b thru 0x036c28 (0xa1ee bytes) 000967 1788461315.893602 read 0x03056c thru 0x036c28 (0x66bd bytes) 000968 1788461315.894293 write 0x02bffc thru 0x031ab9 (0x5abe bytes) 000969 1788461315.897583 mapread 0x02b735 thru 0x036c28 (0xb4f4 bytes) 000970 1788461315.903730 MIRROR_RESYNC 8 mirrors 000971 1788461317.663224 punch from 0x014d8d to 0x015c1e (0xe92 bytes) 000973 1788461317.791398 trunc from 0x036c29 to 0x016544 (0x206e4 bytes) 000975 1788461317.821706 write 0x03955b thru 0x03ffff (0x6aa5 bytes) 000976 1788461317.823587 write 0x00ab9a thru 0x011689 (0x6af0 bytes) 000977 1788461317.832974 mapwrite 0x026712 thru 0x028cda (0x25c9 bytes) 000980 1788461317.917686 read 0x00b227 thru 0x01419e (0x8f78 bytes) 000981 1788461317.928947 mapread 0x00d030 thru 0x01328f (0x6260 bytes) 000982 1788461317.929932 mapwrite 0x001b7e thru 0x001f80 (0x403 bytes) 000984 1788461317.984696 read 0x02334d thru 0x03062f (0xd2e3 bytes) 000986 1788461317.986028 write 0x003cb3 thru 0x00c485 (0x87d3 bytes) 000987 1788461317.988759 trunc from 0x040000 to 0x02ce26 (0x131d9 bytes) 000988 1788461318.006679 mapwrite 0x006f6f thru 0x015adf (0xeb71 bytes) 000990 1788461318.067518 read 0x02a8a6 thru 0x02ce26 (0x2581 bytes) 000991 1788461318.088401 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2ce27): Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ce27): Mirror 5: 0xf76325e8 (stale) Mirror 10: 0xf76325e8 (stale) Mirror 12: 0xf76325e8 (stale) Mirror 13: 0xf76325e8 (stale) Mirror 14: 0xf76325e8 (stale) Mirror 15: 0xf76325e8 (stale) Mirror 16: 0xf76325e8 (stale) CRC-32 checksum value for chunk [0, 0x2ce27): Mirror 1: 0xa43bbd93 Mirror 17: 0xa43bbd93 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ce27: skipped 000992 1788461319.080912 mapwrite 0x031cef thru 0x0336c0 (0x19d2 bytes) 000994 1788461319.319952 read 0x02d5a4 thru 0x02ffd5 (0x2a32 bytes) 000997 1788461319.329073 read 0x017512 thru 0x01ff75 (0x8a64 bytes) 000998 1788461319.370453 MIRROR_RESYNC 9 mirrors 000999 1788461320.867997 read 0x029beb thru 0x02fcbe (0x60d4 bytes) 001000 1788461320.876021 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c5:0x0]: Invalid argument (22) All operations completed A-OK!