== sanity-flr test 70a: flr mode fsx test ================ 16:34:08 (1788726848) Seed set to 6849 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1788726849.945926 mapwrite 0x01dda2 thru 0x021076 (0x32d5 bytes) 000003 1788726850.061504 mapwrite 0x03dc91 thru 0x03ffff (0x236f bytes) 000004 1788726850.131638 punch from 0x00fdd2 to 0x01e4c4 (0xe6f3 bytes) truncating to largest ever: 0x1ea54 000007 1788726850.137703 trunc from 0x040000 to 0x01ea53 (0x215ac bytes) 000008 1788726850.152485 write 0x005735 thru 0x00db03 (0x83cf bytes) 000009 1788726850.170763 mapread 0x005e0a thru 0x0138b2 (0xdaa9 bytes) 000010 1788726850.182577 write 0x011886 thru 0x01c2a5 (0xaa20 bytes) truncating to largest ever: 0x343c1 000013 1788726850.194126 trunc from 0x01ea54 to 0x0343c0 (0x1596d bytes) 000016 1788726850.209509 write 0x024d03 thru 0x025e83 (0x1181 bytes) 000017 1788726850.225695 mapwrite 0x00c015 thru 0x015d26 (0x9d12 bytes) 000018 1788726850.303544 punch from 0x01b03d to 0x01e03f (0x3003 bytes) 000019 1788726850.312698 MIRROR_EXTEND to 2 mirrors 000020 1788726851.451505 mapwrite 0x02fa01 thru 0x039e38 (0xa438 bytes) 000021 1788726851.623729 punch from 0x031520 to 0x039e38 (0x8919 bytes) 000022 1788726851.629775 read 0x015b29 thru 0x01c721 (0x6bf9 bytes) 000023 1788726851.643809 read 0x00bd7e thru 0x0173c4 (0xb647 bytes) 000024 1788726851.660518 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) 000026 1788726851.854953 mapwrite 0x01182e thru 0x013cbd (0x2490 bytes) 000027 1788726851.951023 read 0x02611d thru 0x02cae8 (0x69cc bytes) 000028 1788726851.967853 mapwrite 0x01886e thru 0x01d002 (0x4795 bytes) 000029 1788726852.027225 trunc from 0x039e39 to 0x022a5b (0x173dd bytes) 000030 1788726852.045091 mapwrite 0x03e663 thru 0x03ffff (0x199d bytes) 000031 1788726852.108598 trunc from 0x040000 to 0x007e73 (0x3818c bytes) 000033 1788726852.134733 trunc from 0x007e74 to 0x02fc64 (0x27df1 bytes) 000034 1788726852.156576 punch from 0x01bd2f to 0x024e5d (0x912f bytes) 000035 1788726852.161262 punch from 0x0002bb to 0x004312 (0x4058 bytes) 000036 1788726852.186371 MIRROR_EXTEND to 2 mirrors 000037 1788726853.452056 read 0x01c288 thru 0x027eaa (0xbc23 bytes) 000039 1788726853.472218 mapread 0x0003d2 thru 0x006bf8 (0x6827 bytes) 000041 1788726853.512277 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) 000042 1788726853.668575 write 0x03dc6d thru 0x03f8b6 (0x1c4a bytes) 000043 1788726853.682179 mapwrite 0x003148 thru 0x0103d9 (0xd292 bytes) 000045 1788726853.747827 mapread 0x01b3a5 thru 0x01e13e (0x2d9a bytes) 000046 1788726853.763531 punch from 0x00c617 to 0x0115e2 (0x4fcc bytes) 000048 1788726853.772925 mapwrite 0x016e69 thru 0x01d442 (0x65da bytes) 000049 1788726853.847523 mapread 0x0139ec thru 0x01a1cf (0x67e4 bytes) 000050 1788726853.866579 punch from 0x01d005 to 0x01d6d0 (0x6cc bytes) 000051 1788726853.878531 punch from 0x007f9f to 0x00a1b0 (0x2212 bytes) 000054 1788726853.898469 trunc from 0x03f8b7 to 0x021121 (0x1e795 bytes) 000055 1788726853.918586 write 0x01e54e thru 0x027c3b (0x96ee bytes) 000057 1788726853.920250 mapread 0x0228c5 thru 0x023e4c (0x1588 bytes) 000058 1788726853.922616 mapwrite 0x008b7a thru 0x0158d1 (0xcd58 bytes) 000059 1788726853.997687 read 0x00937c thru 0x012a59 (0x96de bytes) 000066 1788726854.004560 read 0x01c8ca thru 0x01f027 (0x275e bytes) 000067 1788726854.011294 mapwrite 0x013c21 thru 0x0237ef (0xfbcf bytes) 000068 1788726854.054145 trunc from 0x027c3c to 0x013ce5 (0x13f56 bytes) 000069 1788726854.071543 write 0x008259 thru 0x018143 (0xfeeb bytes) 000073 1788726854.077467 trunc from 0x018144 to 0x02d8eb (0x157a8 bytes) 000074 1788726854.093790 mapread 0x001ef7 thru 0x00a721 (0x882b bytes) 000075 1788726854.094765 trunc from 0x02d8ec to 0x0233f2 (0xa4f9 bytes) 000078 1788726854.109438 write 0x03173d thru 0x03fa22 (0xe2e6 bytes) 000079 1788726854.111857 mapwrite 0x034465 thru 0x03c8d8 (0x8474 bytes) 000080 1788726854.161983 read 0x00d3f2 thru 0x016bdc (0x97eb bytes) 000081 1788726854.162610 punch from 0x005566 to 0x00565d (0xf8 bytes) 000083 1788726854.168896 punch from 0x026010 to 0x0290a3 (0x3094 bytes) 000084 1788726854.172614 write 0x024231 thru 0x02ae6d (0x6c3d bytes) 000085 1788726854.180783 mapread 0x031215 thru 0x03d0b0 (0xbe9c bytes) 000087 1788726854.182120 read 0x01ea8e thru 0x0208c4 (0x1e37 bytes) 000088 1788726854.182859 trunc from 0x03fa23 to 0x03037d (0xf6a5 bytes) 000090 1788726854.209047 mapread 0x020080 thru 0x02896a (0x88eb bytes) 000095 1788726854.215234 trunc from 0x03037e to 0x00a0f8 (0x26285 bytes) 000096 1788726854.234663 read 0x002e8e thru 0x007fd5 (0x5148 bytes) 000098 1788726854.235933 write 0x01dd1b thru 0x020d20 (0x3006 bytes) truncating to largest ever: 0x3b1fd 000099 1788726854.237825 trunc from 0x020d21 to 0x03b1fc (0x1a4dc bytes) 000100 1788726854.254612 trunc from 0x03b1fd to 0x010966 (0x2a896 bytes) 000101 1788726854.271355 write 0x036faa thru 0x03fa09 (0x8a60 bytes) 000102 1788726854.273583 write 0x0063af thru 0x00af2b (0x4b7d bytes) 000103 1788726854.275068 write 0x03d974 thru 0x03ffff (0x268c bytes) 000104 1788726854.276012 punch from 0x0154f8 to 0x0155d5 (0xde bytes) 000105 1788726854.292504 write 0x01b151 thru 0x024e0c (0x9cbc bytes) 000107 1788726854.304632 mapwrite 0x027607 thru 0x02c547 (0x4f41 bytes) 000108 1788726854.357497 mapwrite 0x013837 thru 0x02275a (0xef24 bytes) 000109 1788726854.400559 write 0x01ddd1 thru 0x0286cb (0xa8fb bytes) 000111 1788726854.402810 mapread 0x00872c thru 0x016e5c (0xe731 bytes) 000112 1788726854.404295 write 0x000072 thru 0x007be2 (0x7b71 bytes) 000114 1788726854.405959 mapread 0x012a89 thru 0x0142c0 (0x1838 bytes) 000116 1788726854.408556 write 0x0352c9 thru 0x038ace (0x3806 bytes) 000120 1788726854.412107 read 0x0305d7 thru 0x03cce0 (0xc70a bytes) 000122 1788726854.413697 mapwrite 0x020581 thru 0x029447 (0x8ec7 bytes) 000123 1788726854.470642 punch from 0x038291 to 0x03ffff (0x7d6f bytes) 000125 1788726854.480307 MIRROR_EXTEND to 2 mirrors 000126 1788726855.570597 read 0x007165 thru 0x0095d3 (0x246f bytes) 000127 1788726855.588960 punch from 0x02d2c4 to 0x035e02 (0x8b3f bytes) 000129 1788726855.684846 punch from 0x021f27 to 0x0265cd (0x46a7 bytes) 000131 1788726855.690637 write 0x03fadb thru 0x03ffff (0x525 bytes) 000132 1788726855.696399 read 0x034147 thru 0x03e733 (0xa5ed bytes) 000133 1788726855.715892 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd9f7da (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa3e98230 Mirror 3: 0xa3e98230 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000134 1788726857.014927 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd9f7da (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd9f7da (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000135 1788726857.242637 trunc from 0x040000 to 0x033e3d (0xc1c2 bytes) 000136 1788726857.266739 trunc from 0x033e3e to 0x039353 (0x5516 bytes) 000137 1788726857.282692 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x39354): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39354): Mirror 2: 0xccff2dc1 (stale) CRC-32 checksum value for chunk [0, 0x39354): Mirror 1: 0x8046437e Mirror 3: 0x8046437e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39354: skipped 000138 1788726858.525931 read 0x000392 thru 0x00f5be (0xf22d bytes) 000139 1788726858.546948 trunc from 0x039354 to 0x00d142 (0x2c211 bytes) 000140 1788726858.613812 write 0x00c312 thru 0x018727 (0xc416 bytes) 000141 1788726858.619716 mapread 0x007b4c thru 0x014df9 (0xd2ae bytes) 000143 1788726858.636697 write 0x01d75a thru 0x01f9f8 (0x229f bytes) 000144 1788726858.640890 read 0x01f474 thru 0x01f9f8 (0x585 bytes) 000145 1788726858.641774 mapwrite 0x034e50 thru 0x03ce9e (0x804f bytes) 000146 1788726858.734641 mapread 0x037cbd thru 0x03c79f (0x4ae3 bytes) 000147 1788726858.739959 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3ce9f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce9f): Mirror 2: 0xdc0cd825 (stale) Mirror 3: 0x489ed605 (stale) CRC-32 checksum value for chunk [0, 0x3ce9f): Mirror 1: 0x3f240025 Mirror 4: 0x3f240025 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce9f: skipped 000148 1788726859.720787 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ce9f): Mirror 2: 0xdc0cd825 (stale) Mirror 3: 0x489ed605 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce9f): Mirror 2: 0xdc0cd825 (stale) Mirror 3: 0x489ed605 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce9f: skipped 000149 1788726860.124576 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3ce9f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce9f): Mirror 2: 0xdc0cd825 (stale) Mirror 3: 0x489ed605 (stale) CRC-32 checksum value for chunk [0, 0x3ce9f): Mirror 1: 0x3f240025 Mirror 4: 0x3f240025 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce9f: skipped 000150 1788726861.334884 write 0x00e51a thru 0x017ce2 (0x97c9 bytes) 000151 1788726861.460702 write 0x02e3f8 thru 0x0310f9 (0x2d02 bytes) 000152 1788726861.479684 write 0x03d533 thru 0x03ffff (0x2acd bytes) 000154 1788726861.485085 trunc from 0x040000 to 0x019fd8 (0x26027 bytes) 000156 1788726861.535189 trunc from 0x019fd9 to 0x0318bf (0x178e7 bytes) 000158 1788726861.563877 write 0x01d4b9 thru 0x02308b (0x5bd3 bytes) 000159 1788726861.579449 mapread 0x01ab4b thru 0x01fb29 (0x4fdf bytes) 000160 1788726861.624189 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x318c0): Mirror 2: 0xb2ccc579 (stale) Mirror 4: 0x7d7362bf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x318c0): Mirror 2: 0xb2ccc579 (stale) Mirror 4: 0x7d7362bf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x318c0: skipped 000161 1788726861.899029 punch from 0x015827 to 0x0232b0 (0xda8a bytes) 000162 1788726861.908251 punch from 0x02570a to 0x030f15 (0xb80c bytes) 000165 1788726861.914109 punch from 0x02f3d8 to 0x0318bf (0x24e8 bytes) 000167 1788726861.919228 read 0x00c2aa thru 0x0151db (0x8f32 bytes) 000168 1788726861.926398 mapwrite 0x010550 thru 0x016c58 (0x6709 bytes) 000169 1788726861.981199 mapread 0x0049fb thru 0x00756b (0x2b71 bytes) 000170 1788726861.997717 mapread 0x001c43 thru 0x003189 (0x1547 bytes) 000171 1788726861.998562 mapread 0x005846 thru 0x013efe (0xe6b9 bytes) 000172 1788726861.999428 mapread 0x00750e thru 0x015574 (0xe067 bytes) 000173 1788726862.001058 mapread 0x011f82 thru 0x018688 (0x6707 bytes) 000174 1788726862.011038 mapwrite 0x032e91 thru 0x03e8d2 (0xba42 bytes) 000175 1788726862.087679 read 0x011529 thru 0x018e21 (0x78f9 bytes) 000178 1788726862.089828 trunc from 0x03e8d3 to 0x018090 (0x26842 bytes) 000179 1788726862.103933 read 0x015f2a thru 0x017e79 (0x1f50 bytes) 000181 1788726862.105027 write 0x00f2a3 thru 0x01893c (0x969a bytes) 000183 1788726862.108476 mapread 0x015a6f thru 0x018396 (0x2928 bytes) 000184 1788726862.109442 read 0x00691e thru 0x0101f5 (0x98d8 bytes) 000186 1788726862.112044 mapwrite 0x01f0ce thru 0x029703 (0xa636 bytes) 000188 1788726862.204704 mapread 0x012f96 thru 0x01598b (0x29f6 bytes) 000189 1788726862.206371 read 0x0018e1 thru 0x0054c4 (0x3be4 bytes) 000190 1788726862.207207 mapwrite 0x01b37d thru 0x021c7e (0x6902 bytes) 000193 1788726862.252472 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x29704): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29704): Mirror 2: 0x90dd2500 (stale) Mirror 4: 0x312d0d6c (stale) CRC-32 checksum value for chunk [0, 0x29704): Mirror 1: 0x7553f8f0 Mirror 5: 0x7553f8f0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29704: skipped 000195 1788726863.302005 read 0x00041c thru 0x01033f (0xff24 bytes) 000196 1788726863.326213 MIRROR_RESYNC 4 mirrors 000197 1788726864.508551 read 0x01158a thru 0x0183d4 (0x6e4b bytes) 000202 1788726864.524834 mapread 0x00eea4 thru 0x00fdbe (0xf1b bytes) 000208 1788726864.535618 read 0x01f762 thru 0x026418 (0x6cb7 bytes) 000209 1788726864.545139 mapread 0x020b48 thru 0x022aff (0x1fb8 bytes) 000210 1788726864.545753 write 0x01ec68 thru 0x023499 (0x4832 bytes) 000211 1788726864.639057 punch from 0x028922 to 0x028b2a (0x209 bytes) 000212 1788726864.665060 mapread 0x010305 thru 0x015cb8 (0x59b4 bytes) 000213 1788726864.708950 punch from 0x018697 to 0x026900 (0xe26a bytes) 000214 1788726864.716273 mapread 0x02063c thru 0x022455 (0x1e1a bytes) 000216 1788726864.738959 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x29704): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29704): Mirror 2: 0x7553f8f0 (stale) Mirror 4: 0x7553f8f0 (stale) Mirror 5: 0x7553f8f0 (stale) CRC-32 checksum value for chunk [0, 0x29704): Mirror 1: 0xff8ecba1 Mirror 6: 0xff8ecba1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29704: skipped 000217 1788726865.836638 mapread 0x026096 thru 0x029703 (0x366e bytes) 000218 1788726865.871548 trunc from 0x029704 to 0x028eab (0x858 bytes) 000219 1788726865.945588 mapwrite 0x00f793 thru 0x0124ba (0x2d28 bytes) 000220 1788726865.988901 mapread 0x0170e3 thru 0x01ba40 (0x495e bytes) 000221 1788726865.999466 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28eac): Mirror 4: 0x5fd14745 (stale) Mirror 5: 0x5fd14745 (stale) Mirror 6: 0x6cce00f9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28eac): Mirror 4: 0x5fd14745 (stale) Mirror 5: 0x5fd14745 (stale) Mirror 6: 0x6cce00f9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28eac: skipped 000222 1788726866.306256 punch from 0x00510e to 0x0104d3 (0xb3c6 bytes) 000223 1788726866.311994 mapwrite 0x00644f thru 0x00685f (0x411 bytes) 000224 1788726866.393419 punch from 0x0158ce to 0x016ef9 (0x162c bytes) 000225 1788726866.399275 mapread 0x000537 thru 0x006d13 (0x67dd bytes) 000226 1788726866.415551 trunc from 0x028eac to 0x018db2 (0x100f9 bytes) 000227 1788726866.434410 trunc from 0x018db3 to 0x03b1d4 (0x22422 bytes) 000228 1788726866.450568 write 0x0086fd thru 0x01061a (0x7f1e bytes) 000229 1788726866.457135 read 0x02c54f thru 0x036468 (0x9f1a bytes) 000231 1788726866.465541 trunc from 0x03b1d5 to 0x0180f6 (0x230de bytes) 000232 1788726866.482104 mapwrite 0x0131cc thru 0x020a35 (0xd86a bytes) 000235 1788726866.598278 read 0x00dff7 thru 0x011c51 (0x3c5b bytes) 000237 1788726866.603408 mapwrite 0x00d12d thru 0x01867e (0xb552 bytes) 000240 1788726866.688436 write 0x02ac49 thru 0x02cfea (0x23a2 bytes) 000241 1788726866.689445 mapwrite 0x0067be thru 0x015e69 (0xf6ac bytes) 000242 1788726866.741689 mapread 0x00a492 thru 0x00efc3 (0x4b32 bytes) 000243 1788726866.742545 read 0x0122c1 thru 0x01b4bf (0x91ff bytes) 000244 1788726866.743070 read 0x02002f thru 0x02cfea (0xcfbc bytes) 000245 1788726866.752278 write 0x024622 thru 0x0317da (0xd1b9 bytes) 000247 1788726866.757813 mapread 0x01da9f thru 0x021c2d (0x418f bytes) truncating to largest ever: 0x3d471 000249 1788726866.759301 trunc from 0x0317db to 0x03d470 (0xbc96 bytes) 000250 1788726866.776134 mapwrite 0x02c3aa thru 0x03b11d (0xed74 bytes) 000251 1788726866.842997 mapread 0x036765 thru 0x03d470 (0x6d0c bytes) 000252 1788726866.844838 write 0x01cc39 thru 0x026612 (0x99da bytes) 000253 1788726866.847088 mapread 0x037f87 thru 0x03d470 (0x54ea bytes) 000254 1788726866.849719 trunc from 0x03d471 to 0x02ef78 (0xe4f8 bytes) 000256 1788726866.873216 mapread 0x02a7b9 thru 0x02ef78 (0x47c0 bytes) 000257 1788726866.876233 trunc from 0x02ef79 to 0x00e309 (0x20c6f bytes) 000258 1788726866.896840 punch from 0x0069bb to 0x00d309 (0x694f bytes) 000259 1788726866.901895 read 0x0090bd thru 0x00bb91 (0x2ad5 bytes) 000260 1788726866.909912 mapread 0x0000db thru 0x009aba (0x99e0 bytes) 000261 1788726866.912830 mapwrite 0x037ecb thru 0x03ffff (0x8135 bytes) 000262 1788726867.016771 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9d34f31 (stale) Mirror 5: 0x9d34f31 (stale) Mirror 6: 0x1c4fbe48 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x38fb7aca Mirror 7: 0x38fb7aca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000263 1788726868.099051 mapwrite 0x0280fb thru 0x0355a4 (0xd4aa bytes) 000265 1788726868.405623 punch from 0x03e388 to 0x03ffff (0x1c78 bytes) 000266 1788726868.410363 punch from 0x036d33 to 0x039d73 (0x3041 bytes) 000268 1788726868.435092 mapread 0x02d1ff thru 0x0365fe (0x9400 bytes) 000269 1788726868.444466 mapwrite 0x00eb31 thru 0x0192f6 (0xa7c6 bytes) 000270 1788726868.521507 read 0x0212ca thru 0x02f40d (0xe144 bytes) 000272 1788726868.531368 read 0x01c67d thru 0x0218fd (0x5281 bytes) 000273 1788726868.550630 mapwrite 0x007a9a thru 0x015991 (0xdef8 bytes) 000274 1788726868.610029 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x9d34f31 (stale) Mirror 6: 0x1c4fbe48 (stale) Mirror 7: 0x38fb7aca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x9d34f31 (stale) Mirror 6: 0x1c4fbe48 (stale) Mirror 7: 0x38fb7aca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000275 1788726869.049736 read 0x014a4d thru 0x022971 (0xdf25 bytes) 000276 1788726869.060710 trunc from 0x040000 to 0x0161bd (0x29e42 bytes) 000277 1788726869.086057 mapwrite 0x01618f thru 0x017fb9 (0x1e2b bytes) 000278 1788726869.206129 punch from 0x00902f to 0x00976b (0x73d bytes) 000279 1788726869.211582 mapread 0x016f37 thru 0x017fb9 (0x1083 bytes) 000281 1788726869.216646 mapwrite 0x01bbbc thru 0x01f397 (0x37dc bytes) 000283 1788726869.350407 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f398): Mirror 6: 0xf920dff4 (stale) Mirror 7: 0xfd3196f3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f398): Mirror 6: 0xf920dff4 (stale) Mirror 7: 0xfd3196f3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f398: skipped 000284 1788726869.643212 read 0x01c85b thru 0x01f397 (0x2b3d bytes) 000285 1788726869.653115 mapread 0x01620e thru 0x01f397 (0x918a bytes) 000289 1788726869.675878 read 0x00c6ee thru 0x01c083 (0xf996 bytes) 000292 1788726869.694608 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f398): Mirror 7: 0xfd3196f3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f398): Mirror 7: 0xfd3196f3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f398: skipped 000293 1788726869.937036 mapread 0x007b77 thru 0x014188 (0xc612 bytes) 000294 1788726869.961059 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) 000295 1788726870.076072 write 0x01b782 thru 0x02b5af (0xfe2e bytes) 000296 1788726870.083288 mapwrite 0x00f954 thru 0x014d0d (0x53ba bytes) 000297 1788726870.138279 mapwrite 0x02c48c thru 0x02ce0d (0x982 bytes) 000300 1788726870.191405 trunc from 0x02ce0e to 0x0047fb (0x28612 bytes) 000302 1788726870.204309 write 0x0212ce thru 0x023742 (0x2475 bytes) 000303 1788726870.205403 write 0x0004d7 thru 0x00a3ce (0x9ef8 bytes) 000305 1788726870.213857 write 0x00216c thru 0x003836 (0x16cb bytes) 000307 1788726870.216177 mapread 0x02364e thru 0x023742 (0xf5 bytes) 000308 1788726870.220256 MIRROR_EXTEND to 2 mirrors 000310 1788726871.025546 write 0x03d68d thru 0x03db9d (0x511 bytes) 000311 1788726871.113743 write 0x00447c thru 0x006814 (0x2399 bytes) 000312 1788726871.132570 read 0x00a4fa thru 0x017704 (0xd20b bytes) 000314 1788726871.141889 write 0x03faf5 thru 0x03ffff (0x50b bytes) 000316 1788726871.147301 read 0x01652f thru 0x0208ae (0xa380 bytes) 000318 1788726871.166379 mapwrite 0x004356 thru 0x00e2b3 (0x9f5e bytes) 000319 1788726871.248356 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) 000320 1788726871.400882 mapread 0x0091a2 thru 0x009c6b (0xaca bytes) 000321 1788726871.405691 mapwrite 0x03651d thru 0x03ffff (0x9ae3 bytes) 000322 1788726871.470649 write 0x03b451 thru 0x03ffff (0x4baf bytes) 000323 1788726871.472160 read 0x02ce1a thru 0x038d06 (0xbeed bytes) 000324 1788726871.479866 read 0x01aa0a thru 0x028403 (0xd9fa bytes) 000325 1788726871.493680 mapwrite 0x0294cf thru 0x036842 (0xd374 bytes) 000326 1788726871.563750 read 0x00a5bd thru 0x0196f7 (0xf13b bytes) 000327 1788726871.564799 write 0x03a36e thru 0x03bcc6 (0x1959 bytes) 000330 1788726871.568234 mapwrite 0x006a30 thru 0x0163ae (0xf97f bytes) 000331 1788726871.607105 mapread 0x02e713 thru 0x03df2b (0xf819 bytes) 000333 1788726871.608591 read 0x03020c thru 0x036ff8 (0x6ded bytes) 000335 1788726871.610835 trunc from 0x040000 to 0x0206eb (0x1f914 bytes) 000337 1788726871.655187 trunc from 0x0206ec to 0x021dec (0x1701 bytes) 000338 1788726871.669138 punch from 0x01f8ef to 0x021dec (0x24fe bytes) 000339 1788726871.673806 read 0x01a7f7 thru 0x01eb32 (0x433c bytes) truncating to largest ever: 0x3e906 000342 1788726871.677024 trunc from 0x021ded to 0x03e905 (0x1cb19 bytes) 000343 1788726871.691672 mapwrite 0x00e951 thru 0x01ca9f (0xe14f bytes) 000344 1788726871.740617 mapread 0x0126d2 thru 0x021f61 (0xf890 bytes) 000345 1788726871.752252 write 0x00519a thru 0x00cc0d (0x7a74 bytes) 000346 1788726871.758137 MIRROR_EXTEND to 2 mirrors 000347 1788726872.811028 trunc from 0x03e906 to 0x0178b9 (0x2704c bytes) 000348 1788726872.952437 mapwrite 0x010433 thru 0x01f5ab (0xf179 bytes) 000350 1788726873.093522 mapread 0x016c61 thru 0x01f5ab (0x894b bytes) 000351 1788726873.094769 mapread 0x013eea thru 0x0167d6 (0x28ed bytes) 000352 1788726873.095749 write 0x01f418 thru 0x027f40 (0x8b29 bytes) 000353 1788726873.106734 MIRROR_RESYNC 2 mirrors 000355 1788726873.920260 mapwrite 0x0092a9 thru 0x015ac3 (0xc81b bytes) 000356 1788726874.290551 mapwrite 0x0154e2 thru 0x016dfa (0x1919 bytes) 000357 1788726874.356592 mapread 0x016b89 thru 0x01dcb8 (0x7130 bytes) 000358 1788726874.369488 punch from 0x00ae0a to 0x00bda8 (0xf9f bytes) 000359 1788726874.374514 write 0x01276d thru 0x015d44 (0x35d8 bytes) 000361 1788726874.376512 punch from 0x023555 to 0x0257d4 (0x2280 bytes) 000362 1788726874.396465 mapread 0x014527 thru 0x01e060 (0x9b3a bytes) 000364 1788726874.410287 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) 000365 1788726874.605030 read 0x00ddff thru 0x01122e (0x3430 bytes) 000366 1788726874.623819 mapread 0x01a869 thru 0x023660 (0x8df8 bytes) 000368 1788726874.653606 trunc from 0x027f41 to 0x039ce2 (0x11da2 bytes) 000369 1788726874.704954 mapwrite 0x01f92a thru 0x02a4b0 (0xab87 bytes) 000372 1788726874.839547 mapwrite 0x0131e5 thru 0x01e9cc (0xb7e8 bytes) 000373 1788726874.928706 trunc from 0x039ce3 to 0x02278c (0x17556 bytes) 000374 1788726874.944817 read 0x006930 thru 0x00eb8f (0x8260 bytes) 000376 1788726874.954136 trunc from 0x02278d to 0x032b37 (0x103ab bytes) 000377 1788726874.978129 read 0x02d30c thru 0x02d4d8 (0x1cd bytes) 000378 1788726875.002506 read 0x005592 thru 0x00ba1e (0x648d bytes) 000379 1788726875.005608 trunc from 0x032b38 to 0x00e23e (0x248f9 bytes) 000380 1788726875.072608 MIRROR_EXTEND to 2 mirrors 000381 1788726876.130682 punch from 0x00668c to 0x00e23e (0x7bb3 bytes) 000382 1788726876.268868 trunc from 0x00e23f to 0x01e711 (0x104d3 bytes) 000383 1788726876.328680 punch from 0x01a0dc to 0x01e711 (0x4636 bytes) 000384 1788726876.333403 punch from 0x01675b to 0x0169c7 (0x26d bytes) 000385 1788726876.349814 mapwrite 0x01721e thru 0x026e32 (0xfc15 bytes) 000387 1788726876.557613 mapwrite 0x01d201 thru 0x0281a0 (0xafa0 bytes) 000388 1788726876.627834 read 0x018a94 thru 0x019ccf (0x123c bytes) 000389 1788726876.628609 write 0x01e1a2 thru 0x027522 (0x9381 bytes) 000390 1788726876.630861 read 0x017374 thru 0x0178fa (0x587 bytes) 000391 1788726876.631719 mapwrite 0x01768a thru 0x01a2db (0x2c52 bytes) 000393 1788726876.685794 punch from 0x024b55 to 0x0281a0 (0x364c bytes) 000395 1788726876.692681 mapread 0x0002cd thru 0x001b6f (0x18a3 bytes) 000396 1788726876.701513 trunc from 0x0281a1 to 0x0149b7 (0x137e9 bytes) 000397 1788726876.715706 read 0x0078d2 thru 0x00910b (0x183a bytes) 000398 1788726876.716303 mapwrite 0x01d7d8 thru 0x02c86b (0xf094 bytes) 000400 1788726876.810637 mapwrite 0x038b82 thru 0x03ffff (0x747e bytes) 000401 1788726876.890163 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1ec019f3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc61fe398 Mirror 3: 0xc61fe398 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000403 1788726877.989033 mapwrite 0x01f34a thru 0x01f904 (0x5bb bytes) 000404 1788726878.119817 mapwrite 0x029fc3 thru 0x02aea4 (0xee2 bytes) 000406 1788726878.185873 punch from 0x00d264 to 0x00dd90 (0xb2d bytes) 000407 1788726878.216143 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc61fe398 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc61fe398 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000408 1788726878.529837 write 0x0009ce thru 0x00a7b1 (0x9de4 bytes) 000409 1788726878.541728 write 0x00a46c thru 0x00fdf2 (0x5987 bytes) 000411 1788726878.555219 mapread 0x00ca8c thru 0x019720 (0xcc95 bytes) 000413 1788726878.576684 trunc from 0x040000 to 0x01fedd (0x20122 bytes) 000414 1788726878.596966 trunc from 0x01fede to 0x002772 (0x1d76b bytes) 000415 1788726878.621184 write 0x01aa51 thru 0x02a4f8 (0xfaa8 bytes) 000417 1788726878.624749 read 0x004469 thru 0x007a7f (0x3617 bytes) 000418 1788726878.630759 mapwrite 0x00711a thru 0x00db3d (0x6a24 bytes) 000420 1788726878.739943 write 0x03fec4 thru 0x03ffff (0x13c bytes) 000421 1788726878.742996 write 0x027d01 thru 0x02eb50 (0x6e50 bytes) 000422 1788726878.756456 trunc from 0x040000 to 0x0245fb (0x1ba04 bytes) 000423 1788726878.792029 mapread 0x0049de thru 0x011395 (0xc9b8 bytes) 000424 1788726878.802050 punch from 0x005ce4 to 0x00b552 (0x586f bytes) 000425 1788726878.807790 punch from 0x01b155 to 0x0245fb (0x94a7 bytes) 000426 1788726878.813071 read 0x003b33 thru 0x012ea5 (0xf373 bytes) 000427 1788726878.829167 mapwrite 0x0286b3 thru 0x02a066 (0x19b4 bytes) 000428 1788726879.001565 read 0x008050 thru 0x00e5ef (0x65a0 bytes) 000429 1788726879.002147 read 0x0132d6 thru 0x01b322 (0x804d bytes) 000430 1788726879.002720 read 0x000e63 thru 0x006706 (0x58a4 bytes) 000431 1788726879.003259 mapwrite 0x029c4c thru 0x0365e9 (0xc99e bytes) 000432 1788726879.090291 punch from 0x032813 to 0x0365e9 (0x3dd7 bytes) 000435 1788726879.096429 write 0x014e7e thru 0x01ffcc (0xb14f bytes) 000436 1788726879.100865 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) 000437 1788726879.222524 mapread 0x00324c thru 0x004017 (0xdcc bytes) 000438 1788726879.245270 write 0x0000fb thru 0x00085d (0x763 bytes) 000439 1788726879.252682 punch from 0x011954 to 0x0146bb (0x2d68 bytes) 000440 1788726879.274881 mapwrite 0x00bbd2 thru 0x017bfa (0xc029 bytes) 000442 1788726879.364640 read 0x02cc72 thru 0x033faf (0x733e bytes) 000443 1788726879.394481 MIRROR_EXTEND to 2 mirrors 000444 1788726880.094518 mapread 0x032493 thru 0x0365e9 (0x4157 bytes) 000446 1788726880.138132 MIRROR_RESYNC 2 mirrors 000447 1788726880.527608 mapread 0x02505c thru 0x02d197 (0x813c bytes) 000448 1788726880.563509 trunc from 0x0365ea to 0x007f51 (0x2e698 bytes) 000449 1788726880.689723 mapread 0x001a03 thru 0x00216f (0x76d bytes) 000450 1788726880.697831 write 0x01d92d thru 0x023bee (0x62c2 bytes) 000451 1788726880.701291 mapwrite 0x016df7 thru 0x024aad (0xdcb7 bytes) 000452 1788726880.868821 trunc from 0x024aae to 0x0137e4 (0x112c9 bytes) 000453 1788726880.892030 trunc from 0x0137e5 to 0x0134ca (0x31a bytes) 000454 1788726880.920846 trunc from 0x0134cb to 0x039bcb (0x26701 bytes) 000455 1788726880.934285 trunc from 0x039bcc to 0x002b54 (0x37077 bytes) 000457 1788726880.950080 write 0x005684 thru 0x014c32 (0xf5af bytes) 000458 1788726880.952836 trunc from 0x014c33 to 0x01ae58 (0x6226 bytes) 000459 1788726880.968023 mapwrite 0x0270c2 thru 0x032052 (0xaf91 bytes) 000461 1788726881.081511 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) 000463 1788726881.220843 mapwrite 0x037d23 thru 0x038eaa (0x1188 bytes) 000465 1788726881.280830 read 0x020723 thru 0x025659 (0x4f37 bytes) 000466 1788726881.289358 trunc from 0x038eab to 0x024adf (0x143cb bytes) 000467 1788726881.310680 trunc from 0x024ae0 to 0x0365d0 (0x11af1 bytes) 000469 1788726881.340828 trunc from 0x0365d1 to 0x02ef10 (0x76c0 bytes) 000471 1788726881.359983 read 0x00e82e thru 0x0176fa (0x8ecd bytes) 000473 1788726881.370706 mapread 0x0042a8 thru 0x0091c5 (0x4f1e bytes) 000474 1788726881.371677 mapwrite 0x00d96c thru 0x019ce1 (0xc376 bytes) 000476 1788726881.422526 mapread 0x0263da thru 0x02725d (0xe84 bytes) 000477 1788726881.423421 mapwrite 0x03e0a7 thru 0x03ffff (0x1f59 bytes) 000478 1788726881.488507 mapread 0x01e117 thru 0x023b6f (0x5a59 bytes) 000480 1788726881.490223 mapread 0x01f47c thru 0x0285fd (0x9182 bytes) 000481 1788726881.492132 read 0x008b82 thru 0x0091bf (0x63e bytes) 000482 1788726881.492847 punch from 0x013d68 to 0x01b7c6 (0x7a5f bytes) 000483 1788726881.501344 trunc from 0x040000 to 0x034ba3 (0xb45c bytes) 000485 1788726881.519712 read 0x006d3b thru 0x00abfa (0x3ec0 bytes) 000486 1788726881.520596 punch from 0x013c11 to 0x018752 (0x4b42 bytes) 000489 1788726881.527671 write 0x03b3f3 thru 0x03fba5 (0x47b3 bytes) 000490 1788726881.531010 mapread 0x024c1d thru 0x025044 (0x428 bytes) 000491 1788726881.531912 mapread 0x036122 thru 0x03fba5 (0x9a84 bytes) 000492 1788726881.546761 trunc from 0x03fba6 to 0x033af2 (0xc0b3 bytes) 000496 1788726881.582636 trunc from 0x033af3 to 0x02b75b (0x8397 bytes) 000498 1788726881.605642 trunc from 0x02b75c to 0x0269ef (0x4d6c bytes) 000502 1788726881.622660 mapread 0x006ea8 thru 0x01180d (0xa966 bytes) 000504 1788726881.626589 read 0x01f6ec thru 0x02583e (0x6153 bytes) 000505 1788726881.627445 mapread 0x0128fa thru 0x01d0ec (0xa7f3 bytes) 000506 1788726881.629179 mapread 0x014b6c thru 0x015c8f (0x1124 bytes) 000508 1788726881.630940 punch from 0x02075d to 0x025ba3 (0x5447 bytes) 000512 1788726881.643720 MIRROR_EXTEND to 2 mirrors 000516 1788726882.653090 MIRROR_EXTEND to 3 mirrors 000517 1788726883.261072 read 0x00b7bf thru 0x00fb40 (0x4382 bytes) 000519 1788726883.291484 write 0x01c7d8 thru 0x01d054 (0x87d bytes) 000520 1788726883.373615 mapread 0x00c951 thru 0x0116a8 (0x4d58 bytes) 000521 1788726883.394182 mapread 0x00d04c thru 0x00f84d (0x2802 bytes) 000522 1788726883.395542 write 0x03030d thru 0x03e881 (0xe575 bytes) 000523 1788726883.398486 mapwrite 0x0071dd thru 0x0124a3 (0xb2c7 bytes) 000524 1788726883.488911 punch from 0x0192e7 to 0x0199f6 (0x710 bytes) 000525 1788726883.497005 punch from 0x003a57 to 0x012153 (0xe6fd bytes) 000526 1788726883.501669 punch from 0x02f9d2 to 0x031626 (0x1c55 bytes) 000527 1788726883.507880 trunc from 0x03e882 to 0x0357a8 (0x90d9 bytes) 000529 1788726883.529575 trunc from 0x0357a9 to 0x037146 (0x199e bytes) 000531 1788726883.544822 mapwrite 0x02cf68 thru 0x03bd5d (0xedf6 bytes) 000532 1788726883.682381 mapread 0x0008d4 thru 0x005ef7 (0x5624 bytes) 000534 1788726883.696732 mapread 0x031839 thru 0x03bd5d (0xa525 bytes) 000535 1788726883.701159 mapwrite 0x00f4a7 thru 0x013f6b (0x4ac5 bytes) 000538 1788726883.771306 write 0x020a48 thru 0x02d213 (0xc7cc bytes) 000541 1788726883.778646 mapread 0x02621a thru 0x029558 (0x333f bytes) 000542 1788726883.779996 mapread 0x0074bb thru 0x010462 (0x8fa8 bytes) 000544 1788726883.784898 punch from 0x012f4f to 0x0212af (0xe361 bytes) 000545 1788726883.801399 trunc from 0x03bd5e to 0x00ba56 (0x30307 bytes) 000546 1788726883.822775 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xba57): Mirror 3: 0x96b725c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xba57): Mirror 3: 0x96b725c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xba57: skipped 000547 1788726884.079124 mapread 0x002ec0 thru 0x0053c8 (0x2509 bytes) 000548 1788726884.100388 read 0x00b465 thru 0x00ba56 (0x5f2 bytes) 000550 1788726884.101528 write 0x0168e8 thru 0x01845a (0x1b73 bytes) 000551 1788726884.103251 mapread 0x005c6b thru 0x00d7be (0x7b54 bytes) 000552 1788726884.109770 mapread 0x006c98 thru 0x00d31e (0x6687 bytes) 000553 1788726884.114705 MIRROR_RESYNC 2 mirrors 000554 1788726884.927288 MIRROR_EXTEND to 3 mirrors 000556 1788726885.707626 punch from 0x008180 to 0x00e1f7 (0x6078 bytes) 000557 1788726885.830576 mapwrite 0x00d478 thru 0x01a6ea (0xd273 bytes) 000559 1788726885.953704 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1a6eb): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a6eb): Mirror 3: 0x8415454d (stale) Mirror 4: 0x8415454d (stale) CRC-32 checksum value for chunk [0, 0x1a6eb): Mirror 1: 0x161a7b37 Mirror 5: 0x161a7b37 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a6eb: skipped 000561 1788726887.223725 read 0x013595 thru 0x018f6a (0x59d6 bytes) 000562 1788726887.248097 mapwrite 0x032a82 thru 0x0366a7 (0x3c26 bytes) 000563 1788726887.465642 trunc from 0x0366a8 to 0x00546c (0x3123b bytes) 000565 1788726887.484665 mapread 0x004259 thru 0x00546c (0x1214 bytes) 000566 1788726887.491200 write 0x013458 thru 0x01bd03 (0x88ac bytes) 000568 1788726887.493639 mapwrite 0x00ce73 thru 0x0129c4 (0x5b52 bytes) 000569 1788726887.544404 MIRROR_RESYNC 4 mirrors 000570 1788726888.902582 mapwrite 0x028002 thru 0x036f64 (0xef63 bytes) 000571 1788726889.116416 write 0x00c3bc thru 0x01a272 (0xdeb7 bytes) 000572 1788726889.134778 punch from 0x02a558 to 0x02beb9 (0x1962 bytes) 000573 1788726889.164629 read 0x009c01 thru 0x00a32b (0x72b bytes) 000574 1788726889.171673 write 0x00a83f thru 0x0109d9 (0x619b bytes) 000577 1788726889.175973 read 0x036230 thru 0x036f64 (0xd35 bytes) 000578 1788726889.176631 read 0x01050c thru 0x01b395 (0xae8a bytes) 000579 1788726889.187893 punch from 0x01df21 to 0x021851 (0x3931 bytes) 000582 1788726889.216242 mapread 0x02b458 thru 0x036f64 (0xbb0d bytes) 000584 1788726889.224055 mapwrite 0x026392 thru 0x026c87 (0x8f6 bytes) 000585 1788726889.316471 punch from 0x0285d1 to 0x02ed1f (0x674f bytes) 000586 1788726889.330674 mapread 0x013851 thru 0x021820 (0xdfd0 bytes) 000587 1788726889.389034 punch from 0x0186c7 to 0x021a7b (0x93b5 bytes) 000588 1788726889.400262 mapwrite 0x02042c thru 0x02cbe0 (0xc7b5 bytes) 000589 1788726889.560114 read 0x01a2ff thru 0x0250ce (0xadd0 bytes) 000591 1788726889.574729 mapwrite 0x02f963 thru 0x03dbb5 (0xe253 bytes) 000592 1788726889.694601 punch from 0x00646a to 0x015e7c (0xfa13 bytes) 000594 1788726889.713558 trunc from 0x03dbb6 to 0x030886 (0xd32f bytes) 000595 1788726889.754233 mapread 0x01ed29 thru 0x02d03b (0xe313 bytes) 000596 1788726889.759289 mapread 0x026b78 thru 0x030886 (0x9d0f bytes) 000597 1788726889.767619 read 0x00f8cc thru 0x01a5bc (0xacf1 bytes) 000598 1788726889.782605 punch from 0x0053ac to 0x0117ec (0xc441 bytes) 000600 1788726889.788561 read 0x025361 thru 0x02d668 (0x8308 bytes) 000601 1788726889.789163 read 0x021b07 thru 0x02e290 (0xc78a bytes) 000603 1788726889.791020 mapwrite 0x01af39 thru 0x01d949 (0x2a11 bytes) 000604 1788726889.842586 punch from 0x0144ce to 0x022c0c (0xe73f bytes) 000606 1788726889.856657 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30887): Mirror 4: 0x2492f394 (stale) Mirror 5: 0x2492f394 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30887): Mirror 4: 0x2492f394 (stale) Mirror 5: 0x2492f394 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30887: skipped 000607 1788726890.309365 mapwrite 0x02435c thru 0x02a98a (0x662f bytes) 000609 1788726890.450696 punch from 0x00fb2b to 0x01afd3 (0xb4a9 bytes) 000610 1788726890.473829 trunc from 0x030887 to 0x00a045 (0x26841 bytes) 000611 1788726890.503149 MIRROR_RESYNC 3 mirrors 000612 1788726891.567547 write 0x03cde0 thru 0x03ffff (0x3220 bytes) 000613 1788726891.638297 mapwrite 0x01034d thru 0x01d50b (0xd1bf bytes) 000615 1788726891.788795 read 0x019133 thru 0x0231ce (0xa09c bytes) 000618 1788726891.793031 mapread 0x038cf4 thru 0x03ffff (0x730c bytes) 000619 1788726891.805506 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x26f21fbb (stale) Mirror 5: 0x26f21fbb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8ae5c4a Mirror 6: 0x8ae5c4a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000621 1788726893.433593 punch from 0x001142 to 0x003269 (0x2128 bytes) 000623 1788726893.498035 write 0x030951 thru 0x03f226 (0xe8d6 bytes) 000624 1788726893.508944 trunc from 0x040000 to 0x01dac7 (0x22538 bytes) 000626 1788726893.535669 punch from 0x0181a0 to 0x01dac7 (0x5928 bytes) 000627 1788726893.544935 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1dac8): Mirror 4: 0xcf498c4c (stale) Mirror 5: 0xcf498c4c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1dac8): Mirror 4: 0xcf498c4c (stale) Mirror 5: 0xcf498c4c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1dac8: skipped 000632 1788726893.841235 mapwrite 0x0233cf thru 0x031351 (0xdf83 bytes) 000633 1788726893.978590 trunc from 0x031352 to 0x029948 (0x7a09 bytes) 000635 1788726894.001822 punch from 0x003475 to 0x0066f3 (0x327f bytes) 000636 1788726894.017541 mapread 0x01ed8b thru 0x029948 (0xabbe bytes) 000639 1788726894.023897 trunc from 0x029949 to 0x02a1e0 (0x898 bytes) 000641 1788726894.059024 mapread 0x00fce9 thru 0x011ec3 (0x21db bytes) 000642 1788726894.074761 mapread 0x010da6 thru 0x01de38 (0xd093 bytes) 000643 1788726894.093668 trunc from 0x02a1e1 to 0x02b669 (0x1489 bytes) 000644 1788726894.110107 mapread 0x0219a7 thru 0x02ab61 (0x91bb bytes) 000647 1788726894.121374 mapwrite 0x01a3b4 thru 0x01e0e0 (0x3d2d bytes) 000648 1788726894.177687 mapwrite 0x033ba8 thru 0x03fd97 (0xc1f0 bytes) 000649 1788726894.391211 punch from 0x0272b8 to 0x0295f5 (0x233e bytes) 000650 1788726894.416559 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fd98): Mirror 5: 0x57c44a7c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fd98): Mirror 5: 0x57c44a7c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fd98: skipped 000651 1788726894.772417 trunc from 0x03fd98 to 0x005b92 (0x3a205 bytes) 000652 1788726894.788700 mapwrite 0x023845 thru 0x02b19b (0x7957 bytes) 000653 1788726894.871822 mapwrite 0x01b4e8 thru 0x01eecf (0x39e8 bytes) 000655 1788726894.920670 mapread 0x0186c4 thru 0x024816 (0xc153 bytes) 000656 1788726894.922507 read 0x018585 thru 0x01d785 (0x5201 bytes) 000657 1788726894.928397 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2b19c): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b19c): Mirror 5: 0xfb1ced35 (stale) CRC-32 checksum value for chunk [0, 0x2b19c): Mirror 1: 0x2798d17a Mirror 6: 0x2798d17a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b19c: skipped 000658 1788726895.854575 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b19c): Mirror 5: 0xfb1ced35 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b19c): Mirror 5: 0xfb1ced35 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b19c: skipped 000659 1788726896.116563 punch from 0x026dfc to 0x02b19b (0x43a0 bytes) 000660 1788726896.144245 mapread 0x00856e thru 0x00f03f (0x6ad2 bytes) 000665 1788726896.167546 mapread 0x029a35 thru 0x02b19b (0x1767 bytes) 000666 1788726896.176918 trunc from 0x02b19c to 0x010ce4 (0x1a4b7 bytes) 000668 1788726896.193408 mapwrite 0x02669e thru 0x029ef3 (0x3856 bytes) 000670 1788726896.252585 write 0x0177cc thru 0x01fd91 (0x85c6 bytes) 000671 1788726896.258568 punch from 0x01578e to 0x01d705 (0x7f78 bytes) 000675 1788726896.272216 punch from 0x01dc32 to 0x01fbed (0x1fbc bytes) 000679 1788726896.281664 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x29ef4): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29ef4): Mirror 5: 0xd4701333 (stale) CRC-32 checksum value for chunk [0, 0x29ef4): Mirror 1: 0x1143abd8 Mirror 6: 0x1143abd8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29ef4: skipped 000680 1788726897.640975 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x29ef4): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29ef4): Mirror 5: 0xd4701333 (stale) CRC-32 checksum value for chunk [0, 0x29ef4): Mirror 1: 0x1143abd8 Mirror 6: 0x1143abd8 Mirror 7: 0x1143abd8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29ef4: skipped 000681 1788726898.918210 mapread 0x005f10 thru 0x006950 (0xa41 bytes) 000683 1788726898.927475 trunc from 0x029ef4 to 0x01c95b (0xd598 bytes) 000685 1788726898.992911 write 0x011890 thru 0x016230 (0x49a1 bytes) 000686 1788726899.002024 read 0x017284 thru 0x01c95b (0x56d8 bytes) 000687 1788726899.008817 mapread 0x015896 thru 0x01c95b (0x70c6 bytes) 000688 1788726899.009717 read 0x009626 thru 0x01740b (0xdde6 bytes) 000689 1788726899.017425 mapread 0x00ed0b thru 0x01c95b (0xdc51 bytes) 000690 1788726899.018512 trunc from 0x01c95c to 0x001f7d (0x1a9de bytes) 000691 1788726899.035545 trunc from 0x001f7e to 0x0301ee (0x2e271 bytes) 000693 1788726899.048569 mapread 0x00edfb thru 0x017775 (0x897b bytes) 000694 1788726899.091415 write 0x03ef8c thru 0x03ffff (0x1074 bytes) 000695 1788726899.092554 punch from 0x02c33f to 0x037b0f (0xb7d1 bytes) 000697 1788726899.101276 punch from 0x0346f1 to 0x03deee (0x97fe bytes) 000699 1788726899.105612 mapwrite 0x022404 thru 0x02aae6 (0x86e3 bytes) 000700 1788726899.145070 trunc from 0x040000 to 0x00ad51 (0x352ae bytes) 000701 1788726899.164585 trunc from 0x00ad52 to 0x012fd6 (0x8285 bytes) 000702 1788726899.178549 mapread 0x00f064 thru 0x01061d (0x15ba bytes) 000703 1788726899.191050 write 0x0186c6 thru 0x024989 (0xc2c4 bytes) 000705 1788726899.193113 trunc from 0x02498a to 0x00f4e4 (0x154a5 bytes) 000706 1788726899.224676 write 0x02f4d5 thru 0x03274a (0x3276 bytes) 000707 1788726899.226067 mapwrite 0x035ec7 thru 0x03a446 (0x4580 bytes) 000708 1788726899.312462 punch from 0x0036db to 0x0107ab (0xd0d1 bytes) 000709 1788726899.318025 write 0x00e871 thru 0x00f297 (0xa27 bytes) 000710 1788726899.327223 mapread 0x032b74 thru 0x03a446 (0x78d3 bytes) 000711 1788726899.328352 write 0x02d35a thru 0x034e81 (0x7b28 bytes) 000712 1788726899.333976 trunc from 0x03a447 to 0x02a11b (0x1032b bytes) 000714 1788726899.359032 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2a11c): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a11c): Mirror 5: 0xbeb80be9 (stale) Mirror 6: 0xd5ef6582 (stale) Mirror 7: 0xd5ef6582 (stale) CRC-32 checksum value for chunk [0, 0x2a11c): Mirror 1: 0x9429c769 Mirror 8: 0x9429c769 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a11c: skipped 000715 1788726900.373248 mapwrite 0x025ec4 thru 0x0334a9 (0xd5e6 bytes) 000719 1788726900.605927 mapwrite 0x019d5c thru 0x0234e3 (0x9788 bytes) 000720 1788726900.686257 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x334aa): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x334aa): Mirror 5: 0x84438382 (stale) Mirror 6: 0x7b25df91 (stale) Mirror 7: 0x7b25df91 (stale) Mirror 8: 0xde61f69e (stale) CRC-32 checksum value for chunk [0, 0x334aa): Mirror 1: 0x6b632326 Mirror 9: 0x6b632326 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x334aa: skipped 000721 1788726901.939236 trunc from 0x0334aa to 0x02b614 (0x7e95 bytes) 000723 1788726902.068434 write 0x00833a thru 0x012c2d (0xa8f4 bytes) 000724 1788726902.080009 mapwrite 0x03eb44 thru 0x03ffff (0x14bc bytes) 000725 1788726902.169154 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x8bd7b8a7 (stale) Mirror 7: 0x8bd7b8a7 (stale) Mirror 8: 0x2f1b5212 (stale) Mirror 9: 0x6e5aadce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x8bd7b8a7 (stale) Mirror 7: 0x8bd7b8a7 (stale) Mirror 8: 0x2f1b5212 (stale) Mirror 9: 0x6e5aadce (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000726 1788726902.610102 mapread 0x00079d thru 0x009a35 (0x9299 bytes) 000727 1788726902.645602 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x8bd7b8a7 (stale) Mirror 7: 0x8bd7b8a7 (stale) Mirror 8: 0x2f1b5212 (stale) Mirror 9: 0x6e5aadce (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6fe2fa4b Mirror 10: 0x6fe2fa4b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000728 1788726903.884249 read 0x01cf04 thru 0x028179 (0xb276 bytes) 000731 1788726903.923993 trunc from 0x040000 to 0x0196c9 (0x26936 bytes) 000732 1788726904.087176 read 0x005460 thru 0x00adf6 (0x5997 bytes) 000733 1788726904.097714 mapwrite 0x038650 thru 0x03ffff (0x79b0 bytes) 000736 1788726904.197656 mapwrite 0x026614 thru 0x02cdd0 (0x67bd bytes) 000740 1788726904.253180 mapwrite 0x0157f5 thru 0x0245ad (0xedb9 bytes) 000741 1788726904.333406 write 0x019d2c thru 0x01bb87 (0x1e5c bytes) 000742 1788726904.352311 MIRROR_RESYNC 6 mirrors 000743 1788726907.151225 trunc from 0x040000 to 0x03bfaf (0x4050 bytes) 000744 1788726907.275004 trunc from 0x03bfb0 to 0x0138c9 (0x286e6 bytes) 000746 1788726907.294689 punch from 0x00733f to 0x00fe96 (0x8b58 bytes) 000748 1788726907.299948 write 0x02b7e0 thru 0x031414 (0x5c35 bytes) 000749 1788726907.301173 mapwrite 0x02f360 thru 0x03a529 (0xb1ca bytes) 000750 1788726907.446732 write 0x02406a thru 0x030d4d (0xcce4 bytes) 000751 1788726907.453571 punch from 0x002529 to 0x002ced (0x7c5 bytes) 000752 1788726907.486033 read 0x013850 thru 0x016f3a (0x36eb bytes) 000753 1788726907.504681 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a52a): Mirror 6: 0x7bedc6 (stale) Mirror 7: 0x7bedc6 (stale) Mirror 8: 0x7bedc6 (stale) Mirror 9: 0x7bedc6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a52a): Mirror 6: 0x7bedc6 (stale) Mirror 7: 0x7bedc6 (stale) Mirror 8: 0x7bedc6 (stale) Mirror 9: 0x7bedc6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a52a: skipped 000754 1788726907.947172 trunc from 0x03a52a to 0x01b591 (0x1ef98 bytes) 000756 1788726907.962712 write 0x00ae82 thru 0x018b73 (0xdcf2 bytes) 000758 1788726907.973230 punch from 0x00b61c to 0x00c857 (0x123c bytes) 000759 1788726907.996514 write 0x00e85a thru 0x01d683 (0xee2a bytes) 000761 1788726907.999852 mapwrite 0x00386f thru 0x009fa4 (0x6736 bytes) 000762 1788726908.118131 mapread 0x009ba4 thru 0x01453a (0xa997 bytes) 000763 1788726908.120642 punch from 0x00eea9 to 0x01226f (0x33c7 bytes) 000764 1788726908.131409 punch from 0x00e53b to 0x01bd3d (0xd803 bytes) 000765 1788726908.141967 write 0x00855c thru 0x00d9d6 (0x547b bytes) 000766 1788726908.144267 punch from 0x011d9e to 0x01d683 (0xb8e6 bytes) 000768 1788726908.159667 punch from 0x01d5a2 to 0x01d683 (0xe2 bytes) 000769 1788726908.163160 read 0x019c62 thru 0x019feb (0x38a bytes) 000770 1788726908.167851 mapread 0x01b8e1 thru 0x01d683 (0x1da3 bytes) 000772 1788726908.175034 trunc from 0x01d684 to 0x0025fe (0x1b085 bytes) 000774 1788726908.193274 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25ff): Mirror 7: 0x44358f4b (stale) Mirror 8: 0x44358f4b (stale) Mirror 9: 0x44358f4b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25ff): Mirror 7: 0x44358f4b (stale) Mirror 8: 0x44358f4b (stale) Mirror 9: 0x44358f4b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25ff: skipped 000775 1788726908.502720 write 0x021e55 thru 0x02e2da (0xc486 bytes) 000778 1788726908.516480 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2e2db): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e2db): Mirror 7: 0x91809589 (stale) Mirror 8: 0x91809589 (stale) Mirror 9: 0x91809589 (stale) CRC-32 checksum value for chunk [0, 0x2e2db): Mirror 1: 0x684773a Mirror 10: 0x684773a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e2db: skipped 000779 1788726909.630427 punch from 0x0182cf to 0x028193 (0xfec5 bytes) 000780 1788726909.749426 mapread 0x005e4a thru 0x007b0b (0x1cc2 bytes) 000786 1788726909.774737 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2e2db): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e2db): Mirror 7: 0x91809589 (stale) Mirror 8: 0x91809589 (stale) Mirror 9: 0x91809589 (stale) Mirror 10: 0x684773a (stale) CRC-32 checksum value for chunk [0, 0x2e2db): Mirror 1: 0xe4d917a4 Mirror 11: 0xe4d917a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e2db: skipped 000787 1788726910.691271 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2e2db): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e2db): Mirror 7: 0x91809589 (stale) Mirror 8: 0x91809589 (stale) Mirror 9: 0x91809589 (stale) Mirror 10: 0x684773a (stale) CRC-32 checksum value for chunk [0, 0x2e2db): Mirror 1: 0xe4d917a4 Mirror 11: 0xe4d917a4 Mirror 12: 0xe4d917a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e2db: skipped 000788 1788726911.884976 trunc from 0x02e2db to 0x039c13 (0xb939 bytes) 000790 1788726912.039860 read 0x019804 thru 0x020661 (0x6e5e bytes) truncating to largest ever: 0x3f35f 000791 1788726912.053768 trunc from 0x039c14 to 0x03f35e (0x574b bytes) 000792 1788726912.093222 mapwrite 0x02f9e7 thru 0x03e24f (0xe869 bytes) 000793 1788726912.244403 trunc from 0x03f35f to 0x007bab (0x377b3 bytes) 000795 1788726912.266860 write 0x0305af thru 0x038ecf (0x8921 bytes) 000799 1788726912.274481 mapwrite 0x00d6cc thru 0x019ca3 (0xc5d8 bytes) 000801 1788726912.365577 trunc from 0x038ed0 to 0x00f019 (0x29eb6 bytes) 000802 1788726912.382583 trunc from 0x00f01a to 0x03532b (0x26312 bytes) 000804 1788726912.404470 write 0x033440 thru 0x03ffff (0xcbc0 bytes) 000805 1788726912.415171 write 0x00d2af thru 0x01549d (0x81ef bytes) 000810 1788726912.424040 write 0x03fbe7 thru 0x03ffff (0x419 bytes) 000811 1788726912.424774 trunc from 0x040000 to 0x033621 (0xc9de bytes) 000812 1788726912.468579 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33622): Mirror 7: 0x6ab7d3d (stale) Mirror 8: 0x6ab7d3d (stale) Mirror 9: 0x6ab7d3d (stale) Mirror 11: 0x84f02c97 (stale) Mirror 12: 0x84f02c97 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33622): Mirror 7: 0x6ab7d3d (stale) Mirror 8: 0x6ab7d3d (stale) Mirror 9: 0x6ab7d3d (stale) Mirror 11: 0x84f02c97 (stale) Mirror 12: 0x84f02c97 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33622: skipped 000813 1788726912.874773 write 0x03fac6 thru 0x03ffff (0x53a bytes) 000814 1788726912.875790 write 0x02545e thru 0x02a1d1 (0x4d74 bytes) 000815 1788726912.889530 mapread 0x008457 thru 0x00faa0 (0x764a bytes) 000817 1788726912.917003 mapread 0x0231d4 thru 0x031865 (0xe692 bytes) 000819 1788726912.947494 mapwrite 0x031561 thru 0x03ffff (0xea9f bytes) 000822 1788726913.102995 mapread 0x026c5d thru 0x02f775 (0x8b19 bytes) 000823 1788726913.104112 write 0x03cf43 thru 0x03ffff (0x30bd bytes) 000824 1788726913.115463 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xae0328e2 (stale) Mirror 8: 0xae0328e2 (stale) Mirror 9: 0xae0328e2 (stale) Mirror 11: 0xd5fec1bc (stale) Mirror 12: 0xd5fec1bc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6a37de20 Mirror 13: 0x6a37de20 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000825 1788726914.482234 read 0x01cd26 thru 0x02052b (0x3806 bytes) 000828 1788726914.508825 write 0x0289f9 thru 0x02d932 (0x4f3a bytes) 000829 1788726914.601866 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xae0328e2 (stale) Mirror 8: 0xae0328e2 (stale) Mirror 9: 0xae0328e2 (stale) Mirror 11: 0xd5fec1bc (stale) Mirror 12: 0xd5fec1bc (stale) Mirror 13: 0x6a37de20 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf4287049 Mirror 14: 0xf4287049 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000830 1788726915.728427 mapread 0x00d540 thru 0x01bce7 (0xe7a8 bytes) 000831 1788726915.804223 trunc from 0x040000 to 0x01ff11 (0x200ee bytes) 000832 1788726915.941776 mapwrite 0x01533b thru 0x015e52 (0xb18 bytes) 000833 1788726916.005289 mapwrite 0x0008e7 thru 0x000f43 (0x65d bytes) 000834 1788726916.047856 punch from 0x01e00e to 0x01ff11 (0x1f04 bytes) 000836 1788726916.052910 punch from 0x018ffe to 0x01cf4c (0x3f4f bytes) 000838 1788726916.057545 trunc from 0x01ff12 to 0x0256b1 (0x57a0 bytes) 000839 1788726916.074343 mapwrite 0x00a623 thru 0x00ce4a (0x2828 bytes) 000840 1788726916.115095 write 0x00e6db thru 0x00f00b (0x931 bytes) 000841 1788726916.116256 mapread 0x00bc3a thru 0x015685 (0x9a4c bytes) 000842 1788726916.121836 punch from 0x009f12 to 0x00e361 (0x4450 bytes) 000844 1788726916.138216 mapwrite 0x033ddd thru 0x0365c7 (0x27eb bytes) 000845 1788726916.204054 mapwrite 0x007c6e thru 0x00fb41 (0x7ed4 bytes) 000847 1788726916.263474 MIRROR_RESYNC 8 mirrors 000850 1788726918.631890 punch from 0x009c50 to 0x010baa (0x6f5b bytes) 000851 1788726918.690394 read 0x0022b8 thru 0x011ccb (0xfa14 bytes) 000852 1788726918.702461 MIRROR_RESYNC 8 mirrors 000855 1788726921.680922 mapread 0x02614f thru 0x0345c8 (0xe47a bytes) 000859 1788726921.760174 write 0x03b093 thru 0x03e888 (0x37f6 bytes) 000860 1788726921.861337 read 0x0134f9 thru 0x020c50 (0xd758 bytes) 000861 1788726921.873187 MIRROR_RESYNC 8 mirrors 000863 1788726925.111582 write 0x022d21 thru 0x02d1c1 (0xa4a1 bytes) 000866 1788726925.240533 mapread 0x01bfcc thru 0x0203bb (0x43f0 bytes) 000868 1788726925.271392 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3e889): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e889): Mirror 7: 0xd5ba1593 (stale) Mirror 8: 0xd5ba1593 (stale) Mirror 9: 0xd5ba1593 (stale) Mirror 11: 0xd5ba1593 (stale) Mirror 12: 0xd5ba1593 (stale) Mirror 13: 0xd5ba1593 (stale) Mirror 14: 0xd5ba1593 (stale) CRC-32 checksum value for chunk [0, 0x3e889): Mirror 1: 0x7c7c101a Mirror 15: 0x7c7c101a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e889: skipped 000870 1788726926.459547 MIRROR_RESYNC 9 mirrors 000873 1788726930.647941 read 0x02d2b7 thru 0x0370e2 (0x9e2c bytes) 000874 1788726930.656456 mapread 0x013441 thru 0x013967 (0x527 bytes) 000875 1788726930.660755 read 0x029bd6 thru 0x0349c6 (0xadf1 bytes) 000876 1788726930.672195 punch from 0x018fbb to 0x01be4a (0x2e90 bytes) 000877 1788726930.746943 MIRROR_RESYNC 9 mirrors 000878 1788726935.679167 read 0x0378b0 thru 0x03e888 (0x6fd9 bytes) 000879 1788726935.690448 MIRROR_RESYNC 9 mirrors 000882 1788726936.349798 read 0x034b99 thru 0x0388a2 (0x3d0a bytes) 000884 1788726936.364177 mapread 0x0352e1 thru 0x03e888 (0x95a8 bytes) 000885 1788726936.370740 mapwrite 0x03cb6a thru 0x03ffff (0x3496 bytes) 000886 1788726936.510282 mapwrite 0x0326a0 thru 0x037629 (0x4f8a bytes) 000887 1788726936.589249 mapread 0x032e90 thru 0x03d1dd (0xa34e bytes) 000888 1788726936.593279 mapread 0x03c8a5 thru 0x03ffff (0x375b bytes) 000889 1788726936.595690 mapwrite 0x03b5d6 thru 0x03ffff (0x4a2a bytes) 000890 1788726936.643523 mapwrite 0x00f6a5 thru 0x01c404 (0xcd60 bytes) 000891 1788726936.726729 MIRROR_RESYNC 9 mirrors 000892 1788726942.630031 mapwrite 0x009d0d thru 0x00c114 (0x2408 bytes) 000894 1788726942.781981 mapwrite 0x006887 thru 0x007364 (0xade bytes) 000897 1788726942.819895 mapread 0x03d1ce thru 0x03eadc (0x190f bytes) 000900 1788726942.832280 mapread 0x036ee9 thru 0x03d748 (0x6860 bytes) 000901 1788726942.833777 mapwrite 0x00302d thru 0x00c9ac (0x9980 bytes) 000902 1788726942.879220 read 0x012a57 thru 0x022875 (0xfe1f bytes) 000905 1788726942.889202 punch from 0x022a3b to 0x030a4a (0xe010 bytes) 000907 1788726942.897702 MIRROR_RESYNC 9 mirrors 000912 1788726947.456087 write 0x03b1b9 thru 0x03ffff (0x4e47 bytes) 000914 1788726947.548454 read 0x025d11 thru 0x03132e (0xb61e bytes) 000915 1788726947.560802 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1bd:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xa0259c0d (stale) Mirror 8: 0xa0259c0d (stale) Mirror 9: 0xa0259c0d (stale) Mirror 11: 0xa0259c0d (stale) Mirror 12: 0xa0259c0d (stale) Mirror 14: 0xa0259c0d (stale) Mirror 15: 0xa0259c0d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xa0259c0d (stale) Mirror 8: 0xa0259c0d (stale) Mirror 9: 0xa0259c0d (stale) Mirror 11: 0xa0259c0d (stale) Mirror 12: 0xa0259c0d (stale) Mirror 14: 0xa0259c0d (stale) Mirror 15: 0xa0259c0d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000918 1788726948.221038 trunc from 0x040000 to 0x011907 (0x2e6f8 bytes) 000920 1788726948.254409 mapwrite 0x00b0a4 thru 0x014b18 (0x9a75 bytes) 000921 1788726948.406558 write 0x0301ec thru 0x031f00 (0x1d15 bytes) 000922 1788726948.407546 mapread 0x021124 thru 0x02168f (0x56c bytes) 000923 1788726948.428754 write 0x02912e thru 0x036585 (0xd458 bytes) 000926 1788726948.432192 trunc from 0x036586 to 0x0170bd (0x1f4c8 bytes) 000929 1788726948.454935 read 0x01394b thru 0x016619 (0x2ccf bytes) 000930 1788726948.471362 MIRROR_RESYNC 8 mirrors 000931 1788726951.162081 read 0x0107f1 thru 0x01424b (0x3a5b bytes) 000932 1788726951.180843 punch from 0x003a8c to 0x0041cb (0x740 bytes) 000933 1788726951.259107 write 0x00b215 thru 0x016415 (0xb201 bytes) 000935 1788726951.272261 mapwrite 0x002081 thru 0x007e84 (0x5e04 bytes) 000937 1788726951.350950 trunc from 0x0170be to 0x038b34 (0x21a77 bytes) 000938 1788726951.377206 read 0x0144c4 thru 0x01d5b5 (0x90f2 bytes) 000940 1788726951.395069 trunc from 0x038b35 to 0x016d2e (0x21e06 bytes) 000941 1788726951.413887 mapwrite 0x02e9e2 thru 0x03195b (0x2f7a bytes) 000942 1788726951.551223 read 0x022155 thru 0x03195b (0xf807 bytes) 000945 1788726951.570921 punch from 0x007145 to 0x00877c (0x1638 bytes) 000947 1788726951.602934 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3195c): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3195c): Mirror 7: 0x86b639dd (stale) Mirror 8: 0x86b639dd (stale) Mirror 9: 0x86b639dd (stale) Mirror 11: 0x86b639dd (stale) Mirror 12: 0x86b639dd (stale) Mirror 14: 0x86b639dd (stale) Mirror 15: 0x86b639dd (stale) CRC-32 checksum value for chunk [0, 0x3195c): Mirror 1: 0xee1709bb Mirror 16: 0xee1709bb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3195c: skipped 000948 1788726952.867603 mapread 0x021d80 thru 0x024821 (0x2aa2 bytes) 000949 1788726952.907062 read 0x0025b2 thru 0x00fecd (0xd91c bytes) 000950 1788726952.932725 read 0x022dd1 thru 0x02a5d8 (0x7808 bytes) 000951 1788726952.951600 mapread 0x00880a thru 0x011ede (0x96d5 bytes) 000953 1788726953.022125 write 0x019928 thru 0x0217f2 (0x7ecb bytes) 000954 1788726953.244129 write 0x0276f0 thru 0x036c6c (0xf57d bytes) 000955 1788726953.262681 trunc from 0x036c6d to 0x03183d (0x542f bytes) 000957 1788726953.288052 punch from 0x0196c8 to 0x025490 (0xbdc9 bytes) 000959 1788726953.304630 mapread 0x00a434 thru 0x018596 (0xe163 bytes) 000962 1788726953.379510 punch from 0x02da0a to 0x03183d (0x3e34 bytes) 000963 1788726953.384643 read 0x0004fc thru 0x00f882 (0xf387 bytes) 000964 1788726953.395484 trunc from 0x03183e to 0x00684d (0x2aff0 bytes) 000965 1788726953.427346 trunc from 0x00684e to 0x03e07c (0x3782f bytes) 000966 1788726953.451510 mapread 0x025153 thru 0x034adc (0xf98a bytes) 000968 1788726953.507457 punch from 0x00006b to 0x00caec (0xca82 bytes) 000970 1788726953.511998 mapwrite 0x014d14 thru 0x0221db (0xd4c8 bytes) 000971 1788726953.627300 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3e07d): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e07d): Mirror 7: 0xa7d003d0 (stale) Mirror 8: 0xa7d003d0 (stale) Mirror 9: 0xa7d003d0 (stale) Mirror 11: 0xa7d003d0 (stale) Mirror 12: 0xa7d003d0 (stale) Mirror 14: 0xa7d003d0 (stale) Mirror 15: 0xa7d003d0 (stale) Mirror 16: 0xec5a8dab (stale) CRC-32 checksum value for chunk [0, 0x3e07d): Mirror 1: 0x52419133 Mirror 17: 0x52419133 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e07d: skipped 000972 1788726954.766120 read 0x02cfac thru 0x034a02 (0x7a57 bytes) 000973 1788726954.777904 punch from 0x032eb3 to 0x03db87 (0xacd5 bytes) 000974 1788726954.846098 trunc from 0x03e07d to 0x0350c9 (0x8fb3 bytes) 000975 1788726954.872917 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x350ca): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x350ca): Mirror 7: 0x56e559ea (stale) Mirror 8: 0x56e559ea (stale) Mirror 9: 0x56e559ea (stale) Mirror 11: 0x56e559ea (stale) Mirror 12: 0x56e559ea (stale) Mirror 14: 0x56e559ea (stale) Mirror 15: 0x56e559ea (stale) Mirror 16: 0x4fa5e3f6 (stale) Mirror 17: 0xd62961c2 (stale) CRC-32 checksum value for chunk [0, 0x350ca): Mirror 1: 0xd62961c2 Mirror 18: 0xd62961c2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x350ca: skipped 000976 1788726956.069822 trunc from 0x0350ca to 0x019e45 (0x1b284 bytes) 000977 1788726956.201831 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x19e46): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19e46): Mirror 7: 0x74296e8f (stale) Mirror 8: 0x74296e8f (stale) Mirror 9: 0x74296e8f (stale) Mirror 11: 0x74296e8f (stale) Mirror 12: 0x74296e8f (stale) Mirror 14: 0x74296e8f (stale) Mirror 15: 0x74296e8f (stale) Mirror 16: 0x903f1bd3 (stale) Mirror 17: 0xab0049e (stale) Mirror 18: 0xab0049e (stale) CRC-32 checksum value for chunk [0, 0x19e46): Mirror 1: 0xab0049e Mirror 19: 0xab0049e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19e46: skipped 000978 1788726957.370661 punch from 0x013770 to 0x013fa7 (0x838 bytes) 000979 1788726957.463193 trunc from 0x019e46 to 0x0027a0 (0x176a5 bytes) 000981 1788726957.481899 read 0x000670 thru 0x0027a0 (0x2131 bytes) 000982 1788726957.492439 punch from 0x0023e3 to 0x0027a0 (0x3be bytes) 000983 1788726957.498622 mapread 0x00249f thru 0x0027a0 (0x302 bytes) 000984 1788726957.505888 write 0x02454d thru 0x0265ec (0x20a0 bytes) 000986 1788726957.507696 mapwrite 0x03e220 thru 0x03ffff (0x1de0 bytes) 000987 1788726957.579294 write 0x007a95 thru 0x008e52 (0x13be bytes) 000988 1788726957.591765 MIRROR_RESYNC 12 mirrors 000989 1788726962.293927 trunc from 0x040000 to 0x0214dd (0x1eb22 bytes) 000990 1788726962.385024 punch from 0x01e906 to 0x0214dd (0x2bd8 bytes) 000991 1788726962.392193 mapwrite 0x033eb0 thru 0x038946 (0x4a97 bytes) 000992 1788726962.510949 punch from 0x00a5b5 to 0x019abb (0xf507 bytes) 000993 1788726962.522737 mapwrite 0x00b8d7 thru 0x018044 (0xc76e bytes) 000994 1788726962.725468 mapread 0x0099b4 thru 0x00a69c (0xce9 bytes) 000995 1788726962.730110 write 0x025d5d thru 0x0291fc (0x34a0 bytes) 000996 1788726962.751543 mapread 0x02cbc0 thru 0x038946 (0xbd87 bytes) 000998 1788726962.766607 punch from 0x026895 to 0x032e6f (0xc5db bytes) 000999 1788726962.787387 write 0x00efba thru 0x00efba (0x1 bytes) 001000 1788726962.789245 mapread 0x028d73 thru 0x029624 (0x8b2 bytes) All operations completed A-OK!