== sanity-flr test 70a: flr mode fsx test ================ 12:11:16 (1777911076) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 1077 skipping zero size read 000002 1777911077.427445 mapwrite 0x00e864 thru 0x00f0e0 (0x87d bytes) fallocating to largest ever: 0x25bc1 000003 1777911077.464733 fallocate 0x01916e thru 0x025bc0 (0xca53 bytes) 000005 1777911077.473432 read 0x005ffa thru 0x00f0e0 (0x90e7 bytes) 000006 1777911077.481583 trunc from 0x00445e to 0x0091fd (0x4da0 bytes) 000008 1777911077.489711 trunc from 0x008533 to 0x00f0e0 (0x6bae bytes) 000009 1777911077.497244 read 0x009e8b thru 0x00cd53 (0x2ec9 bytes) 000012 1777911077.524331 fallocate 0x0142ba thru 0x023c89 (0xf9d0 bytes) 000013 1777911077.530482 read 0x00fd4f thru 0x01da5d (0xdd0f bytes) 000015 1777911077.540201 punch from 0x0007ca to 0x007493 (0x6cca bytes) 000016 1777911077.553999 trunc from 0x023c8a to 0x01c45c (0x782d bytes) 000017 1777911077.577579 mapread 0x0179d8 thru 0x01c45c (0x4a85 bytes) 000018 1777911077.581735 read 0x017c5d thru 0x01c45c (0x4800 bytes) 000019 1777911077.588549 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x2af6e 000020 1777911078.121368 trunc from 0x01c45d to 0x02af6d (0xeb11 bytes) 000021 1777911078.196132 mapread 0x0298ce thru 0x02af6d (0x16a0 bytes) 000022 1777911078.209570 trunc from 0x00fe22 to 0x019fab (0xa18a bytes) 000023 1777911078.215274 mapwrite 0x0048ca thru 0x00aede (0x6615 bytes) 000024 1777911078.248658 mapread 0x01aab2 thru 0x02117b (0x66ca bytes) 000025 1777911078.263219 mapread 0x023d6c thru 0x02af6d (0x7202 bytes) 000026 1777911078.272995 trunc from 0x02af6e to 0x01afc5 (0xffa8 bytes) 000027 1777911078.308907 punch from 0x006038 to 0x0073ed (0x13b6 bytes) 000028 1777911078.314649 write 0x002c16 thru 0x0075b3 (0x499e bytes) 000029 1777911078.321686 trunc from 0x014caa to 0x0191af (0x4506 bytes) 000030 1777911078.328451 trunc from 0x01145e to 0x01afc5 (0x9b68 bytes) 000031 1777911078.342565 read 0x0090b6 thru 0x010281 (0x71cc bytes) 000032 1777911078.343920 read 0x007cc7 thru 0x0153dc (0xd716 bytes) 000033 1777911078.353900 mapwrite 0x036319 thru 0x038a73 (0x275b bytes) 000034 1777911078.406238 read 0x007693 thru 0x00a59f (0x2f0d bytes) 000036 1777911078.412475 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) 000037 1777911078.570570 mapwrite 0x009e5d thru 0x00f5d1 (0x5775 bytes) 000038 1777911078.620974 read 0x02f745 thru 0x031fce (0x288a bytes) 000040 1777911078.629888 read 0x004716 thru 0x0109c1 (0xc2ac bytes) 000041 1777911078.630637 punch from 0x02905c to 0x0314b3 (0x8458 bytes) truncating to largest ever: 0x2e7e6 000042 1777911078.639526 trunc from 0x038a74 to 0x02e7e5 (0xa28e bytes) 000043 1777911078.666475 punch from 0x024d35 to 0x02e7e5 (0x9ab1 bytes) 000044 1777911078.670024 mapread 0x001bfa thru 0x00b31e (0x9725 bytes) 000045 1777911078.678336 mapwrite 0x00ab8c thru 0x00f3c7 (0x483c bytes) 000046 1777911078.694816 write 0x029c1b thru 0x02a469 (0x84f bytes) 000048 1777911078.697337 trunc from 0x02df4c to 0x02e7e5 (0x89a bytes) 000049 1777911078.702222 punch from 0x00891e to 0x00c223 (0x3906 bytes) 000050 1777911078.708125 punch from 0x00dde3 to 0x0129b5 (0x4bd3 bytes) 000051 1777911078.713183 mapread 0x007425 thru 0x00d158 (0x5d34 bytes) 000052 1777911078.747028 mapread 0x0115a1 thru 0x0177ae (0x620e bytes) 000053 1777911078.759001 fallocate 0x00e2b0 thru 0x00fe38 (0x1b89 bytes) 000054 1777911078.763786 read 0x0123b7 thru 0x012614 (0x25e bytes) 000055 1777911078.764565 fallocate 0x01c59c thru 0x02643e (0x9ea3 bytes) 000056 1777911078.772113 punch from 0x019f39 to 0x02945a (0xf522 bytes) 000057 1777911078.783594 mapread 0x029fcb thru 0x02e7e5 (0x481b bytes) 000058 1777911078.800761 MIRROR_EXTEND to 2 mirrors 000059 1777911079.474989 write 0x019bc9 thru 0x0232c7 (0x96ff bytes) 000060 1777911079.517662 fallocate 0x0035d2 thru 0x009e3f (0x686e bytes) 000061 1777911079.525848 write 0x03d881 thru 0x03ffff (0x277f bytes) 000062 1777911079.527423 mapread 0x03232d thru 0x032bf7 (0x8cb bytes) 000063 1777911079.538753 fallocate 0x015a27 thru 0x023f96 (0xe570 bytes) 000065 1777911079.553529 write 0x0025b5 thru 0x01229c (0xfce8 bytes) 000066 1777911079.580008 write 0x030550 thru 0x03f04d (0xeafe bytes) 000067 1777911079.584949 read 0x0248c4 thru 0x028457 (0x3b94 bytes) 000068 1777911079.593998 write 0x03ef2d thru 0x03ffff (0x10d3 bytes) 000069 1777911079.595471 punch from 0x029a35 to 0x02dea2 (0x446e bytes) 000071 1777911079.602547 trunc from 0x0141d3 to 0x019f1e (0x5d4c bytes) 000072 1777911079.620826 read 0x00aa45 thru 0x01a282 (0xf83e bytes) zero_range to largest ever: 0x338f9 000073 1777911079.630252 trunc from 0x024f7d to 0x0338f8 (0xe97c bytes) 000074 1777911079.638203 MIRROR_RESYNC 2 mirrors 000075 1777911080.285581 write 0x00caec thru 0x01add4 (0xe2e9 bytes) 000076 1777911080.350957 punch from 0x037056 to 0x03b1ee (0x4199 bytes) 000077 1777911080.357268 mapread 0x0060e9 thru 0x00d431 (0x7349 bytes) 000078 1777911080.372302 punch from 0x006b8d to 0x01139d (0xa811 bytes) 000080 1777911080.390581 read 0x018ebb thru 0x02256a (0x96b0 bytes) 000081 1777911080.403853 mapread 0x01a6c4 thru 0x01afd0 (0x90d bytes) 000082 1777911080.406565 mapread 0x00bcd7 thru 0x014740 (0x8a6a bytes) 000083 1777911080.421330 write 0x0364ed thru 0x03a453 (0x3f67 bytes) zero_range to largest ever: 0x37c22 000084 1777911080.431930 trunc from 0x02a42d to 0x037c21 (0xd7f5 bytes) 000085 1777911080.455345 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xca84e89c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbbe34a7e Mirror 3: 0xbbe34a7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000086 1777911081.211977 read 0x03cb6c thru 0x03cff5 (0x48a bytes) 000087 1777911081.223237 trunc from 0x000882 to 0x009922 (0x90a1 bytes) 000088 1777911081.264447 trunc from 0x040000 to 0x024b68 (0x1b497 bytes) 000089 1777911081.316403 punch from 0x018f45 to 0x023659 (0xa715 bytes) 000090 1777911081.325419 mapread 0x01fce2 thru 0x024b68 (0x4e87 bytes) 000092 1777911081.343485 trunc from 0x00cde7 to 0x011c28 (0x4e42 bytes) 000093 1777911081.350423 punch from 0x011e65 to 0x0218b2 (0xfa4e bytes) 000094 1777911081.362000 MIRROR_RESYNC 3 mirrors 000095 1777911082.031759 punch from 0x01bc00 to 0x024b68 (0x8f69 bytes) 000096 1777911082.059413 mapwrite 0x0272c6 thru 0x03071a (0x9455 bytes) 000097 1777911082.149053 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3071b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3071b): Mirror 2: 0x34bf05e1 (stale) Mirror 3: 0x34bf05e1 (stale) CRC-32 checksum value for chunk [0, 0x3071b): Mirror 1: 0x903086dd Mirror 4: 0x903086dd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3071b: skipped 000098 1777911082.825748 mapread 0x0033f6 thru 0x00f641 (0xc24c bytes) 000100 1777911082.871491 read 0x018793 thru 0x028748 (0xffb6 bytes) 000102 1777911082.904723 mapwrite 0x02279a thru 0x028cb0 (0x6517 bytes) 000103 1777911082.992990 trunc from 0x03071b to 0x00aecd (0x2584d bytes) 000104 1777911083.040671 trunc from 0x003a02 to 0x00aecd (0x74cc bytes) 000105 1777911083.045113 write 0x008335 thru 0x0133b8 (0xb084 bytes) 000106 1777911083.056102 write 0x03e88d thru 0x03ffff (0x1773 bytes) 000107 1777911083.057992 trunc from 0x040000 to 0x01c377 (0x23c88 bytes) 000108 1777911083.072288 mapread 0x00081c thru 0x006a1d (0x6202 bytes) 000109 1777911083.080530 fallocate 0x0252bc thru 0x030bb9 (0xb8fe bytes) 000110 1777911083.086356 read 0x01fc98 thru 0x028e56 (0x91bf bytes) 000111 1777911083.095673 trunc from 0x030bba to 0x02da6c (0x314d bytes) 000112 1777911083.118080 mapwrite 0x0392e5 thru 0x03ffff (0x6d1b bytes) 000115 1777911083.184643 fallocate 0x0213bf thru 0x030800 (0xf442 bytes) 000116 1777911083.189499 trunc from 0x040000 to 0x00d520 (0x32adf bytes) 000117 1777911083.211397 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd521): Mirror 2: 0xf19b95d (stale) Mirror 4: 0xf19b95d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd521): Mirror 2: 0xf19b95d (stale) Mirror 4: 0xf19b95d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd521: skipped 000118 1777911083.490963 mapwrite 0x027f8c thru 0x02c0b6 (0x412b bytes) 000119 1777911083.553829 write 0x033e81 thru 0x0353a1 (0x1521 bytes) 000120 1777911083.555550 fallocate 0x0128a3 thru 0x0193b3 (0x6b11 bytes) 000121 1777911083.559644 read 0x00cec6 thru 0x011869 (0x49a4 bytes) 000123 1777911083.568617 read 0x028fe3 thru 0x03211f (0x913d bytes) 000124 1777911083.582316 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x353a2): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x353a2): Mirror 2: 0xb5217ab (stale) Mirror 4: 0xed5061d3 (stale) CRC-32 checksum value for chunk [0, 0x353a2): Mirror 1: 0x2605f7dc Mirror 5: 0x2605f7dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x353a2: skipped 000125 1777911084.365792 punch from 0x0257a3 to 0x027905 (0x2163 bytes) 000126 1777911084.418285 write 0x00ba41 thru 0x017203 (0xb7c3 bytes) 000127 1777911084.446806 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x353a2): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x353a2): Mirror 2: 0xb5217ab (stale) Mirror 4: 0xed5061d3 (stale) Mirror 5: 0x2605f7dc (stale) CRC-32 checksum value for chunk [0, 0x353a2): Mirror 1: 0x9aed2e6c Mirror 6: 0x9aed2e6c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x353a2: skipped 000128 1777911085.433780 mapwrite 0x000d77 thru 0x009f28 (0x91b2 bytes) 000129 1777911085.615768 punch from 0x01545e to 0x01b319 (0x5ebc bytes) 000130 1777911085.631464 MIRROR_RESYNC 5 mirrors 000131 1777911086.907802 punch from 0x019576 to 0x01b962 (0x23ed bytes) 000132 1777911086.941706 trunc from 0x0353a2 to 0x000e2f (0x34572 bytes) 000133 1777911086.969537 mapwrite 0x01c2e8 thru 0x0243cb (0x80e4 bytes) 000134 1777911087.032885 trunc from 0x0243cc to 0x013c5a (0x10771 bytes) 000135 1777911087.049967 read 0x005c48 thru 0x0105c5 (0xa97e bytes) 000136 1777911087.058076 read 0x009851 thru 0x013c5a (0xa40a bytes) 000137 1777911087.065381 trunc from 0x007234 to 0x007fef (0xdbc bytes) 000139 1777911087.078432 read 0x008054 thru 0x00a82f (0x27dc bytes) 000141 1777911087.080124 read 0x005493 thru 0x013c5a (0xe7c8 bytes) 000142 1777911087.089273 write 0x02dad0 thru 0x033a56 (0x5f87 bytes) 000144 1777911087.091908 mapread 0x020a5b thru 0x029f8e (0x9534 bytes) 000146 1777911087.108256 mapread 0x01028c thru 0x0187eb (0x8560 bytes) 000147 1777911087.109578 mapread 0x01afea thru 0x027f23 (0xcf3a bytes) 000148 1777911087.114081 trunc from 0x033a57 to 0x003e11 (0x2fc45 bytes) 000149 1777911087.133513 punch from 0x0012db to 0x003e11 (0x2b37 bytes) 000150 1777911087.140740 mapwrite 0x026337 thru 0x029ecf (0x3b99 bytes) 000152 1777911087.204976 read 0x02510e thru 0x029ecf (0x4dc2 bytes) 000153 1777911087.222225 fallocate 0x011edf thru 0x01cda9 (0xaecb bytes) 000154 1777911087.227322 trunc from 0x0226ba to 0x029ecf (0x7816 bytes) 000155 1777911087.237205 read 0x01189a thru 0x0184e4 (0x6c4b bytes) 000156 1777911087.237971 mapread 0x02193f thru 0x021c56 (0x318 bytes) 000157 1777911087.239033 read 0x022e3e thru 0x029ecf (0x7092 bytes) 000158 1777911087.251078 punch from 0x0295f3 to 0x029ecf (0x8dd bytes) 000160 1777911087.261832 mapread 0x010a96 thru 0x0151d0 (0x473b bytes) 000161 1777911087.269919 MIRROR_RESYNC 5 mirrors 000162 1777911088.299557 trunc from 0x00697e to 0x00b9ec (0x506f bytes) 000163 1777911088.335067 read 0x020344 thru 0x02438e (0x404b bytes) 000164 1777911088.342301 trunc from 0x00111b to 0x010ec1 (0xfda7 bytes) 000165 1777911088.353971 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x29ed0): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29ed0): Mirror 2: 0x190cac5d (stale) Mirror 4: 0x190cac5d (stale) Mirror 5: 0x190cac5d (stale) Mirror 6: 0x190cac5d (stale) CRC-32 checksum value for chunk [0, 0x29ed0): Mirror 1: 0x190cac5d Mirror 7: 0x190cac5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29ed0: skipped 000166 1777911089.372074 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x29ed0): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29ed0): Mirror 2: 0x190cac5d (stale) Mirror 4: 0x190cac5d (stale) Mirror 5: 0x190cac5d (stale) Mirror 6: 0x190cac5d (stale) CRC-32 checksum value for chunk [0, 0x29ed0): Mirror 1: 0x190cac5d Mirror 7: 0x190cac5d Mirror 8: 0x190cac5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29ed0: skipped 000168 1777911090.414980 MIRROR_RESYNC 7 mirrors 000169 1777911091.459417 mapwrite 0x012f3a thru 0x01a9d9 (0x7aa0 bytes) 000170 1777911091.603988 mapread 0x00f6fd thru 0x01f39b (0xfc9f bytes) 000171 1777911091.625704 punch from 0x00a7f1 to 0x00e848 (0x4058 bytes) 000172 1777911091.632751 fallocate 0x01f0ab thru 0x02858a (0x94e0 bytes) 000173 1777911091.641315 trunc from 0x029ed0 to 0x03479c (0xa8cd bytes) 000176 1777911091.674422 trunc from 0x03479d to 0x023465 (0x11337 bytes) 000177 1777911091.705856 punch from 0x01ad1f to 0x01c413 (0x16f5 bytes) 000178 1777911091.722586 trunc from 0x01659f to 0x01b27a (0x4cdc bytes) 000180 1777911091.737840 mapread 0x01d30e thru 0x01ef4d (0x1c40 bytes) 000181 1777911091.759695 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x23466): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23466): Mirror 2: 0x77993915 (stale) Mirror 4: 0x77993915 (stale) Mirror 5: 0x77993915 (stale) Mirror 6: 0x77993915 (stale) Mirror 7: 0x77993915 (stale) Mirror 8: 0x77993915 (stale) CRC-32 checksum value for chunk [0, 0x23466): Mirror 1: 0x40d897e2 Mirror 9: 0x40d897e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23466: skipped 000183 1777911092.709948 write 0x0157bd thru 0x01fabc (0xa300 bytes) 000184 1777911092.789794 write 0x02e815 thru 0x03bb22 (0xd30e bytes) 000185 1777911092.805555 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3bb23): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bb23): Mirror 2: 0x7d581cca (stale) Mirror 4: 0x7d581cca (stale) Mirror 5: 0x7d581cca (stale) Mirror 6: 0x7d581cca (stale) Mirror 7: 0x7d581cca (stale) Mirror 8: 0x7d581cca (stale) Mirror 9: 0xe9b1d1c5 (stale) CRC-32 checksum value for chunk [0, 0x3bb23): Mirror 1: 0x4e9ecb8c Mirror 10: 0x4e9ecb8c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bb23: skipped fallocating to largest ever: 0x3f810 000186 1777911093.955413 fallocate 0x0358a4 thru 0x03f80f (0x9f6c bytes) 000187 1777911094.002535 read 0x03e5c2 thru 0x03f80f (0x124e bytes) 000188 1777911094.007446 mapwrite 0x018162 thru 0x022fb5 (0xae54 bytes) 000189 1777911094.074546 read 0x013b8d thru 0x014d8d (0x1201 bytes) 000190 1777911094.077007 mapwrite 0x00523a thru 0x00a625 (0x53ec bytes) 000191 1777911094.128144 trunc from 0x03f810 to 0x01aa8b (0x24d84 bytes) 000192 1777911094.185990 trunc from 0x011f6c to 0x018f62 (0x6ff7 bytes) 000193 1777911094.206192 trunc from 0x01aa8c to 0x02d8bd (0x12e32 bytes) 000194 1777911094.244956 mapread 0x024453 thru 0x0245af (0x15d bytes) 000196 1777911094.255730 punch from 0x0094c7 to 0x00a23e (0xd78 bytes) 000197 1777911094.264004 write 0x008735 thru 0x01037d (0x7c49 bytes) 000198 1777911094.277358 MIRROR_RESYNC 9 mirrors 000199 1777911096.489711 fallocate 0x03524a thru 0x03af17 (0x5cce bytes) 000200 1777911096.531429 trunc from 0x015b94 to 0x024a69 (0xeed6 bytes) 000201 1777911096.554513 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3af18): Mirror 4: 0xd5bb521d (stale) Mirror 5: 0xd5bb521d (stale) Mirror 6: 0xd5bb521d (stale) Mirror 7: 0xd5bb521d (stale) Mirror 8: 0xd5bb521d (stale) Mirror 9: 0xd5bb521d (stale) Mirror 10: 0xd5bb521d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3af18): Mirror 4: 0xd5bb521d (stale) Mirror 5: 0xd5bb521d (stale) Mirror 6: 0xd5bb521d (stale) Mirror 7: 0xd5bb521d (stale) Mirror 8: 0xd5bb521d (stale) Mirror 9: 0xd5bb521d (stale) Mirror 10: 0xd5bb521d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3af18: skipped 000202 1777911097.131015 trunc from 0x03af18 to 0x01d1ec (0x1dd2b bytes) 000204 1777911097.152234 fallocate 0x004bea thru 0x010202 (0xb619 bytes) 000205 1777911097.159216 write 0x01bf1f thru 0x0230e5 (0x71c7 bytes) 000206 1777911097.167194 mapwrite 0x016488 thru 0x019bcc (0x3745 bytes) 000207 1777911097.203269 mapwrite 0x00f7bf thru 0x01864b (0x8e8d bytes) 000208 1777911097.260510 punch from 0x012e89 to 0x01b01e (0x8196 bytes) 000209 1777911097.269856 trunc from 0x0224c7 to 0x0230e5 (0xc1f bytes) 000210 1777911097.286287 punch from 0x01dee4 to 0x0204c4 (0x25e1 bytes) 000211 1777911097.298008 mapread 0x017d68 thru 0x019379 (0x1612 bytes) 000212 1777911097.333757 read 0x022f59 thru 0x0230e5 (0x18d bytes) 000213 1777911097.346779 read 0x00fc60 thru 0x0104d8 (0x879 bytes) 000214 1777911097.347920 mapwrite 0x014229 thru 0x022ee6 (0xecbe bytes) 000215 1777911097.390455 mapwrite 0x01b2d7 thru 0x02a019 (0xed43 bytes) 000216 1777911097.455132 trunc from 0x01d105 to 0x026e5b (0x9d57 bytes) 000217 1777911097.460358 punch from 0x00f429 to 0x014e62 (0x5a3a bytes) 000218 1777911097.473098 punch from 0x01f732 to 0x02a019 (0xa8e8 bytes) 000219 1777911097.478808 fallocate 0x033463 thru 0x0375fd (0x419b bytes) 000220 1777911097.491958 MIRROR_RESYNC 8 mirrors 000222 1777911099.597906 punch from 0x00e1e0 to 0x017c48 (0x9a69 bytes) 000223 1777911099.652115 trunc from 0x0293d4 to 0x02a019 (0xc46 bytes) 000224 1777911099.664884 MIRROR_RESYNC 8 mirrors 000225 1777911101.775806 MIRROR_EXTEND to 9 mirrors 000226 1777911102.692766 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) 000227 1777911103.080964 fallocate 0x0347d4 thru 0x03834d (0x3b7a bytes) 000228 1777911103.122415 trunc from 0x03834e to 0x039521 (0x11d4 bytes) 000229 1777911103.163696 fallocate 0x036775 thru 0x03f058 (0x88e4 bytes) 000230 1777911103.172814 trunc from 0x01876b to 0x022dcd (0xa663 bytes) 000231 1777911103.179573 read 0x024141 thru 0x02497d (0x83d bytes) 000232 1777911103.186181 mapread 0x038363 thru 0x039521 (0x11bf bytes) 000234 1777911103.199416 mapread 0x0256c0 thru 0x027e96 (0x27d7 bytes) 000235 1777911103.209958 punch from 0x00ffd4 to 0x016f62 (0x6f8f bytes) 000236 1777911103.214288 write 0x03db46 thru 0x03ffff (0x24ba bytes) 000237 1777911103.215864 punch from 0x013b4f to 0x016769 (0x2c1b bytes) 000238 1777911103.224788 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xde0cd581 (stale) Mirror 5: 0xde0cd581 (stale) Mirror 7: 0xde0cd581 (stale) Mirror 8: 0xde0cd581 (stale) Mirror 10: 0xde0cd581 (stale) Mirror 11: 0xde0cd581 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xde0cd581 (stale) Mirror 5: 0xde0cd581 (stale) Mirror 7: 0xde0cd581 (stale) Mirror 8: 0xde0cd581 (stale) Mirror 10: 0xde0cd581 (stale) Mirror 11: 0xde0cd581 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000239 1777911103.690717 trunc from 0x01319f to 0x01bec4 (0x8d26 bytes) 000240 1777911103.706827 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xde0cd581 (stale) Mirror 5: 0xde0cd581 (stale) Mirror 8: 0xde0cd581 (stale) Mirror 10: 0xde0cd581 (stale) Mirror 11: 0xde0cd581 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xde0cd581 (stale) Mirror 5: 0xde0cd581 (stale) Mirror 8: 0xde0cd581 (stale) Mirror 10: 0xde0cd581 (stale) Mirror 11: 0xde0cd581 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000241 1777911104.142408 trunc from 0x040000 to 0x018720 (0x278df bytes) 000242 1777911104.171239 trunc from 0x018721 to 0x01c010 (0x38f0 bytes) 000244 1777911104.192691 punch from 0x009847 to 0x017bbe (0xe378 bytes) 000245 1777911104.202698 trunc from 0x01c011 to 0x00fd67 (0xc2a9 bytes) 000246 1777911104.229353 trunc from 0x00fd68 to 0x02c1d0 (0x1c469 bytes) 000247 1777911104.246905 MIRROR_RESYNC 6 mirrors 000248 1777911105.606941 read 0x00fd8e thru 0x01066b (0x8de bytes) 000250 1777911105.612307 read 0x01470e thru 0x01e966 (0xa259 bytes) 000251 1777911105.630889 MIRROR_RESYNC 6 mirrors 000252 1777911106.166887 punch from 0x007644 to 0x010be9 (0x95a6 bytes) 000253 1777911106.213327 trunc from 0x02c1d1 to 0x01eb87 (0xd649 bytes) 000254 1777911106.247316 trunc from 0x01eb88 to 0x03a45c (0x1b8d5 bytes) 000255 1777911106.278695 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3a45d): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a45d): Mirror 4: 0x8abb2d7c (stale) Mirror 5: 0x8abb2d7c (stale) Mirror 8: 0x8abb2d7c (stale) Mirror 10: 0x8abb2d7c (stale) Mirror 11: 0x8abb2d7c (stale) CRC-32 checksum value for chunk [0, 0x3a45d): Mirror 1: 0x346ea8b Mirror 12: 0x346ea8b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a45d: skipped 000256 1777911107.289559 trunc from 0x039736 to 0x03a45c (0xd27 bytes) 000258 1777911107.345695 mapwrite 0x01ddc1 thru 0x02d07d (0xf2bd bytes) 000259 1777911107.402804 mapread 0x00b78c thru 0x010e70 (0x56e5 bytes) 000260 1777911107.427933 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a45d): Mirror 4: 0x8abb2d7c (stale) Mirror 5: 0x8abb2d7c (stale) Mirror 8: 0x8abb2d7c (stale) Mirror 11: 0x8abb2d7c (stale) Mirror 12: 0x346ea8b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a45d): Mirror 4: 0x8abb2d7c (stale) Mirror 5: 0x8abb2d7c (stale) Mirror 8: 0x8abb2d7c (stale) Mirror 11: 0x8abb2d7c (stale) Mirror 12: 0x346ea8b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a45d: skipped 000261 1777911107.908653 trunc from 0x020988 to 0x02b3a5 (0xaa1e bytes) 000262 1777911107.918638 fallocate 0x00fee4 thru 0x011444 (0x1561 bytes) 000263 1777911107.926196 write 0x019dd2 thru 0x026423 (0xc652 bytes) 000264 1777911107.945102 mapwrite 0x003014 thru 0x00dca6 (0xac93 bytes) 000266 1777911107.994614 punch from 0x01cf05 to 0x02803c (0xb138 bytes) 000267 1777911108.000121 write 0x004d62 thru 0x00fea1 (0xb140 bytes) 000268 1777911108.002018 write 0x036a14 thru 0x03b844 (0x4e31 bytes) 000269 1777911108.010364 mapread 0x018741 thru 0x025779 (0xd039 bytes) 000270 1777911108.028977 trunc from 0x03b845 to 0x01dc74 (0x1dbd0 bytes) 000271 1777911108.049691 mapwrite 0x0232b2 thru 0x032a95 (0xf7e4 bytes) 000272 1777911108.109889 trunc from 0x032a96 to 0x01fd30 (0x12d65 bytes) 000273 1777911108.130575 read 0x0145cc thru 0x01ac49 (0x667e bytes) 000275 1777911108.131975 write 0x014082 thru 0x01fa4f (0xb9ce bytes) 000276 1777911108.142036 MIRROR_RESYNC 6 mirrors fallocating to largest ever: 0x40000 000277 1777911109.471824 fallocate 0x03ca49 thru 0x03ffff (0x35b7 bytes) 000279 1777911109.501483 trunc from 0x01a2d6 to 0x01fd30 (0x5a5b bytes) 000280 1777911109.507011 fallocate 0x023213 thru 0x02ec06 (0xb9f4 bytes) 000282 1777911109.513642 fallocate 0x02d667 thru 0x037de8 (0xa782 bytes) 000283 1777911109.518462 trunc from 0x0118ae to 0x016767 (0x4eba bytes) 000284 1777911109.523478 read 0x018878 thru 0x019685 (0xe0e bytes) 000285 1777911109.530776 mapwrite 0x02418e thru 0x02589b (0x170e bytes) 000286 1777911109.570681 mapwrite 0x001db0 thru 0x0081e0 (0x6431 bytes) 000287 1777911109.609030 write 0x013b5e thru 0x019f17 (0x63ba bytes) 000288 1777911109.620811 trunc from 0x00e351 to 0x017781 (0x9431 bytes) 000289 1777911109.635940 trunc from 0x02ec07 to 0x00221b (0x2c9eb bytes) 000290 1777911109.666057 fallocate 0x007037 thru 0x016899 (0xf863 bytes) 000291 1777911109.671998 punch from 0x00b4df to 0x00e702 (0x3224 bytes) 000292 1777911109.684839 fallocate 0x03b7de thru 0x03ffff (0x4822 bytes) 000293 1777911109.693793 mapwrite 0x028154 thru 0x0348b2 (0xc75f bytes) 000294 1777911109.765852 mapwrite 0x00f1ef thru 0x015b83 (0x6995 bytes) 000295 1777911109.795910 mapwrite 0x020746 thru 0x028a6f (0x832a bytes) 000296 1777911109.825393 fallocate 0x025978 thru 0x02793b (0x1fc4 bytes) 000297 1777911109.830408 punch from 0x0124a7 to 0x01be38 (0x9992 bytes) 000298 1777911109.838300 fallocate 0x00938a thru 0x012e68 (0x9adf bytes) 000299 1777911109.845834 punch from 0x019a29 to 0x026bb3 (0xd18b bytes) 000300 1777911109.850653 trunc from 0x0348b3 to 0x036ab7 (0x2205 bytes) 000301 1777911109.868426 trunc from 0x01f416 to 0x0224dd (0x30c8 bytes) 000302 1777911109.881528 mapread 0x015900 thru 0x01efba (0x96bb bytes) 000303 1777911109.905058 mapread 0x02eb19 thru 0x036403 (0x78eb bytes) 000304 1777911109.917039 fallocate 0x01c6b6 thru 0x025752 (0x909d bytes) 000305 1777911109.928588 fallocate 0x028429 thru 0x037622 (0xf1fa bytes) 000306 1777911109.939541 mapwrite 0x001f59 thru 0x00de63 (0xbf0b bytes) 000307 1777911109.981746 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36ab8): Mirror 4: 0x3514e162 (stale) Mirror 8: 0x3514e162 (stale) Mirror 11: 0x3514e162 (stale) Mirror 12: 0x3514e162 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36ab8): Mirror 4: 0x3514e162 (stale) Mirror 8: 0x3514e162 (stale) Mirror 11: 0x3514e162 (stale) Mirror 12: 0x3514e162 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36ab8: skipped 000308 1777911110.367124 mapwrite 0x029cc2 thru 0x03533a (0xb679 bytes) 000310 1777911110.415807 read 0x01b15c thru 0x027421 (0xc2c6 bytes) 000311 1777911110.427563 write 0x02cf74 thru 0x03aeef (0xdf7c bytes) 000312 1777911110.435219 fallocate 0x015030 thru 0x0185ed (0x35be bytes) 000313 1777911110.443076 punch from 0x02bb89 to 0x031470 (0x58e8 bytes) 000314 1777911110.465596 mapread 0x02fcae thru 0x033042 (0x3395 bytes) 000315 1777911110.479976 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3aef0): Mirror 4: 0x388ab8 (stale) Mirror 11: 0x388ab8 (stale) Mirror 12: 0x388ab8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aef0): Mirror 4: 0x388ab8 (stale) Mirror 11: 0x388ab8 (stale) Mirror 12: 0x388ab8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aef0: skipped 000316 1777911110.821465 trunc from 0x03aef0 to 0x007de9 (0x33106 bytes) 000318 1777911110.847025 trunc from 0x0024cf to 0x007de9 (0x591b bytes) 000319 1777911110.856538 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x7dea): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7dea): Mirror 4: 0xab483193 (stale) Mirror 11: 0xab483193 (stale) Mirror 12: 0xab483193 (stale) CRC-32 checksum value for chunk [0, 0x7dea): Mirror 1: 0xc760fbe0 Mirror 13: 0xc760fbe0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7dea: skipped 000320 1777911111.626573 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x7dea): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7dea): Mirror 4: 0xab483193 (stale) Mirror 11: 0xab483193 (stale) Mirror 12: 0xab483193 (stale) CRC-32 checksum value for chunk [0, 0x7dea): Mirror 1: 0xc760fbe0 Mirror 13: 0xc760fbe0 Mirror 14: 0xc760fbe0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7dea: skipped 000321 1777911112.356720 fallocate 0x0297aa thru 0x02b3c9 (0x1c20 bytes) 000322 1777911112.399980 read 0x00eb3f thru 0x014234 (0x56f6 bytes) 000323 1777911112.409217 trunc from 0x0273b0 to 0x02b3c9 (0x401a bytes) 000324 1777911112.417794 fallocate 0x015542 thru 0x01fcbe (0xa77d bytes) 000325 1777911112.427196 punch from 0x01297c to 0x012b47 (0x1cc bytes) 000327 1777911112.452462 MIRROR_RESYNC 6 mirrors 000328 1777911113.587803 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) 000329 1777911113.942826 read 0x00b272 thru 0x01a129 (0xeeb8 bytes) 000330 1777911113.958650 read 0x005569 thru 0x00a12e (0x4bc6 bytes) 000331 1777911113.975743 trunc from 0x02b3ca to 0x0222b7 (0x9112 bytes) 000332 1777911114.027014 mapwrite 0x010e07 thru 0x013ecd (0x30c7 bytes) 000335 1777911114.075242 write 0x012b8b thru 0x01ffc5 (0xd43b bytes) 000336 1777911114.084745 mapread 0x012b10 thru 0x018037 (0x5528 bytes) 000337 1777911114.087195 fallocate 0x007762 thru 0x010b61 (0x9400 bytes) 000339 1777911114.095848 read 0x007c67 thru 0x00d1f3 (0x558d bytes) 000340 1777911114.109668 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x222b8): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x222b8): Mirror 4: 0xb5b3a13b (stale) Mirror 11: 0xb5b3a13b (stale) Mirror 12: 0xb5b3a13b (stale) Mirror 13: 0xb5b3a13b (stale) CRC-32 checksum value for chunk [0, 0x222b8): Mirror 1: 0x6e57ef05 Mirror 14: 0x6e57ef05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x222b8: skipped 000341 1777911114.944553 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x222b8): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x222b8): Mirror 4: 0xb5b3a13b (stale) Mirror 11: 0xb5b3a13b (stale) Mirror 12: 0xb5b3a13b (stale) Mirror 13: 0xb5b3a13b (stale) CRC-32 checksum value for chunk [0, 0x222b8): Mirror 1: 0x6e57ef05 Mirror 14: 0x6e57ef05 Mirror 15: 0x6e57ef05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x222b8: skipped 000342 1777911115.761073 trunc from 0x006998 to 0x00dcea (0x7353 bytes) 000343 1777911115.814430 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x222b8): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x222b8): Mirror 4: 0xb5b3a13b (stale) Mirror 11: 0xb5b3a13b (stale) Mirror 12: 0xb5b3a13b (stale) Mirror 13: 0xb5b3a13b (stale) Mirror 14: 0x6e57ef05 (stale) Mirror 15: 0x6e57ef05 (stale) CRC-32 checksum value for chunk [0, 0x222b8): Mirror 1: 0x6e57ef05 Mirror 16: 0x6e57ef05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x222b8: skipped 000344 1777911116.613869 mapwrite 0x030601 thru 0x037ea9 (0x78a9 bytes) 000345 1777911116.721143 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x37eaa): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37eaa): Mirror 4: 0x6014515e (stale) Mirror 11: 0x6014515e (stale) Mirror 12: 0x6014515e (stale) Mirror 13: 0x6014515e (stale) Mirror 14: 0x3840eca0 (stale) Mirror 15: 0x3840eca0 (stale) Mirror 16: 0x3840eca0 (stale) CRC-32 checksum value for chunk [0, 0x37eaa): Mirror 1: 0x41a105a6 Mirror 17: 0x41a105a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37eaa: skipped 000346 1777911117.699829 trunc from 0x037eaa to 0x00038e (0x37b1b bytes) 000348 1777911117.773025 read 0x0000c4 thru 0x00038e (0x2cb bytes) 000349 1777911117.783077 write 0x02502f thru 0x02ce88 (0x7e5a bytes) 000350 1777911117.784679 write 0x00e4dd thru 0x013de4 (0x5908 bytes) 000351 1777911117.795668 punch from 0x01ff4c to 0x02ce88 (0xcf3d bytes) 000352 1777911117.815130 punch from 0x028068 to 0x02a08b (0x2024 bytes) 000353 1777911117.823421 mapread 0x0066bb thru 0x00d6d0 (0x7016 bytes) 000354 1777911117.841304 fallocate 0x0399ba thru 0x03ffff (0x6646 bytes) 000355 1777911117.846455 write 0x0059e2 thru 0x00cc6e (0x728d bytes) 000356 1777911117.848305 read 0x02cc37 thru 0x036aea (0x9eb4 bytes) 000357 1777911117.858843 read 0x03b3ac thru 0x03ffff (0x4c54 bytes) 000358 1777911117.859533 trunc from 0x0155d0 to 0x0199f6 (0x4427 bytes) 000359 1777911117.866517 trunc from 0x00cda1 to 0x00d861 (0xac1 bytes) 000360 1777911117.894245 trunc from 0x040000 to 0x0222f7 (0x1dd08 bytes) 000361 1777911117.923088 mapread 0x0096b8 thru 0x01438f (0xacd8 bytes) 000362 1777911117.936792 fallocate 0x0327af thru 0x037ba0 (0x53f2 bytes) 000364 1777911117.943865 mapread 0x005e1e thru 0x00af25 (0x5108 bytes) 000365 1777911117.945567 fallocate 0x01a2e7 thru 0x0220ad (0x7dc7 bytes) 000366 1777911117.955721 trunc from 0x004112 to 0x00de00 (0x9cef bytes) 000367 1777911117.962014 mapread 0x010719 thru 0x01da1e (0xd306 bytes) 000368 1777911117.963527 trunc from 0x0222f8 to 0x01f8e0 (0x2a17 bytes) 000369 1777911117.979786 trunc from 0x01f8e1 to 0x00e069 (0x11877 bytes) 000370 1777911118.002035 trunc from 0x00e06a to 0x033688 (0x2561f bytes) 000371 1777911118.035658 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x33689): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33689): Mirror 4: 0x33850e3d (stale) Mirror 11: 0x33850e3d (stale) Mirror 12: 0x33850e3d (stale) Mirror 13: 0x33850e3d (stale) Mirror 14: 0xa9983a6f (stale) Mirror 15: 0xa9983a6f (stale) Mirror 16: 0xa9983a6f (stale) Mirror 17: 0x3d1eb18d (stale) CRC-32 checksum value for chunk [0, 0x33689): Mirror 1: 0xde47c4c0 Mirror 18: 0xde47c4c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33689: skipped 000372 1777911119.086879 trunc from 0x033689 to 0x028487 (0xb201 bytes) 000373 1777911119.176759 trunc from 0x022efc to 0x02837e (0x5483 bytes) 000375 1777911119.191670 fallocate 0x03f0b9 thru 0x03ffff (0xf47 bytes) 000376 1777911119.198322 trunc from 0x01bde2 to 0x0262e3 (0xa502 bytes) 000377 1777911119.208829 MIRROR_RESYNC 10 mirrors 000378 1777911120.922188 trunc from 0x040000 to 0x022c5f (0x1d3a0 bytes) 000379 1777911120.961790 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22c60): Mirror 4: 0x177e00ae (stale) Mirror 11: 0x177e00ae (stale) Mirror 12: 0x177e00ae (stale) Mirror 14: 0x177e00ae (stale) Mirror 15: 0x177e00ae (stale) Mirror 16: 0x177e00ae (stale) Mirror 17: 0x177e00ae (stale) Mirror 18: 0x177e00ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22c60): Mirror 4: 0x177e00ae (stale) Mirror 11: 0x177e00ae (stale) Mirror 12: 0x177e00ae (stale) Mirror 14: 0x177e00ae (stale) Mirror 15: 0x177e00ae (stale) Mirror 16: 0x177e00ae (stale) Mirror 17: 0x177e00ae (stale) Mirror 18: 0x177e00ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22c60: skipped 000380 1777911121.395312 mapread 0x0021c2 thru 0x0106c1 (0xe500 bytes) 000381 1777911121.423773 mapwrite 0x02d879 thru 0x02f074 (0x17fc bytes) 000382 1777911121.485376 read 0x00f537 thru 0x019dbd (0xa887 bytes) 000384 1777911121.494238 punch from 0x008ced to 0x012a99 (0x9dad bytes) 000385 1777911121.499540 read 0x01c510 thru 0x027a61 (0xb552 bytes) 000386 1777911121.510526 read 0x016ab2 thru 0x0220f5 (0xb644 bytes) 000387 1777911121.511821 read 0x019807 thru 0x025f5e (0xc758 bytes) 000388 1777911121.512605 punch from 0x02cec2 to 0x02dd9c (0xedb bytes) 000389 1777911121.517221 fallocate 0x01e4b6 thru 0x022cd6 (0x4821 bytes) 000390 1777911121.524045 write 0x033454 thru 0x037194 (0x3d41 bytes) 000391 1777911121.525568 punch from 0x01981a to 0x024479 (0xac60 bytes) 000392 1777911121.532923 fallocate 0x01e721 thru 0x02390a (0x51ea bytes) 000393 1777911121.537441 write 0x01cb64 thru 0x025867 (0x8d04 bytes) 000394 1777911121.546957 trunc from 0x017f1b to 0x0231e8 (0xb2ce bytes) 000395 1777911121.561587 punch from 0x014a71 to 0x01b7c7 (0x6d57 bytes) 000396 1777911121.567044 mapwrite 0x016207 thru 0x0243bf (0xe1b9 bytes) 000397 1777911121.665024 trunc from 0x037195 to 0x02df5a (0x923a bytes) 000399 1777911121.693823 mapwrite 0x035c63 thru 0x03ffff (0xa39d bytes) 000400 1777911121.760328 read 0x0300cb thru 0x0399a9 (0x98df bytes) 000401 1777911121.784323 write 0x0149b9 thru 0x01c186 (0x77ce bytes) 000402 1777911121.785842 mapread 0x03e3d3 thru 0x03ffff (0x1c2d bytes) 000403 1777911121.787596 punch from 0x01a2c0 to 0x0293dd (0xf11e bytes) 000404 1777911121.805446 write 0x03a347 thru 0x03ffff (0x5cb9 bytes) 000405 1777911121.806898 read 0x0174a8 thru 0x01a173 (0x2ccc bytes) 000406 1777911121.834689 punch from 0x022322 to 0x028fb0 (0x6c8f bytes) 000407 1777911121.846740 mapread 0x012a27 thru 0x02109f (0xe679 bytes) 000408 1777911121.849680 punch from 0x01fdee to 0x026f1e (0x7131 bytes) 000409 1777911121.855846 mapread 0x0051b2 thru 0x0133c4 (0xe213 bytes) 000411 1777911121.858487 trunc from 0x040000 to 0x02f536 (0x10ac9 bytes) 000412 1777911121.881775 trunc from 0x02f537 to 0x02f37a (0x1bc bytes) 000413 1777911121.905799 write 0x027afc thru 0x02f518 (0x7a1d bytes) 000414 1777911121.917865 punch from 0x02c820 to 0x02f518 (0x2cf9 bytes) 000415 1777911121.935333 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2f519): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f519): Mirror 4: 0xc812be9b (stale) Mirror 11: 0xc812be9b (stale) Mirror 12: 0xc812be9b (stale) Mirror 14: 0xc812be9b (stale) Mirror 15: 0xc812be9b (stale) Mirror 16: 0xc812be9b (stale) Mirror 17: 0xc812be9b (stale) Mirror 18: 0xc812be9b (stale) CRC-32 checksum value for chunk [0, 0x2f519): Mirror 1: 0xd527d96e Mirror 19: 0xd527d96e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f519: skipped 000416 1777911122.992992 fallocate 0x031c5d thru 0x03c268 (0xa60c bytes) 000417 1777911123.052929 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f519): Mirror 4: 0xc812be9b (stale) Mirror 11: 0xc812be9b (stale) Mirror 12: 0xc812be9b (stale) Mirror 14: 0xc812be9b (stale) Mirror 16: 0xc812be9b (stale) Mirror 17: 0xc812be9b (stale) Mirror 18: 0xc812be9b (stale) Mirror 19: 0xd527d96e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f519): Mirror 4: 0xc812be9b (stale) Mirror 11: 0xc812be9b (stale) Mirror 12: 0xc812be9b (stale) Mirror 14: 0xc812be9b (stale) Mirror 16: 0xc812be9b (stale) Mirror 17: 0xc812be9b (stale) Mirror 18: 0xc812be9b (stale) Mirror 19: 0xd527d96e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f519: skipped 000418 1777911123.538575 write 0x02f098 thru 0x0365c5 (0x752e bytes) 000419 1777911123.554115 trunc from 0x022ee8 to 0x029da4 (0x6ebd bytes) 000420 1777911123.559059 fallocate 0x0365df thru 0x03ffff (0x9a21 bytes) 000421 1777911123.564438 punch from 0x01f410 to 0x025ef4 (0x6ae5 bytes) 000422 1777911123.570627 punch from 0x027988 to 0x036abd (0xf136 bytes) 000423 1777911123.587055 trunc from 0x03cedd to 0x03ffff (0x3123 bytes) 000424 1777911123.595612 read 0x00debf thru 0x01298f (0x4ad1 bytes) 000425 1777911123.609269 punch from 0x03eb35 to 0x03ffff (0x14cb bytes) 000426 1777911123.619342 trunc from 0x040000 to 0x031fee (0xe011 bytes) 000428 1777911123.640224 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31fef): Mirror 11: 0x8eeabd2b (stale) Mirror 12: 0x8eeabd2b (stale) Mirror 14: 0x8eeabd2b (stale) Mirror 16: 0x8eeabd2b (stale) Mirror 17: 0x8eeabd2b (stale) Mirror 18: 0x8eeabd2b (stale) Mirror 19: 0xaad5d5ad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31fef): Mirror 11: 0x8eeabd2b (stale) Mirror 12: 0x8eeabd2b (stale) Mirror 14: 0x8eeabd2b (stale) Mirror 16: 0x8eeabd2b (stale) Mirror 17: 0x8eeabd2b (stale) Mirror 18: 0x8eeabd2b (stale) Mirror 19: 0xaad5d5ad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31fef: skipped 000431 1777911124.158501 read 0x015689 thru 0x01a1f2 (0x4b6a bytes) 000432 1777911124.172549 punch from 0x013e21 to 0x016783 (0x2963 bytes) 000433 1777911124.183631 read 0x0277cc thru 0x031fee (0xa823 bytes) 000434 1777911124.200324 mapwrite 0x02c9fe thru 0x038451 (0xba54 bytes) 000435 1777911124.285596 mapwrite 0x02ea32 thru 0x03db05 (0xf0d4 bytes) 000436 1777911124.347692 punch from 0x00ddf7 to 0x0109d6 (0x2be0 bytes) 000437 1777911124.352407 mapwrite 0x00d8cc thru 0x0121a0 (0x48d5 bytes) 000438 1777911124.401095 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3db06): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3db06): Mirror 11: 0x8387fc46 (stale) Mirror 12: 0x8387fc46 (stale) Mirror 14: 0x8387fc46 (stale) Mirror 16: 0x8387fc46 (stale) Mirror 17: 0x8387fc46 (stale) Mirror 18: 0x8387fc46 (stale) Mirror 19: 0x39f1abf3 (stale) CRC-32 checksum value for chunk [0, 0x3db06): Mirror 1: 0x4636b0c Mirror 20: 0x4636b0c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3db06: skipped 000439 1777911125.528476 trunc from 0x026a6a to 0x031103 (0xa69a bytes) 000442 1777911125.584991 trunc from 0x03db06 to 0x026996 (0x1716f bytes) 000443 1777911125.654676 write 0x0203f2 thru 0x023453 (0x3062 bytes) 000445 1777911125.672703 fallocate 0x018395 thru 0x024e73 (0xcadf bytes) 000446 1777911125.680748 punch from 0x02197b to 0x025b78 (0x41fe bytes) 000447 1777911125.715718 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x26997): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26997): Mirror 11: 0xfe5020c8 (stale) Mirror 12: 0xfe5020c8 (stale) Mirror 14: 0xfe5020c8 (stale) Mirror 16: 0xfe5020c8 (stale) Mirror 17: 0xfe5020c8 (stale) Mirror 18: 0xfe5020c8 (stale) Mirror 19: 0x82bde500 (stale) Mirror 20: 0x9fca5f (stale) CRC-32 checksum value for chunk [0, 0x26997): Mirror 1: 0xc7c6d441 Mirror 21: 0xc7c6d441 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26997: skipped 000449 1777911126.882403 read 0x00a969 thru 0x018bb0 (0xe248 bytes) 000450 1777911126.900569 mapread 0x01504c thru 0x01e422 (0x93d7 bytes) 000451 1777911126.930317 read 0x019d21 thru 0x023211 (0x94f1 bytes) 000452 1777911126.938972 punch from 0x020052 to 0x026996 (0x6945 bytes) 000453 1777911126.977997 trunc from 0x026997 to 0x033b77 (0xd1e1 bytes) 000454 1777911126.999731 trunc from 0x0214fc to 0x0279ec (0x64f1 bytes) 000455 1777911127.004647 mapread 0x011e30 thru 0x01c51a (0xa6eb bytes) 000456 1777911127.021376 punch from 0x01599c to 0x01d8dd (0x7f42 bytes) 000457 1777911127.032776 write 0x009435 thru 0x015ee9 (0xcab5 bytes) 000458 1777911127.048667 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33b78): Mirror 11: 0x9ce6292d (stale) Mirror 12: 0x9ce6292d (stale) Mirror 14: 0x9ce6292d (stale) Mirror 16: 0x9ce6292d (stale) Mirror 17: 0x9ce6292d (stale) Mirror 19: 0x55f87906 (stale) Mirror 20: 0x75eab9cf (stale) Mirror 21: 0x38b7e68c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33b78): Mirror 11: 0x9ce6292d (stale) Mirror 12: 0x9ce6292d (stale) Mirror 14: 0x9ce6292d (stale) Mirror 16: 0x9ce6292d (stale) Mirror 17: 0x9ce6292d (stale) Mirror 19: 0x55f87906 (stale) Mirror 20: 0x75eab9cf (stale) Mirror 21: 0x38b7e68c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33b78: skipped 000459 1777911127.613909 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x33b78): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33b78): Mirror 11: 0x9ce6292d (stale) Mirror 12: 0x9ce6292d (stale) Mirror 14: 0x9ce6292d (stale) Mirror 16: 0x9ce6292d (stale) Mirror 17: 0x9ce6292d (stale) Mirror 19: 0x55f87906 (stale) Mirror 20: 0x75eab9cf (stale) Mirror 21: 0x38b7e68c (stale) CRC-32 checksum value for chunk [0, 0x33b78): Mirror 1: 0x9f8db2a8 Mirror 22: 0x9f8db2a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33b78: skipped 000460 1777911128.778440 punch from 0x031d23 to 0x033b77 (0x1e55 bytes) 000461 1777911128.816825 write 0x00c286 thru 0x01722a (0xafa5 bytes) 000462 1777911128.837647 mapread 0x00f140 thru 0x018a86 (0x9947 bytes) 000463 1777911128.846525 mapwrite 0x0144f0 thru 0x01ec18 (0xa729 bytes) 000464 1777911128.881233 mapread 0x02e999 thru 0x033b77 (0x51df bytes) 000465 1777911128.896944 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33b78): Mirror 11: 0x9ce6292d (stale) Mirror 12: 0x9ce6292d (stale) Mirror 14: 0x9ce6292d (stale) Mirror 16: 0x9ce6292d (stale) Mirror 17: 0x9ce6292d (stale) Mirror 19: 0x55f87906 (stale) Mirror 20: 0x75eab9cf (stale) Mirror 21: 0x38b7e68c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33b78): Mirror 11: 0x9ce6292d (stale) Mirror 12: 0x9ce6292d (stale) Mirror 14: 0x9ce6292d (stale) Mirror 16: 0x9ce6292d (stale) Mirror 17: 0x9ce6292d (stale) Mirror 19: 0x55f87906 (stale) Mirror 20: 0x75eab9cf (stale) Mirror 21: 0x38b7e68c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33b78: skipped 000466 1777911129.408600 punch from 0x01cc5a to 0x02343e (0x67e5 bytes) 000467 1777911129.412390 trunc from 0x033b78 to 0x02b853 (0x8324 bytes) 000468 1777911129.437861 trunc from 0x00b6d9 to 0x01042b (0x4d53 bytes) 000469 1777911129.444659 read 0x005a58 thru 0x014af4 (0xf09d bytes) 000470 1777911129.459943 mapwrite 0x01096e thru 0x0206d0 (0xfd63 bytes) 000471 1777911129.524722 mapread 0x00b0e4 thru 0x00fc27 (0x4b44 bytes) 000472 1777911129.526755 write 0x02c17d thru 0x033610 (0x7494 bytes) 000473 1777911129.533140 read 0x02d6f7 thru 0x033610 (0x5f1a bytes) 000474 1777911129.534351 fallocate 0x0394bb thru 0x03ffff (0x6b45 bytes) 000476 1777911129.546974 mapread 0x00192b thru 0x004c65 (0x333b bytes) 000477 1777911129.567647 trunc from 0x040000 to 0x0201f1 (0x1fe0e bytes) 000478 1777911129.594141 mapwrite 0x029ce0 thru 0x032391 (0x86b2 bytes) 000479 1777911129.674655 mapread 0x025e5d thru 0x02e347 (0x84eb bytes) 000480 1777911129.696503 mapwrite 0x03ac11 thru 0x03ffb6 (0x53a6 bytes) 000481 1777911129.787045 punch from 0x022e0b to 0x02f5c2 (0xc7b8 bytes) 000482 1777911129.794246 read 0x01b3bf thru 0x01c349 (0xf8b bytes) 000483 1777911129.794974 write 0x00969a thru 0x00d564 (0x3ecb bytes) 000484 1777911129.796257 punch from 0x0073ad to 0x00b45c (0x40b0 bytes) 000485 1777911129.809926 trunc from 0x003e5b to 0x00c70d (0x88b3 bytes) 000486 1777911129.817754 read 0x00628b thru 0x0076cf (0x1445 bytes) 000487 1777911129.831663 punch from 0x023c36 to 0x024128 (0x4f3 bytes) 000488 1777911129.839259 trunc from 0x03ffb7 to 0x03afbd (0x4ff9 bytes) 000489 1777911129.870861 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3afbe): Mirror 12: 0x6ebc5932 (stale) Mirror 14: 0x6ebc5932 (stale) Mirror 16: 0x6ebc5932 (stale) Mirror 17: 0x6ebc5932 (stale) Mirror 19: 0x816dcd1d (stale) Mirror 20: 0x56e0bb0f (stale) Mirror 21: 0xc239b68f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afbe): Mirror 12: 0x6ebc5932 (stale) Mirror 14: 0x6ebc5932 (stale) Mirror 16: 0x6ebc5932 (stale) Mirror 17: 0x6ebc5932 (stale) Mirror 19: 0x816dcd1d (stale) Mirror 20: 0x56e0bb0f (stale) Mirror 21: 0xc239b68f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afbe: skipped 000490 1777911130.364501 mapwrite 0x034e85 thru 0x03e0fe (0x927a bytes) 000491 1777911130.444810 trunc from 0x03e0ff to 0x02884d (0x158b1 bytes) 000492 1777911130.468917 trunc from 0x015038 to 0x019df1 (0x4dba bytes) 000493 1777911130.479866 mapread 0x016280 thru 0x0237dc (0xd55d bytes) 000494 1777911130.495397 trunc from 0x02884e to 0x0396bc (0x10e6f bytes) 000495 1777911130.521071 mapread 0x00b1ab thru 0x0194a6 (0xe2fc bytes) 000496 1777911130.531491 mapread 0x00710c thru 0x00cc3a (0x5b2f bytes) 000497 1777911130.533127 trunc from 0x0396bd to 0x007840 (0x31e7c bytes) 000499 1777911130.552885 trunc from 0x007841 to 0x029b8f (0x2234f bytes) 000501 1777911130.568366 fallocate 0x01f671 thru 0x02183a (0x21ca bytes) 000502 1777911130.578124 trunc from 0x029b90 to 0x01a74c (0xf443 bytes) 000503 1777911130.591142 trunc from 0x001074 to 0x007597 (0x6524 bytes) 000505 1777911130.602951 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1a74d): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a74d): Mirror 12: 0xc91b9176 (stale) Mirror 14: 0xc91b9176 (stale) Mirror 16: 0xc91b9176 (stale) Mirror 17: 0xc91b9176 (stale) Mirror 19: 0x1ddce948 (stale) Mirror 20: 0xa182741e (stale) Mirror 21: 0xa182741e (stale) CRC-32 checksum value for chunk [0, 0x1a74d): Mirror 1: 0xc91b9176 Mirror 22: 0xc91b9176 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a74d: skipped 000506 1777911131.505870 trunc from 0x00dad5 to 0x01a74c (0xcc78 bytes) 000507 1777911131.550357 mapread 0x002513 thru 0x009172 (0x6c60 bytes) 000508 1777911131.567184 write 0x0135ec thru 0x01f6a9 (0xc0be bytes) 000509 1777911131.592833 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f6aa): Mirror 14: 0xb7066888 (stale) Mirror 16: 0xb7066888 (stale) Mirror 17: 0xb7066888 (stale) Mirror 19: 0x452b72fe (stale) Mirror 20: 0x570eeba6 (stale) Mirror 21: 0x570eeba6 (stale) Mirror 22: 0xb7066888 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f6aa): Mirror 14: 0xb7066888 (stale) Mirror 16: 0xb7066888 (stale) Mirror 17: 0xb7066888 (stale) Mirror 19: 0x452b72fe (stale) Mirror 20: 0x570eeba6 (stale) Mirror 21: 0x570eeba6 (stale) Mirror 22: 0xb7066888 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f6aa: skipped 000510 1777911132.108785 mapwrite 0x038054 thru 0x03de74 (0x5e21 bytes) 000511 1777911132.178554 mapwrite 0x0211a2 thru 0x0300d2 (0xef31 bytes) 000512 1777911132.223780 write 0x03dfca thru 0x03fead (0x1ee4 bytes) 000513 1777911132.227556 trunc from 0x01450e to 0x021e00 (0xd8f3 bytes) 000514 1777911132.236524 mapwrite 0x015e77 thru 0x01d0ad (0x7237 bytes) 000516 1777911132.280269 MIRROR_RESYNC 8 mirrors 000517 1777911134.417893 mapwrite 0x025272 thru 0x02d49f (0x822e bytes) 000518 1777911134.508421 trunc from 0x03feae to 0x034904 (0xb5a9 bytes) 000519 1777911134.540569 read 0x021498 thru 0x02f86a (0xe3d3 bytes) 000520 1777911134.547363 read 0x0048ba thru 0x009549 (0x4c90 bytes) 000521 1777911134.563311 read 0x030431 thru 0x034904 (0x44d4 bytes) 000522 1777911134.565537 punch from 0x02b885 to 0x031530 (0x5cac bytes) 000523 1777911134.571724 write 0x039449 thru 0x03f1f1 (0x5da9 bytes) 000524 1777911134.575627 write 0x020f77 thru 0x0239f9 (0x2a83 bytes) 000525 1777911134.577095 trunc from 0x025015 to 0x033b16 (0xeb02 bytes) 000526 1777911134.586779 mapwrite 0x008262 thru 0x00b3c6 (0x3165 bytes) 000527 1777911134.607912 fallocate 0x02c9df thru 0x03b5a4 (0xebc6 bytes) 000528 1777911134.612995 fallocate 0x00a454 thru 0x012933 (0x84e0 bytes) 000529 1777911134.621870 punch from 0x02554e to 0x026cde (0x1791 bytes) 000530 1777911134.631564 fallocate 0x024dc7 thru 0x034d7c (0xffb6 bytes) 000531 1777911134.637144 read 0x011cd4 thru 0x0167c3 (0x4af0 bytes) 000532 1777911134.642475 MIRROR_RESYNC 8 mirrors 000535 1777911136.372023 punch from 0x039674 to 0x03f1f1 (0x5b7e bytes) 000536 1777911136.419382 write 0x03103b thru 0x03be74 (0xae3a bytes) 000538 1777911136.431475 fallocate 0x018fdd thru 0x025adf (0xcb03 bytes) 000539 1777911136.438183 mapwrite 0x0045cb thru 0x0074dd (0x2f13 bytes) 000540 1777911136.463914 mapread 0x02e45d thru 0x02f317 (0xebb bytes) 000541 1777911136.474668 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f1f2): Mirror 14: 0x24074964 (stale) Mirror 16: 0x24074964 (stale) Mirror 19: 0x24074964 (stale) Mirror 20: 0x24074964 (stale) Mirror 21: 0x24074964 (stale) Mirror 22: 0x24074964 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f1f2): Mirror 14: 0x24074964 (stale) Mirror 16: 0x24074964 (stale) Mirror 19: 0x24074964 (stale) Mirror 20: 0x24074964 (stale) Mirror 21: 0x24074964 (stale) Mirror 22: 0x24074964 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f1f2: skipped 000542 1777911136.793829 trunc from 0x006dd0 to 0x011e34 (0xb065 bytes) 000543 1777911136.799019 trunc from 0x005956 to 0x0096ed (0x3d98 bytes) 000544 1777911136.804222 punch from 0x02e5c2 to 0x033ea7 (0x58e6 bytes) 000545 1777911136.808973 write 0x00e77d thru 0x01bc2a (0xd4ae bytes) 000546 1777911136.826760 write 0x00bff8 thru 0x00d79f (0x17a8 bytes) 000547 1777911136.838569 trunc from 0x03eabc to 0x03f1f1 (0x736 bytes) 000549 1777911136.845403 trunc from 0x0164ab to 0x01d68b (0x71e1 bytes) 000550 1777911136.862054 MIRROR_RESYNC 7 mirrors 000551 1777911138.758233 fallocate 0x0183b6 thru 0x021143 (0x8d8e bytes) 000552 1777911138.791391 trunc from 0x008735 to 0x01448c (0xbd58 bytes) 000553 1777911138.795359 read 0x024448 thru 0x025036 (0xbef bytes) 000554 1777911138.799743 trunc from 0x035a8b to 0x03645e (0x9d4 bytes) 000555 1777911138.807698 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f1f2): Mirror 14: 0x82a4ab9e (stale) Mirror 16: 0x82a4ab9e (stale) Mirror 19: 0x82a4ab9e (stale) Mirror 20: 0x82a4ab9e (stale) Mirror 22: 0x82a4ab9e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f1f2): Mirror 14: 0x82a4ab9e (stale) Mirror 16: 0x82a4ab9e (stale) Mirror 19: 0x82a4ab9e (stale) Mirror 20: 0x82a4ab9e (stale) Mirror 22: 0x82a4ab9e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f1f2: skipped 000557 1777911139.144932 trunc from 0x014e04 to 0x01be2b (0x7028 bytes) 000558 1777911139.150148 mapread 0x019069 thru 0x022bef (0x9b87 bytes) 000559 1777911139.173118 trunc from 0x03f1f2 to 0x03daf3 (0x16fe bytes) 000560 1777911139.204065 punch from 0x011d37 to 0x01dee9 (0xc1b3 bytes) 000561 1777911139.213266 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3daf4): Mirror 16: 0x5be3d32 (stale) Mirror 19: 0x5be3d32 (stale) Mirror 20: 0x5be3d32 (stale) Mirror 22: 0x5be3d32 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3daf4): Mirror 16: 0x5be3d32 (stale) Mirror 19: 0x5be3d32 (stale) Mirror 20: 0x5be3d32 (stale) Mirror 22: 0x5be3d32 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3daf4: skipped 000562 1777911139.499733 trunc from 0x03daf4 to 0x03788f (0x6264 bytes) 000563 1777911139.514372 fallocate 0x019cd6 thru 0x0225d1 (0x88fc bytes) 000564 1777911139.520653 trunc from 0x00740e to 0x00869f (0x1292 bytes) 000565 1777911139.532299 MIRROR_RESYNC 5 mirrors 000566 1777911140.538610 read 0x031fe3 thru 0x03788f (0x58ad bytes) 000567 1777911140.545848 trunc from 0x037890 to 0x002c05 (0x34c8a bytes) 000568 1777911140.582965 mapwrite 0x03f214 thru 0x03ffff (0xdec bytes) 000570 1777911140.627541 mapread 0x036909 thru 0x03f2c1 (0x89b9 bytes) 000572 1777911140.650289 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x8327e919 (stale) Mirror 20: 0x8327e919 (stale) Mirror 22: 0x8327e919 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x8327e919 (stale) Mirror 20: 0x8327e919 (stale) Mirror 22: 0x8327e919 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000573 1777911140.930108 mapread 0x02bec4 thru 0x032b80 (0x6cbd bytes) 000575 1777911140.952804 write 0x02070e thru 0x02e9e9 (0xe2dc bytes) 000577 1777911140.971433 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x8327e919 (stale) Mirror 20: 0x8327e919 (stale) Mirror 22: 0x8327e919 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd1645717 Mirror 23: 0xd1645717 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000578 1777911141.682400 read 0x028b61 thru 0x033baa (0xb04a bytes) 000579 1777911141.700738 fallocate 0x038dd8 thru 0x03ffff (0x7228 bytes) 000580 1777911141.730870 trunc from 0x036f98 to 0x03ffff (0x9068 bytes) 000581 1777911141.739585 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x8327e919 (stale) Mirror 20: 0x8327e919 (stale) Mirror 22: 0x8327e919 (stale) Mirror 23: 0xd1645717 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x63570169 Mirror 24: 0x63570169 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000582 1777911142.461729 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0x8327e919 (stale) Mirror 22: 0x8327e919 (stale) Mirror 23: 0xd1645717 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0x8327e919 (stale) Mirror 22: 0x8327e919 (stale) Mirror 23: 0xd1645717 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x63570169 Mirror 24: 0x63570169 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000583 1777911143.076142 mapwrite 0x02ad10 thru 0x02f3b1 (0x46a2 bytes) 000584 1777911143.170894 mapwrite 0x01cbac thru 0x025169 (0x85be bytes) 000585 1777911143.208604 trunc from 0x040000 to 0x02385f (0x1c7a0 bytes) 000586 1777911143.234544 mapwrite 0x00fbb7 thru 0x010019 (0x463 bytes) 000587 1777911143.264594 fallocate 0x0384c9 thru 0x03b35c (0x2e94 bytes) 000588 1777911143.270732 trunc from 0x0379ea to 0x03b35c (0x3973 bytes) 000589 1777911143.276260 trunc from 0x0366fb to 0x03b35c (0x4c62 bytes) 000590 1777911143.281687 write 0x0194be thru 0x0218a8 (0x83eb bytes) 000591 1777911143.283936 mapwrite 0x0216d7 thru 0x03100a (0xf934 bytes) 000592 1777911143.318890 fallocate 0x02c715 thru 0x030e98 (0x4784 bytes) 000593 1777911143.324799 mapwrite 0x0177bd thru 0x01c6c6 (0x4f0a bytes) 000595 1777911143.343951 mapwrite 0x0180c8 thru 0x019e2f (0x1d68 bytes) 000596 1777911143.362226 mapread 0x0007ab thru 0x00e132 (0xd988 bytes) 000597 1777911143.376211 fallocate 0x03903d thru 0x0397e8 (0x7ac bytes) 000598 1777911143.384349 trunc from 0x010a5c to 0x019a56 (0x8ffb bytes) 000599 1777911143.395491 trunc from 0x005908 to 0x00e8df (0x8fd8 bytes) 000600 1777911143.402405 trunc from 0x03b35d to 0x0284a5 (0x12eb7 bytes) 000601 1777911143.421915 mapwrite 0x01e97a thru 0x0256cb (0x6d52 bytes) 000602 1777911143.446811 read 0x014a38 thru 0x016eae (0x2477 bytes) 000603 1777911143.451735 write 0x00368e thru 0x005953 (0x22c6 bytes) 000604 1777911143.463052 mapread 0x00f8d1 thru 0x0106c0 (0xdf0 bytes) 000605 1777911143.467123 read 0x01f8bf thru 0x0284a5 (0x8be7 bytes) 000606 1777911143.469356 fallocate 0x00da07 thru 0x01098e (0x2f88 bytes) 000608 1777911143.477706 punch from 0x020607 to 0x025fac (0x59a6 bytes) 000609 1777911143.486276 read 0x020a08 thru 0x0277ed (0x6de6 bytes) 000610 1777911143.506952 MIRROR_RESYNC 5 mirrors 000611 1777911144.652101 trunc from 0x01ed86 to 0x0284a5 (0x9720 bytes) 000613 1777911144.679098 write 0x01b575 thru 0x028db2 (0xd83e bytes) 000615 1777911144.690632 trunc from 0x014584 to 0x015147 (0xbc4 bytes) 000616 1777911144.697024 fallocate 0x02d6af thru 0x02eafc (0x144e bytes) 000617 1777911144.702558 mapread 0x01204c thru 0x01ce59 (0xae0e bytes) 000618 1777911144.709876 fallocate 0x00add6 thru 0x015db3 (0xafde bytes) 000619 1777911144.714378 read 0x01f7ba thru 0x027d46 (0x858d bytes) 000621 1777911144.715581 write 0x01bedb thru 0x029ceb (0xde11 bytes) 000623 1777911144.717991 mapread 0x0263c7 thru 0x029ceb (0x3925 bytes) 000624 1777911144.719185 punch from 0x00ff7d to 0x010f12 (0xf96 bytes) 000625 1777911144.723247 trunc from 0x0250ad to 0x029ceb (0x4c3f bytes) 000626 1777911144.733124 trunc from 0x029cec to 0x03e990 (0x14ca5 bytes) 000627 1777911144.752327 write 0x0076ee thru 0x015ac6 (0xe3d9 bytes) 000628 1777911144.758545 mapread 0x008c87 thru 0x012dc6 (0xa140 bytes) 000629 1777911144.759946 trunc from 0x00ec99 to 0x010ade (0x1e46 bytes) 000630 1777911144.771253 read 0x02a06a thru 0x033858 (0x97ef bytes) 000631 1777911144.780590 mapwrite 0x003010 thru 0x011627 (0xe618 bytes) 000632 1777911144.798309 fallocate 0x02e5d6 thru 0x039016 (0xaa41 bytes) 000633 1777911144.802400 trunc from 0x03e991 to 0x0281d7 (0x167b9 bytes) 000634 1777911144.815916 mapwrite 0x008b44 thru 0x00f392 (0x684f bytes) 000635 1777911144.844546 MIRROR_RESYNC 5 mirrors 000637 1777911145.655768 MIRROR_EXTEND to 6 mirrors 000638 1777911146.203634 write 0x035c1b thru 0x03ffff (0xa3e5 bytes) 000639 1777911146.243778 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0x3385a6d9 (stale) Mirror 22: 0x3385a6d9 (stale) Mirror 23: 0x3385a6d9 (stale) Mirror 24: 0x3385a6d9 (stale) Mirror 25: 0x3385a6d9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb843c606 Mirror 26: 0xb843c606 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000640 1777911147.082838 fallocate 0x013a53 thru 0x015f2f (0x24dd bytes) 000641 1777911147.111046 trunc from 0x040000 to 0x037362 (0x8c9d bytes) 000642 1777911147.138465 mapwrite 0x028f5b thru 0x02c5ed (0x3693 bytes) 000643 1777911147.185733 trunc from 0x037363 to 0x011500 (0x25e62 bytes) 000644 1777911147.201426 mapread 0x0011b4 thru 0x00d293 (0xc0e0 bytes) 000645 1777911147.209003 punch from 0x008a12 to 0x00964e (0xc3d bytes) 000646 1777911147.215080 mapread 0x00554c thru 0x008c53 (0x3708 bytes) 000647 1777911147.223938 punch from 0x00cd78 to 0x011500 (0x4789 bytes) 000648 1777911147.229434 trunc from 0x011501 to 0x015475 (0x3f75 bytes) 000649 1777911147.242628 mapwrite 0x003667 thru 0x00df92 (0xa92c bytes) 000650 1777911147.274576 read 0x011618 thru 0x015475 (0x3e5e bytes) 000651 1777911147.280079 punch from 0x002e3c to 0x0046c7 (0x188c bytes) 000652 1777911147.286745 read 0x00da8c thru 0x013993 (0x5f08 bytes) 000653 1777911147.287917 mapread 0x001378 thru 0x00a841 (0x94ca bytes) 000654 1777911147.296381 punch from 0x00a339 to 0x014e79 (0xab41 bytes) 000655 1777911147.302904 fallocate 0x007192 thru 0x00859f (0x140e bytes) 000656 1777911147.308952 read 0x00f1a5 thru 0x015475 (0x62d1 bytes) 000657 1777911147.316210 punch from 0x00fa1e to 0x015475 (0x5a58 bytes) 000658 1777911147.322325 write 0x031f43 thru 0x03ea02 (0xcac0 bytes) 000659 1777911147.328696 MIRROR_RESYNC 7 mirrors 000660 1777911148.448067 fallocate 0x00e749 thru 0x01c543 (0xddfb bytes) 000661 1777911148.474611 mapread 0x01beb8 thru 0x0274dd (0xb626 bytes) 000662 1777911148.501422 punch from 0x0119fe to 0x02094c (0xef4f bytes) 000663 1777911148.511590 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ea03): Mirror 20: 0x6f494c02 (stale) Mirror 23: 0x6f494c02 (stale) Mirror 24: 0x6f494c02 (stale) Mirror 25: 0x6f494c02 (stale) Mirror 26: 0x6f494c02 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ea03): Mirror 20: 0x6f494c02 (stale) Mirror 23: 0x6f494c02 (stale) Mirror 24: 0x6f494c02 (stale) Mirror 25: 0x6f494c02 (stale) Mirror 26: 0x6f494c02 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ea03: skipped 000664 1777911148.842782 read 0x00d80a thru 0x013365 (0x5b5c bytes) 000665 1777911148.851198 read 0x00b564 thru 0x00b79f (0x23c bytes) 000666 1777911148.863580 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ea03): Mirror 20: 0x6f494c02 (stale) Mirror 23: 0x6f494c02 (stale) Mirror 24: 0x6f494c02 (stale) Mirror 25: 0x6f494c02 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ea03): Mirror 20: 0x6f494c02 (stale) Mirror 23: 0x6f494c02 (stale) Mirror 24: 0x6f494c02 (stale) Mirror 25: 0x6f494c02 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ea03: skipped 000667 1777911149.162770 trunc from 0x000c29 to 0x00ffe5 (0xf3bd bytes) 000668 1777911149.168631 mapread 0x00b4a7 thru 0x01885a (0xd3b4 bytes) 000670 1777911149.200866 mapwrite 0x014aef thru 0x01f583 (0xaa95 bytes) 000671 1777911149.230984 trunc from 0x034331 to 0x03e144 (0x9e14 bytes) 000672 1777911149.237909 read 0x00dd23 thru 0x0111ba (0x3498 bytes) 000674 1777911149.239341 fallocate 0x022f88 thru 0x028a4c (0x5ac5 bytes) 000675 1777911149.243899 trunc from 0x015d9a to 0x01e742 (0x89a9 bytes) 000676 1777911149.257730 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ea03): Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ea03): Mirror 20: 0x6f494c02 (stale) Mirror 23: 0x6f494c02 (stale) Mirror 24: 0x6f494c02 (stale) Mirror 25: 0x6f494c02 (stale) CRC-32 checksum value for chunk [0, 0x3ea03): Mirror 1: 0x2d99831d Mirror 26: 0x2d99831d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ea03: skipped 000677 1777911149.994791 write 0x028f3a thru 0x02e856 (0x591d bytes) 000678 1777911150.052141 fallocate 0x027cfa thru 0x0329b3 (0xacba bytes) 000679 1777911150.059234 write 0x015a06 thru 0x01a38e (0x4989 bytes) 000680 1777911150.069517 mapread 0x03b709 thru 0x03ea02 (0x32fa bytes) 000681 1777911150.078852 trunc from 0x01fec1 to 0x022475 (0x25b5 bytes) 000682 1777911150.085803 write 0x03f6b9 thru 0x03ffff (0x947 bytes) 000684 1777911150.091327 trunc from 0x040000 to 0x03f01c (0xfe3 bytes) 000686 1777911150.139561 MIRROR_RESYNC 6 mirrors 000687 1777911151.562272 punch from 0x0347e7 to 0x034964 (0x17e bytes) 000688 1777911151.600028 punch from 0x023cff to 0x029135 (0x5437 bytes) 000689 1777911151.605545 read 0x01e58a thru 0x02cda2 (0xe819 bytes) 000690 1777911151.619363 fallocate 0x03aa43 thru 0x03ffff (0x55bd bytes) 000691 1777911151.627997 mapwrite 0x03c5f5 thru 0x03ffff (0x3a0b bytes) 000692 1777911151.672639 trunc from 0x02629c to 0x02d89f (0x7604 bytes) 000693 1777911151.678339 read 0x02cf89 thru 0x032d6c (0x5de4 bytes) 000695 1777911151.692145 trunc from 0x01c9e0 to 0x02838a (0xb9ab bytes) 000696 1777911151.703128 punch from 0x02cf40 to 0x03b773 (0xe834 bytes) 000697 1777911151.707841 mapwrite 0x00505d thru 0x0097f9 (0x479d bytes) 000698 1777911151.723361 trunc from 0x040000 to 0x038959 (0x76a6 bytes) 000699 1777911151.741247 read 0x01b29e thru 0x025943 (0xa6a6 bytes) 000700 1777911151.750639 read 0x005485 thru 0x012d29 (0xd8a5 bytes) 000701 1777911151.751524 mapread 0x01ff94 thru 0x0213e0 (0x144d bytes) 000702 1777911151.752992 write 0x037584 thru 0x038435 (0xeb2 bytes) 000703 1777911151.754257 trunc from 0x03895a to 0x01d5a5 (0x1b3b4 bytes) 000704 1777911151.775756 MIRROR_RESYNC 6 mirrors 000705 1777911152.941864 mapwrite 0x00e62d thru 0x0152c8 (0x6c9c bytes) 000706 1777911153.013796 trunc from 0x01d5a6 to 0x034007 (0x16a62 bytes) 000707 1777911153.028142 trunc from 0x025aaa to 0x032e28 (0xd37f bytes) 000708 1777911153.032431 mapwrite 0x03202c thru 0x03a35d (0x8332 bytes) 000709 1777911153.069226 punch from 0x0255cc to 0x02626a (0xc9f bytes) 000710 1777911153.073484 punch from 0x039047 to 0x03a35d (0x1317 bytes) 000711 1777911153.078068 fallocate 0x039e3b thru 0x03ffff (0x61c5 bytes) 000712 1777911153.082913 punch from 0x013f88 to 0x01ad12 (0x6d8b bytes) 000713 1777911153.090402 trunc from 0x03a35e to 0x0283b4 (0x11fa9 bytes) 000714 1777911153.104611 trunc from 0x01f254 to 0x027cad (0x8a5a bytes) 000715 1777911153.107771 mapwrite 0x00070c thru 0x00fe69 (0xf75e bytes) 000717 1777911153.139586 mapwrite 0x01f899 thru 0x02ca8d (0xd1f5 bytes) 000719 1777911153.184345 write 0x00c8b0 thru 0x00e776 (0x1ec7 bytes) 000720 1777911153.185922 write 0x00494c thru 0x00da65 (0x911a bytes) 000721 1777911153.187408 read 0x01330e thru 0x0194a2 (0x6195 bytes) 000722 1777911153.194541 read 0x01d73d thru 0x02944e (0xbd12 bytes) 000723 1777911153.195206 fallocate 0x01020a thru 0x01b2e3 (0xb0da bytes) 000726 1777911153.203036 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2ca8e): Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ca8e): Mirror 20: 0x4323d88 (stale) Mirror 23: 0x4323d88 (stale) Mirror 24: 0x4323d88 (stale) Mirror 25: 0x4323d88 (stale) Mirror 26: 0x4323d88 (stale) CRC-32 checksum value for chunk [0, 0x2ca8e): Mirror 1: 0x568efdd9 Mirror 27: 0x568efdd9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ca8e: skipped 000727 1777911153.911286 write 0x0219a4 thru 0x024466 (0x2ac3 bytes) 000728 1777911153.959275 read 0x02bbd2 thru 0x02ca8d (0xebc bytes) 000729 1777911153.967392 trunc from 0x005697 to 0x0060b1 (0xa1b bytes) 000730 1777911153.972637 mapread 0x00bae6 thru 0x00de16 (0x2331 bytes) 000732 1777911153.981394 trunc from 0x02ca8e to 0x018b16 (0x13f77 bytes) 000733 1777911154.014647 mapread 0x00a820 thru 0x00c92e (0x210f bytes) 000734 1777911154.016745 fallocate 0x0266c5 thru 0x031865 (0xb1a1 bytes) 000735 1777911154.021611 trunc from 0x031866 to 0x002806 (0x2f05f bytes) 000736 1777911154.038290 fallocate 0x008fe0 thru 0x00cdbb (0x3ddc bytes) 000737 1777911154.049644 MIRROR_RESYNC 7 mirrors 000739 1777911154.724365 write 0x0100a0 thru 0x017e16 (0x7d77 bytes) 000740 1777911154.756764 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17e17): Mirror 23: 0x91ed48f7 (stale) Mirror 24: 0x91ed48f7 (stale) Mirror 25: 0x91ed48f7 (stale) Mirror 26: 0x91ed48f7 (stale) Mirror 27: 0x91ed48f7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17e17): Mirror 23: 0x91ed48f7 (stale) Mirror 24: 0x91ed48f7 (stale) Mirror 25: 0x91ed48f7 (stale) Mirror 26: 0x91ed48f7 (stale) Mirror 27: 0x91ed48f7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17e17: skipped 000741 1777911155.110850 mapread 0x0014a6 thru 0x00a759 (0x92b4 bytes) 000742 1777911155.133196 trunc from 0x00b82a to 0x017e16 (0xc5ed bytes) 000743 1777911155.140026 trunc from 0x00bcac to 0x00cd52 (0x10a7 bytes) 000745 1777911155.147123 punch from 0x002dbd to 0x005ac5 (0x2d09 bytes) 000746 1777911155.153498 fallocate 0x023224 thru 0x0287fd (0x55da bytes) 000747 1777911155.159106 read 0x006611 thru 0x0069ca (0x3ba bytes) 000748 1777911155.159763 punch from 0x006950 to 0x010220 (0x98d1 bytes) 000749 1777911155.163506 write 0x01229b thru 0x0142e7 (0x204d bytes) 000750 1777911155.176022 trunc from 0x017e17 to 0x03e97b (0x26b65 bytes) 000751 1777911155.198139 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3e97c): Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e97c): Mirror 23: 0xa6a5985d (stale) Mirror 24: 0xa6a5985d (stale) Mirror 25: 0xa6a5985d (stale) Mirror 26: 0xa6a5985d (stale) Mirror 27: 0xa6a5985d (stale) CRC-32 checksum value for chunk [0, 0x3e97c): Mirror 1: 0x677ac2b2 Mirror 28: 0x677ac2b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e97c: skipped 000753 1777911155.901068 trunc from 0x0287a9 to 0x02ec78 (0x64d0 bytes) 000754 1777911155.928038 read 0x024afa thru 0x02ac12 (0x6119 bytes) 000755 1777911155.935835 trunc from 0x03e97c to 0x00135c (0x3d61f bytes) 000756 1777911155.962496 mapwrite 0x036db0 thru 0x03c1af (0x5400 bytes) 000757 1777911156.020486 mapwrite 0x011ae1 thru 0x01b493 (0x99b3 bytes) 000758 1777911156.062841 fallocate 0x00efe2 thru 0x01d763 (0xe782 bytes) 000759 1777911156.068458 punch from 0x039a2c to 0x03c1af (0x2784 bytes) 000760 1777911156.076558 read 0x006973 thru 0x011808 (0xae96 bytes) 000761 1777911156.088444 fallocate 0x024bf4 thru 0x033f41 (0xf34e bytes) 000762 1777911156.094845 read 0x0285a7 thru 0x02c1c9 (0x3c23 bytes) 000763 1777911156.096306 trunc from 0x03c1b0 to 0x00f436 (0x2cd79 bytes) 000764 1777911156.111627 punch from 0x006205 to 0x007c5d (0x1a59 bytes) 000765 1777911156.117572 mapwrite 0x03bbbc thru 0x03ffff (0x4444 bytes) 000766 1777911156.166843 trunc from 0x00869b to 0x00be8f (0x37f5 bytes) 000767 1777911156.179670 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0x6d65d20d (stale) Mirror 24: 0x6d65d20d (stale) Mirror 25: 0x6d65d20d (stale) Mirror 26: 0x6d65d20d (stale) Mirror 28: 0xcc205dfa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0x6d65d20d (stale) Mirror 24: 0x6d65d20d (stale) Mirror 25: 0x6d65d20d (stale) Mirror 26: 0x6d65d20d (stale) Mirror 28: 0xcc205dfa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000768 1777911156.555686 punch from 0x02510e to 0x03325e (0xe151 bytes) 000770 1777911156.561084 trunc from 0x040000 to 0x009d42 (0x362bd bytes) 000771 1777911156.588501 trunc from 0x009d43 to 0x03c756 (0x32a14 bytes) 000772 1777911156.602391 trunc from 0x004ea6 to 0x012013 (0xd16e bytes) 000773 1777911156.607055 mapwrite 0x02a113 thru 0x03515c (0xb04a bytes) 000774 1777911156.666118 trunc from 0x008138 to 0x0170a8 (0xef71 bytes) 000775 1777911156.679314 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c757): Mirror 23: 0x812ff0b3 (stale) Mirror 24: 0x812ff0b3 (stale) Mirror 25: 0x812ff0b3 (stale) Mirror 26: 0x812ff0b3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c757): Mirror 23: 0x812ff0b3 (stale) Mirror 24: 0x812ff0b3 (stale) Mirror 25: 0x812ff0b3 (stale) Mirror 26: 0x812ff0b3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c757: skipped 000778 1777911157.004652 trunc from 0x030033 to 0x035320 (0x52ee bytes) 000779 1777911157.013697 trunc from 0x03c757 to 0x02dbb4 (0xeba2 bytes) 000780 1777911157.032808 trunc from 0x0282e7 to 0x0288f9 (0x613 bytes) 000781 1777911157.037533 mapwrite 0x03ebbf thru 0x03ffff (0x1441 bytes) 000782 1777911157.085762 fallocate 0x004d0f thru 0x00ab02 (0x5df4 bytes) 000783 1777911157.089713 mapread 0x00dbde thru 0x014ab2 (0x6ed5 bytes) 000785 1777911157.097229 write 0x015f98 thru 0x021fbb (0xc024 bytes) 000786 1777911157.102629 trunc from 0x006190 to 0x0107e5 (0xa656 bytes) 000787 1777911157.108197 trunc from 0x040000 to 0x02c68d (0x13972 bytes) 000788 1777911157.118108 mapwrite 0x036977 thru 0x03de9a (0x7524 bytes) 000789 1777911157.165953 fallocate 0x003e7e thru 0x006db8 (0x2f3b bytes) 000790 1777911157.170000 trunc from 0x014f4e to 0x01cff8 (0x80ab bytes) 000791 1777911157.175429 write 0x0081f0 thru 0x00af93 (0x2da4 bytes) 000792 1777911157.182737 write 0x011391 thru 0x0194e1 (0x8151 bytes) 000793 1777911157.188668 punch from 0x0092eb to 0x00ca8a (0x37a0 bytes) 000794 1777911157.206244 fallocate 0x02447b thru 0x02a834 (0x63ba bytes) 000795 1777911157.212744 mapwrite 0x02e3e2 thru 0x030fc9 (0x2be8 bytes) 000796 1777911157.253377 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3de9b): Mirror 23: 0xa20c83f (stale) Mirror 24: 0xa20c83f (stale) Mirror 26: 0xa20c83f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de9b): Mirror 23: 0xa20c83f (stale) Mirror 24: 0xa20c83f (stale) Mirror 26: 0xa20c83f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de9b: skipped 000798 1777911157.546046 mapread 0x0031ea thru 0x00f587 (0xc39e bytes) 000799 1777911157.576480 mapread 0x038506 thru 0x03de9a (0x5995 bytes) 000800 1777911157.587628 trunc from 0x03b3e8 to 0x03de9a (0x2ab3 bytes) 000801 1777911157.596762 trunc from 0x03de9b to 0x0305ec (0xd8ae bytes) 000802 1777911157.619920 trunc from 0x019f1c to 0x0206be (0x67a3 bytes) 000803 1777911157.631715 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x305ed): Mirror 24: 0xb0c7033e (stale) Mirror 26: 0xb0c7033e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x305ed): Mirror 24: 0xb0c7033e (stale) Mirror 26: 0xb0c7033e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x305ed: skipped 000804 1777911157.907120 mapread 0x01216c thru 0x01588c (0x3721 bytes) 000805 1777911157.925804 trunc from 0x0305ed to 0x013533 (0x1d0b9 bytes) 000806 1777911157.955727 mapwrite 0x016442 thru 0x01c921 (0x64e0 bytes) 000807 1777911158.021582 mapwrite 0x0247bb thru 0x026c5f (0x24a5 bytes) 000808 1777911158.069449 mapread 0x0225f3 thru 0x0250a1 (0x2aaf bytes) 000810 1777911158.071421 trunc from 0x026c60 to 0x0066be (0x205a1 bytes) 000811 1777911158.086026 write 0x00584f thru 0x008739 (0x2eeb bytes) 000812 1777911158.095443 punch from 0x007cd0 to 0x008739 (0xa6a bytes) 000813 1777911158.114973 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x873a): Mirror 26: 0x6483d63b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x873a): Mirror 26: 0x6483d63b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x873a: skipped 000814 1777911158.352368 mapwrite 0x01f22a thru 0x023309 (0x40e0 bytes) 000815 1777911158.403658 trunc from 0x02330a to 0x02358d (0x284 bytes) 000816 1777911158.417564 punch from 0x01d3b8 to 0x02358d (0x61d6 bytes) 000817 1777911158.422138 trunc from 0x02358e to 0x03414d (0x10bc0 bytes) 000818 1777911158.441121 punch from 0x033aa9 to 0x03414d (0x6a5 bytes) 000819 1777911158.444711 mapwrite 0x0158a2 thru 0x018958 (0x30b7 bytes) 000820 1777911158.474028 write 0x01e9c9 thru 0x020e5e (0x2496 bytes) 000821 1777911158.483552 read 0x00b433 thru 0x012076 (0x6c44 bytes) 000822 1777911158.493779 punch from 0x0023ae to 0x008e3f (0x6a92 bytes) 000823 1777911158.499145 read 0x033659 thru 0x03414d (0xaf5 bytes) 000824 1777911158.508646 write 0x03293b thru 0x03b2b2 (0x8978 bytes) 000825 1777911158.510529 write 0x031748 thru 0x03618a (0x4a43 bytes) 000826 1777911158.514519 trunc from 0x03b2b3 to 0x03159b (0x9d17 bytes) 000827 1777911158.538530 mapread 0x024363 thru 0x02c849 (0x84e7 bytes) 000828 1777911158.539898 write 0x03950a thru 0x03ffff (0x6af6 bytes) 000829 1777911158.547805 MIRROR_RESYNC 2 mirrors 000831 1777911159.453045 mapwrite 0x024e00 thru 0x02bd63 (0x6f64 bytes) 000832 1777911159.549913 punch from 0x0321bd to 0x037d24 (0x5b68 bytes) 000833 1777911159.556047 fallocate 0x015678 thru 0x01930a (0x3c93 bytes) 000834 1777911159.561490 mapread 0x025dbc thru 0x0334a4 (0xd6e9 bytes) 000835 1777911159.570587 mapread 0x014994 thru 0x014b28 (0x195 bytes) 000837 1777911159.578695 mapwrite 0x0064e9 thru 0x00a918 (0x4430 bytes) 000838 1777911159.619598 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 26: 0x262afa6f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe3ef84bd Mirror 27: 0xe3ef84bd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000839 1777911160.552447 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 26: 0x262afa6f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe3ef84bd Mirror 27: 0xe3ef84bd Mirror 28: 0xe3ef84bd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000840 1777911161.368597 read 0x03b22c thru 0x03ffff (0x4dd4 bytes) 000841 1777911161.376476 write 0x0130ff thru 0x015e17 (0x2d19 bytes) 000842 1777911161.421617 write 0x029a04 thru 0x02dfa0 (0x459d bytes) 000843 1777911161.432079 write 0x003120 thru 0x012cc9 (0xfbaa bytes) 000844 1777911161.453493 trunc from 0x040000 to 0x020c54 (0x1f3ab bytes) 000845 1777911161.475394 write 0x03897c thru 0x03b1d0 (0x2855 bytes) 000846 1777911161.476852 mapread 0x02b239 thru 0x034ad9 (0x98a1 bytes) 000847 1777911161.486888 mapwrite 0x03309d thru 0x03dc19 (0xab7d bytes) 000848 1777911161.522958 mapwrite 0x033fbc thru 0x03ffff (0xc044 bytes) 000849 1777911161.558285 read 0x03bbfd thru 0x03ffff (0x4403 bytes) 000850 1777911161.562044 mapread 0x00d5bd thru 0x018ee1 (0xb925 bytes) 000851 1777911161.570939 punch from 0x038836 to 0x03d0ed (0x48b8 bytes) 000852 1777911161.575109 trunc from 0x040000 to 0x029849 (0x167b6 bytes) 000853 1777911161.587496 punch from 0x00e6c4 to 0x01cde4 (0xe721 bytes) 000854 1777911161.592188 fallocate 0x0150cf thru 0x01ab8b (0x5abd bytes) 000855 1777911161.596455 fallocate 0x039f6c thru 0x03bfb1 (0x2046 bytes) 000856 1777911161.603845 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3bfb2): Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bfb2): Mirror 26: 0x717d8153 (stale) Mirror 27: 0x1c338ac9 (stale) Mirror 28: 0x1c338ac9 (stale) CRC-32 checksum value for chunk [0, 0x3bfb2): Mirror 1: 0xf3f57521 Mirror 29: 0xf3f57521 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bfb2: skipped 000857 1777911162.327312 trunc from 0x0219a7 to 0x0286b6 (0x6d10 bytes) 000858 1777911162.365275 mapwrite 0x036edd thru 0x03932b (0x244f bytes) 000859 1777911162.409352 read 0x038704 thru 0x03a80b (0x2108 bytes) 000860 1777911162.411045 trunc from 0x034a9f to 0x039f22 (0x5484 bytes) 000861 1777911162.417271 read 0x032811 thru 0x039c37 (0x7427 bytes) 000862 1777911162.429486 write 0x0374b3 thru 0x03f382 (0x7ed0 bytes) 000863 1777911162.436297 fallocate 0x03ce53 thru 0x03ffff (0x31ad bytes) 000864 1777911162.445259 trunc from 0x01ba80 to 0x027f82 (0xc503 bytes) 000865 1777911162.456259 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f383): Mirror 26: 0xeb279282 (stale) Mirror 28: 0xa2385cd8 (stale) Mirror 29: 0x4543d4be (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f383): Mirror 26: 0xeb279282 (stale) Mirror 28: 0xa2385cd8 (stale) Mirror 29: 0x4543d4be (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f383: skipped 000866 1777911162.789722 punch from 0x031ebe to 0x0375d5 (0x5718 bytes) 000867 1777911162.803262 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3f383): Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f383): Mirror 26: 0xeb279282 (stale) Mirror 28: 0xa2385cd8 (stale) Mirror 29: 0x4543d4be (stale) CRC-32 checksum value for chunk [0, 0x3f383): Mirror 1: 0x53bd81b2 Mirror 30: 0x53bd81b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f383: skipped 000868 1777911163.513842 mapwrite 0x00d265 thru 0x01ba64 (0xe800 bytes) 000869 1777911163.627470 read 0x0317b0 thru 0x036c1b (0x546c bytes) 000870 1777911163.634140 write 0x025a69 thru 0x025aa1 (0x39 bytes) 000871 1777911163.650443 trunc from 0x03f383 to 0x0395e1 (0x5da1 bytes) 000872 1777911163.671279 write 0x01a921 thru 0x01da00 (0x30e0 bytes) 000873 1777911163.673399 read 0x034471 thru 0x0395e1 (0x5171 bytes) 000874 1777911163.683672 write 0x0152b9 thru 0x01bd52 (0x6a9a bytes) 000875 1777911163.685275 fallocate 0x023f34 thru 0x027c69 (0x3d36 bytes) 000876 1777911163.692540 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x395e2): Mirror 26: 0x4f8273a5 (stale) Mirror 29: 0x14bbe3d0 (stale) Mirror 30: 0xcfa5cee4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x395e2): Mirror 26: 0x4f8273a5 (stale) Mirror 29: 0x14bbe3d0 (stale) Mirror 30: 0xcfa5cee4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x395e2: skipped 000877 1777911164.013761 read 0x034760 thru 0x0375fd (0x2e9e bytes) 000878 1777911164.020973 punch from 0x0276bf to 0x028d79 (0x16bb bytes) 000879 1777911164.031938 trunc from 0x01134a to 0x016468 (0x511f bytes) 000880 1777911164.040972 mapwrite 0x0220c2 thru 0x026dac (0x4ceb bytes) 000881 1777911164.083804 trunc from 0x0395e2 to 0x019b53 (0x1fa8e bytes) 000882 1777911164.107148 mapwrite 0x035eb1 thru 0x03ffff (0xa14f bytes) 000883 1777911164.165987 punch from 0x015e17 to 0x017fa1 (0x218b bytes) 000884 1777911164.171486 write 0x02b17d thru 0x03046e (0x52f2 bytes) 000885 1777911164.180603 mapwrite 0x039de5 thru 0x03ffff (0x621b bytes) 000886 1777911164.210186 punch from 0x01a8bc to 0x01dc23 (0x3368 bytes) 000887 1777911164.217648 write 0x0035ab thru 0x004c64 (0x16ba bytes) 000888 1777911164.226482 mapread 0x038cd6 thru 0x03ffff (0x732a bytes) 000889 1777911164.228084 read 0x0029ad thru 0x00b2ef (0x8943 bytes) 000890 1777911164.228923 write 0x0122f0 thru 0x021be3 (0xf8f4 bytes) 000892 1777911164.237351 trunc from 0x0196a2 to 0x027708 (0xe067 bytes) 000894 1777911164.254460 mapread 0x029ca0 thru 0x038633 (0xe994 bytes) 000895 1777911164.256972 write 0x013a17 thru 0x021092 (0xd67c bytes) 000896 1777911164.266251 mapread 0x007749 thru 0x012d16 (0xb5ce bytes) 000897 1777911164.267840 write 0x03cdc9 thru 0x03edbf (0x1ff7 bytes) 000898 1777911164.269337 mapwrite 0x0206c6 thru 0x023e0c (0x3747 bytes) 000899 1777911164.308202 read 0x0397e4 thru 0x03ffff (0x681c bytes) 000900 1777911164.309290 mapwrite 0x03aa58 thru 0x03ffff (0x55a8 bytes) 000901 1777911164.326499 punch from 0x025605 to 0x034624 (0xf020 bytes) 000902 1777911164.349293 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 29: 0x901526eb (stale) Mirror 30: 0xbbafeb47 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 29: 0x901526eb (stale) Mirror 30: 0xbbafeb47 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000903 1777911164.640426 read 0x01959d thru 0x0266a3 (0xd107 bytes) 000904 1777911164.656796 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 30: 0xbbafeb47 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 30: 0xbbafeb47 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000905 1777911164.995672 mapread 0x027423 thru 0x033d26 (0xc904 bytes) 000906 1777911165.025779 trunc from 0x0023c5 to 0x005700 (0x333c bytes) 000907 1777911165.031655 write 0x03c34d thru 0x03ffff (0x3cb3 bytes) 000908 1777911165.050875 read 0x03c963 thru 0x03e480 (0x1b1e bytes) 000909 1777911165.051841 mapwrite 0x03c2ed thru 0x03dd09 (0x1a1d bytes) 000910 1777911165.073901 mapread 0x012170 thru 0x01b43b (0x92cc bytes) 000911 1777911165.101557 mapwrite 0x00a649 thru 0x011dd3 (0x778b bytes) 000912 1777911165.129786 trunc from 0x0345f3 to 0x03e909 (0xa317 bytes) 000913 1777911165.136536 fallocate 0x02c5fa thru 0x035254 (0x8c5b bytes) 000914 1777911165.151526 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 30: 0xbbafeb47 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1cf0c966 Mirror 31: 0x1cf0c966 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000915 1777911165.919453 punch from 0x02839b to 0x02881c (0x482 bytes) 000916 1777911165.975809 punch from 0x030407 to 0x03bf0b (0xbb05 bytes) 000919 1777911165.993615 trunc from 0x02f07e to 0x032d9f (0x3d22 bytes) 000920 1777911166.017424 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 31: 0x1cf0c966 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 31: 0x1cf0c966 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000921 1777911166.295874 trunc from 0x03b92c to 0x03ffff (0x46d4 bytes) 000922 1777911166.302659 write 0x026ce8 thru 0x02fb7c (0x8e95 bytes) 000923 1777911166.317230 write 0x038800 thru 0x03ffff (0x7800 bytes) 000925 1777911166.330651 trunc from 0x040000 to 0x003a30 (0x3c5cf bytes) 000926 1777911166.387095 mapwrite 0x01aa59 thru 0x02011c (0x56c4 bytes) 000927 1777911166.446228 mapwrite 0x02666f thru 0x0321fd (0xbb8f bytes) 000928 1777911166.500893 mapread 0x00d4c3 thru 0x015537 (0x8075 bytes) 000929 1777911166.512422 trunc from 0x026a0e to 0x0321fd (0xb7f0 bytes) 000930 1777911166.521756 trunc from 0x018aa2 to 0x0232a2 (0xa801 bytes) 000931 1777911166.534519 trunc from 0x0321fe to 0x003488 (0x2ed75 bytes) 000932 1777911166.553781 punch from 0x001fd5 to 0x003488 (0x14b4 bytes) 000933 1777911166.561642 mapwrite 0x005c65 thru 0x0131de (0xd57a bytes) 000934 1777911166.637674 punch from 0x00262d to 0x00bf19 (0x98ed bytes) 000935 1777911166.655901 mapread 0x00a74e thru 0x00ae26 (0x6d9 bytes) 000937 1777911166.684683 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) 000939 1777911166.811291 mapread 0x00bf8a thru 0x0131de (0x7255 bytes) 000941 1777911166.829788 read 0x004838 thru 0x0131de (0xe9a7 bytes) 000943 1777911166.836401 mapread 0x01016d thru 0x0131de (0x3072 bytes) 000944 1777911166.837439 read 0x00816d thru 0x011c38 (0x9acc bytes) 000945 1777911166.838482 trunc from 0x006d46 to 0x00dfd2 (0x728d bytes) 000946 1777911166.844360 read 0x001a2e thru 0x002a39 (0x100c bytes) 000947 1777911166.856094 mapread 0x00f6f6 thru 0x0131de (0x3ae9 bytes) 000948 1777911166.857290 fallocate 0x019686 thru 0x01efc9 (0x5944 bytes) 000949 1777911166.871833 MIRROR_EXTEND to 2 mirrors 000950 1777911167.440471 mapread 0x001615 thru 0x0027d0 (0x11bc bytes) 000952 1777911167.451369 trunc from 0x00b101 to 0x018d98 (0xdc98 bytes) 000953 1777911167.480201 trunc from 0x015589 to 0x01efc9 (0x9a41 bytes) 000954 1777911167.483029 mapwrite 0x017451 thru 0x01b112 (0x3cc2 bytes) 000955 1777911167.513616 mapread 0x00fcd1 thru 0x019aee (0x9e1e bytes) 000956 1777911167.528401 trunc from 0x01efca to 0x02c368 (0xd39f bytes) 000957 1777911167.555756 mapwrite 0x032d0e thru 0x0385eb (0x58de bytes) 000958 1777911167.618902 punch from 0x018f62 to 0x01af52 (0x1ff1 bytes) 000960 1777911167.627393 mapread 0x00b01a thru 0x00c15b (0x1142 bytes) 000961 1777911167.629032 mapread 0x024527 thru 0x0311ed (0xccc7 bytes) 000962 1777911167.643515 MIRROR_RESYNC 2 mirrors 000963 1777911168.165320 read 0x012178 thru 0x016bd2 (0x4a5b bytes) 000964 1777911168.181880 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) 000965 1777911168.311749 write 0x029324 thru 0x036400 (0xd0dd bytes) 000966 1777911168.331093 fallocate 0x03cb1e thru 0x03d804 (0xce7 bytes) 000967 1777911168.336505 read 0x016eef thru 0x024969 (0xda7b bytes) 000968 1777911168.345277 fallocate 0x003411 thru 0x00c24f (0x8e3f bytes) 000969 1777911168.352192 write 0x03f474 thru 0x03ffff (0xb8c bytes) 000970 1777911168.358399 MIRROR_EXTEND to 2 mirrors 000971 1777911169.012953 trunc from 0x02cfc6 to 0x036b71 (0x9bac bytes) 000972 1777911169.049779 fallocate 0x02b1e8 thru 0x03a849 (0xf662 bytes) 000973 1777911169.065105 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe4d1dd2b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x995f379f Mirror 3: 0x995f379f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000974 1777911169.869738 trunc from 0x0172fc to 0x023bfd (0xc902 bytes) 000975 1777911169.917048 mapwrite 0x01edcf thru 0x022dbc (0x3fee bytes) 000976 1777911169.976067 trunc from 0x040000 to 0x03097c (0xf683 bytes) 000977 1777911169.997071 mapread 0x0122a8 thru 0x01f48e (0xd1e7 bytes) 000978 1777911170.010455 mapwrite 0x01fb04 thru 0x02c460 (0xc95d bytes) 000979 1777911170.048734 trunc from 0x03097d to 0x03c155 (0xb7d9 bytes) 000980 1777911170.078136 read 0x015739 thru 0x01888b (0x3153 bytes) 000981 1777911170.078935 fallocate 0x021962 thru 0x02d3e1 (0xba80 bytes) 000982 1777911170.083423 mapwrite 0x016dc5 thru 0x021dfc (0xb038 bytes) 000983 1777911170.101981 read 0x000092 thru 0x00b69d (0xb60c bytes) 000984 1777911170.113886 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3c156): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c156): Mirror 2: 0x54b18e7 (stale) Mirror 3: 0x5ade3e5b (stale) CRC-32 checksum value for chunk [0, 0x3c156): Mirror 1: 0x75a8eec7 Mirror 4: 0x75a8eec7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c156: skipped 000985 1777911170.859971 trunc from 0x03c156 to 0x02fbf4 (0xc561 bytes) 000986 1777911170.923488 fallocate 0x00f214 thru 0x011f2c (0x2d19 bytes) 000987 1777911170.941458 MIRROR_RESYNC 4 mirrors 000988 1777911171.753645 MIRROR_RESYNC 4 mirrors 000989 1777911172.143664 mapread 0x015979 thru 0x01b3a1 (0x5a29 bytes) 000990 1777911172.166369 punch from 0x014e6c to 0x0150e2 (0x277 bytes) 000991 1777911172.197764 trunc from 0x02fbf5 to 0x01778d (0x18467 bytes) 000992 1777911172.224894 mapread 0x013b40 thru 0x01778d (0x3c4e bytes) 000993 1777911172.232672 trunc from 0x01778e to 0x02b090 (0x13903 bytes) 000994 1777911172.255334 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x22a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b091): Mirror 2: 0xacf430c7 (stale) Mirror 3: 0xacf430c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b091): Mirror 2: 0xacf430c7 (stale) Mirror 3: 0xacf430c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b091: skipped 000995 1777911172.496309 punch from 0x0296e0 to 0x02b090 (0x19b1 bytes) 000996 1777911172.509244 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2b091): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b091): Mirror 2: 0xacf430c7 (stale) Mirror 3: 0xacf430c7 (stale) CRC-32 checksum value for chunk [0, 0x2b091): Mirror 1: 0x5018296d Mirror 4: 0x5018296d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b091: skipped 000997 1777911173.299327 read 0x018b2b thru 0x02007c (0x7552 bytes) 000998 1777911173.318484 trunc from 0x00fe57 to 0x01827a (0x8424 bytes) 000999 1777911173.350071 punch from 0x010e51 to 0x01a1f6 (0x93a6 bytes) 001000 1777911173.355199 trunc from 0x013e33 to 0x020a1e (0xcbec bytes) All operations completed A-OK!