== sanity-flr test 70a: flr mode fsx test ================ 07:18:30 (1787829510) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 9512 skipping zero length punch hole skipping zero length punch hole 000004 1787829512.990402 MIRROR_EXTEND to 2 mirrors skipping zero size read truncating to largest ever: 0x167f4 000006 1787829513.521117 trunc from 00000000 to 0x0167f3 (0x167f4 bytes) 000007 1787829513.578202 MIRROR_RESYNC 2 mirrors 000008 1787829514.307388 read 0x000137 thru 0x005432 (0x52fc bytes) 000009 1787829514.328980 write 0x017507 thru 0x019d8a (0x2884 bytes) 000010 1787829514.386804 fallocate 0x00eefc thru 0x015df1 (0x6ef6 bytes) 000012 1787829514.396341 fallocate 0x009bca thru 0x0113cb (0x7802 bytes) 000013 1787829514.411659 punch from 0x0020e8 to 0x00945c (0x7375 bytes) 000014 1787829514.418651 write 0x024f48 thru 0x028ad4 (0x3b8d bytes) fallocating to largest ever: 0x174dd 000015 1787829514.419901 fallocate 0x00fbe4 thru 0x0174dc (0x78f9 bytes) 000017 1787829514.432283 punch from 0x013eaa to 0x02012e (0xc285 bytes) 000018 1787829514.471796 write 0x02ed1e thru 0x031d2b (0x300e bytes) fallocating to largest ever: 0x3e343 000019 1787829514.473076 fallocate 0x03e01d thru 0x03e342 (0x326 bytes) 000020 1787829514.481271 mapread 0x01d874 thru 0x02a3c3 (0xcb50 bytes) 000021 1787829514.568989 mapwrite 0x02d07f thru 0x039e8b (0xce0d bytes) 000022 1787829514.631613 mapread 0x00712e thru 0x01362b (0xc4fe bytes) 000023 1787829514.679901 trunc from 0x03e343 to 0x03beb6 (0x248c bytes) 000024 1787829514.731323 write 0x00a96f thru 0x00de1a (0x34ac bytes) 000026 1787829514.734167 punch from 0x033ca8 to 0x03beb6 (0x820f bytes) 000027 1787829514.766681 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3beb7): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3beb7): Mirror 2: 0x5d9498de (stale) CRC-32 checksum value for chunk [0, 0x3beb7): Mirror 1: 0xa0e56071 Mirror 3: 0xa0e56071 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3beb7: skipped 000028 1787829515.938441 trunc from 0x0039f2 to 0x009a84 (0x6093 bytes) 000029 1787829516.002298 fallocate 0x01c315 thru 0x026dcb (0xaab7 bytes) 000030 1787829516.011357 trunc from 0x025a2f to 0x03504b (0xf61d bytes) 000031 1787829516.017111 punch from 0x0040f1 to 0x00fd7f (0xbc8f bytes) 000032 1787829516.023093 mapread 0x01e86e thru 0x02bbf7 (0xd38a bytes) 000033 1787829516.060739 write 0x01c76d thru 0x02248b (0x5d1f bytes) 000034 1787829516.066635 trunc from 0x0248a9 to 0x032b98 (0xe2f0 bytes) 000035 1787829516.075205 mapread 0x032f00 thru 0x0353a3 (0x24a4 bytes) 000036 1787829516.097363 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3beb7): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3beb7): Mirror 2: 0x5d9498de (stale) Mirror 3: 0xa0e56071 (stale) CRC-32 checksum value for chunk [0, 0x3beb7): Mirror 1: 0xab8ba74 Mirror 4: 0xab8ba74 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3beb7: skipped 000037 1787829517.185316 trunc from 0x00edbd to 0x01df62 (0xf1a6 bytes) 000039 1787829517.231284 trunc from 0x003a88 to 0x010dd5 (0xd34e bytes) 000040 1787829517.236874 mapwrite 0x001c18 thru 0x00f931 (0xdd1a bytes) 000041 1787829517.280115 fallocate 0x00bfbb thru 0x01b7fc (0xf842 bytes) 000042 1787829517.285538 read 0x00f39d thru 0x01c6f1 (0xd355 bytes) 000043 1787829517.296135 trunc from 0x03beb7 to 0x0027ed (0x396c9 bytes) 000044 1787829517.356643 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x27ee): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27ee): Mirror 2: 0x12414592 (stale) Mirror 3: 0x12414592 (stale) Mirror 4: 0x12414592 (stale) CRC-32 checksum value for chunk [0, 0x27ee): Mirror 1: 0x87907897 Mirror 5: 0x87907897 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27ee: skipped 000045 1787829518.368796 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27ee): Mirror 3: 0x12414592 (stale) Mirror 4: 0x12414592 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27ee): Mirror 3: 0x12414592 (stale) Mirror 4: 0x12414592 (stale) CRC-32 checksum value for chunk [0, 0x27ee): Mirror 1: 0x87907897 Mirror 5: 0x87907897 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27ee: skipped 000046 1787829518.952698 fallocate 0x018443 thru 0x0256cc (0xd28a bytes) 000047 1787829519.013731 fallocate 0x004b32 thru 0x00c9d3 (0x7ea2 bytes) 000048 1787829519.020276 write 0x0272db thru 0x02dd5a (0x6a80 bytes) 000049 1787829519.027692 read 0x01c7b2 thru 0x01c9da (0x229 bytes) 000050 1787829519.033740 trunc from 0x00feed to 0x015129 (0x523d bytes) 000051 1787829519.040469 read 0x007023 thru 0x011398 (0xa376 bytes) 000052 1787829519.081728 trunc from 0x02992b to 0x02dd5a (0x4430 bytes) 000053 1787829519.102933 write 0x01ecd5 thru 0x02ce33 (0xe15f bytes) 000054 1787829519.117004 trunc from 0x0019ec to 0x00846b (0x6a80 bytes) 000055 1787829519.133372 mapread 0x02acbb thru 0x02dd5a (0x30a0 bytes) 000056 1787829519.142702 punch from 0x02816e to 0x02cd2c (0x4bbf bytes) 000058 1787829519.166786 punch from 0x027b80 to 0x02b8c8 (0x3d49 bytes) 000059 1787829519.174617 write 0x02888b thru 0x02d754 (0x4eca bytes) fallocating to largest ever: 0x40000 000060 1787829519.181184 fallocate 0x03c263 thru 0x03ffff (0x3d9d bytes) 000061 1787829519.190696 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf6c3932e (stale) Mirror 5: 0xbc40821a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf6c3932e (stale) Mirror 5: 0xbc40821a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000062 1787829519.666174 punch from 0x00eff3 to 0x0115a6 (0x25b4 bytes) 000064 1787829519.672279 trunc from 0x040000 to 0x033a47 (0xc5b8 bytes) 000065 1787829519.730151 mapwrite 0x03110e thru 0x03317f (0x2072 bytes) 000066 1787829519.776453 punch from 0x02e8e7 to 0x033a47 (0x5161 bytes) 000067 1787829519.781979 mapwrite 0x005f7e thru 0x0136da (0xd75d bytes) 000068 1787829519.823705 fallocate 0x03f8e9 thru 0x03ffff (0x717 bytes) 000069 1787829519.830268 fallocate 0x00d29c thru 0x014fef (0x7d54 bytes) 000070 1787829519.835788 punch from 0x02e0f3 to 0x033a47 (0x5955 bytes) 000071 1787829519.843691 mapwrite 0x014743 thru 0x016fd9 (0x2897 bytes) 000072 1787829519.862108 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x33a48): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33a48): Mirror 4: 0x9016323e (stale) Mirror 5: 0xdad7a048 (stale) CRC-32 checksum value for chunk [0, 0x33a48): Mirror 1: 0xd4e58ef5 Mirror 6: 0xd4e58ef5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33a48: skipped 000073 1787829521.094498 fallocate 0x03d641 thru 0x03ffff (0x29bf bytes) 000074 1787829521.166011 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbc40821a (stale) Mirror 6: 0x5693ebb3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbc40821a (stale) Mirror 6: 0x5693ebb3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000075 1787829521.513828 read 0x0113da thru 0x01281e (0x1445 bytes) 000076 1787829521.524670 read 0x0311da thru 0x036390 (0x51b7 bytes) 000077 1787829521.546860 mapread 0x026a33 thru 0x02f2f7 (0x88c5 bytes) 000078 1787829521.547899 mapread 0x001b70 thru 0x004a0e (0x2e9f bytes) 000079 1787829521.562225 MIRROR_RESYNC 3 mirrors 000080 1787829522.831682 fallocate 0x034fa6 thru 0x03ffff (0xb05a bytes) 000081 1787829522.902155 mapwrite 0x03aa45 thru 0x03ffff (0x55bb bytes) 000082 1787829522.961685 trunc from 0x026a97 to 0x02724b (0x7b5 bytes) 000083 1787829522.975623 trunc from 0x0320a5 to 0x037980 (0x58dc bytes) 000084 1787829522.988595 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5693ebb3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x5693ebb3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000085 1787829523.358231 trunc from 0x040000 to 0x000bde (0x3f421 bytes) 000087 1787829523.397727 MIRROR_RESYNC 2 mirrors 000088 1787829524.169177 mapread 0x0005a0 thru 0x000bde (0x63f bytes) 000089 1787829524.177517 punch from 0x000455 to 0x000bde (0x78a bytes) 000090 1787829524.224595 trunc from 0x000bdf to 0x00d9b6 (0xcdd8 bytes) 000091 1787829524.246048 trunc from 0x002989 to 0x00d9b6 (0xb02e bytes) 000092 1787829524.255026 fallocate 0x0220f0 thru 0x025daa (0x3cbb bytes) 000093 1787829524.273396 punch from 0x00f01c to 0x018259 (0x923e bytes) 000094 1787829524.293071 write 0x007c60 thru 0x00ef44 (0x72e5 bytes) 000096 1787829524.309396 write 0x01ce5a thru 0x0290a7 (0xc24e bytes) 000097 1787829524.317679 mapread 0x00fde6 thru 0x011d86 (0x1fa1 bytes) 000098 1787829524.343140 trunc from 0x00745c to 0x00ea48 (0x75ed bytes) 000100 1787829524.362281 mapread 0x01ea70 thru 0x01efef (0x580 bytes) 000101 1787829524.363811 trunc from 0x01813c to 0x0213b1 (0x9276 bytes) 000102 1787829524.371434 fallocate 0x01f104 thru 0x02808d (0x8f8a bytes) 000103 1787829524.389955 MIRROR_RESYNC 2 mirrors 000106 1787829525.192433 write 0x0100d2 thru 0x01e8fd (0xe82c bytes) 000107 1787829525.230687 write 0x038468 thru 0x03e36c (0x5f05 bytes) 000108 1787829525.232139 fallocate 0x01d234 thru 0x029fbf (0xcd8c bytes) 000109 1787829525.237734 read 0x0128a1 thru 0x01e547 (0xbca7 bytes) 000110 1787829525.238695 mapread 0x03917e thru 0x03e36c (0x51ef bytes) 000111 1787829525.239830 write 0x033515 thru 0x039c19 (0x6705 bytes) 000112 1787829525.245275 fallocate 0x005a99 thru 0x01349c (0xda04 bytes) 000113 1787829525.250704 fallocate 0x0302d3 thru 0x0389f4 (0x8722 bytes) 000114 1787829525.256627 trunc from 0x03e36d to 0x00d890 (0x30adc bytes) 000115 1787829525.298715 write 0x02cfa3 thru 0x03541d (0x847b bytes) 000116 1787829525.302040 punch from 0x035102 to 0x03541d (0x31c bytes) 000117 1787829525.325301 mapread 0x0185d1 thru 0x02654e (0xdf7e bytes) 000118 1787829525.386950 MIRROR_RESYNC 2 mirrors 000119 1787829526.157990 fallocate 0x03fa1e thru 0x03ffff (0x5e2 bytes) 000120 1787829526.206068 write 0x002a02 thru 0x00f987 (0xcf86 bytes) 000121 1787829526.217986 mapread 0x0368c5 thru 0x03ffff (0x973b bytes) 000122 1787829526.240738 read 0x02acd3 thru 0x03468d (0x99bb bytes) 000123 1787829526.251376 trunc from 0x040000 to 0x0307ce (0xf831 bytes) 000124 1787829526.299414 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) 000125 1787829526.517879 trunc from 0x00ca2e to 0x01c5e4 (0xfbb7 bytes) 000126 1787829526.534165 trunc from 0x010010 to 0x0113b9 (0x13aa bytes) 000127 1787829526.539445 trunc from 0x01a527 to 0x01c614 (0x20ee bytes) 000128 1787829526.553536 fallocate 0x009b82 thru 0x011151 (0x75d0 bytes) 000129 1787829526.566329 mapwrite 0x018ed2 thru 0x01f419 (0x6548 bytes) 000130 1787829526.654023 write 0x015e83 thru 0x01947c (0x35fa bytes) 000131 1787829526.673842 mapwrite 0x01bf3f thru 0x027eeb (0xbfad bytes) 000132 1787829526.720942 write 0x03a3f7 thru 0x03afc2 (0xbcc bytes) 000133 1787829526.721887 mapwrite 0x010dba thru 0x018ab9 (0x7d00 bytes) 000136 1787829526.751438 read 0x027d15 thru 0x02e121 (0x640d bytes) 000137 1787829526.757735 trunc from 0x03afc3 to 0x00d3de (0x2dbe4 bytes) 000138 1787829526.773248 mapwrite 0x01c1d1 thru 0x028bbe (0xc9ee bytes) 000139 1787829526.867916 mapread 0x01e09c thru 0x028bbe (0xab23 bytes) 000141 1787829526.871272 trunc from 0x028bbf to 0x026f53 (0x1c6b bytes) 000144 1787829526.902888 MIRROR_EXTEND to 2 mirrors 000145 1787829527.586704 read 0x0127cd thru 0x01f8df (0xd113 bytes) 000146 1787829527.595556 trunc from 0x026f54 to 0x03c50c (0x155b9 bytes) 000147 1787829527.643983 mapwrite 0x003126 thru 0x008c83 (0x5b5e bytes) 000148 1787829527.700973 MIRROR_RESYNC 2 mirrors 000149 1787829528.546901 write 0x019dcc thru 0x0257f5 (0xba2a bytes) 000150 1787829528.606384 mapread 0x00bf34 thru 0x010297 (0x4364 bytes) 000151 1787829528.645999 punch from 0x02a2df to 0x034bf3 (0xa915 bytes) 000152 1787829528.654985 mapwrite 0x026c4c thru 0x032c01 (0xbfb6 bytes) 000153 1787829528.719911 read 0x00e27c thru 0x014679 (0x63fe bytes) 000154 1787829528.722611 mapwrite 0x03fb4a thru 0x03ffff (0x4b6 bytes) 000155 1787829528.770870 mapread 0x02eb71 thru 0x0398b7 (0xad47 bytes) 000156 1787829528.773871 mapwrite 0x034d8a thru 0x03540e (0x685 bytes) 000157 1787829528.794852 write 0x004a48 thru 0x0125f5 (0xdbae bytes) 000158 1787829528.802303 punch from 0x03fe99 to 0x03ffff (0x167 bytes) 000159 1787829528.824293 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3e0b0def (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd3d690c2 Mirror 3: 0xd3d690c2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000160 1787829529.844910 mapwrite 0x00677e thru 0x00fdd1 (0x9654 bytes) 000161 1787829529.979073 read 0x003581 thru 0x00fd79 (0xc7f9 bytes) 000162 1787829529.981026 write 0x00cf4e thru 0x00d25d (0x310 bytes) 000163 1787829529.991941 read 0x00676f thru 0x013b13 (0xd3a5 bytes) 000164 1787829530.012935 punch from 0x00f146 to 0x016dc1 (0x7c7c bytes) 000165 1787829530.022066 write 0x002d24 thru 0x0065a9 (0x3886 bytes) 000166 1787829530.024979 trunc from 0x040000 to 0x03e4cb (0x1b34 bytes) 000167 1787829530.086603 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e4cc): Mirror 3: 0xd1e98646 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e4cc): Mirror 3: 0xd1e98646 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e4cc: skipped 000170 1787829530.580756 trunc from 0x03e4cc to 0x020e36 (0x1d695 bytes) 000171 1787829530.610369 fallocate 0x02a7be thru 0x034244 (0x9a87 bytes) 000172 1787829530.616411 mapread 0x002133 thru 0x007722 (0x55f0 bytes) 000173 1787829530.640550 mapwrite 0x02225b thru 0x0226dc (0x482 bytes) 000174 1787829530.687554 mapread 0x01e9ce thru 0x01f155 (0x788 bytes) 000175 1787829530.688431 mapread 0x017532 thru 0x02176d (0xa23c bytes) 000176 1787829530.710037 mapread 0x004512 thru 0x007c23 (0x3712 bytes) 000177 1787829530.711141 mapread 0x016f0a thru 0x0226dc (0xb7d3 bytes) 000178 1787829530.712941 trunc from 0x014c00 to 0x0225d3 (0xd9d4 bytes) 000180 1787829530.726262 punch from 0x015fd5 to 0x01d369 (0x7395 bytes) 000182 1787829530.743829 trunc from 0x0168db to 0x0226dc (0xbe02 bytes) 000183 1787829530.753835 fallocate 0x031b2a thru 0x03ffff (0xe4d6 bytes) 000184 1787829530.762138 mapwrite 0x03de42 thru 0x03ffff (0x21be bytes) 000185 1787829530.829408 punch from 0x03c4da to 0x03ffff (0x3b26 bytes) 000186 1787829530.835993 mapread 0x037a96 thru 0x03ffff (0x856a bytes) 000187 1787829530.846613 trunc from 0x040000 to 0x02157b (0x1ea84 bytes) 000188 1787829530.869033 trunc from 0x02157c to 0x02c400 (0xae85 bytes) 000189 1787829530.894361 MIRROR_RESYNC 2 mirrors 000190 1787829531.696109 mapread 0x006fbe thru 0x0097bb (0x27fe bytes) 000191 1787829531.749916 trunc from 0x02c401 to 0x00033a (0x2c0c6 bytes) 000192 1787829531.818288 mapwrite 0x027025 thru 0x0302c7 (0x92a3 bytes) 000193 1787829531.904348 mapread 0x018f2e thru 0x027a9d (0xeb70 bytes) 000195 1787829531.916671 trunc from 0x01be93 to 0x01f03f (0x31ad bytes) 000196 1787829531.921409 mapread 0x01f0ae thru 0x023bea (0x4b3d bytes) 000197 1787829531.959157 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) 000198 1787829532.230196 mapread 0x02fce1 thru 0x0302c7 (0x5e7 bytes) 000199 1787829532.244623 trunc from 0x02f56c to 0x0302c7 (0xd5c bytes) 000200 1787829532.251760 mapread 0x008aac thru 0x016b0d (0xe062 bytes) 000201 1787829532.273978 mapwrite 0x03a237 thru 0x03f6cd (0x5497 bytes) 000202 1787829532.345253 write 0x006aaa thru 0x00a8a5 (0x3dfc bytes) 000203 1787829532.348053 punch from 0x0327f1 to 0x039c1e (0x742e bytes) 000204 1787829532.370080 MIRROR_EXTEND to 2 mirrors 000206 1787829533.197371 mapread 0x00cf05 thru 0x012e0d (0x5f09 bytes) 000208 1787829533.222662 punch from 0x00a488 to 0x00b85e (0x13d7 bytes) 000209 1787829533.264982 mapwrite 0x021530 thru 0x025204 (0x3cd5 bytes) 000210 1787829533.300449 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3f6ce): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f6ce): Mirror 2: 0x6449ff21 (stale) CRC-32 checksum value for chunk [0, 0x3f6ce): Mirror 1: 0x754a3115 Mirror 3: 0x754a3115 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f6ce: skipped 000211 1787829534.105885 write 0x015d7a thru 0x016ad8 (0xd5f bytes) 000212 1787829534.166156 write 0x01e05c thru 0x02ba79 (0xda1e bytes) 000213 1787829534.181826 trunc from 0x03a3b5 to 0x03f6cd (0x5319 bytes) 000214 1787829534.187821 mapwrite 0x03c298 thru 0x03ffff (0x3d68 bytes) 000215 1787829534.274829 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8d6ac37d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8d6ac37d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000216 1787829534.799532 fallocate 0x0363eb thru 0x03ffff (0x9c15 bytes) 000217 1787829534.804122 fallocate 0x004a16 thru 0x007ba4 (0x318f bytes) 000218 1787829534.812447 trunc from 0x040000 to 0x01677d (0x29882 bytes) 000219 1787829534.848403 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) 000220 1787829535.082436 MIRROR_EXTEND to 2 mirrors 000221 1787829535.882329 trunc from 0x01677e to 0x036f7c (0x207ff bytes) 000224 1787829535.977935 write 0x036131 thru 0x037342 (0x1212 bytes) 000225 1787829535.984427 mapread 0x03177c thru 0x037342 (0x5bc7 bytes) 000226 1787829536.003835 punch from 0x004ccb to 0x00fe71 (0xb1a7 bytes) 000227 1787829536.008805 write 0x001b30 thru 0x010856 (0xed27 bytes) 000228 1787829536.021946 punch from 0x02e43c to 0x031544 (0x3109 bytes) 000229 1787829536.027818 write 0x014832 thru 0x017b99 (0x3368 bytes) 000230 1787829536.039929 punch from 0x012385 to 0x0180fb (0x5d77 bytes) 000231 1787829536.057614 read 0x002b8d thru 0x005d68 (0x31dc bytes) 000233 1787829536.059011 punch from 0x019847 to 0x021593 (0x7d4d bytes) 000234 1787829536.069530 trunc from 0x0285f2 to 0x02da5e (0x546d bytes) 000235 1787829536.077542 punch from 0x003837 to 0x013108 (0xf8d2 bytes) 000236 1787829536.083919 trunc from 0x037343 to 0x0095a1 (0x2dda1 bytes) 000237 1787829536.109315 mapwrite 0x0395e5 thru 0x03ffff (0x6a1b bytes) 000238 1787829536.161105 mapread 0x00da6f thru 0x013d46 (0x62d8 bytes) 000239 1787829536.181278 mapread 0x01ab66 thru 0x0229f1 (0x7e8c bytes) 000240 1787829536.194368 trunc from 0x01e8dd to 0x028b2b (0xa24f bytes) 000241 1787829536.200637 trunc from 0x040000 to 0x01ccc2 (0x2333d bytes) 000242 1787829536.230216 read 0x01047c thru 0x011bdb (0x1760 bytes) 000243 1787829536.231759 mapread 0x007c90 thru 0x013254 (0xb5c5 bytes) 000244 1787829536.234283 punch from 0x012d3b to 0x012f62 (0x228 bytes) 000245 1787829536.241410 mapread 0x00a302 thru 0x012228 (0x7f27 bytes) 000246 1787829536.254632 mapread 0x019ce2 thru 0x01ccc2 (0x2fe1 bytes) 000247 1787829536.255953 trunc from 0x01ccc3 to 0x014cb8 (0x800a bytes) 000248 1787829536.279832 trunc from 0x008999 to 0x014cb8 (0xc320 bytes) 000249 1787829536.289358 MIRROR_RESYNC 2 mirrors 000250 1787829536.960636 mapwrite 0x03559a thru 0x03e5e5 (0x904c bytes) 000252 1787829537.182205 trunc from 0x03e5e6 to 0x01acb9 (0x2392c bytes) 000253 1787829537.228104 write 0x026697 thru 0x028d26 (0x2690 bytes) 000254 1787829537.237098 fallocate 0x03bda3 thru 0x03ffff (0x425d bytes) 000255 1787829537.251568 punch from 0x00d73e to 0x01c027 (0xe8ea bytes) 000256 1787829537.259741 trunc from 0x040000 to 0x000cfa (0x3f305 bytes) 000257 1787829537.300123 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) 000259 1787829537.479915 punch from 0x0000a7 to 0x000cfa (0xc54 bytes) 000260 1787829537.485790 write 0x02fdc3 thru 0x03ba77 (0xbcb5 bytes) 000261 1787829537.498959 trunc from 0x03ba78 to 0x01ae9f (0x20bd8 bytes) 000262 1787829537.520922 read 0x00fbcc thru 0x01ae9f (0xb2d4 bytes) 000263 1787829537.529818 trunc from 0x004ca4 to 0x006873 (0x1bd0 bytes) 000264 1787829537.541324 trunc from 0x00bc49 to 0x017fc4 (0xc37c bytes) 000265 1787829537.548425 fallocate 0x01f36b thru 0x02193a (0x25d0 bytes) 000267 1787829537.556806 mapread 0x00794d thru 0x015bd0 (0xe284 bytes) 000268 1787829537.590762 trunc from 0x02193b to 0x014f08 (0xca32 bytes) 000269 1787829537.617670 punch from 0x00cadc to 0x012512 (0x5a37 bytes) 000270 1787829537.625373 trunc from 0x009466 to 0x00afea (0x1b85 bytes) 000271 1787829537.647968 punch from 0x00cc61 to 0x014f08 (0x82a8 bytes) 000273 1787829537.663765 write 0x023036 thru 0x028456 (0x5421 bytes) 000274 1787829537.671512 trunc from 0x01e308 to 0x021bbf (0x38b8 bytes) 000275 1787829537.679846 fallocate 0x006b6d thru 0x00a703 (0x3b97 bytes) 000276 1787829537.691128 trunc from 0x028457 to 0x0263fe (0x2058 bytes) 000277 1787829537.715671 mapwrite 0x01246b thru 0x018678 (0x620e bytes) 000279 1787829537.795182 mapwrite 0x01da9f thru 0x02b8c8 (0xde2a bytes) 000280 1787829537.876427 trunc from 0x00dbd1 to 0x0101ba (0x25ea bytes) 000281 1787829537.883546 trunc from 0x00c92f to 0x0119ae (0x5080 bytes) 000282 1787829537.889706 mapwrite 0x00c6d3 thru 0x016096 (0x99c4 bytes) 000284 1787829537.927785 MIRROR_EXTEND to 2 mirrors 000285 1787829538.801414 write 0x02e00d thru 0x03b29e (0xd292 bytes) 000286 1787829538.849364 MIRROR_RESYNC 2 mirrors 000287 1787829539.690344 fallocate 0x0161ac thru 0x024f82 (0xedd7 bytes) 000288 1787829539.726239 punch from 0x00dbcd to 0x010d52 (0x3186 bytes) 000289 1787829539.732236 trunc from 0x03b29f to 0x017021 (0x2427d bytes) 000290 1787829539.755388 read 0x007c86 thru 0x00e24c (0x65c7 bytes) 000291 1787829539.766272 mapwrite 0x018005 thru 0x01d48d (0x5489 bytes) 000292 1787829539.844564 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1d48e): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d48e): Mirror 2: 0xd74be6cf (stale) CRC-32 checksum value for chunk [0, 0x1d48e): Mirror 1: 0xe2444293 Mirror 3: 0xe2444293 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d48e: skipped 000293 1787829540.781549 fallocate 0x02bb22 thru 0x033372 (0x7851 bytes) 000294 1787829540.881288 read 0x00369d thru 0x00eeeb (0xb84f bytes) 000296 1787829540.896634 write 0x02bcbb thru 0x031e2e (0x6174 bytes) 000297 1787829540.916178 punch from 0x00e6fb to 0x013075 (0x497b bytes) 000298 1787829540.923571 trunc from 0x033373 to 0x032eee (0x484 bytes) 000299 1787829540.950008 trunc from 0x0066bd to 0x0139c5 (0xd309 bytes) 000300 1787829540.956447 mapwrite 0x01a4da thru 0x01ba84 (0x15ab bytes) 000302 1787829540.992370 mapread 0x023426 thru 0x027ed8 (0x4ab3 bytes) 000303 1787829541.005822 write 0x010958 thru 0x01a8a2 (0x9f4b bytes) 000304 1787829541.023032 mapwrite 0x00ff1b thru 0x012663 (0x2749 bytes) 000305 1787829541.084517 mapread 0x024ef1 thru 0x02605c (0x116c bytes) 000306 1787829541.086282 trunc from 0x02c432 to 0x02c7de (0x3ad bytes) 000307 1787829541.093390 fallocate 0x03ddd7 thru 0x03ffff (0x2229 bytes) 000308 1787829541.106963 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32eef): Mirror 2: 0x290a063a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32eef): Mirror 2: 0x290a063a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32eef: skipped 000309 1787829541.582536 mapread 0x005387 thru 0x00bae3 (0x675d bytes) 000310 1787829541.612770 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) 000312 1787829541.765175 write 0x02c981 thru 0x034ead (0x852d bytes) 000314 1787829541.779810 trunc from 0x01f5b1 to 0x02ee64 (0xf8b4 bytes) 000315 1787829541.829348 mapwrite 0x0286de thru 0x030344 (0x7c67 bytes) 000316 1787829541.882415 read 0x034de2 thru 0x034ead (0xcc bytes) 000317 1787829541.898976 MIRROR_EXTEND to 2 mirrors 000318 1787829542.798103 punch from 0x00190c to 0x0036fb (0x1df0 bytes) 000319 1787829542.887739 punch from 0x01130f to 0x013559 (0x224b bytes) 000320 1787829542.898897 write 0x03cc22 thru 0x03ffff (0x33de bytes) 000321 1787829542.916942 fallocate 0x02798e thru 0x036778 (0xedeb bytes) 000322 1787829542.926846 punch from 0x018a3b to 0x02871b (0xfce1 bytes) 000323 1787829542.955436 trunc from 0x040000 to 0x001740 (0x3e8bf bytes) 000324 1787829542.990697 write 0x03531b thru 0x03e250 (0x8f36 bytes) 000325 1787829542.994566 punch from 0x0093d8 to 0x00fdf2 (0x6a1b bytes) 000326 1787829543.000237 fallocate 0x0233a2 thru 0x02fce4 (0xc943 bytes) 000327 1787829543.010436 MIRROR_RESYNC 2 mirrors 000328 1787829543.705780 trunc from 0x03e251 to 0x000dff (0x3d451 bytes) 000329 1787829543.800792 trunc from 0x000e00 to 0x01848c (0x1768d bytes) 000330 1787829543.849634 punch from 0x005cd6 to 0x00f50e (0x9839 bytes) 000331 1787829543.863657 write 0x03e5a1 thru 0x03ffff (0x1a5f bytes) 000332 1787829543.865216 write 0x03482f thru 0x03e15a (0x992c bytes) 000333 1787829543.890319 MIRROR_RESYNC 2 mirrors 000335 1787829544.621155 MIRROR_RESYNC 2 mirrors 000336 1787829545.124936 write 0x019e53 thru 0x01a90d (0xabb bytes) 000337 1787829545.175445 read 0x003dc0 thru 0x004b53 (0xd94 bytes) 000338 1787829545.186055 mapread 0x03f393 thru 0x03ffff (0xc6d bytes) 000339 1787829545.191398 punch from 0x016f5d to 0x02279c (0xb840 bytes) 000340 1787829545.208043 fallocate 0x0183b1 thru 0x020648 (0x8298 bytes) 000341 1787829545.212693 read 0x019956 thru 0x0221bd (0x8868 bytes) 000342 1787829545.227621 trunc from 0x01bfa9 to 0x01dbe9 (0x1c41 bytes) 000343 1787829545.231796 trunc from 0x040000 to 0x00edb2 (0x3124d bytes) 000344 1787829545.249170 trunc from 0x00edb3 to 0x03cadc (0x2dd2a bytes) 000346 1787829545.261911 trunc from 0x01d903 to 0x026a51 (0x914f bytes) 000347 1787829545.269018 mapread 0x007171 thru 0x0123d5 (0xb265 bytes) 000348 1787829545.308135 mapwrite 0x02ca5f thru 0x02cdfb (0x39d bytes) 000349 1787829545.351714 MIRROR_RESYNC 2 mirrors 000350 1787829545.912768 mapread 0x0269bb thru 0x035bf7 (0xf23d bytes) 000351 1787829545.937842 mapwrite 0x038124 thru 0x03ffff (0x7edc bytes) 000352 1787829546.073938 mapread 0x02dd0b thru 0x03d301 (0xf5f7 bytes) 000353 1787829546.088514 mapread 0x0183ff thru 0x0218cc (0x94ce bytes) 000355 1787829546.135247 fallocate 0x039a0f thru 0x03ffff (0x65f1 bytes) 000356 1787829546.145750 MIRROR_RESYNC 2 mirrors 000357 1787829546.963023 write 0x01588f thru 0x020390 (0xab02 bytes) 000358 1787829547.048595 trunc from 0x040000 to 0x003b05 (0x3c4fa bytes) 000359 1787829547.145329 punch from 0x0029d2 to 0x003b05 (0x1134 bytes) 000360 1787829547.152356 punch from 0x002872 to 0x003b05 (0x1294 bytes) 000361 1787829547.162894 fallocate 0x019449 thru 0x0229a3 (0x955b bytes) 000362 1787829547.174615 trunc from 0x003b06 to 0x02887a (0x24d75 bytes) 000363 1787829547.219001 trunc from 0x02887b to 0x037d85 (0xf50b bytes) 000364 1787829547.275579 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x37d86): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37d86): Mirror 2: 0xfb57f242 (stale) CRC-32 checksum value for chunk [0, 0x37d86): Mirror 1: 0xb9d27d96 Mirror 3: 0xb9d27d96 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37d86: skipped 000365 1787829548.542424 mapread 0x027a48 thru 0x02896e (0xf27 bytes) 000366 1787829548.555708 trunc from 0x00755d to 0x00e3c0 (0x6e64 bytes) 000367 1787829548.625101 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37d86): Mirror 2: 0xfb57f242 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37d86): Mirror 2: 0xfb57f242 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37d86: skipped 000368 1787829549.034824 punch from 0x010e33 to 0x012039 (0x1207 bytes) 000369 1787829549.043581 read 0x01e513 thru 0x02a6df (0xc1cd bytes) 000370 1787829549.073041 trunc from 0x037d86 to 0x013144 (0x24c41 bytes) 000371 1787829549.111054 MIRROR_RESYNC 2 mirrors 000372 1787829549.677948 mapread 0x002ded thru 0x00686c (0x3a80 bytes) 000373 1787829549.720693 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) 000374 1787829549.952645 trunc from 0x0087e3 to 0x0129f5 (0xa213 bytes) 000375 1787829549.989638 punch from 0x00f9f2 to 0x013144 (0x3753 bytes) 000377 1787829550.006041 mapwrite 0x01576a thru 0x025259 (0xfaf0 bytes) 000378 1787829550.125262 trunc from 0x02525a to 0x029777 (0x451e bytes) 000379 1787829550.143892 trunc from 0x028fe2 to 0x029777 (0x796 bytes) 000380 1787829550.155936 punch from 0x0188d1 to 0x01a1f4 (0x1924 bytes) 000381 1787829550.164635 fallocate 0x02b888 thru 0x03b739 (0xfeb2 bytes) 000382 1787829550.173778 read 0x01c3a2 thru 0x01ffbd (0x3c1c bytes) 000383 1787829550.176235 mapread 0x00b16d thru 0x00c5cd (0x1461 bytes) 000384 1787829550.190888 MIRROR_EXTEND to 2 mirrors 000385 1787829550.957265 read 0x008d17 thru 0x009ac0 (0xdaa bytes) 000386 1787829550.965674 mapwrite 0x02474f thru 0x031cec (0xd59e bytes) 000387 1787829551.235153 write 0x010758 thru 0x01c69f (0xbf48 bytes) 000388 1787829551.256831 trunc from 0x031ced to 0x0275ff (0xa6ed bytes) 000390 1787829551.291592 trunc from 0x027600 to 0x032814 (0xb215 bytes) 000391 1787829551.315984 punch from 0x012bbe to 0x01ad7d (0x81c0 bytes) 000392 1787829551.336862 mapread 0x009186 thru 0x015431 (0xc2ac bytes) 000393 1787829551.371530 write 0x031594 thru 0x038e63 (0x78d0 bytes) 000394 1787829551.395281 read 0x0267e9 thru 0x02aaca (0x42e2 bytes) 000395 1787829551.415972 read 0x01e263 thru 0x02c9f2 (0xe790 bytes) 000396 1787829551.416751 mapwrite 0x03f62b thru 0x03ffff (0x9d5 bytes) 000397 1787829551.503232 fallocate 0x031db8 thru 0x03c2bd (0xa506 bytes) 000398 1787829551.519306 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1f098a30 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe32236ea Mirror 3: 0xe32236ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000399 1787829552.832261 MIRROR_RESYNC 3 mirrors 000401 1787829553.949197 trunc from 0x002adf to 0x00bf95 (0x94b7 bytes) 000402 1787829553.997096 read 0x003d6c thru 0x009089 (0x531e bytes) 000403 1787829554.014418 mapwrite 0x015164 thru 0x01f797 (0xa634 bytes) 000404 1787829554.129750 write 0x02365c thru 0x02b8b0 (0x8255 bytes) 000405 1787829554.144318 trunc from 0x02d60a to 0x036896 (0x928d bytes) 000406 1787829554.154398 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe32236ea (stale) Mirror 3: 0xe32236ea (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbcc95ed3 Mirror 4: 0xbcc95ed3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000408 1787829555.515870 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe32236ea (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe32236ea (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbcc95ed3 Mirror 4: 0xbcc95ed3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000409 1787829556.335111 trunc from 0x040000 to 0x02e4e4 (0x11b1b bytes) 000410 1787829556.426719 fallocate 0x03fd5d thru 0x03ffff (0x2a3 bytes) 000411 1787829556.432358 mapread 0x0166f5 thru 0x0194b0 (0x2dbc bytes) 000412 1787829556.464484 trunc from 0x02e4e5 to 0x0118b7 (0x1cc2d bytes) 000413 1787829556.479935 mapread 0x001fb1 thru 0x00d8ac (0xb8fc bytes) 000414 1787829556.493106 punch from 0x0083ab to 0x00dade (0x5734 bytes) 000415 1787829556.499932 mapwrite 0x039a6a thru 0x039ea5 (0x43c bytes) 000416 1787829556.564127 mapwrite 0x004f74 thru 0x014045 (0xf0d2 bytes) 000417 1787829556.648149 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39ea6): Mirror 4: 0xe9b5ed05 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39ea6): Mirror 4: 0xe9b5ed05 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39ea6: skipped 000418 1787829556.989015 punch from 0x00a313 to 0x01505b (0xad49 bytes) 000420 1787829556.995921 trunc from 0x039ea6 to 0x01ee23 (0x1b082 bytes) 000421 1787829557.020867 trunc from 0x01ee24 to 0x020640 (0x181d bytes) 000422 1787829557.050338 trunc from 0x00b2da to 0x00c897 (0x15be bytes) 000423 1787829557.063763 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) 000424 1787829557.270466 mapread 0x019e99 thru 0x01e603 (0x476b bytes) 000425 1787829557.306239 read 0x01b1c5 thru 0x020640 (0x547c bytes) 000426 1787829557.307546 trunc from 0x020641 to 0x01dbd6 (0x2a6a bytes) 000427 1787829557.351824 read 0x006971 thru 0x00d42e (0x6abe bytes) 000428 1787829557.371450 read 0x01c54f thru 0x01dbd6 (0x1688 bytes) 000430 1787829557.372559 mapread 0x00bb5b thru 0x0116de (0x5b84 bytes) 000432 1787829557.377952 mapwrite 0x03e49e thru 0x03ffff (0x1b62 bytes) 000433 1787829557.432797 trunc from 0x033d2c to 0x03d7ac (0x9a81 bytes) 000434 1787829557.441770 mapread 0x0133d3 thru 0x0155d8 (0x2206 bytes) 000435 1787829557.446185 read 0x01d8a7 thru 0x023efe (0x6658 bytes) 000436 1787829557.447761 punch from 0x03db6d to 0x03ffff (0x2493 bytes) 000437 1787829557.456017 write 0x00256f thru 0x010924 (0xe3b6 bytes) 000438 1787829557.460311 mapwrite 0x037d97 thru 0x03a5a4 (0x280e bytes) 000439 1787829557.500046 read 0x00c608 thru 0x01bc7c (0xf675 bytes) 000441 1787829557.502563 mapread 0x00e78c thru 0x00e994 (0x209 bytes) 000442 1787829557.504968 mapwrite 0x02a680 thru 0x02b474 (0xdf5 bytes) 000443 1787829557.526537 write 0x0025d2 thru 0x008478 (0x5ea7 bytes) 000444 1787829557.530951 mapread 0x0130aa thru 0x019065 (0x5fbc bytes) 000445 1787829557.533512 trunc from 0x040000 to 0x00c435 (0x33bca bytes) 000446 1787829557.571102 write 0x0387ee thru 0x03ffff (0x7812 bytes) 000447 1787829557.574170 trunc from 0x040000 to 0x0393de (0x6c21 bytes) 000448 1787829557.605071 fallocate 0x03631d thru 0x0368c1 (0x5a5 bytes) 000449 1787829557.614710 punch from 0x0285fd to 0x02ae85 (0x2889 bytes) 000451 1787829557.628962 mapread 0x011f5b thru 0x01ef93 (0xd039 bytes) 000452 1787829557.653169 mapread 0x024d59 thru 0x0254a3 (0x74b bytes) 000453 1787829557.654311 read 0x023ffa thru 0x02d84b (0x9852 bytes) 000454 1787829557.661095 trunc from 0x0393df to 0x0134b3 (0x25f2b bytes) 000455 1787829557.690229 write 0x02b163 thru 0x030ed2 (0x5d70 bytes) 000456 1787829557.691786 mapread 0x014096 thru 0x018b78 (0x4ae3 bytes) 000457 1787829557.701783 fallocate 0x019e68 thru 0x01a6c7 (0x860 bytes) 000458 1787829557.709187 trunc from 0x0184c6 to 0x022547 (0xa082 bytes) 000460 1787829557.726253 MIRROR_EXTEND to 2 mirrors 000461 1787829558.530135 punch from 0x02a84a to 0x030ed2 (0x6689 bytes) 000462 1787829558.579849 punch from 0x004ed7 to 0x008f8a (0x40b4 bytes) 000463 1787829558.586084 punch from 0x01c83e to 0x01f694 (0x2e57 bytes) 000464 1787829558.591626 trunc from 0x0282bb to 0x02a89b (0x25e1 bytes) 000465 1787829558.597010 trunc from 0x01b0c9 to 0x027e90 (0xcdc8 bytes) 000466 1787829558.602133 fallocate 0x03240a thru 0x03358f (0x1186 bytes) 000467 1787829558.607725 mapread 0x00122d thru 0x001911 (0x6e5 bytes) 000468 1787829558.613829 mapread 0x016cb6 thru 0x0221fe (0xb549 bytes) 000469 1787829558.644995 write 0x0232d1 thru 0x031038 (0xdd68 bytes) 000470 1787829558.652894 trunc from 0x02eb0b to 0x031038 (0x252e bytes) 000471 1787829558.678355 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x31039): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31039): Mirror 2: 0x9b026e48 (stale) CRC-32 checksum value for chunk [0, 0x31039): Mirror 1: 0x4c8b411b Mirror 3: 0x4c8b411b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31039: skipped 000472 1787829559.840076 trunc from 0x007d33 to 0x00bca3 (0x3f71 bytes) 000473 1787829559.884851 write 0x015c0e thru 0x01fbea (0x9fdd bytes) 000474 1787829559.906029 trunc from 0x031039 to 0x02b4c7 (0x5b71 bytes) 000476 1787829559.935243 read 0x017f91 thru 0x0190bd (0x112d bytes) 000477 1787829559.936797 fallocate 0x013d7b thru 0x02317e (0xf404 bytes) 000478 1787829559.948247 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b4c8): Mirror 2: 0x3159d99f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b4c8): Mirror 2: 0x3159d99f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b4c8: skipped 000479 1787829560.366272 trunc from 0x02b4c8 to 0x0326ef (0x7228 bytes) 000480 1787829560.397309 write 0x00ea2f thru 0x00f1a9 (0x77b bytes) 000481 1787829560.409110 read 0x008b6f thru 0x009854 (0xce6 bytes) 000482 1787829560.417092 mapread 0x005d71 thru 0x00b5fe (0x588e bytes) 000484 1787829560.447949 punch from 0x00ea74 to 0x00f041 (0x5ce bytes) 000485 1787829560.467291 trunc from 0x027139 to 0x0301ca (0x9092 bytes) 000486 1787829560.478790 read 0x013b8f thru 0x01423e (0x6b0 bytes) 000488 1787829560.514991 write 0x02e6b8 thru 0x0321a2 (0x3aeb bytes) 000489 1787829560.516738 trunc from 0x0015a8 to 0x00f5ba (0xe013 bytes) 000490 1787829560.527177 read 0x028541 thru 0x030e0e (0x88ce bytes) 000491 1787829560.531414 mapwrite 0x02a4a5 thru 0x038fd0 (0xeb2c bytes) 000493 1787829560.641322 trunc from 0x038fd1 to 0x03f56b (0x659b bytes) 000494 1787829560.673995 punch from 0x006150 to 0x01319c (0xd04d bytes) 000495 1787829560.691264 punch from 0x00d641 to 0x015088 (0x7a48 bytes) 000496 1787829560.700325 mapwrite 0x03083b thru 0x03afd8 (0xa79e bytes) 000497 1787829560.759386 write 0x00677a thru 0x0166ac (0xff33 bytes) 000498 1787829560.768171 trunc from 0x03f56c to 0x0176b9 (0x27eb2 bytes) 000499 1787829560.794938 MIRROR_RESYNC 2 mirrors 000500 1787829561.430043 punch from 0x00d532 to 0x00f196 (0x1c65 bytes) 000501 1787829561.501292 trunc from 0x01741d to 0x0176b9 (0x29d bytes) 000502 1787829561.510928 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) 000503 1787829561.780764 fallocate 0x03384a thru 0x03eec0 (0xb677 bytes) 000504 1787829561.798321 mapread 0x010344 thru 0x015356 (0x5013 bytes) 000505 1787829561.830867 mapwrite 0x038c71 thru 0x03a3b0 (0x1740 bytes) 000506 1787829561.871329 read 0x01a953 thru 0x026af8 (0xc1a6 bytes) 000507 1787829561.883267 trunc from 0x03eec1 to 0x01bece (0x22ff2 bytes) 000510 1787829561.930187 fallocate 0x03f627 thru 0x03ffff (0x9d9 bytes) 000511 1787829561.939175 punch from 0x003a32 to 0x00c81b (0x8dea bytes) 000512 1787829561.947951 trunc from 0x019f4f to 0x01e1a8 (0x425a bytes) 000514 1787829561.955924 trunc from 0x040000 to 0x02c756 (0x138a9 bytes) 000517 1787829561.975326 read 0x016137 thru 0x01d8d9 (0x77a3 bytes) 000518 1787829561.987009 mapread 0x016a81 thru 0x0226c7 (0xbc47 bytes) 000520 1787829561.990372 write 0x01c05e thru 0x024e25 (0x8dc8 bytes) 000522 1787829561.992836 punch from 0x006da4 to 0x00dc40 (0x6e9d bytes) 000524 1787829562.008133 read 0x01ad60 thru 0x021d7b (0x701c bytes) 000525 1787829562.009236 trunc from 0x02c757 to 0x01151e (0x1b238 bytes) 000528 1787829562.031995 write 0x02ed85 thru 0x03cf87 (0xe203 bytes) 000529 1787829562.035239 fallocate 0x028f50 thru 0x0323fd (0x94ae bytes) 000530 1787829562.046694 mapwrite 0x02ec6b thru 0x02ffcd (0x1363 bytes) 000531 1787829562.067766 mapwrite 0x024fc9 thru 0x02fcc1 (0xacf9 bytes) 000532 1787829562.098190 trunc from 0x03cf88 to 0x007750 (0x35837 bytes) 000533 1787829562.113614 trunc from 0x007751 to 0x0322e1 (0x2ab91 bytes) 000534 1787829562.143179 punch from 0x0079b1 to 0x00dc37 (0x6287 bytes) 000535 1787829562.147416 punch from 0x028d7f to 0x0317c8 (0x8a4a bytes) 000536 1787829562.156069 mapread 0x00d02f thru 0x01c739 (0xf70b bytes) 000537 1787829562.294268 fallocate 0x0292a7 thru 0x02bf52 (0x2cac bytes) 000538 1787829562.313259 punch from 0x027281 to 0x0322e1 (0xb061 bytes) 000539 1787829562.327244 mapwrite 0x002678 thru 0x010880 (0xe209 bytes) 000540 1787829562.423980 read 0x01aad7 thru 0x029f95 (0xf4bf bytes) 000541 1787829562.448250 mapread 0x007e6c thru 0x00a9fe (0x2b93 bytes) 000542 1787829562.449110 mapread 0x008d8d thru 0x00b8e9 (0x2b5d bytes) 000543 1787829562.449861 mapread 0x01e53a thru 0x02bdd1 (0xd898 bytes) 000544 1787829562.452199 fallocate 0x00529f thru 0x00e803 (0x9565 bytes) 000545 1787829562.457647 fallocate 0x003891 thru 0x0118e3 (0xe053 bytes) 000546 1787829562.464381 mapwrite 0x00e609 thru 0x01bea5 (0xd89d bytes) 000547 1787829562.511613 punch from 0x00cbe7 to 0x0110e7 (0x4501 bytes) 000549 1787829562.524742 write 0x00ab86 thru 0x00cfe3 (0x245e bytes) 000550 1787829562.533284 trunc from 0x0322e2 to 0x00b5e0 (0x26d01 bytes) 000551 1787829562.561792 MIRROR_EXTEND to 2 mirrors 000552 1787829563.232655 fallocate 0x0146df thru 0x0201fd (0xbb1f bytes) 000553 1787829563.280908 mapread 0x01fd71 thru 0x0201fd (0x48d bytes) 000554 1787829563.301638 mapwrite 0x03c585 thru 0x03ffff (0x3a7b bytes) 000555 1787829563.428033 mapwrite 0x03c0e1 thru 0x03ffff (0x3f1f bytes) 000556 1787829563.440724 fallocate 0x03ff42 thru 0x03ffff (0xbe bytes) 000557 1787829563.444982 write 0x02020e thru 0x02cff4 (0xcde7 bytes) 000558 1787829563.451688 read 0x025caa thru 0x0281e9 (0x2540 bytes) 000559 1787829563.452421 fallocate 0x022bee thru 0x025363 (0x2776 bytes) 000560 1787829563.457667 trunc from 0x040000 to 0x013f14 (0x2c0eb bytes) 000561 1787829563.472408 trunc from 0x0108e3 to 0x012d96 (0x24b4 bytes) 000562 1787829563.476928 trunc from 0x013f15 to 0x02f5a9 (0x1b695 bytes) 000563 1787829563.495396 trunc from 0x02f5aa to 0x005768 (0x29e41 bytes) 000564 1787829563.514422 mapread 0x003a52 thru 0x005768 (0x1d17 bytes) 000565 1787829563.552332 trunc from 0x000240 to 0x0046d8 (0x4499 bytes) 000566 1787829563.564298 trunc from 0x00038c to 0x001d4b (0x19c0 bytes) 000567 1787829563.573519 read 0x000627 thru 0x005768 (0x5142 bytes) 000568 1787829563.591086 write 0x02c8f9 thru 0x02e415 (0x1b1d bytes) 000569 1787829563.592176 punch from 0x018ebc to 0x0203d7 (0x751c bytes) 000570 1787829563.600563 mapread 0x01aa26 thru 0x0291e7 (0xe7c2 bytes) 000571 1787829563.609309 mapread 0x0192e8 thru 0x01f75b (0x6474 bytes) 000572 1787829563.610133 punch from 0x01bdce to 0x01fcfa (0x3f2d bytes) 000573 1787829563.615713 trunc from 0x02e416 to 0x01776e (0x16ca7 bytes) 000574 1787829563.641847 mapread 0x014119 thru 0x01776e (0x3656 bytes) 000575 1787829563.643254 trunc from 0x0078c1 to 0x0096ca (0x1e0a bytes) 000577 1787829563.649197 punch from 0x016883 to 0x01776e (0xeec bytes) 000578 1787829563.654002 mapwrite 0x037b4c thru 0x03c25f (0x4714 bytes) 000579 1787829563.705196 read 0x02cc46 thru 0x034bd5 (0x7f90 bytes) 000580 1787829563.725452 trunc from 0x03c260 to 0x01acda (0x21585 bytes) 000581 1787829563.752431 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) 000583 1787829564.011657 write 0x01cdbd thru 0x02c650 (0xf894 bytes) 000584 1787829564.021280 trunc from 0x02c651 to 0x03b49b (0xee4b bytes) 000585 1787829564.070167 fallocate 0x02abc4 thru 0x0357dc (0xac19 bytes) 000586 1787829564.092669 trunc from 0x017baa to 0x020dad (0x9204 bytes) 000587 1787829564.108998 punch from 0x0146c8 to 0x01838a (0x3cc3 bytes) 000588 1787829564.123124 write 0x01a2bf thru 0x022f89 (0x8ccb bytes) 000589 1787829564.136013 write 0x03a0e3 thru 0x03c3a6 (0x22c4 bytes) 000590 1787829564.154636 fallocate 0x02d01d thru 0x02fe2b (0x2e0f bytes) 000591 1787829564.165850 trunc from 0x03c3a7 to 0x02a97f (0x11a27 bytes) 000592 1787829564.192273 trunc from 0x007a7f to 0x017a67 (0xffe9 bytes) 000593 1787829564.198036 write 0x0241e6 thru 0x030e4d (0xcc68 bytes) 000594 1787829564.200561 fallocate 0x03523a thru 0x03d738 (0x84ff bytes) 000595 1787829564.206622 trunc from 0x013ced to 0x014dcd (0x10e1 bytes) 000596 1787829564.213133 mapwrite 0x0233f5 thru 0x02e77b (0xb387 bytes) 000597 1787829564.248791 punch from 0x02aa60 to 0x0353aa (0xa94b bytes) 000598 1787829564.260552 trunc from 0x03d739 to 0x02d98d (0xfdab bytes) 000599 1787829564.286611 write 0x00e12d thru 0x0154d6 (0x73aa bytes) 000600 1787829564.296965 mapread 0x0048dd thru 0x006518 (0x1c3c bytes) 000601 1787829564.318780 write 0x000594 thru 0x00efbf (0xea2c bytes) 000602 1787829564.326519 mapread 0x01a6e5 thru 0x0260eb (0xba07 bytes) 000603 1787829564.327643 write 0x019c24 thru 0x01adeb (0x11c8 bytes) 000604 1787829564.331433 mapread 0x01fae2 thru 0x024054 (0x4573 bytes) 000605 1787829564.332290 trunc from 0x02d98e to 0x029978 (0x4015 bytes) 000606 1787829564.347735 mapwrite 0x00351c thru 0x00841b (0x4f00 bytes) 000607 1787829564.374638 trunc from 0x000d49 to 0x001b35 (0xded bytes) 000608 1787829564.386770 MIRROR_EXTEND to 2 mirrors 000609 1787829565.499835 trunc from 0x029365 to 0x029978 (0x614 bytes) 000610 1787829565.545823 fallocate 0x0309c8 thru 0x03c83c (0xbe75 bytes) 000611 1787829565.555048 mapread 0x033daf thru 0x035bf8 (0x1e4a bytes) 000612 1787829565.583304 read 0x0272f1 thru 0x02f4b7 (0x81c7 bytes) 000613 1787829565.602999 trunc from 0x01c73c to 0x021f92 (0x5857 bytes) 000614 1787829565.613196 fallocate 0x00ff54 thru 0x0198e0 (0x998d bytes) 000615 1787829565.620403 trunc from 0x018421 to 0x01bffc (0x3bdc bytes) 000616 1787829565.626013 write 0x03eaa7 thru 0x03ffff (0x1559 bytes) 000617 1787829565.632393 mapread 0x03ca2f thru 0x03ffff (0x35d1 bytes) 000618 1787829565.643099 mapread 0x03b824 thru 0x03ffff (0x47dc bytes) 000619 1787829565.644040 mapread 0x007b19 thru 0x00c14e (0x4636 bytes) 000620 1787829565.657854 punch from 0x034683 to 0x037766 (0x30e4 bytes) 000621 1787829565.663809 mapwrite 0x024992 thru 0x02df00 (0x956f bytes) 000623 1787829565.704277 read 0x020da6 thru 0x022091 (0x12ec bytes) 000624 1787829565.705329 fallocate 0x019e02 thru 0x01e078 (0x4277 bytes) 000625 1787829565.713803 read 0x007114 thru 0x014e00 (0xdced bytes) 000626 1787829565.730293 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) 000627 1787829565.897156 fallocate 0x013edc thru 0x01d5a9 (0x96ce bytes) 000628 1787829565.904631 trunc from 0x040000 to 0x037be5 (0x841a bytes) 000629 1787829565.943640 mapwrite 0x000aad thru 0x002053 (0x15a7 bytes) 000630 1787829565.991396 fallocate 0x0040fa thru 0x00df0b (0x9e12 bytes) 000631 1787829565.997212 punch from 0x01a4fa to 0x01e510 (0x4017 bytes) 000632 1787829566.007272 trunc from 0x01e636 to 0x02c679 (0xe044 bytes) 000633 1787829566.013892 mapread 0x037952 thru 0x037be5 (0x294 bytes) 000634 1787829566.028943 mapread 0x029101 thru 0x036f68 (0xde68 bytes) 000636 1787829566.038105 read 0x000dbc thru 0x010db7 (0xfffc bytes) 000637 1787829566.046370 trunc from 0x021aef to 0x02dbcb (0xc0dd bytes) 000638 1787829566.050788 mapread 0x011eb1 thru 0x020278 (0xe3c8 bytes) 000639 1787829566.069041 trunc from 0x037be6 to 0x031ec4 (0x5d21 bytes) 000640 1787829566.083578 fallocate 0x03d6f5 thru 0x03ffff (0x290b bytes) 000642 1787829566.092211 mapread 0x00684e thru 0x008a69 (0x221c bytes) 000643 1787829566.093183 trunc from 0x00b3e3 to 0x0179db (0xc5f9 bytes) 000644 1787829566.098209 read 0x00dd85 thru 0x00dfad (0x229 bytes) 000645 1787829566.107339 write 0x00850c thru 0x00d778 (0x526d bytes) 000646 1787829566.108762 trunc from 0x031ec5 to 0x013599 (0x1e92b bytes) 000647 1787829566.126326 trunc from 0x000234 to 0x003d1c (0x3ae9 bytes) 000648 1787829566.132409 mapread 0x00acd0 thru 0x00ee04 (0x4135 bytes) 000649 1787829566.133365 write 0x00d29b thru 0x014205 (0x6f6b bytes) 000650 1787829566.134543 mapread 0x0117a5 thru 0x014205 (0x2a61 bytes) 000651 1787829566.135639 trunc from 0x00f095 to 0x00f901 (0x86d bytes) 000653 1787829566.148392 mapwrite 0x017c44 thru 0x021eb3 (0xa270 bytes) 000654 1787829566.269796 trunc from 0x021eb4 to 0x00c74f (0x15764 bytes) 000655 1787829566.292975 trunc from 0x008aac to 0x00c74f (0x3ca4 bytes) 000656 1787829566.299875 read 0x000bec thru 0x0044e3 (0x38f8 bytes) 000657 1787829566.309814 trunc from 0x006f7a to 0x00c44b (0x54d2 bytes) 000659 1787829566.316809 fallocate 0x034785 thru 0x03e9d2 (0xa24e bytes) 000660 1787829566.322833 fallocate 0x023c90 thru 0x02da3a (0x9dab bytes) 000663 1787829566.328447 read 0x02100a thru 0x027ecd (0x6ec4 bytes) 000664 1787829566.338963 read 0x02ab64 thru 0x02f697 (0x4b34 bytes) 000665 1787829566.339570 mapread 0x0118ee thru 0x016bde (0x52f1 bytes) 000666 1787829566.340390 fallocate 0x02d5d7 thru 0x0391a0 (0xbbca bytes) 000667 1787829566.345989 trunc from 0x03e9d3 to 0x02f332 (0xf6a0 bytes) 000668 1787829566.369805 MIRROR_EXTEND to 2 mirrors 000670 1787829567.156606 trunc from 0x02f333 to 0x02edc3 (0x56f bytes) 000672 1787829567.319116 fallocate 0x019ce4 thru 0x01a599 (0x8b6 bytes) 000673 1787829567.332361 write 0x00ecce thru 0x01869a (0x99cd bytes) 000674 1787829567.349016 trunc from 0x0083e8 to 0x013385 (0xaf9e bytes) 000675 1787829567.364187 trunc from 0x023660 to 0x0245ae (0xf4f bytes) 000676 1787829567.369048 write 0x0190b3 thru 0x02500b (0xbf59 bytes) 000677 1787829567.383059 fallocate 0x010544 thru 0x016dfb (0x68b8 bytes) 000678 1787829567.388858 mapread 0x02bf80 thru 0x02edc3 (0x2e44 bytes) 000679 1787829567.416405 trunc from 0x00b1fd to 0x01a77e (0xf582 bytes) 000680 1787829567.432524 write 0x022f0b thru 0x026764 (0x385a bytes) 000681 1787829567.433750 read 0x020bbc thru 0x028f17 (0x835c bytes) 000683 1787829567.436176 write 0x034bea thru 0x03ffff (0xb416 bytes) 000684 1787829567.439122 trunc from 0x040000 to 0x035c94 (0xa36b bytes) 000685 1787829567.465682 write 0x039bb7 thru 0x03ffff (0x6449 bytes) 000686 1787829567.467856 punch from 0x0059d5 to 0x00afbb (0x55e7 bytes) 000687 1787829567.473943 write 0x02f300 thru 0x033854 (0x4555 bytes) 000688 1787829567.485845 write 0x023022 thru 0x029bc8 (0x6ba7 bytes) 000689 1787829567.497124 MIRROR_RESYNC 2 mirrors 000690 1787829568.541691 write 0x014e75 thru 0x024da4 (0xff30 bytes) 000691 1787829568.608418 write 0x03033e thru 0x03dd6b (0xda2e bytes) 000692 1787829568.649840 trunc from 0x00658e to 0x00d79b (0x720e bytes) 000693 1787829568.674179 trunc from 0x040000 to 0x017572 (0x28a8d bytes) 000694 1787829568.714460 write 0x016123 thru 0x01e9bb (0x8899 bytes) 000695 1787829568.722361 read 0x0173fb thru 0x01e9bb (0x75c1 bytes) 000696 1787829568.726809 punch from 0x017bb5 to 0x01896f (0xdbb bytes) 000697 1787829568.753135 trunc from 0x0173f7 to 0x01e9bb (0x75c5 bytes) 000698 1787829568.769138 read 0x012d0d thru 0x01cc5a (0x9f4e bytes) 000699 1787829568.810740 read 0x01c1e1 thru 0x01e9bb (0x27db bytes) 000700 1787829568.812742 fallocate 0x011e61 thru 0x01d76d (0xb90d bytes) 000701 1787829568.821750 write 0x0033be thru 0x008107 (0x4d4a bytes) 000702 1787829568.828104 read 0x01dd46 thru 0x01e9bb (0xc76 bytes) 000703 1787829568.829298 trunc from 0x011205 to 0x018d6c (0x7b68 bytes) 000704 1787829568.837100 write 0x03ccec thru 0x03ffff (0x3314 bytes) 000705 1787829568.839590 write 0x02baf7 thru 0x03a252 (0xe75c bytes) 000707 1787829568.863157 mapwrite 0x000259 thru 0x006999 (0x6741 bytes) 000708 1787829568.903928 write 0x01c199 thru 0x0245c2 (0x842a bytes) 000709 1787829568.905609 write 0x0390d1 thru 0x03ffff (0x6f2f bytes) 000710 1787829568.908305 fallocate 0x02c43c thru 0x0346bd (0x8282 bytes) 000711 1787829568.915204 fallocate 0x00b225 thru 0x00d81e (0x25fa bytes) 000712 1787829568.926311 trunc from 0x025f19 to 0x0275b2 (0x169a bytes) 000713 1787829568.937154 read 0x012f99 thru 0x021121 (0xe189 bytes) 000714 1787829568.939031 trunc from 0x011a0c to 0x0140d9 (0x26ce bytes) 000715 1787829568.948549 write 0x00b02d thru 0x017d1f (0xccf3 bytes) 000716 1787829568.961037 MIRROR_RESYNC 2 mirrors 000717 1787829570.135434 write 0x000f5e thru 0x005005 (0x40a8 bytes) 000718 1787829570.205303 trunc from 0x040000 to 0x013c60 (0x2c39f bytes) 000720 1787829570.241157 mapread 0x000643 thru 0x00bd30 (0xb6ee bytes) 000722 1787829570.257726 read 0x004dbb thru 0x0108e1 (0xbb27 bytes) 000723 1787829570.258437 trunc from 0x013c61 to 0x00c164 (0x7afc bytes) 000725 1787829570.277860 trunc from 0x00c165 to 0x026378 (0x1a214 bytes) 000726 1787829570.307394 write 0x00d926 thru 0x01374a (0x5e25 bytes) 000727 1787829570.319524 trunc from 0x026379 to 0x03da74 (0x176fc bytes) 000728 1787829570.341038 mapwrite 0x01a201 thru 0x01e5dd (0x43dd bytes) 000730 1787829570.374810 read 0x01c796 thru 0x01f12b (0x2996 bytes) 000732 1787829570.376654 read 0x02475c thru 0x02a124 (0x59c9 bytes) 000733 1787829570.395939 read 0x033d19 thru 0x03d534 (0x981c bytes) 000734 1787829570.397256 trunc from 0x013abf to 0x021dcd (0xe30f bytes) 000735 1787829570.405768 mapwrite 0x029801 thru 0x038c6a (0xf46a bytes) 000736 1787829570.457886 trunc from 0x03da75 to 0x01b023 (0x22a51 bytes) 000737 1787829570.491794 read 0x013b8d thru 0x01aa88 (0x6efc bytes) 000738 1787829570.506425 mapread 0x008d2d thru 0x010a08 (0x7cdc bytes) 000739 1787829570.508111 fallocate 0x00cdb1 thru 0x00cdbe (0xe bytes) 000740 1787829570.513904 mapread 0x0028f2 thru 0x00e295 (0xb9a4 bytes) 000741 1787829570.524247 MIRROR_RESYNC 2 mirrors 000742 1787829571.121114 write 0x01e88b thru 0x021f8c (0x3702 bytes) 000743 1787829571.176628 trunc from 0x021f8d to 0x02a69c (0x8710 bytes) 000744 1787829571.233043 fallocate 0x0196a5 thru 0x023caf (0xa60b bytes) 000745 1787829571.239755 mapwrite 0x035a93 thru 0x0383c0 (0x292e bytes) 000746 1787829571.321372 trunc from 0x036c9f to 0x0383c0 (0x1722 bytes) 000747 1787829571.331993 read 0x00f813 thru 0x0175ac (0x7d9a bytes) 000748 1787829571.358847 trunc from 0x0383c1 to 0x0240b5 (0x1430b bytes) 000749 1787829571.386378 mapread 0x023830 thru 0x0240b5 (0x886 bytes) 000752 1787829571.411314 write 0x005174 thru 0x00f169 (0x9ff6 bytes) 000753 1787829571.426008 fallocate 0x007d67 thru 0x00a6b0 (0x294a bytes) 000754 1787829571.430953 mapread 0x012082 thru 0x0135a4 (0x1523 bytes) 000755 1787829571.432064 mapread 0x00ad13 thru 0x018649 (0xd937 bytes) 000756 1787829571.440547 write 0x027040 thru 0x02badd (0x4a9e bytes) 000757 1787829571.441760 trunc from 0x02bade to 0x01e0e8 (0xd9f5 bytes) 000758 1787829571.465024 mapread 0x015f02 thru 0x01e0e8 (0x81e7 bytes) 000759 1787829571.468148 fallocate 0x0020e8 thru 0x0059b8 (0x38d1 bytes) 000760 1787829571.483286 trunc from 0x01e0e9 to 0x036cab (0x18bc3 bytes) 000762 1787829571.512490 trunc from 0x02fb8c to 0x036cab (0x7120 bytes) 000763 1787829571.528133 write 0x0112f6 thru 0x016829 (0x5534 bytes) 000764 1787829571.530821 mapread 0x0022fa thru 0x00a693 (0x839a bytes) 000765 1787829571.538329 read 0x00ca8c thru 0x015d85 (0x92fa bytes) 000766 1787829571.539553 trunc from 0x025ee6 to 0x0265b5 (0x6d0 bytes) 000767 1787829571.546598 fallocate 0x029663 thru 0x036d50 (0xd6ee bytes) 000768 1787829571.556004 mapread 0x02e2d1 thru 0x03611d (0x7e4d bytes) 000769 1787829571.571820 trunc from 0x036d51 to 0x02b148 (0xbc08 bytes) 000770 1787829571.616233 MIRROR_RESYNC 2 mirrors 000771 1787829572.297150 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) 000772 1787829572.444209 fallocate 0x011da2 thru 0x01304c (0x12ab bytes) 000773 1787829572.461834 fallocate 0x02e350 thru 0x02e91a (0x5cb bytes) 000774 1787829572.467947 fallocate 0x02fa0a thru 0x03df4f (0xe546 bytes) 000775 1787829572.475657 trunc from 0x03df50 to 0x010852 (0x2d6fd bytes) 000776 1787829572.538111 MIRROR_EXTEND to 2 mirrors 000777 1787829573.197696 punch from 0x006ffb to 0x010852 (0x9858 bytes) 000778 1787829573.259865 trunc from 0x004da8 to 0x00a7ae (0x5a07 bytes) 000779 1787829573.272410 trunc from 0x010853 to 0x019361 (0x8b0f bytes) 000780 1787829573.303066 trunc from 0x019362 to 0x024d8b (0xba2a bytes) 000781 1787829573.322291 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) 000782 1787829573.475976 punch from 0x00b432 to 0x015a12 (0xa5e1 bytes) 000783 1787829573.484530 write 0x032982 thru 0x03fb82 (0xd201 bytes) 000784 1787829573.494380 read 0x02fc7e thru 0x036441 (0x67c4 bytes) 000785 1787829573.506288 punch from 0x00f3e3 to 0x01ee2f (0xfa4d bytes) 000786 1787829573.521532 mapread 0x0252c2 thru 0x02e0aa (0x8de9 bytes) 000787 1787829573.558264 trunc from 0x03fb83 to 0x03cd55 (0x2e2d bytes) 000788 1787829573.604015 fallocate 0x005306 thru 0x011aad (0xc7a8 bytes) 000789 1787829573.610318 trunc from 0x03cd56 to 0x017a65 (0x252f0 bytes) 000790 1787829573.629916 mapwrite 0x02944f thru 0x03656e (0xd120 bytes) 000792 1787829573.679530 trunc from 0x03656f to 0x012953 (0x23c1b bytes) 000793 1787829573.691379 write 0x035ae2 thru 0x03ffff (0xa51e bytes) 000796 1787829573.695525 read 0x01ef36 thru 0x02703a (0x8105 bytes) 000797 1787829573.709608 trunc from 0x040000 to 0x015e5e (0x2a1a1 bytes) 000798 1787829573.727973 punch from 0x006a97 to 0x00d733 (0x6c9d bytes) 000799 1787829573.734977 trunc from 0x015e5f to 0x0370ec (0x2128e bytes) 000801 1787829573.768951 read 0x013aa1 thru 0x020849 (0xcda9 bytes) 000802 1787829573.787749 mapread 0x008e26 thru 0x0141a9 (0xb384 bytes) 000803 1787829573.789427 punch from 0x0294b1 to 0x02c20f (0x2d5f bytes) 000804 1787829573.795101 mapwrite 0x01207c thru 0x01d663 (0xb5e8 bytes) 000805 1787829573.820019 trunc from 0x0370ed to 0x02e022 (0x90ca bytes) 000806 1787829573.840883 read 0x028a03 thru 0x02e022 (0x5620 bytes) 000807 1787829573.854382 read 0x00305e thru 0x0091d0 (0x6173 bytes) 000808 1787829573.855836 fallocate 0x01741d thru 0x023ba0 (0xc784 bytes) 000809 1787829573.862967 trunc from 0x02e023 to 0x01b0d3 (0x12f4f bytes) 000810 1787829573.898281 trunc from 0x01b0d4 to 0x00af43 (0x10190 bytes) 000811 1787829573.924819 punch from 0x0080c7 to 0x00af43 (0x2e7d bytes) 000812 1787829573.938539 trunc from 0x007057 to 0x00af43 (0x3eed bytes) 000813 1787829573.944199 fallocate 0x027d24 thru 0x036ea9 (0xf186 bytes) 000814 1787829573.948881 punch from 0x01097e to 0x01dce0 (0xd363 bytes) 000815 1787829573.955595 trunc from 0x036eaa to 0x01d630 (0x19879 bytes) 000816 1787829573.972017 mapread 0x0177a0 thru 0x01d630 (0x5e91 bytes) 000817 1787829573.983193 fallocate 0x0382a8 thru 0x03efea (0x6d43 bytes) 000818 1787829573.988628 trunc from 0x01d631 to 0x00cd19 (0x10917 bytes) 000819 1787829574.011734 read 0x00a5b9 thru 0x00cd19 (0x2761 bytes) 000820 1787829574.014261 trunc from 0x0062be to 0x00cd19 (0x6a5c bytes) 000821 1787829574.023471 trunc from 0x00cd1a to 0x03d387 (0x3066e bytes) 000823 1787829574.047847 trunc from 0x0358ec to 0x03d387 (0x7a9c bytes) 000824 1787829574.054036 fallocate 0x02e767 thru 0x032aa5 (0x433f bytes) 000825 1787829574.059675 mapwrite 0x02b62e thru 0x035508 (0x9edb bytes) 000826 1787829574.132934 write 0x033600 thru 0x035127 (0x1b28 bytes) 000827 1787829574.134879 mapwrite 0x01b592 thru 0x0234af (0x7f1e bytes) 000830 1787829574.162698 mapwrite 0x017a47 thru 0x01e196 (0x6750 bytes) 000831 1787829574.187774 punch from 0x02880e to 0x038364 (0xfb57 bytes) 000832 1787829574.195116 punch from 0x01b00a to 0x01c07a (0x1071 bytes) 000833 1787829574.201001 write 0x030308 thru 0x0370c6 (0x6dbf bytes) 000834 1787829574.214951 punch from 0x0009d7 to 0x008de9 (0x8413 bytes) 000835 1787829574.221912 read 0x01ec8d thru 0x01edf5 (0x169 bytes) 000836 1787829574.223035 mapread 0x02f8cc thru 0x03ab0d (0xb242 bytes) 000837 1787829574.234701 fallocate 0x02df7e thru 0x03157b (0x35fe bytes) 000840 1787829574.242129 punch from 0x002513 to 0x00a25e (0x7d4c bytes) 000841 1787829574.251748 MIRROR_EXTEND to 2 mirrors 000842 1787829575.123128 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) 000843 1787829575.273945 mapwrite 0x026c8b thru 0x02b105 (0x447b bytes) 000844 1787829575.335458 trunc from 0x00c0fe to 0x01378a (0x768d bytes) 000845 1787829575.345993 trunc from 0x03d388 to 0x01905a (0x2432d bytes) 000846 1787829575.426130 trunc from 0x017b87 to 0x01905a (0x14d4 bytes) 000847 1787829575.434844 mapwrite 0x036428 thru 0x03c6c2 (0x629b bytes) 000848 1787829575.483218 trunc from 0x03c6c3 to 0x026b0c (0x15bb6 bytes) 000849 1787829575.502583 punch from 0x008bc8 to 0x00b608 (0x2a41 bytes) 000850 1787829575.511203 mapread 0x006aed thru 0x0127c5 (0xbcd9 bytes) 000852 1787829575.537050 read 0x00025d thru 0x002bb7 (0x295b bytes) 000853 1787829575.543126 write 0x01a99f thru 0x024961 (0x9fc3 bytes) 000855 1787829575.557376 trunc from 0x026b0d to 0x003f6d (0x22b9f bytes) 000856 1787829575.575570 mapread 0x00168e thru 0x002f1c (0x188f bytes) 000857 1787829575.577691 trunc from 0x003f6e to 0x025650 (0x216e3 bytes) 000858 1787829575.600690 punch from 0x01dafa to 0x022c9d (0x51a4 bytes) 000859 1787829575.605147 write 0x021f42 thru 0x023e95 (0x1f54 bytes) 000861 1787829575.617111 mapwrite 0x03a267 thru 0x03e98c (0x4726 bytes) 000863 1787829575.671847 mapwrite 0x00f427 thru 0x01491c (0x54f6 bytes) 000864 1787829575.713113 trunc from 0x017b66 to 0x01dc91 (0x612c bytes) 000865 1787829575.725802 write 0x036151 thru 0x03ffff (0x9eaf bytes) 000866 1787829575.727811 mapwrite 0x00f2ea thru 0x018407 (0x911e bytes) 000867 1787829575.773387 punch from 0x032d06 to 0x038d88 (0x6083 bytes) 000870 1787829575.781567 trunc from 0x020694 to 0x028c2d (0x859a bytes) 000871 1787829575.786048 mapread 0x00e714 thru 0x00f68f (0xf7c bytes) 000872 1787829575.787645 trunc from 0x040000 to 0x026c60 (0x1939f bytes) 000873 1787829575.813931 MIRROR_EXTEND to 2 mirrors 000874 1787829576.575227 write 0x02f593 thru 0x03b352 (0xbdc0 bytes) 000875 1787829576.618379 punch from 0x02c45f to 0x02e5f8 (0x219a bytes) 000876 1787829576.624613 fallocate 0x03929d thru 0x03fd25 (0x6a89 bytes) 000877 1787829576.637193 MIRROR_RESYNC 2 mirrors 000878 1787829577.335906 mapread 0x0140e9 thru 0x01ce31 (0x8d49 bytes) 000879 1787829577.366464 mapread 0x02214e thru 0x02c679 (0xa52c bytes) 000881 1787829577.389048 mapread 0x02229f thru 0x024c0b (0x296d bytes) 000882 1787829577.390160 fallocate 0x032370 thru 0x03bb3b (0x97cc bytes) 000884 1787829577.438710 read 0x005aad thru 0x015419 (0xf96d bytes) 000885 1787829577.455942 trunc from 0x03fd26 to 0x034ad4 (0xb251 bytes) 000886 1787829577.474703 mapwrite 0x002c45 thru 0x00dd1a (0xb0d6 bytes) 000887 1787829577.506449 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) 000888 1787829577.719509 MIRROR_EXTEND to 2 mirrors 000889 1787829578.694228 fallocate 0x0016ef thru 0x0026f1 (0x1003 bytes) 000890 1787829578.753165 fallocate 0x032f0e thru 0x038e40 (0x5f33 bytes) 000891 1787829578.758736 fallocate 0x0236ff thru 0x02a5ce (0x6ed0 bytes) 000892 1787829578.764525 punch from 0x008a5f to 0x016c6a (0xe20c bytes) 000893 1787829578.770048 write 0x0101ea thru 0x01272f (0x2546 bytes) 000894 1787829578.787023 trunc from 0x034ad5 to 0x032766 (0x236e bytes) 000895 1787829578.810451 read 0x027cb8 thru 0x02dc3a (0x5f83 bytes) 000897 1787829578.824847 fallocate 0x017eef thru 0x01a3b4 (0x24c6 bytes) 000898 1787829578.843827 fallocate 0x035661 thru 0x039e25 (0x47c5 bytes) 000899 1787829578.852817 trunc from 0x00f7d5 to 0x01f412 (0xfc3e bytes) 000900 1787829578.878594 mapread 0x01551f thru 0x023390 (0xde72 bytes) 000901 1787829578.961374 mapread 0x02b493 thru 0x02d38a (0x1ef8 bytes) 000902 1787829578.962543 write 0x005c45 thru 0x0071f0 (0x15ac bytes) 000903 1787829578.991662 trunc from 0x00b807 to 0x0118b0 (0x60aa bytes) 000904 1787829578.996104 trunc from 0x032767 to 0x003e29 (0x2e93d bytes) 000905 1787829579.024831 punch from 0x001693 to 0x003e29 (0x2797 bytes) 000906 1787829579.035853 mapread 0x0000fb thru 0x003e29 (0x3d2f bytes) 000907 1787829579.077265 MIRROR_RESYNC 2 mirrors 000908 1787829579.843666 trunc from 0x0013ba to 0x003e29 (0x2a70 bytes) 000910 1787829579.878136 punch from 0x002599 to 0x0030b9 (0xb21 bytes) 000911 1787829579.888049 MIRROR_RESYNC 2 mirrors 000912 1787829580.434289 mapwrite 0x038acf thru 0x03ab3f (0x2071 bytes) 000913 1787829580.511788 trunc from 0x03ab40 to 0x02b1f3 (0xf94c bytes) 000914 1787829580.532798 mapwrite 0x0233c4 thru 0x02aa6d (0x76aa bytes) 000915 1787829580.575063 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2b1f4): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b1f4): Mirror 2: 0x4d9d6692 (stale) CRC-32 checksum value for chunk [0, 0x2b1f4): Mirror 1: 0xf81e217 Mirror 3: 0xf81e217 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b1f4: skipped 000917 1787829581.768916 mapread 0x013fb3 thru 0x016be4 (0x2c32 bytes) 000918 1787829581.813401 fallocate 0x02c8ba thru 0x0330cd (0x6814 bytes) 000919 1787829581.892563 punch from 0x01afe2 to 0x02060f (0x562e bytes) 000920 1787829581.925091 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2b1f4): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b1f4): Mirror 2: 0x4d9d6692 (stale) Mirror 3: 0xf81e217 (stale) CRC-32 checksum value for chunk [0, 0x2b1f4): Mirror 1: 0xf81e217 Mirror 4: 0xf81e217 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b1f4: skipped 000921 1787829583.128271 mapread 0x01ca15 thru 0x029a32 (0xd01e bytes) 000922 1787829583.169409 write 0x027c37 thru 0x035482 (0xd84c bytes) 000923 1787829583.226642 trunc from 0x035483 to 0x03cdf3 (0x7971 bytes) 000924 1787829583.246298 punch from 0x039a70 to 0x03c89c (0x2e2d bytes) 000925 1787829583.252258 fallocate 0x00f554 thru 0x01977d (0xa22a bytes) 000926 1787829583.258082 punch from 0x031530 to 0x03b521 (0x9ff2 bytes) 000927 1787829583.278819 punch from 0x0257e9 to 0x028261 (0x2a79 bytes) 000928 1787829583.290242 MIRROR_RESYNC 4 mirrors 000929 1787829584.645576 fallocate 0x0023fa thru 0x0027be (0x3c5 bytes) 000930 1787829584.704293 MIRROR_RESYNC 4 mirrors 000931 1787829585.972392 mapread 0x024b28 thru 0x02f034 (0xa50d bytes) 000932 1787829586.015919 trunc from 0x02667c to 0x02e65f (0x7fe4 bytes) 000933 1787829586.080041 read 0x006061 thru 0x0096d6 (0x3676 bytes) 000934 1787829586.095455 punch from 0x0272ed to 0x03018c (0x8ea0 bytes) 000935 1787829586.100827 write 0x00ebb3 thru 0x010c97 (0x20e5 bytes) 000936 1787829586.126189 fallocate 0x03a551 thru 0x03d74d (0x31fd bytes) 000937 1787829586.134721 trunc from 0x03cdf4 to 0x00eb13 (0x2e2e0 bytes) 000938 1787829586.180637 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xeb14): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xeb14): Mirror 2: 0xeda8e9d4 (stale) Mirror 3: 0xeda8e9d4 (stale) Mirror 4: 0xeda8e9d4 (stale) CRC-32 checksum value for chunk [0, 0xeb14): Mirror 1: 0xeda8e9d4 Mirror 5: 0xeda8e9d4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xeb14: skipped 000939 1787829587.464658 mapread 0x00964b thru 0x00eb13 (0x54c9 bytes) 000940 1787829587.488370 read 0x00881e thru 0x00dbeb (0x53ce bytes) 000941 1787829587.489049 mapread 0x005e31 thru 0x00eb13 (0x8ce3 bytes) 000942 1787829587.499093 write 0x00624c thru 0x00da18 (0x77cd bytes) 000943 1787829587.549843 trunc from 0x00eb14 to 0x0350e9 (0x265d6 bytes) 000944 1787829587.593759 trunc from 0x002f61 to 0x006d02 (0x3da2 bytes) 000945 1787829587.616851 MIRROR_RESYNC 5 mirrors 000946 1787829588.752374 write 0x02e967 thru 0x03dafd (0xf197 bytes) 000947 1787829588.809126 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3dafe): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dafe): Mirror 2: 0xceedba0a (stale) Mirror 3: 0xceedba0a (stale) Mirror 4: 0xceedba0a (stale) Mirror 5: 0xceedba0a (stale) CRC-32 checksum value for chunk [0, 0x3dafe): Mirror 1: 0xf9aeda62 Mirror 6: 0xf9aeda62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dafe: skipped 000948 1787829589.837028 read 0x01c286 thru 0x02aa23 (0xe79e bytes) 000950 1787829589.857460 trunc from 0x03dafe to 0x037fe6 (0x5b17 bytes) 000951 1787829589.919119 trunc from 0x037fe7 to 0x01d2c7 (0x1ad1f bytes) 000952 1787829589.941859 read 0x00699f thru 0x010e37 (0xa499 bytes) 000953 1787829589.961956 MIRROR_RESYNC 6 mirrors 000954 1787829591.492775 read 0x01b391 thru 0x01d2c7 (0x1f37 bytes) 000955 1787829591.497508 fallocate 0x01915c thru 0x026508 (0xd3ad bytes) 000956 1787829591.535425 mapwrite 0x03e8d5 thru 0x03ffff (0x172b bytes) 000957 1787829591.575327 punch from 0x036dbc to 0x03ffff (0x9244 bytes) 000958 1787829591.583456 fallocate 0x01f689 thru 0x020ee6 (0x185e bytes) 000959 1787829591.591884 trunc from 0x040000 to 0x00887d (0x37782 bytes) 000960 1787829591.625878 trunc from 0x00887e to 0x009a39 (0x11bc bytes) 000961 1787829591.654031 mapread 0x009063 thru 0x009a39 (0x9d7 bytes) 000962 1787829591.669852 mapwrite 0x033017 thru 0x03fbfa (0xcbe4 bytes) 000963 1787829591.780147 read 0x024f02 thru 0x02bbc5 (0x6cc4 bytes) 000964 1787829591.793948 read 0x03e2fd thru 0x03fbfa (0x18fe bytes) 000965 1787829591.794540 punch from 0x00cf69 to 0x01b7ba (0xe852 bytes) 000966 1787829591.806854 mapwrite 0x00e283 thru 0x01d77d (0xf4fb bytes) 000968 1787829591.925077 mapwrite 0x038aa7 thru 0x038bb2 (0x10c bytes) 000969 1787829591.960026 trunc from 0x03fbfb to 0x028c39 (0x16fc1 bytes) 000970 1787829592.028177 punch from 0x01f4c1 to 0x028c39 (0x9779 bytes) 000972 1787829592.043801 fallocate 0x03b804 thru 0x03ffff (0x47fc bytes) 000973 1787829592.050773 trunc from 0x028c3a to 0x01fdaf (0x8e8a bytes) 000974 1787829592.072359 punch from 0x01c2a0 to 0x01fdaf (0x3b10 bytes) 000975 1787829592.078425 mapread 0x009129 thru 0x015f54 (0xce2c bytes) 000976 1787829592.079791 fallocate 0x02d073 thru 0x039dc8 (0xcd56 bytes) 000977 1787829592.085165 punch from 0x02d39f to 0x031e93 (0x4af5 bytes) 000979 1787829592.110041 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x39dc9): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39dc9): Mirror 2: 0x53f001fe (stale) Mirror 3: 0x53f001fe (stale) Mirror 4: 0x53f001fe (stale) Mirror 5: 0x53f001fe (stale) Mirror 6: 0x53f001fe (stale) CRC-32 checksum value for chunk [0, 0x39dc9): Mirror 1: 0xc800ca04 Mirror 7: 0xc800ca04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39dc9: skipped 000980 1787829593.315860 read 0x0097e2 thru 0x00a788 (0xfa7 bytes) 000981 1787829593.321336 write 0x03e6f1 thru 0x03ffff (0x190f bytes) 000982 1787829593.377186 mapread 0x016efc thru 0x0198cf (0x29d4 bytes) 000983 1787829593.418695 fallocate 0x031ac4 thru 0x033bef (0x212c bytes) 000984 1787829593.423351 write 0x0223af thru 0x022d00 (0x952 bytes) 000985 1787829593.433646 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8f66be27 (stale) Mirror 3: 0x8f66be27 (stale) Mirror 5: 0x8f66be27 (stale) Mirror 6: 0x8f66be27 (stale) Mirror 7: 0x9eac5466 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8f66be27 (stale) Mirror 3: 0x8f66be27 (stale) Mirror 5: 0x8f66be27 (stale) Mirror 6: 0x8f66be27 (stale) Mirror 7: 0x9eac5466 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000986 1787829593.996867 punch from 0x0056f8 to 0x01364f (0xdf58 bytes) 000988 1787829594.007828 trunc from 0x014d4c to 0x0152ea (0x59f bytes) 000989 1787829594.032205 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8f66be27 (stale) Mirror 3: 0x8f66be27 (stale) Mirror 5: 0x8f66be27 (stale) Mirror 6: 0x8f66be27 (stale) Mirror 7: 0x9eac5466 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x35b4b447 Mirror 8: 0x35b4b447 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000990 1787829595.178311 trunc from 0x027a51 to 0x0280ec (0x69c bytes) 000991 1787829595.233156 write 0x03dee8 thru 0x03ffff (0x2118 bytes) 000992 1787829595.263178 write 0x019dd5 thru 0x0299f6 (0xfc22 bytes) 000994 1787829595.282731 mapwrite 0x033228 thru 0x03f1e5 (0xbfbe bytes) 000995 1787829595.384078 MIRROR_RESYNC 7 mirrors 000996 1787829597.241071 read 0x02c286 thru 0x037f92 (0xbd0d bytes) 000997 1787829597.254380 trunc from 0x040000 to 0x02b56e (0x14a91 bytes) 000998 1787829597.311919 MIRROR_RESYNC 7 mirrors 000999 1787829598.824706 trunc from 0x02b56f to 0x023c27 (0x7947 bytes) 001000 1787829598.899264 trunc from 0x023c28 to 0x00b6b4 (0x18573 bytes) All operations completed A-OK!