== sanity-flr test 70a: flr mode fsx test ================ 19:34:01 (1789601641) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 1643 truncating to largest ever: 0x17284 000001 1789601644.036405 trunc from 00000000 to 0x017283 (0x17284 bytes) 000002 1789601644.085775 MIRROR_EXTEND to 2 mirrors 000004 1789601644.924899 write 0x035ab4 thru 0x0375fa (0x1b47 bytes) 000005 1789601644.959274 read 0x0202c7 thru 0x02282b (0x2565 bytes) 000006 1789601644.978052 trunc from 0x00ce77 to 0x00f752 (0x28dc bytes) 000007 1789601645.003675 punch from 0x01bc41 to 0x01f071 (0x3431 bytes) 000008 1789601645.013188 write 0x001a3c thru 0x00697d (0x4f42 bytes) truncating to largest ever: 0x2dd15 000009 1789601645.034381 trunc from 0x0375fb to 0x02dd14 (0x98e6 bytes) 000011 1789601645.061272 punch from 0x028789 to 0x02c185 (0x39fd bytes) 000012 1789601645.066856 punch from 0x02cb21 to 0x02dd14 (0x11f4 bytes) 000013 1789601645.073605 mapread 0x0176ff thru 0x01a697 (0x2f99 bytes) 000015 1789601645.099391 trunc from 0x0016ba to 0x002b06 (0x144d bytes) fallocating to largest ever: 0x3f240 000016 1789601645.113856 fallocate 0x03edc2 thru 0x03f23f (0x47e bytes) 000017 1789601645.118710 fallocate 0x0137c3 thru 0x0166f5 (0x2f33 bytes) 000018 1789601645.125565 punch from 0x02a4ef to 0x02dd14 (0x3826 bytes) 000019 1789601645.130044 trunc from 0x02dd15 to 0x00c24a (0x21aca bytes) 000020 1789601645.153482 mapread 0x00a750 thru 0x00c24a (0x1afb bytes) 000021 1789601645.164318 write 0x02e5c6 thru 0x0349ad (0x63e8 bytes) 000022 1789601645.165834 write 0x035928 thru 0x03a169 (0x4842 bytes) 000023 1789601645.168541 write 0x0177bf thru 0x01e83b (0x707d bytes) 000024 1789601645.186338 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3a16a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a16a): Mirror 2: 0x87143999 (stale) CRC-32 checksum value for chunk [0, 0x3a16a): Mirror 1: 0x1e596f3c Mirror 3: 0x1e596f3c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a16a: skipped 000026 1789601646.403365 trunc from 0x03a16a to 0x01df16 (0x1c253 bytes) 000027 1789601646.491971 trunc from 0x01df17 to 0x01601e (0x7ef8 bytes) 000028 1789601646.510772 trunc from 0x00c2c5 to 0x0116cd (0x5409 bytes) 000029 1789601646.520836 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1601f): Mirror 3: 0x58da22ac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1601f): Mirror 3: 0x58da22ac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1601f: skipped 000030 1789601646.870080 write 0x0398dd thru 0x03ffff (0x6723 bytes) 000031 1789601646.878809 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) 000032 1789601647.099396 trunc from 0x02e936 to 0x032961 (0x402c bytes) 000033 1789601647.106694 read 0x038a2c thru 0x03ffff (0x75d4 bytes) 000034 1789601647.120660 trunc from 0x02328f to 0x031fee (0xed60 bytes) 000035 1789601647.127532 mapwrite 0x00e3f7 thru 0x013a10 (0x561a bytes) 000036 1789601647.173089 trunc from 0x005c5c to 0x00ddcb (0x8170 bytes) 000037 1789601647.181006 write 0x033bd1 thru 0x03ffff (0xc42f bytes) 000040 1789601647.200015 trunc from 0x040000 to 0x02a59b (0x15a64 bytes) 000041 1789601647.224545 punch from 0x0122e6 to 0x018cd9 (0x69f4 bytes) 000042 1789601647.232816 write 0x00587d thru 0x0066af (0xe33 bytes) 000043 1789601647.246466 trunc from 0x02a59c to 0x02d79d (0x3202 bytes) 000045 1789601647.271091 mapread 0x000ab5 thru 0x010969 (0xfeb5 bytes) 000046 1789601647.284594 trunc from 0x00d3a9 to 0x017107 (0x9d5f bytes) 000047 1789601647.290341 punch from 0x02a7bc to 0x02adcb (0x610 bytes) 000048 1789601647.296445 trunc from 0x01a690 to 0x022d97 (0x8708 bytes) 000049 1789601647.303815 write 0x0100de thru 0x01c618 (0xc53b bytes) 000050 1789601647.320638 write 0x02f752 thru 0x03673d (0x6fec bytes) 000052 1789601647.325213 trunc from 0x03673e to 0x038ebc (0x277f bytes) 000053 1789601647.343064 punch from 0x03518c to 0x038ebc (0x3d31 bytes) 000054 1789601647.370622 trunc from 0x038ebd to 0x015871 (0x2364b bytes) 000056 1789601647.393917 write 0x03195b thru 0x0320cc (0x772 bytes) 000058 1789601647.397624 mapwrite 0x007078 thru 0x016dd8 (0xfd61 bytes) 000059 1789601647.434203 trunc from 0x00b31e to 0x015c43 (0xa926 bytes) 000060 1789601647.440091 mapread 0x0158f5 thru 0x016eea (0x15f6 bytes) 000061 1789601647.452789 write 0x031b9d thru 0x039be7 (0x804b bytes) 000062 1789601647.455325 mapread 0x02393e thru 0x02bac8 (0x818b bytes) 000063 1789601647.465893 read 0x02a3c3 thru 0x033106 (0x8d44 bytes) 000064 1789601647.475936 mapread 0x0242bb thru 0x02d614 (0x935a bytes) 000066 1789601647.478803 read 0x036cd9 thru 0x039be7 (0x2f0f bytes) 000067 1789601647.480301 trunc from 0x0242a5 to 0x02555e (0x12ba bytes) 000068 1789601647.485100 trunc from 0x039be8 to 0x03cff5 (0x340e bytes) 000069 1789601647.504065 punch from 0x037a87 to 0x03cff5 (0x556f bytes) 000070 1789601647.521811 mapwrite 0x022d9d thru 0x030c39 (0xde9d bytes) 000072 1789601647.557483 read 0x01b35e thru 0x01e911 (0x35b4 bytes) 000073 1789601647.558270 trunc from 0x0288b4 to 0x033d7a (0xb4c7 bytes) 000074 1789601647.564621 punch from 0x03c720 to 0x03cff5 (0x8d6 bytes) 000076 1789601647.571814 mapread 0x035f49 thru 0x0372a8 (0x1360 bytes) 000077 1789601647.574038 punch from 0x01e81a to 0x023a25 (0x520c bytes) 000078 1789601647.579294 write 0x01a4af thru 0x021d15 (0x7867 bytes) 000079 1789601647.585490 read 0x0344a8 thru 0x03cff5 (0x8b4e bytes) 000081 1789601647.593867 fallocate 0x015d75 thru 0x019940 (0x3bcc bytes) 000083 1789601647.600011 fallocate 0x027a59 thru 0x035eee (0xe496 bytes) 000086 1789601647.606463 fallocate 0x03dd07 thru 0x03ddad (0xa7 bytes) 000090 1789601647.614369 trunc from 0x03ddae to 0x039e01 (0x3fac bytes) 000091 1789601647.630487 mapread 0x0241e4 thru 0x0336cc (0xf4e9 bytes) 000092 1789601647.632751 trunc from 0x039e02 to 0x02356a (0x16897 bytes) 000093 1789601647.650833 mapread 0x01aa9e thru 0x023362 (0x88c5 bytes) 000095 1789601647.654825 trunc from 0x012df1 to 0x0225fe (0xf80e bytes) 000096 1789601647.668617 read 0x00adec thru 0x011516 (0x672b bytes) 000097 1789601647.670500 punch from 0x00609b to 0x014367 (0xe2cd bytes) 000098 1789601647.676930 read 0x01c86b thru 0x02356a (0x6d00 bytes) 000099 1789601647.687634 trunc from 0x003cfe to 0x00b762 (0x7a65 bytes) 000100 1789601647.693424 mapread 0x00346f thru 0x008b65 (0x56f7 bytes) 000101 1789601647.733991 mapread 0x00138f thru 0x00aaab (0x971d bytes) 000102 1789601647.747919 read 0x009643 thru 0x01051b (0x6ed9 bytes) 000104 1789601647.757225 mapread 0x00e605 thru 0x01e3a4 (0xfda0 bytes) 000105 1789601647.760291 mapread 0x01a5d2 thru 0x02356a (0x8f99 bytes) 000106 1789601647.763432 trunc from 0x02356b to 0x00d26f (0x162fb bytes) 000107 1789601647.782196 mapread 0x002884 thru 0x00d26f (0xa9ec bytes) 000108 1789601647.783500 fallocate 0x000456 thru 0x00da2e (0xd5d9 bytes) 000109 1789601647.791237 fallocate 0x024b10 thru 0x02b4dd (0x69ce bytes) 000110 1789601647.798683 mapwrite 0x0065a1 thru 0x015d75 (0xf7d5 bytes) 000111 1789601647.890372 MIRROR_EXTEND to 2 mirrors 000112 1789601648.866673 read 0x002025 thru 0x008988 (0x6964 bytes) 000114 1789601648.910763 write 0x02ed60 thru 0x03b922 (0xcbc3 bytes) 000115 1789601648.967137 write 0x00d905 thru 0x011a37 (0x4133 bytes) 000116 1789601648.982020 trunc from 0x00084c to 0x00e62a (0xdddf bytes) 000117 1789601648.998673 write 0x006213 thru 0x0080da (0x1ec8 bytes) 000120 1789601649.009477 trunc from 0x03b923 to 0x010385 (0x2b59d bytes) 000121 1789601649.027207 mapread 0x00c4dd thru 0x010385 (0x3ea9 bytes) 000122 1789601649.044139 mapwrite 0x0253d0 thru 0x027417 (0x2048 bytes) 000123 1789601649.098314 trunc from 0x00bbe1 to 0x013ab9 (0x7ed9 bytes) 000124 1789601649.105286 trunc from 0x004fe9 to 0x013665 (0xe67d bytes) 000125 1789601649.114559 trunc from 0x027418 to 0x030b3c (0x9725 bytes) 000126 1789601649.173028 MIRROR_RESYNC 2 mirrors 000128 1789601650.044407 write 0x029e5c thru 0x03162e (0x77d3 bytes) 000129 1789601650.100451 punch from 0x008f74 to 0x0092e9 (0x376 bytes) 000130 1789601650.109595 mapwrite 0x03cd43 thru 0x03d1ee (0x4ac bytes) 000131 1789601650.184905 mapwrite 0x02cadc thru 0x02e451 (0x1976 bytes) 000132 1789601650.202321 punch from 0x01b374 to 0x024115 (0x8da2 bytes) 000133 1789601650.207623 trunc from 0x0098d2 to 0x00fd7a (0x64a9 bytes) 000134 1789601650.213234 read 0x0039f8 thru 0x0095a4 (0x5bad bytes) 000135 1789601650.222752 trunc from 0x01a8ed to 0x020c6b (0x637f bytes) 000136 1789601650.242451 fallocate 0x0356cb thru 0x036fff (0x1935 bytes) 000137 1789601650.249418 trunc from 0x000933 to 0x004dae (0x447c bytes) 000138 1789601650.254556 write 0x01c170 thru 0x025117 (0x8fa8 bytes) 000139 1789601650.272818 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d1ef): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d1ef): Mirror 2: 0x45dcdf4d (stale) CRC-32 checksum value for chunk [0, 0x3d1ef): Mirror 1: 0x59d0c350 Mirror 3: 0x59d0c350 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d1ef: skipped 000140 1789601651.340425 fallocate 0x0324c7 thru 0x038c4e (0x6788 bytes) 000141 1789601651.405936 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3d1ef): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d1ef): Mirror 2: 0x45dcdf4d (stale) Mirror 3: 0x59d0c350 (stale) CRC-32 checksum value for chunk [0, 0x3d1ef): Mirror 1: 0x59d0c350 Mirror 4: 0x59d0c350 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d1ef: skipped 000142 1789601652.510845 fallocate 0x012f16 thru 0x01b45f (0x854a bytes) 000143 1789601652.563589 read 0x0315c6 thru 0x03752f (0x5f6a bytes) 000144 1789601652.574591 trunc from 0x03d1ef to 0x012af8 (0x2a6f6 bytes) 000145 1789601652.603859 fallocate 0x01fef9 thru 0x0247fe (0x4906 bytes) 000146 1789601652.610490 read 0x00fa5d thru 0x012af8 (0x309c bytes) 000147 1789601652.631033 trunc from 0x00fb5b to 0x012af8 (0x2f9e bytes) 000149 1789601652.635540 mapread 0x000faa thru 0x00b6f8 (0xa74f bytes) 000150 1789601652.636802 punch from 0x00ac45 to 0x011159 (0x6515 bytes) 000151 1789601652.642744 punch from 0x00e91a to 0x012af8 (0x41df bytes) 000152 1789601652.650330 mapwrite 0x003bc4 thru 0x009cf6 (0x6133 bytes) 000153 1789601652.689066 mapread 0x00ff10 thru 0x012af8 (0x2be9 bytes) 000154 1789601652.737211 write 0x0117cb thru 0x015b85 (0x43bb bytes) 000155 1789601652.738397 read 0x01255b thru 0x01375d (0x1203 bytes) 000156 1789601652.741149 write 0x00d08e thru 0x01194d (0x48c0 bytes) 000157 1789601652.768117 fallocate 0x00eea2 thru 0x016208 (0x7367 bytes) 000158 1789601652.786657 punch from 0x00c188 to 0x010768 (0x45e1 bytes) 000159 1789601652.856013 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15b86): Mirror 3: 0xcd676388 (stale) Mirror 4: 0xcd676388 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15b86): Mirror 3: 0xcd676388 (stale) Mirror 4: 0xcd676388 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15b86: skipped 000161 1789601653.263427 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15b86): Mirror 4: 0xcd676388 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15b86): Mirror 4: 0xcd676388 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15b86: skipped 000162 1789601653.587687 fallocate 0x00ee3d thru 0x0198d4 (0xaa98 bytes) 000163 1789601653.591625 trunc from 0x018c00 to 0x0198d4 (0xcd5 bytes) 000164 1789601653.601840 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x198d5): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x198d5): Mirror 4: 0xdb0688a2 (stale) CRC-32 checksum value for chunk [0, 0x198d5): Mirror 1: 0x5ae41c8f Mirror 5: 0x5ae41c8f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x198d5: skipped 000166 1789601654.973986 trunc from 0x00dd85 to 0x011e20 (0x409c bytes) 000167 1789601655.076845 read 0x000201 thru 0x00173e (0x153e bytes) 000168 1789601655.085056 fallocate 0x009c00 thru 0x01176f (0x7b70 bytes) 000169 1789601655.092492 read 0x00341f thru 0x00855a (0x513c bytes) 000170 1789601655.116183 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x198d5): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x198d5): Mirror 4: 0xdb0688a2 (stale) Mirror 5: 0x5ae41c8f (stale) CRC-32 checksum value for chunk [0, 0x198d5): Mirror 1: 0xe5857fd0 Mirror 6: 0xe5857fd0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x198d5: skipped 000171 1789601656.328351 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x198d5): Mirror 4: 0xdb0688a2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x198d5): Mirror 4: 0xdb0688a2 (stale) CRC-32 checksum value for chunk [0, 0x198d5): Mirror 1: 0xe5857fd0 Mirror 6: 0xe5857fd0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x198d5: skipped 000172 1789601657.112046 write 0x013d39 thru 0x020a33 (0xccfb bytes) 000173 1789601657.169374 punch from 0x010b49 to 0x013732 (0x2bea bytes) 000174 1789601657.187914 fallocate 0x02449f thru 0x0246b3 (0x215 bytes) 000175 1789601657.206806 punch from 0x01c259 to 0x01d909 (0x16b1 bytes) 000177 1789601657.224333 mapwrite 0x03c5e3 thru 0x03ffff (0x3a1d bytes) 000179 1789601657.368207 trunc from 0x040000 to 0x02ccef (0x13310 bytes) 000180 1789601657.401699 MIRROR_RESYNC 3 mirrors 000181 1789601658.619484 trunc from 0x024681 to 0x02ccef (0x866f bytes) 000182 1789601658.677560 trunc from 0x02ccf0 to 0x01f986 (0xd369 bytes) fallocating to largest ever: 0x40000 000183 1789601658.710505 fallocate 0x03cbf7 thru 0x03ffff (0x3409 bytes) 000184 1789601658.717437 mapwrite 0x0110c5 thru 0x01a684 (0x95c0 bytes) 000185 1789601658.805318 fallocate 0x022b6e thru 0x028e88 (0x631b bytes) 000186 1789601658.843015 MIRROR_RESYNC 3 mirrors 000187 1789601660.094579 MIRROR_RESYNC 3 mirrors 000189 1789601660.637450 fallocate 0x036201 thru 0x03ffff (0x9dff bytes) 000190 1789601660.668130 write 0x008f93 thru 0x00acb9 (0x1d27 bytes) 000191 1789601660.678771 trunc from 0x01b098 to 0x01e121 (0x308a bytes) 000192 1789601660.687266 trunc from 0x040000 to 0x016522 (0x29add bytes) 000193 1789601660.731381 read 0x00b294 thru 0x010b68 (0x58d5 bytes) 000194 1789601660.764310 trunc from 0x016523 to 0x0114eb (0x5037 bytes) 000195 1789601660.798401 fallocate 0x01d91d thru 0x026dce (0x94b2 bytes) 000196 1789601660.809199 trunc from 0x01d261 to 0x026dce (0x9b6e bytes) 000197 1789601660.817457 fallocate 0x03ed11 thru 0x03ffff (0x12ef bytes) 000198 1789601660.833570 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb4503d8c (stale) Mirror 6: 0xb4503d8c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc33a2647 Mirror 7: 0xc33a2647 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000199 1789601661.862460 punch from 0x01403c to 0x02058c (0xc551 bytes) 000200 1789601661.924931 write 0x002a3c thru 0x00e7ef (0xbdb4 bytes) 000201 1789601661.942365 fallocate 0x03b74a thru 0x03ffff (0x48b6 bytes) 000202 1789601661.947078 mapwrite 0x02497f thru 0x02be06 (0x7488 bytes) 000205 1789601662.006844 mapwrite 0x024e4c thru 0x02517d (0x332 bytes) 000206 1789601662.027561 fallocate 0x002d7a thru 0x0043fa (0x1681 bytes) 000207 1789601662.031561 mapread 0x03dd36 thru 0x03ffff (0x22ca bytes) 000208 1789601662.070331 MIRROR_RESYNC 4 mirrors 000209 1789601663.548051 read 0x0176e8 thru 0x02221e (0xab37 bytes) 000210 1789601663.556780 read 0x00d776 thru 0x00edf9 (0x1684 bytes) 000211 1789601663.569259 punch from 0x009536 to 0x011a59 (0x8524 bytes) 000212 1789601663.598833 trunc from 0x017bdf to 0x021ce5 (0xa107 bytes) 000213 1789601663.603685 mapread 0x0063f9 thru 0x0142d1 (0xded9 bytes) 000214 1789601663.761175 punch from 0x015694 to 0x01f7be (0xa12b bytes) 000215 1789601663.769411 write 0x0096dd thru 0x0108d4 (0x71f8 bytes) 000216 1789601663.775185 read 0x00ea8f thru 0x00f436 (0x9a8 bytes) 000217 1789601663.775885 read 0x01c2e9 thru 0x0237ad (0x74c5 bytes) 000218 1789601663.786225 mapread 0x01391f thru 0x0214b5 (0xdb97 bytes) 000219 1789601663.787290 fallocate 0x039bb9 thru 0x03ffff (0x6447 bytes) 000220 1789601663.798976 mapwrite 0x021988 thru 0x02bd85 (0xa3fe bytes) 000221 1789601663.827710 fallocate 0x001b0b thru 0x010b6f (0xf065 bytes) 000222 1789601663.834210 write 0x0008bb thru 0x004ff6 (0x473c bytes) 000224 1789601663.839184 trunc from 0x040000 to 0x03b490 (0x4b6f bytes) 000225 1789601663.865584 fallocate 0x0086a9 thru 0x010ab6 (0x840e bytes) 000226 1789601663.877876 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3b491): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b491): Mirror 4: 0xf689b7a6 (stale) Mirror 6: 0xf689b7a6 (stale) Mirror 7: 0xf689b7a6 (stale) CRC-32 checksum value for chunk [0, 0x3b491): Mirror 1: 0xb311a78a Mirror 8: 0xb311a78a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b491: skipped 000227 1789601664.814759 fallocate 0x017c0d thru 0x025e23 (0xe217 bytes) 000229 1789601664.889594 write 0x01878e thru 0x019908 (0x117b bytes) 000230 1789601664.911325 mapread 0x011f93 thru 0x016549 (0x45b7 bytes) 000231 1789601664.944011 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b491): Mirror 4: 0xf689b7a6 (stale) Mirror 6: 0xf689b7a6 (stale) Mirror 8: 0xb311a78a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b491): Mirror 4: 0xf689b7a6 (stale) Mirror 6: 0xf689b7a6 (stale) Mirror 8: 0xb311a78a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b491: skipped 000232 1789601665.506174 trunc from 0x03b491 to 0x03fd4c (0x48bc bytes) 000233 1789601665.561792 punch from 0x03396a to 0x0398b6 (0x5f4d bytes) 000234 1789601665.571213 trunc from 0x03fd4d to 0x00725e (0x38aee bytes) 000235 1789601665.620663 fallocate 0x01e55d thru 0x02aab3 (0xc557 bytes) 000236 1789601665.648412 punch from 0x005596 to 0x00725e (0x1cc9 bytes) 000237 1789601665.674368 trunc from 0x00725f to 0x02c1ae (0x24f50 bytes) 000238 1789601665.714119 punch from 0x002504 to 0x0124a5 (0xffa2 bytes) 000239 1789601665.725193 mapread 0x01cb82 thru 0x02b3b0 (0xe82f bytes) 000240 1789601665.775070 write 0x02a6cb thru 0x031ebf (0x77f5 bytes) 000241 1789601665.779121 read 0x00a4f8 thru 0x014b86 (0xa68f bytes) 000242 1789601665.800760 punch from 0x010848 to 0x0196ac (0x8e65 bytes) 000243 1789601665.816663 write 0x028232 thru 0x02c71f (0x44ee bytes) 000244 1789601665.825812 read 0x00c21b thru 0x012370 (0x6156 bytes) 000245 1789601665.838934 read 0x031849 thru 0x031ebf (0x677 bytes) 000246 1789601665.840576 write 0x011b21 thru 0x014260 (0x2740 bytes) 000247 1789601665.848561 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31ec0): Mirror 4: 0x8a4e11ec (stale) Mirror 8: 0x625a2e48 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31ec0): Mirror 4: 0x8a4e11ec (stale) Mirror 8: 0x625a2e48 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31ec0: skipped 000248 1789601666.422312 punch from 0x010da4 to 0x015b50 (0x4dad bytes) 000249 1789601666.427874 trunc from 0x031ec0 to 0x028e36 (0x9089 bytes) 000250 1789601666.448147 mapwrite 0x00ff61 thru 0x014930 (0x49d0 bytes) 000251 1789601666.480868 read 0x022bf0 thru 0x024c10 (0x2021 bytes) 000252 1789601666.486511 trunc from 0x01ed4c to 0x028e36 (0xa0eb bytes) 000253 1789601666.491623 trunc from 0x028e37 to 0x025663 (0x37d3 bytes) 000254 1789601666.504578 write 0x026185 thru 0x02e647 (0x84c3 bytes) 000255 1789601666.507732 punch from 0x01cdde to 0x021034 (0x4257 bytes) 000256 1789601666.528428 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2e648): Mirror 4: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e648): Mirror 4: 0xeff9495c (stale) Mirror 8: 0x48cffc4e (stale) CRC-32 checksum value for chunk [0, 0x2e648): Mirror 1: 0x6eac9029 Mirror 9: 0x6eac9029 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e648: skipped 000257 1789601667.674503 write 0x01de68 thru 0x01f01a (0x11b3 bytes) 000258 1789601667.745638 read 0x00f05c thru 0x01cc17 (0xdbbc bytes) 000259 1789601667.772916 punch from 0x0142af to 0x0176a4 (0x33f6 bytes) 000260 1789601667.788365 trunc from 0x02e648 to 0x014d1b (0x1992c bytes) 000261 1789601667.828735 read 0x004fe2 thru 0x00e1f2 (0x9211 bytes) 000262 1789601667.846460 mapread 0x0123d2 thru 0x013fec (0x1c1b bytes) 000264 1789601667.848838 punch from 0x009638 to 0x00a64b (0x1014 bytes) 000265 1789601667.868924 write 0x00f7c0 thru 0x018cad (0x94ee bytes) 000266 1789601667.871041 fallocate 0x017398 thru 0x01b9b1 (0x461a bytes) 000267 1789601667.883391 read 0x01750c thru 0x018cad (0x17a2 bytes) 000268 1789601667.885315 mapwrite 0x025448 thru 0x0340e2 (0xec9b bytes) 000269 1789601667.974346 punch from 0x00335d to 0x008b11 (0x57b5 bytes) 000270 1789601667.994559 mapwrite 0x017849 thru 0x01b4fc (0x3cb4 bytes) 000271 1789601668.048385 write 0x03918e thru 0x03af11 (0x1d84 bytes) 000272 1789601668.049862 trunc from 0x0208cd to 0x027e1f (0x7553 bytes) 000273 1789601668.057497 trunc from 0x03af12 to 0x039ace (0x1443 bytes) 000274 1789601668.110097 MIRROR_RESYNC 4 mirrors 000275 1789601669.695218 write 0x013287 thru 0x01a368 (0x70e2 bytes) 000276 1789601669.759452 trunc from 0x00aa3d to 0x00bd2c (0x12f0 bytes) 000277 1789601669.791729 mapread 0x01aaea thru 0x02208e (0x75a5 bytes) 000278 1789601669.821834 mapwrite 0x03a222 thru 0x03affe (0xddd bytes) 000279 1789601669.895478 read 0x020489 thru 0x02c5ae (0xc126 bytes) 000280 1789601669.917212 punch from 0x03564e to 0x03a658 (0x500b bytes) 000281 1789601669.931478 mapread 0x01d239 thru 0x021f22 (0x4cea bytes) 000282 1789601669.938193 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3afff): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afff): Mirror 4: 0xd58abc6f (stale) Mirror 8: 0xd58abc6f (stale) Mirror 9: 0xd58abc6f (stale) CRC-32 checksum value for chunk [0, 0x3afff): Mirror 1: 0xe736391f Mirror 10: 0xe736391f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afff: skipped 000283 1789601671.345195 mapread 0x013761 thru 0x01f159 (0xb9f9 bytes) 000284 1789601671.415355 trunc from 0x00f537 to 0x0158b3 (0x637d bytes) 000285 1789601671.458138 mapwrite 0x001326 thru 0x00b8d8 (0xa5b3 bytes) 000286 1789601671.493097 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3afff): Mirror 4: 0xd58abc6f (stale) Mirror 9: 0xd58abc6f (stale) Mirror 10: 0xe736391f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afff): Mirror 4: 0xd58abc6f (stale) Mirror 9: 0xd58abc6f (stale) Mirror 10: 0xe736391f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afff: skipped 000287 1789601671.889509 fallocate 0x0102d5 thru 0x0120cc (0x1df8 bytes) 000289 1789601671.897660 fallocate 0x01f9c9 thru 0x02c285 (0xc8bd bytes) 000290 1789601671.904067 punch from 0x01e0e8 to 0x024ece (0x6de7 bytes) 000291 1789601671.911412 mapwrite 0x0050ab thru 0x008c1d (0x3b73 bytes) 000292 1789601671.954535 trunc from 0x014e2a to 0x0165fc (0x17d3 bytes) 000293 1789601671.964827 trunc from 0x02570c to 0x032aeb (0xd3e0 bytes) 000294 1789601671.973848 mapread 0x01ac13 thru 0x027b2a (0xcf18 bytes) 000295 1789601672.020438 read 0x01a9b0 thru 0x025daf (0xb400 bytes) 000296 1789601672.021286 punch from 0x029c00 to 0x033d70 (0xa171 bytes) 000297 1789601672.031622 mapread 0x02860a thru 0x02c06b (0x3a62 bytes) 000298 1789601672.047847 trunc from 0x03afff to 0x02a373 (0x10c8b bytes) 000299 1789601672.080800 punch from 0x0097fb to 0x00b9dc (0x21e2 bytes) 000300 1789601672.099752 mapread 0x007f25 thru 0x016c33 (0xed0f bytes) 000301 1789601672.154457 trunc from 0x004a43 to 0x00dae7 (0x90a5 bytes) 000302 1789601672.167494 trunc from 0x00271b to 0x005466 (0x2d4c bytes) 000303 1789601672.183324 fallocate 0x024735 thru 0x031a03 (0xd2cf bytes) 000304 1789601672.194697 read 0x00d21f thru 0x016c4b (0x9a2d bytes) 000305 1789601672.213818 write 0x0193f4 thru 0x02292e (0x953b bytes) 000306 1789601672.216755 read 0x020b47 thru 0x024b56 (0x4010 bytes) 000307 1789601672.217488 read 0x029ec0 thru 0x031a03 (0x7b44 bytes) 000308 1789601672.218820 mapwrite 0x03483f thru 0x03d091 (0x8853 bytes) 000309 1789601672.316048 mapwrite 0x012e0d thru 0x01b423 (0x8617 bytes) 000310 1789601672.350936 write 0x017dda thru 0x02240d (0xa634 bytes) 000311 1789601672.352304 read 0x024c2f thru 0x02fe90 (0xb262 bytes) 000312 1789601672.352858 write 0x02e288 thru 0x032b0a (0x4883 bytes) 000313 1789601672.357238 trunc from 0x03d092 to 0x00c93c (0x30755 bytes) 000314 1789601672.388824 punch from 0x00b993 to 0x00c93c (0xfaa bytes) 000315 1789601672.393637 fallocate 0x01c50f thru 0x029fba (0xdaac bytes) 000316 1789601672.403006 mapwrite 0x00974d thru 0x01803f (0xe8f3 bytes) 000317 1789601672.461797 mapread 0x00a5ac thru 0x015466 (0xaebb bytes) 000318 1789601672.463260 trunc from 0x004e10 to 0x00af80 (0x6171 bytes) 000319 1789601672.475158 write 0x00e1e4 thru 0x018b5a (0xa977 bytes) 000320 1789601672.476542 write 0x01a194 thru 0x020ada (0x6947 bytes) 000321 1789601672.479301 trunc from 0x0153ba to 0x020ada (0xb721 bytes) 000322 1789601672.496912 punch from 0x006fd8 to 0x009a3c (0x2a65 bytes) 000323 1789601672.505509 punch from 0x00fed5 to 0x0165b2 (0x66de bytes) 000324 1789601672.514401 write 0x01e20a thru 0x020deb (0x2be2 bytes) 000326 1789601672.529764 trunc from 0x01a885 to 0x01eb45 (0x42c1 bytes) 000327 1789601672.544200 mapread 0x0170b1 thru 0x020deb (0x9d3b bytes) 000328 1789601672.614336 write 0x01cdc2 thru 0x02a056 (0xd295 bytes) 000329 1789601672.616919 fallocate 0x02030a thru 0x02130a (0x1001 bytes) 000330 1789601672.622662 mapwrite 0x0161d2 thru 0x016ed7 (0xd06 bytes) 000331 1789601672.665031 write 0x02b1eb thru 0x039b9b (0xe9b1 bytes) 000332 1789601672.666718 write 0x01dbff thru 0x01dfa1 (0x3a3 bytes) 000333 1789601672.674514 fallocate 0x037aff thru 0x039a4a (0x1f4c bytes) 000334 1789601672.687174 trunc from 0x039b9c to 0x02d161 (0xca3a bytes) 000335 1789601672.736024 write 0x02c836 thru 0x03334f (0x6b1a bytes) 000336 1789601672.751132 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x33350): Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33350): Mirror 4: 0x3de4e068 (stale) Mirror 9: 0x3de4e068 (stale) Mirror 10: 0x67a54040 (stale) CRC-32 checksum value for chunk [0, 0x33350): Mirror 1: 0x6f257797 Mirror 11: 0x6f257797 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33350: skipped 000337 1789601673.835939 write 0x000866 thru 0x00256d (0x1d08 bytes) 000338 1789601673.892531 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x33350): Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33350): Mirror 4: 0x3de4e068 (stale) Mirror 9: 0x3de4e068 (stale) Mirror 10: 0x67a54040 (stale) Mirror 11: 0x6f257797 (stale) CRC-32 checksum value for chunk [0, 0x33350): Mirror 1: 0x4037bf52 Mirror 12: 0x4037bf52 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33350: skipped 000339 1789601675.184103 mapwrite 0x036766 thru 0x03ffff (0x989a bytes) 000340 1789601675.348579 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe40c4889 (stale) Mirror 9: 0xe40c4889 (stale) Mirror 10: 0x3f27c91e (stale) Mirror 11: 0xd78f9121 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe40c4889 (stale) Mirror 9: 0xe40c4889 (stale) Mirror 10: 0x3f27c91e (stale) Mirror 11: 0xd78f9121 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000341 1789601675.921627 write 0x00d1b7 thru 0x012ca7 (0x5af1 bytes) 000342 1789601675.970401 punch from 0x002a47 to 0x0121d2 (0xf78c bytes) 000343 1789601675.994334 mapwrite 0x007292 thru 0x01378b (0xc4fa bytes) 000344 1789601676.079677 punch from 0x00b349 to 0x0175d3 (0xc28b bytes) 000346 1789601676.089489 trunc from 0x040000 to 0x017342 (0x28cbd bytes) 000348 1789601676.117524 trunc from 0x007771 to 0x016372 (0xec02 bytes) 000349 1789601676.123530 write 0x0162a0 thru 0x023817 (0xd578 bytes) 000350 1789601676.134900 trunc from 0x023818 to 0x0325e8 (0xedd1 bytes) 000351 1789601676.156246 trunc from 0x0325e9 to 0x025e44 (0xc7a4 bytes) 000352 1789601676.174457 mapread 0x000165 thru 0x00c16e (0xc00a bytes) 000353 1789601676.192411 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25e45): Mirror 4: 0x545462f6 (stale) Mirror 10: 0xbcd99b14 (stale) Mirror 11: 0xefff9cf3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25e45): Mirror 4: 0x545462f6 (stale) Mirror 10: 0xbcd99b14 (stale) Mirror 11: 0xefff9cf3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25e45: skipped 000354 1789601676.750624 mapwrite 0x03cd7a thru 0x03ffff (0x3286 bytes) 000355 1789601676.856250 read 0x02ffae thru 0x03e2ea (0xe33d bytes) 000356 1789601676.882786 trunc from 0x040000 to 0x009df2 (0x3620d bytes) 000357 1789601676.924571 punch from 0x0047cb to 0x009df2 (0x5628 bytes) 000358 1789601676.934808 mapread 0x003b78 thru 0x009df2 (0x627b bytes) 000359 1789601676.955559 trunc from 0x003a96 to 0x009df2 (0x635d bytes) 000360 1789601676.964428 trunc from 0x009df3 to 0x02ec27 (0x24e35 bytes) 000362 1789601677.005787 trunc from 0x02ec28 to 0x016716 (0x18511 bytes) 000363 1789601677.033836 trunc from 0x0134d3 to 0x016716 (0x3244 bytes) 000364 1789601677.043187 write 0x02ae54 thru 0x0387d8 (0xd985 bytes) 000365 1789601677.048777 trunc from 0x01f10b to 0x02e66f (0xf565 bytes) 000366 1789601677.070837 write 0x013436 thru 0x01dbd6 (0xa7a1 bytes) 000367 1789601677.098763 MIRROR_RESYNC 4 mirrors 000368 1789601678.750493 mapread 0x015181 thru 0x01f00e (0x9e8e bytes) 000369 1789601678.778172 trunc from 0x01ed0c to 0x024f83 (0x6278 bytes) 000370 1789601678.822944 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x387d9): Mirror 4: 0x5c8d3d20 (stale) Mirror 10: 0x5c8d3d20 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x387d9): Mirror 4: 0x5c8d3d20 (stale) Mirror 10: 0x5c8d3d20 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x387d9: skipped 000372 1789601679.357245 mapwrite 0x01943c thru 0x020334 (0x6ef9 bytes) 000373 1789601679.409458 mapwrite 0x02cc72 thru 0x02f356 (0x26e5 bytes) 000374 1789601679.433937 trunc from 0x033c3f to 0x0387d8 (0x4b9a bytes) 000375 1789601679.439920 fallocate 0x00e762 thru 0x0115f7 (0x2e96 bytes) 000376 1789601679.452334 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x387d9): Mirror 4: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x387d9): Mirror 4: 0x5c8d3d20 (stale) Mirror 10: 0x5c8d3d20 (stale) CRC-32 checksum value for chunk [0, 0x387d9): Mirror 1: 0xb7dd65e5 Mirror 11: 0xb7dd65e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x387d9: skipped 000377 1789601680.819550 fallocate 0x03f4bb thru 0x03ffff (0xb45 bytes) 000379 1789601680.878189 read 0x022030 thru 0x031174 (0xf145 bytes) 000380 1789601680.887305 trunc from 0x040000 to 0x01026a (0x2fd95 bytes) 000381 1789601680.946856 MIRROR_RESYNC 4 mirrors 000382 1789601681.845897 trunc from 0x003b41 to 0x008dcd (0x528d bytes) 000383 1789601681.876598 punch from 0x00cbf0 to 0x01026a (0x367b bytes) 000385 1789601681.883683 mapread 0x003070 thru 0x003862 (0x7f3 bytes) 000387 1789601681.890548 read 0x007e55 thru 0x01026a (0x8416 bytes) 000388 1789601681.898637 trunc from 0x005c46 to 0x00bc9f (0x605a bytes) 000389 1789601681.902728 read 0x00ba1e thru 0x01026a (0x484d bytes) 000390 1789601681.912907 write 0x031fbe thru 0x038f6b (0x6fae bytes) 000391 1789601681.914478 mapwrite 0x00cab3 thru 0x00f6ec (0x2c3a bytes) 000392 1789601681.938223 punch from 0x00f8da to 0x018d53 (0x947a bytes) 000393 1789601681.943479 mapwrite 0x019877 thru 0x022f60 (0x96ea bytes) 000394 1789601681.973350 trunc from 0x038f6c to 0x01192f (0x2763c bytes) 000395 1789601681.998490 mapwrite 0x00d512 thru 0x00dc02 (0x6f1 bytes) 000396 1789601682.009495 write 0x01ccdc thru 0x021158 (0x447d bytes) 000397 1789601682.010803 trunc from 0x0113ef to 0x015f7e (0x4b90 bytes) 000398 1789601682.019560 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x21159): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21159): Mirror 4: 0x1928ddf0 (stale) Mirror 10: 0x1928ddf0 (stale) Mirror 11: 0x1928ddf0 (stale) CRC-32 checksum value for chunk [0, 0x21159): Mirror 1: 0xb44f13ce Mirror 12: 0xb44f13ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21159: skipped 000399 1789601683.477685 write 0x006420 thru 0x007b29 (0x170a bytes) 000401 1789601683.527266 punch from 0x00298f to 0x003a00 (0x1072 bytes) 000403 1789601683.531821 trunc from 0x01fac0 to 0x021158 (0x1699 bytes) 000404 1789601683.538231 write 0x03216b thru 0x034c17 (0x2aad bytes) 000405 1789601683.539619 trunc from 0x014a71 to 0x01500b (0x59b bytes) 000407 1789601683.544162 read 0x010ca5 thru 0x011a68 (0xdc4 bytes) 000408 1789601683.549148 trunc from 0x00e2e0 to 0x0122c9 (0x3fea bytes) 000409 1789601683.554049 trunc from 0x034c18 to 0x0257e1 (0xf436 bytes) 000410 1789601683.572832 fallocate 0x02b9bb thru 0x03405d (0x86a3 bytes) 000411 1789601683.579295 fallocate 0x011f4f thru 0x01c536 (0xa5e8 bytes) 000412 1789601683.583674 write 0x00ad66 thru 0x01502d (0xa2c8 bytes) 000413 1789601683.593855 punch from 0x0088d5 to 0x013421 (0xab4d bytes) 000414 1789601683.609726 write 0x0039c0 thru 0x011bf2 (0xe233 bytes) 000415 1789601683.619804 trunc from 0x024db6 to 0x0257e1 (0xa2c bytes) 000417 1789601683.624728 punch from 0x01d414 to 0x0257e1 (0x83ce bytes) 000418 1789601683.629583 read 0x00f160 thru 0x015436 (0x62d7 bytes) 000419 1789601683.638479 write 0x02fb0f thru 0x03bf7b (0xc46d bytes) 000420 1789601683.641383 trunc from 0x03bf7c to 0x00e5eb (0x2d990 bytes) 000421 1789601683.659141 mapwrite 0x0356f6 thru 0x036b88 (0x1493 bytes) 000422 1789601683.710774 fallocate 0x03accc thru 0x03b332 (0x667 bytes) 000423 1789601683.716874 trunc from 0x01f96e to 0x022ee4 (0x3577 bytes) 000424 1789601683.722230 trunc from 0x00b700 to 0x016cf0 (0xb5f1 bytes) 000425 1789601683.727713 mapread 0x02e3a8 thru 0x036b88 (0x87e1 bytes) 000426 1789601683.733484 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x36b89): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36b89): Mirror 4: 0x82be42af (stale) Mirror 10: 0x82be42af (stale) Mirror 11: 0x82be42af (stale) Mirror 12: 0xf27deca7 (stale) CRC-32 checksum value for chunk [0, 0x36b89): Mirror 1: 0x9c530644 Mirror 13: 0x9c530644 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36b89: skipped 000427 1789601685.019891 mapread 0x0363b6 thru 0x036b88 (0x7d3 bytes) 000428 1789601685.066576 read 0x00a0eb thru 0x011032 (0x6f48 bytes) 000430 1789601685.106323 punch from 0x02292d to 0x025238 (0x290c bytes) 000431 1789601685.196776 trunc from 0x02856c to 0x02e72d (0x61c2 bytes) 000432 1789601685.202363 trunc from 0x036b89 to 0x0223ce (0x147ba bytes) 000433 1789601685.244412 mapread 0x0075de thru 0x0078e4 (0x307 bytes) 000434 1789601685.250538 mapread 0x004bc0 thru 0x00d09b (0x84dc bytes) 000435 1789601685.277392 trunc from 0x0223cf to 0x00b2c5 (0x17109 bytes) 000436 1789601685.308277 mapread 0x00337c thru 0x00b2c5 (0x7f4a bytes) 000437 1789601685.310466 write 0x029114 thru 0x02af9d (0x1e8a bytes) 000439 1789601685.312849 read 0x006938 thru 0x00aaf8 (0x41c1 bytes) 000440 1789601685.313474 write 0x003807 thru 0x0129a7 (0xf1a1 bytes) 000441 1789601685.328177 mapread 0x0249a3 thru 0x02af9d (0x65fb bytes) 000443 1789601685.358701 write 0x03d2bc thru 0x03d9dc (0x721 bytes) 000444 1789601685.364123 punch from 0x023700 to 0x02de80 (0xa781 bytes) 000445 1789601685.396066 fallocate 0x02dbd9 thru 0x03d755 (0xfb7d bytes) 000446 1789601685.406236 write 0x0219f1 thru 0x02d7d6 (0xbde6 bytes) 000447 1789601685.426905 trunc from 0x03d9dd to 0x0148a0 (0x2913c bytes) 000448 1789601685.452471 trunc from 0x0148a1 to 0x01e481 (0x9be1 bytes) 000449 1789601685.481513 read 0x00cc9f thru 0x010d6a (0x40cc bytes) 000450 1789601685.482144 fallocate 0x00335e thru 0x00f4a9 (0xc14c bytes) 000452 1789601685.488747 read 0x01db78 thru 0x01e481 (0x90a bytes) 000453 1789601685.507419 mapread 0x00b528 thru 0x0128ee (0x73c7 bytes) 000454 1789601685.508502 punch from 0x01960a to 0x01e481 (0x4e78 bytes) 000455 1789601685.528251 trunc from 0x01dc91 to 0x01e481 (0x7f1 bytes) 000456 1789601685.533224 punch from 0x01c09d to 0x01e481 (0x23e5 bytes) 000457 1789601685.550558 mapread 0x00b946 thru 0x01a21b (0xe8d6 bytes) 000458 1789601685.578357 mapwrite 0x023281 thru 0x028cbe (0x5a3e bytes) 000459 1789601685.648796 write 0x0330b5 thru 0x036365 (0x32b1 bytes) 000460 1789601685.650669 punch from 0x022b30 to 0x031c18 (0xf0e9 bytes) 000461 1789601685.664762 trunc from 0x036366 to 0x026be7 (0xf77e bytes) 000462 1789601685.709390 write 0x0242ca thru 0x0266fe (0x2435 bytes) 000463 1789601685.735483 trunc from 0x001a62 to 0x003e4e (0x23ed bytes) 000464 1789601685.755760 punch from 0x011a6b to 0x01f592 (0xdb28 bytes) 000465 1789601685.766241 mapwrite 0x006b6c thru 0x00e314 (0x77a9 bytes) 000467 1789601685.815795 mapread 0x021bf4 thru 0x026be7 (0x4ff4 bytes) 000468 1789601685.846375 fallocate 0x0246a3 thru 0x02575a (0x10b8 bytes) 000469 1789601685.859485 write 0x032b70 thru 0x03ffff (0xd490 bytes) 000471 1789601685.876230 mapwrite 0x02da6a thru 0x03c737 (0xecce bytes) 000472 1789601685.979211 write 0x0315f7 thru 0x033b96 (0x25a0 bytes) 000473 1789601685.985471 fallocate 0x01e1b5 thru 0x024965 (0x67b1 bytes) 000474 1789601685.995185 write 0x0134b4 thru 0x01f54f (0xc09c bytes) 000476 1789601686.028127 mapwrite 0x00f698 thru 0x01b3d7 (0xbd40 bytes) 000477 1789601686.139587 read 0x0152fe thru 0x01dd2b (0x8a2e bytes) 000478 1789601686.140368 trunc from 0x040000 to 0x03546c (0xab93 bytes) 000479 1789601686.200284 trunc from 0x018fd0 to 0x0258bc (0xc8ed bytes) 000480 1789601686.207839 mapread 0x02d928 thru 0x03546c (0x7b45 bytes) 000481 1789601686.215160 read 0x01b858 thru 0x028766 (0xcf0f bytes) 000482 1789601686.250167 trunc from 0x03546d to 0x014d7f (0x206ed bytes) 000483 1789601686.306124 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x14d80): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14d80): Mirror 4: 0xa660d59a (stale) Mirror 10: 0xa660d59a (stale) Mirror 11: 0xa660d59a (stale) Mirror 12: 0x83e54bf2 (stale) Mirror 13: 0xaf1a7a0e (stale) CRC-32 checksum value for chunk [0, 0x14d80): Mirror 1: 0x17c81e4d Mirror 14: 0x17c81e4d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14d80: skipped 000485 1789601687.416464 trunc from 0x014d80 to 0x01a165 (0x53e6 bytes) 000486 1789601687.514676 trunc from 0x0096e8 to 0x00ff97 (0x68b0 bytes) 000487 1789601687.519840 write 0x01e1da thru 0x02522e (0x7055 bytes) 000488 1789601687.521245 fallocate 0x012c62 thru 0x013a95 (0xe34 bytes) 000489 1789601687.528067 mapwrite 0x028192 thru 0x02849c (0x30b bytes) 000490 1789601687.592065 write 0x0279c2 thru 0x02b741 (0x3d80 bytes) 000491 1789601687.597575 punch from 0x01883b to 0x0255b2 (0xcd78 bytes) 000492 1789601687.602379 write 0x00b71d thru 0x0157e6 (0xa0ca bytes) 000493 1789601687.628763 MIRROR_RESYNC 7 mirrors 000494 1789601690.072558 write 0x02558e thru 0x027ba4 (0x2617 bytes) 000495 1789601690.111728 mapread 0x00104c thru 0x00deb6 (0xce6b bytes) 000496 1789601690.134728 MIRROR_RESYNC 7 mirrors 000497 1789601692.339051 fallocate 0x00b3ea thru 0x012bda (0x77f1 bytes) 000498 1789601692.369226 write 0x00d891 thru 0x0122f0 (0x4a60 bytes) 000499 1789601692.379590 trunc from 0x018c47 to 0x019dd2 (0x118c bytes) 000500 1789601692.384285 mapread 0x01ffd1 thru 0x02b741 (0xb771 bytes) 000501 1789601692.408768 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2b742): Mirror 4: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b742): Mirror 4: 0xca76990f (stale) Mirror 10: 0xca76990f (stale) Mirror 11: 0xca76990f (stale) Mirror 12: 0xca76990f (stale) Mirror 13: 0xca76990f (stale) Mirror 14: 0xca76990f (stale) CRC-32 checksum value for chunk [0, 0x2b742): Mirror 1: 0x77e1f27b Mirror 15: 0x77e1f27b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b742: skipped 000502 1789601693.520021 write 0x02ba7c thru 0x036244 (0xa7c9 bytes) 000504 1789601693.580553 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36245): Mirror 4: 0xacc62f5c (stale) Mirror 11: 0xacc62f5c (stale) Mirror 12: 0xacc62f5c (stale) Mirror 13: 0xacc62f5c (stale) Mirror 14: 0xacc62f5c (stale) Mirror 15: 0x293c640 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36245): Mirror 4: 0xacc62f5c (stale) Mirror 11: 0xacc62f5c (stale) Mirror 12: 0xacc62f5c (stale) Mirror 13: 0xacc62f5c (stale) Mirror 14: 0xacc62f5c (stale) Mirror 15: 0x293c640 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36245: skipped 000505 1789601694.077667 fallocate 0x01245e thru 0x021a1f (0xf5c2 bytes) 000506 1789601694.084033 trunc from 0x029ce6 to 0x036244 (0xc55f bytes) 000507 1789601694.100669 fallocate 0x011916 thru 0x013219 (0x1904 bytes) 000508 1789601694.111828 write 0x011f20 thru 0x020b5a (0xec3b bytes) 000509 1789601694.139710 trunc from 0x0221a5 to 0x026ee6 (0x4d42 bytes) 000510 1789601694.150417 fallocate 0x0114f9 thru 0x01f8d1 (0xe3d9 bytes) 000511 1789601694.161280 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x36245): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36245): Mirror 4: 0xacc62f5c (stale) Mirror 11: 0xacc62f5c (stale) Mirror 12: 0xacc62f5c (stale) Mirror 13: 0xacc62f5c (stale) Mirror 14: 0xacc62f5c (stale) Mirror 15: 0x293c640 (stale) CRC-32 checksum value for chunk [0, 0x36245): Mirror 1: 0xd821ed72 Mirror 16: 0xd821ed72 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36245: skipped 000512 1789601695.491362 mapread 0x02eca8 thru 0x03224b (0x35a4 bytes) 000514 1789601695.539709 MIRROR_RESYNC 8 mirrors 000515 1789601697.862093 mapwrite 0x0381ae thru 0x03ffff (0x7e52 bytes) 000516 1789601697.949939 read 0x0382d3 thru 0x03b6b7 (0x33e5 bytes) 000517 1789601697.951838 mapread 0x023b14 thru 0x0334fc (0xf9e9 bytes) 000518 1789601697.974251 mapread 0x02e8b9 thru 0x02f2a8 (0x9f0 bytes) 000520 1789601697.976269 punch from 0x022ca0 to 0x03063f (0xd9a0 bytes) 000521 1789601697.981346 write 0x0288b4 thru 0x035215 (0xc962 bytes) 000522 1789601697.987212 punch from 0x01b34d to 0x025faa (0xac5e bytes) 000524 1789601698.002313 MIRROR_RESYNC 8 mirrors 000525 1789601701.319699 trunc from 0x003b22 to 0x00b6e3 (0x7bc2 bytes) 000526 1789601701.359044 mapread 0x010acc thru 0x01f318 (0xe84d bytes) 000527 1789601701.389691 write 0x02cefa thru 0x037837 (0xa93e bytes) 000528 1789601701.400691 read 0x003bd9 thru 0x009513 (0x593b bytes) 000529 1789601701.411720 mapwrite 0x03c818 thru 0x03ffff (0x37e8 bytes) 000530 1789601701.438589 mapwrite 0x0234c9 thru 0x03161e (0xe156 bytes) 000532 1789601701.489149 write 0x012b91 thru 0x01b4d8 (0x8948 bytes) 000533 1789601701.490566 fallocate 0x00bda7 thru 0x01b287 (0xf4e1 bytes) 000534 1789601701.496746 fallocate 0x02b736 thru 0x0394c3 (0xdd8e bytes) 000535 1789601701.501153 trunc from 0x0175e7 to 0x019c6f (0x2689 bytes) 000537 1789601701.519371 fallocate 0x03f6a0 thru 0x03ffff (0x960 bytes) 000538 1789601701.524656 trunc from 0x02fb8c to 0x033150 (0x35c5 bytes) 000540 1789601701.531821 mapwrite 0x00717a thru 0x00a0bf (0x2f46 bytes) 000541 1789601701.552591 trunc from 0x035ab5 to 0x0377c3 (0x1d0f bytes) 000542 1789601701.559779 read 0x01e521 thru 0x02260a (0x40ea bytes) 000543 1789601701.560944 trunc from 0x033eb3 to 0x036c1c (0x2d6a bytes) 000544 1789601701.567593 trunc from 0x012285 to 0x015b50 (0x38cc bytes) 000545 1789601701.574412 write 0x009357 thru 0x0184c9 (0xf173 bytes) 000546 1789601701.596773 write 0x028051 thru 0x031ad9 (0x9a89 bytes) 000547 1789601701.606406 trunc from 0x022982 to 0x02c4ab (0x9b2a bytes) 000549 1789601701.629415 mapwrite 0x012f0d thru 0x01a4bd (0x75b1 bytes) 000550 1789601701.660122 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xfacb44de (stale) Mirror 11: 0xfacb44de (stale) Mirror 13: 0xfacb44de (stale) Mirror 14: 0xfacb44de (stale) Mirror 15: 0xfacb44de (stale) Mirror 16: 0xfacb44de (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xfacb44de (stale) Mirror 11: 0xfacb44de (stale) Mirror 13: 0xfacb44de (stale) Mirror 14: 0xfacb44de (stale) Mirror 15: 0xfacb44de (stale) Mirror 16: 0xfacb44de (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000551 1789601702.188886 read 0x03b68a thru 0x03ffff (0x4976 bytes) 000552 1789601702.202085 fallocate 0x00ac8b thru 0x019429 (0xe79f bytes) 000553 1789601702.216827 write 0x034fa6 thru 0x03ffff (0xb05a bytes) 000554 1789601702.242545 trunc from 0x019835 to 0x025461 (0xbc2d bytes) 000555 1789601702.250571 fallocate 0x0004da thru 0x0039d1 (0x34f8 bytes) 000556 1789601702.258917 trunc from 0x03defb to 0x03ffff (0x2105 bytes) 000557 1789601702.296180 MIRROR_RESYNC 7 mirrors 000558 1789601704.749531 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) 000559 1789601705.312384 mapread 0x017120 thru 0x01d550 (0x6431 bytes) 000560 1789601705.333675 trunc from 0x00b55c to 0x019141 (0xdbe6 bytes) 000561 1789601705.418747 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xdf94e66e (stale) Mirror 11: 0xdf94e66e (stale) Mirror 14: 0xdf94e66e (stale) Mirror 15: 0xdf94e66e (stale) Mirror 16: 0xdf94e66e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2ce3a81b Mirror 17: 0x2ce3a81b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000562 1789601706.812112 mapread 0x02b63f thru 0x038409 (0xcdcb bytes) 000563 1789601706.897495 trunc from 0x040000 to 0x02115d (0x1eea2 bytes) 000564 1789601706.953465 read 0x004b2d thru 0x013cb0 (0xf184 bytes) 000565 1789601706.964931 mapread 0x01645f thru 0x02115d (0xacff bytes) 000566 1789601706.987241 trunc from 0x018afc to 0x01ae73 (0x2378 bytes) 000567 1789601706.998890 trunc from 0x02115e to 0x00a831 (0x1692c bytes) 000568 1789601707.023075 punch from 0x0008ac to 0x0098a7 (0x8ffc bytes) 000569 1789601707.032341 write 0x00e968 thru 0x00ea90 (0x129 bytes) 000570 1789601707.038790 MIRROR_RESYNC 7 mirrors 000571 1789601708.681173 trunc from 0x00ea91 to 0x003674 (0xb41c bytes) 000572 1789601708.738256 punch from 0x001d9a to 0x003674 (0x18db bytes) 000573 1789601708.743893 trunc from 0x00336a to 0x003674 (0x30b bytes) 000575 1789601708.749207 trunc from 0x003675 to 0x036b08 (0x33494 bytes) 000576 1789601708.767135 write 0x024631 thru 0x0277ab (0x317b bytes) 000577 1789601708.779668 punch from 0x012448 to 0x01fc3d (0xd7f6 bytes) 000579 1789601708.788551 mapwrite 0x034b26 thru 0x0351be (0x699 bytes) 000580 1789601708.814787 read 0x02206f thru 0x03057f (0xe511 bytes) 000581 1789601708.824258 trunc from 0x0152c4 to 0x024a71 (0xf7ae bytes) 000582 1789601708.829362 read 0x02d112 thru 0x036b08 (0x99f7 bytes) 000583 1789601708.839911 read 0x023616 thru 0x032f42 (0xf92d bytes) 000584 1789601708.840771 trunc from 0x032836 to 0x035223 (0x29ee bytes) 000585 1789601708.846046 fallocate 0x0068db thru 0x0124f2 (0xbc18 bytes) 000586 1789601708.854681 MIRROR_RESYNC 7 mirrors 000587 1789601710.721770 punch from 0x022c1b to 0x025fda (0x33c0 bytes) 000588 1789601710.754997 write 0x02f6b0 thru 0x03e541 (0xee92 bytes) 000590 1789601710.777520 mapread 0x01f293 thru 0x029ff6 (0xad64 bytes) 000591 1789601710.807047 fallocate 0x03d574 thru 0x03fe97 (0x2924 bytes) 000592 1789601710.819897 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3fe98): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe98): Mirror 4: 0x164dab1f (stale) Mirror 11: 0x164dab1f (stale) Mirror 14: 0x164dab1f (stale) Mirror 15: 0x164dab1f (stale) Mirror 16: 0x164dab1f (stale) Mirror 17: 0x164dab1f (stale) CRC-32 checksum value for chunk [0, 0x3fe98): Mirror 1: 0x43c38680 Mirror 18: 0x43c38680 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe98: skipped 000593 1789601711.992889 punch from 0x03568d to 0x0379c9 (0x233d bytes) 000594 1789601712.039915 write 0x001c86 thru 0x002da1 (0x111c bytes) 000595 1789601712.057593 trunc from 0x03fe98 to 0x005c97 (0x3a200 bytes) 000596 1789601712.083709 trunc from 0x005c98 to 0x023dfc (0x1e165 bytes) 000597 1789601712.103503 mapwrite 0x039558 thru 0x03ffff (0x6aa8 bytes) 000598 1789601712.177269 punch from 0x017b6c to 0x026ba9 (0xf03e bytes) 000599 1789601712.182330 read 0x03d8b1 thru 0x03fe99 (0x25e9 bytes) 000600 1789601712.183271 fallocate 0x01e771 thru 0x027402 (0x8c92 bytes) 000601 1789601712.192436 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd8e64e20 (stale) Mirror 11: 0xd8e64e20 (stale) Mirror 14: 0xd8e64e20 (stale) Mirror 15: 0xd8e64e20 (stale) Mirror 16: 0xd8e64e20 (stale) Mirror 17: 0xd8e64e20 (stale) Mirror 18: 0xdefc3e3d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7f40860b Mirror 19: 0x7f40860b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000602 1789601713.570801 mapread 0x00e3dd thru 0x01d4b4 (0xf0d8 bytes) 000603 1789601713.637133 fallocate 0x013f28 thru 0x0183a5 (0x447e bytes) 000604 1789601713.698532 read 0x03284f thru 0x03eb11 (0xc2c3 bytes) 000605 1789601713.728416 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd8e64e20 (stale) Mirror 11: 0xd8e64e20 (stale) Mirror 14: 0xd8e64e20 (stale) Mirror 16: 0xd8e64e20 (stale) Mirror 17: 0xd8e64e20 (stale) Mirror 18: 0xdefc3e3d (stale) Mirror 19: 0x7f40860b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd8e64e20 (stale) Mirror 11: 0xd8e64e20 (stale) Mirror 14: 0xd8e64e20 (stale) Mirror 16: 0xd8e64e20 (stale) Mirror 17: 0xd8e64e20 (stale) Mirror 18: 0xdefc3e3d (stale) Mirror 19: 0x7f40860b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000606 1789601714.281181 punch from 0x02b9fd to 0x038bec (0xd1f0 bytes) 000607 1789601714.286360 mapread 0x03540e thru 0x03fad7 (0xa6ca bytes) 000608 1789601714.316428 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd8e64e20 (stale) Mirror 11: 0xd8e64e20 (stale) Mirror 14: 0xd8e64e20 (stale) Mirror 16: 0xd8e64e20 (stale) Mirror 17: 0xd8e64e20 (stale) Mirror 18: 0xdefc3e3d (stale) Mirror 19: 0x7f40860b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7f40860b Mirror 20: 0x7f40860b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000609 1789601715.576201 punch from 0x00b86a to 0x0114c7 (0x5c5e bytes) 000610 1789601715.630593 mapwrite 0x01bc5a thru 0x0239b9 (0x7d60 bytes) 000611 1789601715.686403 trunc from 0x014369 to 0x022307 (0xdf9f bytes) 000612 1789601715.692475 trunc from 0x040000 to 0x030430 (0xfbcf bytes) 000613 1789601715.716719 trunc from 0x030431 to 0x01816c (0x182c4 bytes) 000614 1789601715.749009 fallocate 0x035a40 thru 0x03efa7 (0x9568 bytes) 000615 1789601715.757278 trunc from 0x0192b2 to 0x025cef (0xca3e bytes) 000616 1789601715.761513 read 0x01fc22 thru 0x0255b5 (0x5994 bytes) 000617 1789601715.772173 mapwrite 0x03132d thru 0x03bc8a (0xa95e bytes) 000618 1789601715.815275 trunc from 0x006cbe to 0x011051 (0xa394 bytes) 000619 1789601715.823671 punch from 0x00f370 to 0x014d37 (0x59c8 bytes) 000620 1789601715.830075 read 0x00c84c thru 0x01a260 (0xda15 bytes) 000621 1789601715.851363 fallocate 0x01d3db thru 0x02b6bd (0xe2e3 bytes) 000622 1789601715.855698 mapwrite 0x037d34 thru 0x037d5f (0x2c bytes) 000623 1789601715.869185 write 0x00af70 thru 0x014e48 (0x9ed9 bytes) 000624 1789601715.870766 mapread 0x033017 thru 0x037e3e (0x4e28 bytes) 000625 1789601715.872348 read 0x02ecb8 thru 0x033a52 (0x4d9b bytes) 000626 1789601715.873328 fallocate 0x013d98 thru 0x01d1e1 (0x944a bytes) 000627 1789601715.878516 punch from 0x002fa2 to 0x00d7c1 (0xa820 bytes) 000628 1789601715.896871 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3efa8): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3efa8): Mirror 4: 0x9d98a63e (stale) Mirror 11: 0x9d98a63e (stale) Mirror 14: 0x9d98a63e (stale) Mirror 16: 0x9d98a63e (stale) Mirror 17: 0x9d98a63e (stale) Mirror 18: 0xc6031076 (stale) Mirror 19: 0x1b8b5eb6 (stale) Mirror 20: 0x1b8b5eb6 (stale) CRC-32 checksum value for chunk [0, 0x3efa8): Mirror 1: 0x55f13cf9 Mirror 21: 0x55f13cf9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3efa8: skipped 000629 1789601716.969278 trunc from 0x03efa8 to 0x003c79 (0x3b32e bytes) 000630 1789601717.018314 mapread 0x000b26 thru 0x003c79 (0x3154 bytes) 000631 1789601717.057155 mapread 0x002886 thru 0x0032ca (0xa45 bytes) 000632 1789601717.058300 trunc from 0x003c7a to 0x028f0c (0x25293 bytes) 000633 1789601717.085978 trunc from 0x028f0d to 0x00be98 (0x1d074 bytes) 000634 1789601717.105250 trunc from 0x002f17 to 0x007869 (0x4953 bytes) 000635 1789601717.110307 mapwrite 0x029fe6 thru 0x032237 (0x8252 bytes) 000636 1789601717.179121 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32238): Mirror 4: 0x4db62700 (stale) Mirror 11: 0x4db62700 (stale) Mirror 14: 0x4db62700 (stale) Mirror 16: 0x4db62700 (stale) Mirror 18: 0xb83dad3 (stale) Mirror 19: 0x543330af (stale) Mirror 20: 0x543330af (stale) Mirror 21: 0x71ed93df (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32238): Mirror 4: 0x4db62700 (stale) Mirror 11: 0x4db62700 (stale) Mirror 14: 0x4db62700 (stale) Mirror 16: 0x4db62700 (stale) Mirror 18: 0xb83dad3 (stale) Mirror 19: 0x543330af (stale) Mirror 20: 0x543330af (stale) Mirror 21: 0x71ed93df (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32238: skipped 000637 1789601718.117430 write 0x03cd21 thru 0x03ffff (0x32df bytes) 000639 1789601718.123255 trunc from 0x040000 to 0x028418 (0x17be7 bytes) 000640 1789601718.142533 punch from 0x00ac1b to 0x0196c2 (0xeaa8 bytes) 000641 1789601718.152152 mapwrite 0x02cc56 thru 0x03266d (0x5a18 bytes) 000642 1789601718.223870 mapwrite 0x01d96e thru 0x0216d1 (0x3d64 bytes) 000643 1789601718.269892 mapread 0x01d2a8 thru 0x022e11 (0x5b6a bytes) 000644 1789601718.273257 mapread 0x0153a1 thru 0x017ace (0x272e bytes) 000646 1789601718.292290 punch from 0x02ff09 to 0x03266d (0x2765 bytes) 000647 1789601718.301514 write 0x029dcc thru 0x031dc7 (0x7ffc bytes) 000648 1789601718.314412 trunc from 0x03266e to 0x02a9ca (0x7ca3 bytes) 000649 1789601718.339754 mapread 0x022ae6 thru 0x028b36 (0x6051 bytes) 000651 1789601718.359000 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a9cb): Mirror 11: 0x1f827a22 (stale) Mirror 14: 0x1f827a22 (stale) Mirror 16: 0x1f827a22 (stale) Mirror 18: 0x85b83895 (stale) Mirror 19: 0xf9d5565c (stale) Mirror 20: 0xf9d5565c (stale) Mirror 21: 0x852a37e8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a9cb): Mirror 11: 0x1f827a22 (stale) Mirror 14: 0x1f827a22 (stale) Mirror 16: 0x1f827a22 (stale) Mirror 18: 0x85b83895 (stale) Mirror 19: 0xf9d5565c (stale) Mirror 20: 0xf9d5565c (stale) Mirror 21: 0x852a37e8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a9cb: skipped 000652 1789601718.956689 fallocate 0x03da26 thru 0x03ffff (0x25da bytes) 000654 1789601718.965723 mapwrite 0x038642 thru 0x038863 (0x222 bytes) 000655 1789601718.997251 mapread 0x01469b thru 0x02215b (0xdac1 bytes) 000656 1789601719.023310 read 0x03eca3 thru 0x03ffff (0x135d bytes) 000657 1789601719.028273 trunc from 0x009509 to 0x00ce12 (0x390a bytes) 000658 1789601719.032317 punch from 0x03ec20 to 0x03ffff (0x13e0 bytes) 000659 1789601719.036572 trunc from 0x040000 to 0x0038d1 (0x3c72e bytes) 000660 1789601719.055704 MIRROR_RESYNC 8 mirrors 000661 1789601720.567156 trunc from 0x0038d2 to 0x03d24f (0x3997e bytes) 000662 1789601720.664407 write 0x00ae73 thru 0x0150ca (0xa258 bytes) 000664 1789601720.683880 punch from 0x0128f9 to 0x0152ad (0x29b5 bytes) 000665 1789601720.705492 trunc from 0x03d250 to 0x02de10 (0xf43f bytes) 000666 1789601720.735882 trunc from 0x028cd9 to 0x02de10 (0x5138 bytes) 000667 1789601720.743181 read 0x0204c5 thru 0x02ac21 (0xa75d bytes) 000669 1789601720.760052 mapread 0x01dae4 thru 0x027817 (0x9d34 bytes) 000671 1789601720.798599 trunc from 0x0020b4 to 0x00d2c4 (0xb211 bytes) 000672 1789601720.803622 mapwrite 0x0138ca thru 0x0233e8 (0xfb1f bytes) 000673 1789601720.866878 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2de11): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2de11): Mirror 11: 0x52326db5 (stale) Mirror 14: 0x52326db5 (stale) Mirror 16: 0x52326db5 (stale) Mirror 18: 0x52326db5 (stale) Mirror 19: 0x52326db5 (stale) Mirror 20: 0x52326db5 (stale) Mirror 21: 0x52326db5 (stale) CRC-32 checksum value for chunk [0, 0x2de11): Mirror 1: 0x9a644988 Mirror 22: 0x9a644988 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2de11: skipped 000674 1789601722.424691 trunc from 0x02de11 to 0x031555 (0x3745 bytes) 000675 1789601722.518673 trunc from 0x002c46 to 0x009c41 (0x6ffc bytes) 000676 1789601722.525370 punch from 0x018022 to 0x01d6d2 (0x56b1 bytes) 000677 1789601722.537843 fallocate 0x02f119 thru 0x039e8e (0xad76 bytes) 000679 1789601722.555084 read 0x00c9c9 thru 0x011ea4 (0x54dc bytes) 000680 1789601722.586075 mapwrite 0x03c8fd thru 0x03ffff (0x3703 bytes) 000682 1789601722.680691 write 0x01fc1a thru 0x0288a7 (0x8c8e bytes) 000683 1789601722.695102 trunc from 0x0244f4 to 0x0332af (0xedbc bytes) 000684 1789601722.715274 mapread 0x0001c9 thru 0x00ac58 (0xaa90 bytes) 000685 1789601722.728919 trunc from 0x040000 to 0x03aa1f (0x55e0 bytes) 000687 1789601722.769178 fallocate 0x02b698 thru 0x0399f7 (0xe360 bytes) 000688 1789601722.788596 write 0x03a8c7 thru 0x03cd2b (0x2465 bytes) 000690 1789601722.791715 mapwrite 0x027eed thru 0x028ec2 (0xfd6 bytes) 000691 1789601722.833285 mapread 0x038335 thru 0x0386b6 (0x382 bytes) 000692 1789601722.834331 mapread 0x001410 thru 0x00e79d (0xd38e bytes) 000693 1789601722.835678 mapwrite 0x023219 thru 0x028b76 (0x595e bytes) 000694 1789601722.862563 write 0x0208f5 thru 0x02cafa (0xc206 bytes) 000695 1789601722.865484 mapwrite 0x010b34 thru 0x014edb (0x43a8 bytes) 000696 1789601722.909540 mapread 0x02eb05 thru 0x0329d8 (0x3ed4 bytes) 000697 1789601722.919868 read 0x01c75b thru 0x01f935 (0x31db bytes) 000698 1789601722.926727 mapread 0x018f44 thru 0x01bfa3 (0x3060 bytes) 000699 1789601722.933919 MIRROR_RESYNC 9 mirrors 000700 1789601726.100850 trunc from 0x0184ea to 0x01eefc (0x6a13 bytes) 000701 1789601726.192819 fallocate 0x0139d7 thru 0x02398d (0xffb7 bytes) 000702 1789601726.227152 MIRROR_RESYNC 9 mirrors 000703 1789601728.867739 write 0x012cd6 thru 0x01a3b3 (0x76de bytes) 000704 1789601728.923068 trunc from 0x03b063 to 0x03cd2b (0x1cc9 bytes) 000705 1789601728.930073 trunc from 0x03cd2c to 0x01331b (0x29a10 bytes) 000706 1789601728.951091 trunc from 0x00a172 to 0x00c651 (0x24e0 bytes) 000707 1789601728.956280 read 0x000465 thru 0x000e11 (0x9ad bytes) 000708 1789601728.962789 mapread 0x00d251 thru 0x01331b (0x60cb bytes) 000709 1789601728.988099 mapwrite 0x0221d6 thru 0x02e184 (0xbfaf bytes) 000710 1789601729.107282 punch from 0x01d871 to 0x02a4c6 (0xcc56 bytes) 000711 1789601729.122695 read 0x001e65 thru 0x004022 (0x21be bytes) 000712 1789601729.160308 punch from 0x02d3a4 to 0x02e184 (0xde1 bytes) 000713 1789601729.169694 mapread 0x0048cd thru 0x00922d (0x4961 bytes) 000714 1789601729.177619 MIRROR_RESYNC 9 mirrors 000716 1789601731.543553 trunc from 0x007464 to 0x009872 (0x240f bytes) 000718 1789601731.603541 fallocate 0x026e59 thru 0x033618 (0xc7c0 bytes) 000719 1789601731.612817 fallocate 0x019ccd thru 0x0272b6 (0xd5ea bytes) 000720 1789601731.621850 mapread 0x00882a thru 0x00a25e (0x1a35 bytes) 000721 1789601731.649407 read 0x011f4a thru 0x0179c6 (0x5a7d bytes) 000722 1789601731.673839 write 0x01cae8 thru 0x027542 (0xaa5b bytes) 000723 1789601731.703831 write 0x02254c thru 0x022a6e (0x523 bytes) 000724 1789601731.719566 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2e185): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e185): Mirror 11: 0x6b6d204b (stale) Mirror 14: 0x6b6d204b (stale) Mirror 16: 0x6b6d204b (stale) Mirror 18: 0x6b6d204b (stale) Mirror 19: 0x6b6d204b (stale) Mirror 20: 0x6b6d204b (stale) Mirror 21: 0x6b6d204b (stale) Mirror 22: 0x6b6d204b (stale) CRC-32 checksum value for chunk [0, 0x2e185): Mirror 1: 0x6222c873 Mirror 23: 0x6222c873 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e185: skipped 000725 1789601732.783723 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2e185): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e185): Mirror 11: 0x6b6d204b (stale) Mirror 14: 0x6b6d204b (stale) Mirror 16: 0x6b6d204b (stale) Mirror 18: 0x6b6d204b (stale) Mirror 19: 0x6b6d204b (stale) Mirror 20: 0x6b6d204b (stale) Mirror 21: 0x6b6d204b (stale) Mirror 22: 0x6b6d204b (stale) CRC-32 checksum value for chunk [0, 0x2e185): Mirror 1: 0x6222c873 Mirror 23: 0x6222c873 Mirror 24: 0x6222c873 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e185: skipped 000726 1789601734.249057 MIRROR_RESYNC 11 mirrors 000728 1789601736.433597 trunc from 0x02e185 to 0x026470 (0x7d14 bytes) 000729 1789601736.486527 fallocate 0x012c2d thru 0x019a5d (0x6e31 bytes) 000730 1789601736.493998 mapread 0x013848 thru 0x017393 (0x3b4c bytes) 000731 1789601736.512315 trunc from 0x026471 to 0x028a9c (0x262c bytes) 000732 1789601736.535622 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x28a9d): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28a9d): Mirror 11: 0x522c83d6 (stale) Mirror 14: 0x522c83d6 (stale) Mirror 16: 0x522c83d6 (stale) Mirror 18: 0x522c83d6 (stale) Mirror 19: 0x522c83d6 (stale) Mirror 20: 0x522c83d6 (stale) Mirror 21: 0x522c83d6 (stale) Mirror 22: 0x522c83d6 (stale) Mirror 23: 0x522c83d6 (stale) Mirror 24: 0x522c83d6 (stale) CRC-32 checksum value for chunk [0, 0x28a9d): Mirror 1: 0xa06ea70 Mirror 25: 0xa06ea70 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28a9d: skipped 000733 1789601737.969620 read 0x01e8b7 thru 0x0280ca (0x9814 bytes) 000734 1789601737.993054 punch from 0x02718f to 0x028a9c (0x190e bytes) 000735 1789601738.051661 mapwrite 0x00f392 thru 0x0115fd (0x226c bytes) 000736 1789601738.104403 fallocate 0x013968 thru 0x015fdd (0x2676 bytes) 000737 1789601738.118845 mapread 0x022e3b thru 0x028a9c (0x5c62 bytes) 000738 1789601738.143596 mapread 0x026934 thru 0x028a9c (0x2169 bytes) 000740 1789601738.148492 fallocate 0x0324de thru 0x03b9a0 (0x94c3 bytes) 000741 1789601738.154597 read 0x0084c2 thru 0x012620 (0xa15f bytes) 000742 1789601738.183425 mapwrite 0x008a43 thru 0x00d2ec (0x48aa bytes) 000743 1789601738.234311 punch from 0x013a7a to 0x01bf8d (0x8514 bytes) 000744 1789601738.250459 MIRROR_RESYNC 12 mirrors 000746 1789601741.888094 trunc from 0x002a1c to 0x0116ec (0xecd1 bytes) 000748 1789601741.926803 trunc from 0x0022ae to 0x009f14 (0x7c67 bytes) 000749 1789601741.932107 fallocate 0x02e3f1 thru 0x03b11a (0xcd2a bytes) 000750 1789601741.936478 trunc from 0x03b11b to 0x015945 (0x257d5 bytes) 000752 1789601741.967584 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x15946): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15946): Mirror 11: 0x7de76a1e (stale) Mirror 14: 0x7de76a1e (stale) Mirror 16: 0x7de76a1e (stale) Mirror 18: 0x7de76a1e (stale) Mirror 19: 0x7de76a1e (stale) Mirror 20: 0x7de76a1e (stale) Mirror 21: 0x7de76a1e (stale) Mirror 22: 0x7de76a1e (stale) Mirror 23: 0x7de76a1e (stale) Mirror 24: 0x7de76a1e (stale) Mirror 25: 0x7de76a1e (stale) CRC-32 checksum value for chunk [0, 0x15946): Mirror 1: 0xbaea386f Mirror 26: 0xbaea386f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15946: skipped 000753 1789601743.905619 punch from 0x011848 to 0x015945 (0x40fe bytes) 000754 1789601744.012405 mapread 0x014904 thru 0x015945 (0x1042 bytes) 000755 1789601744.031818 mapread 0x00632c thru 0x011b56 (0xb82b bytes) 000756 1789601744.069732 write 0x02fdd2 thru 0x038de1 (0x9010 bytes) 000757 1789601744.077780 fallocate 0x00dce5 thru 0x0130e3 (0x53ff bytes) 000758 1789601744.090592 read 0x00b975 thru 0x00dbf7 (0x2283 bytes) 000759 1789601744.102457 read 0x0024e9 thru 0x0027e7 (0x2ff bytes) 000760 1789601744.121887 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38de2): Mirror 11: 0x46b3cb33 (stale) Mirror 16: 0x46b3cb33 (stale) Mirror 18: 0x46b3cb33 (stale) Mirror 19: 0x46b3cb33 (stale) Mirror 20: 0x46b3cb33 (stale) Mirror 21: 0x46b3cb33 (stale) Mirror 22: 0x46b3cb33 (stale) Mirror 23: 0x46b3cb33 (stale) Mirror 24: 0x46b3cb33 (stale) Mirror 25: 0x46b3cb33 (stale) Mirror 26: 0xc2d1024e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38de2): Mirror 11: 0x46b3cb33 (stale) Mirror 16: 0x46b3cb33 (stale) Mirror 18: 0x46b3cb33 (stale) Mirror 19: 0x46b3cb33 (stale) Mirror 20: 0x46b3cb33 (stale) Mirror 21: 0x46b3cb33 (stale) Mirror 22: 0x46b3cb33 (stale) Mirror 23: 0x46b3cb33 (stale) Mirror 24: 0x46b3cb33 (stale) Mirror 25: 0x46b3cb33 (stale) Mirror 26: 0xc2d1024e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38de2: skipped 000762 1789601745.030382 mapwrite 0x022aef thru 0x02b50f (0x8a21 bytes) 000763 1789601745.125134 fallocate 0x03e0f9 thru 0x03ffff (0x1f07 bytes) 000764 1789601745.137235 trunc from 0x03a736 to 0x03ffff (0x58ca bytes) 000765 1789601745.144491 fallocate 0x0179e2 thru 0x0210ab (0x96ca bytes) 000766 1789601745.155823 trunc from 0x040000 to 0x029add (0x16522 bytes) 000767 1789601745.230563 trunc from 0x029ade to 0x0153f7 (0x146e6 bytes) 000768 1789601745.274305 trunc from 0x0153f8 to 0x03a8c7 (0x254d0 bytes) 000769 1789601745.292300 fallocate 0x033540 thru 0x034c18 (0x16d9 bytes) 000772 1789601745.303188 mapwrite 0x026a0a thru 0x032b50 (0xc147 bytes) 000773 1789601745.387380 punch from 0x02da65 to 0x039685 (0xbc21 bytes) 000774 1789601745.409134 trunc from 0x034411 to 0x039242 (0x4e32 bytes) 000775 1789601745.422128 trunc from 0x02840f to 0x02b5f6 (0x31e8 bytes) 000776 1789601745.433764 write 0x02b0de thru 0x035e56 (0xad79 bytes) 000777 1789601745.467261 mapwrite 0x01d9e4 thru 0x01ea2f (0x104c bytes) 000778 1789601745.522924 fallocate 0x03bc98 thru 0x03ffff (0x4368 bytes) 000779 1789601745.538687 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xf2227c07 (stale) Mirror 16: 0xf2227c07 (stale) Mirror 18: 0xf2227c07 (stale) Mirror 19: 0xf2227c07 (stale) Mirror 20: 0xf2227c07 (stale) Mirror 21: 0xf2227c07 (stale) Mirror 22: 0xf2227c07 (stale) Mirror 23: 0xf2227c07 (stale) Mirror 24: 0xf2227c07 (stale) Mirror 25: 0xf2227c07 (stale) Mirror 26: 0x31d08d14 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9d86e582 Mirror 27: 0x9d86e582 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000780 1789601747.096421 mapwrite 0x0399b1 thru 0x03fb3f (0x618f bytes) 000781 1789601747.223648 mapread 0x026591 thru 0x02a506 (0x3f76 bytes) 000782 1789601747.250251 MIRROR_SPLIT mirror 7 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xf2227c07 (stale) Mirror 16: 0xf2227c07 (stale) Mirror 18: 0xf2227c07 (stale) Mirror 19: 0xf2227c07 (stale) Mirror 20: 0xf2227c07 (stale) Mirror 21: 0xf2227c07 (stale) Mirror 23: 0xf2227c07 (stale) Mirror 24: 0xf2227c07 (stale) Mirror 25: 0xf2227c07 (stale) Mirror 26: 0x31d08d14 (stale) Mirror 27: 0x9d86e582 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xf2227c07 (stale) Mirror 16: 0xf2227c07 (stale) Mirror 18: 0xf2227c07 (stale) Mirror 19: 0xf2227c07 (stale) Mirror 20: 0xf2227c07 (stale) Mirror 21: 0xf2227c07 (stale) Mirror 23: 0xf2227c07 (stale) Mirror 24: 0xf2227c07 (stale) Mirror 25: 0xf2227c07 (stale) Mirror 26: 0x31d08d14 (stale) Mirror 27: 0x9d86e582 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000783 1789601748.211069 trunc from 0x040000 to 0x02aae8 (0x15517 bytes) 000785 1789601748.240769 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2aae9): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aae9): Mirror 11: 0xc241dfaa (stale) Mirror 16: 0xc241dfaa (stale) Mirror 18: 0xc241dfaa (stale) Mirror 19: 0xc241dfaa (stale) Mirror 20: 0xc241dfaa (stale) Mirror 21: 0xc241dfaa (stale) Mirror 23: 0xc241dfaa (stale) Mirror 24: 0xc241dfaa (stale) Mirror 25: 0xc241dfaa (stale) Mirror 26: 0x6d7fb7ea (stale) Mirror 27: 0x241ddae0 (stale) CRC-32 checksum value for chunk [0, 0x2aae9): Mirror 1: 0x241ddae0 Mirror 28: 0x241ddae0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aae9: skipped 000786 1789601749.612208 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2aae9): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aae9): Mirror 11: 0xc241dfaa (stale) Mirror 16: 0xc241dfaa (stale) Mirror 18: 0xc241dfaa (stale) Mirror 19: 0xc241dfaa (stale) Mirror 20: 0xc241dfaa (stale) Mirror 21: 0xc241dfaa (stale) Mirror 23: 0xc241dfaa (stale) Mirror 24: 0xc241dfaa (stale) Mirror 25: 0xc241dfaa (stale) Mirror 26: 0x6d7fb7ea (stale) Mirror 27: 0x241ddae0 (stale) CRC-32 checksum value for chunk [0, 0x2aae9): Mirror 1: 0x241ddae0 Mirror 28: 0x241ddae0 Mirror 29: 0x241ddae0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aae9: skipped 000787 1789601750.928907 mapread 0x01673f thru 0x01c8b0 (0x6172 bytes) 000788 1789601750.993559 trunc from 0x00cdf7 to 0x00f0c8 (0x22d2 bytes) 000789 1789601751.109758 trunc from 0x0231c5 to 0x0245a8 (0x13e4 bytes) 000790 1789601751.135279 read 0x00040d thru 0x007084 (0x6c78 bytes) 000791 1789601751.174823 mapread 0x01a2d0 thru 0x020dcf (0x6b00 bytes) 000792 1789601751.214143 trunc from 0x0204b7 to 0x024d0b (0x4855 bytes) 000793 1789601751.225162 mapread 0x021a91 thru 0x0248bf (0x2e2f bytes) 000794 1789601751.241734 fallocate 0x03c1cb thru 0x03ffff (0x3e35 bytes) 000795 1789601751.248590 punch from 0x0055bb to 0x013c2b (0xe671 bytes) 000796 1789601751.253687 trunc from 0x040000 to 0x00bdf2 (0x3420d bytes) 000797 1789601751.295512 mapwrite 0x03620b thru 0x03a07b (0x3e71 bytes) 000798 1789601751.366705 write 0x00b092 thru 0x0166c9 (0xb638 bytes) 000799 1789601751.376494 mapwrite 0x03b0f8 thru 0x03ffff (0x4f08 bytes) 000800 1789601751.462647 trunc from 0x006845 to 0x007c4e (0x140a bytes) 000801 1789601751.470051 read 0x03d615 thru 0x03ffff (0x29eb bytes) 000802 1789601751.470652 mapwrite 0x01f5e7 thru 0x02159f (0x1fb9 bytes) 000803 1789601751.529448 write 0x039628 thru 0x039a17 (0x3f0 bytes) 000804 1789601751.534665 fallocate 0x000349 thru 0x002a12 (0x26ca bytes) 000805 1789601751.546045 trunc from 0x040000 to 0x01736c (0x28c93 bytes) 000806 1789601751.577217 punch from 0x0158f4 to 0x01736c (0x1a79 bytes) 000807 1789601751.585625 trunc from 0x0040fc to 0x009c93 (0x5b98 bytes) 000808 1789601751.595870 mapread 0x00a255 thru 0x00a992 (0x73e bytes) 000809 1789601751.596917 punch from 0x008148 to 0x014d93 (0xcc4c bytes) 000810 1789601751.608154 mapread 0x006567 thru 0x0157a7 (0xf241 bytes) 000811 1789601751.777533 read 0x002a38 thru 0x00dab6 (0xb07f bytes) 000812 1789601751.789552 trunc from 0x00d973 to 0x01378a (0x5e18 bytes) 000813 1789601751.803792 fallocate 0x0251d3 thru 0x02fe11 (0xac3f bytes) 000814 1789601751.827650 write 0x017fd1 thru 0x01bfb6 (0x3fe6 bytes) 000815 1789601751.828731 write 0x000946 thru 0x00a8c2 (0x9f7d bytes) 000816 1789601751.845285 trunc from 0x0160ed to 0x01bfb6 (0x5eca bytes) 000817 1789601751.885931 punch from 0x0131fd to 0x015136 (0x1f3a bytes) 000818 1789601751.896575 mapread 0x0100c8 thru 0x010cb6 (0xbef bytes) 000819 1789601751.946446 write 0x00fabb thru 0x019af1 (0xa037 bytes) 000820 1789601751.954815 trunc from 0x01bfb7 to 0x02787f (0xb8c9 bytes) 000821 1789601752.016386 fallocate 0x01b74a thru 0x0213a1 (0x5c58 bytes) 000822 1789601752.054691 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27880): Mirror 11: 0x97feea36 (stale) Mirror 16: 0x97feea36 (stale) Mirror 18: 0x97feea36 (stale) Mirror 19: 0x97feea36 (stale) Mirror 20: 0x97feea36 (stale) Mirror 21: 0x97feea36 (stale) Mirror 24: 0x97feea36 (stale) Mirror 25: 0x97feea36 (stale) Mirror 26: 0xe9786504 (stale) Mirror 27: 0xff7663d6 (stale) Mirror 28: 0xff7663d6 (stale) Mirror 29: 0xff7663d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27880): Mirror 11: 0x97feea36 (stale) Mirror 16: 0x97feea36 (stale) Mirror 18: 0x97feea36 (stale) Mirror 19: 0x97feea36 (stale) Mirror 20: 0x97feea36 (stale) Mirror 21: 0x97feea36 (stale) Mirror 24: 0x97feea36 (stale) Mirror 25: 0x97feea36 (stale) Mirror 26: 0xe9786504 (stale) Mirror 27: 0xff7663d6 (stale) Mirror 28: 0xff7663d6 (stale) Mirror 29: 0xff7663d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27880: skipped 000823 1789601753.029743 trunc from 0x027880 to 0x02e883 (0x7004 bytes) 000824 1789601753.063223 read 0x006228 thru 0x00fc7d (0x9a56 bytes) 000825 1789601753.075532 trunc from 0x02e884 to 0x017ff9 (0x1688a bytes) 000826 1789601753.111699 MIRROR_SPLIT mirror 6 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17ffa): Mirror 11: 0x68020503 (stale) Mirror 16: 0x68020503 (stale) Mirror 18: 0x68020503 (stale) Mirror 19: 0x68020503 (stale) Mirror 20: 0x68020503 (stale) Mirror 24: 0x68020503 (stale) Mirror 25: 0x68020503 (stale) Mirror 26: 0xc21dd503 (stale) Mirror 27: 0x86970c37 (stale) Mirror 28: 0x86970c37 (stale) Mirror 29: 0x86970c37 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17ffa): Mirror 11: 0x68020503 (stale) Mirror 16: 0x68020503 (stale) Mirror 18: 0x68020503 (stale) Mirror 19: 0x68020503 (stale) Mirror 20: 0x68020503 (stale) Mirror 24: 0x68020503 (stale) Mirror 25: 0x68020503 (stale) Mirror 26: 0xc21dd503 (stale) Mirror 27: 0x86970c37 (stale) Mirror 28: 0x86970c37 (stale) Mirror 29: 0x86970c37 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17ffa: skipped 000827 1789601753.844923 write 0x015c76 thru 0x01d380 (0x770b bytes) 000828 1789601753.859708 punch from 0x00d00b to 0x0193b0 (0xc3a6 bytes) 000829 1789601753.892749 write 0x0161f4 thru 0x02078b (0xa598 bytes) 000830 1789601753.900376 punch from 0x017fbe to 0x02078b (0x87ce bytes) 000832 1789601753.917149 trunc from 0x02078c to 0x024dc8 (0x463d bytes) 000833 1789601753.932393 write 0x031e49 thru 0x03d706 (0xb8be bytes) 000834 1789601753.934443 read 0x0153f7 thru 0x01f57c (0xa186 bytes) 000835 1789601753.945996 punch from 0x0044f2 to 0x008f87 (0x4a96 bytes) 000836 1789601753.952465 write 0x03d416 thru 0x03d5de (0x1c9 bytes) 000837 1789601753.953429 trunc from 0x03d707 to 0x033a17 (0x9cef bytes) 000838 1789601753.970440 write 0x031ca0 thru 0x0362ee (0x464f bytes) 000839 1789601753.972118 trunc from 0x0362ef to 0x02f4e8 (0x6e06 bytes) 000840 1789601753.992417 write 0x0009e7 thru 0x006ff7 (0x6611 bytes) 000841 1789601754.002011 fallocate 0x037918 thru 0x03ffff (0x86e8 bytes) 000842 1789601754.011311 mapread 0x006096 thru 0x00b938 (0x58a3 bytes) 000843 1789601754.034347 fallocate 0x0006b4 thru 0x005127 (0x4a74 bytes) 000844 1789601754.040282 punch from 0x02da7c to 0x02f4e8 (0x1a6d bytes) 000846 1789601754.046376 punch from 0x024b46 to 0x02f4e8 (0xa9a3 bytes) 000847 1789601754.055769 mapwrite 0x0075e5 thru 0x015ca0 (0xe6bc bytes) 000848 1789601754.085189 punch from 0x02b093 to 0x02c4c5 (0x1433 bytes) 000849 1789601754.094337 punch from 0x01a594 to 0x022a1c (0x8489 bytes) 000850 1789601754.100297 trunc from 0x008f04 to 0x00c9f5 (0x3af2 bytes) 000851 1789601754.105101 fallocate 0x032d30 thru 0x037fec (0x52bd bytes) 000852 1789601754.109870 fallocate 0x017a40 thru 0x019567 (0x1b28 bytes) 000853 1789601754.114688 trunc from 0x02f4e9 to 0x0008a5 (0x2ec43 bytes) 000854 1789601754.135775 fallocate 0x031ace thru 0x03a297 (0x87ca bytes) 000855 1789601754.144483 MIRROR_RESYNC 12 mirrors 000856 1789601755.644681 mapread 0x00070f thru 0x0008a5 (0x197 bytes) 000857 1789601755.652338 fallocate 0x004729 thru 0x00c4a4 (0x7d7c bytes) 000858 1789601755.695077 fallocate 0x005189 thru 0x00d272 (0x80ea bytes) 000859 1789601755.704680 fallocate 0x02128e thru 0x02efff (0xdd72 bytes) 000860 1789601755.710513 read 0x0022c8 thru 0x00c4a4 (0xa1dd bytes) 000861 1789601755.719839 mapread 0x005d2c thru 0x00c4a4 (0x6779 bytes) 000862 1789601755.722074 trunc from 0x00480e to 0x00c4a4 (0x7c97 bytes) 000863 1789601755.729241 mapwrite 0x03f16b thru 0x03ffff (0xe95 bytes) 000865 1789601755.824266 mapread 0x004af8 thru 0x005ef8 (0x1401 bytes) 000866 1789601755.898552 MIRROR_SPLIT mirror 7 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x3f8ac2ee (stale) Mirror 16: 0x3f8ac2ee (stale) Mirror 18: 0x3f8ac2ee (stale) Mirror 19: 0x3f8ac2ee (stale) Mirror 20: 0x3f8ac2ee (stale) Mirror 24: 0x3f8ac2ee (stale) Mirror 26: 0x3f8ac2ee (stale) Mirror 27: 0x3f8ac2ee (stale) Mirror 28: 0x3f8ac2ee (stale) Mirror 29: 0x3f8ac2ee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x3f8ac2ee (stale) Mirror 16: 0x3f8ac2ee (stale) Mirror 18: 0x3f8ac2ee (stale) Mirror 19: 0x3f8ac2ee (stale) Mirror 20: 0x3f8ac2ee (stale) Mirror 24: 0x3f8ac2ee (stale) Mirror 26: 0x3f8ac2ee (stale) Mirror 27: 0x3f8ac2ee (stale) Mirror 28: 0x3f8ac2ee (stale) Mirror 29: 0x3f8ac2ee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000867 1789601756.598942 read 0x031cdf thru 0x03943d (0x775f bytes) 000868 1789601756.616509 mapwrite 0x005c3f thru 0x008042 (0x2404 bytes) 000869 1789601756.656875 trunc from 0x040000 to 0x011bab (0x2e454 bytes) 000870 1789601756.686436 trunc from 0x011bac to 0x02d1c9 (0x1b61e bytes) 000871 1789601756.716447 mapwrite 0x02166a thru 0x026a3d (0x53d4 bytes) 000872 1789601756.811049 punch from 0x013afe to 0x01b21d (0x7720 bytes) 000873 1789601756.818298 mapread 0x004a28 thru 0x004c2d (0x206 bytes) 000874 1789601756.820543 punch from 0x0215dc to 0x02d1c9 (0xbbee bytes) 000875 1789601756.829085 mapwrite 0x0315de thru 0x03471e (0x3141 bytes) 000876 1789601756.943850 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3471f): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3471f): Mirror 11: 0x6e748cc (stale) Mirror 16: 0x6e748cc (stale) Mirror 18: 0x6e748cc (stale) Mirror 19: 0x6e748cc (stale) Mirror 20: 0x6e748cc (stale) Mirror 24: 0x6e748cc (stale) Mirror 26: 0x6e748cc (stale) Mirror 27: 0x6e748cc (stale) Mirror 28: 0x6e748cc (stale) Mirror 29: 0x6e748cc (stale) CRC-32 checksum value for chunk [0, 0x3471f): Mirror 1: 0x83a370b8 Mirror 30: 0x83a370b8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3471f: skipped 000877 1789601758.280827 punch from 0x030fba to 0x03471e (0x3765 bytes) 000878 1789601758.354926 read 0x016b7e thru 0x0209f5 (0x9e78 bytes) 000879 1789601758.382507 fallocate 0x02fb09 thru 0x03baf6 (0xbfee bytes) 000880 1789601758.392051 mapwrite 0x016da0 thru 0x0220cc (0xb32d bytes) 000881 1789601758.468282 fallocate 0x00b5fd thru 0x00c663 (0x1067 bytes) 000882 1789601758.476919 write 0x01c80c thru 0x020439 (0x3c2e bytes) 000883 1789601758.481869 fallocate 0x00812c thru 0x01120c (0x90e1 bytes) 000884 1789601758.489893 punch from 0x001425 to 0x009be3 (0x87bf bytes) 000885 1789601758.496353 punch from 0x01972f to 0x019ff2 (0x8c4 bytes) 000886 1789601758.505360 mapwrite 0x03d169 thru 0x03f230 (0x20c8 bytes) 000887 1789601758.590304 mapread 0x026d75 thru 0x02f4aa (0x8736 bytes) 000888 1789601758.630860 write 0x0011a2 thru 0x0058e9 (0x4748 bytes) 000889 1789601758.652930 mapwrite 0x0044b2 thru 0x0131e6 (0xed35 bytes) 000890 1789601758.702255 trunc from 0x00d9cd to 0x015a30 (0x8064 bytes) 000891 1789601758.708739 punch from 0x035589 to 0x03a76c (0x51e4 bytes) 000892 1789601758.715120 trunc from 0x03f231 to 0x013755 (0x2badb bytes) 000894 1789601758.740894 mapwrite 0x031a76 thru 0x035231 (0x37bc bytes) 000895 1789601758.821369 write 0x03a250 thru 0x03ffff (0x5db0 bytes) 000896 1789601758.826922 mapwrite 0x01f3a9 thru 0x027859 (0x84b1 bytes) 000897 1789601758.861393 trunc from 0x023543 to 0x0252d7 (0x1d95 bytes) 000898 1789601758.866722 write 0x03ad5d thru 0x03ffff (0x52a3 bytes) 000899 1789601758.871856 MIRROR_RESYNC 12 mirrors 000901 1789601763.510507 fallocate 0x0166f6 thru 0x0247da (0xe0e5 bytes) 000902 1789601763.634649 trunc from 0x031217 to 0x038d87 (0x7b71 bytes) 000904 1789601763.656989 read 0x033067 thru 0x0354e2 (0x247c bytes) 000906 1789601763.665710 mapread 0x03e01e thru 0x03ffff (0x1fe2 bytes) 000907 1789601763.685790 punch from 0x00498c to 0x0132ff (0xe974 bytes) 000908 1789601763.700349 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x94093bfc (stale) Mirror 16: 0x94093bfc (stale) Mirror 18: 0x94093bfc (stale) Mirror 19: 0x94093bfc (stale) Mirror 20: 0x94093bfc (stale) Mirror 26: 0x94093bfc (stale) Mirror 27: 0x94093bfc (stale) Mirror 28: 0x94093bfc (stale) Mirror 29: 0x94093bfc (stale) Mirror 30: 0x94093bfc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x94093bfc (stale) Mirror 16: 0x94093bfc (stale) Mirror 18: 0x94093bfc (stale) Mirror 19: 0x94093bfc (stale) Mirror 20: 0x94093bfc (stale) Mirror 26: 0x94093bfc (stale) Mirror 27: 0x94093bfc (stale) Mirror 28: 0x94093bfc (stale) Mirror 29: 0x94093bfc (stale) Mirror 30: 0x94093bfc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000909 1789601764.534887 trunc from 0x000b7e to 0x0079f7 (0x6e7a bytes) 000911 1789601764.543306 write 0x014b78 thru 0x01b174 (0x65fd bytes) 000912 1789601764.561791 fallocate 0x02ae32 thru 0x035c0c (0xaddb bytes) 000913 1789601764.568174 trunc from 0x01ed36 to 0x0263ab (0x7676 bytes) 000914 1789601764.578393 mapread 0x01ddc5 thru 0x026ccd (0x8f09 bytes) 000915 1789601764.607786 trunc from 0x022242 to 0x02786a (0x5629 bytes) 000916 1789601764.613512 mapwrite 0x038b24 thru 0x039796 (0xc73 bytes) 000917 1789601764.669476 write 0x018c2f thru 0x01a4ac (0x187e bytes) 000918 1789601764.672164 write 0x035e28 thru 0x03ffff (0xa1d8 bytes) 000919 1789601764.674909 mapread 0x037e2d thru 0x03ffff (0x81d3 bytes) 000920 1789601764.676786 punch from 0x00ea90 to 0x012a0b (0x3f7c bytes) 000921 1789601764.682706 read 0x015d66 thru 0x0178d3 (0x1b6e bytes) 000922 1789601764.688308 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x44:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x94093bfc (stale) Mirror 16: 0x94093bfc (stale) Mirror 18: 0x94093bfc (stale) Mirror 19: 0x94093bfc (stale) Mirror 20: 0x94093bfc (stale) Mirror 26: 0x94093bfc (stale) Mirror 28: 0x94093bfc (stale) Mirror 29: 0x94093bfc (stale) Mirror 30: 0x94093bfc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x94093bfc (stale) Mirror 16: 0x94093bfc (stale) Mirror 18: 0x94093bfc (stale) Mirror 19: 0x94093bfc (stale) Mirror 20: 0x94093bfc (stale) Mirror 26: 0x94093bfc (stale) Mirror 28: 0x94093bfc (stale) Mirror 29: 0x94093bfc (stale) Mirror 30: 0x94093bfc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000924 1789601765.469347 mapwrite 0x020a3a thru 0x029f9c (0x9563 bytes) 000925 1789601765.531444 write 0x038dff thru 0x03ffff (0x7201 bytes) 000926 1789601765.553558 fallocate 0x009f7e thru 0x00dc6f (0x3cf2 bytes) 000927 1789601765.562348 mapwrite 0x03284c thru 0x03f1e8 (0xc99d bytes) 000928 1789601765.658494 mapread 0x02ce77 thru 0x034942 (0x7acc bytes) 000929 1789601765.661503 write 0x02a5b8 thru 0x034243 (0x9c8c bytes) 000930 1789601765.667500 trunc from 0x0022f3 to 0x009f8f (0x7c9d bytes) 000931 1789601765.682904 write 0x026fd9 thru 0x036531 (0xf559 bytes) 000933 1789601765.687257 mapread 0x035c00 thru 0x039363 (0x3764 bytes) 000934 1789601765.688685 write 0x03031e thru 0x03ecce (0xe9b1 bytes) 000935 1789601765.694122 mapread 0x00f63a thru 0x0186ca (0x9091 bytes) 000936 1789601765.719479 write 0x019ce9 thru 0x01cd19 (0x3031 bytes) 000937 1789601765.726035 mapwrite 0x03af17 thru 0x03ffff (0x50e9 bytes) 000938 1789601765.781495 fallocate 0x027f8c thru 0x02b13c (0x31b1 bytes) 000939 1789601765.802182 mapwrite 0x01ce35 thru 0x021e94 (0x5060 bytes) 000940 1789601765.825156 fallocate 0x00c1d4 thru 0x01a138 (0xdf65 bytes) 000941 1789601765.830799 trunc from 0x029406 to 0x0346a9 (0xb2a4 bytes) 000942 1789601765.835760 mapwrite 0x03f0b9 thru 0x03f12d (0x75 bytes) 000943 1789601765.848913 fallocate 0x033ba9 thru 0x03ffff (0xc457 bytes) 000944 1789601765.855258 read 0x02144f thru 0x02d74f (0xc301 bytes) 000945 1789601765.867844 fallocate 0x025f7f thru 0x034c61 (0xece3 bytes) 000946 1789601765.878417 punch from 0x031fac to 0x034a25 (0x2a7a bytes) 000947 1789601765.887756 read 0x005799 thru 0x00de5d (0x86c5 bytes) 000948 1789601765.900933 read 0x017f8a thru 0x024f8e (0xd005 bytes) 000949 1789601765.902190 mapread 0x033d53 thru 0x03ea3f (0xaced bytes) 000950 1789601765.910474 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x94093bfc (stale) Mirror 16: 0x94093bfc (stale) Mirror 18: 0x94093bfc (stale) Mirror 19: 0x94093bfc (stale) Mirror 20: 0x94093bfc (stale) Mirror 26: 0x94093bfc (stale) Mirror 28: 0x94093bfc (stale) Mirror 29: 0x94093bfc (stale) Mirror 30: 0x94093bfc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc48860db Mirror 31: 0xc48860db lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000951 1789601767.589267 trunc from 0x040000 to 0x00f347 (0x30cb8 bytes) 000953 1789601767.644352 mapwrite 0x00c7ac thru 0x01551c (0x8d71 bytes) 000954 1789601767.740777 trunc from 0x00f79d to 0x01551c (0x5d80 bytes) 000955 1789601767.750541 read 0x014a14 thru 0x01551c (0xb09 bytes) 000956 1789601767.759558 mapread 0x008042 thru 0x014afa (0xcab9 bytes) 000957 1789601767.785837 read 0x00bfdb thru 0x012694 (0x66ba bytes) 000958 1789601767.788217 read 0x00fcc1 thru 0x01312c (0x346c bytes) 000959 1789601767.790446 mapwrite 0x027ff1 thru 0x03487a (0xc88a bytes) 000960 1789601767.914358 trunc from 0x02a2e5 to 0x02b8d4 (0x15f0 bytes) 000961 1789601767.927993 mapread 0x01888b thru 0x01ded1 (0x5647 bytes) 000962 1789601767.932399 trunc from 0x00483e to 0x008f86 (0x4749 bytes) 000963 1789601767.944902 read 0x033845 thru 0x03487a (0x1036 bytes) 000964 1789601767.958145 MIRROR_RESYNC 11 mirrors 000965 1789601771.671118 punch from 0x02b3ef to 0x0307a5 (0x53b7 bytes) 000966 1789601771.744844 MIRROR_RESYNC 11 mirrors 000967 1789601776.915976 trunc from 0x03487b to 0x023b5f (0x10d1b bytes) 000968 1789601776.969210 mapread 0x000c5d thru 0x0036d4 (0x2a78 bytes) 000969 1789601776.995460 write 0x02481d thru 0x033d79 (0xf55d bytes) 000970 1789601776.997217 fallocate 0x006015 thru 0x0071b4 (0x11a0 bytes) 000971 1789601777.003313 fallocate 0x03cae0 thru 0x03ffff (0x3520 bytes) 000972 1789601777.013352 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x3001b02c (stale) Mirror 16: 0x3001b02c (stale) Mirror 18: 0x3001b02c (stale) Mirror 19: 0x3001b02c (stale) Mirror 20: 0x3001b02c (stale) Mirror 26: 0x3001b02c (stale) Mirror 28: 0x3001b02c (stale) Mirror 29: 0x3001b02c (stale) Mirror 30: 0x3001b02c (stale) Mirror 31: 0x3001b02c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5446ebe6 Mirror 32: 0x5446ebe6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000973 1789601778.387938 mapwrite 0x01bd6f thru 0x025058 (0x92ea bytes) 000974 1789601778.575818 trunc from 0x02c1f1 to 0x03a6d2 (0xe4e2 bytes) 000975 1789601778.604620 punch from 0x03bc83 to 0x03ffff (0x437d bytes) 000976 1789601778.615149 punch from 0x00bca8 to 0x01bbab (0xff04 bytes) 000977 1789601778.634326 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x3001b02c (stale) Mirror 16: 0x3001b02c (stale) Mirror 18: 0x3001b02c (stale) Mirror 19: 0x3001b02c (stale) Mirror 20: 0x3001b02c (stale) Mirror 26: 0x3001b02c (stale) Mirror 28: 0x3001b02c (stale) Mirror 29: 0x3001b02c (stale) Mirror 30: 0x3001b02c (stale) Mirror 31: 0x3001b02c (stale) Mirror 32: 0x5446ebe6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x470484cc Mirror 33: 0x470484cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000978 1789601780.222771 write 0x01c939 thru 0x0279e9 (0xb0b1 bytes) 000979 1789601780.352831 read 0x031eee thru 0x03aacf (0x8be2 bytes) 000980 1789601780.375680 punch from 0x00c09a to 0x016fd0 (0xaf37 bytes) 000981 1789601780.383909 trunc from 0x00a165 to 0x00fa8c (0x5928 bytes) 000982 1789601780.390353 write 0x00bd3b thru 0x013424 (0x76ea bytes) 000983 1789601780.419117 mapread 0x032d13 thru 0x03818f (0x547d bytes) 000984 1789601780.420873 write 0x03f882 thru 0x03ffff (0x77e bytes) 000985 1789601780.436021 mapwrite 0x03c78d thru 0x03ca6f (0x2e3 bytes) 000986 1789601780.523404 trunc from 0x024a10 to 0x028d37 (0x4328 bytes) 000987 1789601780.533265 fallocate 0x00b797 thru 0x01a649 (0xeeb3 bytes) 000988 1789601780.540835 punch from 0x02f075 to 0x02fcdc (0xc68 bytes) 000989 1789601780.551313 trunc from 0x040000 to 0x013d20 (0x2c2df bytes) 000990 1789601780.596179 mapread 0x0124c6 thru 0x013d20 (0x185b bytes) 000991 1789601780.598407 fallocate 0x00a30d thru 0x019903 (0xf5f7 bytes) 000992 1789601780.604319 punch from 0x000d0e to 0x003573 (0x2866 bytes) 000994 1789601780.612200 trunc from 0x013d21 to 0x02b9f9 (0x17cd9 bytes) 000996 1789601780.642414 fallocate 0x03dbf3 thru 0x03ffff (0x240d bytes) 000997 1789601780.658600 mapread 0x01bca1 thru 0x02b9f9 (0xfd59 bytes) 000998 1789601780.724080 MIRROR_RESYNC 13 mirrors 000999 1789601783.567851 mapwrite 0x002fdb thru 0x00c28e (0x92b4 bytes) 001000 1789601783.719815 write 0x025a79 thru 0x031e86 (0xc40e bytes) All operations completed A-OK!