== sanity-flr test 70a: flr mode fsx test ================ 16:38:34 (1786480714) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 716 skipping zero size read skipping zero size read 000007 1786480717.191829 write 0x020be0 thru 0x024371 (0x3792 bytes) 000008 1786480717.196924 mapread 0x00d278 thru 0x0140f4 (0x6e7d bytes) 000010 1786480717.228443 write 0x01b052 thru 0x02877c (0xd72b bytes) 000011 1786480717.237865 write 0x02a84d thru 0x03486e (0xa022 bytes) 000012 1786480717.243628 write 0x02812d thru 0x036d46 (0xec1a bytes) truncating to largest ever: 0x74ce 000014 1786480717.251106 trunc from 0x036d47 to 0x0074cd (0x2f879 bytes) 000015 1786480717.268860 mapread 0x0059d4 thru 0x0074cd (0x1afa bytes) 000016 1786480717.284759 read 0x00387a thru 0x0074cd (0x3c54 bytes) 000017 1786480717.287730 mapwrite 0x03331d thru 0x03a204 (0x6ee8 bytes) truncating to largest ever: 0x9e0d 000019 1786480717.338827 trunc from 0x03a205 to 0x009e0c (0x303f8 bytes) 000020 1786480717.365041 punch from 0x0011cc to 0x002302 (0x1137 bytes) 000021 1786480717.370641 mapwrite 0x0328ab thru 0x03dfe2 (0xb738 bytes) truncating to largest ever: 0x20443 000022 1786480717.448520 trunc from 0x03dfe3 to 0x020442 (0x1dba0 bytes) 000023 1786480717.475319 mapread 0x0038b9 thru 0x0135da (0xfd22 bytes) 000024 1786480717.499733 punch from 0x0201e1 to 0x020442 (0x262 bytes) 000025 1786480717.508831 read 0x000986 thru 0x00ea10 (0xe08b bytes) 000026 1786480717.521620 punch from 0x009c63 to 0x018247 (0xe5e5 bytes) 000027 1786480717.529333 mapread 0x0112fe thru 0x01fd6c (0xea6f bytes) 000028 1786480717.585396 read 0x005a10 thru 0x011dbe (0xc3af bytes) 000029 1786480717.600397 read 0x011a20 thru 0x013877 (0x1e58 bytes) 000030 1786480717.602526 fallocate 0x00c84e thru 0x0171f1 (0xa9a4 bytes) 000032 1786480717.619438 MIRROR_EXTEND to 2 mirrors fallocating to largest ever: 0x24815 000033 1786480718.323661 fallocate 0x01968a thru 0x024814 (0xb18b bytes) 000034 1786480718.376279 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x24815): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24815): Mirror 2: 0x5dbe5213 (stale) CRC-32 checksum value for chunk [0, 0x24815): Mirror 1: 0x5dbe5213 Mirror 3: 0x5dbe5213 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24815: skipped 000035 1786480719.220673 mapwrite 0x0017e8 thru 0x00d515 (0xbd2e bytes) 000036 1786480719.385205 fallocate 0x01369c thru 0x018d71 (0x56d6 bytes) 000037 1786480719.392581 mapread 0x02351a thru 0x024814 (0x12fb bytes) 000038 1786480719.406454 mapwrite 0x022a11 thru 0x0237c8 (0xdb8 bytes) 000039 1786480719.423419 punch from 0x005975 to 0x0150e2 (0xf76e bytes) 000040 1786480719.437185 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24815): Mirror 2: 0x5dbe5213 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24815): Mirror 2: 0x5dbe5213 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24815: skipped 000041 1786480719.770353 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) 000042 1786480719.954664 read 0x012216 thru 0x020a9d (0xe888 bytes) 000043 1786480719.970461 mapread 0x004ab0 thru 0x011576 (0xcac7 bytes) 000044 1786480719.999016 write 0x0319ee thru 0x037f97 (0x65aa bytes) 000045 1786480720.007328 read 0x01f780 thru 0x029a07 (0xa288 bytes) 000046 1786480720.023515 read 0x01c356 thru 0x01c9dd (0x688 bytes) 000047 1786480720.025470 punch from 0x037860 to 0x037f97 (0x738 bytes) 000049 1786480720.046281 fallocate 0x00f14a thru 0x01e6f9 (0xf5b0 bytes) 000052 1786480720.057085 fallocate 0x011676 thru 0x01a9e1 (0x936c bytes) 000053 1786480720.063605 fallocate 0x02310a thru 0x023fad (0xea4 bytes) 000055 1786480720.071525 mapread 0x033796 thru 0x037f97 (0x4802 bytes) 000056 1786480720.082984 read 0x026c8a thru 0x02e774 (0x7aeb bytes) 000057 1786480720.084516 trunc from 0x0126fd to 0x019536 (0x6e3a bytes) truncating to largest ever: 0x34e17 000058 1786480720.091574 trunc from 0x037f98 to 0x034e16 (0x3181 bytes) 000059 1786480720.111937 trunc from 0x034e17 to 0x01f023 (0x15df3 bytes) 000060 1786480720.140289 punch from 0x004edf to 0x01046c (0xb58e bytes) fallocating to largest ever: 0x40000 000061 1786480720.146432 fallocate 0x03ddf3 thru 0x03ffff (0x220d bytes) 000062 1786480720.157569 punch from 0x015bb5 to 0x01c454 (0x68a0 bytes) 000063 1786480720.173545 write 0x02c2b1 thru 0x02c882 (0x5d2 bytes) 000066 1786480720.177481 trunc from 0x00b2ed to 0x016281 (0xaf95 bytes) 000069 1786480720.186314 trunc from 0x02c883 to 0x00a0d9 (0x227a9 bytes) 000070 1786480720.202630 fallocate 0x03e9e4 thru 0x03ffff (0x161c bytes) 000071 1786480720.214512 mapread 0x00881d thru 0x009482 (0xc66 bytes) 000072 1786480720.226149 write 0x0176a3 thru 0x01fb41 (0x849f bytes) 000073 1786480720.227820 read 0x00ccc2 thru 0x014d0c (0x804b bytes) 000074 1786480720.241271 trunc from 0x01fb42 to 0x020241 (0x700 bytes) 000075 1786480720.280288 read 0x00bad3 thru 0x00c1ee (0x71c bytes) 000076 1786480720.281272 punch from 0x00ba25 to 0x0199d5 (0xdfb1 bytes) 000077 1786480720.296029 mapread 0x01349c thru 0x01d3d8 (0x9f3d bytes) 000078 1786480720.307123 mapwrite 0x03610b thru 0x03a3ea (0x42e0 bytes) 000079 1786480720.351633 trunc from 0x03a3eb to 0x02a3f0 (0xfffa bytes) 000080 1786480720.369025 punch from 0x026ef6 to 0x0294fa (0x2605 bytes) 000081 1786480720.379595 fallocate 0x02e9a7 thru 0x0337a4 (0x4dfe bytes) 000083 1786480720.387829 fallocate 0x005789 thru 0x00ac68 (0x54e0 bytes) 000084 1786480720.393559 punch from 0x00afca to 0x00b9e9 (0xa20 bytes) 000085 1786480720.399138 mapwrite 0x038275 thru 0x03ffff (0x7d8b bytes) 000086 1786480720.451436 trunc from 0x040000 to 0x02d9e5 (0x1261a bytes) 000087 1786480720.470136 fallocate 0x02fdfa thru 0x0374aa (0x76b1 bytes) 000088 1786480720.475813 mapwrite 0x017f2f thru 0x01e649 (0x671b bytes) 000089 1786480720.496270 trunc from 0x0156ef to 0x018d43 (0x3655 bytes) 000090 1786480720.506422 read 0x01fcbd thru 0x02680b (0x6b4f bytes) 000091 1786480720.527238 punch from 0x01f29f to 0x023aa4 (0x4806 bytes) 000092 1786480720.539123 trunc from 0x0374ab to 0x021d68 (0x15742 bytes) 000093 1786480720.556239 write 0x027033 thru 0x036602 (0xf5d0 bytes) 000094 1786480720.558421 trunc from 0x036603 to 0x014a2c (0x21bd6 bytes) 000095 1786480720.575963 trunc from 0x001fa3 to 0x00dd0b (0xbd69 bytes) 000096 1786480720.581746 fallocate 0x03ef04 thru 0x03ffff (0x10fc bytes) 000097 1786480720.586898 trunc from 0x040000 to 0x0271f0 (0x18e0f bytes) 000098 1786480720.604691 fallocate 0x0042bb thru 0x010d4e (0xca94 bytes) 000099 1786480720.610212 punch from 0x01f8de to 0x0271f0 (0x7913 bytes) 000100 1786480720.615145 punch from 0x01746c to 0x02416b (0xcd00 bytes) 000102 1786480720.621688 mapread 0x025c32 thru 0x0271f0 (0x15bf bytes) 000103 1786480720.636378 trunc from 0x0129c2 to 0x01fe77 (0xd4b6 bytes) 000105 1786480720.642997 mapwrite 0x0034a3 thru 0x009cb3 (0x6811 bytes) 000106 1786480720.699635 mapwrite 0x031ab2 thru 0x039717 (0x7c66 bytes) 000107 1786480720.772634 trunc from 0x00b317 to 0x018a65 (0xd74f bytes) 000109 1786480720.779055 mapwrite 0x02d2d5 thru 0x030ff0 (0x3d1c bytes) 000110 1786480720.823408 trunc from 0x02bcbb to 0x038d49 (0xd08f bytes) 000111 1786480720.837042 punch from 0x016805 to 0x01f7eb (0x8fe7 bytes) 000112 1786480720.842455 fallocate 0x02b9a4 thru 0x03b0e7 (0xf744 bytes) 000113 1786480720.849039 write 0x004294 thru 0x0123c0 (0xe12d bytes) 000114 1786480720.858556 write 0x0191f6 thru 0x01d58e (0x4399 bytes) 000115 1786480720.869335 trunc from 0x03b0e8 to 0x014dd6 (0x26311 bytes) 000116 1786480720.888051 mapread 0x00fc5d thru 0x011c37 (0x1fdb bytes) 000117 1786480720.889648 punch from 0x0144e9 to 0x014dd6 (0x8ee bytes) 000118 1786480720.900439 MIRROR_EXTEND to 2 mirrors 000119 1786480721.527396 mapread 0x005af3 thru 0x00660e (0xb1c bytes) 000120 1786480721.546673 fallocate 0x005efd thru 0x00c0d4 (0x61d8 bytes) 000121 1786480721.586456 mapread 0x00ef4b thru 0x00fcd4 (0xd8a bytes) 000122 1786480721.606363 punch from 0x00877c to 0x00f131 (0x69b6 bytes) 000123 1786480721.614622 write 0x01ff00 thru 0x021634 (0x1735 bytes) 000124 1786480721.622247 mapwrite 0x03bdcf thru 0x03d2f2 (0x1524 bytes) 000125 1786480721.674288 write 0x013132 thru 0x01b7a0 (0x866f bytes) 000128 1786480721.692715 read 0x027d97 thru 0x033913 (0xbb7d bytes) 000129 1786480721.703276 read 0x025c10 thru 0x02f567 (0x9958 bytes) 000130 1786480721.726648 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d2f3): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d2f3): Mirror 2: 0xd933dd5a (stale) CRC-32 checksum value for chunk [0, 0x3d2f3): Mirror 1: 0x36805d7b Mirror 3: 0x36805d7b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d2f3: skipped 000132 1786480723.060362 punch from 0x032967 to 0x03637d (0x3a17 bytes) 000133 1786480723.103394 mapwrite 0x001f3a thru 0x011c10 (0xfcd7 bytes) 000134 1786480723.163177 mapwrite 0x003627 thru 0x0040a5 (0xa7f bytes) 000135 1786480723.177546 fallocate 0x01f03d thru 0x020cc1 (0x1c85 bytes) 000136 1786480723.187917 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d2f3): Mirror 2: 0xd933dd5a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d2f3): Mirror 2: 0xd933dd5a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d2f3: skipped 000137 1786480723.540358 read 0x02195f thru 0x029f39 (0x85db bytes) 000138 1786480723.550524 trunc from 0x03d2f3 to 0x017972 (0x25980 bytes) 000139 1786480723.568691 read 0x016f8f thru 0x017972 (0x9e4 bytes) 000141 1786480723.580222 trunc from 0x013f94 to 0x016926 (0x2993 bytes) 000142 1786480723.583459 fallocate 0x03e5fb thru 0x03ffff (0x1a05 bytes) 000143 1786480723.586413 trunc from 0x017973 to 0x0234bb (0xbb49 bytes) 000144 1786480723.598051 write 0x0011e8 thru 0x0076e4 (0x64fd bytes) 000145 1786480723.599217 trunc from 0x01f557 to 0x0234bb (0x3f65 bytes) 000146 1786480723.602519 write 0x039f63 thru 0x03d0ba (0x3158 bytes) 000149 1786480723.604603 punch from 0x0035e5 to 0x00dd6a (0xa786 bytes) 000150 1786480723.621148 write 0x02ee65 thru 0x038105 (0x92a1 bytes) 000151 1786480723.636797 read 0x00d7ca thru 0x01c161 (0xe998 bytes) 000152 1786480723.648277 trunc from 0x03d0bb to 0x00daa0 (0x2f61a bytes) 000153 1786480723.667161 read 0x009fdd thru 0x00daa0 (0x3ac4 bytes) 000154 1786480723.669088 mapwrite 0x00913e thru 0x015a61 (0xc924 bytes) 000155 1786480723.729401 trunc from 0x015a62 to 0x02a937 (0x14ed6 bytes) 000156 1786480723.762614 fallocate 0x01df23 thru 0x025049 (0x7127 bytes) 000157 1786480723.776011 fallocate 0x038db4 thru 0x03cf40 (0x418d bytes) 000158 1786480723.782662 punch from 0x00f131 to 0x01078f (0x165f bytes) 000159 1786480723.794113 trunc from 0x03cf41 to 0x03f49b (0x255b bytes) 000160 1786480723.812114 mapread 0x007f21 thru 0x013a1a (0xbafa bytes) 000161 1786480723.833312 MIRROR_RESYNC 2 mirrors 000162 1786480724.530671 write 0x014c19 thru 0x019d00 (0x50e8 bytes) 000163 1786480724.564356 punch from 0x014388 to 0x019ab4 (0x572d bytes) 000164 1786480724.576817 fallocate 0x0007eb thru 0x006461 (0x5c77 bytes) 000165 1786480724.594316 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) 000166 1786480724.745345 write 0x008461 thru 0x00bccc (0x386c bytes) 000167 1786480724.761912 mapwrite 0x02f87c thru 0x03ab0a (0xb28f bytes) 000168 1786480724.811032 fallocate 0x0007ad thru 0x00cd6a (0xc5be bytes) 000170 1786480724.817124 trunc from 0x03f49c to 0x00fc87 (0x2f814 bytes) 000171 1786480724.836988 trunc from 0x00fc88 to 0x02a40e (0x1a787 bytes) 000173 1786480724.857369 fallocate 0x032574 thru 0x032831 (0x2be bytes) 000174 1786480724.863319 fallocate 0x007b62 thru 0x01447c (0xc91b bytes) 000175 1786480724.868743 fallocate 0x03f72d thru 0x03ffff (0x8d3 bytes) 000176 1786480724.874629 mapread 0x034a66 thru 0x03d3e1 (0x897c bytes) 000177 1786480724.892535 read 0x01a96a thru 0x01cc00 (0x2297 bytes) 000179 1786480724.905398 write 0x02756e thru 0x03201d (0xaab0 bytes) 000181 1786480724.919963 punch from 0x026fb9 to 0x027ebd (0xf05 bytes) 000182 1786480724.944249 fallocate 0x02ad78 thru 0x037d51 (0xcfda bytes) 000183 1786480724.962052 trunc from 0x0008cc to 0x000d1d (0x452 bytes) 000184 1786480724.968640 mapread 0x011421 thru 0x01c58a (0xb16a bytes) 000185 1786480724.980473 write 0x00eb97 thru 0x01702a (0x8494 bytes) 000186 1786480724.982994 punch from 0x004989 to 0x00e354 (0x99cc bytes) 000187 1786480725.006346 read 0x00b676 thru 0x00dcc4 (0x264f bytes) 000188 1786480725.024020 fallocate 0x032ed1 thru 0x03ffff (0xd12f bytes) 000189 1786480725.032089 write 0x0396f5 thru 0x03a552 (0xe5e bytes) 000190 1786480725.034786 read 0x0094f0 thru 0x010a16 (0x7527 bytes) 000192 1786480725.038838 punch from 0x01e9fb to 0x02d857 (0xee5d bytes) 000194 1786480725.046643 trunc from 0x040000 to 0x037f8f (0x8070 bytes) 000195 1786480725.086233 read 0x00e712 thru 0x018843 (0xa132 bytes) 000196 1786480725.101325 MIRROR_EXTEND to 2 mirrors 000197 1786480725.922276 trunc from 0x037f90 to 0x007937 (0x30658 bytes) 000198 1786480725.996457 mapread 0x00386d thru 0x007937 (0x40cb bytes) 000199 1786480726.042313 trunc from 0x0069e9 to 0x007937 (0xf4f bytes) 000200 1786480726.058979 read 0x000bca thru 0x007937 (0x6d6e bytes) 000201 1786480726.069759 fallocate 0x00b67c thru 0x015d35 (0xa6ba bytes) 000202 1786480726.077857 write 0x008fda thru 0x017207 (0xe22e bytes) 000203 1786480726.079973 fallocate 0x0082c5 thru 0x00c5ba (0x42f6 bytes) 000204 1786480726.090696 mapwrite 0x02408d thru 0x0307d4 (0xc748 bytes) 000205 1786480726.148908 fallocate 0x036673 thru 0x03ffff (0x998d bytes) 000206 1786480726.154651 trunc from 0x0307d5 to 0x001cd4 (0x2eb00 bytes) 000207 1786480726.173531 mapwrite 0x017ebe thru 0x026ccd (0xee10 bytes) 000209 1786480726.235483 trunc from 0x0260a7 to 0x026ccd (0xc27 bytes) 000210 1786480726.246454 mapread 0x008c8f thru 0x008cf6 (0x68 bytes) 000211 1786480726.260494 punch from 0x01e8f5 to 0x020750 (0x1e5c bytes) 000212 1786480726.265839 read 0x00cb33 thru 0x01ab64 (0xe032 bytes) 000213 1786480726.266697 fallocate 0x038aa0 thru 0x03fadd (0x703e bytes) 000214 1786480726.276568 fallocate 0x017e9b thru 0x01a02c (0x2192 bytes) 000215 1786480726.281582 mapwrite 0x000c2b thru 0x00eb9c (0xdf72 bytes) 000216 1786480726.302299 mapwrite 0x008f31 thru 0x018e59 (0xff29 bytes) 000217 1786480726.330286 punch from 0x019dc3 to 0x01f08c (0x52ca bytes) 000218 1786480726.338549 mapread 0x0068a5 thru 0x00a03b (0x3797 bytes) 000219 1786480726.340296 mapread 0x01af9f thru 0x026ccd (0xbd2f bytes) 000220 1786480726.350622 read 0x008f02 thru 0x015860 (0xc95f bytes) 000221 1786480726.351475 mapread 0x00ea51 thru 0x0134bd (0x4a6d bytes) 000222 1786480726.353364 read 0x01a1fd thru 0x022c18 (0x8a1c bytes) 000223 1786480726.357313 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x26cce): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26cce): Mirror 2: 0x324ab69d (stale) CRC-32 checksum value for chunk [0, 0x26cce): Mirror 1: 0x75fbbe5a Mirror 3: 0x75fbbe5a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26cce: skipped 000224 1786480727.255451 mapread 0x01e187 thru 0x026ccd (0x8b47 bytes) 000225 1786480727.282754 mapwrite 0x013191 thru 0x02230f (0xf17f bytes) 000226 1786480727.390214 punch from 0x02416e to 0x026ccd (0x2b60 bytes) 000227 1786480727.395782 trunc from 0x026cce to 0x0149ca (0x12303 bytes) 000228 1786480727.477919 mapwrite 0x0208a3 thru 0x028423 (0x7b81 bytes) 000229 1786480727.531153 write 0x03a2e2 thru 0x03f4a2 (0x51c1 bytes) 000230 1786480727.534339 read 0x03b5ce thru 0x03f4a2 (0x3ed5 bytes) 000231 1786480727.534962 mapwrite 0x026309 thru 0x029dcb (0x3ac3 bytes) 000232 1786480727.575622 trunc from 0x032b49 to 0x037c1d (0x50d5 bytes) 000233 1786480727.581589 read 0x00efd4 thru 0x01cc1d (0xdc4a bytes) 000234 1786480727.599541 read 0x01b80e thru 0x01d69d (0x1e90 bytes) 000235 1786480727.601297 write 0x009d5c thru 0x012d5d (0x9002 bytes) 000236 1786480727.604578 trunc from 0x03f4a3 to 0x0141c9 (0x2b2d9 bytes) 000237 1786480727.626449 fallocate 0x03200d thru 0x03c09c (0xa090 bytes) 000238 1786480727.633246 fallocate 0x0382df thru 0x039055 (0xd77 bytes) 000239 1786480727.652495 fallocate 0x005f11 thru 0x007380 (0x1470 bytes) 000240 1786480727.669982 mapread 0x0381f7 thru 0x039055 (0xe5f bytes) 000241 1786480727.681511 read 0x02e1e1 thru 0x033787 (0x55a7 bytes) 000242 1786480727.686783 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39056): Mirror 3: 0xad096b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39056): Mirror 3: 0xad096b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39056: skipped 000243 1786480728.033182 write 0x006dcc thru 0x00d504 (0x6739 bytes) 000244 1786480728.053986 punch from 0x003523 to 0x005900 (0x23de bytes) 000246 1786480728.061602 fallocate 0x02b2a6 thru 0x039c59 (0xe9b4 bytes) 000247 1786480728.068473 write 0x0214c4 thru 0x02b054 (0x9b91 bytes) 000248 1786480728.080917 trunc from 0x01ccd5 to 0x028228 (0xb554 bytes) 000249 1786480728.101856 mapwrite 0x0338f2 thru 0x038acc (0x51db bytes) 000250 1786480728.150984 fallocate 0x019643 thru 0x027ced (0xe6ab bytes) 000251 1786480728.168546 mapread 0x006392 thru 0x011486 (0xb0f5 bytes) 000252 1786480728.191715 write 0x0253e5 thru 0x02adc7 (0x59e3 bytes) 000253 1786480728.199913 trunc from 0x02da37 to 0x035203 (0x77cd bytes) 000254 1786480728.207047 punch from 0x003794 to 0x008b8b (0x53f8 bytes) 000255 1786480728.213361 trunc from 0x039c5a to 0x024b26 (0x15133 bytes) 000256 1786480728.237590 write 0x03877a thru 0x03ffff (0x7886 bytes) 000257 1786480728.240414 trunc from 0x00c362 to 0x016741 (0xa3e0 bytes) 000258 1786480728.260804 read 0x039db9 thru 0x03ffff (0x6247 bytes) 000259 1786480728.261843 write 0x0379fd thru 0x03ffff (0x8603 bytes) 000260 1786480728.276621 mapwrite 0x02388b thru 0x02d9b3 (0xa129 bytes) 000261 1786480728.317959 trunc from 0x040000 to 0x00a1c9 (0x35e36 bytes) 000262 1786480728.356329 punch from 0x006ea2 to 0x009a0e (0x2b6d bytes) 000263 1786480728.368962 punch from 0x000f6b to 0x0097c1 (0x8857 bytes) 000264 1786480728.385136 read 0x00163c thru 0x00742c (0x5df1 bytes) 000265 1786480728.441104 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) 000266 1786480728.642733 mapwrite 0x0049ee thru 0x00e6a2 (0x9cb5 bytes) 000267 1786480728.725603 mapread 0x0006c9 thru 0x003ca0 (0x35d8 bytes) 000268 1786480728.731993 fallocate 0x034791 thru 0x03aa1a (0x628a bytes) 000269 1786480728.739532 fallocate 0x02088e thru 0x02213f (0x18b2 bytes) 000270 1786480728.751194 trunc from 0x0181d0 to 0x01c0ce (0x3eff bytes) 000271 1786480728.770214 read 0x012c36 thru 0x01dbeb (0xafb6 bytes) 000272 1786480728.788461 fallocate 0x00cb4d thru 0x01777f (0xac33 bytes) 000273 1786480728.796878 fallocate 0x01b22b thru 0x02473e (0x9514 bytes) 000275 1786480728.806691 fallocate 0x007d01 thru 0x015818 (0xdb18 bytes) 000276 1786480728.814842 fallocate 0x015421 thru 0x0245a9 (0xf189 bytes) 000277 1786480728.825340 trunc from 0x02473f to 0x020d37 (0x3a07 bytes) 000278 1786480728.862571 read 0x018652 thru 0x01959b (0xf4a bytes) 000279 1786480728.863922 fallocate 0x02e084 thru 0x033dc6 (0x5d43 bytes) 000280 1786480728.873815 mapwrite 0x02c5ac thru 0x0333cc (0x6e21 bytes) 000282 1786480728.945604 MIRROR_EXTEND to 2 mirrors 000283 1786480729.760785 fallocate 0x003682 thru 0x003735 (0xb4 bytes) 000284 1786480729.813584 trunc from 0x020300 to 0x02949a (0x919b bytes) 000285 1786480729.825976 trunc from 0x01f7d9 to 0x02d014 (0xd83c bytes) 000286 1786480729.840641 trunc from 0x0333cd to 0x031d07 (0x16c5 bytes) 000287 1786480729.878658 mapwrite 0x03b90f thru 0x03ffff (0x46f1 bytes) 000288 1786480729.945436 trunc from 0x006ce3 to 0x014adf (0xddfd bytes) 000289 1786480729.954349 fallocate 0x00d4dd thru 0x01b167 (0xdc8b bytes) 000290 1786480729.961434 mapwrite 0x01256a thru 0x01345b (0xef2 bytes) 000291 1786480729.989300 mapread 0x00de0c thru 0x01dc4c (0xfe41 bytes) 000292 1786480730.002219 read 0x032725 thru 0x036d33 (0x460f bytes) 000293 1786480730.008898 trunc from 0x040000 to 0x033c22 (0xc3dd bytes) 000294 1786480730.028243 punch from 0x031b54 to 0x033c22 (0x20cf bytes) 000295 1786480730.034240 mapwrite 0x00f843 thru 0x01f5f4 (0xfdb2 bytes) 000296 1786480730.056932 trunc from 0x033c23 to 0x016299 (0x1d989 bytes) 000298 1786480730.081466 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1629a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1629a): Mirror 2: 0x13605f4e (stale) CRC-32 checksum value for chunk [0, 0x1629a): Mirror 1: 0x5facaa59 Mirror 3: 0x5facaa59 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1629a: skipped 000301 1786480730.789376 punch from 0x00ae70 to 0x0118b8 (0x6a49 bytes) 000302 1786480730.826967 mapwrite 0x039bd2 thru 0x03eeb2 (0x52e1 bytes) 000303 1786480730.902524 fallocate 0x00f259 thru 0x0132b0 (0x4058 bytes) 000306 1786480730.911239 read 0x0342fe thru 0x03d12a (0x8e2d bytes) 000307 1786480730.917456 MIRROR_RESYNC 3 mirrors 000308 1786480731.740766 MIRROR_EXTEND to 4 mirrors 000309 1786480732.659318 mapread 0x03b85e thru 0x03eeb2 (0x3655 bytes) 000310 1786480732.692767 trunc from 0x03eeb3 to 0x02226f (0x1cc43 bytes) 000311 1786480732.741531 fallocate 0x00edbb thru 0x018756 (0x999c bytes) 000312 1786480732.747159 mapwrite 0x036167 thru 0x03ffff (0x9e99 bytes) 000313 1786480732.845466 punch from 0x01a652 to 0x01fbe2 (0x5591 bytes) 000314 1786480732.851041 read 0x009338 thru 0x009625 (0x2ee bytes) 000315 1786480732.858297 punch from 0x0355a4 to 0x038e49 (0x38a6 bytes) 000316 1786480732.867675 read 0x02cdf3 thru 0x02ec97 (0x1ea5 bytes) 000317 1786480732.884696 trunc from 0x040000 to 0x0196d5 (0x2692a bytes) 000318 1786480732.902803 trunc from 0x007a0f to 0x00eefc (0x74ee bytes) 000319 1786480732.907910 trunc from 0x0196d6 to 0x02faec (0x16417 bytes) 000320 1786480732.928813 trunc from 0x01837a to 0x01b7d2 (0x3459 bytes) 000323 1786480732.934927 trunc from 0x028de0 to 0x02f1dc (0x63fd bytes) 000325 1786480732.941397 punch from 0x00251e to 0x00ae12 (0x88f5 bytes) 000326 1786480732.946807 punch from 0x012435 to 0x01f2e0 (0xceac bytes) 000328 1786480732.953136 fallocate 0x037b10 thru 0x03ffff (0x84f0 bytes) 000329 1786480732.963365 MIRROR_RESYNC 4 mirrors 000331 1786480733.979321 trunc from 0x02faed to 0x00384c (0x2c2a0 bytes) 000332 1786480734.020400 trunc from 0x00384d to 0x005029 (0x17dd bytes) 000333 1786480734.051359 read 0x0015f1 thru 0x005029 (0x3a39 bytes) 000334 1786480734.061582 mapread 0x0016e9 thru 0x005029 (0x3941 bytes) 000335 1786480734.064631 read 0x0013f7 thru 0x005029 (0x3c33 bytes) 000336 1786480734.065982 trunc from 0x00502a to 0x02b997 (0x2696e bytes) 000337 1786480734.086584 trunc from 0x02b998 to 0x019e7a (0x11b1d bytes) 000338 1786480734.131457 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19e7b): Mirror 3: 0xb5177db3 (stale) Mirror 4: 0xb5177db3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19e7b): Mirror 3: 0xb5177db3 (stale) Mirror 4: 0xb5177db3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19e7b: skipped 000339 1786480734.492323 trunc from 0x01108d to 0x012e40 (0x1db4 bytes) 000340 1786480734.500181 trunc from 0x007b93 to 0x00f521 (0x798f bytes) 000341 1786480734.511572 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19e7b): Mirror 3: 0xb5177db3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19e7b): Mirror 3: 0xb5177db3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19e7b: skipped 000342 1786480734.747994 read 0x0110d9 thru 0x0185a5 (0x74cd bytes) 000343 1786480734.758389 read 0x0041ec thru 0x00d075 (0x8e8a bytes) 000344 1786480734.767786 trunc from 0x019e7b to 0x00f779 (0xa701 bytes) 000345 1786480734.793358 trunc from 0x00f77a to 0x004182 (0xb5f7 bytes) 000346 1786480734.819270 punch from 0x00200f to 0x004182 (0x2174 bytes) 000347 1786480734.824187 mapwrite 0x00863c thru 0x016313 (0xdcd8 bytes) 000348 1786480734.935397 mapwrite 0x033b1c thru 0x039bc2 (0x60a7 bytes) 000349 1786480734.996266 MIRROR_RESYNC 2 mirrors 000350 1786480735.840227 MIRROR_EXTEND to 3 mirrors 000351 1786480736.602851 trunc from 0x039bc3 to 0x03771e (0x24a4 bytes) 000352 1786480736.664124 read 0x02793c thru 0x0366fe (0xedc3 bytes) 000353 1786480736.683005 fallocate 0x037c5b thru 0x039437 (0x17dd bytes) 000355 1786480736.692984 trunc from 0x03771f to 0x01c7aa (0x1af74 bytes) 000357 1786480736.740578 write 0x011cef thru 0x01f924 (0xdc36 bytes) 000358 1786480736.764694 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1f925): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f925): Mirror 3: 0xb5a85b73 (stale) Mirror 4: 0xb5a85b73 (stale) CRC-32 checksum value for chunk [0, 0x1f925): Mirror 1: 0x5cac599c Mirror 5: 0x5cac599c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f925: skipped 000359 1786480737.735359 punch from 0x0074c0 to 0x00eb76 (0x76b7 bytes) 000360 1786480737.771519 trunc from 0x01f925 to 0x004fac (0x1a978 bytes) 000361 1786480737.796779 mapwrite 0x02df2d thru 0x03a7bc (0xc890 bytes) 000362 1786480737.885344 fallocate 0x03526c thru 0x03ffff (0xad94 bytes) 000363 1786480737.898632 mapwrite 0x01668a thru 0x01892b (0x22a2 bytes) 000364 1786480737.943045 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3a7bd): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a7bd): Mirror 3: 0x3c53321c (stale) Mirror 4: 0x3c53321c (stale) Mirror 5: 0xab7cf416 (stale) CRC-32 checksum value for chunk [0, 0x3a7bd): Mirror 1: 0x94a2f3c3 Mirror 6: 0x94a2f3c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a7bd: skipped 000365 1786480738.988126 fallocate 0x03d6c8 thru 0x03ffff (0x2938 bytes) 000366 1786480739.056630 write 0x023ab3 thru 0x0304bc (0xca0a bytes) 000367 1786480739.102281 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3a7bd): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a7bd): Mirror 3: 0x3c53321c (stale) Mirror 4: 0x3c53321c (stale) Mirror 5: 0xab7cf416 (stale) Mirror 6: 0x94a2f3c3 (stale) CRC-32 checksum value for chunk [0, 0x3a7bd): Mirror 1: 0x5181c08c Mirror 7: 0x5181c08c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a7bd: skipped 000368 1786480740.060720 trunc from 0x02c13b to 0x02c6ca (0x590 bytes) 000369 1786480740.099380 read 0x02a9bd thru 0x030a67 (0x60ab bytes) 000370 1786480740.108243 fallocate 0x034f27 thru 0x035a78 (0xb52 bytes) 000371 1786480740.113638 punch from 0x01a623 to 0x022008 (0x79e6 bytes) 000372 1786480740.123795 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3a7bd): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a7bd): Mirror 3: 0x3c53321c (stale) Mirror 4: 0x3c53321c (stale) Mirror 5: 0xab7cf416 (stale) Mirror 6: 0x94a2f3c3 (stale) Mirror 7: 0x5181c08c (stale) CRC-32 checksum value for chunk [0, 0x3a7bd): Mirror 1: 0x6b0b5ddc Mirror 8: 0x6b0b5ddc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a7bd: skipped 000373 1786480741.033416 punch from 0x031244 to 0x03a7bc (0x9579 bytes) 000374 1786480741.074194 write 0x00e6f6 thru 0x01ba6b (0xd376 bytes) 000375 1786480741.089297 read 0x013002 thru 0x0201be (0xd1bd bytes) 000376 1786480741.097662 write 0x00bc30 thru 0x017609 (0xb9da bytes) 000378 1786480741.109492 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3a7bd): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a7bd): Mirror 3: 0x3c53321c (stale) Mirror 4: 0x3c53321c (stale) Mirror 5: 0xab7cf416 (stale) Mirror 6: 0x94a2f3c3 (stale) Mirror 7: 0x5181c08c (stale) Mirror 8: 0x6b0b5ddc (stale) CRC-32 checksum value for chunk [0, 0x3a7bd): Mirror 1: 0x564b2bb5 Mirror 9: 0x564b2bb5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a7bd: skipped 000379 1786480742.029901 write 0x00fad8 thru 0x01d0d6 (0xd5ff bytes) 000380 1786480742.072342 write 0x03345b thru 0x034197 (0xd3d bytes) 000381 1786480742.080025 read 0x0374e5 thru 0x03a0e4 (0x2c00 bytes) 000382 1786480742.085593 fallocate 0x0028d3 thru 0x00cdeb (0xa519 bytes) 000383 1786480742.090299 trunc from 0x03a7bd to 0x03220f (0x85ad bytes) 000384 1786480742.127194 trunc from 0x00e3a0 to 0x018e99 (0xaafa bytes) 000385 1786480742.139745 punch from 0x00f82d to 0x0140d9 (0x48ad bytes) 000386 1786480742.144318 trunc from 0x032210 to 0x0048f7 (0x2d918 bytes) 000387 1786480742.166005 trunc from 0x003019 to 0x0048f7 (0x18df bytes) 000388 1786480742.171163 mapread 0x00066f thru 0x0048f7 (0x4289 bytes) 000390 1786480742.192990 read 0x003729 thru 0x0048f7 (0x11cf bytes) 000391 1786480742.194006 fallocate 0x017164 thru 0x01df9c (0x6e39 bytes) 000392 1786480742.203812 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x48f8): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x48f8): Mirror 3: 0x96bbe00b (stale) Mirror 4: 0x96bbe00b (stale) Mirror 5: 0x96bbe00b (stale) Mirror 6: 0x96bbe00b (stale) Mirror 7: 0x96bbe00b (stale) Mirror 8: 0x96bbe00b (stale) Mirror 9: 0x96bbe00b (stale) CRC-32 checksum value for chunk [0, 0x48f8): Mirror 1: 0x96bbe00b Mirror 10: 0x96bbe00b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x48f8: skipped 000393 1786480743.067580 write 0x0256dd thru 0x03282f (0xd153 bytes) 000394 1786480743.101287 trunc from 0x02673a to 0x02803a (0x1901 bytes) 000395 1786480743.128785 trunc from 0x032830 to 0x034aae (0x227f bytes) 000396 1786480743.176152 write 0x01a970 thru 0x02a6a9 (0xfd3a bytes) 000397 1786480743.184927 mapwrite 0x01fa72 thru 0x028b70 (0x90ff bytes) 000398 1786480743.211109 write 0x02b286 thru 0x039fb6 (0xed31 bytes) 000399 1786480743.220623 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39fb7): Mirror 3: 0x4b1e6750 (stale) Mirror 4: 0x4b1e6750 (stale) Mirror 5: 0x2377b8f4 (stale) Mirror 6: 0xaad61903 (stale) Mirror 8: 0x1f1fc23f (stale) Mirror 9: 0x10249ddf (stale) Mirror 10: 0xf6c41f23 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39fb7): Mirror 3: 0x4b1e6750 (stale) Mirror 4: 0x4b1e6750 (stale) Mirror 5: 0x2377b8f4 (stale) Mirror 6: 0xaad61903 (stale) Mirror 8: 0x1f1fc23f (stale) Mirror 9: 0x10249ddf (stale) Mirror 10: 0xf6c41f23 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39fb7: skipped 000400 1786480743.822416 read 0x00a133 thru 0x01280d (0x86db bytes) 000401 1786480743.844807 MIRROR_RESYNC 8 mirrors 000402 1786480745.317903 mapwrite 0x0330f3 thru 0x03e7ca (0xb6d8 bytes) 000403 1786480745.443519 write 0x01bfe9 thru 0x01fc74 (0x3c8c bytes) 000404 1786480745.455314 mapread 0x01ca27 thru 0x029cff (0xd2d9 bytes) 000405 1786480745.471171 read 0x00b58a thru 0x013b6b (0x85e2 bytes) 000407 1786480745.480662 fallocate 0x0364de thru 0x03b349 (0x4e6c bytes) 000408 1786480745.486360 read 0x024728 thru 0x02486a (0x143 bytes) 000409 1786480745.487608 mapwrite 0x03afb0 thru 0x03ffff (0x5050 bytes) 000410 1786480745.527310 mapwrite 0x02caf0 thru 0x034f10 (0x8421 bytes) 000411 1786480745.549005 mapread 0x032004 thru 0x03ffff (0xdffc bytes) 000412 1786480745.551106 write 0x0340e4 thru 0x037942 (0x385f bytes) 000413 1786480745.555887 trunc from 0x040000 to 0x030b5a (0xf4a5 bytes) 000414 1786480745.573880 trunc from 0x030b5b to 0x004c65 (0x2bef5 bytes) 000415 1786480745.588142 write 0x00ed12 thru 0x019610 (0xa8ff bytes) 000416 1786480745.590035 trunc from 0x019611 to 0x02666e (0xd05e bytes) 000417 1786480745.617834 read 0x009a93 thru 0x016a66 (0xcfd4 bytes) 000418 1786480745.627829 write 0x0374ca thru 0x03ffff (0x8b36 bytes) 000419 1786480745.633022 punch from 0x009844 to 0x00c8bd (0x307a bytes) 000420 1786480745.641631 read 0x008380 thru 0x008c3a (0x8bb bytes) 000421 1786480745.649043 fallocate 0x015ef2 thru 0x01f03d (0x914c bytes) 000422 1786480745.660653 trunc from 0x040000 to 0x02ae2e (0x151d1 bytes) 000423 1786480745.693785 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2ae2f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ae2f): Mirror 3: 0xcead9d3c (stale) Mirror 4: 0xcead9d3c (stale) Mirror 5: 0xcead9d3c (stale) Mirror 6: 0xcead9d3c (stale) Mirror 8: 0xcead9d3c (stale) Mirror 9: 0xcead9d3c (stale) Mirror 10: 0xcead9d3c (stale) CRC-32 checksum value for chunk [0, 0x2ae2f): Mirror 1: 0xab52dcc5 Mirror 11: 0xab52dcc5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ae2f: skipped 000424 1786480746.691876 read 0x02645f thru 0x02ae2e (0x49d0 bytes) 000425 1786480746.713106 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ae2f): Mirror 4: 0xcead9d3c (stale) Mirror 5: 0xcead9d3c (stale) Mirror 6: 0xcead9d3c (stale) Mirror 8: 0xcead9d3c (stale) Mirror 9: 0xcead9d3c (stale) Mirror 10: 0xcead9d3c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ae2f): Mirror 4: 0xcead9d3c (stale) Mirror 5: 0xcead9d3c (stale) Mirror 6: 0xcead9d3c (stale) Mirror 8: 0xcead9d3c (stale) Mirror 9: 0xcead9d3c (stale) Mirror 10: 0xcead9d3c (stale) CRC-32 checksum value for chunk [0, 0x2ae2f): Mirror 1: 0xab52dcc5 Mirror 11: 0xab52dcc5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ae2f: skipped 000426 1786480747.453001 punch from 0x027e3b to 0x02ae2e (0x2ff4 bytes) 000427 1786480747.496862 mapread 0x01473e thru 0x023fab (0xf86e bytes) 000428 1786480747.574955 trunc from 0x02ae2f to 0x0311c0 (0x6392 bytes) 000429 1786480747.598705 mapwrite 0x03f8fd thru 0x03ffff (0x703 bytes) 000430 1786480747.660206 mapwrite 0x0183b0 thru 0x022349 (0x9f9a bytes) 000431 1786480747.694763 mapread 0x027eaf thru 0x0343c2 (0xc514 bytes) 000432 1786480747.715553 read 0x0125a6 thru 0x021e0f (0xf86a bytes) 000433 1786480747.716651 mapread 0x017c5a thru 0x01f189 (0x7530 bytes) 000434 1786480747.719946 trunc from 0x040000 to 0x03f3f3 (0xc0c bytes) 000435 1786480747.745550 mapread 0x0383e4 thru 0x0393ff (0x101c bytes) 000436 1786480747.749226 trunc from 0x004a2e to 0x00e9a7 (0x9f7a bytes) 000437 1786480747.755245 write 0x0389fb thru 0x03914d (0x753 bytes) 000438 1786480747.756462 trunc from 0x0070a7 to 0x015d50 (0xecaa bytes) 000439 1786480747.764450 trunc from 0x03f3f4 to 0x03da7b (0x1978 bytes) 000440 1786480747.782236 trunc from 0x03da7c to 0x02aa2a (0x13051 bytes) 000441 1786480747.800900 trunc from 0x00c6a4 to 0x0161ad (0x9b0a bytes) 000442 1786480747.805673 write 0x02d1a1 thru 0x02fbde (0x2a3e bytes) 000443 1786480747.807684 mapread 0x028754 thru 0x02e109 (0x59b6 bytes) 000444 1786480747.812757 mapwrite 0x03f94c thru 0x03ffff (0x6b4 bytes) 000445 1786480747.837349 trunc from 0x040000 to 0x02422a (0x1bdd5 bytes) 000446 1786480747.859261 trunc from 0x02422b to 0x01d549 (0x6ce1 bytes) 000447 1786480747.881213 MIRROR_RESYNC 8 mirrors 000448 1786480749.164400 mapread 0x00bfd4 thru 0x019920 (0xd94d bytes) 000449 1786480749.194564 fallocate 0x025e0e thru 0x028b00 (0x2cf3 bytes) 000450 1786480749.227048 trunc from 0x028b01 to 0x03d74b (0x14c4b bytes) 000451 1786480749.249231 punch from 0x003286 to 0x00d084 (0x9dff bytes) 000452 1786480749.255457 fallocate 0x00df41 thru 0x014d3f (0x6dff bytes) 000453 1786480749.261459 mapread 0x033fe1 thru 0x03bc06 (0x7c26 bytes) 000454 1786480749.271463 punch from 0x02a126 to 0x036466 (0xc341 bytes) 000455 1786480749.276931 punch from 0x000eae to 0x00e25b (0xd3ae bytes) 000456 1786480749.283321 trunc from 0x03d74c to 0x01cdae (0x2099d bytes) 000457 1786480749.300333 mapwrite 0x01bc74 thru 0x022da3 (0x7130 bytes) 000458 1786480749.366972 fallocate 0x023f75 thru 0x032e39 (0xeec5 bytes) 000459 1786480749.375231 trunc from 0x022da4 to 0x01ec07 (0x419c bytes) 000460 1786480749.399367 read 0x00f0bd thru 0x01cfab (0xdeef bytes) 000461 1786480749.411126 trunc from 0x01ec08 to 0x031468 (0x12861 bytes) 000462 1786480749.433917 mapwrite 0x0233b9 thru 0x02d8cb (0xa513 bytes) 000463 1786480749.479514 write 0x003d8d thru 0x006ba2 (0x2e16 bytes) 000464 1786480749.500170 MIRROR_RESYNC 8 mirrors 000465 1786480752.124272 MIRROR_EXTEND to 9 mirrors 000466 1786480753.021730 MIRROR_EXTEND to 10 mirrors 000467 1786480754.075012 trunc from 0x031469 to 0x02a3b9 (0x70af bytes) 000468 1786480754.155797 trunc from 0x0120ab to 0x02081e (0xe774 bytes) 000469 1786480754.163135 mapwrite 0x02e7b7 thru 0x03a443 (0xbc8d bytes) 000471 1786480754.238930 punch from 0x033f47 to 0x037bb6 (0x3c70 bytes) 000472 1786480754.250132 fallocate 0x012e3e thru 0x01be7b (0x903e bytes) 000473 1786480754.258545 mapread 0x00b639 thru 0x010d5d (0x5725 bytes) 000474 1786480754.271833 mapwrite 0x022d28 thru 0x02c23b (0x9514 bytes) 000475 1786480754.309055 trunc from 0x03a444 to 0x00cb2e (0x2d915 bytes) 000476 1786480754.333039 mapwrite 0x014617 thru 0x015e04 (0x17ee bytes) 000477 1786480754.377851 fallocate 0x00d0e6 thru 0x0116a6 (0x45c1 bytes) 000478 1786480754.384406 read 0x011fd9 thru 0x015e04 (0x3e2c bytes) 000479 1786480754.385626 trunc from 0x011661 to 0x015e04 (0x47a4 bytes) 000480 1786480754.393143 write 0x01f8d0 thru 0x02e7b0 (0xeee1 bytes) 000481 1786480754.397002 mapwrite 0x03e48a thru 0x03ffff (0x1b76 bytes) 000484 1786480754.484724 read 0x01302b thru 0x014508 (0x14de bytes) 000485 1786480754.508366 write 0x02960e thru 0x02a214 (0xc07 bytes) 000486 1786480754.509469 mapwrite 0x027dd0 thru 0x028add (0xd0e bytes) 000488 1786480754.531857 trunc from 0x015a16 to 0x016da8 (0x1393 bytes) 000489 1786480754.549236 mapwrite 0x01a3ab thru 0x027168 (0xcdbe bytes) 000490 1786480754.596584 trunc from 0x0042ef to 0x004fd8 (0xcea bytes) 000492 1786480754.603589 fallocate 0x01a17f thru 0x0299eb (0xf86d bytes) 000493 1786480754.617649 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6d024b7f (stale) Mirror 5: 0x6d024b7f (stale) Mirror 6: 0x6d024b7f (stale) Mirror 8: 0x6d024b7f (stale) Mirror 9: 0x6d024b7f (stale) Mirror 10: 0x6d024b7f (stale) Mirror 11: 0x6d024b7f (stale) Mirror 12: 0x6d024b7f (stale) Mirror 13: 0x6d024b7f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2e6d986 Mirror 14: 0x2e6d986 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000494 1786480756.295095 trunc from 0x029f95 to 0x03961e (0xf68a bytes) 000495 1786480756.354046 mapread 0x01e735 thru 0x021adf (0x33ab bytes) 000496 1786480756.394526 mapread 0x030757 thru 0x032caa (0x2554 bytes) 000497 1786480756.410771 mapwrite 0x01b8ee thru 0x0232d7 (0x79ea bytes) 000498 1786480756.450947 mapwrite 0x015d0a thru 0x02005e (0xa355 bytes) 000499 1786480756.500615 mapwrite 0x037c7c thru 0x03d742 (0x5ac7 bytes) 000500 1786480756.548341 trunc from 0x040000 to 0x006c47 (0x393b8 bytes) 000501 1786480756.577907 read 0x000488 thru 0x006c47 (0x67c0 bytes) 000502 1786480756.592974 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6c48): Mirror 4: 0xbbef5886 (stale) Mirror 5: 0xbbef5886 (stale) Mirror 6: 0xbbef5886 (stale) Mirror 8: 0xbbef5886 (stale) Mirror 9: 0xbbef5886 (stale) Mirror 10: 0xbbef5886 (stale) Mirror 12: 0xbbef5886 (stale) Mirror 13: 0xbbef5886 (stale) Mirror 14: 0x73d6405d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6c48): Mirror 4: 0xbbef5886 (stale) Mirror 5: 0xbbef5886 (stale) Mirror 6: 0xbbef5886 (stale) Mirror 8: 0xbbef5886 (stale) Mirror 9: 0xbbef5886 (stale) Mirror 10: 0xbbef5886 (stale) Mirror 12: 0xbbef5886 (stale) Mirror 13: 0xbbef5886 (stale) Mirror 14: 0x73d6405d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6c48: skipped 000503 1786480757.161933 fallocate 0x009ec6 thru 0x00a7f3 (0x92e bytes) 000504 1786480757.185855 trunc from 0x008bf4 to 0x00a7f3 (0x1c00 bytes) 000505 1786480757.198825 mapwrite 0x0318fe thru 0x03c777 (0xae7a bytes) 000506 1786480757.277489 punch from 0x016f37 to 0x01f668 (0x8732 bytes) 000507 1786480757.283785 trunc from 0x03c778 to 0x02adc1 (0x119b6 bytes) 000508 1786480757.299807 punch from 0x020957 to 0x0253ed (0x4a97 bytes) 000509 1786480757.304952 write 0x009035 thru 0x01693d (0xd909 bytes) 000510 1786480757.329439 read 0x01af96 thru 0x02888c (0xd8f7 bytes) 000511 1786480757.339484 punch from 0x01fc14 to 0x027c73 (0x8060 bytes) 000512 1786480757.352106 MIRROR_RESYNC 10 mirrors 000513 1786480760.363299 read 0x021295 thru 0x0243e4 (0x3150 bytes) 000514 1786480760.368424 fallocate 0x01ce5f thru 0x02a800 (0xd9a2 bytes) 000515 1786480760.403947 trunc from 0x02adc2 to 0x01dade (0xd2e3 bytes) 000516 1786480760.432811 trunc from 0x01dadf to 0x022733 (0x4c55 bytes) 000517 1786480760.483649 punch from 0x018a89 to 0x020386 (0x78fe bytes) 000518 1786480760.497860 mapread 0x01fdc7 thru 0x021284 (0x14be bytes) 000519 1786480760.548096 punch from 0x00f1c8 to 0x01df5d (0xed96 bytes) 000520 1786480760.569973 MIRROR_RESYNC 10 mirrors 000521 1786480762.839771 punch from 0x020c74 to 0x021fb1 (0x133e bytes) 000522 1786480762.877184 MIRROR_RESYNC 10 mirrors 000523 1786480765.324732 write 0x012ba9 thru 0x013a47 (0xe9f bytes) 000524 1786480765.388720 read 0x01700c thru 0x01a4a2 (0x3497 bytes) 000525 1786480765.403279 trunc from 0x00839a to 0x008a52 (0x6b9 bytes) 000526 1786480765.413773 trunc from 0x022734 to 0x010c4b (0x11ae8 bytes) 000527 1786480765.476463 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x10c4c): Mirror 4: 0x19456f0 (stale) Mirror 6: 0x19456f0 (stale) Mirror 8: 0x19456f0 (stale) Mirror 9: 0x19456f0 (stale) Mirror 10: 0x19456f0 (stale) Mirror 12: 0x19456f0 (stale) Mirror 13: 0x19456f0 (stale) Mirror 14: 0x19456f0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10c4c): Mirror 4: 0x19456f0 (stale) Mirror 6: 0x19456f0 (stale) Mirror 8: 0x19456f0 (stale) Mirror 9: 0x19456f0 (stale) Mirror 10: 0x19456f0 (stale) Mirror 12: 0x19456f0 (stale) Mirror 13: 0x19456f0 (stale) Mirror 14: 0x19456f0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10c4c: skipped 000528 1786480765.984760 trunc from 0x010c4c to 0x03a220 (0x295d5 bytes) 000529 1786480766.007104 trunc from 0x01e8bf to 0x025349 (0x6a8b bytes) 000530 1786480766.012620 read 0x01b5a4 thru 0x01d167 (0x1bc4 bytes) 000531 1786480766.017933 write 0x03cd5a thru 0x03f7e5 (0x2a8c bytes) 000532 1786480766.019177 mapread 0x036461 thru 0x03eec4 (0x8a64 bytes) 000535 1786480766.045161 read 0x021120 thru 0x02d240 (0xc121 bytes) 000536 1786480766.060236 mapread 0x035e9a thru 0x03f7e5 (0x994c bytes) 000538 1786480766.064464 mapread 0x02975f thru 0x032c62 (0x9504 bytes) 000540 1786480766.077243 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3f7e6): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f7e6): Mirror 4: 0x5e7a3e0c (stale) Mirror 6: 0x5e7a3e0c (stale) Mirror 8: 0x5e7a3e0c (stale) Mirror 9: 0x5e7a3e0c (stale) Mirror 10: 0x5e7a3e0c (stale) Mirror 12: 0x5e7a3e0c (stale) Mirror 13: 0x5e7a3e0c (stale) Mirror 14: 0x5e7a3e0c (stale) CRC-32 checksum value for chunk [0, 0x3f7e6): Mirror 1: 0x9449b654 Mirror 15: 0x9449b654 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f7e6: skipped 000542 1786480767.119604 fallocate 0x011d03 thru 0x017f27 (0x6225 bytes) 000543 1786480767.189221 punch from 0x02136d to 0x0249b9 (0x364d bytes) 000544 1786480767.199771 MIRROR_RESYNC 10 mirrors 000545 1786480769.754763 MIRROR_RESYNC 10 mirrors 000547 1786480770.376669 read 0x01298e thru 0x01b53e (0x8bb1 bytes) 000549 1786480770.390054 mapread 0x0221c6 thru 0x02f663 (0xd49e bytes) 000550 1786480770.436015 read 0x022da8 thru 0x02613a (0x3393 bytes) 000551 1786480770.436551 mapread 0x029cd1 thru 0x032117 (0x8447 bytes) 000552 1786480770.437464 trunc from 0x0305bc to 0x03f7e5 (0xf22a bytes) 000553 1786480770.491228 mapwrite 0x01bbbf thru 0x01fa0e (0x3e50 bytes) 000554 1786480770.545279 MIRROR_RESYNC 10 mirrors 000555 1786480773.259966 MIRROR_EXTEND to 11 mirrors 000556 1786480774.145436 punch from 0x033677 to 0x03f7e5 (0xc16f bytes) 000557 1786480774.238615 MIRROR_RESYNC 11 mirrors 000558 1786480777.373366 MIRROR_EXTEND to 12 mirrors 000559 1786480778.328176 trunc from 0x00421f to 0x00f1aa (0xaf8c bytes) 000560 1786480778.368539 fallocate 0x03d9e1 thru 0x03ffff (0x261f bytes) 000561 1786480778.377851 MIRROR_RESYNC 12 mirrors 000563 1786480781.401370 read 0x00aea3 thru 0x01511e (0xa27c bytes) 000564 1786480781.424833 trunc from 0x03f7e6 to 0x002fb8 (0x3c82d bytes) 000565 1786480781.492189 mapwrite 0x02a83f thru 0x02e7ac (0x3f6e bytes) 000566 1786480781.572431 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2e7ad): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e7ad): Mirror 4: 0xf328c022 (stale) Mirror 6: 0xf328c022 (stale) Mirror 8: 0xf328c022 (stale) Mirror 9: 0xf328c022 (stale) Mirror 10: 0xf328c022 (stale) Mirror 12: 0xf328c022 (stale) Mirror 13: 0xf328c022 (stale) Mirror 14: 0xf328c022 (stale) Mirror 15: 0xf328c022 (stale) Mirror 16: 0xf328c022 (stale) Mirror 17: 0xf328c022 (stale) CRC-32 checksum value for chunk [0, 0x2e7ad): Mirror 1: 0xdd826d1c Mirror 18: 0xdd826d1c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e7ad: skipped 000567 1786480782.833590 fallocate 0x035af0 thru 0x03ffff (0xa510 bytes) 000568 1786480782.892860 read 0x0166b0 thru 0x019fbb (0x390c bytes) 000569 1786480782.906333 write 0x005f3a thru 0x0098b6 (0x397d bytes) 000570 1786480782.933801 mapwrite 0x01aec0 thru 0x02ab02 (0xfc43 bytes) 000571 1786480783.000952 read 0x0251c9 thru 0x031071 (0xbea9 bytes) 000572 1786480783.040445 MIRROR_RESYNC 13 mirrors 000573 1786480785.886943 write 0x01cb19 thru 0x01fba0 (0x3088 bytes) 000574 1786480785.937458 mapread 0x025e7f thru 0x02c80f (0x6991 bytes) 000575 1786480785.966007 write 0x012396 thru 0x014e58 (0x2ac3 bytes) 000576 1786480785.982447 MIRROR_SPLIT mirror 5 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd2046141 (stale) Mirror 6: 0xd2046141 (stale) Mirror 8: 0xd2046141 (stale) Mirror 9: 0xd2046141 (stale) Mirror 12: 0xd2046141 (stale) Mirror 13: 0xd2046141 (stale) Mirror 14: 0xd2046141 (stale) Mirror 15: 0xd2046141 (stale) Mirror 16: 0xd2046141 (stale) Mirror 17: 0xd2046141 (stale) Mirror 18: 0xd2046141 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd2046141 (stale) Mirror 6: 0xd2046141 (stale) Mirror 8: 0xd2046141 (stale) Mirror 9: 0xd2046141 (stale) Mirror 12: 0xd2046141 (stale) Mirror 13: 0xd2046141 (stale) Mirror 14: 0xd2046141 (stale) Mirror 15: 0xd2046141 (stale) Mirror 16: 0xd2046141 (stale) Mirror 17: 0xd2046141 (stale) Mirror 18: 0xd2046141 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000577 1786480786.684954 punch from 0x024d84 to 0x0318d9 (0xcb56 bytes) 000578 1786480786.693816 trunc from 0x02e402 to 0x03690e (0x850d bytes) 000579 1786480786.699561 fallocate 0x01b96c thru 0x01e0c8 (0x275d bytes) 000580 1786480786.705389 punch from 0x014251 to 0x0173fe (0x31ae bytes) 000581 1786480786.711053 write 0x036149 thru 0x037452 (0x130a bytes) 000582 1786480786.727681 trunc from 0x015300 to 0x01f90c (0xa60d bytes) 000583 1786480786.732834 write 0x009160 thru 0x00b5f3 (0x2494 bytes) 000584 1786480786.745478 mapread 0x0017ea thru 0x0112ff (0xfb16 bytes) 000585 1786480786.776771 trunc from 0x040000 to 0x02bfa7 (0x14058 bytes) 000586 1786480786.796341 trunc from 0x013fcd to 0x01d96d (0x99a1 bytes) 000587 1786480786.805380 trunc from 0x014018 to 0x01bf3f (0x7f28 bytes) 000589 1786480786.812260 mapread 0x003707 thru 0x0068d9 (0x31d3 bytes) 000590 1786480786.814176 mapwrite 0x03dc4a thru 0x03ffbe (0x2375 bytes) 000591 1786480786.862385 mapread 0x003abf thru 0x0099db (0x5f1d bytes) 000592 1786480786.864939 mapread 0x02c20c thru 0x033784 (0x7579 bytes) 000593 1786480786.876624 mapwrite 0x024346 thru 0x026312 (0x1fcd bytes) 000594 1786480786.904434 write 0x00f350 thru 0x0113bd (0x206e bytes) 000595 1786480786.906847 trunc from 0x03ffbf to 0x01432f (0x2bc8f bytes) 000596 1786480786.926650 trunc from 0x014330 to 0x019f63 (0x5c34 bytes) 000597 1786480786.949239 punch from 0x0030c0 to 0x007d39 (0x4c7a bytes) 000598 1786480786.955369 trunc from 0x019f64 to 0x00be24 (0xe13f bytes) 000599 1786480786.973548 trunc from 0x00be25 to 0x020695 (0x14871 bytes) 000600 1786480786.992444 trunc from 0x011298 to 0x012a9d (0x1806 bytes) 000601 1786480787.001716 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x20696): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20696): Mirror 4: 0xd04592e1 (stale) Mirror 6: 0xd04592e1 (stale) Mirror 8: 0xd04592e1 (stale) Mirror 9: 0xd04592e1 (stale) Mirror 12: 0xd04592e1 (stale) Mirror 13: 0xd04592e1 (stale) Mirror 14: 0xd04592e1 (stale) Mirror 15: 0xd04592e1 (stale) Mirror 16: 0xd04592e1 (stale) Mirror 17: 0xd04592e1 (stale) Mirror 18: 0xd04592e1 (stale) CRC-32 checksum value for chunk [0, 0x20696): Mirror 1: 0x8da146cc Mirror 19: 0x8da146cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20696: skipped 000602 1786480788.155321 mapread 0x01eec4 thru 0x01f305 (0x442 bytes) 000603 1786480788.183891 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x20696): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20696): Mirror 4: 0xd04592e1 (stale) Mirror 6: 0xd04592e1 (stale) Mirror 8: 0xd04592e1 (stale) Mirror 9: 0xd04592e1 (stale) Mirror 12: 0xd04592e1 (stale) Mirror 13: 0xd04592e1 (stale) Mirror 14: 0xd04592e1 (stale) Mirror 15: 0xd04592e1 (stale) Mirror 16: 0xd04592e1 (stale) Mirror 17: 0xd04592e1 (stale) Mirror 18: 0xd04592e1 (stale) CRC-32 checksum value for chunk [0, 0x20696): Mirror 1: 0x8da146cc Mirror 19: 0x8da146cc Mirror 20: 0x8da146cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20696: skipped 000604 1786480789.168666 read 0x00873e thru 0x00d6cf (0x4f92 bytes) 000605 1786480789.183973 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x20696): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20696): Mirror 4: 0xd04592e1 (stale) Mirror 6: 0xd04592e1 (stale) Mirror 8: 0xd04592e1 (stale) Mirror 9: 0xd04592e1 (stale) Mirror 12: 0xd04592e1 (stale) Mirror 13: 0xd04592e1 (stale) Mirror 14: 0xd04592e1 (stale) Mirror 15: 0xd04592e1 (stale) Mirror 16: 0xd04592e1 (stale) Mirror 17: 0xd04592e1 (stale) Mirror 18: 0xd04592e1 (stale) CRC-32 checksum value for chunk [0, 0x20696): Mirror 1: 0x8da146cc Mirror 19: 0x8da146cc Mirror 20: 0x8da146cc Mirror 21: 0x8da146cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20696: skipped 000606 1786480790.333970 fallocate 0x0124c9 thru 0x01e4c3 (0xbffb bytes) 000607 1786480790.388000 mapwrite 0x02c5bd thru 0x03bb3e (0xf582 bytes) 000608 1786480790.464121 trunc from 0x03bb3f to 0x009976 (0x321c8 bytes) 000609 1786480790.482824 fallocate 0x03e878 thru 0x03ffff (0x1788 bytes) 000610 1786480790.491551 MIRROR_RESYNC 15 mirrors 000611 1786480792.530871 write 0x000b45 thru 0x0023b7 (0x1873 bytes) 000612 1786480792.586828 write 0x005674 thru 0x00fecb (0xa858 bytes) 000613 1786480792.593926 read 0x00b669 thru 0x00fa6a (0x4402 bytes) 000614 1786480792.595296 read 0x004544 thru 0x00eaa3 (0xa560 bytes) 000615 1786480792.600265 mapwrite 0x0093b3 thru 0x014ef1 (0xbb3f bytes) 000616 1786480792.636761 trunc from 0x006093 to 0x013da6 (0xdd14 bytes) 000617 1786480792.653134 MIRROR_SPLIT mirror 4 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14ef2): Mirror 4: 0x39b2652f (stale) Mirror 6: 0x39b2652f (stale) Mirror 8: 0x39b2652f (stale) Mirror 12: 0x39b2652f (stale) Mirror 13: 0x39b2652f (stale) Mirror 14: 0x39b2652f (stale) Mirror 15: 0x39b2652f (stale) Mirror 16: 0x39b2652f (stale) Mirror 17: 0x39b2652f (stale) Mirror 18: 0x39b2652f (stale) Mirror 19: 0x39b2652f (stale) Mirror 20: 0x39b2652f (stale) Mirror 21: 0x39b2652f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14ef2): Mirror 4: 0x39b2652f (stale) Mirror 6: 0x39b2652f (stale) Mirror 8: 0x39b2652f (stale) Mirror 12: 0x39b2652f (stale) Mirror 13: 0x39b2652f (stale) Mirror 14: 0x39b2652f (stale) Mirror 15: 0x39b2652f (stale) Mirror 16: 0x39b2652f (stale) Mirror 17: 0x39b2652f (stale) Mirror 18: 0x39b2652f (stale) Mirror 19: 0x39b2652f (stale) Mirror 20: 0x39b2652f (stale) Mirror 21: 0x39b2652f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14ef2: skipped 000618 1786480793.260465 mapread 0x010193 thru 0x013200 (0x306e bytes) 000619 1786480793.298300 MIRROR_RESYNC 14 mirrors 000620 1786480795.690950 MIRROR_SPLIT mirror 5 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) 000621 1786480796.187010 mapwrite 0x008447 thru 0x0121ab (0x9d65 bytes) 000622 1786480796.294400 write 0x01ea3e thru 0x02271e (0x3ce1 bytes) 000625 1786480796.303150 mapwrite 0x01448e thru 0x016263 (0x1dd6 bytes) 000626 1786480796.325709 punch from 0x01b09b to 0x02271e (0x7684 bytes) 000627 1786480796.331429 trunc from 0x02271f to 0x008324 (0x1a3fa bytes) 000628 1786480796.350560 punch from 0x003ece to 0x008324 (0x4457 bytes) 000629 1786480796.356745 trunc from 0x005ea2 to 0x008324 (0x2483 bytes) 000630 1786480796.363172 trunc from 0x0055db to 0x008324 (0x2d4a bytes) 000631 1786480796.368335 mapwrite 0x03aa7a thru 0x03ffff (0x5586 bytes) 000632 1786480796.409642 mapread 0x03f710 thru 0x03ffff (0x8f0 bytes) 000633 1786480796.410728 mapread 0x0178a5 thru 0x01c3b6 (0x4b12 bytes) 000634 1786480796.427881 MIRROR_SPLIT mirror 12 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x8a5e79bb (stale) Mirror 6: 0x8a5e79bb (stale) Mirror 8: 0x8a5e79bb (stale) Mirror 12: 0x8a5e79bb (stale) Mirror 14: 0x8a5e79bb (stale) Mirror 15: 0x8a5e79bb (stale) Mirror 16: 0x8a5e79bb (stale) Mirror 17: 0x8a5e79bb (stale) Mirror 18: 0x8a5e79bb (stale) Mirror 19: 0x8a5e79bb (stale) Mirror 20: 0x8a5e79bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x8a5e79bb (stale) Mirror 6: 0x8a5e79bb (stale) Mirror 8: 0x8a5e79bb (stale) Mirror 12: 0x8a5e79bb (stale) Mirror 14: 0x8a5e79bb (stale) Mirror 15: 0x8a5e79bb (stale) Mirror 16: 0x8a5e79bb (stale) Mirror 17: 0x8a5e79bb (stale) Mirror 18: 0x8a5e79bb (stale) Mirror 19: 0x8a5e79bb (stale) Mirror 20: 0x8a5e79bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000635 1786480796.974288 write 0x0336cd thru 0x036003 (0x2937 bytes) 000636 1786480797.000285 read 0x01002a thru 0x015b26 (0x5afd bytes) 000637 1786480797.016003 trunc from 0x040000 to 0x02aa31 (0x155ce bytes) 000638 1786480797.047451 mapread 0x018a85 thru 0x01c300 (0x387c bytes) 000640 1786480797.089286 mapwrite 0x010e70 thru 0x0188a4 (0x7a35 bytes) 000641 1786480797.115570 MIRROR_RESYNC 12 mirrors 000642 1786480800.194409 trunc from 0x022e1a to 0x028658 (0x583f bytes) 000643 1786480800.265868 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2aa32): Mirror 4: 0x7fc3f228 (stale) Mirror 6: 0x7fc3f228 (stale) Mirror 8: 0x7fc3f228 (stale) Mirror 12: 0x7fc3f228 (stale) Mirror 14: 0x7fc3f228 (stale) Mirror 15: 0x7fc3f228 (stale) Mirror 16: 0x7fc3f228 (stale) Mirror 17: 0x7fc3f228 (stale) Mirror 18: 0x7fc3f228 (stale) Mirror 19: 0x7fc3f228 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aa32): Mirror 4: 0x7fc3f228 (stale) Mirror 6: 0x7fc3f228 (stale) Mirror 8: 0x7fc3f228 (stale) Mirror 12: 0x7fc3f228 (stale) Mirror 14: 0x7fc3f228 (stale) Mirror 15: 0x7fc3f228 (stale) Mirror 16: 0x7fc3f228 (stale) Mirror 17: 0x7fc3f228 (stale) Mirror 18: 0x7fc3f228 (stale) Mirror 19: 0x7fc3f228 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aa32: skipped 000644 1786480801.018780 mapread 0x01213c thru 0x01c5b8 (0xa47d bytes) 000645 1786480801.045731 fallocate 0x0140ca thru 0x01d468 (0x939f bytes) 000647 1786480801.053600 mapwrite 0x003443 thru 0x0127a1 (0xf35f bytes) 000648 1786480801.088836 mapwrite 0x016d5c thru 0x020b94 (0x9e39 bytes) 000649 1786480801.137871 trunc from 0x028fb6 to 0x02aa31 (0x1a7c bytes) 000650 1786480801.144203 trunc from 0x02aa32 to 0x025282 (0x57af bytes) 000651 1786480801.170758 read 0x0218f7 thru 0x025282 (0x398c bytes) 000652 1786480801.171968 write 0x030837 thru 0x0358f2 (0x50bc bytes) 000653 1786480801.175956 trunc from 0x0358f3 to 0x017355 (0x1e59d bytes) 000654 1786480801.200289 trunc from 0x017356 to 0x005c4b (0x1170a bytes) 000655 1786480801.222569 punch from 0x004e7a to 0x0052b7 (0x43e bytes) 000656 1786480801.227133 mapread 0x0050be thru 0x005c4b (0xb8e bytes) 000657 1786480801.232948 punch from 0x0030f0 to 0x005c4b (0x2b5c bytes) 000658 1786480801.237975 trunc from 0x00471a to 0x005c4b (0x1532 bytes) 000659 1786480801.243708 mapread 0x002df3 thru 0x005c4b (0x2e59 bytes) 000660 1786480801.250838 read 0x001ece thru 0x005c4b (0x3d7e bytes) 000661 1786480801.251823 fallocate 0x033ef4 thru 0x036312 (0x241f bytes) 000662 1786480801.257611 punch from 0x004bb5 to 0x005c4b (0x1097 bytes) 000663 1786480801.262817 mapwrite 0x007af0 thru 0x01651c (0xea2d bytes) 000665 1786480801.333311 trunc from 0x01651d to 0x037e52 (0x21936 bytes) 000666 1786480801.349124 trunc from 0x037e53 to 0x0262f0 (0x11b62 bytes) 000667 1786480801.375765 trunc from 0x0262f1 to 0x0084e4 (0x1de0c bytes) 000668 1786480801.394303 trunc from 0x0013be to 0x00690c (0x554f bytes) 000670 1786480801.401513 punch from 0x006667 to 0x0078be (0x1258 bytes) 000671 1786480801.405927 punch from 0x0055ea to 0x0084e4 (0x2efb bytes) 000672 1786480801.411948 trunc from 0x0084e5 to 0x01bf85 (0x13aa1 bytes) 000673 1786480801.429196 trunc from 0x0105b7 to 0x010e44 (0x88e bytes) 000674 1786480801.434017 fallocate 0x0308e0 thru 0x0373a6 (0x6ac7 bytes) 000675 1786480801.440634 mapread 0x00b357 thru 0x00f19e (0x3e48 bytes) 000676 1786480801.473052 mapread 0x027dce thru 0x028dc9 (0xffc bytes) 000677 1786480801.474092 fallocate 0x0042bf thru 0x00cade (0x8820 bytes) 000678 1786480801.480214 trunc from 0x01c62d to 0x025df5 (0x97c9 bytes) 000679 1786480801.485774 punch from 0x002ddc to 0x0060e1 (0x3306 bytes) 000680 1786480801.491273 mapwrite 0x0341b2 thru 0x03e8e8 (0xa737 bytes) 000681 1786480801.550527 trunc from 0x03e8e9 to 0x017693 (0x27255 bytes) 000682 1786480801.568579 mapread 0x00da0e thru 0x014cb8 (0x72ab bytes) 000683 1786480801.598155 fallocate 0x03592d thru 0x03fe3e (0xa512 bytes) 000684 1786480801.604440 mapread 0x03c528 thru 0x03fe3e (0x3917 bytes) 000685 1786480801.626815 write 0x000c80 thru 0x0044bd (0x383e bytes) 000686 1786480801.635953 mapread 0x012283 thru 0x01db2b (0xb8a9 bytes) 000687 1786480801.681804 mapwrite 0x01f854 thru 0x02c367 (0xcb14 bytes) 000688 1786480801.802777 trunc from 0x03fe3f to 0x03dffd (0x1e41 bytes) 000689 1786480801.837767 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dffe): Mirror 4: 0x26402b54 (stale) Mirror 6: 0x26402b54 (stale) Mirror 8: 0x26402b54 (stale) Mirror 12: 0x26402b54 (stale) Mirror 14: 0x26402b54 (stale) Mirror 15: 0x26402b54 (stale) Mirror 17: 0x26402b54 (stale) Mirror 18: 0x26402b54 (stale) Mirror 19: 0x26402b54 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dffe): Mirror 4: 0x26402b54 (stale) Mirror 6: 0x26402b54 (stale) Mirror 8: 0x26402b54 (stale) Mirror 12: 0x26402b54 (stale) Mirror 14: 0x26402b54 (stale) Mirror 15: 0x26402b54 (stale) Mirror 17: 0x26402b54 (stale) Mirror 18: 0x26402b54 (stale) Mirror 19: 0x26402b54 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dffe: skipped 000690 1786480802.540054 trunc from 0x03dffe to 0x02c8d5 (0x11728 bytes) 000691 1786480802.565972 trunc from 0x0130c7 to 0x020c6a (0xdba4 bytes) 000693 1786480802.573198 trunc from 0x02c8d6 to 0x018617 (0x142be bytes) 000695 1786480802.588973 punch from 0x00cf3a to 0x018617 (0xb6de bytes) 000696 1786480802.595164 trunc from 0x018618 to 0x00d92a (0xaced bytes) 000697 1786480802.621986 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd92b): Mirror 4: 0x553c95f1 (stale) Mirror 6: 0x553c95f1 (stale) Mirror 8: 0x553c95f1 (stale) Mirror 12: 0x553c95f1 (stale) Mirror 14: 0x553c95f1 (stale) Mirror 15: 0x553c95f1 (stale) Mirror 17: 0x553c95f1 (stale) Mirror 18: 0x553c95f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd92b): Mirror 4: 0x553c95f1 (stale) Mirror 6: 0x553c95f1 (stale) Mirror 8: 0x553c95f1 (stale) Mirror 12: 0x553c95f1 (stale) Mirror 14: 0x553c95f1 (stale) Mirror 15: 0x553c95f1 (stale) Mirror 17: 0x553c95f1 (stale) Mirror 18: 0x553c95f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd92b: skipped 000698 1786480803.114964 read 0x00d5e0 thru 0x00d92a (0x34b bytes) 000699 1786480803.129585 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd92b): Mirror 6: 0x553c95f1 (stale) Mirror 8: 0x553c95f1 (stale) Mirror 12: 0x553c95f1 (stale) Mirror 14: 0x553c95f1 (stale) Mirror 15: 0x553c95f1 (stale) Mirror 17: 0x553c95f1 (stale) Mirror 18: 0x553c95f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd92b): Mirror 6: 0x553c95f1 (stale) Mirror 8: 0x553c95f1 (stale) Mirror 12: 0x553c95f1 (stale) Mirror 14: 0x553c95f1 (stale) Mirror 15: 0x553c95f1 (stale) Mirror 17: 0x553c95f1 (stale) Mirror 18: 0x553c95f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd92b: skipped 000700 1786480803.598656 mapread 0x00c2bc thru 0x00d92a (0x166f bytes) 000701 1786480803.616517 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd92b): Mirror 6: 0x553c95f1 (stale) Mirror 8: 0x553c95f1 (stale) Mirror 12: 0x553c95f1 (stale) Mirror 14: 0x553c95f1 (stale) Mirror 15: 0x553c95f1 (stale) Mirror 17: 0x553c95f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd92b): Mirror 6: 0x553c95f1 (stale) Mirror 8: 0x553c95f1 (stale) Mirror 12: 0x553c95f1 (stale) Mirror 14: 0x553c95f1 (stale) Mirror 15: 0x553c95f1 (stale) Mirror 17: 0x553c95f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd92b: skipped 000702 1786480804.053544 write 0x0350d8 thru 0x03977a (0x46a3 bytes) 000703 1786480804.060696 fallocate 0x00b829 thru 0x013d24 (0x84fc bytes) 000704 1786480804.068275 trunc from 0x03977b to 0x02c5e9 (0xd191 bytes) 000705 1786480804.104227 mapwrite 0x020702 thru 0x0269bf (0x62be bytes) 000706 1786480804.194689 mapread 0x006d7a thru 0x00a7a2 (0x3a29 bytes) 000707 1786480804.213485 fallocate 0x00a960 thru 0x012620 (0x7cc1 bytes) 000708 1786480804.221822 trunc from 0x02c5ea to 0x02668e (0x5f5b bytes) 000709 1786480804.243146 fallocate 0x03ba4d thru 0x03ffff (0x45b3 bytes) 000710 1786480804.250131 mapread 0x0237b1 thru 0x02668e (0x2ede bytes) 000712 1786480804.253647 fallocate 0x01ff1c thru 0x024864 (0x4949 bytes) 000713 1786480804.260148 punch from 0x007c96 to 0x011d3d (0xa0a8 bytes) 000714 1786480804.269989 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2668f): Mirror 6: 0xf5ad354f (stale) Mirror 8: 0xf5ad354f (stale) Mirror 14: 0xf5ad354f (stale) Mirror 15: 0xf5ad354f (stale) Mirror 17: 0xf5ad354f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2668f): Mirror 6: 0xf5ad354f (stale) Mirror 8: 0xf5ad354f (stale) Mirror 14: 0xf5ad354f (stale) Mirror 15: 0xf5ad354f (stale) Mirror 17: 0xf5ad354f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2668f: skipped 000715 1786480804.636004 fallocate 0x0052c2 thru 0x00a4ad (0x51ec bytes) 000716 1786480804.643731 trunc from 0x02668f to 0x006032 (0x2065c bytes) 000717 1786480804.668281 trunc from 0x005a52 to 0x006032 (0x5e1 bytes) 000718 1786480804.674912 write 0x00847a thru 0x0182d8 (0xfe5f bytes) 000719 1786480804.678282 trunc from 0x002b74 to 0x011a95 (0xef22 bytes) 000720 1786480804.693012 write 0x0237f6 thru 0x032816 (0xf021 bytes) 000721 1786480804.695858 read 0x01d585 thru 0x0269c1 (0x943d bytes) 000722 1786480804.702044 punch from 0x0149d2 to 0x017984 (0x2fb3 bytes) 000723 1786480804.707585 trunc from 0x032817 to 0x036293 (0x3a7d bytes) 000724 1786480804.728579 mapwrite 0x0353bf thru 0x03ffff (0xac41 bytes) 000725 1786480804.792946 write 0x020b9e thru 0x0304ff (0xf962 bytes) 000726 1786480804.795913 mapwrite 0x0386ee thru 0x03ffff (0x7912 bytes) 000727 1786480804.822982 trunc from 0x02f661 to 0x030221 (0xbc1 bytes) 000728 1786480804.830627 mapread 0x013b41 thru 0x01fc86 (0xc146 bytes) 000729 1786480804.845387 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa780d2de (stale) Mirror 8: 0xa780d2de (stale) Mirror 14: 0xa780d2de (stale) Mirror 15: 0xa780d2de (stale) Mirror 17: 0xa780d2de (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbff6f823 Mirror 18: 0xbff6f823 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000730 1786480805.973633 mapwrite 0x01aa9a thru 0x0259c8 (0xaf2f bytes) 000731 1786480806.124127 punch from 0x02d7ab to 0x038a86 (0xb2dc bytes) 000732 1786480806.133205 mapwrite 0x019fcc thru 0x021926 (0x795b bytes) 000734 1786480806.157806 read 0x036e7b thru 0x03ffff (0x9185 bytes) 000735 1786480806.188520 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa780d2de (stale) Mirror 8: 0xa780d2de (stale) Mirror 14: 0xa780d2de (stale) Mirror 15: 0xa780d2de (stale) Mirror 17: 0xa780d2de (stale) Mirror 18: 0xbff6f823 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x98c92f85 Mirror 19: 0x98c92f85 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000736 1786480807.230749 write 0x005d38 thru 0x00cc43 (0x6f0c bytes) 000737 1786480807.281047 mapwrite 0x019eae thru 0x0246b1 (0xa804 bytes) 000738 1786480807.336986 trunc from 0x027191 to 0x035b48 (0xe9b8 bytes) 000739 1786480807.345494 trunc from 0x040000 to 0x02de8a (0x12175 bytes) 000740 1786480807.401967 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2de8b): Mirror 6: 0x4db2260 (stale) Mirror 14: 0x4db2260 (stale) Mirror 15: 0x4db2260 (stale) Mirror 17: 0x4db2260 (stale) Mirror 18: 0xc4bca2aa (stale) Mirror 19: 0x48d0f146 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2de8b): Mirror 6: 0x4db2260 (stale) Mirror 14: 0x4db2260 (stale) Mirror 15: 0x4db2260 (stale) Mirror 17: 0x4db2260 (stale) Mirror 18: 0xc4bca2aa (stale) Mirror 19: 0x48d0f146 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2de8b: skipped 000741 1786480807.953730 mapwrite 0x02286f thru 0x031369 (0xeafb bytes) 000742 1786480808.039934 fallocate 0x00b7ea thru 0x00e4e8 (0x2cff bytes) 000743 1786480808.056868 MIRROR_RESYNC 7 mirrors 000745 1786480809.931264 trunc from 0x03136a to 0x017f2c (0x1943d bytes) 000746 1786480809.969696 fallocate 0x02acf5 thru 0x0356a0 (0xa9ac bytes) 000747 1786480809.979736 write 0x01eca2 thru 0x029b80 (0xaedf bytes) 000748 1786480809.982809 trunc from 0x029b81 to 0x03c825 (0x12ca5 bytes) 000749 1786480810.020110 trunc from 0x008a25 to 0x015584 (0xcb60 bytes) 000750 1786480810.042279 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3c826): Mirror 6: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c826): Mirror 6: 0x32d86406 (stale) Mirror 14: 0x32d86406 (stale) Mirror 15: 0x32d86406 (stale) Mirror 17: 0x32d86406 (stale) Mirror 18: 0x32d86406 (stale) Mirror 19: 0x32d86406 (stale) CRC-32 checksum value for chunk [0, 0x3c826): Mirror 1: 0x916de92 Mirror 20: 0x916de92 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c826: skipped 000751 1786480811.346677 MIRROR_RESYNC 8 mirrors 000752 1786480813.761136 fallocate 0x0172d8 thru 0x01adef (0x3b18 bytes) 000753 1786480813.827372 mapread 0x022153 thru 0x02506c (0x2f1a bytes) 000754 1786480813.867787 read 0x00a2b3 thru 0x014d35 (0xaa83 bytes) 000755 1786480813.880813 punch from 0x017ad1 to 0x017e30 (0x360 bytes) 000756 1786480813.887969 punch from 0x037cc8 to 0x03c825 (0x4b5e bytes) 000757 1786480813.896573 mapread 0x00d631 thru 0x019748 (0xc118 bytes) 000758 1786480813.912633 mapread 0x00682a thru 0x0120f1 (0xb8c8 bytes) 000759 1786480813.927519 fallocate 0x029179 thru 0x032f41 (0x9dc9 bytes) 000760 1786480813.940770 mapread 0x02a29d thru 0x03016c (0x5ed0 bytes) 000761 1786480813.956846 write 0x0004d6 thru 0x006ed1 (0x69fc bytes) 000762 1786480813.966424 mapread 0x00d120 thru 0x00f1d4 (0x20b5 bytes) 000763 1786480813.967449 mapwrite 0x005dab thru 0x010a55 (0xacab bytes) 000764 1786480814.009431 read 0x017f53 thru 0x023cf8 (0xbda6 bytes) 000766 1786480814.011790 read 0x01cee4 thru 0x02bd8a (0xeea7 bytes) 000768 1786480814.014666 fallocate 0x00fd60 thru 0x018c91 (0x8f32 bytes) 000769 1786480814.027668 fallocate 0x00de9b thru 0x01d5a5 (0xf70b bytes) 000770 1786480814.032845 fallocate 0x02afaa thru 0x02c808 (0x185f bytes) 000771 1786480814.039928 write 0x00540c thru 0x00f4ba (0xa0af bytes) 000772 1786480814.041373 read 0x0281fe thru 0x0335a4 (0xb3a7 bytes) 000773 1786480814.047162 MIRROR_RESYNC 8 mirrors 000775 1786480816.108528 MIRROR_EXTEND to 9 mirrors 000776 1786480817.128781 mapwrite 0x03e053 thru 0x03ffff (0x1fad bytes) 000777 1786480817.218421 read 0x015068 thru 0x021cf2 (0xcc8b bytes) 000778 1786480817.228509 mapread 0x033e49 thru 0x03ffff (0xc1b7 bytes) 000779 1786480817.246398 mapwrite 0x0074bd thru 0x013b6b (0xc6af bytes) 000780 1786480817.289929 fallocate 0x021204 thru 0x02d0d9 (0xbed6 bytes) 000781 1786480817.298997 trunc from 0x02fc31 to 0x03ea68 (0xee38 bytes) 000782 1786480817.306494 write 0x013c64 thru 0x016301 (0x269e bytes) 000783 1786480817.307934 write 0x00dd1a thru 0x013e42 (0x6129 bytes) 000785 1786480817.315754 trunc from 0x040000 to 0x02ad5d (0x152a2 bytes) 000786 1786480817.350706 trunc from 0x011aea to 0x01576f (0x3c86 bytes) 000787 1786480817.398545 mapwrite 0x005d6b thru 0x0062e3 (0x579 bytes) 000788 1786480817.430613 write 0x035b8d thru 0x03ffff (0xa473 bytes) 000789 1786480817.432943 read 0x02d906 thru 0x03ba51 (0xe14c bytes) 000790 1786480817.462750 trunc from 0x032e7a to 0x03f9a3 (0xcb2a bytes) 000791 1786480817.507141 fallocate 0x00d623 thru 0x018711 (0xb0ef bytes) 000792 1786480817.521496 punch from 0x010ab7 to 0x012967 (0x1eb1 bytes) 000793 1786480817.535363 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x1f4dd2dd (stale) Mirror 14: 0x1f4dd2dd (stale) Mirror 15: 0x1f4dd2dd (stale) Mirror 17: 0x1f4dd2dd (stale) Mirror 18: 0x1f4dd2dd (stale) Mirror 19: 0x1f4dd2dd (stale) Mirror 20: 0x1f4dd2dd (stale) Mirror 21: 0x1f4dd2dd (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x724a306 Mirror 22: 0x724a306 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000794 1786480818.572981 trunc from 0x040000 to 0x013b59 (0x2c4a6 bytes) 000795 1786480818.657445 punch from 0x00b5dc to 0x00daa9 (0x24ce bytes) 000796 1786480818.663513 trunc from 0x002b33 to 0x00cc87 (0xa155 bytes) 000797 1786480818.670182 trunc from 0x00760f to 0x012ce8 (0xb6da bytes) 000798 1786480818.675096 mapwrite 0x009042 thru 0x018319 (0xf2d8 bytes) 000799 1786480818.760479 trunc from 0x01831a to 0x019a49 (0x1730 bytes) 000800 1786480818.778912 write 0x020a8d thru 0x024c99 (0x420d bytes) 000801 1786480818.788363 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24c9a): Mirror 6: 0x6f273a09 (stale) Mirror 15: 0x6f273a09 (stale) Mirror 17: 0x6f273a09 (stale) Mirror 18: 0x6f273a09 (stale) Mirror 19: 0x6f273a09 (stale) Mirror 20: 0x6f273a09 (stale) Mirror 21: 0x6f273a09 (stale) Mirror 22: 0x9f93dfa1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24c9a): Mirror 6: 0x6f273a09 (stale) Mirror 15: 0x6f273a09 (stale) Mirror 17: 0x6f273a09 (stale) Mirror 18: 0x6f273a09 (stale) Mirror 19: 0x6f273a09 (stale) Mirror 20: 0x6f273a09 (stale) Mirror 21: 0x6f273a09 (stale) Mirror 22: 0x9f93dfa1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24c9a: skipped 000802 1786480819.366543 mapwrite 0x0219f3 thru 0x030f97 (0xf5a5 bytes) 000804 1786480819.445808 fallocate 0x02ed97 thru 0x03e91b (0xfb85 bytes) 000806 1786480819.459571 punch from 0x0137ea to 0x014c93 (0x14aa bytes) 000807 1786480819.464972 mapread 0x000224 thru 0x00fec3 (0xfca0 bytes) 000808 1786480819.478345 mapread 0x02b7f2 thru 0x030f97 (0x57a6 bytes) 000810 1786480819.483353 punch from 0x02ccb1 to 0x02f522 (0x2872 bytes) 000811 1786480819.489769 trunc from 0x030f98 to 0x00f331 (0x21c66 bytes) 000812 1786480819.507463 fallocate 0x007d4d thru 0x0086dd (0x991 bytes) 000814 1786480819.514821 mapwrite 0x0319c1 thru 0x034391 (0x29d1 bytes) 000815 1786480819.558896 mapwrite 0x03f485 thru 0x03ffff (0xb7b bytes) 000816 1786480819.607907 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x1f4dd2dd (stale) Mirror 15: 0x1f4dd2dd (stale) Mirror 17: 0x1f4dd2dd (stale) Mirror 18: 0x1f4dd2dd (stale) Mirror 19: 0x1f4dd2dd (stale) Mirror 20: 0x1f4dd2dd (stale) Mirror 21: 0x1f4dd2dd (stale) Mirror 22: 0x724a306 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7a944a21 Mirror 23: 0x7a944a21 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000818 1786480821.050325 trunc from 0x007405 to 0x00760d (0x209 bytes) 000819 1786480821.105361 trunc from 0x040000 to 0x00819f (0x37e60 bytes) 000820 1786480821.168692 mapread 0x00109c thru 0x00819f (0x7104 bytes) 000821 1786480821.194697 trunc from 0x0081a0 to 0x02e906 (0x26767 bytes) 000822 1786480821.216919 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2e907): Mirror 6: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e907): Mirror 6: 0x91b7695e (stale) Mirror 15: 0x91b7695e (stale) Mirror 17: 0x91b7695e (stale) Mirror 18: 0x91b7695e (stale) Mirror 19: 0x91b7695e (stale) Mirror 20: 0x91b7695e (stale) Mirror 21: 0x91b7695e (stale) Mirror 22: 0x92020ab0 (stale) Mirror 23: 0xfe6dcd9 (stale) CRC-32 checksum value for chunk [0, 0x2e907): Mirror 1: 0xcc3cee2e Mirror 24: 0xcc3cee2e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e907: skipped 000823 1786480822.491431 trunc from 0x02e907 to 0x015500 (0x19406 bytes) 000824 1786480822.553821 punch from 0x00fb6e to 0x015500 (0x5993 bytes) 000825 1786480822.558948 trunc from 0x015501 to 0x0137e6 (0x1d1a bytes) 000826 1786480822.585895 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x137e7): Mirror 6: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x137e7): Mirror 6: 0x55351a2f (stale) Mirror 15: 0x55351a2f (stale) Mirror 17: 0x55351a2f (stale) Mirror 18: 0x55351a2f (stale) Mirror 19: 0x55351a2f (stale) Mirror 20: 0x55351a2f (stale) Mirror 21: 0x55351a2f (stale) Mirror 22: 0xd8b4012b (stale) Mirror 23: 0xc6fe5a32 (stale) Mirror 24: 0x563f5286 (stale) CRC-32 checksum value for chunk [0, 0x137e7): Mirror 1: 0x563f5286 Mirror 25: 0x563f5286 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x137e7: skipped 000827 1786480823.738201 MIRROR_RESYNC 12 mirrors 000828 1786480825.644595 punch from 0x012e45 to 0x0137e6 (0x9a2 bytes) 000829 1786480825.692465 mapread 0x000e2b thru 0x001425 (0x5fb bytes) 000830 1786480825.704566 mapread 0x0100ec thru 0x0137e6 (0x36fb bytes) 000831 1786480825.722738 trunc from 0x010a0d to 0x0137e6 (0x2dda bytes) 000832 1786480825.728010 read 0x0033f4 thru 0x00f7b8 (0xc3c5 bytes) 000833 1786480825.742471 punch from 0x00a022 to 0x010128 (0x6107 bytes) 000834 1786480825.749188 read 0x0092ce thru 0x0096e5 (0x418 bytes) 000835 1786480825.750299 write 0x02c59c thru 0x037c43 (0xb6a8 bytes) 000836 1786480825.756607 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x37c44): Mirror 6: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c44): Mirror 6: 0x20b91061 (stale) Mirror 15: 0x20b91061 (stale) Mirror 17: 0x20b91061 (stale) Mirror 18: 0x20b91061 (stale) Mirror 19: 0x20b91061 (stale) Mirror 20: 0x20b91061 (stale) Mirror 21: 0x20b91061 (stale) Mirror 22: 0x20b91061 (stale) Mirror 23: 0x20b91061 (stale) Mirror 24: 0x20b91061 (stale) Mirror 25: 0x20b91061 (stale) CRC-32 checksum value for chunk [0, 0x37c44): Mirror 1: 0xa69045b1 Mirror 26: 0xa69045b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c44: skipped 000837 1786480826.901304 write 0x001267 thru 0x003605 (0x239f bytes) 000838 1786480826.972486 trunc from 0x03200b to 0x037c43 (0x5c39 bytes) 000839 1786480826.978428 punch from 0x000d48 to 0x00ff4a (0xf203 bytes) 000841 1786480826.993278 read 0x007ca6 thru 0x0159c0 (0xdd1b bytes) 000842 1786480827.006659 write 0x014cc6 thru 0x01708a (0x23c5 bytes) 000843 1786480827.013421 write 0x038b7d thru 0x03ca62 (0x3ee6 bytes) 000844 1786480827.015719 trunc from 0x00cbfb to 0x019c59 (0xd05f bytes) 000845 1786480827.033417 fallocate 0x012482 thru 0x01be1c (0x999b bytes) 000846 1786480827.039456 read 0x00033b thru 0x00280a (0x24d0 bytes) 000847 1786480827.056621 MIRROR_RESYNC 13 mirrors 000848 1786480829.379488 fallocate 0x007702 thru 0x00fdda (0x86d9 bytes) 000849 1786480829.438851 fallocate 0x035c44 thru 0x03ccf3 (0x70b0 bytes) 000850 1786480829.454003 mapread 0x01ef0f thru 0x02387d (0x496f bytes) 000851 1786480829.485665 trunc from 0x0273ef to 0x02f92d (0x853f bytes) 000852 1786480829.497283 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3ccf4): Mirror 6: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ccf4): Mirror 6: 0x96ddcd02 (stale) Mirror 15: 0x96ddcd02 (stale) Mirror 17: 0x96ddcd02 (stale) Mirror 18: 0x96ddcd02 (stale) Mirror 19: 0x96ddcd02 (stale) Mirror 20: 0x96ddcd02 (stale) Mirror 21: 0x96ddcd02 (stale) Mirror 22: 0x96ddcd02 (stale) Mirror 23: 0x96ddcd02 (stale) Mirror 24: 0x96ddcd02 (stale) Mirror 25: 0x96ddcd02 (stale) Mirror 26: 0x96ddcd02 (stale) CRC-32 checksum value for chunk [0, 0x3ccf4): Mirror 1: 0x90757a95 Mirror 27: 0x90757a95 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ccf4: skipped 000853 1786480830.879490 MIRROR_RESYNC 14 mirrors 000854 1786480833.648818 trunc from 0x03ccf4 to 0x01b455 (0x2189e bytes) 000855 1786480833.725940 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b456): Mirror 15: 0x1614ab10 (stale) Mirror 17: 0x1614ab10 (stale) Mirror 18: 0x1614ab10 (stale) Mirror 19: 0x1614ab10 (stale) Mirror 20: 0x1614ab10 (stale) Mirror 21: 0x1614ab10 (stale) Mirror 22: 0x1614ab10 (stale) Mirror 23: 0x1614ab10 (stale) Mirror 24: 0x1614ab10 (stale) Mirror 25: 0x1614ab10 (stale) Mirror 26: 0x1614ab10 (stale) Mirror 27: 0x1614ab10 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b456): Mirror 15: 0x1614ab10 (stale) Mirror 17: 0x1614ab10 (stale) Mirror 18: 0x1614ab10 (stale) Mirror 19: 0x1614ab10 (stale) Mirror 20: 0x1614ab10 (stale) Mirror 21: 0x1614ab10 (stale) Mirror 22: 0x1614ab10 (stale) Mirror 23: 0x1614ab10 (stale) Mirror 24: 0x1614ab10 (stale) Mirror 25: 0x1614ab10 (stale) Mirror 26: 0x1614ab10 (stale) Mirror 27: 0x1614ab10 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b456: skipped 000856 1786480834.387040 trunc from 0x01b456 to 0x0397ed (0x1e398 bytes) 000858 1786480834.406570 punch from 0x0366ac to 0x0397ed (0x3142 bytes) 000860 1786480834.411148 trunc from 0x0397ee to 0x02f7ad (0xa040 bytes) 000862 1786480834.424744 punch from 0x01e7c9 to 0x020e83 (0x26bb bytes) 000863 1786480834.433541 write 0x02ce93 thru 0x03145e (0x45cc bytes) 000864 1786480834.442702 mapwrite 0x000a25 thru 0x00e757 (0xdd33 bytes) 000865 1786480834.508904 fallocate 0x008c7c thru 0x00d0f2 (0x4477 bytes) 000866 1786480834.517474 write 0x008cd6 thru 0x017829 (0xeb54 bytes) 000867 1786480834.527379 read 0x015a64 thru 0x01aa78 (0x5015 bytes) 000868 1786480834.535820 punch from 0x00e132 to 0x015b0c (0x79db bytes) 000869 1786480834.560808 MIRROR_RESYNC 13 mirrors 000870 1786480837.366508 MIRROR_EXTEND to 14 mirrors 000871 1786480838.285370 fallocate 0x015282 thru 0x019ab0 (0x482f bytes) 000872 1786480838.353032 write 0x0158d4 thru 0x0165c2 (0xcef bytes) 000873 1786480838.371492 mapread 0x0274e7 thru 0x03145e (0x9f78 bytes) 000874 1786480838.391295 mapwrite 0x03c0b7 thru 0x03ffff (0x3f49 bytes) 000875 1786480838.427487 trunc from 0x018b7c to 0x023d33 (0xb1b8 bytes) 000876 1786480838.434552 fallocate 0x02eace thru 0x0366a6 (0x7bd9 bytes) 000877 1786480838.442894 trunc from 0x021e90 to 0x0240df (0x2250 bytes) 000878 1786480838.448253 read 0x01d1ea thru 0x0220b3 (0x4eca bytes) 000879 1786480838.464111 read 0x01de0b thru 0x025eea (0x80e0 bytes) 000880 1786480838.488930 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x6f229b06 (stale) Mirror 17: 0x6f229b06 (stale) Mirror 18: 0x6f229b06 (stale) Mirror 19: 0x6f229b06 (stale) Mirror 20: 0x6f229b06 (stale) Mirror 21: 0x6f229b06 (stale) Mirror 22: 0x6f229b06 (stale) Mirror 23: 0x6f229b06 (stale) Mirror 24: 0x6f229b06 (stale) Mirror 25: 0x6f229b06 (stale) Mirror 26: 0x6f229b06 (stale) Mirror 27: 0x6f229b06 (stale) Mirror 28: 0x6f229b06 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xac78255b Mirror 29: 0xac78255b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000881 1786480839.570268 punch from 0x009886 to 0x00d1c7 (0x3942 bytes) 000882 1786480839.618332 fallocate 0x01d0c3 thru 0x029f59 (0xce97 bytes) 000884 1786480839.625359 mapread 0x0211b2 thru 0x02465f (0x34ae bytes) 000885 1786480839.646319 trunc from 0x028b9b to 0x03286c (0x9cd2 bytes) 000886 1786480839.654523 trunc from 0x0039c8 to 0x0086be (0x4cf7 bytes) 000888 1786480839.667221 mapread 0x008208 thru 0x015a9c (0xd895 bytes) 000889 1786480839.697997 punch from 0x01606f to 0x01ad26 (0x4cb8 bytes) 000891 1786480839.704389 trunc from 0x040000 to 0x02738c (0x18c73 bytes) 000892 1786480839.754553 write 0x01c07a thru 0x01d5c1 (0x1548 bytes) 000893 1786480839.756911 punch from 0x008c5b to 0x00fe6e (0x7214 bytes) 000894 1786480839.766863 punch from 0x007213 to 0x0110be (0x9eac bytes) 000895 1786480839.771325 write 0x02af82 thru 0x0342e8 (0x9367 bytes) 000896 1786480839.774235 trunc from 0x02fb7b to 0x0342e8 (0x476e bytes) 000897 1786480839.792112 trunc from 0x02ddda to 0x0304c2 (0x26e9 bytes) 000898 1786480839.797840 mapread 0x0285a4 thru 0x0342e8 (0xbd45 bytes) 000899 1786480839.822271 MIRROR_SPLIT mirror 3 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x342e9): Mirror 15: 0x429697f0 (stale) Mirror 17: 0x429697f0 (stale) Mirror 19: 0x429697f0 (stale) Mirror 20: 0x429697f0 (stale) Mirror 21: 0x429697f0 (stale) Mirror 22: 0x429697f0 (stale) Mirror 23: 0x429697f0 (stale) Mirror 24: 0x429697f0 (stale) Mirror 25: 0x429697f0 (stale) Mirror 26: 0x429697f0 (stale) Mirror 27: 0x429697f0 (stale) Mirror 28: 0x429697f0 (stale) Mirror 29: 0xbd9615b3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x342e9): Mirror 15: 0x429697f0 (stale) Mirror 17: 0x429697f0 (stale) Mirror 19: 0x429697f0 (stale) Mirror 20: 0x429697f0 (stale) Mirror 21: 0x429697f0 (stale) Mirror 22: 0x429697f0 (stale) Mirror 23: 0x429697f0 (stale) Mirror 24: 0x429697f0 (stale) Mirror 25: 0x429697f0 (stale) Mirror 26: 0x429697f0 (stale) Mirror 27: 0x429697f0 (stale) Mirror 28: 0x429697f0 (stale) Mirror 29: 0xbd9615b3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x342e9: skipped 000901 1786480840.624292 trunc from 0x00a6bb to 0x017f38 (0xd87e bytes) 000902 1786480840.631884 mapread 0x02c23c thru 0x033885 (0x764a bytes) 000903 1786480840.651872 fallocate 0x0362f2 thru 0x03ffff (0x9d0e bytes) 000904 1786480840.657546 mapread 0x0334ec thru 0x0342e8 (0xdfd bytes) 000905 1786480840.659436 trunc from 0x00031c to 0x00d411 (0xd0f6 bytes) 000906 1786480840.665447 trunc from 0x01f597 to 0x02a151 (0xabbb bytes) 000907 1786480840.675339 trunc from 0x0342e9 to 0x035dab (0x1ac3 bytes) 000908 1786480840.698455 punch from 0x011ce0 to 0x01b2f2 (0x9613 bytes) 000909 1786480840.702910 fallocate 0x01a3b5 thru 0x024b9f (0xa7eb bytes) 000912 1786480840.714237 read 0x004ec9 thru 0x00c87f (0x79b7 bytes) 000913 1786480840.726480 trunc from 0x035dac to 0x01bacf (0x1a2dc bytes) 000914 1786480840.740796 mapread 0x000eaf thru 0x001927 (0xa79 bytes) 000915 1786480840.752161 mapread 0x00cb03 thru 0x014e2d (0x832b bytes) 000916 1786480840.762313 trunc from 0x00ae33 to 0x00ae69 (0x37 bytes) 000917 1786480840.768633 punch from 0x009c57 to 0x0105e8 (0x6992 bytes) 000918 1786480840.773583 mapwrite 0x01f9db thru 0x02b671 (0xbc97 bytes) 000919 1786480840.837593 punch from 0x026051 to 0x02b671 (0x5621 bytes) 000920 1786480840.843675 mapread 0x00033b thru 0x00b941 (0xb607 bytes) 000921 1786480840.864486 read 0x000769 thru 0x00209b (0x1933 bytes) 000922 1786480840.866983 fallocate 0x028811 thru 0x02eb1c (0x630c bytes) 000923 1786480840.878856 fallocate 0x0294be thru 0x033e02 (0xa945 bytes) 000924 1786480840.887591 punch from 0x02afe4 to 0x02eb1c (0x3b39 bytes) 000925 1786480840.895658 mapread 0x0134a7 thru 0x01b152 (0x7cac bytes) 000926 1786480840.898627 read 0x02dec3 thru 0x02eb1c (0xc5a bytes) 000927 1786480840.911180 trunc from 0x02eb1d to 0x026838 (0x82e4 bytes) 000928 1786480840.927850 punch from 0x01e678 to 0x026838 (0x81c1 bytes) 000929 1786480840.933748 write 0x01da85 thru 0x022643 (0x4bbf bytes) 000930 1786480840.940313 trunc from 0x026839 to 0x02ede8 (0x85b0 bytes) 000931 1786480840.960027 MIRROR_RESYNC 14 mirrors 000932 1786480844.685573 trunc from 0x02ede9 to 0x0089dc (0x2640c bytes) 000933 1786480844.739267 read 0x004f38 thru 0x0089dc (0x3aa5 bytes) 000934 1786480844.749913 fallocate 0x033eec thru 0x038eea (0x4fff bytes) 000935 1786480844.759784 read 0x004219 thru 0x0089dc (0x47c4 bytes) 000936 1786480844.760541 fallocate 0x009859 thru 0x01701c (0xd7c4 bytes) 000937 1786480844.767642 write 0x02b4a6 thru 0x036695 (0xb1f0 bytes) 000938 1786480844.779295 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x36696): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36696): Mirror 15: 0x27e829ee (stale) Mirror 17: 0x27e829ee (stale) Mirror 19: 0x27e829ee (stale) Mirror 20: 0x27e829ee (stale) Mirror 21: 0x27e829ee (stale) Mirror 22: 0x27e829ee (stale) Mirror 23: 0x27e829ee (stale) Mirror 24: 0x27e829ee (stale) Mirror 25: 0x27e829ee (stale) Mirror 26: 0x27e829ee (stale) Mirror 27: 0x27e829ee (stale) Mirror 28: 0x27e829ee (stale) Mirror 29: 0x27e829ee (stale) CRC-32 checksum value for chunk [0, 0x36696): Mirror 1: 0x9d102d82 Mirror 30: 0x9d102d82 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36696: skipped 000939 1786480846.152052 mapread 0x019c35 thru 0x01d225 (0x35f1 bytes) 000940 1786480846.191663 mapwrite 0x02672c thru 0x02f985 (0x925a bytes) 000941 1786480846.318909 read 0x00e15f thru 0x01b87f (0xd721 bytes) 000942 1786480846.329307 mapread 0x0355f3 thru 0x036695 (0x10a3 bytes) 000943 1786480846.330560 mapread 0x036545 thru 0x036695 (0x151 bytes) 000944 1786480846.332165 trunc from 0x036696 to 0x03114a (0x554b bytes) 000945 1786480846.369900 MIRROR_RESYNC 15 mirrors 000946 1786480848.845913 mapwrite 0x03e6df thru 0x03ffff (0x1921 bytes) 000947 1786480848.975995 read 0x036f11 thru 0x03ffff (0x90ef bytes) 000948 1786480848.995502 fallocate 0x01df09 thru 0x01f901 (0x19f9 bytes) 000950 1786480849.003230 fallocate 0x00a969 thru 0x01307a (0x8712 bytes) 000951 1786480849.013052 trunc from 0x00683c to 0x0107bf (0x9f84 bytes) 000952 1786480849.023954 trunc from 0x040000 to 0x03bfb3 (0x404c bytes) 000953 1786480849.074282 read 0x020484 thru 0x020e41 (0x9be bytes) 000954 1786480849.093933 punch from 0x008128 to 0x010c34 (0x8b0d bytes) 000955 1786480849.099734 read 0x012892 thru 0x019469 (0x6bd8 bytes) 000956 1786480849.100638 trunc from 0x02b22f to 0x02c5fd (0x13cf bytes) 000957 1786480849.122737 mapwrite 0x001970 thru 0x003710 (0x1da1 bytes) 000958 1786480849.153009 trunc from 0x03bfb4 to 0x0108d0 (0x2b6e3 bytes) 000959 1786480849.182233 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x108d1): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x108d1): Mirror 15: 0x87f1df85 (stale) Mirror 17: 0x87f1df85 (stale) Mirror 19: 0x87f1df85 (stale) Mirror 20: 0x87f1df85 (stale) Mirror 21: 0x87f1df85 (stale) Mirror 22: 0x87f1df85 (stale) Mirror 23: 0x87f1df85 (stale) Mirror 24: 0x87f1df85 (stale) Mirror 25: 0x87f1df85 (stale) Mirror 26: 0x87f1df85 (stale) Mirror 27: 0x87f1df85 (stale) Mirror 28: 0x87f1df85 (stale) Mirror 29: 0x87f1df85 (stale) Mirror 30: 0x87f1df85 (stale) CRC-32 checksum value for chunk [0, 0x108d1): Mirror 1: 0xc69fd908 Mirror 31: 0xc69fd908 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x108d1: skipped 000960 1786480850.665384 MIRROR_RESYNC 16 mirrors 000961 1786480852.645954 MIRROR_RESYNC 16 mirrors 000963 1786480853.350304 mapread 0x001bf4 thru 0x0103d8 (0xe7e5 bytes) 000964 1786480853.378016 read 0x00170d thru 0x008667 (0x6f5b bytes) 000965 1786480853.378485 fallocate 0x03d677 thru 0x03ffff (0x2989 bytes) 000967 1786480853.450036 fallocate 0x030fbd thru 0x035758 (0x479c bytes) 000968 1786480853.482900 read 0x02ed04 thru 0x03c444 (0xd741 bytes) 000969 1786480853.517440 punch from 0x022eb6 to 0x032e8d (0xffd8 bytes) 000971 1786480853.542673 MIRROR_SPLIT mirror 9 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xec52345f (stale) Mirror 17: 0xec52345f (stale) Mirror 19: 0xec52345f (stale) Mirror 20: 0xec52345f (stale) Mirror 21: 0xec52345f (stale) Mirror 22: 0xec52345f (stale) Mirror 23: 0xec52345f (stale) Mirror 24: 0xec52345f (stale) Mirror 26: 0xec52345f (stale) Mirror 27: 0xec52345f (stale) Mirror 28: 0xec52345f (stale) Mirror 29: 0xec52345f (stale) Mirror 30: 0xec52345f (stale) Mirror 31: 0xec52345f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xec52345f (stale) Mirror 17: 0xec52345f (stale) Mirror 19: 0xec52345f (stale) Mirror 20: 0xec52345f (stale) Mirror 21: 0xec52345f (stale) Mirror 22: 0xec52345f (stale) Mirror 23: 0xec52345f (stale) Mirror 24: 0xec52345f (stale) Mirror 26: 0xec52345f (stale) Mirror 27: 0xec52345f (stale) Mirror 28: 0xec52345f (stale) Mirror 29: 0xec52345f (stale) Mirror 30: 0xec52345f (stale) Mirror 31: 0xec52345f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000973 1786480854.358751 fallocate 0x0206bd thru 0x02c9ec (0xc330 bytes) 000974 1786480854.364792 trunc from 0x03f6e3 to 0x03fdea (0x708 bytes) 000975 1786480854.370299 mapread 0x015c32 thru 0x01e2ed (0x86bc bytes) 000977 1786480854.391437 trunc from 0x01a020 to 0x024b23 (0xab04 bytes) 000978 1786480854.396618 trunc from 0x040000 to 0x003020 (0x3cfdf bytes) 000979 1786480854.455381 punch from 0x001aab to 0x003020 (0x1576 bytes) 000980 1786480854.460861 write 0x01aef3 thru 0x020fc7 (0x60d5 bytes) 000981 1786480854.463019 read 0x00b917 thru 0x00fead (0x4597 bytes) 000982 1786480854.483011 punch from 0x01ce48 to 0x01f9bf (0x2b78 bytes) 000983 1786480854.500756 fallocate 0x035d83 thru 0x037a79 (0x1cf7 bytes) 000984 1786480854.506857 read 0x0009be thru 0x009412 (0x8a55 bytes) 000985 1786480854.518817 write 0x011b66 thru 0x01eac6 (0xcf61 bytes) 000986 1786480854.522168 punch from 0x01c851 to 0x01ddce (0x157e bytes) 000987 1786480854.536420 punch from 0x014bb6 to 0x01e8d1 (0x9d1c bytes) 000988 1786480854.544373 fallocate 0x035126 thru 0x037396 (0x2271 bytes) 000989 1786480854.553000 trunc from 0x00391e to 0x00d415 (0x9af8 bytes) 000990 1786480854.559284 mapwrite 0x01cf2e thru 0x02b629 (0xe6fc bytes) 000991 1786480854.643738 read 0x01376c thru 0x0178a6 (0x413b bytes) 000992 1786480854.650617 write 0x02391c thru 0x02bb13 (0x81f8 bytes) 000993 1786480854.651750 mapread 0x006167 thru 0x00748f (0x1329 bytes) 000994 1786480854.653190 trunc from 0x005745 to 0x00a522 (0x4dde bytes) 000995 1786480854.656613 trunc from 0x01f1ca to 0x01fa10 (0x847 bytes) 000996 1786480854.663052 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bb14): Mirror 17: 0xc3fe7bd0 (stale) Mirror 19: 0xc3fe7bd0 (stale) Mirror 20: 0xc3fe7bd0 (stale) Mirror 21: 0xc3fe7bd0 (stale) Mirror 22: 0xc3fe7bd0 (stale) Mirror 23: 0xc3fe7bd0 (stale) Mirror 24: 0xc3fe7bd0 (stale) Mirror 26: 0xc3fe7bd0 (stale) Mirror 27: 0xc3fe7bd0 (stale) Mirror 28: 0xc3fe7bd0 (stale) Mirror 29: 0xc3fe7bd0 (stale) Mirror 30: 0xc3fe7bd0 (stale) Mirror 31: 0xc3fe7bd0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bb14): Mirror 17: 0xc3fe7bd0 (stale) Mirror 19: 0xc3fe7bd0 (stale) Mirror 20: 0xc3fe7bd0 (stale) Mirror 21: 0xc3fe7bd0 (stale) Mirror 22: 0xc3fe7bd0 (stale) Mirror 23: 0xc3fe7bd0 (stale) Mirror 24: 0xc3fe7bd0 (stale) Mirror 26: 0xc3fe7bd0 (stale) Mirror 27: 0xc3fe7bd0 (stale) Mirror 28: 0xc3fe7bd0 (stale) Mirror 29: 0xc3fe7bd0 (stale) Mirror 30: 0xc3fe7bd0 (stale) Mirror 31: 0xc3fe7bd0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bb14: skipped 000997 1786480855.507053 trunc from 0x003b40 to 0x005410 (0x18d1 bytes) 000998 1786480855.519542 trunc from 0x02bb14 to 0x016871 (0x152a2 bytes) 000999 1786480855.550784 trunc from 0x00507a to 0x00c88c (0x7813 bytes) 001000 1786480855.570025 MIRROR_SPLIT mirror 4 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16872): Mirror 17: 0xb603a245 (stale) Mirror 19: 0xb603a245 (stale) Mirror 20: 0xb603a245 (stale) Mirror 22: 0xb603a245 (stale) Mirror 23: 0xb603a245 (stale) Mirror 24: 0xb603a245 (stale) Mirror 26: 0xb603a245 (stale) Mirror 27: 0xb603a245 (stale) Mirror 28: 0xb603a245 (stale) Mirror 29: 0xb603a245 (stale) Mirror 30: 0xb603a245 (stale) Mirror 31: 0xb603a245 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16872): Mirror 17: 0xb603a245 (stale) Mirror 19: 0xb603a245 (stale) Mirror 20: 0xb603a245 (stale) Mirror 22: 0xb603a245 (stale) Mirror 23: 0xb603a245 (stale) Mirror 24: 0xb603a245 (stale) Mirror 26: 0xb603a245 (stale) Mirror 27: 0xb603a245 (stale) Mirror 28: 0xb603a245 (stale) Mirror 29: 0xb603a245 (stale) Mirror 30: 0xb603a245 (stale) Mirror 31: 0xb603a245 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16872: skipped All operations completed A-OK!