== sanity-flr test 70a: flr mode fsx test ================ 03:16:18 (1782630978) Seed set to 979 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0xc2fd 000006 1782630979.424381 trunc from 00000000 to 0x00c2fc (0xc2fd bytes) 000007 1782630979.428787 write 0x01c251 thru 0x01fe3a (0x3bea bytes) 000008 1782630979.429574 mapread 0x001f72 thru 0x004e50 (0x2edf bytes) 000009 1782630979.435214 mapread 0x00fd5c thru 0x010799 (0xa3e bytes) 000010 1782630979.435854 read 0x0139d6 thru 0x019fd9 (0x6604 bytes) 000011 1782630979.438239 read 0x01f211 thru 0x01fe3a (0xc2a bytes) 000016 1782630979.440531 trunc from 0x01fe3b to 0x00b327 (0x14b13 bytes) 000018 1782630979.446065 mapread 0x005e41 thru 0x00b327 (0x54e7 bytes) 000020 1782630979.447232 mapread 0x00adbf thru 0x00b327 (0x569 bytes) 000021 1782630979.447935 write 0x02f410 thru 0x0386ae (0x929f bytes) truncating to largest ever: 0x22c9c 000027 1782630979.451577 trunc from 0x0386af to 0x022c9b (0x15a13 bytes) 000028 1782630979.456147 mapwrite 0x02cf08 thru 0x033e03 (0x6efc bytes) 000030 1782630979.480787 mapwrite 0x00bc92 thru 0x019a3a (0xdda9 bytes) 000034 1782630979.500443 read 0x01e7c9 thru 0x02c51d (0xdd55 bytes) 000035 1782630979.501019 write 0x003791 thru 0x00a1dd (0x6a4d bytes) 000037 1782630979.502198 read 0x0203b2 thru 0x023a03 (0x3652 bytes) 000038 1782630979.502584 read 0x02d646 thru 0x033e03 (0x67be bytes) truncating to largest ever: 0x36af4 000041 1782630979.503685 trunc from 0x033e04 to 0x036af3 (0x2cf0 bytes) 000042 1782630979.509162 mapwrite 0x0237b6 thru 0x0302b1 (0xcafc bytes) 000043 1782630979.528136 write 0x00e0b8 thru 0x01a8ac (0xc7f5 bytes) 000044 1782630979.529155 trunc from 0x036af4 to 0x016877 (0x2027c bytes) 000049 1782630979.536364 mapread 0x00cf3d thru 0x0107f1 (0x38b5 bytes) 000050 1782630979.537090 write 0x0037ca thru 0x00b974 (0x81ab bytes) 000053 1782630979.540293 MIRROR_EXTEND to 2 mirrors 000054 1782630979.694274 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) 000057 1782630979.727348 mapwrite 0x007206 thru 0x008c2c (0x1a27 bytes) 000058 1782630979.745235 mapread 0x0052a9 thru 0x014725 (0xf47d bytes) 000059 1782630979.750699 read 0x012e23 thru 0x016877 (0x3a55 bytes) 000060 1782630979.751183 mapread 0x00155c thru 0x00b1bb (0x9c60 bytes) 000061 1782630979.753372 MIRROR_EXTEND to 2 mirrors 000063 1782630979.909087 trunc from 0x016878 to 0x0221b3 (0xb93c bytes) 000064 1782630979.934155 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) 000065 1782630979.971676 trunc from 0x0221b4 to 0x0007f8 (0x219bb bytes) 000067 1782630979.976431 write 0x03f969 thru 0x03ffff (0x697 bytes) 000069 1782630979.977549 mapread 0x00d8b6 thru 0x012f9b (0x56e6 bytes) 000071 1782630979.983210 mapwrite 0x02e437 thru 0x032b56 (0x4720 bytes) 000074 1782630980.001515 write 0x0395d5 thru 0x03ffff (0x6a2b bytes) 000075 1782630980.005167 MIRROR_EXTEND to 2 mirrors 000077 1782630980.178102 read 0x023eeb thru 0x02a76d (0x6883 bytes) 000079 1782630980.184725 read 0x00da61 thru 0x0142ef (0x688f bytes) 000080 1782630980.190655 MIRROR_RESYNC 2 mirrors 000082 1782630980.298697 mapread 0x02b85e thru 0x033573 (0x7d16 bytes) 000083 1782630980.302871 write 0x00182c thru 0x008662 (0x6e37 bytes) 000084 1782630980.321194 read 0x035873 thru 0x03ffff (0xa78d bytes) 000085 1782630980.323568 mapwrite 0x02544a thru 0x0350e3 (0xfc9a bytes) 000086 1782630980.344611 read 0x00f2b3 thru 0x017472 (0x81c0 bytes) 000087 1782630980.347745 write 0x003402 thru 0x00f6f1 (0xc2f0 bytes) 000088 1782630980.348589 write 0x00293c thru 0x00a78a (0x7e4f bytes) 000090 1782630980.349813 write 0x03eb3f thru 0x03ffff (0x14c1 bytes) 000092 1782630980.350799 write 0x0228e9 thru 0x02d46b (0xab83 bytes) 000093 1782630980.353132 MIRROR_RESYNC 2 mirrors 000094 1782630980.509616 read 0x002d85 thru 0x0045ea (0x1866 bytes) 000095 1782630980.512463 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) 000096 1782630980.546119 write 0x02f0d1 thru 0x033e90 (0x4dc0 bytes) 000097 1782630980.551365 write 0x028fe2 thru 0x02cf9f (0x3fbe bytes) 000098 1782630980.554059 read 0x0241a2 thru 0x027c36 (0x3a95 bytes) 000101 1782630980.556687 write 0x0219fa thru 0x02b039 (0x9640 bytes) 000104 1782630980.559418 write 0x02789a thru 0x02ac14 (0x337b bytes) 000106 1782630980.560692 write 0x03c8ad thru 0x03e14e (0x18a2 bytes) 000108 1782630980.563927 read 0x034df2 thru 0x03e4ab (0x96ba bytes) 000109 1782630980.567329 trunc from 0x040000 to 0x012086 (0x2df79 bytes) 000113 1782630980.577466 write 0x02e0e5 thru 0x0330c6 (0x4fe2 bytes) 000114 1782630980.578355 write 0x03fba5 thru 0x03ffff (0x45b bytes) 000117 1782630980.579782 read 0x003f87 thru 0x0090ed (0x5167 bytes) 000118 1782630980.580239 read 0x005fab thru 0x00f7c5 (0x981b bytes) 000119 1782630980.580717 write 0x021a1a thru 0x0270a2 (0x5689 bytes) 000121 1782630980.584495 write 0x0144d9 thru 0x015128 (0xc50 bytes) 000125 1782630980.586877 write 0x02678b thru 0x035434 (0xecaa bytes) truncating to largest ever: 0x38bbd 000126 1782630980.587794 trunc from 0x040000 to 0x038bbc (0x7443 bytes) 000129 1782630980.593166 mapread 0x0039df thru 0x005e9d (0x24bf bytes) 000130 1782630980.595137 MIRROR_EXTEND to 2 mirrors 000131 1782630980.746668 read 0x012e19 thru 0x014b91 (0x1d79 bytes) 000132 1782630980.749246 read 0x02b730 thru 0x0307cf (0x50a0 bytes) 000133 1782630980.752990 read 0x006ced thru 0x00fc8a (0x8f9e bytes) 000134 1782630980.754333 write 0x02c12a thru 0x0311a4 (0x507b bytes) 000135 1782630980.776605 MIRROR_RESYNC 2 mirrors 000137 1782630980.936883 write 0x00fbba thru 0x0144bd (0x4904 bytes) 000138 1782630980.957357 mapread 0x01ecf0 thru 0x01ff7f (0x1290 bytes) 000141 1782630980.961642 write 0x03a2d6 thru 0x03ffff (0x5d2a bytes) 000142 1782630980.962487 write 0x02a644 thru 0x039f04 (0xf8c1 bytes) 000143 1782630980.965958 read 0x016a9d thru 0x01add6 (0x433a bytes) 000145 1782630980.968996 trunc from 0x040000 to 0x035b69 (0xa496 bytes) 000146 1782630980.979574 mapwrite 0x0005de thru 0x00ee96 (0xe8b9 bytes) 000147 1782630981.000744 mapwrite 0x0231ea thru 0x02396a (0x781 bytes) 000148 1782630981.015452 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35b6a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35b6a): Mirror 2: 0x619a09fe (stale) CRC-32 checksum value for chunk [0, 0x35b6a): Mirror 1: 0x6fcbcb90 Mirror 3: 0x6fcbcb90 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35b6a: skipped 000149 1782630981.221378 read 0x00009b thru 0x005097 (0x4ffd bytes) 000150 1782630981.225046 write 0x034317 thru 0x03c347 (0x8031 bytes) 000151 1782630981.246734 MIRROR_RESYNC 3 mirrors 000154 1782630981.435708 mapwrite 0x008a45 thru 0x016400 (0xd9bc bytes) 000155 1782630981.486316 write 0x0132d7 thru 0x015710 (0x243a bytes) 000158 1782630981.489139 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c348): Mirror 3: 0x83438d2a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c348): Mirror 3: 0x83438d2a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c348: skipped 000159 1782630981.569045 read 0x021829 thru 0x02f032 (0xd80a bytes) 000160 1782630981.571925 trunc from 0x03c348 to 0x02da56 (0xe8f1 bytes) 000161 1782630981.580429 mapwrite 0x03cb7d thru 0x03ffff (0x3483 bytes) 000162 1782630981.600681 read 0x023b8e thru 0x028b33 (0x4fa6 bytes) 000163 1782630981.602671 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) 000164 1782630981.636294 read 0x02b8c2 thru 0x02dd81 (0x24c0 bytes) 000165 1782630981.638303 write 0x0164cf thru 0x01ddda (0x790c bytes) 000167 1782630981.641757 write 0x021e66 thru 0x0261ef (0x438a bytes) 000168 1782630981.644954 mapread 0x01bb9c thru 0x02a577 (0xe9dc bytes) 000170 1782630981.652701 mapwrite 0x01fb69 thru 0x02646c (0x6904 bytes) 000171 1782630981.666636 mapwrite 0x038ebe thru 0x03ffff (0x7142 bytes) 000172 1782630981.683871 mapread 0x02fe3e thru 0x039830 (0x99f3 bytes) 000173 1782630981.684778 read 0x0388ac thru 0x0399e4 (0x1139 bytes) 000174 1782630981.685316 mapread 0x01ad87 thru 0x026b07 (0xbd81 bytes) 000175 1782630981.686131 mapwrite 0x0106a5 thru 0x0174c3 (0x6e1f bytes) 000176 1782630981.702026 mapread 0x02c52f thru 0x038a1d (0xc4ef bytes) 000182 1782630981.705272 mapread 0x003d3a thru 0x00eed9 (0xb1a0 bytes) 000185 1782630981.706796 read 0x0017f7 thru 0x010b8d (0xf397 bytes) 000186 1782630981.707306 mapread 0x039cab thru 0x03ffff (0x6355 bytes) 000188 1782630981.708461 mapwrite 0x019869 thru 0x021d01 (0x8499 bytes) 000189 1782630981.726999 mapread 0x037041 thru 0x03ffff (0x8fbf bytes) 000192 1782630981.728531 read 0x018e10 thru 0x01dea1 (0x5092 bytes) 000195 1782630981.730270 mapwrite 0x00b93c thru 0x014f0f (0x95d4 bytes) 000199 1782630981.744511 read 0x00f85f thru 0x01121f (0x19c1 bytes) 000200 1782630981.744949 read 0x006bbf thru 0x00be95 (0x52d7 bytes) truncating to largest ever: 0x3e9d7 000202 1782630981.745699 trunc from 0x040000 to 0x03e9d6 (0x1629 bytes) 000204 1782630981.750337 read 0x00174a thru 0x010434 (0xeceb bytes) 000207 1782630981.751470 read 0x00b949 thru 0x00fa68 (0x4120 bytes) 000211 1782630981.753409 write 0x00c905 thru 0x010394 (0x3a90 bytes) 000212 1782630981.754095 mapwrite 0x00dcc2 thru 0x00fa4e (0x1d8d bytes) 000214 1782630981.766375 read 0x01f634 thru 0x022dc8 (0x3795 bytes) 000215 1782630981.768806 MIRROR_EXTEND to 2 mirrors 000220 1782630981.932579 MIRROR_EXTEND to 3 mirrors 000223 1782630982.114910 trunc from 0x03e9d7 to 0x0058fa (0x390dc bytes) 000224 1782630982.140135 read 0x005789 thru 0x0058fa (0x172 bytes) 000226 1782630982.142980 mapread 0x0026a3 thru 0x0058fa (0x3258 bytes) 000227 1782630982.147700 trunc from 0x0058fb to 0x011132 (0xb838 bytes) 000228 1782630982.152823 mapread 0x00da67 thru 0x011132 (0x36cc bytes) 000229 1782630982.155540 mapread 0x00ded8 thru 0x011132 (0x325b bytes) 000234 1782630982.157960 read 0x0052d1 thru 0x011132 (0xbe62 bytes) 000236 1782630982.158864 write 0x0339cb thru 0x03a774 (0x6daa bytes) 000238 1782630982.160238 read 0x02a7ac thru 0x02d982 (0x31d7 bytes) 000239 1782630982.163142 read 0x038049 thru 0x03a774 (0x272c bytes) 000241 1782630982.165285 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a775): Mirror 3: 0x1f52bf63 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a775): Mirror 3: 0x1f52bf63 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a775: skipped 000242 1782630982.247592 trunc from 0x03a775 to 0x00158c (0x391e8 bytes) 000244 1782630982.253274 mapread 0x001379 thru 0x00158c (0x214 bytes) 000245 1782630982.255697 write 0x010f40 thru 0x0126ea (0x17ab bytes) 000248 1782630982.257582 mapread 0x0013c7 thru 0x00e311 (0xcf4b bytes) 000251 1782630982.263672 write 0x0110f7 thru 0x016f3d (0x5e47 bytes) 000255 1782630982.266203 mapread 0x00199a thru 0x002809 (0xe70 bytes) 000256 1782630982.268894 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) 000258 1782630982.310068 mapwrite 0x0142af thru 0x017846 (0x3598 bytes) 000261 1782630982.333228 mapwrite 0x03a17d thru 0x03d6c6 (0x354a bytes) 000262 1782630982.351729 mapwrite 0x0101ef thru 0x01e27e (0xe090 bytes) 000265 1782630982.370614 mapread 0x00cfd0 thru 0x00e25a (0x128b bytes) 000266 1782630982.373958 write 0x0190d1 thru 0x01ef48 (0x5e78 bytes) 000267 1782630982.374802 write 0x02946f thru 0x02a8b7 (0x1449 bytes) 000268 1782630982.378342 read 0x032ebb thru 0x03737c (0x44c2 bytes) 000271 1782630982.382139 write 0x028c81 thru 0x02fc6c (0x6fec bytes) 000274 1782630982.387146 read 0x009dfe thru 0x0169ee (0xcbf1 bytes) 000277 1782630982.389246 mapwrite 0x039c24 thru 0x03ffff (0x63dc bytes) 000280 1782630982.413927 mapwrite 0x030021 thru 0x0327e0 (0x27c0 bytes) 000283 1782630982.427648 write 0x0267a8 thru 0x035cec (0xf545 bytes) 000284 1782630982.430087 MIRROR_EXTEND to 2 mirrors 000285 1782630982.614508 write 0x01d398 thru 0x022376 (0x4fdf bytes) 000286 1782630982.636485 mapwrite 0x01ca1c thru 0x029c70 (0xd255 bytes) 000289 1782630982.658405 read 0x01c5c0 thru 0x02184e (0x528f bytes) 000290 1782630982.658917 read 0x0062f9 thru 0x00990a (0x3612 bytes) 000293 1782630982.663136 mapread 0x0258de thru 0x02cad8 (0x71fb bytes) 000295 1782630982.665635 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) truncating to largest ever: 0x3f82a 000296 1782630982.700192 trunc from 0x040000 to 0x03f829 (0x7d6 bytes) 000297 1782630982.708838 trunc from 0x03f82a to 0x0158bc (0x29f6d bytes) 000298 1782630982.713246 mapwrite 0x01f7e8 thru 0x025e0a (0x6623 bytes) 000299 1782630982.735435 write 0x029aa0 thru 0x038919 (0xee7a bytes) 000301 1782630982.738656 MIRROR_EXTEND to 2 mirrors 000303 1782630982.892731 mapread 0x0063f0 thru 0x0100fd (0x9d0e bytes) 000304 1782630982.899637 write 0x018dfe thru 0x027885 (0xea88 bytes) 000306 1782630982.920774 trunc from 0x03891a to 0x03e2c2 (0x59a9 bytes) 000308 1782630982.930995 trunc from 0x03e2c3 to 0x007008 (0x372ba bytes) 000309 1782630982.935672 read 0x002f0f thru 0x007008 (0x40fa bytes) 000310 1782630982.938432 write 0x023bb8 thru 0x031683 (0xdacc bytes) 000312 1782630982.940227 mapread 0x013004 thru 0x01fde1 (0xcdde bytes) 000313 1782630982.945566 write 0x0119f5 thru 0x01fab3 (0xe0bf bytes) 000314 1782630982.946549 mapread 0x001f1b thru 0x008ac1 (0x6ba7 bytes) 000315 1782630982.949350 trunc from 0x031684 to 0x03c07a (0xa9f7 bytes) 000317 1782630982.958181 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3c07b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c07b): Mirror 2: 0x77d1dbd2 (stale) CRC-32 checksum value for chunk [0, 0x3c07b): Mirror 1: 0xc1a51f94 Mirror 3: 0xc1a51f94 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c07b: skipped 000318 1782630983.182463 mapread 0x03438c thru 0x03c07a (0x7cef bytes) 000319 1782630983.192653 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c07b): Mirror 2: 0x77d1dbd2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c07b): Mirror 2: 0x77d1dbd2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c07b: skipped 000320 1782630983.271314 mapread 0x00f6ac thru 0x016eb5 (0x780a bytes) 000321 1782630983.276631 write 0x02a111 thru 0x02f825 (0x5715 bytes) 000323 1782630983.282394 write 0x026efd thru 0x02cc02 (0x5d06 bytes) 000325 1782630983.286422 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) 000326 1782630983.323386 write 0x01b5ca thru 0x028441 (0xce78 bytes) 000329 1782630983.330299 MIRROR_EXTEND to 2 mirrors 000330 1782630983.508550 write 0x025fc9 thru 0x035465 (0xf49d bytes) 000331 1782630983.528464 mapread 0x00482e thru 0x009764 (0x4f37 bytes) 000332 1782630983.534050 mapread 0x00a11b thru 0x00a82f (0x715 bytes) 000333 1782630983.534858 write 0x0064e7 thru 0x010794 (0xa2ae bytes) 000336 1782630983.536680 mapread 0x01d8b0 thru 0x0299cd (0xc11e bytes) 000337 1782630983.539844 read 0x021425 thru 0x02c070 (0xac4c bytes) 000338 1782630983.540290 write 0x00cf0c thru 0x01ac45 (0xdd3a bytes) 000341 1782630983.542175 write 0x027dd7 thru 0x0302ec (0x8516 bytes) 000342 1782630983.544341 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) 000343 1782630983.584026 write 0x01464e thru 0x01bfaf (0x7962 bytes) 000344 1782630983.587309 mapread 0x026ccc thru 0x034753 (0xda88 bytes) 000346 1782630983.595302 read 0x0035ad thru 0x008f81 (0x59d5 bytes) 000348 1782630983.599696 mapwrite 0x029305 thru 0x0332c3 (0x9fbf bytes) 000349 1782630983.619991 mapread 0x025b11 thru 0x02bd2a (0x621a bytes) 000350 1782630983.620794 mapwrite 0x020952 thru 0x026569 (0x5c18 bytes) 000351 1782630983.636980 trunc from 0x03c07b to 0x01932b (0x22d4f bytes) 000352 1782630983.641697 trunc from 0x01932c to 0x03353b (0x1a210 bytes) 000353 1782630983.645686 trunc from 0x03353c to 0x025f99 (0xd5a2 bytes) 000354 1782630983.649772 mapwrite 0x002525 thru 0x00f56a (0xd046 bytes) 000355 1782630983.666883 write 0x03d791 thru 0x03f61c (0x1e8c bytes) 000358 1782630983.668791 read 0x00ef32 thru 0x015656 (0x6725 bytes) 000359 1782630983.672189 mapread 0x01d884 thru 0x022496 (0x4c13 bytes) 000360 1782630983.674267 MIRROR_EXTEND to 2 mirrors 000362 1782630983.830674 mapread 0x01c2f9 thru 0x02b320 (0xf028 bytes) 000365 1782630983.843429 MIRROR_EXTEND to 3 mirrors 000366 1782630984.001331 mapwrite 0x032838 thru 0x03361c (0xde5 bytes) 000368 1782630984.053063 mapwrite 0x007fec thru 0x013955 (0xb96a bytes) 000371 1782630984.072771 mapwrite 0x036735 thru 0x03b3b5 (0x4c81 bytes) 000372 1782630984.085925 mapread 0x037375 thru 0x03f61c (0x82a8 bytes) 000373 1782630984.088840 read 0x036293 thru 0x037605 (0x1373 bytes) 000374 1782630984.089525 mapread 0x01abd1 thru 0x024de2 (0xa212 bytes) 000375 1782630984.094615 trunc from 0x03f61d to 0x03108e (0xe58e bytes) 000376 1782630984.104818 mapread 0x0264dc thru 0x02bbfc (0x5721 bytes) 000379 1782630984.106739 read 0x02d02d thru 0x03108e (0x4062 bytes) 000380 1782630984.108535 MIRROR_RESYNC 3 mirrors 000381 1782630984.291235 MIRROR_EXTEND to 4 mirrors 000382 1782630984.456213 write 0x011e17 thru 0x019d9d (0x7f87 bytes) 000383 1782630984.478117 trunc from 0x03108f to 0x02f5f4 (0x1a9a bytes) 000384 1782630984.488798 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f5f5): Mirror 2: 0x35de972f (stale) Mirror 3: 0x35de972f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f5f5): Mirror 2: 0x35de972f (stale) Mirror 3: 0x35de972f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f5f5: skipped 000385 1782630984.571489 read 0x020fe0 thru 0x022715 (0x1736 bytes) 000390 1782630984.575569 mapwrite 0x023d88 thru 0x03157f (0xd7f8 bytes) 000391 1782630984.603636 trunc from 0x031580 to 0x007e03 (0x2977c bytes) 000392 1782630984.608658 trunc from 0x007e04 to 0x025a15 (0x1dc12 bytes) 000393 1782630984.613146 write 0x014af9 thru 0x016c5e (0x2166 bytes) 000394 1782630984.617441 MIRROR_RESYNC 3 mirrors 000395 1782630984.805006 MIRROR_EXTEND to 4 mirrors 000396 1782630984.966057 read 0x0237dc thru 0x025a15 (0x223a bytes) 000397 1782630984.969125 write 0x00e5ad thru 0x019571 (0xafc5 bytes) 000398 1782630984.989631 trunc from 0x025a16 to 0x010edb (0x14b3a bytes) 000400 1782630985.001319 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x10edc): Mirror 3: 0x24d9139d (stale) Mirror 4: 0x24d9139d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10edc): Mirror 3: 0x24d9139d (stale) Mirror 4: 0x24d9139d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10edc: skipped 000406 1782630985.083656 mapread 0x006363 thru 0x010edb (0xab79 bytes) 000408 1782630985.090050 write 0x02da36 thru 0x0344f1 (0x6abc bytes) 000410 1782630985.091357 read 0x02a30c thru 0x02f346 (0x503b bytes) 000414 1782630985.095580 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x344f2): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x344f2): Mirror 3: 0xc717b4f4 (stale) Mirror 4: 0xc717b4f4 (stale) CRC-32 checksum value for chunk [0, 0x344f2): Mirror 1: 0x19e6ec49 Mirror 5: 0x19e6ec49 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x344f2: skipped 000415 1782630985.321650 write 0x038da6 thru 0x039cf3 (0xf4e bytes) 000416 1782630985.340402 mapread 0x012379 thru 0x0206f8 (0xe380 bytes) 000419 1782630985.349765 read 0x01c22e thru 0x01d46e (0x1241 bytes) 000420 1782630985.350261 mapread 0x02ce79 thru 0x037eb7 (0xb03f bytes) 000422 1782630985.355722 mapwrite 0x00abde thru 0x00fd62 (0x5185 bytes) 000423 1782630985.378232 mapread 0x02c0cf thru 0x030f2a (0x4e5c bytes) 000424 1782630985.379570 trunc from 0x039cf4 to 0x02dd23 (0xbfd0 bytes) 000425 1782630985.392675 mapread 0x017477 thru 0x019ca9 (0x2833 bytes) 000427 1782630985.394501 trunc from 0x02dd24 to 0x0177b5 (0x1656e bytes) 000429 1782630985.401167 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x177b6): Mirror 4: 0x9665d1a6 (stale) Mirror 5: 0x1b5caa5a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x177b6): Mirror 4: 0x9665d1a6 (stale) Mirror 5: 0x1b5caa5a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x177b6: skipped 000430 1782630985.482875 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x177b6): Mirror 5: 0x1b5caa5a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x177b6): Mirror 5: 0x1b5caa5a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x177b6: skipped 000431 1782630985.554604 mapread 0x0051cd thru 0x00cb1e (0x7952 bytes) 000434 1782630985.561349 read 0x0096f2 thru 0x0177b5 (0xe0c4 bytes) 000435 1782630985.565663 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) 000442 1782630985.605785 write 0x037e52 thru 0x039e52 (0x2001 bytes) 000444 1782630985.607558 read 0x01b5dd thru 0x01d4bb (0x1edf bytes) 000445 1782630985.609907 trunc from 0x039e53 to 0x012cb0 (0x271a2 bytes) 000446 1782630985.614438 mapwrite 0x0330eb thru 0x03ffff (0xcf15 bytes) 000448 1782630985.647127 mapwrite 0x02ebab thru 0x03cda9 (0xe1ff bytes) 000449 1782630985.666527 write 0x01c2aa thru 0x0294b8 (0xd20f bytes) 000452 1782630985.671691 read 0x03dae8 thru 0x03fba9 (0x20c2 bytes) 000453 1782630985.672272 read 0x01753f thru 0x0203a6 (0x8e68 bytes) 000454 1782630985.676219 write 0x0385f0 thru 0x03cbdd (0x45ee bytes) 000455 1782630985.677415 mapread 0x0398d9 thru 0x03ffff (0x6727 bytes) 000456 1782630985.678604 read 0x021282 thru 0x02ceda (0xbc59 bytes) 000459 1782630985.680551 read 0x02c422 thru 0x03bbeb (0xf7ca bytes) 000461 1782630985.682177 trunc from 0x040000 to 0x0048ad (0x3b752 bytes) 000462 1782630985.689101 write 0x03b507 thru 0x03ffff (0x4af9 bytes) 000463 1782630985.690261 write 0x014c03 thru 0x01c30b (0x7709 bytes) 000464 1782630985.695250 write 0x017c57 thru 0x023221 (0xb5cb bytes) 000465 1782630985.696379 read 0x02248e thru 0x024176 (0x1ce9 bytes) 000466 1782630985.696821 mapwrite 0x0193a8 thru 0x0261d9 (0xce32 bytes) 000470 1782630985.716297 write 0x007be9 thru 0x00b2fb (0x3713 bytes) 000471 1782630985.717448 mapwrite 0x01fd5f thru 0x0297e5 (0x9a87 bytes) 000473 1782630985.740289 read 0x02eb1c thru 0x03b344 (0xc829 bytes) 000479 1782630985.743691 mapwrite 0x002988 thru 0x00c08d (0x9706 bytes) 000481 1782630985.762349 mapwrite 0x035600 thru 0x03a777 (0x5178 bytes) 000482 1782630985.779119 mapread 0x03d160 thru 0x03ffff (0x2ea0 bytes) 000483 1782630985.780102 write 0x0005cb thru 0x0014b9 (0xeef bytes) 000484 1782630985.782458 MIRROR_EXTEND to 2 mirrors 000487 1782630985.949231 trunc from 0x040000 to 0x01b5b8 (0x24a47 bytes) 000490 1782630985.976907 mapread 0x01217f thru 0x01b5b8 (0x943a bytes) 000492 1782630985.982892 trunc from 0x01b5b9 to 0x03c06e (0x20ab6 bytes) 000493 1782630985.989565 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) 000495 1782630986.026093 write 0x012af9 thru 0x0159e5 (0x2eed bytes) 000499 1782630986.031741 read 0x01f2e0 thru 0x02ba30 (0xc751 bytes) 000500 1782630986.034518 read 0x0029e1 thru 0x00f879 (0xce99 bytes) 000502 1782630986.038655 trunc from 0x03c06f to 0x0138d8 (0x28796 bytes) 000503 1782630986.043525 mapwrite 0x0373b6 thru 0x03c0eb (0x4d36 bytes) 000508 1782630986.072360 trunc from 0x03c0ec to 0x023384 (0x18d67 bytes) 000509 1782630986.076839 mapread 0x0174e5 thru 0x01ea50 (0x756c bytes) 000510 1782630986.087098 read 0x00c676 thru 0x01b0e2 (0xea6d bytes) 000511 1782630986.089738 read 0x0104cb thru 0x019cb7 (0x97ed bytes) 000513 1782630986.090586 write 0x01fc92 thru 0x029f1a (0xa289 bytes) 000519 1782630986.093843 mapread 0x017bbf thru 0x01ee52 (0x7294 bytes) 000524 1782630986.096022 read 0x029106 thru 0x029f1a (0xe15 bytes) 000525 1782630986.096410 read 0x0204ce thru 0x023223 (0x2d56 bytes) 000526 1782630986.096819 mapwrite 0x03d75c thru 0x03ffff (0x28a4 bytes) 000527 1782630986.116932 mapread 0x005e81 thru 0x009f8d (0x410d bytes) 000530 1782630986.119096 mapread 0x03c558 thru 0x03ffff (0x3aa8 bytes) 000532 1782630986.120588 mapwrite 0x011dd0 thru 0x01a275 (0x84a6 bytes) 000533 1782630986.134816 mapread 0x007682 thru 0x011222 (0x9ba1 bytes) 000534 1782630986.135614 read 0x0247db thru 0x02b2b8 (0x6ade bytes) 000535 1782630986.136114 read 0x03d451 thru 0x03ffff (0x2baf bytes) 000539 1782630986.137913 read 0x012cdd thru 0x01cf2d (0xa251 bytes) 000541 1782630986.138680 write 0x003f97 thru 0x008e29 (0x4e93 bytes) 000542 1782630986.139561 write 0x0267e9 thru 0x035d6c (0xf584 bytes) 000543 1782630986.140610 mapwrite 0x01f92e thru 0x02181f (0x1ef2 bytes) 000544 1782630986.155180 mapwrite 0x035167 thru 0x03c52b (0x73c5 bytes) 000545 1782630986.168305 mapread 0x003d65 thru 0x00d813 (0x9aaf bytes) 000548 1782630986.170172 write 0x00596a thru 0x00b29e (0x5935 bytes) 000549 1782630986.170893 read 0x03d149 thru 0x03ffff (0x2eb7 bytes) 000550 1782630986.172819 MIRROR_EXTEND to 2 mirrors 000552 1782630986.332073 read 0x03b76c thru 0x03ffff (0x4894 bytes) 000553 1782630986.335281 mapread 0x03aee4 thru 0x03ffff (0x511c bytes) 000554 1782630986.339353 mapread 0x01f2c7 thru 0x01f90e (0x648 bytes) 000555 1782630986.343400 mapread 0x02a2ff thru 0x02be88 (0x1b8a bytes) 000556 1782630986.348522 write 0x00af0b thru 0x01a153 (0xf249 bytes) 000557 1782630986.370352 trunc from 0x040000 to 0x020961 (0x1f69e bytes) 000560 1782630986.381659 read 0x01eb3f thru 0x020961 (0x1e23 bytes) 000561 1782630986.384944 read 0x00a33c thru 0x00c38c (0x2051 bytes) 000562 1782630986.385685 read 0x0151bb thru 0x01da61 (0x88a7 bytes) 000563 1782630986.386431 trunc from 0x020962 to 0x014903 (0xc05e bytes) 000566 1782630986.391298 read 0x0103ce thru 0x014903 (0x4536 bytes) 000567 1782630986.393015 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x14904): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14904): Mirror 2: 0x6c1e77f9 (stale) CRC-32 checksum value for chunk [0, 0x14904): Mirror 1: 0x5db3f824 Mirror 3: 0x5db3f824 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14904: skipped 000569 1782630986.596238 mapread 0x00b849 thru 0x013fe4 (0x879c bytes) 000571 1782630986.604688 write 0x005dea thru 0x00c806 (0x6a1d bytes) 000573 1782630986.624610 trunc from 0x014904 to 0x029274 (0x14971 bytes) 000574 1782630986.634095 mapwrite 0x030903 thru 0x03c2de (0xb9dc bytes) 000575 1782630986.659492 trunc from 0x03c2df to 0x00a478 (0x31e66 bytes) 000577 1782630986.665964 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa479): Mirror 2: 0x1029a920 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa479): Mirror 2: 0x1029a920 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa479: skipped 000578 1782630986.737132 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) 000579 1782630986.769906 trunc from 0x00a479 to 0x00f476 (0x4ffe bytes) 000583 1782630986.775125 mapread 0x00d6a4 thru 0x00e395 (0xcf2 bytes) 000584 1782630986.778290 trunc from 0x00f477 to 0x037613 (0x2819d bytes) 000587 1782630986.783376 read 0x00ab6c thru 0x01748d (0xc922 bytes) 000588 1782630986.786077 mapwrite 0x009392 thru 0x009b59 (0x7c8 bytes) 000589 1782630986.799721 read 0x00ce3b thru 0x01c611 (0xf7d7 bytes) 000592 1782630986.804586 mapwrite 0x0044b9 thru 0x00dea6 (0x99ee bytes) 000593 1782630986.819087 mapwrite 0x01aaaa thru 0x029d4a (0xf2a1 bytes) 000596 1782630986.836235 mapwrite 0x0063ba thru 0x0103b9 (0xa000 bytes) 000598 1782630986.851212 mapwrite 0x036e19 thru 0x03e65a (0x7842 bytes) 000599 1782630986.870082 mapwrite 0x0339b7 thru 0x03c851 (0x8e9b bytes) 000600 1782630986.884575 mapread 0x007447 thru 0x01187f (0xa439 bytes) 000602 1782630986.885871 mapwrite 0x02482b thru 0x03482a (0x10000 bytes) 000603 1782630986.901419 trunc from 0x03e65b to 0x0055f0 (0x3906a bytes) 000605 1782630986.908533 MIRROR_EXTEND to 2 mirrors 000609 1782630987.067221 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) 000610 1782630987.101216 trunc from 0x0055f1 to 0x0023ac (0x3244 bytes) 000611 1782630987.111488 read 0x002291 thru 0x0023ac (0x11c bytes) 000618 1782630987.115622 mapread 0x000d78 thru 0x0023ac (0x1635 bytes) 000619 1782630987.119295 read 0x00041e thru 0x0023ac (0x1f8f bytes) 000620 1782630987.121089 MIRROR_EXTEND to 2 mirrors 000621 1782630987.280588 mapwrite 0x002e74 thru 0x005067 (0x21f4 bytes) 000622 1782630987.330614 trunc from 0x005068 to 0x013a95 (0xea2e bytes) 000623 1782630987.336364 trunc from 0x013a96 to 0x00ccf0 (0x6da5 bytes) 000624 1782630987.342340 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) 000627 1782630987.381426 read 0x00b875 thru 0x00ccf0 (0x147c bytes) 000631 1782630987.385201 mapread 0x0047b4 thru 0x00ccf0 (0x853d bytes) 000632 1782630987.391007 read 0x0074d1 thru 0x009e5b (0x298b bytes) 000635 1782630987.392505 write 0x00ee2e thru 0x01017c (0x134f bytes) 000637 1782630987.393692 mapread 0x00e09c thru 0x01017c (0x20e1 bytes) 000639 1782630987.395134 mapwrite 0x003452 thru 0x003b62 (0x711 bytes) 000641 1782630987.410262 mapread 0x004a3a thru 0x01017c (0xb743 bytes) 000644 1782630987.414539 write 0x036266 thru 0x03ffff (0x9d9a bytes) 000645 1782630987.415613 trunc from 0x040000 to 0x038979 (0x7686 bytes) 000647 1782630987.420894 read 0x0257d3 thru 0x0288d1 (0x30ff bytes) 000648 1782630987.424413 mapwrite 0x03dfd8 thru 0x03ffff (0x2028 bytes) 000651 1782630987.446551 read 0x00f1e4 thru 0x018592 (0x93af bytes) 000653 1782630987.448146 mapwrite 0x01cf6d thru 0x025af2 (0x8b86 bytes) 000654 1782630987.464723 write 0x022ed9 thru 0x02e2a7 (0xb3cf bytes) 000655 1782630987.465730 read 0x02e9e9 thru 0x039420 (0xaa38 bytes) 000659 1782630987.467447 mapread 0x005dec thru 0x00e43d (0x8652 bytes) 000660 1782630987.468221 read 0x03b109 thru 0x03ffff (0x4ef7 bytes) 000662 1782630987.468975 mapread 0x0345b6 thru 0x03d2e1 (0x8d2c bytes) 000663 1782630987.469681 trunc from 0x040000 to 0x013d8c (0x2c273 bytes) 000664 1782630987.475129 mapread 0x00d57d thru 0x0139a7 (0x642b bytes) 000665 1782630987.475873 trunc from 0x013d8d to 0x038c75 (0x24ee9 bytes) 000666 1782630987.480284 write 0x0393b8 thru 0x03c81d (0x3466 bytes) 000667 1782630987.481047 read 0x00058c thru 0x00dd97 (0xd80c bytes) 000674 1782630987.484692 mapread 0x011436 thru 0x01db63 (0xc72e bytes) 000675 1782630987.488887 mapread 0x01d09b thru 0x028de2 (0xbd48 bytes) 000685 1782630987.494119 read 0x019393 thru 0x026415 (0xd083 bytes) 000687 1782630987.495029 mapwrite 0x01f775 thru 0x027da6 (0x8632 bytes) 000689 1782630987.513878 mapread 0x03ac55 thru 0x03b2c1 (0x66d bytes) 000692 1782630987.515574 mapread 0x011a73 thru 0x01dce0 (0xc26e bytes) 000693 1782630987.516753 mapread 0x000bb2 thru 0x00e2aa (0xd6f9 bytes) 000695 1782630987.518903 trunc from 0x03c81e to 0x020cd0 (0x1bb4d bytes) 000698 1782630987.527110 MIRROR_EXTEND to 2 mirrors 000699 1782630987.694650 write 0x03a755 thru 0x03b4a6 (0xd52 bytes) 000702 1782630987.718635 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) 000703 1782630987.757782 write 0x00e785 thru 0x00f23c (0xab8 bytes) 000705 1782630987.761286 read 0x001b50 thru 0x004cd6 (0x3187 bytes) 000709 1782630987.764732 mapwrite 0x017b93 thru 0x020765 (0x8bd3 bytes) 000710 1782630987.787035 write 0x021d18 thru 0x0306df (0xe9c8 bytes) 000713 1782630987.790716 write 0x00bf98 thru 0x012b5d (0x6bc6 bytes) 000714 1782630987.792879 mapwrite 0x00ca2f thru 0x018d40 (0xc312 bytes) 000715 1782630987.811081 mapwrite 0x0194aa thru 0x01bfbd (0x2b14 bytes) 000716 1782630987.823409 mapread 0x02a88c thru 0x02c269 (0x19de bytes) 000718 1782630987.824643 write 0x0090d6 thru 0x012500 (0x942b bytes) 000719 1782630987.827058 trunc from 0x03b4a7 to 0x019d4f (0x21757 bytes) 000720 1782630987.836657 write 0x01fd31 thru 0x02c6e8 (0xc9b8 bytes) 000721 1782630987.837698 mapread 0x01182f thru 0x020996 (0xf168 bytes) 000723 1782630987.841106 write 0x003d22 thru 0x00a6f4 (0x69d3 bytes) 000724 1782630987.841908 trunc from 0x02c6e9 to 0x01a8e7 (0x11e01 bytes) 000725 1782630987.847141 mapread 0x0075e8 thru 0x00bb95 (0x45ae bytes) 000727 1782630987.848585 mapread 0x015b9d thru 0x01a8e7 (0x4d4b bytes) 000731 1782630987.850363 write 0x00eebf thru 0x01d9ba (0xeafc bytes) 000732 1782630987.851357 mapread 0x004ef7 thru 0x00f53d (0xa647 bytes) 000733 1782630987.852181 mapread 0x016bd2 thru 0x01947e (0x28ad bytes) 000734 1782630987.852901 trunc from 0x01d9bb to 0x02191f (0x3f65 bytes) 000735 1782630987.858582 mapwrite 0x03e741 thru 0x03ffff (0x18bf bytes) 000736 1782630987.879785 write 0x01028d thru 0x0102e2 (0x56 bytes) 000737 1782630987.880482 read 0x014f49 thru 0x0236b4 (0xe76c bytes) 000738 1782630987.883699 read 0x0092e2 thru 0x00c10d (0x2e2c bytes) 000739 1782630987.884164 write 0x0092d2 thru 0x009b73 (0x8a2 bytes) 000741 1782630987.885671 write 0x011aff thru 0x014799 (0x2c9b bytes) 000743 1782630987.887464 trunc from 0x040000 to 0x034fc3 (0xb03c bytes) 000744 1782630987.891951 write 0x0392de thru 0x03f3e6 (0x6109 bytes) 000750 1782630987.895204 trunc from 0x03f3e7 to 0x03b1f9 (0x41ed bytes) 000751 1782630987.899459 mapwrite 0x010268 thru 0x018803 (0x859c bytes) 000752 1782630987.913994 trunc from 0x03b1fa to 0x00018b (0x3b06e bytes) 000753 1782630987.918836 read 0x000064 thru 0x00018b (0x128 bytes) 000754 1782630987.919305 mapread 0x000016 thru 0x00018b (0x176 bytes) 000756 1782630987.920392 mapwrite 0x00ca77 thru 0x00cf1f (0x4a9 bytes) 000763 1782630987.939718 mapwrite 0x01faea thru 0x02eb4c (0xf063 bytes) 000764 1782630987.961858 trunc from 0x02eb4d to 0x030a23 (0x1ed7 bytes) 000765 1782630987.968140 MIRROR_EXTEND to 2 mirrors 000767 1782630988.135187 read 0x02dd98 thru 0x030a23 (0x2c8c bytes) 000769 1782630988.140711 mapwrite 0x01bc1c thru 0x029b91 (0xdf76 bytes) 000770 1782630988.196179 mapread 0x002087 thru 0x00587e (0x37f8 bytes) 000771 1782630988.199598 read 0x00540e thru 0x01525c (0xfe4f bytes) 000772 1782630988.202765 read 0x0211be thru 0x024133 (0x2f76 bytes) 000774 1782630988.203896 mapwrite 0x03a555 thru 0x03efa6 (0x4a52 bytes) 000777 1782630988.227158 trunc from 0x03efa7 to 0x01bfe8 (0x22fbe bytes) 000778 1782630988.231641 mapwrite 0x02fbea thru 0x03c1e6 (0xc5fd bytes) 000779 1782630988.267340 write 0x022b8b thru 0x02492d (0x1da3 bytes) 000782 1782630988.272113 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3c1e7): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c1e7): Mirror 2: 0x6f6291ea (stale) CRC-32 checksum value for chunk [0, 0x3c1e7): Mirror 1: 0x1d65c109 Mirror 3: 0x1d65c109 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c1e7: skipped 000783 1782630988.483218 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) 000784 1782630988.578337 trunc from 0x03c1e7 to 0x02ca14 (0xf7d2 bytes) 000785 1782630988.603751 mapread 0x00c41d thru 0x00d1a5 (0xd89 bytes) 000789 1782630988.608587 write 0x000b1d thru 0x00c2a7 (0xb78b bytes) 000790 1782630988.611016 write 0x01dfd3 thru 0x02aadf (0xcb0d bytes) 000791 1782630988.614253 mapwrite 0x001235 thru 0x00b419 (0xa1e5 bytes) 000794 1782630988.630725 mapread 0x01f8e9 thru 0x02ca14 (0xd12c bytes) 000795 1782630988.633985 read 0x024991 thru 0x028a57 (0x40c7 bytes) 000797 1782630988.634754 trunc from 0x02ca15 to 0x03a8ab (0xde97 bytes) 000798 1782630988.642298 MIRROR_RESYNC 2 mirrors 000799 1782630988.807201 mapread 0x01df5b thru 0x02a39e (0xc444 bytes) 000800 1782630988.815049 mapread 0x015dfc thru 0x019aae (0x3cb3 bytes) 000802 1782630988.817711 read 0x00d922 thru 0x014eec (0x75cb bytes) 000803 1782630988.820431 MIRROR_RESYNC 2 mirrors 000804 1782630988.926425 mapwrite 0x012958 thru 0x0208a6 (0xdf4f bytes) 000806 1782630988.978681 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3a8ac): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a8ac): Mirror 3: 0x2daaa2e (stale) CRC-32 checksum value for chunk [0, 0x3a8ac): Mirror 1: 0x9f3dafaa Mirror 4: 0x9f3dafaa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a8ac: skipped 000807 1782630989.196647 mapwrite 0x02c617 thru 0x02f27c (0x2c66 bytes) 000809 1782630989.248958 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a8ac): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a8ac): Mirror 3: 0x2daaa2e (stale) Mirror 4: 0x9f3dafaa (stale) CRC-32 checksum value for chunk [0, 0x3a8ac): Mirror 1: 0x5bd81eac Mirror 5: 0x5bd81eac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a8ac: skipped 000811 1782630989.482222 write 0x0027bb thru 0x005c91 (0x34d7 bytes) 000812 1782630989.502146 read 0x00e45c thru 0x01d024 (0xebc9 bytes) 000813 1782630989.504899 trunc from 0x03a8ac to 0x00f51c (0x2b38f bytes) 000814 1782630989.510533 mapwrite 0x00a6cb thru 0x01a350 (0xfc86 bytes) 000817 1782630989.539856 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1a351): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a351): Mirror 3: 0x933f7401 (stale) Mirror 4: 0xc03062a7 (stale) Mirror 5: 0xc03062a7 (stale) CRC-32 checksum value for chunk [0, 0x1a351): Mirror 1: 0x69e5be8e Mirror 6: 0x69e5be8e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a351: skipped 000818 1782630989.771139 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a351): Mirror 4: 0xc03062a7 (stale) Mirror 5: 0xc03062a7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a351): Mirror 4: 0xc03062a7 (stale) Mirror 5: 0xc03062a7 (stale) CRC-32 checksum value for chunk [0, 0x1a351): Mirror 1: 0x69e5be8e Mirror 6: 0x69e5be8e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a351: skipped 000822 1782630989.939088 write 0x021cc1 thru 0x027351 (0x5691 bytes) 000823 1782630989.958080 trunc from 0x027352 to 0x030243 (0x8ef2 bytes) 000824 1782630989.969351 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x30244): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30244): Mirror 4: 0x8dee5137 (stale) Mirror 5: 0xcaf830dc (stale) Mirror 6: 0x11c93a5 (stale) CRC-32 checksum value for chunk [0, 0x30244): Mirror 1: 0xf7952480 Mirror 7: 0xf7952480 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30244: skipped 000825 1782630990.224129 trunc from 0x030244 to 0x017324 (0x18f1f bytes) 000828 1782630990.247211 mapwrite 0x03b530 thru 0x03ffff (0x4ad0 bytes) 000836 1782630990.273013 read 0x004768 thru 0x00fdbd (0xb656 bytes) 000838 1782630990.276175 mapread 0x0191e5 thru 0x01cb40 (0x395c bytes) 000839 1782630990.279275 read 0x0170b7 thru 0x021afc (0xaa46 bytes) 000840 1782630990.281116 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3a20ee56 (stale) Mirror 5: 0x9153cd05 (stale) Mirror 6: 0x81b1eb2b (stale) Mirror 7: 0xd8d6e49b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2b73f755 Mirror 8: 0x2b73f755 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000841 1782630990.515935 mapwrite 0x020102 thru 0x02269c (0x259b bytes) 000843 1782630990.569583 MIRROR_RESYNC 6 mirrors 000845 1782630990.828229 read 0x03d417 thru 0x03ed82 (0x196c bytes) 000846 1782630990.830121 write 0x039a15 thru 0x03ffff (0x65eb bytes) 000848 1782630990.848635 mapread 0x01f89f thru 0x0264fc (0x6c5e bytes) 000850 1782630990.856264 MIRROR_RESYNC 6 mirrors 000851 1782630991.098192 MIRROR_RESYNC 6 mirrors 000853 1782630991.235836 mapwrite 0x021c98 thru 0x02cacd (0xae36 bytes) 000854 1782630991.288080 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf19250bd (stale) Mirror 5: 0xf19250bd (stale) Mirror 6: 0xf19250bd (stale) Mirror 8: 0xf19250bd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf19250bd (stale) Mirror 5: 0xf19250bd (stale) Mirror 6: 0xf19250bd (stale) Mirror 8: 0xf19250bd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000855 1782630991.387175 trunc from 0x040000 to 0x006949 (0x396b6 bytes) 000856 1782630991.391450 mapread 0x0043c6 thru 0x006949 (0x2584 bytes) 000857 1782630991.396620 trunc from 0x00694a to 0x027382 (0x20a39 bytes) 000861 1782630991.401642 mapwrite 0x016b56 thru 0x01e900 (0x7dab bytes) 000862 1782630991.419457 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x27383): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27383): Mirror 4: 0x82fe89ec (stale) Mirror 5: 0x82fe89ec (stale) Mirror 6: 0x82fe89ec (stale) Mirror 8: 0x82fe89ec (stale) CRC-32 checksum value for chunk [0, 0x27383): Mirror 1: 0x389140fd Mirror 9: 0x389140fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27383: skipped 000863 1782630991.633406 mapread 0x01e7d5 thru 0x027382 (0x8bae bytes) 000864 1782630991.640383 mapwrite 0x00fbcf thru 0x018199 (0x85cb bytes) 000865 1782630991.697015 mapread 0x00900c thru 0x00d522 (0x4517 bytes) 000866 1782630991.697861 write 0x00762e thru 0x00cab4 (0x5487 bytes) 000867 1782630991.700406 write 0x012052 thru 0x020cc9 (0xec78 bytes) 000868 1782630991.701923 write 0x01191f thru 0x014bba (0x329c bytes) 000869 1782630991.703054 mapwrite 0x02184e thru 0x027c94 (0x6447 bytes) 000870 1782630991.730789 mapwrite 0x03185a thru 0x03e086 (0xc82d bytes) 000871 1782630991.756105 mapwrite 0x02a5b4 thru 0x0300b0 (0x5afd bytes) 000872 1782630991.770245 read 0x030f35 thru 0x03a09e (0x916a bytes) 000874 1782630991.771186 trunc from 0x03e087 to 0x0093f0 (0x34c96 bytes) 000875 1782630991.776506 read 0x002561 thru 0x0093f0 (0x6e90 bytes) 000876 1782630991.779175 write 0x03624f thru 0x038ddf (0x2b91 bytes) 000877 1782630991.779980 write 0x005290 thru 0x00599e (0x70f bytes) 000878 1782630991.782150 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x38de0): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38de0): Mirror 4: 0xff0fd5ca (stale) Mirror 5: 0xff0fd5ca (stale) Mirror 6: 0xff0fd5ca (stale) Mirror 8: 0xff0fd5ca (stale) Mirror 9: 0xa95c6ba5 (stale) CRC-32 checksum value for chunk [0, 0x38de0): Mirror 1: 0x851ef85f Mirror 10: 0x851ef85f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38de0: skipped 000880 1782630992.007380 write 0x03885f thru 0x03ffff (0x77a1 bytes) 000881 1782630992.028173 trunc from 0x040000 to 0x02f97e (0x10681 bytes) 000883 1782630992.038333 mapwrite 0x0227dd thru 0x028b93 (0x63b7 bytes) 000884 1782630992.056950 mapwrite 0x0044e8 thru 0x010c92 (0xc7ab bytes) 000885 1782630992.074175 trunc from 0x02f97f to 0x018282 (0x176fc bytes) 000886 1782630992.080316 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x18283): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18283): Mirror 4: 0x70684b7b (stale) Mirror 5: 0x70684b7b (stale) Mirror 6: 0x70684b7b (stale) Mirror 8: 0x70684b7b (stale) Mirror 9: 0x67dd9e4f (stale) Mirror 10: 0x3ac35649 (stale) CRC-32 checksum value for chunk [0, 0x18283): Mirror 1: 0x55697621 Mirror 11: 0x55697621 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18283: skipped 000888 1782630992.330224 MIRROR_RESYNC 8 mirrors 000889 1782630992.603433 write 0x01d7a3 thru 0x02aa39 (0xd297 bytes) 000890 1782630992.621367 read 0x0112e2 thru 0x0132d9 (0x1ff8 bytes) 000891 1782630992.623423 read 0x0132a0 thru 0x017eed (0x4c4e bytes) 000892 1782630992.626483 mapread 0x0009f7 thru 0x007346 (0x6950 bytes) 000894 1782630992.629287 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2aa3a): Mirror 4: 0x9c5669b7 (stale) Mirror 5: 0x9c5669b7 (stale) Mirror 8: 0x9c5669b7 (stale) Mirror 9: 0x9c5669b7 (stale) Mirror 10: 0x9c5669b7 (stale) Mirror 11: 0x9c5669b7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aa3a): Mirror 4: 0x9c5669b7 (stale) Mirror 5: 0x9c5669b7 (stale) Mirror 8: 0x9c5669b7 (stale) Mirror 9: 0x9c5669b7 (stale) Mirror 10: 0x9c5669b7 (stale) Mirror 11: 0x9c5669b7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aa3a: skipped 000896 1782630992.746890 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2aa3a): Mirror 4: 0x9c5669b7 (stale) Mirror 5: 0x9c5669b7 (stale) Mirror 8: 0x9c5669b7 (stale) Mirror 10: 0x9c5669b7 (stale) Mirror 11: 0x9c5669b7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aa3a): Mirror 4: 0x9c5669b7 (stale) Mirror 5: 0x9c5669b7 (stale) Mirror 8: 0x9c5669b7 (stale) Mirror 10: 0x9c5669b7 (stale) Mirror 11: 0x9c5669b7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aa3a: skipped 000897 1782630992.845735 write 0x0225d5 thru 0x02c135 (0x9b61 bytes) 000898 1782630992.847697 write 0x02ec46 thru 0x0317ed (0x2ba8 bytes) 000899 1782630992.849638 MIRROR_RESYNC 6 mirrors 000903 1782630993.102096 write 0x01dd99 thru 0x023895 (0x5afd bytes) 000905 1782630993.122206 write 0x023edc thru 0x027777 (0x389c bytes) 000906 1782630993.124149 trunc from 0x0317ee to 0x025b1f (0xbcce bytes) 000907 1782630993.130576 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25b20): Mirror 5: 0x5047428f (stale) Mirror 8: 0x5047428f (stale) Mirror 10: 0x5047428f (stale) Mirror 11: 0x5047428f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25b20): Mirror 5: 0x5047428f (stale) Mirror 8: 0x5047428f (stale) Mirror 10: 0x5047428f (stale) Mirror 11: 0x5047428f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25b20: skipped 000908 1782630993.235300 mapwrite 0x032945 thru 0x034399 (0x1a55 bytes) 000909 1782630993.260811 mapwrite 0x02c3d5 thru 0x033223 (0x6e4f bytes) 000911 1782630993.280176 write 0x00ba24 thru 0x0190a3 (0xd680 bytes) 000912 1782630993.284479 trunc from 0x03439a to 0x001d12 (0x32687 bytes) 000913 1782630993.289809 write 0x01e8c8 thru 0x0270b9 (0x87f2 bytes) 000916 1782630993.293204 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x270ba): Mirror 8: 0x6bb8ab90 (stale) Mirror 10: 0x6bb8ab90 (stale) Mirror 11: 0x6bb8ab90 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x270ba): Mirror 8: 0x6bb8ab90 (stale) Mirror 10: 0x6bb8ab90 (stale) Mirror 11: 0x6bb8ab90 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x270ba: skipped 000918 1782630993.389008 mapwrite 0x0030df thru 0x012526 (0xf448 bytes) 000920 1782630993.412753 mapread 0x02233b thru 0x0270b9 (0x4d7f bytes) 000921 1782630993.415958 mapwrite 0x002254 thru 0x010fbf (0xed6c bytes) 000922 1782630993.431878 read 0x0194fd thru 0x01ba8d (0x2591 bytes) 000923 1782630993.434019 mapwrite 0x01d28e thru 0x02247c (0x51ef bytes) 000924 1782630993.450628 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x270ba): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x270ba): Mirror 8: 0x6bb8ab90 (stale) Mirror 10: 0x6bb8ab90 (stale) Mirror 11: 0x6bb8ab90 (stale) CRC-32 checksum value for chunk [0, 0x270ba): Mirror 1: 0x635a18a6 Mirror 12: 0x635a18a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x270ba: skipped 000925 1782630993.660359 trunc from 0x0270ba to 0x03a144 (0x1308b bytes) 000926 1782630993.685052 trunc from 0x03a145 to 0x010566 (0x29bde bytes) 000928 1782630993.691264 write 0x03864a thru 0x03ffff (0x79b6 bytes) 000929 1782630993.692966 trunc from 0x040000 to 0x0261db (0x19e24 bytes) 000930 1782630993.697341 trunc from 0x0261dc to 0x015d34 (0x104a7 bytes) 000931 1782630993.702019 trunc from 0x015d35 to 0x00995b (0xc3d9 bytes) 000932 1782630993.706691 mapread 0x00760a thru 0x00995b (0x2352 bytes) 000934 1782630993.712993 mapread 0x00758b thru 0x00995b (0x23d1 bytes) 000937 1782630993.714479 write 0x00fec8 thru 0x01f9e2 (0xfb1b bytes) 000938 1782630993.715942 read 0x0060d5 thru 0x00c8c4 (0x67f0 bytes) 000939 1782630993.718849 read 0x0002f8 thru 0x00f9b9 (0xf6c2 bytes) 000940 1782630993.722529 MIRROR_RESYNC 5 mirrors 000943 1782630993.957106 trunc from 0x01f9e3 to 0x016458 (0x958a bytes) 000944 1782630993.980419 mapwrite 0x038121 thru 0x03ffff (0x7edf bytes) 000947 1782630994.005038 read 0x01bf89 thru 0x02ba7b (0xfaf3 bytes) 000949 1782630994.008451 mapread 0x0039f8 thru 0x004668 (0xc71 bytes) 000950 1782630994.011711 mapwrite 0x00a8dc thru 0x01778b (0xceb0 bytes) 000952 1782630994.029728 mapread 0x03b014 thru 0x03ffff (0x4fec bytes) 000954 1782630994.030965 write 0x010e4b thru 0x019e99 (0x904f bytes) 000955 1782630994.031811 read 0x003a33 thru 0x007860 (0x3e2e bytes) 000956 1782630994.032256 trunc from 0x040000 to 0x00976d (0x36892 bytes) 000957 1782630994.037389 mapwrite 0x026420 thru 0x02b65b (0x523c bytes) 000958 1782630994.057938 mapwrite 0x00cf75 thru 0x00fa48 (0x2ad4 bytes) 000959 1782630994.074028 mapwrite 0x000b52 thru 0x0047f4 (0x3ca3 bytes) 000960 1782630994.090114 MIRROR_RESYNC 5 mirrors 000961 1782630994.314006 trunc from 0x02b65c to 0x03219e (0x6b43 bytes) 000962 1782630994.336388 write 0x026b5a thru 0x0324d0 (0xb977 bytes) 000963 1782630994.339781 mapwrite 0x006464 thru 0x00d807 (0x73a4 bytes) 000964 1782630994.360962 trunc from 0x0324d1 to 0x02fced (0x27e3 bytes) 000965 1782630994.367223 write 0x038142 thru 0x03dd74 (0x5c33 bytes) 000968 1782630994.368899 read 0x022139 thru 0x03206c (0xff34 bytes) 000969 1782630994.371640 mapwrite 0x00a1f9 thru 0x019cff (0xfb07 bytes) 000972 1782630994.393532 trunc from 0x03dd75 to 0x0363c2 (0x79b2 bytes) 000974 1782630994.398925 read 0x018cd0 thru 0x01a9fb (0x1d2c bytes) 000977 1782630994.404109 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x612:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x363c3): Mirror 8: 0x42e2c20c (stale) Mirror 11: 0x42e2c20c (stale) Mirror 12: 0x42e2c20c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x363c3): Mirror 8: 0x42e2c20c (stale) Mirror 11: 0x42e2c20c (stale) Mirror 12: 0x42e2c20c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x363c3: skipped 000979 1782630994.496224 trunc from 0x0363c3 to 0x0364aa (0xe8 bytes) 000980 1782630994.500823 write 0x021cbe thru 0x02a580 (0x88c3 bytes) 000981 1782630994.504124 mapwrite 0x013b58 thru 0x019846 (0x5cef bytes) 000984 1782630994.525189 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x364ab): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x364ab): Mirror 8: 0x2016975a (stale) Mirror 11: 0x2016975a (stale) Mirror 12: 0x2016975a (stale) CRC-32 checksum value for chunk [0, 0x364ab): Mirror 1: 0x518b950d Mirror 13: 0x518b950d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x364ab: skipped 000985 1782630994.750866 mapwrite 0x03ccfc thru 0x03ffff (0x3304 bytes) 000987 1782630994.812767 trunc from 0x040000 to 0x032462 (0xdb9d bytes) 000988 1782630994.821125 mapread 0x0192f6 thru 0x01ca08 (0x3713 bytes) 000989 1782630994.825383 write 0x0377b0 thru 0x03e48c (0x6cdd bytes) 000990 1782630994.828465 MIRROR_RESYNC 5 mirrors 000993 1782630995.098060 write 0x03a1d1 thru 0x03ffff (0x5e2f bytes) 000995 1782630995.114974 read 0x02c01d thru 0x02e525 (0x2509 bytes) 000996 1782630995.116865 mapwrite 0x01ee2b thru 0x02b8f8 (0xcace bytes) 000997 1782630995.140176 mapwrite 0x017e9b thru 0x01b9f7 (0x3b5d bytes) 000998 1782630995.155790 MIRROR_RESYNC 5 mirrors 000999 1782630995.376081 trunc from 0x040000 to 0x037c4c (0x83b3 bytes) All operations completed A-OK!