== sanity-flr test 70a: flr mode fsx test ================ 13:14:49 (1787850889) Seed set to 891 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000011 1787850891.224675 write 0x024b6d thru 0x031995 (0xce29 bytes) truncating to largest ever: 0x2c57d 000012 1787850891.227507 trunc from 0x031996 to 0x02c57c (0x5419 bytes) 000015 1787850891.255832 write 0x007a84 thru 0x00df34 (0x64b1 bytes) 000017 1787850891.283802 mapwrite 0x001446 thru 0x00b9af (0xa56a bytes) 000018 1787850891.377886 read 0x01a7a3 thru 0x01a820 (0x7e bytes) truncating to largest ever: 0x2fb9f 000019 1787850891.384445 trunc from 0x02c57d to 0x02fb9e (0x3622 bytes) 000021 1787850891.400534 read 0x008336 thru 0x010158 (0x7e23 bytes) 000022 1787850891.402140 write 0x031803 thru 0x03713f (0x593d bytes) 000024 1787850891.406123 read 0x010b41 thru 0x012889 (0x1d49 bytes) 000025 1787850891.430983 read 0x017f9b thru 0x0215b3 (0x9619 bytes) 000027 1787850891.432464 mapread 0x01bdb5 thru 0x01e81b (0x2a67 bytes) 000028 1787850891.434707 mapwrite 0x019579 thru 0x024ec6 (0xb94e bytes) 000032 1787850891.512316 MIRROR_EXTEND to 2 mirrors 000033 1787850892.345409 mapread 0x00eb82 thru 0x01bb98 (0xd017 bytes) truncating to largest ever: 0x2fd06 000034 1787850892.404285 trunc from 0x037140 to 0x02fd05 (0x743a bytes) 000035 1787850892.632903 write 0x019b08 thru 0x0250d3 (0xb5cc bytes) 000036 1787850892.651626 read 0x0215d2 thru 0x02e61f (0xd04e bytes) 000037 1787850892.679965 mapwrite 0x031eb0 thru 0x03ffff (0xe150 bytes) 000038 1787850892.861142 mapread 0x03a531 thru 0x03ffff (0x5acf bytes) 000039 1787850892.869407 read 0x017e52 thru 0x01b4bf (0x366e bytes) 000040 1787850892.893139 mapread 0x0282ea thru 0x02c54f (0x4266 bytes) 000041 1787850892.894149 mapread 0x033121 thru 0x0336a2 (0x582 bytes) 000042 1787850892.901553 mapread 0x033df2 thru 0x03866f (0x487e bytes) 000047 1787850892.908681 write 0x0007ea thru 0x00dd64 (0xd57b bytes) 000051 1787850892.920729 mapwrite 0x00ddc5 thru 0x010971 (0x2bad bytes) 000052 1787850892.990114 read 0x0133fb thru 0x014b13 (0x1719 bytes) 000053 1787850892.991188 read 0x004de0 thru 0x011763 (0xc984 bytes) 000054 1787850892.998467 trunc from 0x040000 to 0x022f75 (0x1d08a bytes) 000056 1787850893.052351 trunc from 0x022f76 to 0x018ed4 (0xa0a1 bytes) 000057 1787850893.085092 mapread 0x0173f9 thru 0x01864d (0x1255 bytes) 000058 1787850893.086469 mapwrite 0x01fec1 thru 0x0280fa (0x823a bytes) 000059 1787850893.239490 mapread 0x0169e8 thru 0x022ff5 (0xc60e bytes) 000061 1787850893.249087 mapwrite 0x0178f9 thru 0x01b3e2 (0x3aea bytes) 000062 1787850893.303497 read 0x00f9e5 thru 0x01bfae (0xc5ca bytes) 000063 1787850893.304194 mapwrite 0x030eec thru 0x03bc31 (0xad46 bytes) 000064 1787850893.476056 mapwrite 0x013512 thru 0x01c8b5 (0x93a4 bytes) truncating to largest ever: 0x36470 000065 1787850893.530915 trunc from 0x03bc32 to 0x03646f (0x57c2 bytes) 000066 1787850893.583694 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) 000068 1787850893.750495 read 0x008990 thru 0x00ce0c (0x447d bytes) 000071 1787850893.770852 mapread 0x020f28 thru 0x024889 (0x3962 bytes) 000072 1787850893.806646 mapread 0x009225 thru 0x00b945 (0x2721 bytes) 000074 1787850893.825592 MIRROR_EXTEND to 2 mirrors 000075 1787850894.486386 mapwrite 0x035886 thru 0x03ffff (0xa77a bytes) 000076 1787850894.625706 trunc from 0x040000 to 0x02ea0a (0x115f5 bytes) 000079 1787850894.650459 mapread 0x02d6c8 thru 0x02ea0a (0x1343 bytes) 000080 1787850894.663320 trunc from 0x02ea0b to 0x010131 (0x1e8d9 bytes) 000081 1787850894.680664 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x10132): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10132): Mirror 2: 0xf250a470 (stale) CRC-32 checksum value for chunk [0, 0x10132): Mirror 1: 0xf250a470 Mirror 3: 0xf250a470 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10132: skipped 000082 1787850895.683533 mapwrite 0x009170 thru 0x0100c8 (0x6f59 bytes) 000083 1787850895.904251 read 0x003184 thru 0x010131 (0xcfae bytes) 000084 1787850895.906821 read 0x008ecb thru 0x010131 (0x7267 bytes) 000085 1787850895.907953 mapread 0x00bb29 thru 0x00d115 (0x15ed bytes) 000086 1787850895.908736 trunc from 0x010132 to 0x012a6b (0x293a bytes) truncating to largest ever: 0x3bdcd 000090 1787850895.955063 trunc from 0x012a6c to 0x03bdcc (0x29361 bytes) 000091 1787850895.989410 mapread 0x034e55 thru 0x0368af (0x1a5b bytes) 000093 1787850896.016140 write 0x0273a4 thru 0x036a4b (0xf6a8 bytes) 000094 1787850896.021278 write 0x02deba thru 0x02f2af (0x13f6 bytes) 000095 1787850896.022391 write 0x019628 thru 0x023d41 (0xa71a bytes) 000096 1787850896.026347 mapread 0x00d541 thru 0x019232 (0xbcf2 bytes) 000097 1787850896.037927 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bdcd): Mirror 2: 0xf7f40163 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bdcd): Mirror 2: 0xf7f40163 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bdcd: skipped 000100 1787850896.482581 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3bdcd): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bdcd): Mirror 2: 0xf7f40163 (stale) CRC-32 checksum value for chunk [0, 0x3bdcd): Mirror 1: 0xc687f31a Mirror 3: 0xc687f31a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bdcd: skipped 000101 1787850897.432300 trunc from 0x03bdcd to 0x00031a (0x3bab2 bytes) 000102 1787850897.526448 trunc from 0x00031b to 0x02f277 (0x2ef5d bytes) 000103 1787850897.567007 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2f278): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f278): Mirror 2: 0x804b0a80 (stale) Mirror 3: 0x94a44af1 (stale) CRC-32 checksum value for chunk [0, 0x2f278): Mirror 1: 0xab219e79 Mirror 4: 0xab219e79 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f278: skipped 000104 1787850898.667533 read 0x02546a thru 0x02d03a (0x7bd1 bytes) 000105 1787850898.678963 trunc from 0x02f278 to 0x016864 (0x18a13 bytes) 000110 1787850898.826613 write 0x0389af thru 0x03ffff (0x7651 bytes) 000112 1787850898.844968 trunc from 0x040000 to 0x00cf18 (0x330e7 bytes) 000114 1787850898.895573 write 0x01b665 thru 0x022e15 (0x77b1 bytes) 000117 1787850898.901420 trunc from 0x022e16 to 0x001e83 (0x20f92 bytes) 000119 1787850898.925900 MIRROR_RESYNC 4 mirrors 000120 1787850899.908556 write 0x0208d8 thru 0x02f949 (0xf072 bytes) 000122 1787850899.982564 read 0x029860 thru 0x02f892 (0x6033 bytes) 000125 1787850899.984580 write 0x02f423 thru 0x03068e (0x126c bytes) 000127 1787850899.987339 write 0x039acd thru 0x03ffff (0x6533 bytes) 000128 1787850899.988576 write 0x0336ac thru 0x03ffff (0xc954 bytes) 000129 1787850899.998741 mapread 0x006063 thru 0x0153f0 (0xf38e bytes) 000130 1787850900.022024 trunc from 0x040000 to 0x00dfbc (0x32043 bytes) 000132 1787850900.038949 read 0x004bfd thru 0x00bc4f (0x7053 bytes) 000133 1787850900.039613 mapwrite 0x02f27a thru 0x0339d6 (0x475d bytes) 000134 1787850900.129332 write 0x02e076 thru 0x033ca6 (0x5c31 bytes) 000135 1787850900.130585 write 0x017e10 thru 0x019486 (0x1677 bytes) 000136 1787850900.133561 mapread 0x0134fa thru 0x014d94 (0x189b bytes) 000137 1787850900.134888 trunc from 0x033ca7 to 0x02e602 (0x56a4 bytes) 000138 1787850900.156488 mapread 0x02b9fb thru 0x02e602 (0x2c08 bytes) 000139 1787850900.158482 trunc from 0x02e603 to 0x01ba99 (0x12b69 bytes) 000141 1787850900.186176 trunc from 0x01ba9a to 0x013618 (0x8481 bytes) 000143 1787850900.207478 write 0x03d7dd thru 0x03ffff (0x2823 bytes) 000145 1787850900.214398 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 3: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 3: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000146 1787850900.558709 trunc from 0x040000 to 0x014b85 (0x2b47a bytes) 000147 1787850900.589131 MIRROR_RESYNC 3 mirrors 000149 1787850901.786134 mapwrite 0x0079bd thru 0x015db8 (0xe3fc bytes) 000150 1787850902.077975 trunc from 0x015db9 to 0x020ea2 (0xb0ea bytes) 000151 1787850902.111721 write 0x00a1f9 thru 0x00e110 (0x3f18 bytes) 000152 1787850902.117760 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20ea3): Mirror 3: 0x3f0ca0f3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20ea3): Mirror 3: 0x3f0ca0f3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20ea3: skipped 000154 1787850902.474534 mapwrite 0x009d84 thru 0x016f49 (0xd1c6 bytes) 000155 1787850902.559637 read 0x000dc6 thru 0x00a074 (0x92af bytes) 000156 1787850902.565070 trunc from 0x020ea3 to 0x028367 (0x74c5 bytes) 000157 1787850902.585338 mapread 0x01f9dd thru 0x028367 (0x898b bytes) 000158 1787850902.599764 write 0x002a0a thru 0x00db7f (0xb176 bytes) 000159 1787850902.601470 trunc from 0x028368 to 0x00c2e7 (0x1c080 bytes) 000160 1787850902.616728 mapwrite 0x009390 thru 0x010c6a (0x78db bytes) 000161 1787850902.688644 mapwrite 0x02a780 thru 0x038f56 (0xe7d7 bytes) 000163 1787850902.796533 write 0x0073e7 thru 0x00d12b (0x5d45 bytes) 000164 1787850902.799913 mapwrite 0x0179a9 thru 0x0226e2 (0xad3a bytes) 000165 1787850902.889323 write 0x01997e thru 0x021f30 (0x85b3 bytes) 000166 1787850902.922358 read 0x011db0 thru 0x01663b (0x488c bytes) 000167 1787850902.923148 trunc from 0x038f57 to 0x01e0c8 (0x1ae8e bytes) 000168 1787850902.945887 mapread 0x010e91 thru 0x01deef (0xd05f bytes) 000169 1787850902.948280 mapwrite 0x03ec3f thru 0x03ffff (0x13c1 bytes) 000174 1787850903.058951 mapread 0x02c64a thru 0x03540f (0x8dc6 bytes) 000176 1787850903.066557 mapwrite 0x030ea4 thru 0x03b93a (0xaa97 bytes) 000177 1787850903.131864 trunc from 0x040000 to 0x02a1d0 (0x15e2f bytes) 000178 1787850903.147770 read 0x026e9c thru 0x02a1d0 (0x3335 bytes) 000181 1787850903.149388 mapread 0x01d88b thru 0x02a1d0 (0xc946 bytes) 000182 1787850903.151393 mapread 0x00cb7d thru 0x00fc28 (0x30ac bytes) 000183 1787850903.152346 mapwrite 0x0341b5 thru 0x03cdf9 (0x8c45 bytes) 000185 1787850903.229064 mapread 0x00dca7 thru 0x01a0ce (0xc428 bytes) 000186 1787850903.231065 write 0x038721 thru 0x03ffff (0x78df bytes) 000187 1787850903.232687 mapwrite 0x0311a0 thru 0x039a27 (0x8888 bytes) 000188 1787850903.284316 trunc from 0x040000 to 0x036052 (0x9fad bytes) 000189 1787850903.316084 write 0x01497c thru 0x014b61 (0x1e6 bytes) 000190 1787850903.317136 mapwrite 0x014b5a thru 0x01661d (0x1ac4 bytes) 000192 1787850903.392563 mapwrite 0x002193 thru 0x00ea74 (0xc8e2 bytes) 000193 1787850903.445942 trunc from 0x036053 to 0x02d10e (0x8f44 bytes) 000194 1787850903.476536 mapwrite 0x03c020 thru 0x03ffff (0x3fe0 bytes) 000195 1787850903.542478 mapread 0x006faf thru 0x00f8e2 (0x8934 bytes) 000196 1787850903.543400 mapwrite 0x00c2f7 thru 0x013f73 (0x7c7d bytes) 000198 1787850903.610454 read 0x02cd60 thru 0x039e6b (0xd10c bytes) 000199 1787850903.620710 mapwrite 0x02a469 thru 0x031a3b (0x75d3 bytes) 000201 1787850903.675897 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb6582064 Mirror 4: 0xb6582064 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000205 1787850904.616754 trunc from 0x040000 to 0x017091 (0x28f6e bytes) 000206 1787850904.711203 mapwrite 0x00446e thru 0x0126d0 (0xe263 bytes) 000207 1787850904.872324 read 0x013cf5 thru 0x017091 (0x339d bytes) 000208 1787850904.875871 mapread 0x015868 thru 0x017091 (0x182a bytes) 000210 1787850904.890766 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17092): Mirror 4: 0x4c0c5b63 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17092): Mirror 4: 0x4c0c5b63 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17092: skipped 000211 1787850905.262035 read 0x002511 thru 0x002605 (0xf5 bytes) 000213 1787850905.270149 trunc from 0x017092 to 0x002438 (0x14c59 bytes) 000214 1787850905.290285 read 0x0007c9 thru 0x002438 (0x1c70 bytes) 000215 1787850905.294783 mapread 0x0005b3 thru 0x002438 (0x1e86 bytes) 000218 1787850905.297676 write 0x00c8f0 thru 0x011841 (0x4f52 bytes) 000219 1787850905.298892 mapwrite 0x0100d4 thru 0x012367 (0x2294 bytes) 000221 1787850905.373316 write 0x0258ef thru 0x0344f2 (0xec04 bytes) 000222 1787850905.381715 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) 000225 1787850905.521792 write 0x03c2d1 thru 0x03ffff (0x3d2f bytes) 000228 1787850905.525140 trunc from 0x040000 to 0x0199c6 (0x26639 bytes) 000230 1787850905.543074 mapread 0x006980 thru 0x009d33 (0x33b4 bytes) 000238 1787850905.567083 write 0x03ebc1 thru 0x03ffff (0x143f bytes) 000245 1787850905.574802 read 0x002598 thru 0x00cb97 (0xa600 bytes) 000246 1787850905.575692 mapwrite 0x03e210 thru 0x03ffff (0x1df0 bytes) 000250 1787850905.617982 write 0x0139f0 thru 0x0161ea (0x27fb bytes) 000251 1787850905.637664 write 0x020172 thru 0x027fff (0x7e8e bytes) 000255 1787850905.650090 read 0x03a591 thru 0x03ffff (0x5a6f bytes) 000256 1787850905.674175 mapread 0x0149fd thru 0x023e33 (0xf437 bytes) 000257 1787850905.678057 mapread 0x01d43f thru 0x02d13f (0xfd01 bytes) 000260 1787850905.691524 MIRROR_EXTEND to 2 mirrors 000262 1787850906.506950 MIRROR_RESYNC 2 mirrors 000264 1787850906.869840 MIRROR_EXTEND to 3 mirrors 000265 1787850907.544200 trunc from 0x040000 to 0x038106 (0x7ef9 bytes) 000267 1787850907.653623 mapread 0x01b7d0 thru 0x01bd68 (0x599 bytes) 000268 1787850907.665459 read 0x008d13 thru 0x01024f (0x753d bytes) 000269 1787850907.692087 mapread 0x0095ae thru 0x016a57 (0xd4aa bytes) 000270 1787850907.710089 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38107): Mirror 3: 0x8e87871f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38107): Mirror 3: 0x8e87871f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38107: skipped 000271 1787850908.104032 read 0x0171e0 thru 0x01a992 (0x37b3 bytes) 000272 1787850908.111820 mapread 0x031747 thru 0x03321c (0x1ad6 bytes) 000273 1787850908.173324 trunc from 0x038107 to 0x001ead (0x36259 bytes) 000274 1787850908.211388 read 0x00017b thru 0x001ead (0x1d33 bytes) 000277 1787850908.228016 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) 000278 1787850908.461557 mapread 0x001d8d thru 0x001ead (0x121 bytes) 000279 1787850908.471383 mapread 0x001bc3 thru 0x001ead (0x2eb bytes) 000287 1787850908.482600 write 0x039c83 thru 0x03ffff (0x637d bytes) 000290 1787850908.491263 read 0x00b434 thru 0x010c81 (0x584e bytes) 000291 1787850908.515696 trunc from 0x040000 to 0x006d34 (0x392cb bytes) 000294 1787850908.539404 trunc from 0x006d35 to 0x015ab8 (0xed84 bytes) 000295 1787850908.561810 mapwrite 0x03410c thru 0x03ffff (0xbef4 bytes) 000296 1787850908.677133 trunc from 0x040000 to 0x0385e3 (0x7a1c bytes) 000298 1787850908.716597 mapwrite 0x014f98 thru 0x02241f (0xd488 bytes) 000299 1787850908.828667 write 0x0166ac thru 0x021996 (0xb2eb bytes) 000300 1787850908.831433 mapwrite 0x01ac0f thru 0x02338a (0x877c bytes) 000302 1787850908.900130 MIRROR_EXTEND to 2 mirrors 000304 1787850909.562819 read 0x0319bc thru 0x032c4b (0x1290 bytes) 000305 1787850909.569840 mapread 0x0245c4 thru 0x03325b (0xec98 bytes) 000309 1787850909.603156 trunc from 0x0385e4 to 0x03281f (0x5dc4 bytes) 000311 1787850909.705989 read 0x00bc03 thru 0x01a8f1 (0xecef bytes) 000312 1787850909.720509 mapwrite 0x0150ae thru 0x022b37 (0xda8a bytes) 000313 1787850909.797166 mapread 0x0033c7 thru 0x008f9f (0x5bd9 bytes) 000314 1787850909.801508 trunc from 0x032820 to 0x02a3da (0x8445 bytes) 000315 1787850909.844764 write 0x020a76 thru 0x022430 (0x19bb bytes) 000316 1787850909.847792 mapwrite 0x0267e9 thru 0x034e18 (0xe630 bytes) 000317 1787850910.009767 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x34e19): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34e19): Mirror 2: 0x95269d3f (stale) CRC-32 checksum value for chunk [0, 0x34e19): Mirror 1: 0xb0010f9f Mirror 3: 0xb0010f9f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34e19: skipped 000321 1787850910.990900 write 0x005558 thru 0x009c82 (0x472b bytes) 000322 1787850911.131645 mapread 0x03226e thru 0x034e18 (0x2bab bytes) 000323 1787850911.176797 read 0x017bb5 thru 0x023c07 (0xc053 bytes) 000324 1787850911.209987 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x34e19): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34e19): Mirror 2: 0x95269d3f (stale) Mirror 3: 0xb0010f9f (stale) CRC-32 checksum value for chunk [0, 0x34e19): Mirror 1: 0x84523582 Mirror 4: 0x84523582 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34e19: skipped 000325 1787850912.344975 read 0x00e041 thru 0x011bdf (0x3b9f bytes) 000327 1787850912.357071 read 0x0255e9 thru 0x0269af (0x13c7 bytes) 000328 1787850912.376053 mapwrite 0x00f327 thru 0x01ca82 (0xd75c bytes) 000330 1787850912.678398 trunc from 0x034e19 to 0x002e57 (0x31fc1 bytes) 000333 1787850912.758194 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e58): Mirror 3: 0xd120a575 (stale) Mirror 4: 0xd120a575 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e58): Mirror 3: 0xd120a575 (stale) Mirror 4: 0xd120a575 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e58: skipped 000335 1787850913.220879 mapread 0x001719 thru 0x002e57 (0x173f bytes) 000336 1787850913.236636 read 0x000307 thru 0x002e57 (0x2b51 bytes) 000337 1787850913.246526 read 0x000c21 thru 0x002e57 (0x2237 bytes) 000338 1787850913.248349 write 0x022759 thru 0x02d47c (0xad24 bytes) 000340 1787850913.252260 write 0x03c24b thru 0x03d8b2 (0x1668 bytes) 000341 1787850913.254339 trunc from 0x03d8b3 to 0x014800 (0x290b2 bytes) 000343 1787850913.286736 mapwrite 0x028d62 thru 0x038565 (0xf804 bytes) 000344 1787850913.437188 write 0x037271 thru 0x03ffff (0x8d8f bytes) 000346 1787850913.439025 mapread 0x02cb64 thru 0x03b915 (0xedb2 bytes) 000347 1787850913.442534 mapread 0x010afd thru 0x014e24 (0x4328 bytes) 000348 1787850913.444107 mapread 0x029524 thru 0x02af72 (0x1a4f bytes) 000350 1787850913.448551 trunc from 0x040000 to 0x01db80 (0x2247f bytes) 000351 1787850913.470556 mapwrite 0x036f36 thru 0x03dba8 (0x6c73 bytes) 000358 1787850913.559341 mapwrite 0x00ed40 thru 0x01da66 (0xed27 bytes) 000361 1787850913.665641 read 0x038954 thru 0x03aa4c (0x20f9 bytes) 000363 1787850913.668894 mapread 0x02aed3 thru 0x031113 (0x6241 bytes) 000365 1787850913.716652 trunc from 0x03dba9 to 0x00c248 (0x31960 bytes) 000367 1787850913.748498 mapread 0x004755 thru 0x00c248 (0x7af4 bytes) 000368 1787850913.749613 mapread 0x00070c thru 0x004921 (0x4216 bytes) 000370 1787850913.752186 mapwrite 0x0067b8 thru 0x00de15 (0x765e bytes) 000372 1787850913.910799 mapwrite 0x029abe thru 0x0381d0 (0xe713 bytes) 000373 1787850914.140701 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x381d1): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x381d1): Mirror 3: 0xa0c8d655 (stale) Mirror 4: 0xdb4061cf (stale) CRC-32 checksum value for chunk [0, 0x381d1): Mirror 1: 0x33ffc8a2 Mirror 5: 0x33ffc8a2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x381d1: skipped 000375 1787850915.496657 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x381d1): Mirror 4: 0xdb4061cf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x381d1): Mirror 4: 0xdb4061cf (stale) CRC-32 checksum value for chunk [0, 0x381d1): Mirror 1: 0x33ffc8a2 Mirror 5: 0x33ffc8a2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x381d1: skipped 000376 1787850916.098022 trunc from 0x0381d1 to 0x0171bc (0x21014 bytes) 000377 1787850916.285361 mapwrite 0x01b780 thru 0x01ed85 (0x3606 bytes) 000378 1787850916.432117 write 0x018c9f thru 0x019137 (0x499 bytes) 000379 1787850916.433253 write 0x0266ed thru 0x02bdab (0x56bf bytes) 000380 1787850916.444294 write 0x030e66 thru 0x03d60b (0xc7a6 bytes) 000382 1787850916.457951 mapread 0x00c1d0 thru 0x0175c5 (0xb3f6 bytes) 000384 1787850916.499932 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d60c): Mirror 5: 0x2b6f64d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d60c): Mirror 5: 0x2b6f64d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d60c: skipped 000388 1787850916.942715 write 0x034a65 thru 0x03bceb (0x7287 bytes) 000391 1787850916.959793 mapread 0x01c602 thru 0x01e350 (0x1d4f bytes) 000393 1787850916.990574 read 0x015a88 thru 0x017c19 (0x2192 bytes) truncating to largest ever: 0x3fb5d 000394 1787850917.006972 trunc from 0x03d60c to 0x03fb5c (0x2551 bytes) 000395 1787850917.048476 trunc from 0x03fb5d to 0x034a16 (0xb146 bytes) 000397 1787850917.080512 read 0x0138f7 thru 0x015d96 (0x24a0 bytes) 000399 1787850917.092145 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) 000400 1787850917.307250 mapread 0x033539 thru 0x034a16 (0x14de bytes) 000401 1787850917.322573 read 0x024098 thru 0x02913e (0x50a7 bytes) 000404 1787850917.337133 mapread 0x02f2df thru 0x031bda (0x28fc bytes) 000405 1787850917.346418 write 0x01672e thru 0x0174e4 (0xdb7 bytes) 000409 1787850917.356163 read 0x01b3b5 thru 0x020c9e (0x58ea bytes) 000411 1787850917.369820 trunc from 0x034a17 to 0x0197d4 (0x1b242 bytes) 000416 1787850917.395928 trunc from 0x0197d5 to 0x0046e0 (0x150f4 bytes) 000418 1787850917.412507 mapwrite 0x00ddf9 thru 0x0146a8 (0x68b0 bytes) 000419 1787850917.496402 mapread 0x00b3e3 thru 0x00dee1 (0x2aff bytes) 000420 1787850917.508506 MIRROR_EXTEND to 2 mirrors 000422 1787850918.088401 trunc from 0x0146a9 to 0x027a06 (0x1335e bytes) 000423 1787850918.260762 trunc from 0x027a07 to 0x039a62 (0x1205c bytes) 000424 1787850918.284765 mapread 0x003aef thru 0x00433d (0x84f bytes) 000425 1787850918.307080 read 0x028789 thru 0x02a525 (0x1d9d bytes) 000426 1787850918.320112 mapwrite 0x0252bf thru 0x02c669 (0x73ab bytes) 000429 1787850918.395719 mapread 0x000a8c thru 0x003a39 (0x2fae bytes) 000430 1787850918.405760 MIRROR_RESYNC 2 mirrors 000431 1787850919.405402 mapread 0x035fbc thru 0x039a62 (0x3aa7 bytes) 000433 1787850919.436502 MIRROR_EXTEND to 3 mirrors 000434 1787850920.535448 mapread 0x02206f thru 0x022322 (0x2b4 bytes) 000436 1787850920.549420 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) 000437 1787850920.957729 trunc from 0x039a63 to 0x0168e2 (0x23180 bytes) 000439 1787850921.056464 write 0x03a528 thru 0x03ea7a (0x4553 bytes) 000440 1787850921.058609 mapwrite 0x001b3c thru 0x00dbf9 (0xc0be bytes) 000443 1787850921.124159 write 0x001a51 thru 0x00e612 (0xcbc2 bytes) 000444 1787850921.126527 trunc from 0x03ea7b to 0x03dfe4 (0xa96 bytes) 000447 1787850921.155752 write 0x00b628 thru 0x011dde (0x67b7 bytes) 000448 1787850921.164930 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) 000451 1787850921.333706 write 0x03c74c thru 0x03ffff (0x38b4 bytes) 000452 1787850921.339959 trunc from 0x040000 to 0x00ad6c (0x35293 bytes) 000454 1787850921.359564 mapwrite 0x0141f3 thru 0x018e63 (0x4c71 bytes) 000456 1787850921.454657 mapwrite 0x03dece thru 0x03ffff (0x2132 bytes) 000459 1787850921.537196 mapread 0x013013 thru 0x017a72 (0x4a60 bytes) 000461 1787850921.540789 write 0x00b430 thru 0x00ddb1 (0x2982 bytes) 000462 1787850921.554658 mapwrite 0x013796 thru 0x017193 (0x39fe bytes) 000463 1787850921.613901 mapread 0x016f61 thru 0x0241c4 (0xd264 bytes) 000465 1787850921.644361 mapwrite 0x038ed9 thru 0x03ffff (0x7127 bytes) 000466 1787850921.686624 trunc from 0x040000 to 0x03eca8 (0x1357 bytes) 000468 1787850921.699498 mapread 0x03673c thru 0x03eca8 (0x856d bytes) 000470 1787850921.703443 write 0x03b01b thru 0x03ffff (0x4fe5 bytes) 000472 1787850921.705780 trunc from 0x040000 to 0x0161a2 (0x29e5d bytes) 000473 1787850921.728546 read 0x008ba4 thru 0x0126aa (0x9b07 bytes) 000474 1787850921.738009 read 0x00e651 thru 0x00f1e1 (0xb91 bytes) 000475 1787850921.738754 mapread 0x00b30e thru 0x013584 (0x8277 bytes) 000476 1787850921.740785 write 0x033f9c thru 0x036429 (0x248e bytes) 000479 1787850921.743153 mapread 0x00aab1 thru 0x00c628 (0x1b78 bytes) 000480 1787850921.744288 write 0x00c02d thru 0x010b10 (0x4ae4 bytes) 000481 1787850921.745777 mapwrite 0x003c5a thru 0x0071e9 (0x3590 bytes) 000482 1787850921.805800 mapwrite 0x025a1b thru 0x02c8ba (0x6ea0 bytes) 000485 1787850921.911633 mapwrite 0x025292 thru 0x029327 (0x4096 bytes) 000486 1787850921.958176 write 0x03c8e6 thru 0x03ffff (0x371a bytes) 000492 1787850921.963863 trunc from 0x040000 to 0x008231 (0x37dce bytes) 000495 1787850921.993519 mapread 0x00474e thru 0x008231 (0x3ae4 bytes) 000496 1787850921.995558 trunc from 0x008232 to 0x00e483 (0x6252 bytes) 000501 1787850922.017397 mapread 0x00a681 thru 0x00e483 (0x3e03 bytes) 000502 1787850922.042871 mapwrite 0x002033 thru 0x004cb7 (0x2c85 bytes) 000504 1787850922.075877 read 0x0069d5 thru 0x00e483 (0x7aaf bytes) 000506 1787850922.085357 MIRROR_EXTEND to 2 mirrors 000507 1787850922.916070 mapread 0x001397 thru 0x006153 (0x4dbd bytes) 000510 1787850922.963418 write 0x0080e5 thru 0x00c0e0 (0x3ffc bytes) 000512 1787850923.122947 read 0x00916e thru 0x00a4d1 (0x1364 bytes) 000513 1787850923.131185 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) 000515 1787850923.358113 write 0x030907 thru 0x0376b7 (0x6db1 bytes) 000517 1787850923.361956 trunc from 0x0376b8 to 0x03cc45 (0x558e bytes) 000518 1787850923.409285 mapread 0x014622 thru 0x01712a (0x2b09 bytes) 000520 1787850923.428357 mapwrite 0x00ee2d thru 0x01dc79 (0xee4d bytes) 000521 1787850923.509608 read 0x024744 thru 0x02f938 (0xb1f5 bytes) 000522 1787850923.522150 mapread 0x009c86 thru 0x010fdb (0x7356 bytes) 000523 1787850923.530117 mapwrite 0x02202d thru 0x02a2be (0x8292 bytes) 000525 1787850923.681328 trunc from 0x03cc46 to 0x0360a1 (0x6ba4 bytes) 000526 1787850923.741472 read 0x00033b thru 0x0042b4 (0x3f7a bytes) 000527 1787850923.771329 mapread 0x02d9f8 thru 0x0360a1 (0x86aa bytes) 000528 1787850923.772311 mapwrite 0x028de9 thru 0x02f6d5 (0x68ed bytes) 000529 1787850923.921912 trunc from 0x0360a2 to 0x01c179 (0x19f28 bytes) 000530 1787850923.954338 write 0x02b58a thru 0x037c00 (0xc677 bytes) 000533 1787850923.960738 mapread 0x0241a7 thru 0x031ef1 (0xdd4b bytes) 000535 1787850924.008442 trunc from 0x037c01 to 0x00ed30 (0x28ed0 bytes) 000536 1787850924.041050 mapread 0x0033e6 thru 0x003612 (0x22d bytes) 000538 1787850924.044888 mapwrite 0x030e71 thru 0x0323d4 (0x1564 bytes) 000539 1787850924.211195 mapread 0x025a85 thru 0x0323d4 (0xc950 bytes) 000540 1787850924.321439 mapwrite 0x0314f1 thru 0x036bcb (0x56db bytes) 000544 1787850924.443757 mapread 0x011a02 thru 0x017370 (0x596f bytes) 000546 1787850924.517741 mapwrite 0x037284 thru 0x03ffff (0x8d7c bytes) 000547 1787850924.697430 read 0x025b1e thru 0x02953a (0x3a1d bytes) 000549 1787850924.700751 mapwrite 0x01e4e3 thru 0x02920c (0xad2a bytes) 000550 1787850924.815087 mapread 0x01a719 thru 0x01dd2b (0x3613 bytes) 000551 1787850924.816010 mapread 0x01c413 thru 0x029b17 (0xd705 bytes) 000552 1787850924.831393 MIRROR_EXTEND to 2 mirrors 000553 1787850925.785515 mapread 0x01674a thru 0x0180f0 (0x19a7 bytes) 000554 1787850925.813370 read 0x021b41 thru 0x02e766 (0xcc26 bytes) 000555 1787850925.828691 MIRROR_RESYNC 2 mirrors 000557 1787850926.342031 mapwrite 0x0364b4 thru 0x036b55 (0x6a2 bytes) 000562 1787850926.601671 trunc from 0x040000 to 0x009405 (0x36bfa bytes) 000564 1787850926.643620 read 0x002ef9 thru 0x009405 (0x650d bytes) 000565 1787850926.669444 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x9406): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9406): Mirror 2: 0x7c2b4596 (stale) CRC-32 checksum value for chunk [0, 0x9406): Mirror 1: 0x7c2b4596 Mirror 3: 0x7c2b4596 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9406: skipped 000566 1787850927.848265 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x9406): Mirror 2: 0x7c2b4596 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9406): Mirror 2: 0x7c2b4596 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9406: skipped 000568 1787850928.352823 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) 000570 1787850928.651525 mapwrite 0x017f04 thru 0x01da2e (0x5b2b bytes) 000571 1787850928.872049 mapread 0x009027 thru 0x009938 (0x912 bytes) 000572 1787850928.891399 mapwrite 0x036b78 thru 0x03fffc (0x9485 bytes) 000573 1787850929.064507 write 0x006088 thru 0x00f6d8 (0x9651 bytes) 000576 1787850929.068396 mapwrite 0x03abe6 thru 0x03ffff (0x541a bytes) 000577 1787850929.154945 trunc from 0x040000 to 0x031084 (0xef7b bytes) 000580 1787850929.190132 trunc from 0x031085 to 0x00e0df (0x22fa5 bytes) 000581 1787850929.212280 trunc from 0x00e0e0 to 0x006ae1 (0x75fe bytes) 000584 1787850929.247649 mapwrite 0x02ba82 thru 0x033457 (0x79d6 bytes) 000587 1787850929.332611 mapread 0x008de3 thru 0x0108ee (0x7b0c bytes) 000588 1787850929.343804 trunc from 0x033458 to 0x006343 (0x2d114 bytes) 000589 1787850929.408915 write 0x036471 thru 0x03ffff (0x9b8f bytes) 000590 1787850929.410342 read 0x00c457 thru 0x00dd52 (0x18fc bytes) 000591 1787850929.430017 mapwrite 0x008397 thru 0x00d599 (0x5203 bytes) 000592 1787850929.528673 mapread 0x030250 thru 0x036fcd (0x6d7e bytes) 000595 1787850929.559922 mapwrite 0x000842 thru 0x008d62 (0x8521 bytes) 000601 1787850929.699905 mapread 0x02dd89 thru 0x0312a2 (0x351a bytes) 000605 1787850929.707811 mapread 0x02d018 thru 0x03c6f6 (0xf6df bytes) 000608 1787850929.716799 mapwrite 0x0331db thru 0x03f313 (0xc139 bytes) 000609 1787850929.792499 write 0x022d3f thru 0x02f30c (0xc5ce bytes) 000613 1787850929.806106 write 0x02adb2 thru 0x038852 (0xdaa1 bytes) 000614 1787850929.809810 mapwrite 0x0354b8 thru 0x03a63f (0x5188 bytes) 000618 1787850929.954269 mapread 0x02c3c3 thru 0x030cfb (0x4939 bytes) 000619 1787850929.959147 mapwrite 0x0024b4 thru 0x005b87 (0x36d4 bytes) 000621 1787850930.041156 read 0x03e7f6 thru 0x03ffff (0x180a bytes) 000622 1787850930.041846 write 0x01121b thru 0x014a8d (0x3873 bytes) 000623 1787850930.057196 mapwrite 0x031662 thru 0x03ffff (0xe99e bytes) 000626 1787850930.139944 write 0x00a2d0 thru 0x010ab6 (0x67e7 bytes) 000628 1787850930.142192 read 0x029176 thru 0x034bd5 (0xba60 bytes) 000629 1787850930.146679 MIRROR_EXTEND to 2 mirrors 000630 1787850930.706157 write 0x01e2f0 thru 0x0279e0 (0x96f1 bytes) 000631 1787850930.854959 mapwrite 0x02db2f thru 0x03a221 (0xc6f3 bytes) 000632 1787850931.001577 trunc from 0x040000 to 0x028a20 (0x175df bytes) 000633 1787850931.052288 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) 000634 1787850931.249031 write 0x017ad1 thru 0x01cf4f (0x547f bytes) 000635 1787850931.271358 mapread 0x0263d5 thru 0x028a20 (0x264c bytes) 000636 1787850931.329365 write 0x03763f thru 0x037bda (0x59c bytes) 000637 1787850931.330476 trunc from 0x037bdb to 0x033cfe (0x3edc bytes) 000638 1787850931.354030 read 0x01f719 thru 0x0208a4 (0x118c bytes) 000643 1787850931.368333 mapread 0x016302 thru 0x016dfa (0xaf9 bytes) 000645 1787850931.407305 write 0x02b44c thru 0x03af44 (0xfaf9 bytes) 000648 1787850931.462332 read 0x01f969 thru 0x0263c0 (0x6a58 bytes) 000649 1787850931.463587 mapread 0x03a24d thru 0x03af44 (0xcf8 bytes) 000651 1787850931.471751 trunc from 0x03af45 to 0x03d96c (0x2a28 bytes) 000653 1787850931.501422 read 0x00a0d7 thru 0x019cdd (0xfc07 bytes) 000656 1787850931.512674 write 0x003efc thru 0x00932a (0x542f bytes) 000658 1787850931.514995 trunc from 0x03d96d to 0x008a69 (0x34f03 bytes) 000659 1787850931.535909 mapwrite 0x02b352 thru 0x03a564 (0xf213 bytes) 000660 1787850931.705875 write 0x020280 thru 0x02e81f (0xe5a0 bytes) 000661 1787850931.718000 mapwrite 0x01a840 thru 0x01f54a (0x4d0b bytes) 000662 1787850931.827267 MIRROR_EXTEND to 2 mirrors 000663 1787850932.650819 MIRROR_EXTEND to 3 mirrors 000664 1787850933.390149 trunc from 0x03a565 to 0x014602 (0x25f62 bytes) 000665 1787850933.513183 mapwrite 0x0331e4 thru 0x03d787 (0xa5a4 bytes) 000667 1787850933.612808 write 0x00a862 thru 0x010052 (0x57f1 bytes) 000668 1787850933.623748 mapwrite 0x016149 thru 0x024953 (0xe80b bytes) 000669 1787850933.704260 write 0x02f352 thru 0x030124 (0xdd3 bytes) 000672 1787850933.707167 mapread 0x024091 thru 0x02740a (0x337a bytes) 000673 1787850933.708519 mapread 0x009a8a thru 0x012023 (0x859a bytes) 000674 1787850933.717309 write 0x03d56a thru 0x03ffff (0x2a96 bytes) 000675 1787850933.718564 write 0x030cfd thru 0x036c33 (0x5f37 bytes) 000677 1787850933.720658 write 0x034c8a thru 0x0365b0 (0x1927 bytes) 000679 1787850933.722608 mapread 0x0198de thru 0x021e08 (0x852b bytes) 000681 1787850933.729059 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa52512c6 (stale) Mirror 3: 0xa52512c6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9c494db3 Mirror 4: 0x9c494db3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000682 1787850934.657718 mapwrite 0x025374 thru 0x025654 (0x2e1 bytes) 000683 1787850934.794987 mapread 0x0133e2 thru 0x020b7e (0xd79d bytes) 000684 1787850934.815527 mapread 0x0365ba thru 0x03bc68 (0x56af bytes) 000687 1787850934.826152 trunc from 0x040000 to 0x02e1b4 (0x11e4b bytes) 000689 1787850934.850003 trunc from 0x02e1b5 to 0x012c87 (0x1b52d bytes) 000690 1787850934.867289 trunc from 0x012c88 to 0x036eef (0x24268 bytes) 000691 1787850934.888082 trunc from 0x036ef0 to 0x03e7ea (0x78fb bytes) 000692 1787850934.931496 mapread 0x03b18c thru 0x03e7ea (0x365f bytes) 000694 1787850934.940803 read 0x025bec thru 0x02d6b7 (0x7acc bytes) 000695 1787850934.950654 mapread 0x013a75 thru 0x016020 (0x25ac bytes) 000696 1787850934.963557 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e7eb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7eb): Mirror 2: 0x7f6650c5 (stale) Mirror 3: 0x7f6650c5 (stale) Mirror 4: 0xfe6a596 (stale) CRC-32 checksum value for chunk [0, 0x3e7eb): Mirror 1: 0xc93bedbd Mirror 5: 0xc93bedbd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7eb: skipped 000697 1787850936.026564 mapread 0x016c4f thru 0x023118 (0xc4ca bytes) 000698 1787850936.059708 mapwrite 0x02c131 thru 0x03103d (0x4f0d bytes) 000699 1787850936.239965 mapwrite 0x01e595 thru 0x02747b (0x8ee7 bytes) 000700 1787850936.333241 read 0x02d1b7 thru 0x03ab6e (0xd9b8 bytes) 000701 1787850936.357748 mapread 0x009e5b thru 0x00cfac (0x3152 bytes) 000702 1787850936.367135 read 0x011b54 thru 0x01ec21 (0xd0ce bytes) 000703 1787850936.378010 mapwrite 0x02c3eb thru 0x03c0b2 (0xfcc8 bytes) 000704 1787850936.431623 trunc from 0x03e7eb to 0x022dbb (0x1ba2f bytes) 000705 1787850936.456741 write 0x022a85 thru 0x02651e (0x3a9a bytes) 000708 1787850936.460883 mapwrite 0x00c675 thru 0x00fbd6 (0x3562 bytes) 000709 1787850936.508859 read 0x01642d thru 0x019231 (0x2e05 bytes) 000711 1787850936.510886 mapwrite 0x016006 thru 0x021892 (0xb88d bytes) 000712 1787850936.562718 read 0x02402d thru 0x02651e (0x24f2 bytes) 000715 1787850936.565131 read 0x018761 thru 0x021e8b (0x972b bytes) 000716 1787850936.566582 trunc from 0x02651f to 0x009966 (0x1cbb8 bytes) 000718 1787850936.583832 mapread 0x001b5f thru 0x009966 (0x7e08 bytes) 000719 1787850936.587690 trunc from 0x009967 to 0x0075f7 (0x236f bytes) 000722 1787850936.613156 mapwrite 0x007fc4 thru 0x00e4e0 (0x651d bytes) 000726 1787850936.702183 mapwrite 0x012fc9 thru 0x022811 (0xf849 bytes) 000727 1787850936.814739 read 0x00d0bd thru 0x0138e4 (0x6828 bytes) 000728 1787850936.815394 trunc from 0x022812 to 0x035867 (0x13056 bytes) 000730 1787850936.834724 mapwrite 0x03e27f thru 0x03ffff (0x1d81 bytes) 000731 1787850936.914495 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa52512c6 (stale) Mirror 3: 0xa52512c6 (stale) Mirror 4: 0x9c494db3 (stale) Mirror 5: 0x6d52829d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x564c32fb Mirror 6: 0x564c32fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000733 1787850937.798973 write 0x03f051 thru 0x03ffff (0xfaf bytes) 000735 1787850937.922240 mapwrite 0x004539 thru 0x00869c (0x4164 bytes) 000737 1787850938.052988 mapwrite 0x0176dc thru 0x026647 (0xef6c bytes) 000739 1787850938.148308 mapread 0x02da4d thru 0x02de88 (0x43c bytes) 000740 1787850938.165575 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa52512c6 (stale) Mirror 3: 0xa52512c6 (stale) Mirror 4: 0x9c494db3 (stale) Mirror 6: 0x564c32fb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa52512c6 (stale) Mirror 3: 0xa52512c6 (stale) Mirror 4: 0x9c494db3 (stale) Mirror 6: 0x564c32fb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000742 1787850938.661363 mapread 0x03c88f thru 0x03e3f6 (0x1b68 bytes) 000743 1787850938.681319 trunc from 0x040000 to 0x013142 (0x2cebd bytes) 000745 1787850938.702842 write 0x010536 thru 0x010f96 (0xa61 bytes) 000748 1787850938.716203 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x13143): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13143): Mirror 2: 0xa4918bfa (stale) Mirror 3: 0xa4918bfa (stale) Mirror 4: 0xa6c89f36 (stale) Mirror 6: 0x4953bc2b (stale) CRC-32 checksum value for chunk [0, 0x13143): Mirror 1: 0xb116f370 Mirror 7: 0xb116f370 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13143: skipped 000750 1787850939.856581 write 0x00922c thru 0x018e82 (0xfc57 bytes) 000752 1787850939.976921 read 0x00d55d thru 0x0150f1 (0x7b95 bytes) 000754 1787850939.983350 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x18e83): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18e83): Mirror 2: 0x98ebaa86 (stale) Mirror 3: 0x98ebaa86 (stale) Mirror 4: 0x380841bb (stale) Mirror 6: 0x6df15cea (stale) Mirror 7: 0xa4be70f0 (stale) CRC-32 checksum value for chunk [0, 0x18e83): Mirror 1: 0xf05ba1e7 Mirror 8: 0xf05ba1e7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18e83: skipped 000755 1787850940.940451 mapwrite 0x01da4b thru 0x028b8f (0xb145 bytes) 000758 1787850941.115922 write 0x010357 thru 0x01bb5b (0xb805 bytes) 000759 1787850941.126008 mapwrite 0x012ace thru 0x014995 (0x1ec8 bytes) 000760 1787850941.170060 mapwrite 0x01bb89 thru 0x02a7e0 (0xec58 bytes) 000761 1787850941.242719 mapread 0x025ae1 thru 0x02a7e0 (0x4d00 bytes) 000762 1787850941.244181 trunc from 0x02a7e1 to 0x013ab6 (0x16d2a bytes) 000768 1787850941.267681 write 0x0094ac thru 0x00966d (0x1c2 bytes) 000770 1787850941.274792 write 0x011ff6 thru 0x01637b (0x4386 bytes) 000771 1787850941.275869 read 0x014714 thru 0x01637b (0x1c68 bytes) 000774 1787850941.278449 read 0x00d44d thru 0x01140b (0x3fbf bytes) 000775 1787850941.288541 mapwrite 0x003d11 thru 0x0081fb (0x44eb bytes) 000776 1787850941.342448 mapread 0x00b659 thru 0x010b68 (0x5510 bytes) 000779 1787850941.344773 read 0x008e2a thru 0x00d6d5 (0x48ac bytes) 000780 1787850941.345888 mapwrite 0x00db5d thru 0x01c7ad (0xec51 bytes) 000782 1787850941.431765 write 0x03222a thru 0x03ffff (0xddd6 bytes) 000783 1787850941.434679 read 0x010b43 thru 0x011196 (0x654 bytes) 000785 1787850941.436735 mapread 0x01a0b7 thru 0x01af62 (0xeac bytes) 000786 1787850941.437787 trunc from 0x040000 to 0x0323b3 (0xdc4c bytes) 000787 1787850941.456937 trunc from 0x0323b4 to 0x037626 (0x5273 bytes) 000788 1787850941.477763 write 0x032b67 thru 0x03bce2 (0x917c bytes) 000789 1787850941.488637 MIRROR_RESYNC 7 mirrors 000790 1787850943.843871 mapread 0x023609 thru 0x02595a (0x2352 bytes) 000792 1787850943.875716 trunc from 0x03bce3 to 0x029cb7 (0x1202b bytes) 000793 1787850944.019537 mapwrite 0x03c005 thru 0x03ffff (0x3ffb bytes) 000794 1787850944.158362 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xdca38b72 (stale) Mirror 3: 0xdca38b72 (stale) Mirror 4: 0xdca38b72 (stale) Mirror 6: 0xdca38b72 (stale) Mirror 7: 0xdca38b72 (stale) Mirror 8: 0xdca38b72 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x111ca408 Mirror 9: 0x111ca408 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000797 1787850945.690085 mapwrite 0x020894 thru 0x022975 (0x20e2 bytes) 000798 1787850945.920835 MIRROR_RESYNC 8 mirrors 000799 1787850947.482998 read 0x008e16 thru 0x012723 (0x990e bytes) 000800 1787850947.491934 read 0x01d24a thru 0x02ce33 (0xfbea bytes) 000801 1787850947.506966 MIRROR_EXTEND to 9 mirrors 000804 1787850948.837899 mapread 0x00ed26 thru 0x013802 (0x4add bytes) 000805 1787850948.860925 mapread 0x0202c0 thru 0x02b9a3 (0xb6e4 bytes) 000806 1787850948.885616 trunc from 0x040000 to 0x022fcc (0x1d033 bytes) 000807 1787850949.022907 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x22fcd): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22fcd): Mirror 2: 0xb4478173 (stale) Mirror 3: 0xb4478173 (stale) Mirror 4: 0xb4478173 (stale) Mirror 6: 0xb4478173 (stale) Mirror 7: 0xb4478173 (stale) Mirror 8: 0xb4478173 (stale) Mirror 9: 0xb4478173 (stale) Mirror 10: 0xb4478173 (stale) CRC-32 checksum value for chunk [0, 0x22fcd): Mirror 1: 0xb4478173 Mirror 11: 0xb4478173 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22fcd: skipped 000808 1787850950.409631 read 0x01b852 thru 0x01dd4a (0x24f9 bytes) 000809 1787850950.415830 write 0x00d0f1 thru 0x01cdcc (0xfcdc bytes) 000810 1787850950.528583 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x22fcd): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22fcd): Mirror 2: 0xb4478173 (stale) Mirror 3: 0xb4478173 (stale) Mirror 4: 0xb4478173 (stale) Mirror 6: 0xb4478173 (stale) Mirror 7: 0xb4478173 (stale) Mirror 8: 0xb4478173 (stale) Mirror 9: 0xb4478173 (stale) Mirror 10: 0xb4478173 (stale) Mirror 11: 0xb4478173 (stale) CRC-32 checksum value for chunk [0, 0x22fcd): Mirror 1: 0xf9a6c6b0 Mirror 12: 0xf9a6c6b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22fcd: skipped 000811 1787850951.576566 mapwrite 0x037cf2 thru 0x03ffff (0x830e bytes) 000812 1787850951.845254 write 0x031e4a thru 0x03352a (0x16e1 bytes) 000813 1787850951.863315 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe2df1767 (stale) Mirror 3: 0xe2df1767 (stale) Mirror 4: 0xe2df1767 (stale) Mirror 6: 0xe2df1767 (stale) Mirror 7: 0xe2df1767 (stale) Mirror 8: 0xe2df1767 (stale) Mirror 9: 0xe2df1767 (stale) Mirror 10: 0xe2df1767 (stale) Mirror 11: 0x91106cb4 (stale) Mirror 12: 0x56939aca (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8395267c Mirror 13: 0x8395267c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000816 1787850953.055401 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe2df1767 (stale) Mirror 3: 0xe2df1767 (stale) Mirror 4: 0xe2df1767 (stale) Mirror 6: 0xe2df1767 (stale) Mirror 7: 0xe2df1767 (stale) Mirror 8: 0xe2df1767 (stale) Mirror 9: 0xe2df1767 (stale) Mirror 10: 0xe2df1767 (stale) Mirror 11: 0x91106cb4 (stale) Mirror 12: 0x56939aca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe2df1767 (stale) Mirror 3: 0xe2df1767 (stale) Mirror 4: 0xe2df1767 (stale) Mirror 6: 0xe2df1767 (stale) Mirror 7: 0xe2df1767 (stale) Mirror 8: 0xe2df1767 (stale) Mirror 9: 0xe2df1767 (stale) Mirror 10: 0xe2df1767 (stale) Mirror 11: 0x91106cb4 (stale) Mirror 12: 0x56939aca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000817 1787850953.606291 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe2df1767 (stale) Mirror 3: 0xe2df1767 (stale) Mirror 4: 0xe2df1767 (stale) Mirror 6: 0xe2df1767 (stale) Mirror 7: 0xe2df1767 (stale) Mirror 8: 0xe2df1767 (stale) Mirror 10: 0xe2df1767 (stale) Mirror 11: 0x91106cb4 (stale) Mirror 12: 0x56939aca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe2df1767 (stale) Mirror 3: 0xe2df1767 (stale) Mirror 4: 0xe2df1767 (stale) Mirror 6: 0xe2df1767 (stale) Mirror 7: 0xe2df1767 (stale) Mirror 8: 0xe2df1767 (stale) Mirror 10: 0xe2df1767 (stale) Mirror 11: 0x91106cb4 (stale) Mirror 12: 0x56939aca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000819 1787850954.074394 mapread 0x03401a thru 0x03d7a7 (0x978e bytes) 000820 1787850954.092553 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe2df1767 (stale) Mirror 3: 0xe2df1767 (stale) Mirror 4: 0xe2df1767 (stale) Mirror 6: 0xe2df1767 (stale) Mirror 7: 0xe2df1767 (stale) Mirror 8: 0xe2df1767 (stale) Mirror 10: 0xe2df1767 (stale) Mirror 11: 0x91106cb4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe2df1767 (stale) Mirror 3: 0xe2df1767 (stale) Mirror 4: 0xe2df1767 (stale) Mirror 6: 0xe2df1767 (stale) Mirror 7: 0xe2df1767 (stale) Mirror 8: 0xe2df1767 (stale) Mirror 10: 0xe2df1767 (stale) Mirror 11: 0x91106cb4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000821 1787850954.628706 read 0x01f84e thru 0x02ac3b (0xb3ee bytes) 000823 1787850954.647671 trunc from 0x040000 to 0x00cc4b (0x333b4 bytes) 000826 1787850954.685927 mapread 0x00230a thru 0x0080e1 (0x5dd8 bytes) 000827 1787850954.710681 mapread 0x004acd thru 0x00cc4b (0x817f bytes) 000830 1787850954.714988 mapread 0x0073ec thru 0x00cc4b (0x5860 bytes) 000832 1787850954.717814 read 0x00bf94 thru 0x00c2fc (0x369 bytes) 000833 1787850954.718719 mapread 0x007a46 thru 0x00cc4b (0x5206 bytes) 000834 1787850954.721056 mapwrite 0x018e0f thru 0x0221d0 (0x93c2 bytes) 000835 1787850954.816360 read 0x00347e thru 0x00d8cc (0xa44f bytes) 000836 1787850954.816989 mapread 0x011ff5 thru 0x015338 (0x3344 bytes) 000840 1787850954.820464 read 0x004a0a thru 0x0114ab (0xcaa2 bytes) 000841 1787850954.821449 mapread 0x007999 thru 0x01006d (0x86d5 bytes) 000843 1787850954.828149 MIRROR_RESYNC 9 mirrors 000845 1787850956.625972 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) 000847 1787850957.012302 write 0x01d0a9 thru 0x026772 (0x96ca bytes) 000849 1787850957.098149 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26773): Mirror 2: 0x35cced1 (stale) Mirror 3: 0x35cced1 (stale) Mirror 6: 0x35cced1 (stale) Mirror 7: 0x35cced1 (stale) Mirror 10: 0x35cced1 (stale) Mirror 11: 0x35cced1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26773): Mirror 2: 0x35cced1 (stale) Mirror 3: 0x35cced1 (stale) Mirror 6: 0x35cced1 (stale) Mirror 7: 0x35cced1 (stale) Mirror 10: 0x35cced1 (stale) Mirror 11: 0x35cced1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26773: skipped 000853 1787850957.462645 trunc from 0x026773 to 0x01ee7c (0x78f6 bytes) 000854 1787850957.481767 mapread 0x015ea0 thru 0x01c9ae (0x6b0f bytes) 000855 1787850957.499740 read 0x010ded thru 0x01dc35 (0xce49 bytes) 000856 1787850957.500451 read 0x00f6e3 thru 0x016df3 (0x7711 bytes) 000861 1787850957.514968 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ee7d): Mirror 2: 0xa36bbd48 (stale) Mirror 3: 0xa36bbd48 (stale) Mirror 6: 0xa36bbd48 (stale) Mirror 7: 0xa36bbd48 (stale) Mirror 10: 0xa36bbd48 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ee7d): Mirror 2: 0xa36bbd48 (stale) Mirror 3: 0xa36bbd48 (stale) Mirror 6: 0xa36bbd48 (stale) Mirror 7: 0xa36bbd48 (stale) Mirror 10: 0xa36bbd48 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ee7d: skipped 000862 1787850958.027509 mapread 0x00d09e thru 0x012881 (0x57e4 bytes) 000863 1787850958.065027 mapread 0x00265b thru 0x0094a6 (0x6e4c bytes) 000864 1787850958.075521 mapread 0x01cd94 thru 0x01ee7c (0x20e9 bytes) 000865 1787850958.115408 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ee7d): Mirror 2: 0xa36bbd48 (stale) Mirror 3: 0xa36bbd48 (stale) Mirror 6: 0xa36bbd48 (stale) Mirror 7: 0xa36bbd48 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ee7d): Mirror 2: 0xa36bbd48 (stale) Mirror 3: 0xa36bbd48 (stale) Mirror 6: 0xa36bbd48 (stale) Mirror 7: 0xa36bbd48 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ee7d: skipped 000867 1787850958.431992 write 0x01187f thru 0x01eef3 (0xd675 bytes) 000868 1787850958.439969 mapwrite 0x01df2e thru 0x02d6ec (0xf7bf bytes) 000870 1787850958.546869 mapread 0x020872 thru 0x028197 (0x7926 bytes) 000872 1787850958.552428 MIRROR_RESYNC 5 mirrors 000875 1787850959.469989 mapwrite 0x025c2d thru 0x02852c (0x2900 bytes) 000877 1787850959.718738 MIRROR_RESYNC 5 mirrors 000878 1787850960.791606 MIRROR_EXTEND to 6 mirrors 000879 1787850961.565656 trunc from 0x02d6ed to 0x02bc2c (0x1ac0 bytes) 000880 1787850961.665802 write 0x02524f thru 0x0301e2 (0xaf94 bytes) 000882 1787850961.682879 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x301e3): Mirror 3: 0x4c22b977 (stale) Mirror 6: 0x4c22b977 (stale) Mirror 7: 0x4c22b977 (stale) Mirror 8: 0x4c22b977 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x301e3): Mirror 3: 0x4c22b977 (stale) Mirror 6: 0x4c22b977 (stale) Mirror 7: 0x4c22b977 (stale) Mirror 8: 0x4c22b977 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x301e3: skipped 000883 1787850962.114815 mapread 0x010055 thru 0x012f1e (0x2eca bytes) 000884 1787850962.133633 trunc from 0x0301e3 to 0x01ad85 (0x1545d bytes) 000886 1787850962.149755 trunc from 0x01ad86 to 0x018519 (0x286c bytes) 000887 1787850962.170350 read 0x002594 thru 0x011824 (0xf291 bytes) 000889 1787850962.178741 trunc from 0x01851a to 0x00149e (0x1707b bytes) 000890 1787850962.196330 trunc from 0x00149f to 0x0296fe (0x28260 bytes) 000892 1787850962.211827 trunc from 0x0296ff to 0x028e1b (0x8e3 bytes) 000893 1787850962.228317 write 0x008129 thru 0x0110a1 (0x8f79 bytes) 000895 1787850962.241961 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x28e1c): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28e1c): Mirror 3: 0xc26f594d (stale) Mirror 6: 0xc26f594d (stale) Mirror 7: 0xc26f594d (stale) Mirror 8: 0xc26f594d (stale) CRC-32 checksum value for chunk [0, 0x28e1c): Mirror 1: 0x3ac87beb Mirror 9: 0x3ac87beb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28e1c: skipped 000901 1787850963.273271 write 0x0025d8 thru 0x00c7a2 (0xa1cb bytes) 000902 1787850963.355527 read 0x0046f4 thru 0x0100b5 (0xb9c2 bytes) 000904 1787850963.364333 mapread 0x011e46 thru 0x01ff3d (0xe0f8 bytes) 000907 1787850963.425294 mapread 0x00b0c5 thru 0x0191b8 (0xe0f4 bytes) 000908 1787850963.426745 read 0x00ecef thru 0x01647b (0x778d bytes) 000909 1787850963.428273 write 0x0280ee thru 0x02e35c (0x626f bytes) 000914 1787850963.447360 trunc from 0x02e35d to 0x02c9d5 (0x1987 bytes) 000915 1787850963.520612 mapwrite 0x030274 thru 0x035f09 (0x5c96 bytes) 000921 1787850963.663283 read 0x02e6c7 thru 0x032e35 (0x476f bytes) 000922 1787850963.664113 write 0x01c247 thru 0x026e23 (0xabdd bytes) 000925 1787850963.666646 write 0x0030ff thru 0x00546c (0x236e bytes) 000928 1787850963.676654 mapwrite 0x03c34a thru 0x03ffff (0x3cb6 bytes) 000933 1787850963.815584 trunc from 0x040000 to 0x03933f (0x6cc0 bytes) 000935 1787850963.861493 mapwrite 0x017222 thru 0x01e259 (0x7038 bytes) 000936 1787850963.937940 write 0x0312ad thru 0x03258c (0x12e0 bytes) 000937 1787850963.939250 write 0x027055 thru 0x028c5c (0x1c08 bytes) 000942 1787850963.951272 write 0x027b64 thru 0x03414d (0xc5ea bytes) 000945 1787850963.968083 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x39340): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39340): Mirror 3: 0x8e0018e6 (stale) Mirror 6: 0x8e0018e6 (stale) Mirror 7: 0x8e0018e6 (stale) Mirror 8: 0x8e0018e6 (stale) Mirror 9: 0xa41f7dc1 (stale) CRC-32 checksum value for chunk [0, 0x39340): Mirror 1: 0x23d959bf Mirror 10: 0x23d959bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39340: skipped 000946 1787850965.142164 mapwrite 0x00cdfd thru 0x0110bd (0x42c1 bytes) 000949 1787850965.419350 read 0x004f53 thru 0x006ed1 (0x1f7f bytes) 000951 1787850965.433267 mapwrite 0x03d255 thru 0x03ffff (0x2dab bytes) 000952 1787850965.560607 trunc from 0x040000 to 0x0175c5 (0x28a3a bytes) 000953 1787850965.584179 mapread 0x0098cb thru 0x014a5a (0xb190 bytes) 000955 1787850965.587122 read 0x00d9b9 thru 0x010b74 (0x31bc bytes) 000961 1787850965.592029 read 0x00d399 thru 0x0137d0 (0x6438 bytes) 000963 1787850965.593328 trunc from 0x0175c6 to 0x01ae14 (0x384f bytes) 000965 1787850965.611903 mapread 0x00617c thru 0x0108b3 (0xa738 bytes) 000968 1787850965.623101 read 0x00a293 thru 0x011674 (0x73e2 bytes) 000970 1787850965.627668 mapwrite 0x01d4ea thru 0x0278d0 (0xa3e7 bytes) 000971 1787850965.799486 mapread 0x025d6e thru 0x0278d0 (0x1b63 bytes) 000972 1787850965.815952 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x278d1): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x278d1): Mirror 3: 0xc2a8a778 (stale) Mirror 6: 0xc2a8a778 (stale) Mirror 7: 0xc2a8a778 (stale) Mirror 8: 0xc2a8a778 (stale) Mirror 9: 0x1a3e2d5c (stale) Mirror 10: 0x3cac1561 (stale) CRC-32 checksum value for chunk [0, 0x278d1): Mirror 1: 0xeb34021f Mirror 11: 0xeb34021f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x278d1: skipped 000973 1787850966.985062 mapwrite 0x016049 thru 0x019652 (0x360a bytes) 000976 1787850967.201939 read 0x01e1de thru 0x02070c (0x252f bytes) 000977 1787850967.211048 trunc from 0x0278d1 to 0x035cfc (0xe42c bytes) 000978 1787850967.241803 mapread 0x0275cd thru 0x02a7ed (0x3221 bytes) 000979 1787850967.277031 mapwrite 0x01bfec thru 0x0277f1 (0xb806 bytes) 000981 1787850967.414128 trunc from 0x035cfd to 0x0282a6 (0xda56 bytes) 000984 1787850967.446106 mapread 0x00b590 thru 0x0151da (0x9c4b bytes) 000988 1787850967.475394 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x14b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x282a7): Mirror 6: 0xba0fc04c (stale) Mirror 7: 0xba0fc04c (stale) Mirror 8: 0xba0fc04c (stale) Mirror 9: 0x9a0991c8 (stale) Mirror 10: 0x3556aa00 (stale) Mirror 11: 0x6314a32d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x282a7): Mirror 6: 0xba0fc04c (stale) Mirror 7: 0xba0fc04c (stale) Mirror 8: 0xba0fc04c (stale) Mirror 9: 0x9a0991c8 (stale) Mirror 10: 0x3556aa00 (stale) Mirror 11: 0x6314a32d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x282a7: skipped 000992 1787850967.975125 trunc from 0x0282a7 to 0x03f389 (0x170e3 bytes) 000993 1787850967.993470 write 0x02f831 thru 0x038bc0 (0x9390 bytes) 000994 1787850968.008576 trunc from 0x03f38a to 0x000101 (0x3f288 bytes) 000995 1787850968.053175 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x102): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x102): Mirror 6: 0xae69bf9a (stale) Mirror 7: 0xae69bf9a (stale) Mirror 8: 0xae69bf9a (stale) Mirror 9: 0xae69bf9a (stale) Mirror 10: 0xae69bf9a (stale) Mirror 11: 0xae69bf9a (stale) CRC-32 checksum value for chunk [0, 0x102): Mirror 1: 0xae69bf9a Mirror 12: 0xae69bf9a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x102: skipped 000996 1787850969.157516 write 0x0142c6 thru 0x01814c (0x3e87 bytes) 000998 1787850969.268014 mapread 0x01788f thru 0x01814c (0x8be bytes) 000999 1787850969.270094 read 0x015fd6 thru 0x01814c (0x2177 bytes) All operations completed A-OK!