== sanity-flr test 70a: flr mode fsx test ================ 11:36:06 (1786721766) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 1768 skipping zero size read skipping zero size read skipping zero size read 000004 1786721768.379860 write 0x0036eb thru 0x004b34 (0x144a bytes) 000005 1786721768.382356 trunc from 0x004572 to 0x004b34 (0x5c3 bytes) 000006 1786721768.399849 mapread 0x004a82 thru 0x004b34 (0xb3 bytes) zero_range to largest ever: 0x4b35 000007 1786721768.409149 trunc from 0x002d68 to 0x004b34 (0x1dcd bytes) 000008 1786721768.417404 mapwrite 0x03e1d8 thru 0x03ffff (0x1e28 bytes) 000009 1786721768.498263 write 0x02cffa thru 0x02df55 (0xf5c bytes) 000010 1786721768.509961 write 0x01bd1d thru 0x028d8b (0xd06f bytes) 000011 1786721768.574631 MIRROR_EXTEND to 2 mirrors 000012 1786721769.444483 read 0x00e6ad thru 0x01b31e (0xcc72 bytes) 000013 1786721769.467941 MIRROR_EXTEND to 3 mirrors truncating to largest ever: 0x36f16 000014 1786721770.272675 trunc from 0x040000 to 0x036f15 (0x90ea bytes) 000016 1786721770.358329 write 0x00d48b thru 0x01cb94 (0xf70a bytes) 000019 1786721770.406942 MIRROR_RESYNC 3 mirrors 000020 1786721771.396784 write 0x0128c7 thru 0x01c4bc (0x9bf6 bytes) 000021 1786721771.464552 mapwrite 0x019ba4 thru 0x02013b (0x6598 bytes) 000022 1786721771.600990 mapread 0x00f42e thru 0x016029 (0x6bfc bytes) 000023 1786721771.653010 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x36f16): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36f16): Mirror 2: 0x874fe88 (stale) Mirror 3: 0x874fe88 (stale) CRC-32 checksum value for chunk [0, 0x36f16): Mirror 1: 0x8bd48e8c Mirror 4: 0x8bd48e8c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36f16: skipped 000024 1786721772.757211 write 0x00760f thru 0x00ba8f (0x4481 bytes) 000025 1786721772.815715 trunc from 0x036f16 to 0x01063b (0x268da bytes) 000026 1786721772.840468 trunc from 0x01063c to 0x0305a9 (0x1ff6e bytes) 000027 1786721772.859243 read 0x029784 thru 0x0305a9 (0x6e26 bytes) 000028 1786721772.879173 mapwrite 0x01d3f8 thru 0x022263 (0x4e6c bytes) 000029 1786721772.956154 fallocate 0x006ec9 thru 0x00f880 (0x89b8 bytes) 000030 1786721772.965419 mapwrite 0x02478e thru 0x02cf46 (0x87b9 bytes) 000032 1786721773.101531 MIRROR_RESYNC 4 mirrors 000033 1786721774.966829 mapread 0x015ab8 thru 0x0220fe (0xc647 bytes) 000034 1786721775.057909 mapwrite 0x015368 thru 0x01ae1c (0x5ab5 bytes) 000035 1786721775.205158 read 0x02d80a thru 0x02db28 (0x31f bytes) 000036 1786721775.215657 mapread 0x008d82 thru 0x00bd64 (0x2fe3 bytes) 000037 1786721775.229552 punch from 0x0180d3 to 0x01d9aa (0x58d8 bytes) 000038 1786721775.240664 read 0x00796a thru 0x00d051 (0x56e8 bytes) 000039 1786721775.241651 fallocate 0x01abc0 thru 0x023178 (0x85b9 bytes) 000040 1786721775.256857 trunc from 0x02f7ca to 0x030151 (0x988 bytes) 000041 1786721775.267832 read 0x00c48a thru 0x014e06 (0x897d bytes) 000042 1786721775.290337 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x305aa): Mirror 2: 0xacaac9a9 (stale) Mirror 4: 0xacaac9a9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x305aa): Mirror 2: 0xacaac9a9 (stale) Mirror 4: 0xacaac9a9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x305aa: skipped 000043 1786721775.663724 read 0x023dc8 thru 0x025dfc (0x2035 bytes) 000045 1786721775.679471 mapwrite 0x01076b thru 0x01f894 (0xf12a bytes) 000046 1786721775.738914 trunc from 0x01d10f to 0x0266b9 (0x95ab bytes) 000047 1786721775.745089 read 0x029ce2 thru 0x0305a9 (0x68c8 bytes) 000048 1786721775.758617 punch from 0x017db5 to 0x01f84d (0x7a99 bytes) 000049 1786721775.764090 fallocate 0x008f55 thru 0x0170a3 (0xe14f bytes) truncating to largest ever: 0x3d141 000050 1786721775.771184 trunc from 0x0305aa to 0x03d140 (0xcb97 bytes) 000052 1786721775.787568 fallocate 0x036369 thru 0x03c023 (0x5cbb bytes) 000053 1786721775.793098 read 0x03ada2 thru 0x03d140 (0x239f bytes) 000054 1786721775.803152 read 0x02ebb3 thru 0x032291 (0x36df bytes) 000056 1786721775.805225 trunc from 0x029033 to 0x030889 (0x7857 bytes) 000057 1786721775.810445 mapwrite 0x02a53f thru 0x031d33 (0x77f5 bytes) 000058 1786721775.846915 MIRROR_RESYNC 3 mirrors 000059 1786721776.665107 read 0x0323d4 thru 0x034536 (0x2163 bytes) 000060 1786721776.670999 punch from 0x01127c to 0x01dea3 (0xcc28 bytes) 000061 1786721776.700336 fallocate 0x02494f thru 0x025a13 (0x10c5 bytes) 000062 1786721776.709325 trunc from 0x03d141 to 0x009e6c (0x332d4 bytes) 000063 1786721776.731826 read 0x00887b thru 0x009e6c (0x15f2 bytes) 000064 1786721776.740140 trunc from 0x009e6d to 0x004b08 (0x5364 bytes) 000065 1786721776.752243 write 0x02efb9 thru 0x037412 (0x845a bytes) 000066 1786721776.755053 trunc from 0x037413 to 0x038d87 (0x1975 bytes) 000067 1786721776.774543 trunc from 0x0176bd to 0x01af2d (0x3871 bytes) 000068 1786721776.781861 mapwrite 0x0200d4 thru 0x024589 (0x44b6 bytes) 000069 1786721776.810199 read 0x024ca0 thru 0x02bd08 (0x7069 bytes) 000070 1786721776.811145 trunc from 0x038d88 to 0x0151da (0x23bad bytes) 000071 1786721776.825862 trunc from 0x0151db to 0x037506 (0x2232c bytes) 000072 1786721776.846843 MIRROR_RESYNC 3 mirrors 000074 1786721777.358367 mapread 0x007413 thru 0x01059b (0x9189 bytes) 000075 1786721777.379060 MIRROR_RESYNC 3 mirrors 000076 1786721777.703047 mapread 0x00f347 thru 0x01817e (0x8e38 bytes) 000077 1786721777.719334 trunc from 0x037507 to 0x01a2bf (0x1d247 bytes) 000078 1786721777.752930 mapwrite 0x039526 thru 0x03ffff (0x6ada bytes) truncating to largest ever: 0x3e2fa 000079 1786721777.797899 trunc from 0x040000 to 0x03e2f9 (0x1d06 bytes) 000080 1786721777.820885 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e2fa): Mirror 2: 0x4fd16439 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e2fa): Mirror 2: 0x4fd16439 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e2fa: skipped 000081 1786721778.279048 write 0x00dbeb thru 0x0168b7 (0x8ccd bytes) 000082 1786721778.307206 write 0x02b74f thru 0x031c51 (0x6503 bytes) 000083 1786721778.323690 MIRROR_RESYNC 2 mirrors 000085 1786721779.041884 mapread 0x0079e1 thru 0x01471f (0xcd3f bytes) 000086 1786721779.067950 read 0x003aee thru 0x0043ad (0x8c0 bytes) 000087 1786721779.068411 punch from 0x02d726 to 0x0305dc (0x2eb7 bytes) 000088 1786721779.096950 punch from 0x006490 to 0x00f048 (0x8bb9 bytes) 000089 1786721779.106760 trunc from 0x03e2fa to 0x025392 (0x18f67 bytes) 000091 1786721779.126103 trunc from 0x01bb8f to 0x01d5c5 (0x1a37 bytes) 000092 1786721779.130567 read 0x003934 thru 0x00e92d (0xaffa bytes) 000093 1786721779.146018 punch from 0x003dbc to 0x00d2d0 (0x9515 bytes) 000094 1786721779.151007 fallocate 0x01ec39 thru 0x023296 (0x465e bytes) 000095 1786721779.155994 punch from 0x020588 to 0x025392 (0x4e0b bytes) 000096 1786721779.161274 trunc from 0x006991 to 0x009bb8 (0x3228 bytes) 000097 1786721779.167795 mapwrite 0x00a912 thru 0x00f70e (0x4dfd bytes) 000098 1786721779.205699 trunc from 0x025393 to 0x030ca4 (0xb912 bytes) 000099 1786721779.222969 mapwrite 0x023d08 thru 0x032f46 (0xf23f bytes) 000101 1786721779.295916 fallocate 0x01e176 thru 0x02c1c9 (0xe054 bytes) 000102 1786721779.303982 write 0x017a73 thru 0x024e26 (0xd3b4 bytes) 000103 1786721779.306014 fallocate 0x02abe9 thru 0x0308db (0x5cf3 bytes) 000104 1786721779.310954 trunc from 0x0032bf to 0x006974 (0x36b6 bytes) 000105 1786721779.315850 trunc from 0x025210 to 0x02ed75 (0x9b66 bytes) 000106 1786721779.321651 read 0x00a9d4 thru 0x00c601 (0x1c2e bytes) 000107 1786721779.322647 mapwrite 0x03c50e thru 0x03ffff (0x3af2 bytes) 000108 1786721779.376298 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4c06e50a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1d91c1cf Mirror 3: 0x1d91c1cf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000109 1786721780.344159 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) 000110 1786721780.851503 trunc from 0x040000 to 0x0102e4 (0x2fd1b bytes) 000111 1786721780.915354 write 0x03c49c thru 0x03ffff (0x3b64 bytes) 000112 1786721780.916674 mapwrite 0x03a0e3 thru 0x03ffff (0x5f1d bytes) 000113 1786721780.963318 fallocate 0x0148aa thru 0x0195e4 (0x4d3b bytes) 000114 1786721780.974790 read 0x0251ce thru 0x027c91 (0x2ac4 bytes) 000115 1786721780.987974 read 0x00cafe thru 0x011ba8 (0x50ab bytes) 000116 1786721781.020956 read 0x0312e2 thru 0x03ffff (0xed1e bytes) 000117 1786721781.021736 punch from 0x0284d7 to 0x02e035 (0x5b5f bytes) 000119 1786721781.035922 fallocate 0x009231 thru 0x01116c (0x7f3c bytes) 000120 1786721781.044032 mapwrite 0x02e658 thru 0x03cf01 (0xe8aa bytes) 000121 1786721781.092056 fallocate 0x027d13 thru 0x036a06 (0xecf4 bytes) 000122 1786721781.097207 mapread 0x00d582 thru 0x01c751 (0xf1d0 bytes) 000123 1786721781.105038 fallocate 0x02340e thru 0x030136 (0xcd29 bytes) 000124 1786721781.127226 trunc from 0x040000 to 0x00e46e (0x31b91 bytes) 000125 1786721781.144965 read 0x003638 thru 0x00e46e (0xae37 bytes) 000126 1786721781.145754 punch from 0x009375 to 0x00e46e (0x50fa bytes) 000127 1786721781.164236 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) 000128 1786721781.279727 punch from 0x004610 to 0x00a7f1 (0x61e2 bytes) 000129 1786721781.287218 mapread 0x001d3a thru 0x0097b8 (0x7a7f bytes) 000130 1786721781.305625 punch from 0x0014fa to 0x006376 (0x4e7d bytes) 000132 1786721781.310840 mapwrite 0x033af5 thru 0x03b075 (0x7581 bytes) 000133 1786721781.361238 mapread 0x02a58e thru 0x0321a4 (0x7c17 bytes) 000134 1786721781.379259 mapread 0x01ba62 thru 0x0262c8 (0xa867 bytes) 000136 1786721781.395155 mapread 0x01d70c thru 0x0224b6 (0x4dab bytes) 000137 1786721781.396538 fallocate 0x00124b thru 0x0066c3 (0x5479 bytes) 000138 1786721781.401308 read 0x010c18 thru 0x01f430 (0xe819 bytes) 000139 1786721781.407111 mapread 0x02b024 thru 0x03a39c (0xf379 bytes) 000140 1786721781.409601 write 0x0178e9 thru 0x026510 (0xec28 bytes) 000141 1786721781.414098 write 0x033ac7 thru 0x0348a1 (0xddb bytes) 000143 1786721781.432767 MIRROR_EXTEND to 2 mirrors 000145 1786721781.938695 punch from 0x033ac0 to 0x03895f (0x4ea0 bytes) 000146 1786721781.977711 mapread 0x03037c thru 0x031faa (0x1c2f bytes) 000147 1786721781.987875 trunc from 0x03b076 to 0x007c8a (0x333eb bytes) 000148 1786721782.022693 read 0x002530 thru 0x007c8a (0x575b bytes) 000149 1786721782.029161 read 0x006128 thru 0x007c8a (0x1b63 bytes) 000150 1786721782.029829 trunc from 0x007c8b to 0x01dd51 (0x160c7 bytes) 000152 1786721782.043564 trunc from 0x01dd52 to 0x02306b (0x531a bytes) 000153 1786721782.060202 read 0x01f37b thru 0x02306b (0x3cf1 bytes) 000154 1786721782.073837 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2306c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2306c): Mirror 2: 0x8e58da0 (stale) CRC-32 checksum value for chunk [0, 0x2306c): Mirror 1: 0xa33916ee Mirror 3: 0xa33916ee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2306c: skipped 000155 1786721782.802017 mapread 0x0215b2 thru 0x02306b (0x1aba bytes) fallocating to largest ever: 0x40000 000156 1786721782.858351 fallocate 0x03bfe8 thru 0x03ffff (0x4018 bytes) 000157 1786721782.932474 write 0x0125a7 thru 0x01d8da (0xb334 bytes) 000158 1786721782.963014 punch from 0x005dfa to 0x00edd4 (0x8fdb bytes) 000159 1786721782.986442 read 0x01803e thru 0x024d9d (0xcd60 bytes) 000161 1786721783.031921 punch from 0x03c558 to 0x03ffff (0x3aa8 bytes) 000162 1786721783.042659 read 0x03b747 thru 0x03c8c3 (0x117d bytes) 000163 1786721783.067504 punch from 0x006847 to 0x01604c (0xf806 bytes) 000164 1786721783.107215 read 0x009a62 thru 0x00db32 (0x40d1 bytes) 000165 1786721783.135161 punch from 0x01641c to 0x018f35 (0x2b1a bytes) 000166 1786721783.161295 MIRROR_RESYNC 3 mirrors 000167 1786721784.014523 mapwrite 0x02b8cb thru 0x02f25e (0x3994 bytes) 000168 1786721784.136177 mapread 0x00cfc0 thru 0x01908e (0xc0cf bytes) 000169 1786721784.158092 trunc from 0x040000 to 0x02b244 (0x14dbb bytes) 000170 1786721784.184771 read 0x00f02f thru 0x01336f (0x4341 bytes) 000171 1786721784.186818 trunc from 0x006691 to 0x013310 (0xcc80 bytes) 000174 1786721784.201854 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2b245): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b245): Mirror 2: 0x2d7b9822 (stale) Mirror 3: 0x2d7b9822 (stale) CRC-32 checksum value for chunk [0, 0x2b245): Mirror 1: 0x2d7b9822 Mirror 4: 0x2d7b9822 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b245: skipped 000175 1786721785.032900 read 0x02a96b thru 0x02b244 (0x8da bytes) 000176 1786721785.048026 MIRROR_RESYNC 4 mirrors 000177 1786721786.105404 mapwrite 0x013815 thru 0x01806a (0x4856 bytes) 000180 1786721786.285819 trunc from 0x02b245 to 0x03d677 (0x12433 bytes) 000181 1786721786.328339 trunc from 0x0256a6 to 0x02c2c2 (0x6c1d bytes) 000182 1786721786.338191 trunc from 0x03d678 to 0x009dc4 (0x338b3 bytes) 000184 1786721786.369712 read 0x0039b8 thru 0x009dc4 (0x640d bytes) 000185 1786721786.382759 trunc from 0x0070a2 to 0x009dc4 (0x2d23 bytes) 000186 1786721786.391826 mapread 0x007a18 thru 0x007be1 (0x1ca bytes) 000187 1786721786.410008 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x9dc5): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9dc5): Mirror 2: 0xf9a8c9df (stale) Mirror 3: 0xf9a8c9df (stale) Mirror 4: 0xf9a8c9df (stale) CRC-32 checksum value for chunk [0, 0x9dc5): Mirror 1: 0xf9a8c9df Mirror 5: 0xf9a8c9df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9dc5: skipped 000188 1786721787.139752 mapwrite 0x00648f thru 0x0161a5 (0xfd17 bytes) 000189 1786721787.397923 trunc from 0x0161a6 to 0x021757 (0xb5b2 bytes) 000190 1786721787.455795 fallocate 0x021259 thru 0x024561 (0x3309 bytes) 000191 1786721787.461195 mapread 0x00c6a3 thru 0x014b27 (0x8485 bytes) 000192 1786721787.462609 fallocate 0x01fe9e thru 0x02a40f (0xa572 bytes) 000193 1786721787.493199 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24562): Mirror 3: 0x5b9b6920 (stale) Mirror 4: 0x5b9b6920 (stale) Mirror 5: 0xd436731d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24562): Mirror 3: 0x5b9b6920 (stale) Mirror 4: 0x5b9b6920 (stale) Mirror 5: 0xd436731d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24562: skipped 000194 1786721788.109921 trunc from 0x01f68d to 0x023b28 (0x449c bytes) 000195 1786721788.116181 mapread 0x0195a0 thru 0x024561 (0xafc2 bytes) 000196 1786721788.142560 read 0x009270 thru 0x015ece (0xcc5f bytes) 000197 1786721788.156187 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24562): Mirror 4: 0x5b9b6920 (stale) Mirror 5: 0xd436731d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24562): Mirror 4: 0x5b9b6920 (stale) Mirror 5: 0xd436731d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24562: skipped 000198 1786721788.506539 fallocate 0x039785 thru 0x03afaa (0x1826 bytes) 000199 1786721788.512919 read 0x02c04c thru 0x037bea (0xbb9f bytes) 000201 1786721788.523048 mapread 0x030632 thru 0x03afaa (0xa979 bytes) 000202 1786721788.539108 fallocate 0x00db56 thru 0x01a5c1 (0xca6c bytes) 000203 1786721788.545892 write 0x003821 thru 0x003b78 (0x358 bytes) 000204 1786721788.567640 MIRROR_RESYNC 3 mirrors 000205 1786721789.295175 trunc from 0x025fb1 to 0x02ba4e (0x5a9e bytes) 000206 1786721789.328579 read 0x020c99 thru 0x0281d1 (0x7539 bytes) 000207 1786721789.339849 write 0x01ca7c thru 0x02924a (0xc7cf bytes) 000208 1786721789.348764 punch from 0x0077b6 to 0x0079b5 (0x200 bytes) 000209 1786721789.358146 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3afab): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afab): Mirror 4: 0xd83d9e0e (stale) Mirror 5: 0xd83d9e0e (stale) CRC-32 checksum value for chunk [0, 0x3afab): Mirror 1: 0xf4e1c015 Mirror 6: 0xf4e1c015 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afab: skipped 000210 1786721790.412437 MIRROR_RESYNC 4 mirrors 000211 1786721791.269635 mapread 0x02040f thru 0x02123c (0xe2e bytes) 000212 1786721791.280934 punch from 0x028238 to 0x03284c (0xa615 bytes) 000213 1786721791.320861 mapwrite 0x0198bf thru 0x01a95e (0x10a0 bytes) 000214 1786721791.352229 write 0x0102bf thru 0x019c09 (0x994b bytes) 000215 1786721791.361825 write 0x00be04 thru 0x0106f6 (0x48f3 bytes) 000216 1786721791.374034 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3afab): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afab): Mirror 4: 0xf4e1c015 (stale) Mirror 5: 0xf4e1c015 (stale) Mirror 6: 0xf4e1c015 (stale) CRC-32 checksum value for chunk [0, 0x3afab): Mirror 1: 0x2a497585 Mirror 7: 0x2a497585 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afab: skipped 000217 1786721792.074833 write 0x02e701 thru 0x031fe2 (0x38e2 bytes) 000218 1786721792.118796 mapread 0x00355c thru 0x00e200 (0xaca5 bytes) 000219 1786721792.140903 mapwrite 0x002fe7 thru 0x00b10a (0x8124 bytes) 000220 1786721792.158732 mapread 0x001098 thru 0x00fa8a (0xe9f3 bytes) 000221 1786721792.160031 write 0x0010d7 thru 0x00f0a5 (0xdfcf bytes) 000222 1786721792.162653 mapread 0x029ffe thru 0x03774a (0xd74d bytes) 000223 1786721792.186563 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3afab): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afab): Mirror 4: 0xf4e1c015 (stale) Mirror 5: 0xf4e1c015 (stale) Mirror 6: 0xf4e1c015 (stale) Mirror 7: 0x2a497585 (stale) CRC-32 checksum value for chunk [0, 0x3afab): Mirror 1: 0x9ef441b0 Mirror 8: 0x9ef441b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afab: skipped 000224 1786721793.049801 punch from 0x018b5e to 0x026eed (0xe390 bytes) 000225 1786721793.096480 punch from 0x03a005 to 0x03afaa (0xfa6 bytes) 000226 1786721793.101578 trunc from 0x0220a9 to 0x027ab8 (0x5a10 bytes) 000227 1786721793.105908 mapread 0x028c4f thru 0x03715a (0xe50c bytes) 000228 1786721793.144301 MIRROR_RESYNC 6 mirrors 000229 1786721794.687786 read 0x00de10 thru 0x019e08 (0xbff9 bytes) 000231 1786721794.701606 MIRROR_RESYNC 6 mirrors 000232 1786721795.291207 punch from 0x00ea4c to 0x014027 (0x55dc bytes) 000233 1786721795.333804 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3afab): Mirror 4: 0x1ce530cd (stale) Mirror 5: 0x1ce530cd (stale) Mirror 6: 0x1ce530cd (stale) Mirror 7: 0x1ce530cd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afab): Mirror 4: 0x1ce530cd (stale) Mirror 5: 0x1ce530cd (stale) Mirror 6: 0x1ce530cd (stale) Mirror 7: 0x1ce530cd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afab: skipped 000234 1786721795.710581 punch from 0x000076 to 0x005452 (0x53dd bytes) 000236 1786721795.723599 mapwrite 0x0061c2 thru 0x00de76 (0x7cb5 bytes) 000237 1786721795.772838 punch from 0x02f2c5 to 0x035975 (0x66b1 bytes) 000238 1786721795.778777 punch from 0x006371 to 0x0122bc (0xbf4c bytes) 000239 1786721795.784297 read 0x00ecc2 thru 0x010d6a (0x20a9 bytes) 000240 1786721795.789736 read 0x01c6af thru 0x023d70 (0x76c2 bytes) 000241 1786721795.801062 mapread 0x00de04 thru 0x014b73 (0x6d70 bytes) 000242 1786721795.802990 fallocate 0x013359 thru 0x0202b0 (0xcf58 bytes) 000243 1786721795.808500 punch from 0x00963d to 0x0140d8 (0xaa9c bytes) 000244 1786721795.812827 punch from 0x020719 to 0x0233a6 (0x2c8e bytes) 000245 1786721795.820925 read 0x000d48 thru 0x0014ce (0x787 bytes) 000246 1786721795.826508 MIRROR_RESYNC 5 mirrors 000247 1786721797.394405 read 0x02d9ad thru 0x03ad8a (0xd3de bytes) 000248 1786721797.418592 MIRROR_EXTEND to 6 mirrors 000249 1786721798.173407 write 0x02c34c thru 0x030ff8 (0x4cad bytes) 000250 1786721798.210833 mapwrite 0x0249e9 thru 0x0330fd (0xe715 bytes) 000251 1786721798.260227 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3afab): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afab): Mirror 4: 0xb05dc19b (stale) Mirror 5: 0xb05dc19b (stale) Mirror 6: 0xb05dc19b (stale) Mirror 7: 0xb05dc19b (stale) Mirror 8: 0xb05dc19b (stale) CRC-32 checksum value for chunk [0, 0x3afab): Mirror 1: 0x3faa16c6 Mirror 9: 0x3faa16c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afab: skipped 000252 1786721799.278528 trunc from 0x014a11 to 0x0156fc (0xcec bytes) 000253 1786721799.327053 read 0x02b6ff thru 0x02d1fe (0x1b00 bytes) 000255 1786721799.334395 trunc from 0x03afab to 0x011ef5 (0x290b5 bytes) 000257 1786721799.392968 trunc from 0x00f13f to 0x011ef5 (0x2db7 bytes) 000258 1786721799.398495 trunc from 0x00ff9e to 0x011ef5 (0x1f58 bytes) 000259 1786721799.402699 mapwrite 0x02f4a3 thru 0x03588b (0x63e9 bytes) 000260 1786721799.460912 mapwrite 0x039f93 thru 0x03ffff (0x606d bytes) 000261 1786721799.500587 read 0x01d9ed thru 0x022674 (0x4c88 bytes) 000262 1786721799.529434 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xaefd7a76 (stale) Mirror 5: 0xaefd7a76 (stale) Mirror 6: 0xaefd7a76 (stale) Mirror 7: 0xaefd7a76 (stale) Mirror 8: 0xaefd7a76 (stale) Mirror 9: 0x3a821083 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x27d59146 Mirror 10: 0x27d59146 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000263 1786721800.521745 mapwrite 0x038177 thru 0x03ffff (0x7e89 bytes) 000264 1786721800.673954 punch from 0x015899 to 0x0238a6 (0xe00e bytes) 000265 1786721800.684489 fallocate 0x01a7a9 thru 0x021da4 (0x75fc bytes) 000266 1786721800.696973 punch from 0x002cb9 to 0x011f9e (0xf2e6 bytes) 000267 1786721800.710435 write 0x006415 thru 0x0091a4 (0x2d90 bytes) 000268 1786721800.728545 write 0x0219e0 thru 0x02c39b (0xa9bc bytes) 000269 1786721800.740272 write 0x02358d thru 0x02f5fe (0xc072 bytes) 000270 1786721800.747476 read 0x01b1bb thru 0x01d5bc (0x2402 bytes) 000271 1786721800.753258 trunc from 0x040000 to 0x02668d (0x19972 bytes) 000272 1786721800.800130 mapread 0x01621e thru 0x0250ba (0xee9d bytes) 000273 1786721800.824664 mapread 0x00dbec thru 0x017124 (0x9539 bytes) 000274 1786721800.840642 trunc from 0x025fa1 to 0x02668d (0x6ed bytes) 000275 1786721800.879047 mapwrite 0x02e460 thru 0x030b78 (0x2719 bytes) 000276 1786721800.956902 trunc from 0x0290d5 to 0x030b78 (0x7aa4 bytes) 000277 1786721800.973652 read 0x00eca0 thru 0x018ac2 (0x9e23 bytes) 000279 1786721800.977148 punch from 0x02ade2 to 0x030b78 (0x5d97 bytes) 000280 1786721800.991014 MIRROR_RESYNC 8 mirrors 000281 1786721802.903231 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) 000282 1786721803.340203 mapwrite 0x022bd8 thru 0x032124 (0xf54d bytes) 000283 1786721803.524843 fallocate 0x02468c thru 0x02f931 (0xb2a6 bytes) 000284 1786721803.536622 punch from 0x02a4db to 0x032124 (0x7c4a bytes) 000285 1786721803.542843 write 0x008da4 thru 0x015a9b (0xccf8 bytes) 000286 1786721803.554575 trunc from 0x016bf0 to 0x020bbc (0x9fcd bytes) 000288 1786721803.560861 mapread 0x0214de thru 0x025292 (0x3db5 bytes) 000289 1786721803.562328 write 0x00cc7e thru 0x010feb (0x436e bytes) 000290 1786721803.564260 trunc from 0x01644a to 0x023528 (0xd0df bytes) 000291 1786721803.573874 MIRROR_RESYNC 7 mirrors 000292 1786721805.330095 MIRROR_EXTEND to 8 mirrors 000293 1786721806.380441 MIRROR_EXTEND to 9 mirrors 000294 1786721807.185006 fallocate 0x010c3f thru 0x011039 (0x3fb bytes) 000295 1786721807.234466 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32125): Mirror 4: 0xeb71532a (stale) Mirror 5: 0xeb71532a (stale) Mirror 6: 0xeb71532a (stale) Mirror 8: 0xeb71532a (stale) Mirror 9: 0xeb71532a (stale) Mirror 10: 0xeb71532a (stale) Mirror 12: 0xeb71532a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32125): Mirror 4: 0xeb71532a (stale) Mirror 5: 0xeb71532a (stale) Mirror 6: 0xeb71532a (stale) Mirror 8: 0xeb71532a (stale) Mirror 9: 0xeb71532a (stale) Mirror 10: 0xeb71532a (stale) Mirror 12: 0xeb71532a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32125: skipped 000296 1786721807.907846 trunc from 0x032125 to 0x02e4d6 (0x3c4e bytes) 000297 1786721807.930103 read 0x00ffbf thru 0x01df06 (0xdf48 bytes) 000298 1786721807.947229 mapread 0x010e95 thru 0x0149ab (0x3b17 bytes) 000299 1786721807.949277 mapread 0x009edc thru 0x011bac (0x7cd1 bytes) 000300 1786721807.983570 fallocate 0x00ce20 thru 0x018ce7 (0xbec8 bytes) 000301 1786721807.996705 punch from 0x029d8f to 0x02e4d6 (0x4748 bytes) 000302 1786721808.009692 write 0x03591f thru 0x03d1f5 (0x78d7 bytes) 000303 1786721808.020315 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d1f6): Mirror 4: 0xe3cdcf0a (stale) Mirror 6: 0xe3cdcf0a (stale) Mirror 8: 0xe3cdcf0a (stale) Mirror 9: 0xe3cdcf0a (stale) Mirror 10: 0xe3cdcf0a (stale) Mirror 12: 0xe3cdcf0a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d1f6): Mirror 4: 0xe3cdcf0a (stale) Mirror 6: 0xe3cdcf0a (stale) Mirror 8: 0xe3cdcf0a (stale) Mirror 9: 0xe3cdcf0a (stale) Mirror 10: 0xe3cdcf0a (stale) Mirror 12: 0xe3cdcf0a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d1f6: skipped 000304 1786721808.647668 fallocate 0x02e2e5 thru 0x032679 (0x4395 bytes) 000308 1786721808.659536 write 0x00d2d9 thru 0x00f8d1 (0x25f9 bytes) 000309 1786721808.676022 mapwrite 0x0048df thru 0x01029e (0xb9c0 bytes) 000310 1786721808.765640 trunc from 0x03d1f6 to 0x023deb (0x1940a bytes) 000311 1786721808.791361 write 0x0175ce thru 0x01f54a (0x7f7d bytes) 000312 1786721808.801087 mapwrite 0x03eeac thru 0x03ffff (0x1154 bytes) 000313 1786721808.844611 punch from 0x019eaf to 0x01d8b8 (0x3a0a bytes) 000314 1786721808.859783 read 0x010f4b thru 0x019e8a (0x8f40 bytes) 000315 1786721808.877722 trunc from 0x014917 to 0x022081 (0xd76b bytes) 000316 1786721808.882830 trunc from 0x040000 to 0x0170a7 (0x28f58 bytes) 000317 1786721808.896785 write 0x027bee thru 0x02a802 (0x2c15 bytes) 000318 1786721808.898237 mapread 0x01453d thru 0x01d9cd (0x9491 bytes) 000320 1786721808.915082 punch from 0x00ee13 to 0x012d13 (0x3f01 bytes) 000321 1786721808.919643 mapwrite 0x020660 thru 0x025bb0 (0x5551 bytes) 000322 1786721808.937265 fallocate 0x03b870 thru 0x03ffff (0x4790 bytes) 000323 1786721808.942815 read 0x00ffeb thru 0x01800b (0x8021 bytes) 000324 1786721808.951999 write 0x01688b thru 0x01f2d0 (0x8a46 bytes) 000325 1786721808.953556 mapread 0x039086 thru 0x03c49a (0x3415 bytes) 000327 1786721808.956002 read 0x014bd8 thru 0x016420 (0x1849 bytes) 000328 1786721808.957764 mapwrite 0x006366 thru 0x0074e8 (0x1183 bytes) 000329 1786721808.975105 read 0x03bf78 thru 0x03f184 (0x320d bytes) 000330 1786721808.979563 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1bc1b968 (stale) Mirror 8: 0x1bc1b968 (stale) Mirror 9: 0x1bc1b968 (stale) Mirror 10: 0x1bc1b968 (stale) Mirror 12: 0x1bc1b968 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1bc1b968 (stale) Mirror 8: 0x1bc1b968 (stale) Mirror 9: 0x1bc1b968 (stale) Mirror 10: 0x1bc1b968 (stale) Mirror 12: 0x1bc1b968 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000331 1786721809.363862 trunc from 0x017278 to 0x017d46 (0xacf bytes) 000332 1786721809.372354 trunc from 0x021fd2 to 0x028e8b (0x6eba bytes) 000333 1786721809.381083 write 0x02f259 thru 0x03d259 (0xe001 bytes) 000334 1786721809.412044 MIRROR_RESYNC 6 mirrors 000335 1786721811.346931 mapread 0x0042f9 thru 0x0086d0 (0x43d8 bytes) 000337 1786721811.369498 trunc from 0x040000 to 0x024673 (0x1b98c bytes) 000339 1786721811.422020 MIRROR_RESYNC 6 mirrors 000341 1786721813.055978 fallocate 0x027915 thru 0x02a8ed (0x2fd9 bytes) 000342 1786721813.088679 punch from 0x021660 to 0x023819 (0x21ba bytes) 000343 1786721813.099340 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2a8ee): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a8ee): Mirror 4: 0xba9b2c77 (stale) Mirror 8: 0xba9b2c77 (stale) Mirror 9: 0xba9b2c77 (stale) Mirror 10: 0xba9b2c77 (stale) Mirror 12: 0xba9b2c77 (stale) CRC-32 checksum value for chunk [0, 0x2a8ee): Mirror 1: 0x63e63cb8 Mirror 13: 0x63e63cb8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a8ee: skipped 000344 1786721814.078191 mapread 0x02a37a thru 0x02a8ed (0x574 bytes) 000345 1786721814.100839 fallocate 0x010753 thru 0x01e89e (0xe14c bytes) 000347 1786721814.134424 fallocate 0x02a6bb thru 0x02d854 (0x319a bytes) 000348 1786721814.141291 punch from 0x029cff to 0x02a8ed (0xbef bytes) 000349 1786721814.147928 mapwrite 0x01d43d thru 0x02cb00 (0xf6c4 bytes) 000350 1786721814.269508 mapread 0x01b2c0 thru 0x01cbe3 (0x1924 bytes) 000351 1786721814.284571 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2cb01): Mirror 4: 0x2096a4ce (stale) Mirror 8: 0x2096a4ce (stale) Mirror 9: 0x2096a4ce (stale) Mirror 10: 0x2096a4ce (stale) Mirror 12: 0x2096a4ce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cb01): Mirror 4: 0x2096a4ce (stale) Mirror 8: 0x2096a4ce (stale) Mirror 9: 0x2096a4ce (stale) Mirror 10: 0x2096a4ce (stale) Mirror 12: 0x2096a4ce (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cb01: skipped 000352 1786721814.742424 mapread 0x02395d thru 0x02cb00 (0x91a4 bytes) 000353 1786721814.770684 trunc from 0x02cb01 to 0x017280 (0x15880 bytes) 000354 1786721814.812919 write 0x02f4d0 thru 0x03e042 (0xeb73 bytes) 000355 1786721814.824150 MIRROR_RESYNC 6 mirrors 000356 1786721816.390587 fallocate 0x006b43 thru 0x011952 (0xae10 bytes) 000357 1786721816.425579 trunc from 0x00dd8e to 0x01d43d (0xf6b0 bytes) 000358 1786721816.431408 punch from 0x03cddb to 0x03e042 (0x1268 bytes) 000359 1786721816.437669 read 0x030dc6 thru 0x038205 (0x7440 bytes) 000360 1786721816.448546 punch from 0x010f00 to 0x016c2d (0x5d2e bytes) 000361 1786721816.453952 trunc from 0x03e043 to 0x03ae52 (0x31f0 bytes) 000362 1786721816.478978 write 0x009d96 thru 0x015563 (0xb7ce bytes) 000364 1786721816.492530 fallocate 0x01bf66 thru 0x01fa57 (0x3af2 bytes) 000365 1786721816.500536 trunc from 0x018b61 to 0x01e83f (0x5cdf bytes) 000366 1786721816.505455 fallocate 0x005887 thru 0x012879 (0xcff3 bytes) 000367 1786721816.513276 trunc from 0x02eb66 to 0x0324f7 (0x3992 bytes) 000368 1786721816.518503 write 0x007e2e thru 0x00fafd (0x7cd0 bytes) 000369 1786721816.529517 fallocate 0x00c2d5 thru 0x012026 (0x5d52 bytes) 000370 1786721816.535556 punch from 0x012723 to 0x01d05c (0xa93a bytes) 000371 1786721816.555324 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3ae53): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae53): Mirror 4: 0x9eb32299 (stale) Mirror 8: 0x9eb32299 (stale) Mirror 9: 0x9eb32299 (stale) Mirror 10: 0x9eb32299 (stale) Mirror 12: 0x9eb32299 (stale) CRC-32 checksum value for chunk [0, 0x3ae53): Mirror 1: 0xb1a3991a Mirror 13: 0xb1a3991a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae53: skipped 000372 1786721817.280825 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3ae53): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae53): Mirror 4: 0x9eb32299 (stale) Mirror 8: 0x9eb32299 (stale) Mirror 9: 0x9eb32299 (stale) Mirror 10: 0x9eb32299 (stale) Mirror 12: 0x9eb32299 (stale) CRC-32 checksum value for chunk [0, 0x3ae53): Mirror 1: 0xb1a3991a Mirror 13: 0xb1a3991a Mirror 14: 0xb1a3991a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae53: skipped 000373 1786721818.269962 read 0x00d789 thru 0x011a29 (0x42a1 bytes) 000374 1786721818.282300 punch from 0x00be85 to 0x01bc0f (0xfd8b bytes) 000375 1786721818.387289 trunc from 0x038e83 to 0x03ae52 (0x1fd0 bytes) 000376 1786721818.396329 trunc from 0x03ae53 to 0x01c336 (0x1eb1c bytes) 000377 1786721818.484873 trunc from 0x01c337 to 0x03158b (0x15255 bytes) 000378 1786721818.526151 fallocate 0x01e8f2 thru 0x01f286 (0x995 bytes) 000379 1786721818.538417 mapwrite 0x016555 thru 0x023522 (0xcfce bytes) 000380 1786721818.728333 trunc from 0x03158c to 0x01494f (0x1cc3c bytes) 000381 1786721818.747294 read 0x005c1e thru 0x011d6d (0xc150 bytes) 000382 1786721818.763536 mapread 0x0105b4 thru 0x01303c (0x2a89 bytes) 000383 1786721818.768796 MIRROR_RESYNC 8 mirrors 000384 1786721820.239551 write 0x03cd3d thru 0x03d4f4 (0x7b8 bytes) 000385 1786721820.268700 write 0x013e20 thru 0x014157 (0x338 bytes) 000386 1786721820.278245 mapread 0x020b48 thru 0x02817e (0x7637 bytes) 000388 1786721820.292597 read 0x00078b thru 0x006dd7 (0x664d bytes) 000389 1786721820.298910 trunc from 0x03d4f5 to 0x030eff (0xc5f5 bytes) 000391 1786721820.316341 read 0x01ef6a thru 0x02aed6 (0xbf6d bytes) 000392 1786721820.317122 fallocate 0x009891 thru 0x01152d (0x7c9d bytes) 000393 1786721820.322351 write 0x027206 thru 0x033a14 (0xc80f bytes) 000394 1786721820.324837 punch from 0x02f800 to 0x031582 (0x1d83 bytes) 000395 1786721820.342211 read 0x0139be thru 0x01f475 (0xbab8 bytes) 000396 1786721820.350224 read 0x029bfb thru 0x02a2c0 (0x6c6 bytes) 000397 1786721820.351333 punch from 0x02b63f to 0x02df33 (0x28f5 bytes) 000398 1786721820.359103 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33a15): Mirror 4: 0x8d589a8f (stale) Mirror 8: 0x8d589a8f (stale) Mirror 9: 0x8d589a8f (stale) Mirror 10: 0x8d589a8f (stale) Mirror 12: 0x8d589a8f (stale) Mirror 13: 0x8d589a8f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33a15): Mirror 4: 0x8d589a8f (stale) Mirror 8: 0x8d589a8f (stale) Mirror 9: 0x8d589a8f (stale) Mirror 10: 0x8d589a8f (stale) Mirror 12: 0x8d589a8f (stale) Mirror 13: 0x8d589a8f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33a15: skipped 000399 1786721820.916730 fallocate 0x009c85 thru 0x019022 (0xf39e bytes) 000400 1786721820.926101 fallocate 0x00dd2d thru 0x013380 (0x5654 bytes) 000401 1786721820.933784 mapwrite 0x031132 thru 0x038598 (0x7467 bytes) 000402 1786721820.993843 mapread 0x01b598 thru 0x0240a2 (0x8b0b bytes) 000403 1786721821.015970 punch from 0x027657 to 0x027d07 (0x6b1 bytes) 000404 1786721821.021795 mapread 0x03457e thru 0x03603b (0x1abe bytes) 000405 1786721821.024332 mapwrite 0x03cb1e thru 0x03ffff (0x34e2 bytes) 000406 1786721821.068343 MIRROR_RESYNC 7 mirrors 000407 1786721823.808229 mapread 0x002195 thru 0x0063cb (0x4237 bytes) 000408 1786721823.856428 trunc from 0x02b815 to 0x0379b5 (0xc1a1 bytes) 000409 1786721823.894714 trunc from 0x006987 to 0x012c38 (0xc2b2 bytes) 000410 1786721823.915687 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x7428e4d2 (stale) Mirror 8: 0x7428e4d2 (stale) Mirror 9: 0x7428e4d2 (stale) Mirror 12: 0x7428e4d2 (stale) Mirror 13: 0x7428e4d2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x7428e4d2 (stale) Mirror 8: 0x7428e4d2 (stale) Mirror 9: 0x7428e4d2 (stale) Mirror 12: 0x7428e4d2 (stale) Mirror 13: 0x7428e4d2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000411 1786721824.470807 write 0x00658e thru 0x007c0d (0x1680 bytes) 000412 1786721824.484937 mapwrite 0x032fb4 thru 0x03acd3 (0x7d20 bytes) 000413 1786721824.534409 mapwrite 0x00c3cb thru 0x019e2d (0xda63 bytes) 000414 1786721824.623875 trunc from 0x0128dd to 0x016142 (0x3866 bytes) 000415 1786721824.631715 mapread 0x03de5e thru 0x03ffff (0x21a2 bytes) 000416 1786721824.646007 punch from 0x005cb7 to 0x0098b8 (0x3c02 bytes) 000417 1786721824.655620 punch from 0x034fdb to 0x03ffff (0xb025 bytes) 000418 1786721824.662236 mapwrite 0x0327fe thru 0x03f0c7 (0xc8ca bytes) 000419 1786721824.731094 punch from 0x0063a5 to 0x015af8 (0xf754 bytes) 000421 1786721824.740058 read 0x026bc6 thru 0x0362f8 (0xf733 bytes) 000422 1786721824.759286 fallocate 0x035fcb thru 0x03810f (0x2145 bytes) 000423 1786721824.766105 mapread 0x02baae thru 0x0315a8 (0x5afb bytes) 000424 1786721824.768976 trunc from 0x00e0ba to 0x011970 (0x38b7 bytes) 000425 1786721824.790155 punch from 0x02aa88 to 0x02ba46 (0xfbf bytes) 000426 1786721824.809092 mapread 0x00d428 thru 0x015014 (0x7bed bytes) 000427 1786721824.824466 punch from 0x036e8e to 0x03a43e (0x35b1 bytes) 000428 1786721824.834399 mapread 0x012771 thru 0x01ac96 (0x8526 bytes) 000429 1786721824.851305 trunc from 0x040000 to 0x038daf (0x7250 bytes) 000430 1786721824.871167 trunc from 0x021898 to 0x02b10b (0x9874 bytes) 000431 1786721824.878908 write 0x01467a thru 0x019327 (0x4cae bytes) 000432 1786721824.881004 write 0x007a82 thru 0x015027 (0xd5a6 bytes) 000433 1786721824.883334 trunc from 0x03579a to 0x038daf (0x3616 bytes) 000434 1786721824.897019 fallocate 0x02d397 thru 0x0307cd (0x3437 bytes) 000435 1786721824.910058 trunc from 0x015276 to 0x01a07e (0x4e09 bytes) 000436 1786721824.943890 trunc from 0x038db0 to 0x015064 (0x23d4b bytes) 000437 1786721824.968186 trunc from 0x015065 to 0x014003 (0x1061 bytes) 000439 1786721825.004030 read 0x00d958 thru 0x014003 (0x66ac bytes) 000440 1786721825.011010 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x14004): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14004): Mirror 4: 0x28c0a17e (stale) Mirror 8: 0x28c0a17e (stale) Mirror 9: 0x28c0a17e (stale) Mirror 12: 0x28c0a17e (stale) Mirror 13: 0x28c0a17e (stale) CRC-32 checksum value for chunk [0, 0x14004): Mirror 1: 0x9fb457d2 Mirror 14: 0x9fb457d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14004: skipped 000441 1786721826.230316 write 0x02d2e0 thru 0x02e9ab (0x16cc bytes) 000442 1786721826.292484 write 0x007f47 thru 0x016689 (0xe743 bytes) 000443 1786721826.303779 trunc from 0x02e9ac to 0x00d29f (0x2170c bytes) 000444 1786721826.335758 read 0x00506a thru 0x00d29f (0x8236 bytes) 000445 1786721826.354516 punch from 0x0098b4 to 0x00d29f (0x39ec bytes) 000446 1786721826.383717 write 0x01942c thru 0x01bad7 (0x26ac bytes) 000447 1786721826.386272 trunc from 0x01bad8 to 0x0369df (0x1af08 bytes) 000448 1786721826.412294 MIRROR_RESYNC 7 mirrors 000449 1786721828.662871 trunc from 0x028d86 to 0x02b5f7 (0x2872 bytes) 000450 1786721828.703947 punch from 0x03033e to 0x033122 (0x2de5 bytes) 000451 1786721828.710205 trunc from 0x0192e2 to 0x02195b (0x867a bytes) 000452 1786721828.717664 trunc from 0x019fe0 to 0x01fd40 (0x5d61 bytes) 000453 1786721828.722446 trunc from 0x0369e0 to 0x001432 (0x355ad bytes) 000454 1786721828.797421 mapwrite 0x037f7b thru 0x03ffff (0x8085 bytes) 000455 1786721828.881930 mapwrite 0x03d62f thru 0x03ffff (0x29d1 bytes) 000456 1786721828.895099 mapwrite 0x026fdd thru 0x036bc2 (0xfbe6 bytes) 000457 1786721828.933336 trunc from 0x040000 to 0x02d58f (0x12a70 bytes) 000458 1786721828.949772 mapwrite 0x00f76d thru 0x0112bd (0x1b51 bytes) 000459 1786721829.001422 MIRROR_RESYNC 7 mirrors 000460 1786721830.300150 fallocate 0x032d47 thru 0x03f21d (0xc4d7 bytes) 000461 1786721830.357639 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f21e): Mirror 4: 0x8c4fbef0 (stale) Mirror 8: 0x8c4fbef0 (stale) Mirror 9: 0x8c4fbef0 (stale) Mirror 13: 0x8c4fbef0 (stale) Mirror 14: 0x8c4fbef0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f21e): Mirror 4: 0x8c4fbef0 (stale) Mirror 8: 0x8c4fbef0 (stale) Mirror 9: 0x8c4fbef0 (stale) Mirror 13: 0x8c4fbef0 (stale) Mirror 14: 0x8c4fbef0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f21e: skipped 000462 1786721831.001061 read 0x02660e thru 0x034664 (0xe057 bytes) 000463 1786721831.023560 read 0x018395 thru 0x022979 (0xa5e5 bytes) 000464 1786721831.060176 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3f21e): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f21e): Mirror 4: 0x8c4fbef0 (stale) Mirror 8: 0x8c4fbef0 (stale) Mirror 9: 0x8c4fbef0 (stale) Mirror 13: 0x8c4fbef0 (stale) Mirror 14: 0x8c4fbef0 (stale) CRC-32 checksum value for chunk [0, 0x3f21e): Mirror 1: 0x8c4fbef0 Mirror 15: 0x8c4fbef0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f21e: skipped 000465 1786721832.011676 trunc from 0x03f21e to 0x00fe95 (0x2f388 bytes) 000466 1786721832.090775 read 0x003802 thru 0x00bddb (0x85da bytes) 000467 1786721832.106216 mapread 0x00bf5c thru 0x00fe95 (0x3f3a bytes) 000468 1786721832.135154 fallocate 0x008787 thru 0x00e8ec (0x6166 bytes) 000469 1786721832.140281 fallocate 0x03eeff thru 0x03ffff (0x1101 bytes) 000470 1786721832.150923 MIRROR_RESYNC 7 mirrors 000471 1786721833.590120 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) 000473 1786721834.142928 mapread 0x03b385 thru 0x03c17a (0xdf6 bytes) 000474 1786721834.166981 punch from 0x006dd7 to 0x0146c2 (0xd8ec bytes) 000475 1786721834.242866 mapread 0x025e6c thru 0x033c2a (0xddbf bytes) 000476 1786721834.256898 write 0x035c87 thru 0x03ffff (0xa379 bytes) 000477 1786721834.263000 trunc from 0x0311af to 0x0382b8 (0x710a bytes) 000478 1786721834.281746 trunc from 0x040000 to 0x039426 (0x6bd9 bytes) 000479 1786721834.305266 trunc from 0x00104c to 0x00ef6f (0xdf24 bytes) 000480 1786721834.312645 mapread 0x019cad thru 0x020ea9 (0x71fd bytes) 000482 1786721834.326972 punch from 0x001e63 to 0x00b0f1 (0x928f bytes) 000483 1786721834.332969 read 0x005e02 thru 0x00d158 (0x7357 bytes) 000484 1786721834.340648 fallocate 0x019b77 thru 0x01be59 (0x22e3 bytes) 000486 1786721834.348349 trunc from 0x000d71 to 0x006a53 (0x5ce3 bytes) 000487 1786721834.356986 mapwrite 0x02631e thru 0x0282fe (0x1fe1 bytes) 000488 1786721834.372821 mapread 0x028bf1 thru 0x02e2c7 (0x56d7 bytes) 000489 1786721834.374064 write 0x02cc1a thru 0x03c1ae (0xf595 bytes) 000490 1786721834.376145 trunc from 0x03c1af to 0x0068d9 (0x358d5 bytes) 000491 1786721834.396986 mapwrite 0x003b6f thru 0x01273b (0xebcd bytes) 000492 1786721834.453546 read 0x00b4bb thru 0x00cd74 (0x18ba bytes) 000493 1786721834.454524 trunc from 0x01273c to 0x0158e2 (0x31a7 bytes) 000494 1786721834.475615 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x158e3): Mirror 8: 0x2d77feed (stale) Mirror 9: 0x2d77feed (stale) Mirror 13: 0x2d77feed (stale) Mirror 14: 0x2d77feed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x158e3): Mirror 8: 0x2d77feed (stale) Mirror 9: 0x2d77feed (stale) Mirror 13: 0x2d77feed (stale) Mirror 14: 0x2d77feed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x158e3: skipped 000495 1786721834.876193 read 0x00e3f3 thru 0x0158e2 (0x74f0 bytes) 000496 1786721834.889055 mapwrite 0x021fe3 thru 0x02a13b (0x8159 bytes) 000497 1786721834.950047 mapwrite 0x01daf6 thru 0x028782 (0xac8d bytes) 000498 1786721834.965798 mapread 0x01d083 thru 0x0276a6 (0xa624 bytes) 000499 1786721834.968267 read 0x01355f thru 0x02068c (0xd12e bytes) 000500 1786721834.980552 trunc from 0x02a13c to 0x00c39f (0x1dd9c bytes) 000501 1786721834.995078 trunc from 0x002521 to 0x003925 (0x1405 bytes) 000502 1786721834.999968 trunc from 0x00c03e to 0x00c39f (0x362 bytes) 000503 1786721835.005658 punch from 0x006a96 to 0x00760b (0xb76 bytes) 000504 1786721835.010608 read 0x009323 thru 0x00c39f (0x307d bytes) 000505 1786721835.017153 read 0x004111 thru 0x00c39f (0x828f bytes) 000506 1786721835.018287 read 0x00b9b6 thru 0x00c39f (0x9ea bytes) 000507 1786721835.019178 trunc from 0x006548 to 0x00a637 (0x40f0 bytes) 000508 1786721835.023985 mapwrite 0x01b8b1 thru 0x029c3f (0xe38f bytes) 000509 1786721835.066001 read 0x0108f3 thru 0x01eb8d (0xe29b bytes) 000510 1786721835.066825 trunc from 0x01cc21 to 0x029c3f (0xd01f bytes) 000511 1786721835.071678 mapwrite 0x03b9f1 thru 0x03ffff (0x460f bytes) 000512 1786721835.110203 trunc from 0x0022b5 to 0x00dbb5 (0xb901 bytes) 000513 1786721835.115304 mapread 0x0174a1 thru 0x01ac7b (0x37db bytes) 000514 1786721835.117105 mapwrite 0x003b99 thru 0x00408e (0x4f6 bytes) 000515 1786721835.136848 fallocate 0x036588 thru 0x03ffff (0x9a78 bytes) 000516 1786721835.160939 write 0x003b57 thru 0x006a37 (0x2ee1 bytes) 000517 1786721835.176796 read 0x03b7a5 thru 0x03ffff (0x485b bytes) 000518 1786721835.184246 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x85a1d8bb (stale) Mirror 13: 0x85a1d8bb (stale) Mirror 14: 0x85a1d8bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x85a1d8bb (stale) Mirror 13: 0x85a1d8bb (stale) Mirror 14: 0x85a1d8bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000519 1786721835.566359 punch from 0x003acf to 0x00a80f (0x6d41 bytes) 000520 1786721835.573808 punch from 0x0132ac to 0x01b6a3 (0x83f8 bytes) 000521 1786721835.581596 fallocate 0x038199 thru 0x03ffff (0x7e67 bytes) 000522 1786721835.591773 mapwrite 0x0031ae thru 0x00db76 (0xa9c9 bytes) 000523 1786721835.638231 trunc from 0x040000 to 0x02b9ee (0x14611 bytes) 000524 1786721835.663234 write 0x032aae thru 0x03e8b2 (0xbe05 bytes) 000525 1786721835.664991 write 0x029622 thru 0x02fc93 (0x6672 bytes) 000526 1786721835.682696 MIRROR_RESYNC 4 mirrors 000527 1786721837.230588 write 0x0168f6 thru 0x024020 (0xd72b bytes) 000528 1786721837.267178 trunc from 0x02b340 to 0x034641 (0x9302 bytes) 000529 1786721837.281258 read 0x0366dd thru 0x03e8b2 (0x81d6 bytes) 000530 1786721837.290037 mapwrite 0x0154cb thru 0x018a25 (0x355b bytes) 000532 1786721837.313097 mapwrite 0x00dc88 thru 0x019435 (0xb7ae bytes) 000533 1786721837.346324 trunc from 0x026fb7 to 0x0284e3 (0x152d bytes) 000534 1786721837.352229 punch from 0x0039ce to 0x007d53 (0x4386 bytes) 000535 1786721837.358712 mapread 0x0209a1 thru 0x02b8ed (0xaf4d bytes) 000536 1786721837.370201 trunc from 0x008ad8 to 0x00ddeb (0x5314 bytes) 000537 1786721837.379750 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e8b3): Mirror 13: 0xe6f93610 (stale) Mirror 14: 0xe6f93610 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e8b3): Mirror 13: 0xe6f93610 (stale) Mirror 14: 0xe6f93610 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e8b3: skipped 000538 1786721837.772074 write 0x01c144 thru 0x02a44d (0xe30a bytes) 000539 1786721837.787118 punch from 0x03e2f7 to 0x03e8b2 (0x5bc bytes) 000540 1786721837.791678 mapread 0x0193ca thru 0x01f7ca (0x6401 bytes) 000541 1786721837.810933 punch from 0x02e878 to 0x03d0c9 (0xe852 bytes) 000542 1786721837.817624 punch from 0x0197f6 to 0x027dcc (0xe5d7 bytes) 000543 1786721837.836941 mapread 0x002b6a thru 0x007591 (0x4a28 bytes) 000544 1786721837.848790 punch from 0x034502 to 0x03d7bc (0x92bb bytes) 000547 1786721837.858823 trunc from 0x03e8b3 to 0x003bcd (0x3ace5 bytes) 000548 1786721837.894644 read 0x002c60 thru 0x003bcd (0xf6e bytes) 000549 1786721837.896951 write 0x03ca8a thru 0x03cc19 (0x190 bytes) 000550 1786721837.898861 trunc from 0x00a516 to 0x016832 (0xc31d bytes) 000551 1786721837.904631 fallocate 0x03e2e2 thru 0x03ffff (0x1d1e bytes) 000552 1786721837.944533 MIRROR_RESYNC 3 mirrors 000553 1786721838.754611 read 0x02615c thru 0x02becb (0x5d70 bytes) 000554 1786721838.761627 mapread 0x003e58 thru 0x00cfd0 (0x9179 bytes) 000555 1786721838.785504 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) 000556 1786721839.147929 trunc from 0x017abf to 0x024575 (0xcab7 bytes) 000558 1786721839.193617 trunc from 0x03cc1a to 0x038ead (0x3d6c bytes) 000559 1786721839.229887 trunc from 0x038eae to 0x033278 (0x5c35 bytes) 000560 1786721839.252833 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) 000561 1786721839.404476 mapwrite 0x0116eb thru 0x01dc5b (0xc571 bytes) 000562 1786721839.470775 trunc from 0x0056d2 to 0x0141bb (0xeaea bytes) 000565 1786721839.478977 write 0x03a40b thru 0x03ffff (0x5bf5 bytes) 000566 1786721839.488839 read 0x02fb7f thru 0x039d3f (0xa1c1 bytes) 000567 1786721839.501107 trunc from 0x040000 to 0x039471 (0x6b8e bytes) 000568 1786721839.527494 mapwrite 0x027dad thru 0x033b03 (0xbd57 bytes) 000569 1786721839.564672 write 0x01dae8 thru 0x0222b5 (0x47ce bytes) 000570 1786721839.567015 punch from 0x01212d to 0x014575 (0x2449 bytes) 000571 1786721839.572010 mapread 0x037580 thru 0x039471 (0x1ef2 bytes) 000572 1786721839.573435 mapread 0x039135 thru 0x039471 (0x33d bytes) 000573 1786721839.576118 punch from 0x00b778 to 0x01479f (0x9028 bytes) 000574 1786721839.581685 read 0x038930 thru 0x039471 (0xb42 bytes) 000575 1786721839.582466 read 0x010e3c thru 0x018637 (0x77fc bytes) 000576 1786721839.592764 trunc from 0x039472 to 0x008416 (0x3105b bytes) 000578 1786721839.612482 punch from 0x001e67 to 0x008416 (0x65b0 bytes) 000579 1786721839.622905 fallocate 0x0051a9 thru 0x00c0e7 (0x6f3f bytes) 000580 1786721839.633304 read 0x003b0a thru 0x005b4e (0x2045 bytes) 000581 1786721839.643715 fallocate 0x01a4cd thru 0x01f4f2 (0x5026 bytes) 000582 1786721839.648976 read 0x01b9b0 thru 0x01f4f2 (0x3b43 bytes) 000583 1786721839.658903 write 0x03cd42 thru 0x03ffff (0x32be bytes) 000584 1786721839.660807 read 0x0058b9 thru 0x0128b8 (0xd000 bytes) 000585 1786721839.661754 trunc from 0x027d23 to 0x03248c (0xa76a bytes) 000586 1786721839.666117 fallocate 0x037615 thru 0x03ffff (0x89eb bytes) 000587 1786721839.670860 trunc from 0x02fa66 to 0x0320a0 (0x263b bytes) 000588 1786721839.675269 mapread 0x0357af thru 0x03ffff (0xa851 bytes) 000589 1786721839.691079 mapwrite 0x024570 thru 0x024fab (0xa3c bytes) 000591 1786721839.705865 write 0x035757 thru 0x039fd6 (0x4880 bytes) 000592 1786721839.707164 punch from 0x00c06a to 0x00e596 (0x252d bytes) 000593 1786721839.714159 trunc from 0x00ff1f to 0x011798 (0x187a bytes) 000594 1786721839.720695 fallocate 0x016ce1 thru 0x02672b (0xfa4b bytes) 000595 1786721839.734113 trunc from 0x01655d to 0x022945 (0xc3e9 bytes) 000596 1786721839.740191 read 0x03a0b1 thru 0x03ffff (0x5f4f bytes) 000598 1786721839.741360 fallocate 0x035940 thru 0x03ffff (0xa6c0 bytes) 000600 1786721839.746361 read 0x0359aa thru 0x03ffff (0xa656 bytes) 000601 1786721839.746989 punch from 0x027314 to 0x02ffd8 (0x8cc5 bytes) 000603 1786721839.755996 trunc from 0x004785 to 0x00bc4a (0x74c6 bytes) 000604 1786721839.761441 punch from 0x01e0c1 to 0x01efe9 (0xf29 bytes) 000605 1786721839.765608 write 0x003218 thru 0x004442 (0x122b bytes) 000608 1786721839.794598 trunc from 0x040000 to 0x01c1be (0x23e41 bytes) 000610 1786721839.815724 punch from 0x01b979 to 0x01c1be (0x846 bytes) 000611 1786721839.820228 trunc from 0x01acf4 to 0x01c1be (0x14cb bytes) 000612 1786721839.825254 mapread 0x0111cc thru 0x01c1be (0xaff3 bytes) 000613 1786721839.841857 punch from 0x00c3d1 to 0x018766 (0xc396 bytes) 000614 1786721839.847172 write 0x01486a thru 0x01b826 (0x6fbd bytes) 000615 1786721839.856972 fallocate 0x03a38c thru 0x03ffff (0x5c74 bytes) 000617 1786721839.868844 trunc from 0x040000 to 0x021036 (0x1efc9 bytes) 000618 1786721839.889947 read 0x01ef6e thru 0x021036 (0x20c9 bytes) 000619 1786721839.904937 MIRROR_EXTEND to 2 mirrors 000620 1786721840.625870 MIRROR_RESYNC 2 mirrors 000621 1786721840.960137 mapread 0x0121d0 thru 0x01b906 (0x9737 bytes) 000622 1786721841.013328 MIRROR_EXTEND to 3 mirrors 000623 1786721841.787039 trunc from 0x010e6e to 0x01b356 (0xa4e9 bytes) 000624 1786721841.866785 trunc from 0x015dc1 to 0x020d6f (0xafaf bytes) 000625 1786721841.886211 MIRROR_RESYNC 3 mirrors 000626 1786721842.765780 punch from 0x00fe1e to 0x013b2e (0x3d11 bytes) 000627 1786721842.803694 trunc from 0x0201ec to 0x021036 (0xe4b bytes) 000628 1786721842.808923 fallocate 0x035ef6 thru 0x03a915 (0x4a20 bytes) 000629 1786721842.815716 trunc from 0x0033d8 to 0x00a63b (0x7264 bytes) 000630 1786721842.821856 mapread 0x023ff2 thru 0x025f54 (0x1f63 bytes) 000631 1786721842.846870 mapwrite 0x02f6bc thru 0x032bd5 (0x351a bytes) 000632 1786721842.878736 write 0x001de5 thru 0x00e01b (0xc237 bytes) 000633 1786721842.892142 trunc from 0x035130 to 0x03a915 (0x57e6 bytes) 000634 1786721842.898332 write 0x03bfc1 thru 0x03ffff (0x403f bytes) 000635 1786721842.900793 read 0x021c3b thru 0x02a1a8 (0x856e bytes) 000636 1786721842.901788 trunc from 0x040000 to 0x0300db (0xff24 bytes) 000637 1786721842.925975 read 0x02e5a0 thru 0x0300db (0x1b3c bytes) 000638 1786721842.927136 mapread 0x02dec3 thru 0x0300db (0x2219 bytes) 000639 1786721842.929662 write 0x01e3c0 thru 0x020c41 (0x2882 bytes) 000640 1786721842.931242 mapwrite 0x0004d6 thru 0x00dc3e (0xd769 bytes) 000642 1786721842.968677 mapread 0x02a5d7 thru 0x0300db (0x5b05 bytes) 000643 1786721842.969854 read 0x025fb4 thru 0x0300db (0xa128 bytes) 000644 1786721842.970862 trunc from 0x02fea8 to 0x0300db (0x234 bytes) 000645 1786721842.975336 read 0x024889 thru 0x02e15e (0x98d6 bytes) 000646 1786721842.976072 mapread 0x01e8ad thru 0x0284d2 (0x9c26 bytes) 000647 1786721842.977231 trunc from 0x0300dc to 0x01d41e (0x12cbd bytes) 000648 1786721842.993085 fallocate 0x03d3a8 thru 0x03ffff (0x2c58 bytes) 000649 1786721842.998213 read 0x00d94e thru 0x01ca01 (0xf0b4 bytes) 000650 1786721842.998964 write 0x0086ea thru 0x00ecc8 (0x65df bytes) 000651 1786721843.001090 fallocate 0x006f7e thru 0x00de19 (0x6e9c bytes) 000652 1786721843.006601 trunc from 0x0002cb to 0x00bd8b (0xbac1 bytes) 000653 1786721843.019021 fallocate 0x003219 thru 0x0112a7 (0xe08f bytes) 000654 1786721843.031148 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9d1a0d1c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9d1a0d1c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000655 1786721843.332918 mapread 0x037211 thru 0x03ffff (0x8def bytes) 000657 1786721843.358939 mapread 0x008c65 thru 0x00f9d3 (0x6d6f bytes) 000658 1786721843.378811 fallocate 0x02c9a6 thru 0x032e93 (0x64ee bytes) 000659 1786721843.385991 punch from 0x0325f7 to 0x03dae5 (0xb4ef bytes) 000660 1786721843.394883 mapwrite 0x007c7f thru 0x0094e0 (0x1862 bytes) 000662 1786721843.411996 fallocate 0x03835b thru 0x03ffff (0x7ca5 bytes) 000663 1786721843.418832 trunc from 0x040000 to 0x028b1b (0x174e4 bytes) 000665 1786721843.454136 read 0x01517a thru 0x01b1b6 (0x603d bytes) 000667 1786721843.467017 write 0x02ad9d thru 0x02ec24 (0x3e88 bytes) 000668 1786721843.468982 fallocate 0x01cab2 thru 0x02aa85 (0xdfd4 bytes) 000670 1786721843.475959 trunc from 0x02ec25 to 0x0388a5 (0x9c81 bytes) 000671 1786721843.508887 punch from 0x0168ea to 0x0176e8 (0xdff bytes) 000672 1786721843.522891 trunc from 0x0388a6 to 0x036c3b (0x1c6a bytes) 000673 1786721843.552734 mapwrite 0x026558 thru 0x028492 (0x1f3b bytes) 000674 1786721843.620886 mapwrite 0x0321b6 thru 0x03e390 (0xc1db bytes) 000675 1786721843.689892 write 0x03c6ed thru 0x03ffff (0x3913 bytes) 000677 1786721843.692834 trunc from 0x040000 to 0x03448d (0xbb72 bytes) 000678 1786721843.711045 trunc from 0x03448e to 0x01d1ac (0x172e1 bytes) 000680 1786721843.738756 fallocate 0x00a6e7 thru 0x0106e8 (0x6002 bytes) 000681 1786721843.749819 mapread 0x011a9a thru 0x01a04a (0x85b1 bytes) 000682 1786721843.789062 mapwrite 0x01942e thru 0x023630 (0xa203 bytes) 000683 1786721843.875858 read 0x01d93c thru 0x023630 (0x5cf5 bytes) 000684 1786721843.876799 mapread 0x01bdc3 thru 0x023630 (0x786e bytes) 000685 1786721843.882548 mapwrite 0x02a1d3 thru 0x02e879 (0x46a7 bytes) 000686 1786721843.999617 fallocate 0x0288f2 thru 0x034aad (0xc1bc bytes) 000687 1786721844.017182 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2e87a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e87a): Mirror 2: 0x5e41172f (stale) CRC-32 checksum value for chunk [0, 0x2e87a): Mirror 1: 0x88e6e19c Mirror 3: 0x88e6e19c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e87a: skipped 000688 1786721845.170162 trunc from 0x003e44 to 0x00c68d (0x884a bytes) 000689 1786721845.216551 mapwrite 0x021340 thru 0x02c418 (0xb0d9 bytes) 000690 1786721845.265580 read 0x02229b thru 0x024cf9 (0x2a5f bytes) 000691 1786721845.266761 read 0x017359 thru 0x022c03 (0xb8ab bytes) 000692 1786721845.275477 punch from 0x01992f to 0x01e588 (0x4c5a bytes) 000693 1786721845.280295 mapread 0x02a1b0 thru 0x02dbcb (0x3a1c bytes) 000695 1786721845.282037 read 0x016026 thru 0x0195b2 (0x358d bytes) 000696 1786721845.291463 trunc from 0x02013e to 0x02b237 (0xb0fa bytes) 000698 1786721845.301671 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e87a): Mirror 2: 0x5e41172f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e87a): Mirror 2: 0x5e41172f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e87a: skipped 000699 1786721845.630309 write 0x018447 thru 0x01c616 (0x41d0 bytes) 000700 1786721845.647230 trunc from 0x02dc65 to 0x02e879 (0xc15 bytes) 000701 1786721845.655342 trunc from 0x02e87a to 0x009166 (0x25713 bytes) 000702 1786721845.676326 mapwrite 0x032129 thru 0x03fbf9 (0xdad1 bytes) 000703 1786721845.764591 read 0x011b17 thru 0x01574c (0x3c36 bytes) 000704 1786721845.774702 write 0x01ca3c thru 0x02a9df (0xdfa4 bytes) 000705 1786721845.788348 read 0x02e183 thru 0x03a41e (0xc29c bytes) 000706 1786721845.789748 fallocate 0x023d7d thru 0x031c72 (0xdef6 bytes) 000707 1786721845.795562 trunc from 0x03fbfa to 0x01e21c (0x219dd bytes) 000708 1786721845.817502 mapwrite 0x03b7b5 thru 0x03ffff (0x484b bytes) 000709 1786721845.919608 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) 000710 1786721846.104770 read 0x0117e3 thru 0x014eee (0x370c bytes) 000711 1786721846.115963 write 0x0396a9 thru 0x03ffff (0x6957 bytes) 000712 1786721846.132594 trunc from 0x02f3b1 to 0x038bb4 (0x9804 bytes) 000713 1786721846.162254 fallocate 0x03227c thru 0x03ffff (0xdd84 bytes) 000714 1786721846.203596 trunc from 0x040000 to 0x001c20 (0x3e3df bytes) 000715 1786721846.235364 mapwrite 0x0009c2 thru 0x00254b (0x1b8a bytes) 000718 1786721846.288862 mapread 0x0005ab thru 0x00254b (0x1fa1 bytes) 000719 1786721846.299851 trunc from 0x00254c to 0x019a60 (0x17515 bytes) 000720 1786721846.337066 mapwrite 0x03d16a thru 0x03ffff (0x2e96 bytes) 000721 1786721846.401703 read 0x025e04 thru 0x02763a (0x1837 bytes) 000722 1786721846.420980 mapwrite 0x02aa10 thru 0x02ddc8 (0x33b9 bytes) 000723 1786721846.443954 mapread 0x032a88 thru 0x037195 (0x470e bytes) 000726 1786721846.454603 fallocate 0x00f55c thru 0x014540 (0x4fe5 bytes) 000729 1786721846.474965 trunc from 0x03f07e to 0x03ffff (0xf82 bytes) 000730 1786721846.485490 read 0x0368b9 thru 0x03817d (0x18c5 bytes) 000731 1786721846.491610 mapread 0x018d23 thru 0x021f8e (0x926c bytes) 000732 1786721846.493050 mapread 0x004ec6 thru 0x009772 (0x48ad bytes) 000733 1786721846.496708 trunc from 0x020de8 to 0x02f7e0 (0xe9f9 bytes) 000734 1786721846.508583 trunc from 0x040000 to 0x021f14 (0x1e0eb bytes) 000735 1786721846.532961 fallocate 0x02c35d thru 0x03a7db (0xe47f bytes) 000736 1786721846.549656 read 0x020f05 thru 0x0268fc (0x59f8 bytes) 000737 1786721846.563452 trunc from 0x03a7dc to 0x001eb9 (0x38922 bytes) 000738 1786721846.620232 MIRROR_EXTEND to 2 mirrors 000739 1786721847.154934 trunc from 0x001eba to 0x035548 (0x3368f bytes) 000741 1786721847.272552 mapwrite 0x030c60 thru 0x03fd95 (0xf136 bytes) 000742 1786721847.376845 mapread 0x035076 thru 0x03ba2c (0x69b7 bytes) 000743 1786721847.379512 fallocate 0x0013e4 thru 0x00f0c7 (0xdce4 bytes) 000744 1786721847.385895 mapwrite 0x01d432 thru 0x0293e8 (0xbfb7 bytes) 000745 1786721847.436209 mapwrite 0x01b621 thru 0x01dec9 (0x28a9 bytes) 000746 1786721847.449958 read 0x0145bc thru 0x0201a5 (0xbbea bytes) 000747 1786721847.459468 fallocate 0x03927e thru 0x039967 (0x6ea bytes) 000749 1786721847.466037 read 0x01f706 thru 0x02e39d (0xec98 bytes) 000751 1786721847.467790 write 0x0321fb thru 0x033ca4 (0x1aaa bytes) 000752 1786721847.469455 write 0x00ae13 thru 0x016c34 (0xbe22 bytes) 000753 1786721847.487051 punch from 0x00cb38 to 0x01b0d4 (0xe59d bytes) 000755 1786721847.506904 punch from 0x037a3e to 0x03cc28 (0x51eb bytes) 000756 1786721847.512656 fallocate 0x034dbd thru 0x03ffff (0xb243 bytes) 000758 1786721847.521890 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3fd96): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fd96): Mirror 2: 0x15f9ecbe (stale) CRC-32 checksum value for chunk [0, 0x3fd96): Mirror 1: 0x7495006b Mirror 3: 0x7495006b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fd96: skipped 000759 1786721848.602893 fallocate 0x023d34 thru 0x0331c1 (0xf48e bytes) 000761 1786721848.637901 punch from 0x018294 to 0x022be0 (0xa94d bytes) 000762 1786721848.643016 fallocate 0x00ea4c thru 0x01819b (0x9750 bytes) 000763 1786721848.647177 mapwrite 0x0188dc thru 0x0197ef (0xf14 bytes) 000764 1786721848.666987 fallocate 0x03b1f2 thru 0x03ffff (0x4e0e bytes) 000765 1786721848.671557 fallocate 0x025217 thru 0x0256fc (0x4e6 bytes) 000766 1786721848.676003 read 0x027259 thru 0x029ec8 (0x2c70 bytes) 000768 1786721848.681655 write 0x019b2e thru 0x025955 (0xbe28 bytes) 000769 1786721848.691857 read 0x03326e thru 0x03dc77 (0xaa0a bytes) 000771 1786721848.706237 read 0x005341 thru 0x006e63 (0x1b23 bytes) 000774 1786721848.708795 read 0x014942 thru 0x01e47f (0x9b3e bytes) 000775 1786721848.710030 read 0x03127b thru 0x03e0f1 (0xce77 bytes) 000776 1786721848.710909 mapwrite 0x03b823 thru 0x03ffff (0x47dd bytes) 000777 1786721848.746317 read 0x0344d9 thru 0x03ffff (0xbb27 bytes) 000778 1786721848.747300 trunc from 0x040000 to 0x018b8c (0x27473 bytes) 000780 1786721848.771969 mapread 0x00c65d thru 0x00ea56 (0x23fa bytes) 000783 1786721848.774995 mapwrite 0x034381 thru 0x0399ce (0x564e bytes) 000784 1786721848.818961 MIRROR_RESYNC 3 mirrors 000785 1786721849.926725 fallocate 0x01ccba thru 0x02cbac (0xfef3 bytes) 000786 1786721849.962971 write 0x02f2dd thru 0x030772 (0x1496 bytes) 000787 1786721849.977262 mapread 0x0338d4 thru 0x0399ce (0x60fb bytes) 000788 1786721850.002752 mapwrite 0x00156b thru 0x00e4f9 (0xcf8f bytes) 000789 1786721850.056614 write 0x0184f9 thru 0x0205e6 (0x80ee bytes) 000791 1786721850.077701 fallocate 0x018fde thru 0x024155 (0xb178 bytes) 000792 1786721850.084954 fallocate 0x02bae9 thru 0x03b503 (0xfa1b bytes) 000793 1786721850.094794 mapread 0x01854a thru 0x01d328 (0x4ddf bytes) 000794 1786721850.096758 trunc from 0x01bb37 to 0x02504a (0x9514 bytes) 000795 1786721850.115791 read 0x0298fe thru 0x0333a3 (0x9aa6 bytes) 000796 1786721850.129709 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3b504): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b504): Mirror 2: 0xb48dc3bb (stale) Mirror 3: 0xb48dc3bb (stale) CRC-32 checksum value for chunk [0, 0x3b504): Mirror 1: 0x6a985f68 Mirror 4: 0x6a985f68 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b504: skipped 000797 1786721851.259584 punch from 0x00d3cb to 0x01abb7 (0xd7ed bytes) 000798 1786721851.335231 trunc from 0x0262eb to 0x02d441 (0x7157 bytes) 000799 1786721851.343911 write 0x03fc3e thru 0x03ffff (0x3c2 bytes) 000800 1786721851.362150 write 0x01a4ff thru 0x0261bb (0xbcbd bytes) 000801 1786721851.397466 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf110d328 (stale) Mirror 3: 0xf110d328 (stale) Mirror 4: 0x7f107691 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfd4553c9 Mirror 5: 0xfd4553c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000802 1786721852.618592 mapwrite 0x020ab7 thru 0x02d4bd (0xca07 bytes) 000803 1786721852.779124 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf110d328 (stale) Mirror 3: 0xf110d328 (stale) Mirror 4: 0x7f107691 (stale) Mirror 5: 0xfd4553c9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3858a1d3 Mirror 6: 0x3858a1d3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000804 1786721854.238909 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf110d328 (stale) Mirror 3: 0xf110d328 (stale) Mirror 4: 0x7f107691 (stale) Mirror 5: 0xfd4553c9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3858a1d3 Mirror 6: 0x3858a1d3 Mirror 7: 0x3858a1d3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000805 1786721855.289499 mapread 0x01739e thru 0x01c2fa (0x4f5d bytes) 000806 1786721855.321411 write 0x01d409 thru 0x02722f (0x9e27 bytes) 000808 1786721855.385207 fallocate 0x008097 thru 0x008874 (0x7de bytes) 000809 1786721855.394756 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf110d328 (stale) Mirror 3: 0xf110d328 (stale) Mirror 4: 0x7f107691 (stale) Mirror 5: 0xfd4553c9 (stale) Mirror 6: 0x3858a1d3 (stale) Mirror 7: 0x3858a1d3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf3f3d94 Mirror 8: 0xf3f3d94 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000812 1786721856.708103 read 0x00335c thru 0x0116ac (0xe351 bytes) 000813 1786721856.735199 trunc from 0x040000 to 0x03b3f7 (0x4c08 bytes) 000814 1786721856.849904 mapwrite 0x013612 thru 0x01556f (0x1f5e bytes) 000815 1786721856.905490 read 0x0264f0 thru 0x02eb68 (0x8679 bytes) 000816 1786721856.920672 trunc from 0x02982a to 0x031af4 (0x82cb bytes) 000817 1786721856.928071 mapwrite 0x00d03b thru 0x0198ca (0xc890 bytes) 000820 1786721857.009729 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3b3f8): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b3f8): Mirror 2: 0x7eda3427 (stale) Mirror 3: 0x7eda3427 (stale) Mirror 4: 0x526ee618 (stale) Mirror 5: 0x1c0c507c (stale) Mirror 6: 0x87953f24 (stale) Mirror 7: 0x87953f24 (stale) Mirror 8: 0xd91d7c7f (stale) CRC-32 checksum value for chunk [0, 0x3b3f8): Mirror 1: 0xfcd7af10 Mirror 9: 0xfcd7af10 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b3f8: skipped 000821 1786721858.058187 mapread 0x03abd7 thru 0x03b3f7 (0x821 bytes) 000823 1786721858.101681 read 0x01497f thru 0x021678 (0xccfa bytes) 000824 1786721858.118977 read 0x0375f4 thru 0x03b3f7 (0x3e04 bytes) 000825 1786721858.141017 read 0x039230 thru 0x03b3f7 (0x21c8 bytes) 000826 1786721858.147236 fallocate 0x00d359 thru 0x00f982 (0x262a bytes) 000827 1786721858.241162 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b3f8): Mirror 2: 0x7eda3427 (stale) Mirror 3: 0x7eda3427 (stale) Mirror 4: 0x526ee618 (stale) Mirror 5: 0x1c0c507c (stale) Mirror 6: 0x87953f24 (stale) Mirror 7: 0x87953f24 (stale) Mirror 9: 0xfcd7af10 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b3f8): Mirror 2: 0x7eda3427 (stale) Mirror 3: 0x7eda3427 (stale) Mirror 4: 0x526ee618 (stale) Mirror 5: 0x1c0c507c (stale) Mirror 6: 0x87953f24 (stale) Mirror 7: 0x87953f24 (stale) Mirror 9: 0xfcd7af10 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b3f8: skipped 000828 1786721858.926231 trunc from 0x03b3f8 to 0x00eeba (0x2c53d bytes) 000829 1786721858.953335 write 0x00e013 thru 0x018485 (0xa473 bytes) 000830 1786721858.975092 mapwrite 0x01ed86 thru 0x02cf96 (0xe211 bytes) 000831 1786721859.131478 mapwrite 0x024cfe thru 0x02bdd5 (0x70d8 bytes) 000832 1786721859.162681 read 0x020c1e thru 0x024145 (0x3528 bytes) 000833 1786721859.163368 fallocate 0x013a3b thru 0x014d37 (0x12fd bytes) 000834 1786721859.172208 write 0x026e97 thru 0x0330f5 (0xc25f bytes) 000835 1786721859.177709 trunc from 0x021828 to 0x02a9fd (0x91d6 bytes) 000836 1786721859.197545 read 0x0158c8 thru 0x023e8a (0xe5c3 bytes) 000838 1786721859.224168 punch from 0x02b651 to 0x02ee4c (0x37fc bytes) 000839 1786721859.241821 trunc from 0x0330f6 to 0x01cfa3 (0x16152 bytes) 000840 1786721859.289708 write 0x037203 thru 0x03ffff (0x8dfd bytes) 000841 1786721859.294564 trunc from 0x040000 to 0x02e045 (0x11fba bytes) 000842 1786721859.314845 write 0x019bb7 thru 0x027d25 (0xe16f bytes) 000843 1786721859.339895 write 0x034073 thru 0x037218 (0x31a6 bytes) 000844 1786721859.341223 mapread 0x00079a thru 0x0042e4 (0x3b4b bytes) 000845 1786721859.354752 mapread 0x0322e4 thru 0x03458b (0x22a8 bytes) 000846 1786721859.363518 fallocate 0x034147 thru 0x035555 (0x140f bytes) 000847 1786721859.373695 mapwrite 0x00ed5f thru 0x017985 (0x8c27 bytes) 000849 1786721859.403971 fallocate 0x02a2a4 thru 0x030f65 (0x6cc2 bytes) 000850 1786721859.414105 punch from 0x02a0c5 to 0x02ee06 (0x4d42 bytes) 000851 1786721859.430217 read 0x018a9a thru 0x02284e (0x9db5 bytes) 000852 1786721859.431051 fallocate 0x0234e6 thru 0x028fa2 (0x5abd bytes) 000853 1786721859.440530 read 0x01a875 thru 0x01fd0e (0x549a bytes) 000854 1786721859.441189 write 0x0205b9 thru 0x02c329 (0xbd71 bytes) 000855 1786721859.465246 MIRROR_RESYNC 8 mirrors 000856 1786721860.803908 MIRROR_RESYNC 8 mirrors 000857 1786721861.419438 read 0x0024e3 thru 0x0047bf (0x22dd bytes) 000858 1786721861.430264 fallocate 0x01b168 thru 0x01c77c (0x1615 bytes) 000859 1786721861.471453 write 0x020f14 thru 0x0246d9 (0x37c6 bytes) 000860 1786721861.480681 mapwrite 0x00b69d thru 0x00e9dc (0x3340 bytes) 000861 1786721861.512754 mapwrite 0x002a92 thru 0x003349 (0x8b8 bytes) 000862 1786721861.540982 trunc from 0x01c463 to 0x01f58f (0x312d bytes) 000863 1786721861.565574 MIRROR_RESYNC 8 mirrors 000864 1786721863.675487 fallocate 0x016dba thru 0x01b3e7 (0x462e bytes) 000865 1786721863.717071 read 0x019dbe thru 0x027c8a (0xdecd bytes) 000867 1786721863.729512 trunc from 0x037219 to 0x03ae05 (0x3bed bytes) 000868 1786721863.769071 mapwrite 0x01bf00 thru 0x023ca4 (0x7da5 bytes) 000869 1786721863.799507 mapwrite 0x029cd1 thru 0x036a48 (0xcd78 bytes) 000870 1786721863.866139 mapread 0x000029 thru 0x000736 (0x70e bytes) 000871 1786721863.881643 trunc from 0x03ae06 to 0x01aa29 (0x203dc bytes) 000872 1786721863.914044 mapwrite 0x01e0e2 thru 0x02671e (0x863d bytes) 000873 1786721864.025869 trunc from 0x00efe4 to 0x0190df (0xa0fc bytes) 000874 1786721864.043022 write 0x0007a4 thru 0x002b06 (0x2363 bytes) 000875 1786721864.044180 fallocate 0x03f0c8 thru 0x03ffff (0xf38 bytes) 000876 1786721864.049455 punch from 0x004be9 to 0x00bfae (0x73c6 bytes) 000877 1786721864.061108 mapread 0x001708 thru 0x00e42c (0xcd25 bytes) 000878 1786721864.076962 fallocate 0x02739b thru 0x02c077 (0x4cdd bytes) 000879 1786721864.083253 mapwrite 0x03a4cc thru 0x03ffab (0x5ae0 bytes) 000880 1786721864.138604 mapwrite 0x01055b thru 0x01c97c (0xc422 bytes) 000881 1786721864.173587 read 0x003515 thru 0x003f58 (0xa44 bytes) 000882 1786721864.174364 mapwrite 0x0017e4 thru 0x00a6a9 (0x8ec6 bytes) 000883 1786721864.198583 punch from 0x005d09 to 0x00994e (0x3c46 bytes) 000884 1786721864.203759 read 0x01ad12 thru 0x01f3f3 (0x46e2 bytes) 000886 1786721864.206350 trunc from 0x03ca40 to 0x03ffa3 (0x3564 bytes) 000887 1786721864.212063 fallocate 0x01803c thru 0x018440 (0x405 bytes) 000888 1786721864.217129 read 0x038c9e thru 0x03ffab (0x730e bytes) 000889 1786721864.233194 mapread 0x02d0c7 thru 0x030141 (0x307b bytes) 000890 1786721864.241557 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3ffac): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ffac): Mirror 2: 0xcc5fdfea (stale) Mirror 3: 0xcc5fdfea (stale) Mirror 4: 0xcc5fdfea (stale) Mirror 5: 0xcc5fdfea (stale) Mirror 6: 0xcc5fdfea (stale) Mirror 7: 0xcc5fdfea (stale) Mirror 9: 0xcc5fdfea (stale) CRC-32 checksum value for chunk [0, 0x3ffac): Mirror 1: 0x66e90900 Mirror 10: 0x66e90900 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ffac: skipped 000891 1786721865.684050 mapread 0x001cd3 thru 0x00fdac (0xe0da bytes) 000892 1786721865.762542 mapread 0x02bbe3 thru 0x02ea9c (0x2eba bytes) 000893 1786721865.813740 write 0x02d9f4 thru 0x03b29d (0xd8aa bytes) 000894 1786721865.902920 trunc from 0x010e9b to 0x016ba7 (0x5d0d bytes) 000895 1786721865.908887 punch from 0x02f426 to 0x03cb99 (0xd774 bytes) 000896 1786721865.930585 trunc from 0x03ffac to 0x015b7d (0x2a42e bytes) 000897 1786721866.065356 MIRROR_RESYNC 9 mirrors 000898 1786721868.534093 mapwrite 0x02f36e thru 0x037288 (0x7f1b bytes) 000899 1786721868.623084 trunc from 0x037289 to 0x03aa41 (0x37b9 bytes) 000900 1786721868.647548 fallocate 0x03ac50 thru 0x03ffff (0x53b0 bytes) 000901 1786721868.661397 trunc from 0x03aa42 to 0x02dd7a (0xccc7 bytes) 000902 1786721868.696618 write 0x0204e7 thru 0x027a72 (0x758c bytes) 000903 1786721868.714403 mapread 0x007782 thru 0x00d737 (0x5fb6 bytes) 000904 1786721868.736812 fallocate 0x03adb9 thru 0x03df2e (0x3176 bytes) 000905 1786721868.746601 fallocate 0x01bce9 thru 0x02b1ca (0xf4e2 bytes) 000907 1786721868.767039 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3df2f): Mirror 2: 0x699911b6 (stale) Mirror 4: 0x699911b6 (stale) Mirror 5: 0x699911b6 (stale) Mirror 6: 0x699911b6 (stale) Mirror 7: 0x699911b6 (stale) Mirror 9: 0x699911b6 (stale) Mirror 10: 0x699911b6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3df2f): Mirror 2: 0x699911b6 (stale) Mirror 4: 0x699911b6 (stale) Mirror 5: 0x699911b6 (stale) Mirror 6: 0x699911b6 (stale) Mirror 7: 0x699911b6 (stale) Mirror 9: 0x699911b6 (stale) Mirror 10: 0x699911b6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3df2f: skipped 000908 1786721869.309783 mapwrite 0x020f1f thru 0x024167 (0x3249 bytes) 000910 1786721869.347279 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3df2f): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3df2f): Mirror 2: 0x699911b6 (stale) Mirror 4: 0x699911b6 (stale) Mirror 5: 0x699911b6 (stale) Mirror 6: 0x699911b6 (stale) Mirror 7: 0x699911b6 (stale) Mirror 9: 0x699911b6 (stale) Mirror 10: 0x699911b6 (stale) CRC-32 checksum value for chunk [0, 0x3df2f): Mirror 1: 0xd7dca616 Mirror 11: 0xd7dca616 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3df2f: skipped 000911 1786721870.533050 fallocate 0x026e1c thru 0x03496a (0xdb4f bytes) 000912 1786721870.638991 write 0x0361d7 thru 0x03ffff (0x9e29 bytes) 000914 1786721870.663327 mapwrite 0x00d4d2 thru 0x00edde (0x190d bytes) 000915 1786721870.695648 trunc from 0x040000 to 0x00848b (0x37b74 bytes) 000916 1786721870.769980 read 0x007163 thru 0x00848b (0x1329 bytes) 000917 1786721870.788017 mapwrite 0x025168 thru 0x0300d0 (0xaf69 bytes) 000920 1786721870.935054 trunc from 0x0259f2 to 0x02aa78 (0x5087 bytes) 000921 1786721870.958000 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x300d1): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x300d1): Mirror 2: 0x2e0a6815 (stale) Mirror 4: 0x2e0a6815 (stale) Mirror 5: 0x2e0a6815 (stale) Mirror 6: 0x2e0a6815 (stale) Mirror 7: 0x2e0a6815 (stale) Mirror 9: 0x2e0a6815 (stale) Mirror 10: 0x2e0a6815 (stale) Mirror 11: 0xcfca0839 (stale) CRC-32 checksum value for chunk [0, 0x300d1): Mirror 1: 0x49070036 Mirror 12: 0x49070036 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x300d1: skipped 000922 1786721872.139998 punch from 0x02200f to 0x02dcd1 (0xbcc3 bytes) 000923 1786721872.214646 mapwrite 0x02e518 thru 0x030950 (0x2439 bytes) 000924 1786721872.307272 fallocate 0x007c95 thru 0x014f54 (0xd2c0 bytes) 000925 1786721872.318082 write 0x023f44 thru 0x025ed2 (0x1f8f bytes) 000927 1786721872.335016 write 0x01c080 thru 0x01c5b6 (0x537 bytes) 000928 1786721872.342105 trunc from 0x030951 to 0x0064d5 (0x2a47b bytes) 000929 1786721872.360019 punch from 0x001c13 to 0x0064d5 (0x48c3 bytes) 000930 1786721872.366878 fallocate 0x030202 thru 0x03f97b (0xf77a bytes) 000931 1786721872.377271 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3f97c): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f97c): Mirror 2: 0x2abe88f (stale) Mirror 4: 0x2abe88f (stale) Mirror 5: 0x2abe88f (stale) Mirror 6: 0x2abe88f (stale) Mirror 7: 0x2abe88f (stale) Mirror 9: 0x2abe88f (stale) Mirror 10: 0x2abe88f (stale) Mirror 11: 0xe19e6590 (stale) Mirror 12: 0xdfd21f2 (stale) CRC-32 checksum value for chunk [0, 0x3f97c): Mirror 1: 0xf08b0bd9 Mirror 13: 0xf08b0bd9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f97c: skipped 000932 1786721873.528893 punch from 0x00d449 to 0x01a241 (0xcdf9 bytes) 000933 1786721873.599193 write 0x004bba thru 0x00d676 (0x8abd bytes) 000934 1786721873.644491 fallocate 0x02c278 thru 0x02f688 (0x3411 bytes) 000935 1786721873.667569 trunc from 0x0284ae to 0x028b65 (0x6b8 bytes) 000937 1786721873.682863 fallocate 0x0135ad thru 0x017361 (0x3db5 bytes) 000938 1786721873.691328 trunc from 0x001363 to 0x00a304 (0x8fa2 bytes) 000939 1786721873.725269 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f97c): Mirror 4: 0x2abe88f (stale) Mirror 5: 0x2abe88f (stale) Mirror 6: 0x2abe88f (stale) Mirror 7: 0x2abe88f (stale) Mirror 9: 0x2abe88f (stale) Mirror 10: 0x2abe88f (stale) Mirror 11: 0xe19e6590 (stale) Mirror 12: 0xdfd21f2 (stale) Mirror 13: 0xf08b0bd9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f97c): Mirror 4: 0x2abe88f (stale) Mirror 5: 0x2abe88f (stale) Mirror 6: 0x2abe88f (stale) Mirror 7: 0x2abe88f (stale) Mirror 9: 0x2abe88f (stale) Mirror 10: 0x2abe88f (stale) Mirror 11: 0xe19e6590 (stale) Mirror 12: 0xdfd21f2 (stale) Mirror 13: 0xf08b0bd9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f97c: skipped 000940 1786721874.413675 mapread 0x02ce07 thru 0x033575 (0x676f bytes) 000942 1786721874.461101 mapread 0x006c2b thru 0x006dff (0x1d5 bytes) 000943 1786721874.493270 trunc from 0x03f97c to 0x005e89 (0x39af2 bytes) 000944 1786721874.538693 fallocate 0x01b16a thru 0x01d12f (0x1fc6 bytes) 000945 1786721874.554814 mapwrite 0x0076cd thru 0x0100b0 (0x89e4 bytes) 000946 1786721874.635944 mapread 0x00fd81 thru 0x0100b0 (0x330 bytes) 000947 1786721874.637949 mapread 0x00c83f thru 0x0100b0 (0x3872 bytes) 000949 1786721874.640703 write 0x039ade thru 0x03ffff (0x6522 bytes) 000950 1786721874.642495 punch from 0x031d3c to 0x038188 (0x644d bytes) 000952 1786721874.648360 trunc from 0x004dd8 to 0x0143f1 (0xf61a bytes) 000953 1786721874.653501 trunc from 0x040000 to 0x03b53a (0x4ac5 bytes) 000954 1786721874.678264 trunc from 0x01661a to 0x019755 (0x313c bytes) 000955 1786721874.689547 punch from 0x010890 to 0x011354 (0xac5 bytes) 000956 1786721874.694018 write 0x03dee4 thru 0x03e986 (0xaa3 bytes) 000957 1786721874.695963 mapwrite 0x0360c5 thru 0x03ffff (0x9f3b bytes) 000958 1786721874.739571 punch from 0x00f8c7 to 0x01731a (0x7a54 bytes) 000959 1786721874.748432 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1eaa8eb1 (stale) Mirror 5: 0x1eaa8eb1 (stale) Mirror 6: 0x1eaa8eb1 (stale) Mirror 7: 0x1eaa8eb1 (stale) Mirror 9: 0x1eaa8eb1 (stale) Mirror 10: 0x1eaa8eb1 (stale) Mirror 11: 0x202c16e9 (stale) Mirror 12: 0xfe8aa42e (stale) Mirror 13: 0x3e7ce429 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcbf95c87 Mirror 14: 0xcbf95c87 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000960 1786721875.969832 read 0x018af4 thru 0x02603e (0xd54b bytes) 000963 1786721875.980794 punch from 0x00d6cb to 0x010e82 (0x37b8 bytes) 000964 1786721876.045863 write 0x030e4d thru 0x03506a (0x421e bytes) 000965 1786721876.072769 fallocate 0x037d65 thru 0x03ffff (0x829b bytes) 000966 1786721876.078838 fallocate 0x00a2e9 thru 0x0124a6 (0x81be bytes) 000967 1786721876.091404 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x1eaa8eb1 (stale) Mirror 6: 0x1eaa8eb1 (stale) Mirror 7: 0x1eaa8eb1 (stale) Mirror 9: 0x1eaa8eb1 (stale) Mirror 10: 0x1eaa8eb1 (stale) Mirror 11: 0x202c16e9 (stale) Mirror 12: 0xfe8aa42e (stale) Mirror 13: 0x3e7ce429 (stale) Mirror 14: 0xcbf95c87 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x1eaa8eb1 (stale) Mirror 6: 0x1eaa8eb1 (stale) Mirror 7: 0x1eaa8eb1 (stale) Mirror 9: 0x1eaa8eb1 (stale) Mirror 10: 0x1eaa8eb1 (stale) Mirror 11: 0x202c16e9 (stale) Mirror 12: 0xfe8aa42e (stale) Mirror 13: 0x3e7ce429 (stale) Mirror 14: 0xcbf95c87 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000968 1786721876.653620 trunc from 0x040000 to 0x000eff (0x3f100 bytes) 000969 1786721876.676613 read 0x000228 thru 0x000eff (0xcd8 bytes) 000970 1786721876.681679 write 0x012343 thru 0x020def (0xeaad bytes) 000971 1786721876.683319 punch from 0x01d35b to 0x020def (0x3a95 bytes) 000972 1786721876.706172 mapread 0x00b4ec thru 0x00cef5 (0x1a0a bytes) 000973 1786721876.719211 mapwrite 0x00a410 thru 0x013cf4 (0x98e5 bytes) 000974 1786721876.748138 trunc from 0x011d4f to 0x01556b (0x381d bytes) 000975 1786721876.759175 MIRROR_RESYNC 10 mirrors 000976 1786721879.749144 trunc from 0x00ed85 to 0x0145b6 (0x5832 bytes) 000977 1786721879.784047 mapwrite 0x007c89 thru 0x017928 (0xfca0 bytes) 000978 1786721879.837280 read 0x01f543 thru 0x020def (0x18ad bytes) 000979 1786721879.843209 trunc from 0x01c474 to 0x020def (0x497c bytes) 000980 1786721879.848211 trunc from 0x00b1de to 0x0151c6 (0x9fe9 bytes) 000981 1786721879.854306 mapread 0x01f14e thru 0x020def (0x1ca2 bytes) 000982 1786721879.863767 fallocate 0x020ec5 thru 0x029abe (0x8bfa bytes) 000983 1786721879.869851 mapwrite 0x03cc27 thru 0x03ffff (0x33d9 bytes) 000984 1786721879.920926 MIRROR_RESYNC 10 mirrors 000985 1786721883.147957 read 0x03aa09 thru 0x03ad55 (0x34d bytes) 000987 1786721883.154062 mapwrite 0x00f5f3 thru 0x01aa0e (0xb41c bytes) 000988 1786721883.375838 mapread 0x02e826 thru 0x035f6b (0x7746 bytes) 000989 1786721883.388004 trunc from 0x040000 to 0x03408b (0xbf74 bytes) 000990 1786721883.406834 trunc from 0x03408c to 0x03b367 (0x72dc bytes) 000991 1786721883.434013 trunc from 0x03b368 to 0x0130d3 (0x28294 bytes) 000992 1786721883.479947 punch from 0x004501 to 0x007eba (0x39ba bytes) 000993 1786721883.495993 read 0x00f58d thru 0x0108a5 (0x1319 bytes) 000994 1786721883.498816 write 0x00d9a1 thru 0x0119f0 (0x4050 bytes) 000995 1786721883.513310 fallocate 0x01dda0 thru 0x020f92 (0x31f3 bytes) 000996 1786721883.523889 write 0x01abe5 thru 0x021943 (0x6d5f bytes) 000998 1786721883.557328 trunc from 0x009262 to 0x0151ae (0xbf4d bytes) 000999 1786721883.596471 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1cc:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21944): Mirror 5: 0x7fac943 (stale) Mirror 6: 0x7fac943 (stale) Mirror 7: 0x7fac943 (stale) Mirror 9: 0x7fac943 (stale) Mirror 10: 0x7fac943 (stale) Mirror 11: 0x7fac943 (stale) Mirror 13: 0x7fac943 (stale) Mirror 14: 0x7fac943 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21944): Mirror 5: 0x7fac943 (stale) Mirror 6: 0x7fac943 (stale) Mirror 7: 0x7fac943 (stale) Mirror 9: 0x7fac943 (stale) Mirror 10: 0x7fac943 (stale) Mirror 11: 0x7fac943 (stale) Mirror 13: 0x7fac943 (stale) Mirror 14: 0x7fac943 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21944: skipped 001000 1786721884.239492 trunc from 0x021944 to 0x03b2fa (0x199b7 bytes) All operations completed A-OK!