== sanity-flr test 70a: flr mode fsx test ================ 01:35:21 (1787549721) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 9724 skipping zero length punch hole skipping zero length zero range 000003 1787549724.903265 write 0x03d62e thru 0x03ffff (0x29d2 bytes) truncating to largest ever: 0x26fe3 000004 1787549724.906396 trunc from 0x040000 to 0x026fe2 (0x1901d bytes) 000005 1787549724.920257 read 0x000900 thru 0x0010e2 (0x7e3 bytes) fallocating to largest ever: 0x3088c 000006 1787549724.928631 fallocate 0x02f7db thru 0x03088b (0x10b1 bytes) 000007 1787549724.933946 read 0x00ff55 thru 0x01bfea (0xc096 bytes) 000008 1787549724.964792 read 0x02ef5e thru 0x03088b (0x192e bytes) 000009 1787549724.965397 punch from 0x01e893 to 0x0284ef (0x9c5d bytes) 000011 1787549724.977616 mapwrite 0x011c4d thru 0x020f0d (0xf2c1 bytes) 000012 1787549725.017084 read 0x02d704 thru 0x03088b (0x3188 bytes) 000013 1787549725.017978 mapwrite 0x0048ba thru 0x00edec (0xa533 bytes) 000014 1787549725.035941 read 0x003c7c thru 0x006469 (0x27ee bytes) 000015 1787549725.041937 MIRROR_EXTEND to 2 mirrors 000016 1787549726.034042 fallocate 0x00b0c3 thru 0x016005 (0xaf43 bytes) 000017 1787549726.147392 read 0x0271b2 thru 0x03088b (0x96da bytes) 000018 1787549726.200495 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3088c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3088c): Mirror 2: 0x4163a5c1 (stale) CRC-32 checksum value for chunk [0, 0x3088c): Mirror 1: 0x4163a5c1 Mirror 3: 0x4163a5c1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3088c: skipped 000020 1787549727.261786 write 0x01570e thru 0x02274c (0xd03f bytes) 000021 1787549727.355984 write 0x01c84a thru 0x02959d (0xcd54 bytes) 000022 1787549727.370584 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3088c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3088c): Mirror 2: 0x4163a5c1 (stale) Mirror 3: 0x4163a5c1 (stale) CRC-32 checksum value for chunk [0, 0x3088c): Mirror 1: 0x2cf9ea7c Mirror 4: 0x2cf9ea7c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3088c: skipped 000023 1787549728.354296 write 0x01aec7 thru 0x02391e (0x8a58 bytes) 000024 1787549728.456108 punch from 0x025519 to 0x027306 (0x1dee bytes) 000025 1787549728.461958 write 0x00fed6 thru 0x018873 (0x899e bytes) 000026 1787549728.484879 trunc from 0x03088c to 0x0048a6 (0x2bfe5 bytes) 000027 1787549728.555137 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x48a7): Mirror 2: 0x6ea1c302 (stale) Mirror 4: 0x6ea1c302 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x48a7): Mirror 2: 0x6ea1c302 (stale) Mirror 4: 0x6ea1c302 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x48a7: skipped 000028 1787549729.109296 write 0x00b94d thru 0x01a4e5 (0xeb99 bytes) 000029 1787549729.118704 mapwrite 0x026db0 thru 0x035c7e (0xeecf bytes) 000030 1787549729.208045 trunc from 0x021dba to 0x023c54 (0x1e9b bytes) 000031 1787549729.220611 mapwrite 0x00c43a thru 0x015c1e (0x97e5 bytes) 000032 1787549729.292925 fallocate 0x01952a thru 0x020541 (0x7018 bytes) 000033 1787549729.326263 write 0x0385ee thru 0x03ffff (0x7a12 bytes) 000036 1787549729.375626 MIRROR_RESYNC 3 mirrors 000037 1787549731.059998 mapwrite 0x00a7fe thru 0x00dc4b (0x344e bytes) 000038 1787549731.164161 read 0x021512 thru 0x023cd7 (0x27c6 bytes) 000040 1787549731.169998 fallocate 0x01880f thru 0x02405b (0xb84d bytes) 000041 1787549731.181085 mapwrite 0x00bbdc thru 0x0128d8 (0x6cfd bytes) 000042 1787549731.212203 mapwrite 0x032ea8 thru 0x0348a9 (0x1a02 bytes) 000043 1787549731.255083 punch from 0x02e159 to 0x0320e8 (0x3f90 bytes) 000044 1787549731.264047 write 0x006293 thru 0x0086f0 (0x245e bytes) 000045 1787549731.265914 fallocate 0x00cbd2 thru 0x0192a6 (0xc6d5 bytes) 000046 1787549731.277290 trunc from 0x0214db to 0x02cf6c (0xba92 bytes) 000047 1787549731.283081 mapread 0x01ce4f thru 0x028969 (0xbb1b bytes) 000048 1787549731.313181 trunc from 0x040000 to 0x021856 (0x1e7a9 bytes) 000049 1787549731.336382 punch from 0x018bcb to 0x01f0f5 (0x652b bytes) 000050 1787549731.343758 mapread 0x01a3d6 thru 0x021856 (0x7481 bytes) 000051 1787549731.394540 MIRROR_RESYNC 3 mirrors 000052 1787549732.585022 read 0x002937 thru 0x003e34 (0x14fe bytes) 000053 1787549732.590568 trunc from 0x006fda to 0x0144bc (0xd4e3 bytes) 000055 1787549732.625327 MIRROR_RESYNC 3 mirrors 000058 1787549733.683896 read 0x00707e thru 0x010554 (0x94d7 bytes) 000059 1787549733.701204 mapwrite 0x031d2c thru 0x03b250 (0x9525 bytes) 000060 1787549733.794381 write 0x00574e thru 0x014a7c (0xf32f bytes) 000061 1787549733.806317 mapwrite 0x00e9ed thru 0x011396 (0x29aa bytes) 000063 1787549733.825266 trunc from 0x03b251 to 0x0224f9 (0x18d57 bytes) 000064 1787549733.849638 read 0x01d081 thru 0x0224f9 (0x5479 bytes) 000065 1787549733.869154 trunc from 0x0163e9 to 0x01ab2c (0x4744 bytes) 000066 1787549733.874474 mapwrite 0x029639 thru 0x0310c9 (0x7a91 bytes) 000067 1787549733.910415 punch from 0x015ac2 to 0x01a680 (0x4bbf bytes) 000068 1787549733.917472 punch from 0x01825f to 0x01b2fa (0x309c bytes) 000069 1787549733.923901 write 0x00453c thru 0x01446f (0xff34 bytes) 000070 1787549733.938396 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x310ca): Mirror 4: 0x9f4010c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x310ca): Mirror 4: 0x9f4010c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x310ca: skipped 000071 1787549734.394208 write 0x01f33c thru 0x02c9cc (0xd691 bytes) 000072 1787549734.411259 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x310ca): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x310ca): Mirror 4: 0x9f4010c5 (stale) CRC-32 checksum value for chunk [0, 0x310ca): Mirror 1: 0x6f6d011f Mirror 5: 0x6f6d011f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x310ca: skipped 000073 1787549735.078775 punch from 0x017a43 to 0x019528 (0x1ae6 bytes) 000074 1787549735.111727 fallocate 0x02753d thru 0x02d51e (0x5fe2 bytes) 000075 1787549735.116219 write 0x03d91c thru 0x03ffff (0x26e4 bytes) 000076 1787549735.121455 mapwrite 0x02404b thru 0x02dbfd (0x9bb3 bytes) 000077 1787549735.152271 trunc from 0x029116 to 0x02f3cf (0x62ba bytes) 000079 1787549735.157527 mapread 0x00ed46 thru 0x015bfe (0x6eb9 bytes) 000080 1787549735.166452 trunc from 0x040000 to 0x01fa7c (0x20583 bytes) 000081 1787549735.184040 punch from 0x00db59 to 0x00ef63 (0x140b bytes) 000082 1787549735.193037 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1fa7d): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fa7d): Mirror 4: 0xeee3393b (stale) Mirror 5: 0xa657cecf (stale) CRC-32 checksum value for chunk [0, 0x1fa7d): Mirror 1: 0xfd059806 Mirror 6: 0xfd059806 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fa7d: skipped 000083 1787549736.034401 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1fa7d): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fa7d): Mirror 4: 0xeee3393b (stale) Mirror 5: 0xa657cecf (stale) CRC-32 checksum value for chunk [0, 0x1fa7d): Mirror 1: 0xfd059806 Mirror 6: 0xfd059806 Mirror 7: 0xfd059806 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fa7d: skipped 000084 1787549736.979244 read 0x018c9c thru 0x01fa7c (0x6de1 bytes) 000085 1787549736.994082 trunc from 0x01fa7d to 0x005b0d (0x19f6f bytes) 000087 1787549737.075100 write 0x009767 thru 0x011750 (0x7fea bytes) 000088 1787549737.086167 mapwrite 0x020c64 thru 0x027982 (0x6d1f bytes) 000089 1787549737.166745 mapwrite 0x00484a thru 0x00a3c5 (0x5b7c bytes) 000090 1787549737.226219 trunc from 0x027983 to 0x00348d (0x244f5 bytes) 000091 1787549737.260725 MIRROR_RESYNC 5 mirrors 000092 1787549738.276243 mapwrite 0x02e2a3 thru 0x03c472 (0xe1d0 bytes) 000093 1787549738.373297 mapwrite 0x03ed02 thru 0x03ffff (0x12fe bytes) 000094 1787549738.418023 write 0x02cadf thru 0x036b5d (0xa07f bytes) truncating to largest ever: 0x323a9 000095 1787549738.420346 trunc from 0x040000 to 0x0323a8 (0xdc57 bytes) 000096 1787549738.440170 punch from 0x0204da to 0x02bf30 (0xba57 bytes) 000097 1787549738.447102 mapread 0x00714d thru 0x010cb3 (0x9b67 bytes) 000098 1787549738.465085 read 0x029a5e thru 0x0323a8 (0x894b bytes) 000099 1787549738.472077 mapwrite 0x0063b2 thru 0x00a0fb (0x3d4a bytes) 000100 1787549738.503534 mapread 0x008970 thru 0x00f110 (0x67a1 bytes) 000101 1787549738.507205 mapwrite 0x02f762 thru 0x03377b (0x401a bytes) 000102 1787549738.548268 write 0x00e6ec thru 0x0123b2 (0x3cc7 bytes) 000104 1787549738.556718 punch from 0x025333 to 0x02f5fc (0xa2ca bytes) 000105 1787549738.561030 read 0x029767 thru 0x03377b (0xa015 bytes) 000106 1787549738.570456 MIRROR_RESYNC 5 mirrors truncating to largest ever: 0x3b832 000107 1787549739.988636 trunc from 0x03377c to 0x03b831 (0x80b6 bytes) 000108 1787549740.025099 read 0x02a191 thru 0x02f1f3 (0x5063 bytes) 000111 1787549740.043156 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3b832): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b832): Mirror 4: 0xdffdbcfd (stale) Mirror 5: 0xdffdbcfd (stale) Mirror 6: 0xdffdbcfd (stale) Mirror 7: 0xdffdbcfd (stale) CRC-32 checksum value for chunk [0, 0x3b832): Mirror 1: 0xdffdbcfd Mirror 8: 0xdffdbcfd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b832: skipped 000112 1787549741.059951 trunc from 0x0159e5 to 0x019abf (0x40db bytes) 000113 1787549741.111366 punch from 0x01b696 to 0x023bda (0x8545 bytes) 000114 1787549741.118913 trunc from 0x020633 to 0x021867 (0x1235 bytes) fallocating to largest ever: 0x40000 000115 1787549741.124001 fallocate 0x03b33d thru 0x03ffff (0x4cc3 bytes) 000116 1787549741.129057 trunc from 0x03b832 to 0x006ee8 (0x34949 bytes) 000117 1787549741.152083 fallocate 0x034a01 thru 0x036476 (0x1a76 bytes) 000118 1787549741.159354 punch from 0x00f806 to 0x019cb6 (0xa4b1 bytes) 000119 1787549741.172213 read 0x00053e thru 0x00f22f (0xecf2 bytes) 000120 1787549741.198687 mapread 0x0118f9 thru 0x0186d8 (0x6de0 bytes) 000121 1787549741.230690 mapwrite 0x03af7e thru 0x03ffff (0x5082 bytes) 000122 1787549741.300621 punch from 0x024ca4 to 0x02869b (0x39f8 bytes) 000123 1787549741.309822 mapwrite 0x032037 thru 0x03c0e8 (0xa0b2 bytes) 000124 1787549741.385201 mapwrite 0x004754 thru 0x00b05c (0x6909 bytes) 000125 1787549741.410537 mapread 0x03c963 thru 0x03ffff (0x369d bytes) 000126 1787549741.411542 write 0x01360d thru 0x01b553 (0x7f47 bytes) 000127 1787549741.420781 write 0x01887d thru 0x0273bf (0xeb43 bytes) 000128 1787549741.441819 trunc from 0x022539 to 0x02c1cc (0x9c94 bytes) 000129 1787549741.458160 mapread 0x026e5a thru 0x027b86 (0xd2d bytes) 000131 1787549741.470604 trunc from 0x005f80 to 0x01173b (0xb7bc bytes) 000132 1787549741.475735 mapread 0x036c84 thru 0x03ffff (0x937c bytes) 000133 1787549741.476691 trunc from 0x02a704 to 0x03a0fa (0xf9f7 bytes) 000134 1787549741.482106 mapwrite 0x0000e8 thru 0x00e651 (0xe56a bytes) 000135 1787549741.565748 MIRROR_RESYNC 6 mirrors 000137 1787549743.315666 read 0x03baa5 thru 0x03ffff (0x455b bytes) 000138 1787549743.330036 mapread 0x0219fd thru 0x02fda8 (0xe3ac bytes) 000139 1787549743.374377 MIRROR_EXTEND to 7 mirrors 000140 1787549744.294485 MIRROR_EXTEND to 8 mirrors 000141 1787549745.007236 read 0x00ccdc thru 0x0191c0 (0xc4e5 bytes) 000142 1787549745.023450 fallocate 0x0095fa thru 0x010d38 (0x773f bytes) 000143 1787549745.067806 write 0x0180a5 thru 0x01ae92 (0x2dee bytes) 000144 1787549745.086675 punch from 0x017435 to 0x026d11 (0xf8dd bytes) 000145 1787549745.097381 punch from 0x0322c2 to 0x03868f (0x63ce bytes) 000147 1787549745.102111 trunc from 0x035559 to 0x03a04f (0x4af7 bytes) 000148 1787549745.109453 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x21181b87 (stale) Mirror 5: 0x21181b87 (stale) Mirror 7: 0x21181b87 (stale) Mirror 8: 0x21181b87 (stale) Mirror 9: 0x21181b87 (stale) Mirror 10: 0x21181b87 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x21181b87 (stale) Mirror 5: 0x21181b87 (stale) Mirror 7: 0x21181b87 (stale) Mirror 8: 0x21181b87 (stale) Mirror 9: 0x21181b87 (stale) Mirror 10: 0x21181b87 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000149 1787549745.598751 mapwrite 0x02d983 thru 0x031ca6 (0x4324 bytes) 000151 1787549745.644023 mapwrite 0x008868 thru 0x017231 (0xe9ca bytes) 000152 1787549745.682043 read 0x026ddf thru 0x0326e6 (0xb908 bytes) 000153 1787549745.700982 MIRROR_RESYNC 7 mirrors 000155 1787549747.099807 trunc from 0x027fc7 to 0x02e725 (0x675f bytes) 000156 1787549747.135429 read 0x0221df thru 0x024e16 (0x2c38 bytes) 000157 1787549747.142377 write 0x035474 thru 0x0383e4 (0x2f71 bytes) 000159 1787549747.152987 trunc from 0x0103fe to 0x014e8c (0x4a8f bytes) 000160 1787549747.158893 write 0x03054f thru 0x035f50 (0x5a02 bytes) 000161 1787549747.163915 read 0x02a368 thru 0x02ae4f (0xae8 bytes) 000162 1787549747.173973 punch from 0x01f74f to 0x02552a (0x5ddc bytes) 000163 1787549747.178203 mapwrite 0x0220c3 thru 0x02d634 (0xb572 bytes) 000164 1787549747.214340 trunc from 0x040000 to 0x00d307 (0x32cf8 bytes) 000165 1787549747.235105 punch from 0x00afbe to 0x00d307 (0x234a bytes) 000166 1787549747.244250 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0xd308): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd308): Mirror 4: 0x36b712e5 (stale) Mirror 5: 0x36b712e5 (stale) Mirror 7: 0x36b712e5 (stale) Mirror 8: 0x36b712e5 (stale) Mirror 9: 0x36b712e5 (stale) Mirror 10: 0x36b712e5 (stale) CRC-32 checksum value for chunk [0, 0xd308): Mirror 1: 0x1c6b3014 Mirror 11: 0x1c6b3014 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd308: skipped 000167 1787549748.039101 MIRROR_RESYNC 8 mirrors 000168 1787549749.305527 fallocate 0x034155 thru 0x03ffff (0xbeab bytes) 000169 1787549749.364307 MIRROR_RESYNC 8 mirrors 000170 1787549751.060817 trunc from 0x040000 to 0x024c6d (0x1b392 bytes) 000171 1787549751.097127 trunc from 0x00f8c6 to 0x0170b7 (0x77f2 bytes) 000172 1787549751.101420 trunc from 0x024c6e to 0x00b793 (0x194da bytes) 000173 1787549751.117951 mapwrite 0x02cd11 thru 0x03815b (0xb44b bytes) 000174 1787549751.180902 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3815c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3815c): Mirror 4: 0x28527fe9 (stale) Mirror 5: 0x28527fe9 (stale) Mirror 7: 0x28527fe9 (stale) Mirror 8: 0x28527fe9 (stale) Mirror 9: 0x28527fe9 (stale) Mirror 10: 0x28527fe9 (stale) Mirror 11: 0x28527fe9 (stale) CRC-32 checksum value for chunk [0, 0x3815c): Mirror 1: 0x2cd189e5 Mirror 12: 0x2cd189e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3815c: skipped 000175 1787549752.178547 punch from 0x002503 to 0x0047d3 (0x22d1 bytes) 000177 1787549752.227232 read 0x037be1 thru 0x03815b (0x57b bytes) 000178 1787549752.232821 punch from 0x02f5b9 to 0x03815b (0x8ba3 bytes) 000179 1787549752.237454 write 0x01caaf thru 0x01ceeb (0x43d bytes) 000180 1787549752.253267 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3815c): Mirror 4: 0x28527fe9 (stale) Mirror 5: 0x28527fe9 (stale) Mirror 7: 0x28527fe9 (stale) Mirror 8: 0x28527fe9 (stale) Mirror 9: 0x28527fe9 (stale) Mirror 11: 0x28527fe9 (stale) Mirror 12: 0x2cd189e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3815c): Mirror 4: 0x28527fe9 (stale) Mirror 5: 0x28527fe9 (stale) Mirror 7: 0x28527fe9 (stale) Mirror 8: 0x28527fe9 (stale) Mirror 9: 0x28527fe9 (stale) Mirror 11: 0x28527fe9 (stale) Mirror 12: 0x2cd189e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3815c: skipped 000181 1787549752.912729 trunc from 0x03815c to 0x02a688 (0xdad3 bytes) 000182 1787549752.948803 fallocate 0x00511d thru 0x00c10c (0x6ff0 bytes) 000183 1787549752.953501 trunc from 0x01cad4 to 0x02a688 (0xdbb5 bytes) 000184 1787549752.962787 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a689): Mirror 4: 0x2f33131c (stale) Mirror 5: 0x2f33131c (stale) Mirror 7: 0x2f33131c (stale) Mirror 8: 0x2f33131c (stale) Mirror 9: 0x2f33131c (stale) Mirror 12: 0x2f33131c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a689): Mirror 4: 0x2f33131c (stale) Mirror 5: 0x2f33131c (stale) Mirror 7: 0x2f33131c (stale) Mirror 8: 0x2f33131c (stale) Mirror 9: 0x2f33131c (stale) Mirror 12: 0x2f33131c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a689: skipped 000185 1787549753.436410 fallocate 0x022dd4 thru 0x031efc (0xf129 bytes) 000187 1787549753.446528 mapwrite 0x004e61 thru 0x00d6d5 (0x8875 bytes) 000188 1787549753.502319 mapread 0x01d1db thru 0x0288b0 (0xb6d6 bytes) 000189 1787549753.531828 punch from 0x005877 to 0x009624 (0x3dae bytes) 000190 1787549753.537096 punch from 0x00dd83 to 0x01c140 (0xe3be bytes) 000191 1787549753.542892 write 0x02310a thru 0x024900 (0x17f7 bytes) 000192 1787549753.550378 read 0x028619 thru 0x02a688 (0x2070 bytes) 000193 1787549753.551343 trunc from 0x01026b to 0x01abfa (0xa990 bytes) 000194 1787549753.559334 trunc from 0x010004 to 0x0193e0 (0x93dd bytes) 000195 1787549753.564615 write 0x03d1eb thru 0x03ffff (0x2e15 bytes) 000196 1787549753.565957 mapwrite 0x02192a thru 0x022ade (0x11b5 bytes) 000197 1787549753.583333 trunc from 0x003f30 to 0x00fb9b (0xbc6c bytes) 000198 1787549753.589169 write 0x00570a thru 0x0089f9 (0x32f0 bytes) 000199 1787549753.601946 punch from 0x037ef6 to 0x03c31c (0x4427 bytes) 000200 1787549753.607410 read 0x026516 thru 0x02df1a (0x7a05 bytes) 000201 1787549753.631084 fallocate 0x014055 thru 0x022eab (0xee57 bytes) 000202 1787549753.643176 punch from 0x01c515 to 0x02a1e0 (0xdccc bytes) 000203 1787549753.652375 mapwrite 0x02ea43 thru 0x02fe11 (0x13cf bytes) 000205 1787549753.673892 mapread 0x028133 thru 0x0322e2 (0xa1b0 bytes) 000206 1787549753.688015 fallocate 0x010a34 thru 0x01f6f9 (0xecc6 bytes) 000207 1787549753.692742 punch from 0x028ee9 to 0x03308f (0xa1a7 bytes) 000209 1787549753.697624 trunc from 0x036756 to 0x03ffff (0x98aa bytes) 000210 1787549753.702535 trunc from 0x040000 to 0x036640 (0x99bf bytes) 000211 1787549753.714770 write 0x017d47 thru 0x01f900 (0x7bba bytes) 000214 1787549753.726741 punch from 0x011bd7 to 0x020f15 (0xf33f bytes) 000215 1787549753.739243 read 0x02c144 thru 0x036640 (0xa4fd bytes) 000218 1787549753.767721 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x36641): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36641): Mirror 4: 0x1210d5cb (stale) Mirror 5: 0x1210d5cb (stale) Mirror 7: 0x1210d5cb (stale) Mirror 8: 0x1210d5cb (stale) Mirror 9: 0x1210d5cb (stale) Mirror 12: 0xb4fbf9bc (stale) CRC-32 checksum value for chunk [0, 0x36641): Mirror 1: 0xa78ae826 Mirror 13: 0xa78ae826 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36641: skipped 000219 1787549754.650234 trunc from 0x00b22c to 0x019b7e (0xe953 bytes) 000220 1787549754.694439 mapread 0x02bdf2 thru 0x030b13 (0x4d22 bytes) 000223 1787549754.716121 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36641): Mirror 4: 0x1210d5cb (stale) Mirror 5: 0x1210d5cb (stale) Mirror 8: 0x1210d5cb (stale) Mirror 9: 0x1210d5cb (stale) Mirror 12: 0xb4fbf9bc (stale) Mirror 13: 0xa78ae826 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36641): Mirror 4: 0x1210d5cb (stale) Mirror 5: 0x1210d5cb (stale) Mirror 8: 0x1210d5cb (stale) Mirror 9: 0x1210d5cb (stale) Mirror 12: 0xb4fbf9bc (stale) Mirror 13: 0xa78ae826 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36641: skipped 000224 1787549755.214723 mapwrite 0x03da86 thru 0x03ffff (0x257a bytes) 000225 1787549755.317747 write 0x01d118 thru 0x02c98c (0xf875 bytes) 000226 1787549755.355668 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9c6aef53 (stale) Mirror 8: 0x9c6aef53 (stale) Mirror 9: 0x9c6aef53 (stale) Mirror 12: 0xa5777ae0 (stale) Mirror 13: 0x941a683a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9c6aef53 (stale) Mirror 8: 0x9c6aef53 (stale) Mirror 9: 0x9c6aef53 (stale) Mirror 12: 0xa5777ae0 (stale) Mirror 13: 0x941a683a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000227 1787549755.823480 MIRROR_RESYNC 6 mirrors 000228 1787549757.185141 trunc from 0x014d89 to 0x022050 (0xd2c8 bytes) 000229 1787549757.222896 mapread 0x006b80 thru 0x0153b5 (0xe836 bytes) 000230 1787549757.275243 trunc from 0x040000 to 0x02e2b1 (0x11d4e bytes) 000231 1787549757.303959 trunc from 0x02e2b2 to 0x00a590 (0x23d21 bytes) 000232 1787549757.325623 write 0x039dbc thru 0x03b6c4 (0x1909 bytes) 000233 1787549757.326931 trunc from 0x03b6c5 to 0x02810e (0x135b6 bytes) 000234 1787549757.368581 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2810f): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2810f): Mirror 4: 0xdfdeb02a (stale) Mirror 8: 0xdfdeb02a (stale) Mirror 9: 0xdfdeb02a (stale) Mirror 12: 0xdfdeb02a (stale) Mirror 13: 0xdfdeb02a (stale) CRC-32 checksum value for chunk [0, 0x2810f): Mirror 1: 0xc33def02 Mirror 14: 0xc33def02 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2810f: skipped 000235 1787549758.262132 trunc from 0x003231 to 0x00cc7e (0x9a4e bytes) 000236 1787549758.314567 read 0x027f04 thru 0x02810e (0x20b bytes) 000237 1787549758.321494 trunc from 0x02810f to 0x02607e (0x2090 bytes) 000238 1787549758.346029 fallocate 0x0322a9 thru 0x03a6b9 (0x8411 bytes) 000240 1787549758.353585 trunc from 0x01451f to 0x022dbc (0xe89e bytes) 000241 1787549758.359297 fallocate 0x01e4cb thru 0x021adf (0x3615 bytes) 000242 1787549758.371809 MIRROR_RESYNC 7 mirrors 000243 1787549759.184709 trunc from 0x01ff29 to 0x0215df (0x16b7 bytes) 000244 1787549759.225798 mapwrite 0x023c3a thru 0x0304d8 (0xc89f bytes) 000245 1787549759.278260 write 0x0241ec thru 0x03329d (0xf0b2 bytes) 000246 1787549759.281019 read 0x001ae3 thru 0x0060ba (0x45d8 bytes) 000247 1787549759.291731 read 0x000721 thru 0x00e23f (0xdb1f bytes) 000248 1787549759.318169 punch from 0x020ad4 to 0x023bce (0x30fb bytes) 000249 1787549759.323792 mapwrite 0x013e10 thru 0x020ba3 (0xcd94 bytes) 000250 1787549759.356592 trunc from 0x03a6ba to 0x025ee5 (0x147d4 bytes) 000251 1787549759.426362 trunc from 0x025ee6 to 0x03447a (0xe595 bytes) 000252 1787549759.445450 trunc from 0x03447b to 0x002fa7 (0x314d3 bytes) 000253 1787549759.469130 trunc from 0x002fa8 to 0x0319c2 (0x2ea1b bytes) 000254 1787549759.489328 read 0x02cbff thru 0x0307de (0x3be0 bytes) 000255 1787549759.500127 trunc from 0x0319c3 to 0x00dfd9 (0x239e9 bytes) 000256 1787549759.519577 MIRROR_RESYNC 7 mirrors 000257 1787549760.397681 fallocate 0x0373d5 thru 0x03adde (0x3a0a bytes) 000258 1787549760.433010 punch from 0x003aae to 0x0047f0 (0xd43 bytes) 000259 1787549760.438511 read 0x005e8f thru 0x00b1ee (0x5360 bytes) 000260 1787549760.447818 write 0x02ccf0 thru 0x037761 (0xaa72 bytes) 000261 1787549760.449404 mapwrite 0x01360a thru 0x01fec3 (0xc8ba bytes) 000264 1787549760.495061 trunc from 0x027075 to 0x02fbd8 (0x8b64 bytes) 000265 1787549760.499984 trunc from 0x013ff6 to 0x0151c1 (0x11cc bytes) 000266 1787549760.506574 fallocate 0x019faf thru 0x02569f (0xb6f1 bytes) 000267 1787549760.511054 trunc from 0x037762 to 0x013f44 (0x2381d bytes) 000268 1787549760.532276 mapwrite 0x02c2c6 thru 0x02ca45 (0x780 bytes) 000269 1787549760.574177 MIRROR_RESYNC 7 mirrors 000270 1787549761.944089 read 0x0231e1 thru 0x02a398 (0x71b8 bytes) 000271 1787549761.953936 fallocate 0x0175bb thru 0x01df38 (0x697e bytes) 000273 1787549761.990217 trunc from 0x0248c1 to 0x02ca45 (0x8185 bytes) 000274 1787549761.995270 write 0x03bcb9 thru 0x03ffff (0x4347 bytes) 000275 1787549761.998310 trunc from 0x040000 to 0x031050 (0xefaf bytes) 000276 1787549762.015071 trunc from 0x0174df to 0x017f53 (0xa75 bytes) 000278 1787549762.022184 fallocate 0x01831b thru 0x024c1a (0xc900 bytes) 000279 1787549762.028109 punch from 0x03059b to 0x031050 (0xab6 bytes) 000280 1787549762.032632 fallocate 0x01420c thru 0x01ecb3 (0xaaa8 bytes) 000281 1787549762.036919 read 0x017976 thru 0x01b454 (0x3adf bytes) 000282 1787549762.047225 trunc from 0x031051 to 0x03518d (0x413d bytes) 000283 1787549762.065287 trunc from 0x01830c to 0x01c56b (0x4260 bytes) 000284 1787549762.077093 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3518e): Mirror 4: 0x299d2cc6 (stale) Mirror 8: 0x299d2cc6 (stale) Mirror 9: 0x299d2cc6 (stale) Mirror 13: 0x299d2cc6 (stale) Mirror 14: 0x299d2cc6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3518e): Mirror 4: 0x299d2cc6 (stale) Mirror 8: 0x299d2cc6 (stale) Mirror 9: 0x299d2cc6 (stale) Mirror 13: 0x299d2cc6 (stale) Mirror 14: 0x299d2cc6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3518e: skipped 000285 1787549762.508533 mapread 0x01b072 thru 0x01e3ad (0x333c bytes) 000286 1787549762.535313 read 0x02e297 thru 0x03518d (0x6ef7 bytes) 000287 1787549762.544137 trunc from 0x03518e to 0x00ef49 (0x26244 bytes) 000288 1787549762.572983 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xef4a): Mirror 8: 0x2ec0fe66 (stale) Mirror 9: 0x2ec0fe66 (stale) Mirror 13: 0x2ec0fe66 (stale) Mirror 14: 0x2ec0fe66 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xef4a): Mirror 8: 0x2ec0fe66 (stale) Mirror 9: 0x2ec0fe66 (stale) Mirror 13: 0x2ec0fe66 (stale) Mirror 14: 0x2ec0fe66 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xef4a: skipped 000289 1787549762.907052 mapread 0x007ea8 thru 0x00ef49 (0x70a2 bytes) 000290 1787549762.931027 mapread 0x008843 thru 0x00ef49 (0x6707 bytes) 000292 1787549762.933252 fallocate 0x01f1ad thru 0x02d5df (0xe433 bytes) 000293 1787549762.938258 write 0x00e04a thru 0x01893c (0xa8f3 bytes) 000294 1787549762.948023 read 0x028fd2 thru 0x02d5df (0x460e bytes) 000295 1787549762.958245 write 0x02602d thru 0x032ad4 (0xcaa8 bytes) 000296 1787549762.963581 mapwrite 0x01d98a thru 0x0272d7 (0x994e bytes) 000297 1787549762.994256 punch from 0x02b9fa to 0x032ad4 (0x70db bytes) 000298 1787549763.000708 write 0x025c83 thru 0x026d86 (0x1104 bytes) 000299 1787549763.001966 punch from 0x01032d to 0x017cf2 (0x79c6 bytes) 000300 1787549763.006886 read 0x005971 thru 0x012683 (0xcd13 bytes) 000301 1787549763.016916 read 0x00d909 thru 0x01a355 (0xca4d bytes) 000302 1787549763.017786 punch from 0x03078e to 0x032ad4 (0x2347 bytes) 000303 1787549763.022806 read 0x006b88 thru 0x015867 (0xece0 bytes) 000304 1787549763.024256 punch from 0x01c907 to 0x01e10c (0x1806 bytes) 000305 1787549763.029895 mapread 0x020d8c thru 0x028004 (0x7279 bytes) 000306 1787549763.031263 punch from 0x0282df to 0x032ad4 (0xa7f6 bytes) 000307 1787549763.036637 trunc from 0x032ad5 to 0x01246c (0x20668 bytes) 000309 1787549763.053604 punch from 0x00498c to 0x008d79 (0x43ee bytes) 000311 1787549763.060531 trunc from 0x01246d to 0x02f762 (0x1d2f6 bytes) 000312 1787549763.078581 trunc from 0x02f763 to 0x01ecde (0x10a84 bytes) 000313 1787549763.097234 punch from 0x002a37 to 0x00b28c (0x8856 bytes) 000314 1787549763.102560 fallocate 0x03efcf thru 0x03ffff (0x1031 bytes) 000315 1787549763.108761 read 0x00dec5 thru 0x01876c (0xa8a8 bytes) 000316 1787549763.123443 trunc from 0x01ecdf to 0x008e50 (0x15e8e bytes) 000317 1787549763.145308 fallocate 0x00c488 thru 0x017600 (0xb179 bytes) 000318 1787549763.151135 mapwrite 0x020210 thru 0x028b1f (0x8910 bytes) 000319 1787549763.193421 write 0x01b9f5 thru 0x023f9f (0x85ab bytes) 000320 1787549763.198843 write 0x01b8a7 thru 0x020e60 (0x55ba bytes) 000321 1787549763.199914 mapread 0x016624 thru 0x024f33 (0xe910 bytes) 000322 1787549763.228830 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x28b20): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28b20): Mirror 8: 0xec787d8c (stale) Mirror 9: 0xec787d8c (stale) Mirror 13: 0xec787d8c (stale) Mirror 14: 0xec787d8c (stale) CRC-32 checksum value for chunk [0, 0x28b20): Mirror 1: 0xf59f4cef Mirror 15: 0xf59f4cef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28b20: skipped 000323 1787549764.238596 trunc from 0x028b20 to 0x036b2f (0xe010 bytes) 000324 1787549764.316236 mapwrite 0x03ba1d thru 0x03ffff (0x45e3 bytes) 000325 1787549764.382655 read 0x02c0e4 thru 0x03a004 (0xdf21 bytes) 000326 1787549764.394067 mapread 0x03b7ef thru 0x03ffff (0x4811 bytes) 000327 1787549764.395964 mapwrite 0x011d5d thru 0x021936 (0xfbda bytes) 000328 1787549764.450553 trunc from 0x040000 to 0x01c40c (0x23bf3 bytes) 000329 1787549764.467048 trunc from 0x014a79 to 0x01a98d (0x5f15 bytes) 000330 1787549764.471654 write 0x030797 thru 0x032def (0x2659 bytes) 000331 1787549764.472662 read 0x022f95 thru 0x0315ac (0xe618 bytes) 000332 1787549764.484115 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x32df0): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32df0): Mirror 8: 0xac2ce2a1 (stale) Mirror 9: 0xac2ce2a1 (stale) Mirror 13: 0xac2ce2a1 (stale) Mirror 14: 0xac2ce2a1 (stale) Mirror 15: 0xecd69325 (stale) CRC-32 checksum value for chunk [0, 0x32df0): Mirror 1: 0x1620ff3f Mirror 16: 0x1620ff3f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32df0: skipped 000334 1787549765.815553 write 0x01a299 thru 0x0201cf (0x5f37 bytes) 000335 1787549765.867279 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x32df0): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32df0): Mirror 8: 0xac2ce2a1 (stale) Mirror 9: 0xac2ce2a1 (stale) Mirror 13: 0xac2ce2a1 (stale) Mirror 14: 0xac2ce2a1 (stale) Mirror 15: 0xecd69325 (stale) Mirror 16: 0x1620ff3f (stale) CRC-32 checksum value for chunk [0, 0x32df0): Mirror 1: 0x9991e767 Mirror 17: 0x9991e767 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32df0: skipped 000336 1787549767.097775 mapread 0x02e207 thru 0x0307a9 (0x25a3 bytes) 000337 1787549767.136563 read 0x00acbe thru 0x019c79 (0xefbc bytes) 000338 1787549767.173677 trunc from 0x032df0 to 0x019835 (0x195ba bytes) 000339 1787549767.301827 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19836): Mirror 8: 0x4e75e468 (stale) Mirror 9: 0x4e75e468 (stale) Mirror 13: 0x4e75e468 (stale) Mirror 15: 0x6de422a0 (stale) Mirror 16: 0x1e3863ad (stale) Mirror 17: 0x1e3863ad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19836): Mirror 8: 0x4e75e468 (stale) Mirror 9: 0x4e75e468 (stale) Mirror 13: 0x4e75e468 (stale) Mirror 15: 0x6de422a0 (stale) Mirror 16: 0x1e3863ad (stale) Mirror 17: 0x1e3863ad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19836: skipped 000340 1787549767.808694 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19836): Mirror 9: 0x4e75e468 (stale) Mirror 13: 0x4e75e468 (stale) Mirror 15: 0x6de422a0 (stale) Mirror 16: 0x1e3863ad (stale) Mirror 17: 0x1e3863ad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19836): Mirror 9: 0x4e75e468 (stale) Mirror 13: 0x4e75e468 (stale) Mirror 15: 0x6de422a0 (stale) Mirror 16: 0x1e3863ad (stale) Mirror 17: 0x1e3863ad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19836: skipped 000341 1787549768.456965 punch from 0x007a3a to 0x008437 (0x9fe bytes) 000342 1787549768.463237 mapread 0x00b461 thru 0x00e1c7 (0x2d67 bytes) 000343 1787549768.498476 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19836): Mirror 9: 0x4e75e468 (stale) Mirror 13: 0x4e75e468 (stale) Mirror 15: 0x6de422a0 (stale) Mirror 16: 0x1e3863ad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19836): Mirror 9: 0x4e75e468 (stale) Mirror 13: 0x4e75e468 (stale) Mirror 15: 0x6de422a0 (stale) Mirror 16: 0x1e3863ad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19836: skipped 000344 1787549769.161308 write 0x018b1c thru 0x01da96 (0x4f7b bytes) 000345 1787549769.191731 punch from 0x019321 to 0x01da96 (0x4776 bytes) 000346 1787549769.219941 read 0x015cdd thru 0x0192d7 (0x35fb bytes) 000347 1787549769.266487 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1da97): Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1da97): Mirror 9: 0x5c309462 (stale) Mirror 13: 0x5c309462 (stale) Mirror 15: 0xd752ca68 (stale) Mirror 16: 0x5dfb8512 (stale) CRC-32 checksum value for chunk [0, 0x1da97): Mirror 1: 0xb9410a09 Mirror 17: 0xb9410a09 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1da97: skipped 000348 1787549770.495098 mapwrite 0x01113a thru 0x011dcf (0xc96 bytes) 000349 1787549770.612445 trunc from 0x01da97 to 0x029786 (0xbcf0 bytes) 000350 1787549770.687259 write 0x00a2af thru 0x019eed (0xfc3f bytes) 000351 1787549770.742811 read 0x00c8ca thru 0x016475 (0x9bac bytes) 000352 1787549770.747745 read 0x016212 thru 0x01b4ad (0x529c bytes) 000354 1787549770.803917 fallocate 0x021790 thru 0x024aa8 (0x3319 bytes) 000356 1787549770.820941 trunc from 0x029787 to 0x0319e4 (0x825e bytes) 000357 1787549770.867795 trunc from 0x0319e5 to 0x018a41 (0x18fa3 bytes) 000358 1787549770.908032 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x18a42): Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18a42): Mirror 9: 0xe6d1c622 (stale) Mirror 13: 0xe6d1c622 (stale) Mirror 15: 0xa2475376 (stale) Mirror 16: 0xcd535875 (stale) Mirror 17: 0xcd535875 (stale) CRC-32 checksum value for chunk [0, 0x18a42): Mirror 1: 0x5af72df9 Mirror 18: 0x5af72df9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18a42: skipped 000359 1787549772.721805 trunc from 0x00dbc7 to 0x00f185 (0x15bf bytes) 000360 1787549772.783234 punch from 0x000f4f to 0x00d2bc (0xc36e bytes) 000361 1787549772.789265 trunc from 0x010d1c to 0x0116be (0x9a3 bytes) 000364 1787549772.795617 read 0x0105b8 thru 0x015501 (0x4f4a bytes) 000366 1787549772.803824 write 0x021ea0 thru 0x030892 (0xe9f3 bytes) 000369 1787549772.810556 mapread 0x02b1ac thru 0x030892 (0x56e7 bytes) 000370 1787549772.815943 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x30893): Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30893): Mirror 9: 0xbe7af2a (stale) Mirror 13: 0xbe7af2a (stale) Mirror 15: 0x9bfee740 (stale) Mirror 16: 0xe6b5ef9c (stale) Mirror 17: 0x7d58af74 (stale) Mirror 18: 0x5bf8f753 (stale) CRC-32 checksum value for chunk [0, 0x30893): Mirror 1: 0x4bc6af68 Mirror 19: 0x4bc6af68 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30893: skipped 000371 1787549774.017406 trunc from 0x00eef1 to 0x010f83 (0x2093 bytes) 000372 1787549774.061597 trunc from 0x030893 to 0x001b37 (0x2ed5b bytes) 000373 1787549774.097030 mapread 0x0010b3 thru 0x001b37 (0xa85 bytes) 000374 1787549774.106593 trunc from 0x000b02 to 0x001b37 (0x1036 bytes) 000375 1787549774.111654 read 0x000950 thru 0x001b37 (0x11e8 bytes) 000376 1787549774.122784 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b38): Mirror 13: 0xd16bb363 (stale) Mirror 15: 0xd16bb363 (stale) Mirror 16: 0xd16bb363 (stale) Mirror 17: 0xd16bb363 (stale) Mirror 18: 0xd16bb363 (stale) Mirror 19: 0xb3d7f6bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b38): Mirror 13: 0xd16bb363 (stale) Mirror 15: 0xd16bb363 (stale) Mirror 16: 0xd16bb363 (stale) Mirror 17: 0xd16bb363 (stale) Mirror 18: 0xd16bb363 (stale) Mirror 19: 0xb3d7f6bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b38: skipped 000377 1787549774.510553 trunc from 0x00149c to 0x001b37 (0x69c bytes) 000378 1787549774.523553 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b38): Mirror 13: 0xd16bb363 (stale) Mirror 16: 0xd16bb363 (stale) Mirror 17: 0xd16bb363 (stale) Mirror 18: 0xd16bb363 (stale) Mirror 19: 0xb3d7f6bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b38): Mirror 13: 0xd16bb363 (stale) Mirror 16: 0xd16bb363 (stale) Mirror 17: 0xd16bb363 (stale) Mirror 18: 0xd16bb363 (stale) Mirror 19: 0xb3d7f6bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b38: skipped 000382 1787549774.902979 mapwrite 0x034bc8 thru 0x03ffff (0xb438 bytes) 000383 1787549774.973747 punch from 0x0378ca to 0x03ca3b (0x5172 bytes) 000385 1787549774.991004 punch from 0x02bab1 to 0x036cc7 (0xb217 bytes) 000386 1787549775.007836 punch from 0x024314 to 0x02e12b (0x9e18 bytes) 000387 1787549775.016636 punch from 0x01511c to 0x02305b (0xdf40 bytes) 000388 1787549775.023475 fallocate 0x03e211 thru 0x03e665 (0x455 bytes) 000389 1787549775.032826 read 0x036a12 thru 0x03ffff (0x95ee bytes) 000390 1787549775.048563 write 0x01069f thru 0x012c82 (0x25e4 bytes) 000391 1787549775.070361 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x52164e47 (stale) Mirror 17: 0x95fea421 (stale) Mirror 18: 0xd5393394 (stale) Mirror 19: 0x30c746ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x52164e47 (stale) Mirror 17: 0x95fea421 (stale) Mirror 18: 0xd5393394 (stale) Mirror 19: 0x30c746ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000392 1787549775.676743 write 0x02daeb thru 0x02ea7f (0xf95 bytes) 000393 1787549775.695107 mapread 0x00587a thru 0x010343 (0xaaca bytes) 000394 1787549775.715194 trunc from 0x00bc52 to 0x013b69 (0x7f18 bytes) 000395 1787549775.719761 trunc from 0x040000 to 0x00583a (0x3a7c5 bytes) 000396 1787549775.740472 punch from 0x000d50 to 0x00583a (0x4aeb bytes) 000397 1787549775.752057 fallocate 0x016102 thru 0x0182f1 (0x21f0 bytes) 000398 1787549775.769695 mapwrite 0x034144 thru 0x0349bc (0x879 bytes) 000399 1787549775.825000 punch from 0x006ad9 to 0x0133aa (0xc8d2 bytes) 000400 1787549775.829162 trunc from 0x0349bd to 0x028ed2 (0xbaea bytes) 000401 1787549775.872095 write 0x01e72d thru 0x020caa (0x257e bytes) 000402 1787549775.892768 mapread 0x009f6e thru 0x010e0b (0x6e9e bytes) 000403 1787549775.910713 punch from 0x026d1c to 0x028ed2 (0x21b7 bytes) 000404 1787549775.933757 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28ed3): Mirror 13: 0xc4c6198f (stale) Mirror 17: 0x4582cfa8 (stale) Mirror 18: 0xb75998b3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28ed3): Mirror 13: 0xc4c6198f (stale) Mirror 17: 0x4582cfa8 (stale) Mirror 18: 0xb75998b3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28ed3: skipped 000405 1787549776.242627 write 0x021635 thru 0x0264da (0x4ea6 bytes) 000406 1787549776.265058 MIRROR_RESYNC 4 mirrors 000407 1787549777.403053 write 0x014f1f thru 0x0172cd (0x23af bytes) 000409 1787549777.442796 punch from 0x008bb9 to 0x01323e (0xa686 bytes) 000410 1787549777.449167 write 0x023b39 thru 0x02bc0b (0x80d3 bytes) 000411 1787549777.453730 mapread 0x00f8c5 thru 0x016ab9 (0x71f5 bytes) 000412 1787549777.519721 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bc0c): Mirror 13: 0xd8be15fc (stale) Mirror 17: 0xd8be15fc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bc0c): Mirror 13: 0xd8be15fc (stale) Mirror 17: 0xd8be15fc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bc0c: skipped 000414 1787549777.853674 trunc from 0x02bc0c to 0x00395e (0x282ad bytes) 000415 1787549777.878137 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x395f): Mirror 17: 0x659b5a53 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x395f): Mirror 17: 0x659b5a53 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x395f: skipped 000416 1787549778.089519 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x395f): Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x395f): Mirror 17: 0x659b5a53 (stale) CRC-32 checksum value for chunk [0, 0x395f): Mirror 1: 0x659b5a53 Mirror 18: 0x659b5a53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x395f: skipped 000417 1787549779.093408 punch from 0x000266 to 0x00395e (0x36f9 bytes) 000418 1787549779.153667 MIRROR_RESYNC 3 mirrors 000419 1787549780.035371 mapread 0x001039 thru 0x00395e (0x2926 bytes) 000420 1787549780.054661 trunc from 0x00395f to 0x014168 (0x1080a bytes) 000421 1787549780.096093 MIRROR_RESYNC 3 mirrors 000422 1787549780.631132 trunc from 0x014169 to 0x020e11 (0xcca9 bytes) 000423 1787549780.661543 fallocate 0x036ea4 thru 0x03855c (0x16b9 bytes) 000424 1787549780.666368 trunc from 0x0198ea to 0x02792b (0xe042 bytes) 000425 1787549780.671650 punch from 0x01fdbf to 0x02a293 (0xa4d5 bytes) 000426 1787549780.676071 read 0x023110 thru 0x032b3a (0xfa2b bytes) 000427 1787549780.690744 mapwrite 0x03592c thru 0x03ffff (0xa6d4 bytes) 000429 1787549780.747943 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0x48e25abd (stale) Mirror 18: 0x48e25abd (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9359d547 Mirror 19: 0x9359d547 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000430 1787549781.610285 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0x48e25abd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0x48e25abd (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9359d547 Mirror 19: 0x9359d547 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000431 1787549782.129841 trunc from 0x0070c4 to 0x00ebd6 (0x7b13 bytes) 000432 1787549782.174223 read 0x01eec0 thru 0x02c4d7 (0xd618 bytes) 000433 1787549782.183746 write 0x00dbd3 thru 0x014d7f (0x71ad bytes) 000434 1787549782.195719 read 0x02e1ba thru 0x039587 (0xb3ce bytes) 000435 1787549782.210473 mapwrite 0x027b37 thru 0x034fe9 (0xd4b3 bytes) 000436 1787549782.228109 trunc from 0x040000 to 0x027321 (0x18cde bytes) 000437 1787549782.240025 read 0x006162 thru 0x007a05 (0x18a4 bytes) 000438 1787549782.240545 mapread 0x000151 thru 0x00a41f (0xa2cf bytes) 000440 1787549782.244639 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27322): Mirror 19: 0xb74e8033 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27322): Mirror 19: 0xb74e8033 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27322: skipped 000441 1787549782.501203 trunc from 0x027322 to 0x0266dd (0xc44 bytes) 000442 1787549782.522196 write 0x03c3c2 thru 0x03ffff (0x3c3e bytes) 000443 1787549782.523616 trunc from 0x00d3ad to 0x01342d (0x6081 bytes) 000444 1787549782.529673 mapwrite 0x013733 thru 0x017712 (0x3fe0 bytes) 000445 1787549782.561935 punch from 0x03c486 to 0x03ffff (0x3b7a bytes) 000446 1787549782.572667 MIRROR_RESYNC 2 mirrors 000447 1787549783.390340 write 0x019def thru 0x01fdd7 (0x5fe9 bytes) 000448 1787549783.427720 write 0x01c6b1 thru 0x02a07d (0xd9cd bytes) 000449 1787549783.433688 punch from 0x001eb4 to 0x01041c (0xe569 bytes) 000450 1787549783.438049 fallocate 0x005e2f thru 0x01317a (0xd34c bytes) 000453 1787549783.443766 write 0x02c379 thru 0x02e43b (0x20c3 bytes) 000454 1787549783.454373 punch from 0x02a539 to 0x03a4d3 (0xff9b bytes) 000455 1787549783.480640 write 0x024bb7 thru 0x02ef4f (0xa399 bytes) 000456 1787549783.486169 mapwrite 0x000ba5 thru 0x00f047 (0xe4a3 bytes) 000457 1787549783.530364 read 0x030cb5 thru 0x03a4a5 (0x97f1 bytes) 000458 1787549783.541939 mapwrite 0x03d45c thru 0x03ffff (0x2ba4 bytes) 000459 1787549783.561710 mapread 0x009949 thru 0x013354 (0x9a0c bytes) 000460 1787549783.570909 fallocate 0x02bf41 thru 0x03022e (0x42ee bytes) 000461 1787549783.575650 trunc from 0x040000 to 0x03df85 (0x207a bytes) 000462 1787549783.592419 write 0x007c20 thru 0x015d1d (0xe0fe bytes) 000463 1787549783.594686 fallocate 0x034ec2 thru 0x0387a5 (0x38e4 bytes) 000464 1787549783.599810 fallocate 0x0284e1 thru 0x035516 (0xd036 bytes) 000465 1787549783.605057 write 0x004567 thru 0x009c98 (0x5732 bytes) 000466 1787549783.610127 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) 000467 1787549783.743165 trunc from 0x03df86 to 0x03d1af (0xdd6 bytes) 000468 1787549783.762326 mapwrite 0x02c903 thru 0x02df99 (0x1697 bytes) 000469 1787549783.781569 mapwrite 0x027a71 thru 0x02d00f (0x559f bytes) 000470 1787549783.803580 punch from 0x00fdb5 to 0x00fde9 (0x35 bytes) 000471 1787549783.808864 write 0x0141f2 thru 0x020944 (0xc753 bytes) 000472 1787549783.814523 trunc from 0x03d1b0 to 0x03457d (0x8c32 bytes) 000473 1787549783.832822 MIRROR_EXTEND to 2 mirrors 000474 1787549784.688365 write 0x029a21 thru 0x032bbd (0x919d bytes) 000475 1787549784.731152 trunc from 0x022772 to 0x0316be (0xef4d bytes) 000476 1787549784.795724 trunc from 0x03457e to 0x017139 (0x1d444 bytes) 000477 1787549784.833888 punch from 0x00d9f8 to 0x00fea7 (0x24b0 bytes) 000478 1787549784.842031 punch from 0x013555 to 0x017139 (0x3be5 bytes) 000479 1787549784.848179 mapread 0x0161ee thru 0x017139 (0xf4c bytes) 000480 1787549784.859922 punch from 0x00a9a6 to 0x017139 (0xc794 bytes) 000482 1787549784.866397 mapread 0x005680 thru 0x010da3 (0xb724 bytes) 000483 1787549784.878947 mapwrite 0x017fd5 thru 0x023d10 (0xbd3c bytes) 000484 1787549784.941041 MIRROR_RESYNC 2 mirrors 000485 1787549785.680442 punch from 0x007b73 to 0x011409 (0x9897 bytes) 000486 1787549785.751288 fallocate 0x005564 thru 0x011164 (0xbc01 bytes) 000487 1787549785.759447 fallocate 0x01b80a thru 0x022395 (0x6b8c bytes) 000488 1787549785.778486 write 0x023d51 thru 0x0269b0 (0x2c60 bytes) 000489 1787549785.789486 write 0x004b55 thru 0x00ea00 (0x9eac bytes) 000490 1787549785.812662 mapread 0x014959 thru 0x0171c7 (0x286f bytes) 000491 1787549785.858596 read 0x004ae6 thru 0x007277 (0x2792 bytes) 000492 1787549785.870041 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x269b1): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x269b1): Mirror 2: 0x73653fa2 (stale) CRC-32 checksum value for chunk [0, 0x269b1): Mirror 1: 0xb5041015 Mirror 3: 0xb5041015 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x269b1: skipped 000493 1787549787.030294 trunc from 0x0045e2 to 0x013872 (0xf291 bytes) 000494 1787549787.093736 punch from 0x013709 to 0x016e10 (0x3708 bytes) 000495 1787549787.101772 trunc from 0x01b5a6 to 0x0269b0 (0xb40b bytes) 000496 1787549787.110588 punch from 0x004141 to 0x01306a (0xef2a bytes) 000497 1787549787.118195 trunc from 0x00097f to 0x009978 (0x8ffa bytes) 000499 1787549787.124706 fallocate 0x02f98d thru 0x03bdcd (0xc441 bytes) 000502 1787549787.139192 trunc from 0x03bdce to 0x00a311 (0x31abc bytes) 000503 1787549787.166693 write 0x00c7f0 thru 0x0105d0 (0x3de1 bytes) 000504 1787549787.172377 MIRROR_RESYNC 3 mirrors 000505 1787549787.850587 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) 000506 1787549788.146537 write 0x011356 thru 0x01f684 (0xe32f bytes) 000507 1787549788.205667 trunc from 0x01573d to 0x016f92 (0x1856 bytes) 000508 1787549788.221654 mapwrite 0x0208a8 thru 0x022995 (0x20ee bytes) 000509 1787549788.263817 trunc from 0x022996 to 0x02be35 (0x94a0 bytes) 000510 1787549788.280004 trunc from 0x02aafb to 0x02be35 (0x133b bytes) 000511 1787549788.284494 trunc from 0x02af1f to 0x02be35 (0xf17 bytes) 000512 1787549788.292692 punch from 0x01dc36 to 0x029c26 (0xbff1 bytes) 000513 1787549788.301556 punch from 0x01d22d to 0x029940 (0xc714 bytes) 000514 1787549788.306476 trunc from 0x02382a to 0x028fa6 (0x577d bytes) 000515 1787549788.311174 trunc from 0x02be36 to 0x02634e (0x5ae7 bytes) 000516 1787549788.331685 write 0x01876a thru 0x01b8a5 (0x313c bytes) 000517 1787549788.337152 trunc from 0x0032f5 to 0x00dc32 (0xa93e bytes) 000518 1787549788.343725 read 0x016382 thru 0x017298 (0xf17 bytes) 000519 1787549788.351756 mapwrite 0x02ec15 thru 0x036dd3 (0x81bf bytes) 000520 1787549788.395736 read 0x0084c7 thru 0x01015b (0x7c95 bytes) 000521 1787549788.403784 punch from 0x02e748 to 0x034f3b (0x67f4 bytes) 000523 1787549788.410066 write 0x019e89 thru 0x020f30 (0x70a8 bytes) 000525 1787549788.415707 fallocate 0x0379d5 thru 0x03ffff (0x862b bytes) 000527 1787549788.420136 mapwrite 0x00541c thru 0x00d931 (0x8516 bytes) 000528 1787549788.437954 mapwrite 0x03dc8e thru 0x03ffff (0x2372 bytes) 000529 1787549788.464294 punch from 0x0037b7 to 0x00f933 (0xc17d bytes) 000530 1787549788.468977 mapwrite 0x02b304 thru 0x037846 (0xc543 bytes) 000531 1787549788.519140 trunc from 0x040000 to 0x01bff5 (0x2400a bytes) 000532 1787549788.539138 mapread 0x00c846 thru 0x01057d (0x3d38 bytes) 000533 1787549788.555706 mapwrite 0x0302df thru 0x03996c (0x968e bytes) 000534 1787549788.626725 fallocate 0x004c72 thru 0x01014c (0xb4db bytes) 000535 1787549788.633706 trunc from 0x01e0af to 0x023853 (0x57a5 bytes) 000537 1787549788.643331 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3996d): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3996d): Mirror 2: 0x4b655a1 (stale) CRC-32 checksum value for chunk [0, 0x3996d): Mirror 1: 0xea9c9f39 Mirror 3: 0xea9c9f39 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3996d: skipped 000538 1787549789.586283 mapwrite 0x025c8f thru 0x029835 (0x3ba7 bytes) 000539 1787549789.698376 write 0x02afee thru 0x033691 (0x86a4 bytes) 000540 1787549789.726664 fallocate 0x01e77a thru 0x024fca (0x6851 bytes) 000541 1787549789.736493 mapread 0x01618e thru 0x0191af (0x3022 bytes) 000543 1787549789.753664 trunc from 0x03996d to 0x0391de (0x78e bytes) 000544 1787549789.785458 mapread 0x02a581 thru 0x038aff (0xe57f bytes) 000546 1787549789.798510 punch from 0x0057f0 to 0x013cde (0xe4ef bytes) 000547 1787549789.807588 mapwrite 0x013331 thru 0x01891a (0x55ea bytes) 000548 1787549789.849416 MIRROR_RESYNC 3 mirrors 000549 1787549790.682594 read 0x01475b thru 0x021a09 (0xd2af bytes) 000550 1787549790.688921 write 0x002fbf thru 0x01081a (0xd85c bytes) 000551 1787549790.733914 read 0x027940 thru 0x02b5c3 (0x3c84 bytes) 000552 1787549790.746263 mapread 0x01e72f thru 0x025463 (0x6d35 bytes) 000553 1787549790.747220 mapread 0x0006cd thru 0x00205b (0x198f bytes) 000554 1787549790.747926 mapwrite 0x03c6d7 thru 0x03f0c7 (0x29f1 bytes) 000555 1787549790.806402 fallocate 0x011bb0 thru 0x016bab (0x4ffc bytes) 000556 1787549790.813638 mapread 0x0351b3 thru 0x03b92d (0x677b bytes) 000557 1787549790.822682 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3f0c8): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f0c8): Mirror 2: 0x9983be60 (stale) Mirror 3: 0x9983be60 (stale) CRC-32 checksum value for chunk [0, 0x3f0c8): Mirror 1: 0x72193a6a Mirror 4: 0x72193a6a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f0c8: skipped 000558 1787549791.899323 punch from 0x013340 to 0x014159 (0xe1a bytes) 000559 1787549791.954738 fallocate 0x03b238 thru 0x03ffff (0x4dc8 bytes) 000560 1787549791.963834 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f0c8): Mirror 2: 0x9983be60 (stale) Mirror 3: 0x9983be60 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f0c8): Mirror 2: 0x9983be60 (stale) Mirror 3: 0x9983be60 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f0c8: skipped 000562 1787549792.330152 trunc from 0x03f0c8 to 0x0318b8 (0xd80f bytes) 000563 1787549792.347916 trunc from 0x00a627 to 0x00caab (0x2485 bytes) 000565 1787549792.359971 fallocate 0x01f23e thru 0x02cd3e (0xdb01 bytes) 000567 1787549792.364815 mapwrite 0x005e6d thru 0x00b755 (0x58e9 bytes) 000568 1787549792.403318 fallocate 0x03b29a thru 0x03ffff (0x4d66 bytes) 000569 1787549792.410355 mapwrite 0x03917a thru 0x03ffff (0x6e86 bytes) 000570 1787549792.454652 punch from 0x026e63 to 0x0319b9 (0xab57 bytes) 000571 1787549792.460569 mapread 0x004566 thru 0x004a3e (0x4d9 bytes) 000572 1787549792.461784 punch from 0x00937f to 0x009961 (0x5e3 bytes) 000574 1787549792.466645 write 0x01f51f thru 0x021551 (0x2033 bytes) 000576 1787549792.479543 read 0x02813a thru 0x0357ea (0xd6b1 bytes) 000577 1787549792.492526 punch from 0x020e2a to 0x022d86 (0x1f5d bytes) 000578 1787549792.514475 read 0x019004 thru 0x020d38 (0x7d35 bytes) 000579 1787549792.523662 trunc from 0x040000 to 0x009c25 (0x363da bytes) 000580 1787549792.539276 trunc from 0x002720 to 0x009c25 (0x7506 bytes) 000581 1787549792.545646 write 0x00f5b5 thru 0x01a866 (0xb2b2 bytes) 000582 1787549792.547307 trunc from 0x018d5f to 0x01a866 (0x1b08 bytes) 000583 1787549792.564497 fallocate 0x034c2b thru 0x03ffff (0xb3d5 bytes) 000584 1787549792.570796 punch from 0x006e04 to 0x006ea4 (0xa1 bytes) 000585 1787549792.579141 write 0x02a268 thru 0x02fe56 (0x5bef bytes) 000586 1787549792.580474 fallocate 0x0281cc thru 0x03404b (0xbe80 bytes) 000587 1787549792.584643 punch from 0x0054a3 to 0x00a909 (0x5467 bytes) 000588 1787549792.590840 trunc from 0x02fe57 to 0x008e93 (0x26fc3 bytes) 000589 1787549792.613918 trunc from 0x008e94 to 0x00954d (0x6ba bytes) 000591 1787549792.630662 trunc from 0x002414 to 0x00954d (0x713a bytes) 000592 1787549792.636379 read 0x0030a1 thru 0x00954d (0x64ad bytes) 000593 1787549792.645315 trunc from 0x00954e to 0x03ebb4 (0x35667 bytes) 000594 1787549792.659530 trunc from 0x00f8d8 to 0x01988e (0x9fb7 bytes) 000595 1787549792.664589 trunc from 0x03ebb5 to 0x0241e5 (0x1a9cf bytes) 000596 1787549792.676782 punch from 0x00ead8 to 0x017860 (0x8d89 bytes) 000597 1787549792.685694 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x241e6): Mirror 3: 0xfa144bfd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x241e6): Mirror 3: 0xfa144bfd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x241e6: skipped 000598 1787549792.932128 MIRROR_RESYNC 2 mirrors 000599 1787549793.566604 trunc from 0x0241e6 to 0x02d644 (0x945f bytes) 000601 1787549793.621387 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2d645): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d645): Mirror 3: 0xa92b76bf (stale) CRC-32 checksum value for chunk [0, 0x2d645): Mirror 1: 0xa92b76bf Mirror 4: 0xa92b76bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d645: skipped 000602 1787549795.094316 write 0x02ab9d thru 0x02f4a9 (0x490d bytes) 000603 1787549795.197721 trunc from 0x02c3d8 to 0x02f4a9 (0x30d2 bytes) 000604 1787549795.227230 write 0x016e1b thru 0x026638 (0xf81e bytes) 000605 1787549795.265722 trunc from 0x02f4aa to 0x00ce38 (0x22671 bytes) 000606 1787549795.317213 write 0x01b325 thru 0x01fe1c (0x4af8 bytes) 000607 1787549795.318768 trunc from 0x00b105 to 0x01a5fa (0xf4f6 bytes) 000609 1787549795.331522 mapread 0x002cfb thru 0x01054f (0xd855 bytes) 000610 1787549795.391044 punch from 0x01141f to 0x01778f (0x6371 bytes) 000611 1787549795.426535 fallocate 0x0226ec thru 0x023870 (0x1185 bytes) 000612 1787549795.453785 punch from 0x0091ff to 0x00cf5c (0x3d5e bytes) 000614 1787549795.475059 fallocate 0x01c785 thru 0x01e028 (0x18a4 bytes) 000615 1787549795.491563 mapwrite 0x00683c thru 0x00a798 (0x3f5d bytes) 000618 1787549795.582971 mapwrite 0x02c20a thru 0x02de33 (0x1c2a bytes) 000619 1787549795.709168 trunc from 0x00d4b6 to 0x015f64 (0x8aaf bytes) 000621 1787549795.741188 trunc from 0x007d1a to 0x009dfc (0x20e3 bytes) 000623 1787549795.759339 mapread 0x004aeb thru 0x006148 (0x165e bytes) 000624 1787549795.768274 trunc from 0x010a4f to 0x015db3 (0x5365 bytes) 000625 1787549795.772513 mapread 0x0091f4 thru 0x00dbb9 (0x49c6 bytes) 000626 1787549795.797427 trunc from 0x022ef0 to 0x023d74 (0xe85 bytes) 000627 1787549795.811654 trunc from 0x005ab1 to 0x00e7b4 (0x8d04 bytes) 000628 1787549795.824522 write 0x01c111 thru 0x025aff (0x99ef bytes) 000629 1787549795.838452 MIRROR_RESYNC 3 mirrors 000630 1787549797.784203 punch from 0x0223f4 to 0x022bb3 (0x7c0 bytes) 000631 1787549797.841824 trunc from 0x02de34 to 0x0096b1 (0x24782 bytes) 000632 1787549797.872087 mapwrite 0x005014 thru 0x012607 (0xd5f4 bytes) 000633 1787549798.008094 MIRROR_RESYNC 3 mirrors 000634 1787549799.562039 fallocate 0x007fa9 thru 0x00aa82 (0x2ada bytes) 000635 1787549799.640343 fallocate 0x01a106 thru 0x02910d (0xf008 bytes) 000636 1787549799.647471 punch from 0x014283 to 0x01c2b4 (0x8032 bytes) 000637 1787549799.656690 punch from 0x02129b to 0x02910d (0x7e73 bytes) 000638 1787549799.680103 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2910e): Mirror 4: 0x7dc8c16f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2910e): Mirror 4: 0x7dc8c16f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2910e: skipped 000639 1787549800.311313 fallocate 0x018fab thru 0x01f953 (0x69a9 bytes) 000640 1787549800.319514 mapread 0x00f020 thru 0x01ee05 (0xfde6 bytes) 000641 1787549800.414271 MIRROR_RESYNC 2 mirrors 000642 1787549801.718646 trunc from 0x02910e to 0x03543b (0xc32e bytes) 000643 1787549801.770169 fallocate 0x00fa66 thru 0x01dd58 (0xe2f3 bytes) 000644 1787549801.776526 trunc from 0x03543c to 0x03ccf4 (0x78b9 bytes) 000645 1787549801.814762 trunc from 0x02b7aa to 0x02bcd0 (0x527 bytes) 000646 1787549801.840820 read 0x032157 thru 0x03ccf4 (0xab9e bytes) 000647 1787549801.853895 mapread 0x03cc4d thru 0x03ccf4 (0xa8 bytes) 000648 1787549801.854828 mapread 0x020cdc thru 0x027677 (0x699c bytes) 000649 1787549801.908196 mapread 0x022da6 thru 0x0247a2 (0x19fd bytes) 000650 1787549801.909120 trunc from 0x0107b5 to 0x016eb9 (0x6705 bytes) 000651 1787549801.918556 read 0x024250 thru 0x031b06 (0xd8b7 bytes) 000653 1787549801.949577 trunc from 0x031de0 to 0x03ccf4 (0xaf15 bytes) 000654 1787549801.963782 trunc from 0x0101cd to 0x0107b6 (0x5ea bytes) 000655 1787549801.974036 punch from 0x0018fa to 0x00ac91 (0x9398 bytes) 000657 1787549802.028940 MIRROR_RESYNC 2 mirrors 000659 1787549803.375519 MIRROR_EXTEND to 3 mirrors 000660 1787549804.672351 trunc from 0x0163e5 to 0x022099 (0xbcb5 bytes) 000661 1787549804.747150 fallocate 0x020eb1 thru 0x02f43a (0xe58a bytes) 000662 1787549804.765614 write 0x03d4f9 thru 0x03ffff (0x2b07 bytes) 000663 1787549804.794409 mapwrite 0x030b7c thru 0x03ffff (0xf484 bytes) 000664 1787549804.899583 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf3a5a99f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf3a5a99f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000665 1787549805.456622 trunc from 0x01fcdc to 0x022985 (0x2caa bytes) 000666 1787549805.477253 fallocate 0x022977 thru 0x0242e1 (0x196b bytes) 000667 1787549805.490315 mapwrite 0x0075ea thru 0x00c6ef (0x5106 bytes) 000668 1787549805.644985 trunc from 0x040000 to 0x023ebe (0x1c141 bytes) 000669 1787549805.711317 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) 000670 1787549805.974704 punch from 0x00ed36 to 0x013f47 (0x5212 bytes) 000671 1787549805.987031 write 0x039eeb thru 0x03ffff (0x6115 bytes) 000672 1787549805.996289 trunc from 0x02e76d to 0x03d3a2 (0xec36 bytes) 000673 1787549806.029711 read 0x02a116 thru 0x02b558 (0x1443 bytes) 000675 1787549806.047714 trunc from 0x003151 to 0x00bacd (0x897d bytes) 000676 1787549806.057713 mapwrite 0x011d2a thru 0x01e288 (0xc55f bytes) 000677 1787549806.186137 read 0x016643 thru 0x01edf9 (0x87b7 bytes) 000678 1787549806.186802 read 0x03de43 thru 0x03ffff (0x21bd bytes) 000679 1787549806.213654 trunc from 0x015c13 to 0x01da39 (0x7e27 bytes) 000680 1787549806.228736 trunc from 0x040000 to 0x019116 (0x26ee9 bytes) 000681 1787549806.283165 trunc from 0x01406b to 0x019116 (0x50ac bytes) 000682 1787549806.295079 read 0x014b88 thru 0x0158f8 (0xd71 bytes) 000683 1787549806.316575 mapwrite 0x039e59 thru 0x03ffff (0x61a7 bytes) 000685 1787549806.435298 mapwrite 0x038f20 thru 0x03ffff (0x70e0 bytes) 000687 1787549806.496302 punch from 0x00a0ce to 0x0158af (0xb7e2 bytes) 000688 1787549806.530990 read 0x01f682 thru 0x02138d (0x1d0c bytes) 000689 1787549806.535421 write 0x00e0d1 thru 0x018b03 (0xaa33 bytes) 000690 1787549806.557815 punch from 0x028beb to 0x0378db (0xecf1 bytes) 000691 1787549806.571835 mapwrite 0x0285f0 thru 0x02c2b0 (0x3cc1 bytes) 000692 1787549806.718692 mapwrite 0x01e943 thru 0x029b06 (0xb1c4 bytes) 000694 1787549806.763916 mapwrite 0x02f07d thru 0x03026d (0x11f1 bytes) 000695 1787549806.856835 read 0x01b578 thru 0x0261c2 (0xac4b bytes) 000697 1787549806.858489 read 0x03d153 thru 0x03ffff (0x2ead bytes) 000698 1787549806.859141 read 0x0032a3 thru 0x00ed6e (0xbacc bytes) 000699 1787549806.864943 fallocate 0x002b83 thru 0x00ac4c (0x80ca bytes) 000700 1787549806.875652 mapwrite 0x00316e thru 0x00d545 (0xa3d8 bytes) 000701 1787549806.913378 mapwrite 0x0302d3 thru 0x030c2d (0x95b bytes) 000703 1787549806.951947 write 0x035fd6 thru 0x03e4d2 (0x84fd bytes) 000704 1787549806.979922 read 0x02aa74 thru 0x02df96 (0x3523 bytes) 000705 1787549806.983239 trunc from 0x033458 to 0x03be45 (0x89ee bytes) 000706 1787549807.028764 read 0x019c0e thru 0x029333 (0xf726 bytes) 000707 1787549807.033907 read 0x0336ca thru 0x03ce62 (0x9799 bytes) 000708 1787549807.062373 fallocate 0x037c25 thru 0x03ffff (0x83db bytes) 000709 1787549807.071229 trunc from 0x01c3fe to 0x026027 (0x9c2a bytes) 000710 1787549807.094315 MIRROR_EXTEND to 2 mirrors 000713 1787549808.630655 trunc from 0x040000 to 0x00fea1 (0x3015e bytes) 000714 1787549808.679411 read 0x00ea40 thru 0x00fea1 (0x1462 bytes) 000715 1787549808.685737 trunc from 0x0084c6 to 0x00fea1 (0x79dc bytes) 000717 1787549808.697703 read 0x00d233 thru 0x00fea1 (0x2c6f bytes) 000718 1787549808.717654 trunc from 0x00fea2 to 0x02d86d (0x1d9cc bytes) 000719 1787549808.749026 punch from 0x0095ca to 0x00d4a2 (0x3ed9 bytes) 000720 1787549808.759255 read 0x014a33 thru 0x014df0 (0x3be bytes) 000721 1787549808.792351 trunc from 0x016e5c to 0x026ca3 (0xfe48 bytes) 000722 1787549808.799546 mapwrite 0x02ac8c thru 0x02e366 (0x36db bytes) 000723 1787549808.857353 punch from 0x0208bb to 0x0248ab (0x3ff1 bytes) 000724 1787549808.864177 write 0x031aa9 thru 0x036356 (0x48ae bytes) 000727 1787549808.870421 write 0x03d859 thru 0x03ffff (0x27a7 bytes) 000728 1787549808.877406 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) 000729 1787549809.038412 write 0x03c346 thru 0x03ffff (0x3cba bytes) 000730 1787549809.056942 mapwrite 0x011b9b thru 0x01b207 (0x966d bytes) 000731 1787549809.102652 punch from 0x009e2e to 0x015570 (0xb743 bytes) 000733 1787549809.113007 write 0x02776b thru 0x02ff9a (0x8830 bytes) 000734 1787549809.124600 fallocate 0x02996a thru 0x033c90 (0xa327 bytes) 000735 1787549809.130703 mapread 0x018682 thru 0x026e72 (0xe7f1 bytes) 000736 1787549809.146910 write 0x02de2f thru 0x038c06 (0xadd8 bytes) 000739 1787549809.157590 punch from 0x00e394 to 0x0173d3 (0x9040 bytes) 000740 1787549809.163504 mapread 0x03c583 thru 0x03ffff (0x3a7d bytes) 000741 1787549809.165438 fallocate 0x03ab09 thru 0x03ffff (0x54f7 bytes) 000742 1787549809.171509 write 0x0313d9 thru 0x032caa (0x18d2 bytes) 000743 1787549809.173485 punch from 0x034f05 to 0x03a36c (0x5468 bytes) 000744 1787549809.200488 trunc from 0x040000 to 0x039d70 (0x628f bytes) 000745 1787549809.244337 write 0x009266 thru 0x018b79 (0xf914 bytes) 000746 1787549809.258223 mapwrite 0x00f1b0 thru 0x01880a (0x965b bytes) 000747 1787549809.282577 mapwrite 0x019d0c thru 0x020d6b (0x7060 bytes) 000748 1787549809.299485 write 0x002ef2 thru 0x012806 (0xf915 bytes) 000749 1787549809.306179 read 0x031902 thru 0x0331a2 (0x18a1 bytes) 000750 1787549809.306795 read 0x01e0b1 thru 0x01e0e6 (0x36 bytes) 000751 1787549809.307568 write 0x02f6cc thru 0x037c8f (0x85c4 bytes) 000752 1787549809.316479 trunc from 0x039d71 to 0x0130aa (0x26cc6 bytes) 000753 1787549809.331294 mapwrite 0x019639 thru 0x01c11f (0x2ae7 bytes) 000754 1787549809.391305 read 0x00711d thru 0x01664f (0xf533 bytes) 000755 1787549809.398838 read 0x014296 thru 0x01c11f (0x7e8a bytes) 000756 1787549809.400686 read 0x00f767 thru 0x01a32e (0xabc8 bytes) 000757 1787549809.401357 trunc from 0x00ac1b to 0x01a833 (0xfc19 bytes) 000758 1787549809.408214 mapwrite 0x03a26a thru 0x03ffff (0x5d96 bytes) 000759 1787549809.454027 punch from 0x0198c6 to 0x019abb (0x1f6 bytes) 000761 1787549809.458123 fallocate 0x01fb6c thru 0x02a80f (0xaca4 bytes) 000762 1787549809.464620 write 0x01c00e thru 0x0260ed (0xa0e0 bytes) 000763 1787549809.466407 write 0x0275a0 thru 0x02aa9e (0x34ff bytes) 000764 1787549809.468038 write 0x00cd64 thru 0x012e98 (0x6135 bytes) 000765 1787549809.469317 trunc from 0x040000 to 0x00c101 (0x33efe bytes) 000766 1787549809.488548 trunc from 0x00c102 to 0x021a54 (0x15953 bytes) 000767 1787549809.510143 mapread 0x00eb43 thru 0x013961 (0x4e1f bytes) 000768 1787549809.555515 fallocate 0x014793 thru 0x022c5b (0xe4c9 bytes) 000769 1787549809.561675 fallocate 0x013bd8 thru 0x01dbe0 (0xa009 bytes) 000770 1787549809.570171 mapread 0x00f193 thru 0x0124e3 (0x3351 bytes) 000771 1787549809.572794 trunc from 0x021a55 to 0x03a5b8 (0x18b64 bytes) 000772 1787549809.590368 punch from 0x0080f3 to 0x00b619 (0x3527 bytes) 000775 1787549809.601949 trunc from 0x000f59 to 0x01047c (0xf524 bytes) 000776 1787549809.611253 write 0x03eb35 thru 0x03ffff (0x14cb bytes) 000777 1787549809.612261 write 0x00a003 thru 0x015924 (0xb922 bytes) 000779 1787549809.625265 fallocate 0x02edff thru 0x038807 (0x9a09 bytes) 000780 1787549809.631588 mapread 0x032f2b thru 0x03ffff (0xd0d5 bytes) 000781 1787549809.707175 MIRROR_EXTEND to 2 mirrors 000782 1787549810.697877 fallocate 0x02cbfd thru 0x036849 (0x9c4d bytes) 000783 1787549810.743550 mapread 0x03c200 thru 0x03ffff (0x3e00 bytes) 000784 1787549810.768526 mapwrite 0x018e0f thru 0x01c8cb (0x3abd bytes) 000785 1787549810.801834 MIRROR_RESYNC 2 mirrors 000786 1787549811.491952 mapread 0x03d2b8 thru 0x03f3c9 (0x2112 bytes) 000787 1787549811.519579 MIRROR_RESYNC 2 mirrors 000788 1787549811.904494 trunc from 0x00ee6a to 0x01ec1c (0xfdb3 bytes) 000789 1787549811.932556 trunc from 0x040000 to 0x038ca3 (0x735c bytes) 000791 1787549811.952475 fallocate 0x0317cf thru 0x03ffff (0xe831 bytes) 000792 1787549811.957500 read 0x027d14 thru 0x033bae (0xbe9b bytes) 000793 1787549811.966647 mapread 0x02e749 thru 0x032cf9 (0x45b1 bytes) 000794 1787549811.967644 trunc from 0x005986 to 0x0086d8 (0x2d53 bytes) 000795 1787549811.972322 mapwrite 0x00f36b thru 0x01c5b6 (0xd24c bytes) 000796 1787549812.013492 write 0x0075a6 thru 0x00b78c (0x41e7 bytes) 000797 1787549812.018916 trunc from 0x040000 to 0x009316 (0x36ce9 bytes) 000798 1787549812.035568 mapwrite 0x01315e thru 0x0216e7 (0xe58a bytes) 000799 1787549812.081273 fallocate 0x038328 thru 0x03ffff (0x7cd8 bytes) 000800 1787549812.086430 read 0x03e977 thru 0x03ffff (0x1689 bytes) 000801 1787549812.097279 punch from 0x030d3f to 0x0385fb (0x78bd bytes) 000802 1787549812.101755 punch from 0x0154b8 to 0x01dde8 (0x8931 bytes) 000803 1787549812.106557 fallocate 0x01bebe thru 0x01e32b (0x246e bytes) 000805 1787549812.111521 mapread 0x0230aa thru 0x027391 (0x42e8 bytes) 000806 1787549812.113167 punch from 0x02de8a to 0x030d85 (0x2efc bytes) 000807 1787549812.117037 trunc from 0x01db09 to 0x02ac1f (0xd117 bytes) 000808 1787549812.122633 trunc from 0x040000 to 0x0398ee (0x6711 bytes) 000809 1787549812.138336 fallocate 0x031df7 thru 0x0342de (0x24e8 bytes) 000810 1787549812.143482 punch from 0x01a743 to 0x01e3a0 (0x3c5e bytes) 000811 1787549812.148348 mapwrite 0x03b54a thru 0x03ffff (0x4ab6 bytes) 000812 1787549812.202549 trunc from 0x017792 to 0x01af19 (0x3788 bytes) 000813 1787549812.207454 trunc from 0x040000 to 0x00b98a (0x34675 bytes) 000814 1787549812.222030 trunc from 0x00b98b to 0x0220dd (0x16753 bytes) 000816 1787549812.237823 mapread 0x0177f5 thru 0x02100f (0x981b bytes) 000817 1787549812.294632 read 0x008a35 thru 0x01742f (0xe9fb bytes) 000818 1787549812.304223 trunc from 0x0220de to 0x003e93 (0x1e24a bytes) 000820 1787549812.329920 write 0x031e32 thru 0x036163 (0x4332 bytes) 000821 1787549812.332599 fallocate 0x01e0dc thru 0x022e43 (0x4d68 bytes) 000822 1787549812.339875 write 0x02c30d thru 0x02fab3 (0x37a7 bytes) 000823 1787549812.348124 mapwrite 0x01d88c thru 0x02a202 (0xc977 bytes) 000824 1787549812.418125 MIRROR_RESYNC 2 mirrors 000825 1787549813.074171 trunc from 0x01d9a2 to 0x029342 (0xb9a1 bytes) 000826 1787549813.123194 mapread 0x033cc2 thru 0x036163 (0x24a2 bytes) 000827 1787549813.146758 trunc from 0x036164 to 0x03adfd (0x4c9a bytes) 000828 1787549813.200240 punch from 0x039e6a to 0x03adfd (0xf94 bytes) 000829 1787549813.210111 trunc from 0x00ee5c to 0x01af7c (0xc121 bytes) 000831 1787549813.216576 mapread 0x039574 thru 0x03adfd (0x188a bytes) 000832 1787549813.223837 write 0x026148 thru 0x032597 (0xc450 bytes) 000833 1787549813.232949 trunc from 0x02f4a6 to 0x035cd0 (0x682b bytes) 000834 1787549813.251122 read 0x021309 thru 0x0213e4 (0xdc bytes) 000835 1787549813.257915 punch from 0x009c10 to 0x014f82 (0xb373 bytes) 000836 1787549813.266788 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3adfe): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3adfe): Mirror 2: 0x12524e66 (stale) CRC-32 checksum value for chunk [0, 0x3adfe): Mirror 1: 0x2f6f228a Mirror 3: 0x2f6f228a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3adfe: skipped 000837 1787549814.150077 fallocate 0x012e97 thru 0x021284 (0xe3ee bytes) 000838 1787549814.179461 punch from 0x02a422 to 0x02c0f2 (0x1cd1 bytes) 000839 1787549814.184335 punch from 0x035751 to 0x03adfd (0x56ad bytes) 000840 1787549814.188527 read 0x003516 thru 0x00fcbb (0xc7a6 bytes) 000841 1787549814.196718 trunc from 0x03adfe to 0x033156 (0x7ca7 bytes) 000842 1787549814.251681 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x33157): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33157): Mirror 2: 0xb49c15b9 (stale) Mirror 3: 0x9cbf526f (stale) CRC-32 checksum value for chunk [0, 0x33157): Mirror 1: 0xf082aa5d Mirror 4: 0xf082aa5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33157: skipped 000843 1787549815.634500 fallocate 0x03d702 thru 0x03d8cd (0x1cc bytes) 000845 1787549815.721653 read 0x009785 thru 0x014d02 (0xb57e bytes) 000846 1787549815.739347 punch from 0x00fc43 to 0x018be4 (0x8fa2 bytes) 000847 1787549815.758468 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x33157): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33157): Mirror 2: 0xb49c15b9 (stale) Mirror 3: 0x9cbf526f (stale) Mirror 4: 0xf082aa5d (stale) CRC-32 checksum value for chunk [0, 0x33157): Mirror 1: 0xf082aa5d Mirror 5: 0xf082aa5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33157: skipped 000848 1787549817.271664 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x33157): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33157): Mirror 2: 0xb49c15b9 (stale) Mirror 3: 0x9cbf526f (stale) Mirror 4: 0xf082aa5d (stale) CRC-32 checksum value for chunk [0, 0x33157): Mirror 1: 0xf082aa5d Mirror 5: 0xf082aa5d Mirror 6: 0xf082aa5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33157: skipped 000849 1787549818.729767 trunc from 0x033157 to 0x01c80e (0x16948 bytes) 000850 1787549818.822283 punch from 0x002cab to 0x009e60 (0x71b6 bytes) 000851 1787549818.832143 write 0x037466 thru 0x03ffff (0x8b9a bytes) 000852 1787549818.852258 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x528cbf27 (stale) Mirror 4: 0x9d594e4b (stale) Mirror 5: 0x9d594e4b (stale) Mirror 6: 0x9d594e4b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x528cbf27 (stale) Mirror 4: 0x9d594e4b (stale) Mirror 5: 0x9d594e4b (stale) Mirror 6: 0x9d594e4b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000853 1787549819.395585 punch from 0x001644 to 0x007eb8 (0x6875 bytes) 000854 1787549819.400620 punch from 0x03f6ab to 0x03ffff (0x955 bytes) 000855 1787549819.410612 punch from 0x02b02b to 0x033975 (0x894b bytes) 000856 1787549819.418671 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x528cbf27 (stale) Mirror 4: 0x9d594e4b (stale) Mirror 5: 0x9d594e4b (stale) Mirror 6: 0x9d594e4b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x82baab44 Mirror 7: 0x82baab44 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000857 1787549820.240405 punch from 0x00b96f to 0x00ea83 (0x3115 bytes) 000858 1787549820.278587 mapwrite 0x035e8d thru 0x03dd50 (0x7ec4 bytes) 000859 1787549820.309880 trunc from 0x01cb07 to 0x01e779 (0x1c73 bytes) 000860 1787549820.314563 read 0x0292ba thru 0x02cc52 (0x3999 bytes) 000861 1787549820.320148 trunc from 0x040000 to 0x001222 (0x3eddd bytes) 000862 1787549820.344341 mapread 0x0010f2 thru 0x001222 (0x131 bytes) 000863 1787549820.350352 mapread 0x000423 thru 0x001222 (0xe00 bytes) 000864 1787549820.355455 write 0x01d584 thru 0x027070 (0x9aed bytes) 000865 1787549820.358767 mapwrite 0x01588f thru 0x01aa1c (0x518e bytes) 000866 1787549820.388512 fallocate 0x01cb4a thru 0x02ca83 (0xff3a bytes) 000867 1787549820.395151 mapwrite 0x033fb1 thru 0x035759 (0x17a9 bytes) 000868 1787549820.446327 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3575a): Mirror 3: 0x94641240 (stale) Mirror 4: 0x19ccf6a7 (stale) Mirror 5: 0x19ccf6a7 (stale) Mirror 7: 0x9e11dec6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3575a): Mirror 3: 0x94641240 (stale) Mirror 4: 0x19ccf6a7 (stale) Mirror 5: 0x19ccf6a7 (stale) Mirror 7: 0x9e11dec6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3575a: skipped 000870 1787549820.773459 mapread 0x033a6b thru 0x035759 (0x1cef bytes) 000871 1787549820.801499 read 0x01cabd thru 0x02708a (0xa5ce bytes) 000872 1787549820.816743 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3575a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3575a): Mirror 3: 0x94641240 (stale) Mirror 4: 0x19ccf6a7 (stale) Mirror 5: 0x19ccf6a7 (stale) Mirror 7: 0x9e11dec6 (stale) CRC-32 checksum value for chunk [0, 0x3575a): Mirror 1: 0x4239fdea Mirror 8: 0x4239fdea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3575a: skipped 000873 1787549821.996181 write 0x010747 thru 0x0155cb (0x4e85 bytes) 000874 1787549822.046684 fallocate 0x02094a thru 0x02c31d (0xb9d4 bytes) 000875 1787549822.051940 mapwrite 0x0063bb thru 0x006dbb (0xa01 bytes) 000876 1787549822.072708 punch from 0x0242dd to 0x032d85 (0xeaa9 bytes) 000877 1787549822.082722 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3575a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3575a): Mirror 3: 0x94641240 (stale) Mirror 4: 0x19ccf6a7 (stale) Mirror 5: 0x19ccf6a7 (stale) Mirror 7: 0x9e11dec6 (stale) Mirror 8: 0x4239fdea (stale) CRC-32 checksum value for chunk [0, 0x3575a): Mirror 1: 0x60856e91 Mirror 9: 0x60856e91 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3575a: skipped 000878 1787549822.873695 trunc from 0x011ed6 to 0x016859 (0x4984 bytes) 000879 1787549822.914068 mapwrite 0x011b91 thru 0x01ec0d (0xd07d bytes) 000881 1787549822.957227 read 0x00bf29 thru 0x00dcc3 (0x1d9b bytes) 000882 1787549822.962546 mapwrite 0x010f75 thru 0x019066 (0x80f2 bytes) 000883 1787549822.976522 read 0x00b1af thru 0x01a2ad (0xf0ff bytes) 000884 1787549822.977021 trunc from 0x02008f to 0x02addc (0xad4e bytes) 000885 1787549822.985547 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3575a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3575a): Mirror 3: 0x94641240 (stale) Mirror 4: 0x19ccf6a7 (stale) Mirror 5: 0x19ccf6a7 (stale) Mirror 7: 0x9e11dec6 (stale) Mirror 8: 0x4239fdea (stale) Mirror 9: 0x60856e91 (stale) CRC-32 checksum value for chunk [0, 0x3575a): Mirror 1: 0xbe60080a Mirror 10: 0xbe60080a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3575a: skipped 000886 1787549823.880155 read 0x019f1d thru 0x01afcd (0x10b1 bytes) 000887 1787549823.893154 write 0x01b15f thru 0x01c9cd (0x186f bytes) 000888 1787549823.950015 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3575a): Mirror 3: 0x94641240 (stale) Mirror 4: 0x19ccf6a7 (stale) Mirror 5: 0x19ccf6a7 (stale) Mirror 7: 0x9e11dec6 (stale) Mirror 9: 0x60856e91 (stale) Mirror 10: 0xbe60080a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3575a): Mirror 3: 0x94641240 (stale) Mirror 4: 0x19ccf6a7 (stale) Mirror 5: 0x19ccf6a7 (stale) Mirror 7: 0x9e11dec6 (stale) Mirror 9: 0x60856e91 (stale) Mirror 10: 0xbe60080a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3575a: skipped 000889 1787549824.511030 trunc from 0x03575a to 0x003b24 (0x31c35 bytes) 000890 1787549824.529210 punch from 0x002436 to 0x003b24 (0x16ef bytes) 000891 1787549824.533578 fallocate 0x038598 thru 0x03f1ee (0x6c57 bytes) 000893 1787549824.539735 fallocate 0x038630 thru 0x03ffff (0x79d0 bytes) 000894 1787549824.544253 mapread 0x00125e thru 0x003b24 (0x28c7 bytes) 000895 1787549824.556558 punch from 0x002896 to 0x003b24 (0x128f bytes) 000896 1787549824.560804 mapread 0x000cbb thru 0x003b24 (0x2e6a bytes) 000897 1787549824.568128 fallocate 0x032cbf thru 0x035443 (0x2785 bytes) 000898 1787549824.572552 mapwrite 0x0117b5 thru 0x01f0d7 (0xd923 bytes) 000899 1787549824.611220 trunc from 0x035444 to 0x025909 (0xfb3a bytes) 000900 1787549824.626647 fallocate 0x00e49c thru 0x010cc8 (0x282d bytes) 000902 1787549824.637356 trunc from 0x01a5f5 to 0x01e846 (0x4252 bytes) 000903 1787549824.642529 trunc from 0x02590a to 0x0073f2 (0x1e517 bytes) 000904 1787549824.662457 read 0x0031d9 thru 0x005671 (0x2499 bytes) 000905 1787549824.667817 trunc from 0x00675f to 0x0073f2 (0xc94 bytes) 000906 1787549824.677153 trunc from 0x0073f3 to 0x02e247 (0x26e55 bytes) 000907 1787549824.693160 mapread 0x00cd26 thru 0x010c0f (0x3eea bytes) 000908 1787549824.704776 write 0x025777 thru 0x0306be (0xaf48 bytes) 000909 1787549824.730176 trunc from 0x00ca12 to 0x0160e5 (0x96d4 bytes) 000911 1787549824.743534 mapread 0x00c936 thru 0x012f28 (0x65f3 bytes) 000912 1787549824.760349 punch from 0x01e850 to 0x024a71 (0x6222 bytes) 000913 1787549824.770555 read 0x003e43 thru 0x009df5 (0x5fb3 bytes) 000914 1787549824.771812 mapwrite 0x006055 thru 0x011298 (0xb244 bytes) 000915 1787549824.811586 mapwrite 0x00ad82 thru 0x015123 (0xa3a2 bytes) 000916 1787549824.863431 punch from 0x010723 to 0x01f0b0 (0xe98e bytes) 000917 1787549824.869201 trunc from 0x02ac45 to 0x0306be (0x5a7a bytes) 000918 1787549824.874343 trunc from 0x0306bf to 0x02a49a (0x6224 bytes) 000919 1787549824.896387 read 0x01e62a thru 0x025d13 (0x76ea bytes) 000920 1787549824.910099 mapwrite 0x01b2d3 thru 0x0218e2 (0x6610 bytes) 000921 1787549824.928837 trunc from 0x02a49b to 0x0267ba (0x3ce0 bytes) 000922 1787549824.948275 fallocate 0x0191ca thru 0x027e2d (0xec64 bytes) 000923 1787549824.954298 read 0x00cae4 thru 0x00d3e7 (0x904 bytes) 000924 1787549824.955288 mapwrite 0x031108 thru 0x03ca96 (0xb98f bytes) 000925 1787549825.005805 mapread 0x008aa0 thru 0x0132e9 (0xa84a bytes) 000926 1787549825.007483 read 0x029137 thru 0x02a7f4 (0x16be bytes) 000927 1787549825.008361 trunc from 0x01f8e8 to 0x025f66 (0x667f bytes) 000928 1787549825.014485 mapread 0x028dea thru 0x03738e (0xe5a5 bytes) 000929 1787549825.020694 MIRROR_RESYNC 7 mirrors 000930 1787549827.061410 MIRROR_EXTEND to 8 mirrors 000931 1787549827.854669 mapread 0x00f871 thru 0x01c22c (0xc9bc bytes) 000932 1787549827.896742 trunc from 0x026b0e to 0x035d10 (0xf203 bytes) 000933 1787549827.926215 MIRROR_RESYNC 8 mirrors 000934 1787549830.318152 fallocate 0x0027eb thru 0x0036d3 (0xee9 bytes) 000935 1787549830.339143 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3ca97): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ca97): Mirror 3: 0x92a36263 (stale) Mirror 4: 0x92a36263 (stale) Mirror 5: 0x92a36263 (stale) Mirror 7: 0x92a36263 (stale) Mirror 9: 0x92a36263 (stale) Mirror 10: 0x92a36263 (stale) Mirror 11: 0x92a36263 (stale) CRC-32 checksum value for chunk [0, 0x3ca97): Mirror 1: 0x92a36263 Mirror 12: 0x92a36263 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ca97: skipped 000936 1787549831.525170 write 0x001f2b thru 0x00c4de (0xa5b4 bytes) 000937 1787549831.612792 punch from 0x02f3fa to 0x037673 (0x827a bytes) 000938 1787549831.623120 mapread 0x02bfd1 thru 0x0360f6 (0xa126 bytes) 000939 1787549831.674531 trunc from 0x03ca97 to 0x0095e0 (0x334b6 bytes) 000940 1787549831.724123 punch from 0x007b2d to 0x0095e0 (0x1ab4 bytes) 000941 1787549831.750243 punch from 0x00447d to 0x0056ab (0x122f bytes) 000942 1787549831.756626 trunc from 0x003c73 to 0x006abe (0x2e4c bytes) 000943 1787549831.773690 trunc from 0x0095e1 to 0x018dfa (0xf81a bytes) 000944 1787549831.821297 read 0x0017ac thru 0x00f0cd (0xd922 bytes) 000945 1787549831.828245 write 0x037041 thru 0x03ffff (0x8fbf bytes) 000946 1787549831.833396 MIRROR_RESYNC 9 mirrors 000947 1787549833.984329 punch from 0x02e043 to 0x033483 (0x5441 bytes) 000949 1787549834.016658 mapwrite 0x00a4d5 thru 0x00bf90 (0x1abc bytes) 000950 1787549834.038397 read 0x0300f3 thru 0x03ad06 (0xac14 bytes) 000951 1787549834.049440 trunc from 0x040000 to 0x02c7e5 (0x1381a bytes) 000952 1787549834.068646 punch from 0x00b022 to 0x019745 (0xe724 bytes) 000953 1787549834.074242 trunc from 0x00d8fe to 0x019f18 (0xc61b bytes) 000954 1787549834.078690 read 0x00d909 thru 0x01035d (0x2a55 bytes) 000955 1787549834.093689 MIRROR_RESYNC 9 mirrors 000956 1787549836.297671 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1c1:0x0]: Invalid argument (22) 000957 1787549836.883206 mapwrite 0x03bc65 thru 0x03ffff (0x439b bytes) 000958 1787549837.087034 write 0x039864 thru 0x03b708 (0x1ea5 bytes) 000959 1787549837.088090 write 0x03658f thru 0x03ac7b (0x46ed bytes) 000960 1787549837.089055 write 0x001e62 thru 0x0087a2 (0x6941 bytes) 000961 1787549837.105284 MIRROR_RESYNC 8 mirrors 000962 1787549838.685920 mapread 0x0271aa thru 0x036524 (0xf37b bytes) 000963 1787549838.730688 mapread 0x01f9f5 thru 0x027feb (0x85f7 bytes) 000964 1787549838.755331 mapread 0x013308 thru 0x01de03 (0xaafc bytes) 000965 1787549838.790738 mapread 0x013d0e thru 0x01da8a (0x9d7d bytes) 000966 1787549838.791382 trunc from 0x02fd72 to 0x03474a (0x49d9 bytes) 000967 1787549838.828264 trunc from 0x037406 to 0x03ffff (0x8bfa bytes) 000968 1787549838.841364 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xfc1183fb (stale) Mirror 5: 0xfc1183fb (stale) Mirror 7: 0xfc1183fb (stale) Mirror 9: 0xfc1183fb (stale) Mirror 10: 0xfc1183fb (stale) Mirror 11: 0xfc1183fb (stale) Mirror 12: 0xfc1183fb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdc8c0a1 Mirror 13: 0xdc8c0a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000969 1787549840.115663 read 0x03d0bf thru 0x03ffff (0x2f41 bytes) 000970 1787549840.129805 read 0x00d5f5 thru 0x016829 (0x9235 bytes) 000971 1787549840.149660 punch from 0x0150ab to 0x01f1e8 (0xa13e bytes) 000972 1787549840.204401 fallocate 0x02478b thru 0x02f66e (0xaee4 bytes) 000973 1787549840.210135 trunc from 0x040000 to 0x01ef5e (0x210a1 bytes) 000974 1787549840.240378 trunc from 0x0012af to 0x0089d2 (0x7724 bytes) 000975 1787549840.245698 trunc from 0x01ef5f to 0x03c3c4 (0x1d466 bytes) 000976 1787549840.284372 trunc from 0x01f91d to 0x0299cc (0xa0b0 bytes) 000977 1787549840.290577 fallocate 0x00607d thru 0x00dc4a (0x7bce bytes) 000978 1787549840.296070 punch from 0x00d03a to 0x011a3f (0x4a06 bytes) 000979 1787549840.301648 mapwrite 0x0080a6 thru 0x00a9a9 (0x2904 bytes) 000980 1787549840.337132 trunc from 0x03c3c5 to 0x03115c (0xb268 bytes) 000981 1787549840.387267 mapread 0x014d93 thru 0x0183c6 (0x3634 bytes) 000983 1787549840.453371 punch from 0x012916 to 0x013f41 (0x162c bytes) 000985 1787549840.482341 MIRROR_RESYNC 9 mirrors 000986 1787549842.645516 fallocate 0x00b368 thru 0x0129b9 (0x7652 bytes) 000987 1787549842.681263 mapwrite 0x01d690 thru 0x021b27 (0x4498 bytes) 000988 1787549842.726524 MIRROR_RESYNC 9 mirrors 000989 1787549845.072195 mapwrite 0x039fb8 thru 0x03ffff (0x6048 bytes) 000990 1787549845.145770 write 0x01af36 thru 0x01f1f4 (0x42bf bytes) 000991 1787549845.156169 fallocate 0x028093 thru 0x030da1 (0x8d0f bytes) 000992 1787549845.161092 read 0x005b16 thru 0x012b14 (0xcfff bytes) 000993 1787549845.170241 mapwrite 0x011ff9 thru 0x016f79 (0x4f81 bytes) 000994 1787549845.194053 read 0x036139 thru 0x0361a7 (0x6f bytes) 000995 1787549845.194660 fallocate 0x010562 thru 0x01ccef (0xc78e bytes) 000996 1787549845.200680 mapwrite 0x013eb9 thru 0x01bb4a (0x7c92 bytes) 000997 1787549845.226481 mapread 0x00843f thru 0x014687 (0xc249 bytes) 000998 1787549845.227527 punch from 0x000656 to 0x001b17 (0x14c2 bytes) 000999 1787549845.233564 fallocate 0x02df77 thru 0x03db23 (0xfbad bytes) 001000 1787549845.239327 fallocate 0x01e869 thru 0x0279db (0x9173 bytes) All operations completed A-OK!