== sanity-flr test 70a: flr mode fsx test ================ 09:29:42 (1783517382) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 7382 skipping zero length zero range 000003 1783517382.663645 mapwrite 0x012fb4 thru 0x02152e (0xe57b bytes) 000004 1783517382.682689 punch from 0x00c0fd to 0x00cff5 (0xef9 bytes) fallocating to largest ever: 0x25c89 000005 1783517382.684377 fallocate 0x025bdc thru 0x025c88 (0xad bytes) truncating to largest ever: 0x31d0a 000007 1783517382.686734 trunc from 0x02152f to 0x031d09 (0x107db bytes) 000008 1783517382.691069 mapread 0x010698 thru 0x01132e (0xc97 bytes) 000009 1783517382.691807 punch from 0x021a6e to 0x028c49 (0x71dc bytes) 000010 1783517382.693763 trunc from 0x031d0a to 0x004a68 (0x2d2a1 bytes) 000011 1783517382.697656 trunc from 0x000be4 to 0x004a68 (0x3e85 bytes) 000012 1783517382.699496 trunc from 0x000e87 to 0x004a68 (0x3be2 bytes) 000013 1783517382.701036 mapread 0x004880 thru 0x004a68 (0x1e9 bytes) 000014 1783517382.703718 write 0x030000 thru 0x0355be (0x55bf bytes) 000016 1783517382.705645 write 0x01f53b thru 0x02c1ce (0xcc94 bytes) 000017 1783517382.708699 mapread 0x03173c thru 0x0355be (0x3e83 bytes) 000018 1783517382.709453 punch from 0x00d97e to 0x01ce03 (0xf486 bytes) 000019 1783517382.710926 trunc from 0x0048e2 to 0x0060cd (0x17ec bytes) 000020 1783517382.712496 mapread 0x01623d thru 0x023043 (0xce07 bytes) 000021 1783517382.715278 read 0x013ad2 thru 0x01597c (0x1eab bytes) 000022 1783517382.715779 mapwrite 0x01cdea thru 0x021c73 (0x4e8a bytes) 000023 1783517382.721870 trunc from 0x0355bf to 0x01d8a9 (0x17d15 bytes) 000024 1783517382.726063 trunc from 0x015390 to 0x016271 (0xee2 bytes) 000025 1783517382.727618 mapread 0x000ae8 thru 0x008d67 (0x8280 bytes) 000026 1783517382.730759 mapwrite 0x01407f thru 0x01998a (0x590c bytes) 000027 1783517382.737684 read 0x014daa thru 0x01ca89 (0x7ce0 bytes) 000028 1783517382.738140 trunc from 0x00ee13 to 0x011b54 (0x2d42 bytes) 000030 1783517382.740507 fallocate 0x01599a thru 0x019c65 (0x42cc bytes) 000031 1783517382.742109 read 0x01b281 thru 0x01d8a9 (0x2629 bytes) 000032 1783517382.742699 write 0x014730 thru 0x023bca (0xf49b bytes) 000033 1783517382.743920 fallocate 0x020388 thru 0x02d4c6 (0xd13f bytes) 000034 1783517382.745599 punch from 0x001c85 to 0x005484 (0x3800 bytes) 000035 1783517382.747134 read 0x02533c thru 0x027816 (0x24db bytes) 000036 1783517382.751060 trunc from 0x0016c4 to 0x01126f (0xfbac bytes) 000037 1783517382.752959 mapread 0x001a7c thru 0x004629 (0x2bae bytes) 000038 1783517382.758259 fallocate 0x01a977 thru 0x0209b8 (0x6042 bytes) 000040 1783517382.760853 trunc from 0x02d4c7 to 0x0161bf (0x17307 bytes) 000041 1783517382.765369 mapread 0x012167 thru 0x0161bf (0x4059 bytes) 000042 1783517382.766377 trunc from 0x00091e to 0x005e88 (0x556b bytes) 000043 1783517382.767982 read 0x00676a thru 0x00ceb2 (0x6749 bytes) 000047 1783517382.772667 mapread 0x00ea88 thru 0x0161bf (0x7738 bytes) 000049 1783517382.774257 trunc from 0x00091b to 0x00469e (0x3d84 bytes) 000051 1783517382.776575 read 0x0150e9 thru 0x0161bf (0x10d7 bytes) 000052 1783517382.776945 mapwrite 0x019628 thru 0x01dcaa (0x4683 bytes) 000055 1783517382.790839 mapread 0x00b5d5 thru 0x00befc (0x928 bytes) 000056 1783517382.791760 write 0x0084cf thru 0x0141cf (0xbd01 bytes) 000057 1783517382.793150 read 0x007c9d thru 0x00c316 (0x467a bytes) 000058 1783517382.793759 trunc from 0x01199a to 0x01dcaa (0xc311 bytes) fallocating to largest ever: 0x3a6ed 000059 1783517382.798164 fallocate 0x030ac7 thru 0x03a6ec (0x9c26 bytes) 000060 1783517382.799917 mapwrite 0x01e2ee thru 0x0225f8 (0x430b bytes) 000062 1783517382.811834 mapread 0x00fa07 thru 0x01b1ae (0xb7a8 bytes) 000063 1783517382.814308 MIRROR_EXTEND to 2 mirrors 000064 1783517382.963288 write 0x000295 thru 0x002ff3 (0x2d5f bytes) 000065 1783517382.975640 mapread 0x00d6ef thru 0x00e7eb (0x10fd bytes) 000066 1783517382.978855 trunc from 0x0225f9 to 0x005c5e (0x1c99a bytes) 000067 1783517382.988952 mapread 0x003664 thru 0x005c5e (0x25fb bytes) 000068 1783517382.991399 punch from 0x001631 to 0x005c5e (0x462e bytes) 000070 1783517382.996612 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x5c5f): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5c5f): Mirror 2: 0x73b26a63 (stale) CRC-32 checksum value for chunk [0, 0x5c5f): Mirror 1: 0xd0541881 Mirror 3: 0xd0541881 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5c5f: skipped 000071 1783517383.210082 write 0x0338db thru 0x03bc59 (0x837f bytes) fallocating to largest ever: 0x3eae8 000072 1783517383.219840 fallocate 0x03d2b4 thru 0x03eae7 (0x1834 bytes) 000073 1783517383.221591 trunc from 0x0157b7 to 0x024a71 (0xf2bb bytes) 000074 1783517383.223252 mapread 0x0116e8 thru 0x01ba8f (0xa3a8 bytes) 000076 1783517383.229294 fallocate 0x013786 thru 0x01b737 (0x7fb2 bytes) 000077 1783517383.231346 mapwrite 0x009c52 thru 0x00d24e (0x35fd bytes) 000078 1783517383.239059 trunc from 0x022c50 to 0x028547 (0x58f8 bytes) 000080 1783517383.240978 mapwrite 0x008265 thru 0x0116e5 (0x9481 bytes) fallocating to largest ever: 0x40000 000081 1783517383.247094 fallocate 0x036cbd thru 0x03ffff (0x9343 bytes) 000083 1783517383.249143 trunc from 0x00034a to 0x00c586 (0xc23d bytes) 000084 1783517383.250878 trunc from 0x01e66b to 0x0230fc (0x4a92 bytes) 000085 1783517383.252686 mapwrite 0x01044f thru 0x017481 (0x7033 bytes) 000086 1783517383.259733 read 0x000290 thru 0x0040df (0x3e50 bytes) 000087 1783517383.262372 fallocate 0x03c09f thru 0x03ffff (0x3f61 bytes) 000088 1783517383.264283 punch from 0x003196 to 0x0031cc (0x37 bytes) 000089 1783517383.267026 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bc5a): Mirror 3: 0xb8491c2e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc5a): Mirror 3: 0xb8491c2e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc5a: skipped 000090 1783517383.336792 fallocate 0x0089cc thru 0x00ddad (0x53e2 bytes) 000091 1783517383.338977 trunc from 0x03bc5a to 0x023b42 (0x18117 bytes) 000092 1783517383.344035 trunc from 0x023b43 to 0x018376 (0xb7cc bytes) 000093 1783517383.349599 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x18377): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18377): Mirror 3: 0x7bc0ea0e (stale) CRC-32 checksum value for chunk [0, 0x18377): Mirror 1: 0x3c4f4554 Mirror 4: 0x3c4f4554 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18377: skipped 000094 1783517383.562389 punch from 0x013b0e to 0x015c2b (0x211e bytes) 000095 1783517383.572263 trunc from 0x00c9ff to 0x018376 (0xb978 bytes) 000096 1783517383.573946 trunc from 0x018377 to 0x0029be (0x159b8 bytes) 000098 1783517383.585863 fallocate 0x0335c1 thru 0x03ff41 (0xc981 bytes) 000099 1783517383.588095 fallocate 0x00b7ca thru 0x0142c7 (0x8afe bytes) 000100 1783517383.590249 trunc from 0x0142c8 to 0x02b773 (0x174ac bytes) 000101 1783517383.594897 trunc from 0x0208a4 to 0x0286d7 (0x7e34 bytes) 000102 1783517383.596543 trunc from 0x00cbc6 to 0x00d4bd (0x8f8 bytes) 000103 1783517383.597948 punch from 0x00fc0d to 0x01434b (0x473f bytes) 000104 1783517383.599517 read 0x005eeb thru 0x0146db (0xe7f1 bytes) 000105 1783517383.602528 fallocate 0x00cbf8 thru 0x01a2d7 (0xd6e0 bytes) 000106 1783517383.604444 punch from 0x00667c to 0x016004 (0xf989 bytes) 000107 1783517383.606198 read 0x0102cf thru 0x0123ac (0x20de bytes) 000108 1783517383.609633 trunc from 0x02970e to 0x02b773 (0x2066 bytes) 000109 1783517383.611206 read 0x02a10c thru 0x02b773 (0x1668 bytes) 000110 1783517383.613011 mapwrite 0x03b3ff thru 0x03ffff (0x4c01 bytes) 000111 1783517383.623772 trunc from 0x040000 to 0x01fe7d (0x20182 bytes) 000112 1783517383.627842 write 0x0081ab thru 0x00ead4 (0x692a bytes) 000113 1783517383.628915 mapread 0x00d06a thru 0x018acd (0xba64 bytes) 000114 1783517383.630081 write 0x0035d9 thru 0x00c7c0 (0x91e8 bytes) 000115 1783517383.630992 read 0x014634 thru 0x01fe7d (0xb84a bytes) 000116 1783517383.631443 read 0x014638 thru 0x01df47 (0x9910 bytes) 000117 1783517383.631935 write 0x02c094 thru 0x0330dc (0x7049 bytes) 000119 1783517383.633166 mapread 0x02e261 thru 0x0330dc (0x4e7c bytes) 000120 1783517383.633876 mapread 0x02e861 thru 0x0330dc (0x487c bytes) 000121 1783517383.634500 fallocate 0x00ac13 thru 0x01a4d5 (0xf8c3 bytes) 000122 1783517383.636608 read 0x008c28 thru 0x00e7e5 (0x5bbe bytes) 000123 1783517383.637250 trunc from 0x0330dd to 0x00e303 (0x24dd9 bytes) 000124 1783517383.641642 trunc from 0x00e304 to 0x03c132 (0x2de2f bytes) 000125 1783517383.645609 trunc from 0x008acf to 0x0129de (0x9f10 bytes) 000126 1783517383.649731 read 0x028dc6 thru 0x032b5f (0x9d9a bytes) 000127 1783517383.656849 mapwrite 0x03a3e3 thru 0x03ffff (0x5c1d bytes) 000128 1783517383.668547 read 0x030c94 thru 0x03dd49 (0xd0b6 bytes) 000129 1783517383.669298 mapread 0x014045 thru 0x01fdfc (0xbdb8 bytes) 000130 1783517383.670414 punch from 0x033aee to 0x0363e1 (0x28f4 bytes) 000131 1783517383.672287 trunc from 0x040000 to 0x0346a5 (0xb95a bytes) 000132 1783517383.676590 read 0x00b446 thru 0x00cc34 (0x17ef bytes) 000133 1783517383.677154 read 0x00a15f thru 0x00d91f (0x37c1 bytes) 000134 1783517383.677680 trunc from 0x0346a6 to 0x02190c (0x12d99 bytes) 000135 1783517383.682779 trunc from 0x007da0 to 0x00cd79 (0x4fda bytes) 000136 1783517383.685851 MIRROR_RESYNC 3 mirrors 000138 1783517383.879335 fallocate 0x038237 thru 0x03ffff (0x7dc9 bytes) 000139 1783517383.890211 mapwrite 0x02fcb3 thru 0x03cfbd (0xd30b bytes) 000140 1783517383.907396 mapwrite 0x019851 thru 0x01f20b (0x59bb bytes) 000141 1783517383.917909 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc80de038 (stale) Mirror 4: 0xc80de038 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf6f008bd Mirror 5: 0xf6f008bd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000142 1783517384.173485 fallocate 0x03dc73 thru 0x03ffff (0x238d bytes) 000143 1783517384.184425 punch from 0x02ec03 to 0x034374 (0x5772 bytes) 000144 1783517384.186891 trunc from 0x040000 to 0x037b5a (0x84a5 bytes) 000145 1783517384.194632 trunc from 0x037b5b to 0x0059c1 (0x32199 bytes) 000146 1783517384.199800 mapwrite 0x002bdf thru 0x004feb (0x240d bytes) 000149 1783517384.210502 trunc from 0x004eab to 0x0059c1 (0xb17 bytes) 000150 1783517384.212275 mapread 0x0034d2 thru 0x0059c1 (0x24f0 bytes) 000151 1783517384.215655 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x59c2): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x59c2): Mirror 3: 0xa3ecd021 (stale) Mirror 4: 0xa3ecd021 (stale) Mirror 5: 0xa3ecd021 (stale) CRC-32 checksum value for chunk [0, 0x59c2): Mirror 1: 0x71b56750 Mirror 6: 0x71b56750 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x59c2: skipped 000152 1783517384.414189 fallocate 0x0261ca thru 0x0291f0 (0x3027 bytes) 000153 1783517384.423543 mapread 0x002725 thru 0x0059c1 (0x329d bytes) 000155 1783517384.429217 fallocate 0x030379 thru 0x0358b7 (0x553f bytes) 000156 1783517384.431106 write 0x018884 thru 0x01c107 (0x3884 bytes) 000157 1783517384.432959 punch from 0x01120f to 0x011c82 (0xa74 bytes) 000159 1783517384.434870 fallocate 0x016586 thru 0x01e307 (0x7d82 bytes) 000160 1783517384.436743 mapwrite 0x0172e0 thru 0x024ebe (0xdbdf bytes) 000161 1783517384.460364 mapread 0x01f010 thru 0x01ff18 (0xf09 bytes) 000162 1783517384.461354 fallocate 0x005e3c thru 0x010790 (0xa955 bytes) 000163 1783517384.463424 read 0x00de83 thru 0x00ea88 (0xc06 bytes) 000164 1783517384.465450 trunc from 0x01c9c6 to 0x0204eb (0x3b26 bytes) 000165 1783517384.468349 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x24ebf): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24ebf): Mirror 3: 0x74c34823 (stale) Mirror 4: 0x74c34823 (stale) Mirror 5: 0x649103e8 (stale) Mirror 6: 0x9e9b5d16 (stale) CRC-32 checksum value for chunk [0, 0x24ebf): Mirror 1: 0x3dc48200 Mirror 7: 0x3dc48200 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24ebf: skipped 000166 1783517384.692171 mapread 0x00135f thru 0x002845 (0x14e7 bytes) 000167 1783517384.699627 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x24ebf): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24ebf): Mirror 3: 0x74c34823 (stale) Mirror 4: 0x74c34823 (stale) Mirror 5: 0x649103e8 (stale) Mirror 6: 0x9e9b5d16 (stale) CRC-32 checksum value for chunk [0, 0x24ebf): Mirror 1: 0x3dc48200 Mirror 7: 0x3dc48200 Mirror 8: 0x3dc48200 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24ebf: skipped 000168 1783517384.926225 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24ebf): Mirror 3: 0x74c34823 (stale) Mirror 4: 0x74c34823 (stale) Mirror 5: 0x649103e8 (stale) Mirror 6: 0x9e9b5d16 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24ebf): Mirror 3: 0x74c34823 (stale) Mirror 4: 0x74c34823 (stale) Mirror 5: 0x649103e8 (stale) Mirror 6: 0x9e9b5d16 (stale) CRC-32 checksum value for chunk [0, 0x24ebf): Mirror 1: 0x3dc48200 Mirror 7: 0x3dc48200 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24ebf: skipped 000169 1783517385.083024 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24ebf): Mirror 4: 0x74c34823 (stale) Mirror 5: 0x649103e8 (stale) Mirror 6: 0x9e9b5d16 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24ebf): Mirror 4: 0x74c34823 (stale) Mirror 5: 0x649103e8 (stale) Mirror 6: 0x9e9b5d16 (stale) CRC-32 checksum value for chunk [0, 0x24ebf): Mirror 1: 0x3dc48200 Mirror 7: 0x3dc48200 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24ebf: skipped 000170 1783517385.224259 trunc from 0x024ebf to 0x0294f9 (0x463b bytes) 000171 1783517385.240857 mapwrite 0x017965 thru 0x01f892 (0x7f2e bytes) 000172 1783517385.251766 punch from 0x015e85 to 0x024ee2 (0xf05e bytes) 000173 1783517385.255732 MIRROR_RESYNC 5 mirrors 000174 1783517385.515453 mapwrite 0x032053 thru 0x03ffff (0xdfad bytes) 000175 1783517385.541502 fallocate 0x0128f0 thru 0x0190cd (0x67de bytes) 000176 1783517385.543682 mapwrite 0x012c3b thru 0x01ec6a (0xc030 bytes) 000178 1783517385.555262 trunc from 0x040000 to 0x017cd2 (0x2832d bytes) 000179 1783517385.560479 punch from 0x00fd4d to 0x017cd2 (0x7f86 bytes) 000180 1783517385.563476 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17cd3): Mirror 4: 0x94ac470a (stale) Mirror 5: 0x94ac470a (stale) Mirror 7: 0x94ac470a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17cd3): Mirror 4: 0x94ac470a (stale) Mirror 5: 0x94ac470a (stale) Mirror 7: 0x94ac470a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17cd3: skipped 000181 1783517385.647693 MIRROR_RESYNC 4 mirrors 000182 1783517385.861697 fallocate 0x03eeba thru 0x03ffff (0x1146 bytes) 000183 1783517385.871810 mapread 0x00f050 thru 0x0147f3 (0x57a4 bytes) 000185 1783517385.879256 MIRROR_RESYNC 4 mirrors 000186 1783517386.095018 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) 000187 1783517386.178576 write 0x0038c5 thru 0x006117 (0x2853 bytes) 000188 1783517386.190269 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x17cd3): Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17cd3): Mirror 5: 0x94ac470a (stale) Mirror 7: 0x94ac470a (stale) CRC-32 checksum value for chunk [0, 0x17cd3): Mirror 1: 0xb3a40812 Mirror 8: 0xb3a40812 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17cd3: skipped 000189 1783517386.426979 punch from 0x004194 to 0x00484a (0x6b7 bytes) 000191 1783517386.436739 mapwrite 0x00e757 thru 0x01a9ff (0xc2a9 bytes) 000192 1783517386.458527 punch from 0x00bcf1 to 0x01a9ff (0xed0f bytes) 000193 1783517386.460527 write 0x02d55d thru 0x039643 (0xc0e7 bytes) 000194 1783517386.463171 MIRROR_RESYNC 4 mirrors 000195 1783517386.732060 trunc from 0x01ee3d to 0x023d6f (0x4f33 bytes) 000196 1783517386.740632 trunc from 0x039644 to 0x037a17 (0x1c2c bytes) 000197 1783517386.751861 fallocate 0x00560c thru 0x0059e4 (0x3d9 bytes) 000198 1783517386.753635 trunc from 0x002d4c to 0x00ee03 (0xc0b8 bytes) 000199 1783517386.755423 read 0x024b04 thru 0x027a89 (0x2f86 bytes) 000200 1783517386.757686 fallocate 0x002c11 thru 0x006b56 (0x3f46 bytes) 000202 1783517386.760154 trunc from 0x034886 to 0x037a17 (0x3192 bytes) 000204 1783517386.764079 MIRROR_RESYNC 4 mirrors 000205 1783517387.055457 fallocate 0x03535c thru 0x036fe7 (0x1c8c bytes) 000206 1783517387.067274 fallocate 0x022182 thru 0x02ea25 (0xc8a4 bytes) 000207 1783517387.069156 trunc from 0x037a18 to 0x00b16f (0x2c8a8 bytes) 000208 1783517387.080150 mapread 0x003dc5 thru 0x00b16f (0x73ab bytes) 000209 1783517387.086110 trunc from 0x00b170 to 0x027a4e (0x1c8df bytes) 000211 1783517387.092521 fallocate 0x00fb08 thru 0x019614 (0x9b0d bytes) 000212 1783517387.094476 mapread 0x018dfa thru 0x01ea28 (0x5c2f bytes) 000213 1783517387.097955 fallocate 0x034685 thru 0x0365fd (0x1f79 bytes) 000214 1783517387.099812 mapwrite 0x03aca6 thru 0x03ffff (0x535a bytes) 000215 1783517387.111157 mapwrite 0x021b51 thru 0x022932 (0xde2 bytes) 000216 1783517387.119303 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x38b2d906 (stale) Mirror 7: 0x38b2d906 (stale) Mirror 8: 0x38b2d906 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbcda5126 Mirror 9: 0xbcda5126 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000217 1783517387.351690 read 0x031557 thru 0x03777a (0x6224 bytes) 000218 1783517387.357456 MIRROR_RESYNC 5 mirrors 000219 1783517387.612605 mapwrite 0x038fbd thru 0x03ffff (0x7043 bytes) 000220 1783517387.652864 trunc from 0x000c5a to 0x00169a (0xa41 bytes) 000221 1783517387.655086 write 0x00b716 thru 0x010ce1 (0x55cc bytes) 000223 1783517387.658890 punch from 0x01dc96 to 0x020f95 (0x3300 bytes) 000224 1783517387.660915 punch from 0x023be5 to 0x025364 (0x1780 bytes) 000225 1783517387.662937 read 0x027cd5 thru 0x034e9c (0xd1c8 bytes) 000226 1783517387.666553 write 0x005ebc thru 0x01413f (0xe284 bytes) 000227 1783517387.671011 punch from 0x019649 to 0x020dd6 (0x778e bytes) 000228 1783517387.673010 punch from 0x000e4d to 0x0042a8 (0x345c bytes) 000230 1783517387.675730 mapread 0x000c47 thru 0x00f7f9 (0xebb3 bytes) 000232 1783517387.680096 mapread 0x002049 thru 0x00b276 (0x922e bytes) 000233 1783517387.680833 write 0x0370ab thru 0x0389e1 (0x1937 bytes) 000234 1783517387.681495 read 0x00a659 thru 0x00cfb4 (0x295c bytes) 000235 1783517387.683779 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbcda5126 (stale) Mirror 7: 0xbcda5126 (stale) Mirror 8: 0xbcda5126 (stale) Mirror 9: 0xbcda5126 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9b94d1ff Mirror 10: 0x9b94d1ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000236 1783517387.977240 punch from 0x0139fc to 0x020aae (0xd0b3 bytes) 000238 1783517387.991418 fallocate 0x01145d thru 0x01ca0d (0xb5b1 bytes) 000239 1783517387.994134 trunc from 0x01c881 to 0x02943e (0xcbbe bytes) 000240 1783517387.996113 trunc from 0x0174fc to 0x01a9e7 (0x34ec bytes) 000241 1783517387.998114 punch from 0x01dab7 to 0x02682d (0x8d77 bytes) 000242 1783517387.999926 mapread 0x0115fa thru 0x0150aa (0x3ab1 bytes) 000243 1783517388.005961 mapwrite 0x01eeb3 thru 0x027e62 (0x8fb0 bytes) 000244 1783517388.022063 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbcda5126 (stale) Mirror 8: 0xbcda5126 (stale) Mirror 9: 0xbcda5126 (stale) Mirror 10: 0x9b94d1ff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbcda5126 (stale) Mirror 8: 0xbcda5126 (stale) Mirror 9: 0xbcda5126 (stale) Mirror 10: 0x9b94d1ff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000245 1783517388.140076 write 0x00fef7 thru 0x01a468 (0xa572 bytes) 000246 1783517388.144831 write 0x02c891 thru 0x0338a4 (0x7014 bytes) 000247 1783517388.147861 trunc from 0x040000 to 0x0049b3 (0x3b64c bytes) 000248 1783517388.157282 trunc from 0x0049b4 to 0x01864c (0x13c99 bytes) 000249 1783517388.161399 mapread 0x009e32 thru 0x00f9df (0x5bae bytes) 000250 1783517388.167462 mapread 0x005107 thru 0x008fb1 (0x3eab bytes) 000251 1783517388.168218 mapread 0x00ac32 thru 0x00ed2a (0x40f9 bytes) 000252 1783517388.168803 trunc from 0x01864d to 0x016b34 (0x1b18 bytes) 000253 1783517388.172964 write 0x03182e thru 0x03320d (0x19e0 bytes) 000254 1783517388.173896 trunc from 0x00718a to 0x013bbf (0xca36 bytes) 000255 1783517388.175563 write 0x0209cf thru 0x020eef (0x521 bytes) 000256 1783517388.177515 write 0x00744a thru 0x00a688 (0x323f bytes) 000257 1783517388.180423 punch from 0x02b686 to 0x03320d (0x7b88 bytes) 000258 1783517388.184269 fallocate 0x02325a thru 0x0275a6 (0x434d bytes) 000260 1783517388.186643 trunc from 0x014eea to 0x01cfcf (0x80e6 bytes) 000261 1783517388.189455 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3320e): Mirror 8: 0x1958d887 (stale) Mirror 9: 0x1958d887 (stale) Mirror 10: 0x5c9091e0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3320e): Mirror 8: 0x1958d887 (stale) Mirror 9: 0x1958d887 (stale) Mirror 10: 0x5c9091e0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3320e: skipped 000262 1783517388.278137 write 0x0055fe thru 0x00d628 (0x802b bytes) 000263 1783517388.282196 write 0x03cf70 thru 0x03ffff (0x3090 bytes) 000264 1783517388.284071 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xbcda5126 (stale) Mirror 9: 0xbcda5126 (stale) Mirror 10: 0x9b94d1ff (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x167e13e2 Mirror 11: 0x167e13e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000265 1783517388.556150 write 0x00d964 thru 0x0116a2 (0x3d3f bytes) 000266 1783517388.568509 read 0x029026 thru 0x0319ff (0x89da bytes) 000267 1783517388.571040 trunc from 0x02d584 to 0x02eb1e (0x159b bytes) 000268 1783517388.572698 mapwrite 0x023fcb thru 0x026ab1 (0x2ae7 bytes) 000269 1783517388.582931 punch from 0x022fc8 to 0x02635e (0x3397 bytes) 000270 1783517388.584910 fallocate 0x033531 thru 0x035622 (0x20f2 bytes) 000271 1783517388.586569 mapread 0x02b269 thru 0x03344e (0x81e6 bytes) 000272 1783517388.589594 trunc from 0x007bb3 to 0x014234 (0xc682 bytes) 000273 1783517388.591436 mapread 0x0333ea thru 0x03ffff (0xcc16 bytes) 000274 1783517388.594981 write 0x000b53 thru 0x0037b3 (0x2c61 bytes) 000275 1783517388.598149 write 0x0136e4 thru 0x01cea3 (0x97c0 bytes) 000276 1783517388.601073 write 0x01e2fa thru 0x02a1ce (0xbed5 bytes) 000277 1783517388.602257 trunc from 0x0249bb to 0x02b58f (0x6bd5 bytes) 000278 1783517388.606858 trunc from 0x0093ae to 0x00d7ac (0x43ff bytes) 000279 1783517388.608744 fallocate 0x0334d2 thru 0x03ffff (0xcb2e bytes) 000280 1783517388.610469 read 0x036d32 thru 0x03f7f9 (0x8ac8 bytes) 000281 1783517388.611073 punch from 0x02ec03 to 0x03c911 (0xdd0f bytes) 000282 1783517388.613005 punch from 0x02b910 to 0x032b92 (0x7283 bytes) 000283 1783517388.614520 mapwrite 0x007ed3 thru 0x016fb6 (0xf0e4 bytes) 000284 1783517388.625595 trunc from 0x040000 to 0x008f38 (0x370c7 bytes) 000285 1783517388.632097 trunc from 0x008f39 to 0x03194b (0x28a13 bytes) 000286 1783517388.636643 fallocate 0x0179e6 thru 0x018e63 (0x147e bytes) 000287 1783517388.638771 write 0x00f34b thru 0x00fb03 (0x7b9 bytes) 000288 1783517388.641410 trunc from 0x03194c to 0x032570 (0xc25 bytes) 000290 1783517388.646177 punch from 0x000ba4 to 0x00c67c (0xbad9 bytes) 000291 1783517388.648374 trunc from 0x0082b1 to 0x01405f (0xbdaf bytes) 000292 1783517388.651569 mapread 0x00d25c thru 0x00f868 (0x260d bytes) 000293 1783517388.656273 punch from 0x028a2b to 0x032570 (0x9b46 bytes) 000294 1783517388.658048 punch from 0x028f2a to 0x032570 (0x9647 bytes) 000295 1783517388.659653 mapwrite 0x02e7fa thru 0x030075 (0x187c bytes) 000296 1783517388.668169 read 0x018a34 thru 0x01d763 (0x4d30 bytes) 000297 1783517388.671685 read 0x00c3be thru 0x012e32 (0x6a75 bytes) 000298 1783517388.672369 punch from 0x003996 to 0x010c10 (0xd27b bytes) 000299 1783517388.674360 trunc from 0x01800e to 0x0197de (0x17d1 bytes) 000300 1783517388.676100 punch from 0x005dba to 0x00922e (0x3475 bytes) 000301 1783517388.677801 trunc from 0x024b5b to 0x02d982 (0x8e28 bytes) 000302 1783517388.679514 read 0x02940d thru 0x032570 (0x9164 bytes) 000303 1783517388.684168 MIRROR_RESYNC 5 mirrors 000304 1783517388.945299 fallocate 0x002f57 thru 0x00fab8 (0xcb62 bytes) 000305 1783517388.955198 write 0x0064cc thru 0x0114fe (0xb033 bytes) 000306 1783517388.959979 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x32571): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32571): Mirror 8: 0x91657b11 (stale) Mirror 9: 0x91657b11 (stale) Mirror 10: 0x91657b11 (stale) Mirror 11: 0x91657b11 (stale) CRC-32 checksum value for chunk [0, 0x32571): Mirror 1: 0x1ef22f2c Mirror 12: 0x1ef22f2c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32571: skipped 000307 1783517389.236287 write 0x00d555 thru 0x01c7a4 (0xf250 bytes) 000308 1783517389.248905 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x32571): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32571): Mirror 8: 0x91657b11 (stale) Mirror 9: 0x91657b11 (stale) Mirror 10: 0x91657b11 (stale) Mirror 11: 0x91657b11 (stale) Mirror 12: 0x1ef22f2c (stale) CRC-32 checksum value for chunk [0, 0x32571): Mirror 1: 0xfe16cfc9 Mirror 13: 0xfe16cfc9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32571: skipped 000309 1783517389.488483 punch from 0x00f666 to 0x01ea63 (0xf3fe bytes) 000310 1783517389.499967 trunc from 0x025b88 to 0x02cbf4 (0x706d bytes) 000311 1783517389.501935 mapwrite 0x0208ba thru 0x0276bf (0x6e06 bytes) 000312 1783517389.512725 mapread 0x01841c thru 0x019c5d (0x1842 bytes) 000313 1783517389.515298 trunc from 0x008374 to 0x00c335 (0x3fc2 bytes) 000314 1783517389.517110 write 0x037042 thru 0x03e3bd (0x737c bytes) 000315 1783517389.519137 punch from 0x0307e4 to 0x03cfb1 (0xc7ce bytes) 000316 1783517389.522621 trunc from 0x03e3be to 0x017f3d (0x26480 bytes) 000317 1783517389.527721 write 0x0223e9 thru 0x026499 (0x40b1 bytes) 000319 1783517389.528783 trunc from 0x02649a to 0x01cdd2 (0x96c7 bytes) 000320 1783517389.532460 mapread 0x009bb3 thru 0x0188fb (0xed49 bytes) 000321 1783517389.537863 mapwrite 0x024ec8 thru 0x02d9f0 (0x8b29 bytes) 000322 1783517389.551483 trunc from 0x02d9f1 to 0x0280ad (0x5943 bytes) 000323 1783517389.555558 mapread 0x0248bb thru 0x0280ad (0x37f3 bytes) 000324 1783517389.556392 trunc from 0x0280ae to 0x016e12 (0x1129b bytes) 000325 1783517389.560330 punch from 0x0045bb to 0x00e6c2 (0xa108 bytes) 000326 1783517389.561996 mapwrite 0x037636 thru 0x03ca51 (0x541c bytes) 000328 1783517389.572683 trunc from 0x018e42 to 0x026fc9 (0xe188 bytes) 000329 1783517389.575391 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ca52): Mirror 8: 0xc212e943 (stale) Mirror 9: 0xc212e943 (stale) Mirror 11: 0xc212e943 (stale) Mirror 12: 0x1eff9a95 (stale) Mirror 13: 0x669efd1e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ca52): Mirror 8: 0xc212e943 (stale) Mirror 9: 0xc212e943 (stale) Mirror 11: 0xc212e943 (stale) Mirror 12: 0x1eff9a95 (stale) Mirror 13: 0x669efd1e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ca52: skipped 000330 1783517389.673853 trunc from 0x03ca52 to 0x00e0da (0x2e977 bytes) 000331 1783517389.678888 trunc from 0x0096f8 to 0x00c8e4 (0x31ed bytes) 000332 1783517389.680568 mapread 0x003f8c thru 0x008d6a (0x4ddf bytes) 000333 1783517389.685925 trunc from 0x00e0db to 0x03cb64 (0x2ea8a bytes) 000334 1783517389.689936 write 0x00e0ad thru 0x01c4d6 (0xe42a bytes) 000335 1783517389.692478 write 0x02c150 thru 0x03aac2 (0xe973 bytes) 000336 1783517389.695607 mapread 0x0029de thru 0x010e67 (0xe48a bytes) 000337 1783517389.696691 trunc from 0x03c706 to 0x03cb64 (0x45f bytes) 000338 1783517389.698402 mapread 0x013102 thru 0x01751b (0x441a bytes) 000339 1783517389.699211 write 0x00cdb2 thru 0x01207f (0x52ce bytes) 000340 1783517389.700134 mapread 0x037094 thru 0x03be6f (0x4ddc bytes) 000341 1783517389.702288 trunc from 0x03cb65 to 0x033082 (0x9ae2 bytes) 000342 1783517389.706296 mapwrite 0x035f3b thru 0x0377be (0x1884 bytes) 000343 1783517389.716693 read 0x031862 thru 0x03660b (0x4daa bytes) 000344 1783517389.717285 trunc from 0x0377bf to 0x00b317 (0x2c4a7 bytes) 000345 1783517389.721303 trunc from 0x003d1c to 0x0093af (0x5694 bytes) 000346 1783517389.722989 punch from 0x000ac6 to 0x0012e5 (0x820 bytes) 000347 1783517389.724754 fallocate 0x02d3f3 thru 0x033e2c (0x6a3a bytes) 000348 1783517389.726672 trunc from 0x00b318 to 0x00b4cd (0x1b6 bytes) 000349 1783517389.730888 fallocate 0x034992 thru 0x034ceb (0x35a bytes) 000350 1783517389.732827 punch from 0x00a206 to 0x00b4cd (0x12c8 bytes) 000351 1783517389.734262 mapwrite 0x026a69 thru 0x0276c2 (0xc5a bytes) 000352 1783517389.745144 trunc from 0x007abf to 0x00d04d (0x558f bytes) 000353 1783517389.746895 trunc from 0x0115ba to 0x0213d2 (0xfe19 bytes) 000354 1783517389.749861 MIRROR_RESYNC 6 mirrors 000355 1783517389.982963 mapread 0x01bfef thru 0x022ed6 (0x6ee8 bytes) 000356 1783517389.988750 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) 000357 1783517390.079632 read 0x00ea3f thru 0x01262a (0x3bec bytes) 000358 1783517390.082264 mapwrite 0x00413f thru 0x0137da (0xf69c bytes) 000359 1783517390.119606 mapwrite 0x02a9b3 thru 0x0397be (0xee0c bytes) 000361 1783517390.142756 punch from 0x02fbcb to 0x0351c3 (0x55f9 bytes) 000362 1783517390.144879 fallocate 0x010264 thru 0x01a012 (0x9daf bytes) 000363 1783517390.146811 trunc from 0x0397bf to 0x0343d6 (0x53e8 bytes) 000364 1783517390.151166 trunc from 0x019d5b to 0x01ace5 (0xf8b bytes) 000365 1783517390.152770 punch from 0x029ed8 to 0x0309a0 (0x6ac9 bytes) 000367 1783517390.155299 read 0x0263b8 thru 0x030753 (0xa39c bytes) 000368 1783517390.158469 trunc from 0x0343d7 to 0x01b564 (0x18e72 bytes) 000369 1783517390.162842 mapread 0x016674 thru 0x017b28 (0x14b5 bytes) 000370 1783517390.163565 trunc from 0x01b565 to 0x02ee47 (0x138e3 bytes) 000371 1783517390.167671 trunc from 0x00ddb9 to 0x0116dc (0x3924 bytes) 000372 1783517390.169437 punch from 0x004d78 to 0x00c960 (0x7be9 bytes) 000373 1783517390.171111 mapread 0x01b872 thru 0x01f344 (0x3ad3 bytes) 000374 1783517390.177463 MIRROR_RESYNC 5 mirrors 000375 1783517390.481908 mapread 0x01e139 thru 0x02be86 (0xdd4e bytes) 000376 1783517390.489086 read 0x01fc76 thru 0x02d5d7 (0xd962 bytes) 000377 1783517390.489330 fallocate 0x038e9f thru 0x03ffff (0x7161 bytes) 000378 1783517390.499346 mapread 0x02cfce thru 0x02ee47 (0x1e7a bytes) 000379 1783517390.502285 write 0x029b79 thru 0x0307bb (0x6c43 bytes) 000380 1783517390.503166 read 0x01913d thru 0x028cee (0xfbb2 bytes) 000381 1783517390.506463 trunc from 0x0307bc to 0x02f153 (0x1668 bytes) 000382 1783517390.515452 fallocate 0x01d892 thru 0x0295fe (0xbd6d bytes) 000383 1783517390.517181 write 0x001b02 thru 0x006bbd (0x50bc bytes) 000384 1783517390.518283 write 0x038980 thru 0x03b4cc (0x2b4d bytes) 000385 1783517390.519147 fallocate 0x02034e thru 0x02ce59 (0xcb0c bytes) 000386 1783517390.520576 fallocate 0x000901 thru 0x002c97 (0x2397 bytes) 000387 1783517390.522210 write 0x0124d9 thru 0x01bde8 (0x9910 bytes) 000388 1783517390.522984 mapread 0x0220ba thru 0x023188 (0x10cf bytes) 000389 1783517390.523534 mapwrite 0x02f151 thru 0x03970c (0xa5bc bytes) 000390 1783517390.532415 write 0x01698c thru 0x01a425 (0x3a9a bytes) 000391 1783517390.533300 trunc from 0x021ecc to 0x02206c (0x1a1 bytes) 000392 1783517390.534958 fallocate 0x011206 thru 0x014f41 (0x3d3c bytes) 000393 1783517390.538048 MIRROR_RESYNC 5 mirrors 000394 1783517390.832526 read 0x0188fe thru 0x020f64 (0x8667 bytes) 000395 1783517390.835295 read 0x012be3 thru 0x01bd76 (0x9194 bytes) 000396 1783517390.838223 fallocate 0x038de2 thru 0x03ffff (0x721e bytes) 000397 1783517390.849022 fallocate 0x02e4a0 thru 0x032d87 (0x48e8 bytes) 000398 1783517390.850549 read 0x00fff5 thru 0x01edbb (0xedc7 bytes) 000399 1783517390.855331 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x61b3355f (stale) Mirror 12: 0x61b3355f (stale) Mirror 13: 0x61b3355f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x61b3355f (stale) Mirror 12: 0x61b3355f (stale) Mirror 13: 0x61b3355f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000400 1783517390.942908 punch from 0x02c39e to 0x02f3a8 (0x300b bytes) 000402 1783517390.944974 trunc from 0x03b0d3 to 0x03ffff (0x4f2d bytes) 000403 1783517390.946490 mapread 0x00a8ab thru 0x00dd89 (0x34df bytes) 000404 1783517390.951418 punch from 0x001f17 to 0x006e3c (0x4f26 bytes) 000405 1783517390.952864 write 0x005a8a thru 0x00a27c (0x47f3 bytes) 000406 1783517390.955572 trunc from 0x036d69 to 0x03ffff (0x9297 bytes) 000407 1783517390.957326 trunc from 0x040000 to 0x014ca9 (0x2b356 bytes) 000408 1783517390.965429 trunc from 0x0072a4 to 0x00b400 (0x415d bytes) 000409 1783517390.968900 trunc from 0x014caa to 0x0349ba (0x1fd11 bytes) 000410 1783517390.972749 mapwrite 0x024ca8 thru 0x02ea43 (0x9d9c bytes) 000411 1783517390.983669 punch from 0x0195c6 to 0x023a75 (0xa4b0 bytes) 000412 1783517390.985482 trunc from 0x028ba8 to 0x0310a9 (0x8502 bytes) 000413 1783517390.987306 mapwrite 0x026cfb thru 0x02af8a (0x4290 bytes) 000414 1783517390.996282 MIRROR_RESYNC 4 mirrors 000415 1783517391.302240 MIRROR_EXTEND to 5 mirrors 000416 1783517391.491318 punch from 0x0291ef to 0x0349ba (0xb7cc bytes) 000417 1783517391.499556 trunc from 0x0349bb to 0x02dd54 (0x6c66 bytes) 000418 1783517391.504746 fallocate 0x006d1a thru 0x00c7c2 (0x5aa9 bytes) 000419 1783517391.506560 read 0x009b76 thru 0x0127e9 (0x8c74 bytes) 000420 1783517391.508956 fallocate 0x0273d3 thru 0x02f8fa (0x8528 bytes) 000421 1783517391.510695 fallocate 0x005974 thru 0x009f59 (0x45e6 bytes) 000422 1783517391.513228 MIRROR_RESYNC 5 mirrors 000423 1783517391.869950 punch from 0x004348 to 0x011c59 (0xd912 bytes) 000424 1783517391.880167 read 0x0280f3 thru 0x02ae87 (0x2d95 bytes) 000425 1783517391.883339 MIRROR_RESYNC 5 mirrors 000426 1783517392.181266 punch from 0x023ce1 to 0x023e6a (0x18a bytes) 000429 1783517392.193407 write 0x027e95 thru 0x02cf76 (0x50e2 bytes) 000430 1783517392.197312 read 0x0194ed thru 0x01b139 (0x1c4d bytes) 000431 1783517392.199415 mapread 0x02efd4 thru 0x02f8fa (0x927 bytes) 000432 1783517392.203373 write 0x02e2a6 thru 0x038a77 (0xa7d2 bytes) 000435 1783517392.205368 fallocate 0x00bfd2 thru 0x00debf (0x1eee bytes) 000436 1783517392.207397 trunc from 0x01edd6 to 0x02be7a (0xd0a5 bytes) 000437 1783517392.211920 write 0x00e5cd thru 0x018398 (0x9dcc bytes) 000439 1783517392.215743 trunc from 0x010084 to 0x011f61 (0x1ede bytes) 000440 1783517392.219854 trunc from 0x012a1f to 0x0161f3 (0x37d5 bytes) 000441 1783517392.221794 write 0x033cc8 thru 0x03ffff (0xc338 bytes) 000442 1783517392.223236 write 0x021781 thru 0x02ea9d (0xd31d bytes) 000443 1783517392.225730 trunc from 0x035c5d to 0x03ffff (0xa3a3 bytes) 000444 1783517392.231232 write 0x018d11 thru 0x022db9 (0xa0a9 bytes) 000445 1783517392.232686 fallocate 0x01dfb3 thru 0x02db50 (0xfb9e bytes) 000446 1783517392.235121 read 0x02a415 thru 0x036ef8 (0xcae4 bytes) 000447 1783517392.238852 mapwrite 0x027a11 thru 0x0287b1 (0xda1 bytes) 000448 1783517392.245608 punch from 0x01bc57 to 0x029463 (0xd80d bytes) 000450 1783517392.250563 MIRROR_RESYNC 5 mirrors 000451 1783517392.610953 punch from 0x026464 to 0x031b11 (0xb6ae bytes) 000452 1783517392.624725 MIRROR_RESYNC 5 mirrors 000453 1783517392.971627 mapread 0x034587 thru 0x03fcd9 (0xb753 bytes) 000454 1783517392.977762 punch from 0x01514f to 0x01aa68 (0x591a bytes) 000455 1783517392.988632 trunc from 0x02c0e7 to 0x02e505 (0x241f bytes) 000456 1783517392.990145 mapread 0x006d5a thru 0x00db1d (0x6dc4 bytes) 000457 1783517392.993125 punch from 0x03a42e to 0x03ffff (0x5bd2 bytes) 000458 1783517392.994676 mapread 0x03d993 thru 0x03f79b (0x1e09 bytes) 000459 1783517392.997530 read 0x03be7d thru 0x03ffff (0x4183 bytes) 000460 1783517392.998018 trunc from 0x018f66 to 0x0257ff (0xc89a bytes) 000462 1783517392.999777 trunc from 0x040000 to 0x037bb3 (0x844c bytes) 000463 1783517393.009262 write 0x02bca3 thru 0x03771f (0xba7d bytes) 000464 1783517393.011724 write 0x01690a thru 0x01b2f8 (0x49ef bytes) 000467 1783517393.015680 punch from 0x01493a to 0x019097 (0x475e bytes) 000468 1783517393.019617 fallocate 0x001bed thru 0x003418 (0x182c bytes) 000469 1783517393.021425 mapread 0x025235 thru 0x029c6a (0x4a36 bytes) 000470 1783517393.024633 punch from 0x00fde2 to 0x0168aa (0x6ac9 bytes) 000471 1783517393.026405 trunc from 0x037bb4 to 0x01d85d (0x1a356 bytes) 000472 1783517393.030531 punch from 0x019cf0 to 0x01d85d (0x3b6e bytes) 000473 1783517393.032371 punch from 0x005028 to 0x014788 (0xf761 bytes) 000474 1783517393.035236 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d85e): Mirror 12: 0xf0166537 (stale) Mirror 13: 0xf0166537 (stale) Mirror 14: 0xf0166537 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d85e): Mirror 12: 0xf0166537 (stale) Mirror 13: 0xf0166537 (stale) Mirror 14: 0xf0166537 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d85e: skipped 000475 1783517393.118949 write 0x02366d thru 0x02d327 (0x9cbb bytes) 000476 1783517393.121214 read 0x028cfd thru 0x02bef7 (0x31fb bytes) 000477 1783517393.121692 fallocate 0x00b2dd thru 0x00daf9 (0x281d bytes) 000478 1783517393.123597 write 0x02d573 thru 0x0323ab (0x4e39 bytes) 000480 1783517393.124741 mapread 0x006afe thru 0x011abf (0xafc2 bytes) 000481 1783517393.133276 mapwrite 0x01711b thru 0x01f3e0 (0x82c6 bytes) 000482 1783517393.144712 trunc from 0x015e65 to 0x024fcc (0xf168 bytes) 000483 1783517393.146690 read 0x0289fd thru 0x02d9a7 (0x4fab bytes) 000484 1783517393.147143 fallocate 0x016349 thru 0x01ad7a (0x4a32 bytes) 000486 1783517393.149213 mapread 0x02aa25 thru 0x0323ab (0x7987 bytes) 000487 1783517393.150136 mapread 0x02c554 thru 0x0323ab (0x5e58 bytes) 000488 1783517393.150798 trunc from 0x0323ac to 0x03dc18 (0xb86d bytes) 000489 1783517393.155443 mapwrite 0x00bf32 thru 0x00c090 (0x15f bytes) 000491 1783517393.161947 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3dc19): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc19): Mirror 12: 0x9bc9aab1 (stale) Mirror 13: 0x9bc9aab1 (stale) Mirror 14: 0x9bc9aab1 (stale) CRC-32 checksum value for chunk [0, 0x3dc19): Mirror 1: 0x35811ae8 Mirror 15: 0x35811ae8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc19: skipped 000492 1783517393.406810 mapread 0x01b559 thru 0x02233a (0x6de2 bytes) 000493 1783517393.414696 fallocate 0x0365d7 thru 0x03ffff (0x9a29 bytes) 000494 1783517393.425030 mapread 0x00c6d6 thru 0x012ac2 (0x63ed bytes) 000495 1783517393.428555 mapread 0x005d8d thru 0x00e5cd (0x8841 bytes) 000496 1783517393.429620 punch from 0x003714 to 0x00801e (0x490b bytes) 000497 1783517393.431426 fallocate 0x0246a2 thru 0x02e8ae (0xa20d bytes) 000498 1783517393.433426 write 0x01ed21 thru 0x024b2f (0x5e0f bytes) 000499 1783517393.437651 mapwrite 0x005db3 thru 0x006b1e (0xd6c bytes) 000500 1783517393.445110 fallocate 0x00e6fd thru 0x017a72 (0x9376 bytes) 000501 1783517393.447278 fallocate 0x038bcd thru 0x03f3f1 (0x6825 bytes) 000502 1783517393.449559 punch from 0x029263 to 0x029e19 (0xbb7 bytes) 000503 1783517393.451230 mapwrite 0x017681 thru 0x01abae (0x352e bytes) 000505 1783517393.458633 read 0x026e85 thru 0x02f8b1 (0x8a2d bytes) 000506 1783517393.461595 write 0x014b11 thru 0x01aba3 (0x6093 bytes) 000508 1783517393.463282 fallocate 0x02d626 thru 0x030a56 (0x3431 bytes) 000509 1783517393.465414 write 0x002a23 thru 0x00ce2e (0xa40c bytes) 000510 1783517393.466562 fallocate 0x031362 thru 0x03ffff (0xec9e bytes) 000511 1783517393.468442 trunc from 0x00be72 to 0x019a7c (0xdc0b bytes) 000512 1783517393.472581 mapwrite 0x018cf5 thru 0x0234ae (0xa7ba bytes) 000515 1783517393.483073 trunc from 0x03dc19 to 0x014226 (0x299f2 bytes) 000517 1783517393.493716 mapread 0x011b6b thru 0x014226 (0x26bc bytes) 000518 1783517393.494421 trunc from 0x014227 to 0x012831 (0x19f5 bytes) 000519 1783517393.498786 trunc from 0x011b16 to 0x012831 (0xd1c bytes) 000520 1783517393.500253 read 0x00dacc thru 0x00ef3f (0x1474 bytes) 000521 1783517393.502744 mapwrite 0x000ba2 thru 0x00460e (0x3a6d bytes) 000522 1783517393.508287 write 0x01a648 thru 0x0269c1 (0xc37a bytes) 000523 1783517393.509634 mapread 0x01cf3c thru 0x023989 (0x6a4e bytes) 000524 1783517393.510407 trunc from 0x0269c2 to 0x035452 (0xea91 bytes) 000526 1783517393.514981 fallocate 0x025645 thru 0x03216b (0xcb27 bytes) 000527 1783517393.517744 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35453): Mirror 12: 0x9a16a187 (stale) Mirror 13: 0x9a16a187 (stale) Mirror 14: 0x9a16a187 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35453): Mirror 12: 0x9a16a187 (stale) Mirror 13: 0x9a16a187 (stale) Mirror 14: 0x9a16a187 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35453: skipped 000528 1783517393.612667 write 0x024734 thru 0x02592e (0x11fb bytes) 000529 1783517393.617007 fallocate 0x03a23b thru 0x03ffff (0x5dc5 bytes) 000530 1783517393.620145 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x35453): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35453): Mirror 12: 0x9a16a187 (stale) Mirror 13: 0x9a16a187 (stale) Mirror 14: 0x9a16a187 (stale) CRC-32 checksum value for chunk [0, 0x35453): Mirror 1: 0xf67e6775 Mirror 15: 0xf67e6775 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35453: skipped 000531 1783517393.829410 mapread 0x02fd3a thru 0x035452 (0x5719 bytes) 000532 1783517393.837617 mapwrite 0x00d073 thru 0x016eba (0x9e48 bytes) 000533 1783517393.877531 mapread 0x007b6e thru 0x007b91 (0x24 bytes) 000534 1783517393.878382 fallocate 0x01109d thru 0x01ae18 (0x9d7c bytes) 000535 1783517393.880462 trunc from 0x035453 to 0x00a028 (0x2b42a bytes) 000536 1783517393.894373 trunc from 0x00a029 to 0x02d544 (0x2351c bytes) 000537 1783517393.900639 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2d545): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d545): Mirror 12: 0xbe798325 (stale) Mirror 13: 0xbe798325 (stale) Mirror 14: 0xbe798325 (stale) Mirror 15: 0xb6ec86a6 (stale) CRC-32 checksum value for chunk [0, 0x2d545): Mirror 1: 0x5da7e24b Mirror 16: 0x5da7e24b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d545: skipped 000538 1783517394.127480 fallocate 0x014354 thru 0x01978b (0x5438 bytes) 000539 1783517394.138138 write 0x024de0 thru 0x0318c9 (0xcaea bytes) 000540 1783517394.141536 mapwrite 0x007035 thru 0x00b97e (0x494a bytes) 000541 1783517394.152507 write 0x022359 thru 0x02a9b2 (0x865a bytes) 000543 1783517394.155225 trunc from 0x01174a to 0x01931d (0x7bd4 bytes) 000544 1783517394.157132 mapread 0x016dfd thru 0x019401 (0x2605 bytes) 000545 1783517394.160227 punch from 0x010a55 to 0x01ad73 (0xa31f bytes) 000547 1783517394.163920 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x318ca): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x318ca): Mirror 12: 0xd7b0b580 (stale) Mirror 13: 0xd7b0b580 (stale) Mirror 14: 0xd7b0b580 (stale) Mirror 15: 0x64e95758 (stale) Mirror 16: 0x7059c152 (stale) CRC-32 checksum value for chunk [0, 0x318ca): Mirror 1: 0xd1b35496 Mirror 17: 0xd1b35496 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x318ca: skipped 000548 1783517394.383960 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x318ca): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x318ca): Mirror 12: 0xd7b0b580 (stale) Mirror 13: 0xd7b0b580 (stale) Mirror 14: 0xd7b0b580 (stale) Mirror 15: 0x64e95758 (stale) Mirror 16: 0x7059c152 (stale) CRC-32 checksum value for chunk [0, 0x318ca): Mirror 1: 0xd1b35496 Mirror 17: 0xd1b35496 Mirror 18: 0xd1b35496 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x318ca: skipped 000549 1783517394.605235 punch from 0x0109ac to 0x012c05 (0x225a bytes) 000550 1783517394.615749 mapwrite 0x02ba30 thru 0x030197 (0x4768 bytes) 000551 1783517394.625671 fallocate 0x02286d thru 0x02c28f (0x9a23 bytes) 000552 1783517394.627644 punch from 0x00bea7 to 0x01bd43 (0xfe9d bytes) 000553 1783517394.629419 trunc from 0x0318ca to 0x030f76 (0x953 bytes) 000554 1783517394.640163 read 0x008c2d thru 0x00c1c1 (0x3595 bytes) 000555 1783517394.642949 punch from 0x0079dd to 0x00968f (0x1cb3 bytes) 000556 1783517394.644800 mapwrite 0x03e193 thru 0x03ffff (0x1e6d bytes) 000557 1783517394.659309 MIRROR_RESYNC 8 mirrors 000558 1783517395.102124 trunc from 0x00ba1f to 0x015cb2 (0xa294 bytes) 000559 1783517395.116152 read 0x01a73d thru 0x020b4f (0x6413 bytes) 000560 1783517395.120760 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x4eea7bc7 (stale) Mirror 14: 0x4eea7bc7 (stale) Mirror 15: 0x4eea7bc7 (stale) Mirror 16: 0x4eea7bc7 (stale) Mirror 17: 0x4eea7bc7 (stale) Mirror 18: 0x4eea7bc7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x4eea7bc7 (stale) Mirror 14: 0x4eea7bc7 (stale) Mirror 15: 0x4eea7bc7 (stale) Mirror 16: 0x4eea7bc7 (stale) Mirror 17: 0x4eea7bc7 (stale) Mirror 18: 0x4eea7bc7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000561 1783517395.256305 punch from 0x020eed to 0x024f23 (0x4037 bytes) 000562 1783517395.258448 write 0x03d5f5 thru 0x03ffff (0x2a0b bytes) 000563 1783517395.261740 read 0x013a7c thru 0x021374 (0xd8f9 bytes) 000564 1783517395.264369 mapwrite 0x026e9d thru 0x027540 (0x6a4 bytes) 000565 1783517395.272056 trunc from 0x040000 to 0x020063 (0x1ff9c bytes) 000566 1783517395.282222 MIRROR_RESYNC 7 mirrors 000567 1783517395.565496 mapwrite 0x016caf thru 0x01d6fe (0x6a50 bytes) 000568 1783517395.596737 trunc from 0x01c548 to 0x020063 (0x3b1c bytes) 000569 1783517395.598844 mapwrite 0x011b4a thru 0x01a9ba (0x8e71 bytes) 000570 1783517395.606082 mapwrite 0x00007f thru 0x00555f (0x54e1 bytes) 000571 1783517395.614662 fallocate 0x01f052 thru 0x02815d (0x910c bytes) 000572 1783517395.617182 trunc from 0x01757a to 0x017c43 (0x6ca bytes) 000573 1783517395.619107 mapread 0x00ed0e thru 0x018727 (0x9a1a bytes) 000575 1783517395.623609 fallocate 0x02ac74 thru 0x039f8e (0xf31b bytes) 000576 1783517395.625665 mapwrite 0x03bd16 thru 0x03ffff (0x42ea bytes) 000577 1783517395.644192 trunc from 0x040000 to 0x01d8de (0x22721 bytes) 000578 1783517395.648999 mapread 0x007324 thru 0x00988a (0x2567 bytes) 000579 1783517395.649674 fallocate 0x01a546 thru 0x01afae (0xa69 bytes) 000580 1783517395.651673 mapread 0x000355 thru 0x009562 (0x920e bytes) 000581 1783517395.652467 trunc from 0x006108 to 0x007687 (0x1580 bytes) 000582 1783517395.654229 trunc from 0x013a5b to 0x01bb95 (0x813b bytes) 000583 1783517395.656122 mapread 0x00e172 thru 0x01be3b (0xdcca bytes) 000585 1783517395.660027 mapwrite 0x00448a thru 0x00ae46 (0x69bd bytes) 000586 1783517395.668745 punch from 0x006322 to 0x00657e (0x25d bytes) 000587 1783517395.670640 punch from 0x0002ad to 0x00ec4e (0xe9a2 bytes) 000588 1783517395.672411 mapwrite 0x0118b4 thru 0x01adc9 (0x9516 bytes) 000589 1783517395.678555 fallocate 0x022ad0 thru 0x02dc02 (0xb133 bytes) 000590 1783517395.680570 read 0x015c82 thru 0x0176ce (0x1a4d bytes) 000591 1783517395.681231 mapread 0x00caa2 thru 0x01a814 (0xdd73 bytes) 000592 1783517395.683975 trunc from 0x019311 to 0x01d8de (0x45ce bytes) 000593 1783517395.686849 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1d8df): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d8df): Mirror 13: 0x4c7dee97 (stale) Mirror 14: 0x4c7dee97 (stale) Mirror 15: 0x4c7dee97 (stale) Mirror 16: 0x4c7dee97 (stale) Mirror 17: 0x4c7dee97 (stale) Mirror 18: 0x4c7dee97 (stale) CRC-32 checksum value for chunk [0, 0x1d8df): Mirror 1: 0x92604e75 Mirror 19: 0x92604e75 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d8df: skipped 000595 1783517395.922957 trunc from 0x01d8df to 0x02d001 (0xf723 bytes) 000596 1783517395.941067 mapwrite 0x02d06a thru 0x0316df (0x4676 bytes) 000597 1783517395.958359 fallocate 0x017a58 thru 0x0242f6 (0xc89f bytes) 000598 1783517395.960594 mapread 0x019b5e thru 0x022f43 (0x93e6 bytes) 000600 1783517395.967780 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x316e0): Mirror 13: 0x9a7dc0b3 (stale) Mirror 15: 0x9a7dc0b3 (stale) Mirror 16: 0x9a7dc0b3 (stale) Mirror 17: 0x9a7dc0b3 (stale) Mirror 18: 0x9a7dc0b3 (stale) Mirror 19: 0x1c2ea521 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x316e0): Mirror 13: 0x9a7dc0b3 (stale) Mirror 15: 0x9a7dc0b3 (stale) Mirror 16: 0x9a7dc0b3 (stale) Mirror 17: 0x9a7dc0b3 (stale) Mirror 18: 0x9a7dc0b3 (stale) Mirror 19: 0x1c2ea521 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x316e0: skipped 000601 1783517396.080040 fallocate 0x034c77 thru 0x03fbef (0xaf79 bytes) 000602 1783517396.082037 write 0x00f911 thru 0x01a16b (0xa85b bytes) 000603 1783517396.086278 write 0x0398b2 thru 0x03ffff (0x674e bytes) 000605 1783517396.088656 trunc from 0x03e001 to 0x03f0f4 (0x10f4 bytes) 000606 1783517396.092994 trunc from 0x040000 to 0x0256ab (0x1a954 bytes) 000607 1783517396.098265 read 0x000dd0 thru 0x0017f4 (0xa25 bytes) 000608 1783517396.100370 punch from 0x0106c5 to 0x013ae2 (0x341e bytes) 000609 1783517396.102092 trunc from 0x0256ac to 0x01f4ac (0x61ff bytes) 000610 1783517396.106154 trunc from 0x01f4ad to 0x02e834 (0xf388 bytes) 000611 1783517396.110168 read 0x007707 thru 0x00f267 (0x7b61 bytes) 000612 1783517396.113576 mapwrite 0x0324cb thru 0x03ffff (0xdb35 bytes) 000613 1783517396.127040 write 0x02c6ee thru 0x02da29 (0x133c bytes) 000614 1783517396.127674 read 0x00de33 thru 0x0127a8 (0x4976 bytes) 000615 1783517396.128118 write 0x0316b2 thru 0x03a123 (0x8a72 bytes) 000616 1783517396.128858 mapwrite 0x00074b thru 0x00bc21 (0xb4d7 bytes) 000618 1783517396.135788 write 0x02c952 thru 0x030aa4 (0x4153 bytes) 000619 1783517396.136781 read 0x02ef66 thru 0x03c6b5 (0xd750 bytes) 000620 1783517396.138511 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x23b51290 (stale) Mirror 15: 0x23b51290 (stale) Mirror 16: 0x23b51290 (stale) Mirror 17: 0x23b51290 (stale) Mirror 18: 0x23b51290 (stale) Mirror 19: 0x5c11d78d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe615c8a8 Mirror 20: 0xe615c8a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000621 1783517396.404126 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x23b51290 (stale) Mirror 16: 0x23b51290 (stale) Mirror 17: 0x23b51290 (stale) Mirror 18: 0x23b51290 (stale) Mirror 19: 0x5c11d78d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x23b51290 (stale) Mirror 16: 0x23b51290 (stale) Mirror 17: 0x23b51290 (stale) Mirror 18: 0x23b51290 (stale) Mirror 19: 0x5c11d78d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe615c8a8 Mirror 20: 0xe615c8a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000622 1783517396.598159 fallocate 0x033678 thru 0x03b651 (0x7fda bytes) 000624 1783517396.613040 mapwrite 0x00a408 thru 0x00e8ab (0x44a4 bytes) 000625 1783517396.625346 read 0x021c12 thru 0x02625f (0x464e bytes) 000626 1783517396.628325 write 0x02496f thru 0x024c1c (0x2ae bytes) 000627 1783517396.630524 mapread 0x00c923 thru 0x00cd5f (0x43d bytes) 000628 1783517396.633131 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x23b51290 (stale) Mirror 16: 0x23b51290 (stale) Mirror 17: 0x23b51290 (stale) Mirror 18: 0x23b51290 (stale) Mirror 19: 0x5c11d78d (stale) Mirror 20: 0xe615c8a8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc5abe193 Mirror 21: 0xc5abe193 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000629 1783517396.900101 fallocate 0x030fe0 thru 0x0337df (0x2800 bytes) 000630 1783517396.911426 mapwrite 0x03b3f5 thru 0x03ffff (0x4c0b bytes) 000631 1783517396.923076 trunc from 0x040000 to 0x00c8a1 (0x3375e bytes) 000632 1783517396.934111 mapread 0x00912b thru 0x00c8a1 (0x3777 bytes) 000633 1783517396.937040 trunc from 0x00c8a2 to 0x025cf4 (0x19453 bytes) 000634 1783517396.941187 punch from 0x00b4c5 to 0x00f8d4 (0x4410 bytes) 000635 1783517396.943074 punch from 0x01b2c4 to 0x023302 (0x803f bytes) 000636 1783517396.945184 mapread 0x00b012 thru 0x00d06a (0x2059 bytes) 000637 1783517396.948373 punch from 0x01719f to 0x0192e4 (0x2146 bytes) 000638 1783517396.949917 mapwrite 0x02dda2 thru 0x034f69 (0x71c8 bytes) 000639 1783517396.962995 mapread 0x0018dd thru 0x009806 (0x7f2a bytes) 000640 1783517396.965526 trunc from 0x034f6a to 0x02332a (0x11c3f bytes) 000641 1783517396.970170 mapread 0x003e09 thru 0x00a8c4 (0x6abc bytes) 000643 1783517396.971918 trunc from 0x01c061 to 0x02332a (0x72ca bytes) 000645 1783517396.974126 write 0x01c24e thru 0x02a33d (0xe0f0 bytes) 000646 1783517396.978266 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2a33e): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a33e): Mirror 15: 0x1c588714 (stale) Mirror 16: 0x1c588714 (stale) Mirror 17: 0x1c588714 (stale) Mirror 18: 0x1c588714 (stale) Mirror 19: 0x17a8fa0a (stale) Mirror 20: 0x35327750 (stale) Mirror 21: 0xa77ca37b (stale) CRC-32 checksum value for chunk [0, 0x2a33e): Mirror 1: 0x3b7d9225 Mirror 22: 0x3b7d9225 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a33e: skipped 000647 1783517397.251574 trunc from 0x0074e4 to 0x00cca4 (0x57c1 bytes) 000648 1783517397.262976 mapread 0x007202 thru 0x015b69 (0xe968 bytes) 000649 1783517397.271998 punch from 0x005f9b to 0x00c957 (0x69bd bytes) 000650 1783517397.274025 mapwrite 0x026d2d thru 0x02c9e6 (0x5cba bytes) 000652 1783517397.290125 MIRROR_RESYNC 9 mirrors 000653 1783517397.659758 write 0x012219 thru 0x01949e (0x7286 bytes) 000654 1783517397.675978 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2c9e7): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c9e7): Mirror 15: 0xffa02974 (stale) Mirror 16: 0xffa02974 (stale) Mirror 17: 0xffa02974 (stale) Mirror 18: 0xffa02974 (stale) Mirror 19: 0xffa02974 (stale) Mirror 20: 0xffa02974 (stale) Mirror 21: 0xffa02974 (stale) Mirror 22: 0xffa02974 (stale) CRC-32 checksum value for chunk [0, 0x2c9e7): Mirror 1: 0xd796e7fd Mirror 23: 0xd796e7fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c9e7: skipped 000655 1783517397.942843 fallocate 0x011bde thru 0x0145b8 (0x29db bytes) 000656 1783517397.955138 mapwrite 0x0201d0 thru 0x020f03 (0xd34 bytes) 000657 1783517397.960661 read 0x0012b7 thru 0x00322a (0x1f74 bytes) 000659 1783517397.962935 mapwrite 0x01b22c thru 0x025a07 (0xa7dc bytes) 000661 1783517397.977477 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c9e7): Mirror 15: 0xffa02974 (stale) Mirror 16: 0xffa02974 (stale) Mirror 17: 0xffa02974 (stale) Mirror 18: 0xffa02974 (stale) Mirror 19: 0xffa02974 (stale) Mirror 20: 0xffa02974 (stale) Mirror 21: 0xffa02974 (stale) Mirror 22: 0xffa02974 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c9e7): Mirror 15: 0xffa02974 (stale) Mirror 16: 0xffa02974 (stale) Mirror 17: 0xffa02974 (stale) Mirror 18: 0xffa02974 (stale) Mirror 19: 0xffa02974 (stale) Mirror 20: 0xffa02974 (stale) Mirror 21: 0xffa02974 (stale) Mirror 22: 0xffa02974 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c9e7: skipped 000662 1783517398.108397 punch from 0x013fe5 to 0x01a953 (0x696f bytes) 000663 1783517398.110368 mapread 0x02b765 thru 0x02c9e6 (0x1282 bytes) 000664 1783517398.114059 trunc from 0x02c9e7 to 0x004cf3 (0x27cf3 bytes) 000666 1783517398.125572 mapwrite 0x00a87e thru 0x010173 (0x58f6 bytes) 000667 1783517398.138797 punch from 0x000a86 to 0x00a02c (0x95a7 bytes) 000668 1783517398.142095 fallocate 0x02cc6e thru 0x03a63a (0xd9cd bytes) 000669 1783517398.144276 read 0x00fd74 thru 0x010173 (0x400 bytes) 000670 1783517398.144850 mapread 0x00843a thru 0x008748 (0x30f bytes) 000671 1783517398.148254 punch from 0x000315 to 0x00c780 (0xc46c bytes) 000672 1783517398.150312 trunc from 0x005b60 to 0x00fa78 (0x9f19 bytes) 000673 1783517398.152463 read 0x0007e4 thru 0x005183 (0x49a0 bytes) 000674 1783517398.157347 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x10174): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10174): Mirror 15: 0x49a7c606 (stale) Mirror 16: 0x49a7c606 (stale) Mirror 17: 0x49a7c606 (stale) Mirror 18: 0x49a7c606 (stale) Mirror 19: 0x49a7c606 (stale) Mirror 20: 0x49a7c606 (stale) Mirror 21: 0x49a7c606 (stale) Mirror 22: 0x49a7c606 (stale) CRC-32 checksum value for chunk [0, 0x10174): Mirror 1: 0x4d24cf3b Mirror 23: 0x4d24cf3b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10174: skipped 000675 1783517398.387686 punch from 0x00d7a6 to 0x010173 (0x29ce bytes) 000676 1783517398.400783 mapwrite 0x00c238 thru 0x00d75e (0x1527 bytes) 000677 1783517398.408075 fallocate 0x00d607 thru 0x015a40 (0x843a bytes) 000678 1783517398.410192 mapread 0x008dcb thru 0x015a40 (0xcc76 bytes) 000680 1783517398.417201 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15a41): Mirror 15: 0xb2112d4b (stale) Mirror 16: 0xb2112d4b (stale) Mirror 17: 0xb2112d4b (stale) Mirror 18: 0xb2112d4b (stale) Mirror 19: 0xb2112d4b (stale) Mirror 20: 0xb2112d4b (stale) Mirror 21: 0xb2112d4b (stale) Mirror 23: 0x5c87935c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15a41): Mirror 15: 0xb2112d4b (stale) Mirror 16: 0xb2112d4b (stale) Mirror 17: 0xb2112d4b (stale) Mirror 18: 0xb2112d4b (stale) Mirror 19: 0xb2112d4b (stale) Mirror 20: 0xb2112d4b (stale) Mirror 21: 0xb2112d4b (stale) Mirror 23: 0x5c87935c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15a41: skipped 000681 1783517398.544544 trunc from 0x015a41 to 0x023bae (0xe16e bytes) 000682 1783517398.555656 fallocate 0x031875 thru 0x0337c7 (0x1f53 bytes) 000684 1783517398.558337 mapwrite 0x01ff44 thru 0x0260b3 (0x6170 bytes) 000685 1783517398.571811 read 0x00f558 thru 0x010a97 (0x1540 bytes) 000686 1783517398.574231 mapwrite 0x022b2c thru 0x02c899 (0x9d6e bytes) 000687 1783517398.586342 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x337c8): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x337c8): Mirror 15: 0xbdfdc0ed (stale) Mirror 16: 0xbdfdc0ed (stale) Mirror 17: 0xbdfdc0ed (stale) Mirror 18: 0xbdfdc0ed (stale) Mirror 19: 0xbdfdc0ed (stale) Mirror 20: 0xbdfdc0ed (stale) Mirror 21: 0xbdfdc0ed (stale) Mirror 23: 0xd399b5c5 (stale) CRC-32 checksum value for chunk [0, 0x337c8): Mirror 1: 0xe849b2f5 Mirror 24: 0xe849b2f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x337c8: skipped 000689 1783517398.847545 fallocate 0x03098a thru 0x036603 (0x5c7a bytes) 000691 1783517398.861184 fallocate 0x004667 thru 0x007473 (0x2e0d bytes) 000692 1783517398.863385 trunc from 0x026e8b to 0x02716a (0x2e0 bytes) 000694 1783517398.865597 mapread 0x00c03e thru 0x00fb7b (0x3b3e bytes) 000695 1783517398.871794 trunc from 0x0337c8 to 0x00428d (0x2f53a bytes) 000696 1783517398.884452 punch from 0x000248 to 0x00428d (0x4046 bytes) 000697 1783517398.886288 mapwrite 0x01bd35 thru 0x023a2b (0x7cf7 bytes) 000699 1783517398.901786 mapread 0x010876 thru 0x0154b2 (0x4c3d bytes) 000700 1783517398.905005 trunc from 0x004734 to 0x00d96f (0x923c bytes) 000701 1783517398.908403 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23a2c): Mirror 16: 0x6e5ac2fc (stale) Mirror 17: 0x6e5ac2fc (stale) Mirror 18: 0x6e5ac2fc (stale) Mirror 19: 0x6e5ac2fc (stale) Mirror 20: 0x6e5ac2fc (stale) Mirror 21: 0x6e5ac2fc (stale) Mirror 23: 0xcc72bc17 (stale) Mirror 24: 0xac9635ee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23a2c): Mirror 16: 0x6e5ac2fc (stale) Mirror 17: 0x6e5ac2fc (stale) Mirror 18: 0x6e5ac2fc (stale) Mirror 19: 0x6e5ac2fc (stale) Mirror 20: 0x6e5ac2fc (stale) Mirror 21: 0x6e5ac2fc (stale) Mirror 23: 0xcc72bc17 (stale) Mirror 24: 0xac9635ee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23a2c: skipped 000702 1783517399.041153 trunc from 0x0205c5 to 0x022bdc (0x2618 bytes) 000703 1783517399.042943 mapread 0x00cdc3 thru 0x018df0 (0xc02e bytes) 000704 1783517399.050915 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23a2c): Mirror 16: 0x6e5ac2fc (stale) Mirror 17: 0x6e5ac2fc (stale) Mirror 18: 0x6e5ac2fc (stale) Mirror 19: 0x6e5ac2fc (stale) Mirror 20: 0x6e5ac2fc (stale) Mirror 23: 0xcc72bc17 (stale) Mirror 24: 0xac9635ee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23a2c): Mirror 16: 0x6e5ac2fc (stale) Mirror 17: 0x6e5ac2fc (stale) Mirror 18: 0x6e5ac2fc (stale) Mirror 19: 0x6e5ac2fc (stale) Mirror 20: 0x6e5ac2fc (stale) Mirror 23: 0xcc72bc17 (stale) Mirror 24: 0xac9635ee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23a2c: skipped 000705 1783517399.164618 punch from 0x0010ce to 0x008112 (0x7045 bytes) 000706 1783517399.166514 mapread 0x006a33 thru 0x0164f5 (0xfac3 bytes) 000708 1783517399.175706 fallocate 0x03fb77 thru 0x03ffff (0x489 bytes) 000709 1783517399.177703 mapread 0x0324d7 thru 0x03ffff (0xdb29 bytes) 000710 1783517399.182916 trunc from 0x03fc16 to 0x03ffff (0x3ea bytes) 000711 1783517399.184687 trunc from 0x040000 to 0x012982 (0x2d67d bytes) 000712 1783517399.189974 mapwrite 0x0262c8 thru 0x02761e (0x1357 bytes) 000713 1783517399.201259 fallocate 0x03e3f3 thru 0x03ffff (0x1c0d bytes) 000714 1783517399.203350 read 0x02293f thru 0x02f8f7 (0xcfb9 bytes) 000715 1783517399.207469 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x7295809a (stale) Mirror 17: 0x7295809a (stale) Mirror 18: 0x7295809a (stale) Mirror 19: 0x7295809a (stale) Mirror 20: 0x7295809a (stale) Mirror 23: 0x47fc2f54 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x7295809a (stale) Mirror 17: 0x7295809a (stale) Mirror 18: 0x7295809a (stale) Mirror 19: 0x7295809a (stale) Mirror 20: 0x7295809a (stale) Mirror 23: 0x47fc2f54 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000716 1783517399.319969 mapwrite 0x028f99 thru 0x036eec (0xdf54 bytes) 000717 1783517399.335451 trunc from 0x040000 to 0x02eca2 (0x1135d bytes) 000718 1783517399.341223 punch from 0x021df3 to 0x026ddb (0x4fe9 bytes) 000719 1783517399.343035 read 0x005455 thru 0x009b7a (0x4726 bytes) 000720 1783517399.345758 fallocate 0x01ba10 thru 0x02893e (0xcf2f bytes) 000721 1783517399.347833 punch from 0x00d39c to 0x01bae6 (0xe74b bytes) 000722 1783517399.349520 trunc from 0x02eca3 to 0x0238ed (0xb3b5 bytes) 000723 1783517399.354122 mapwrite 0x03e969 thru 0x03ffff (0x1697 bytes) 000724 1783517399.364476 fallocate 0x02aeaa thru 0x0364dc (0xb633 bytes) 000725 1783517399.366537 fallocate 0x0358b2 thru 0x039e35 (0x4584 bytes) 000726 1783517399.368482 trunc from 0x040000 to 0x009a11 (0x365ee bytes) 000728 1783517399.374418 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x9a12): Mirror 17: 0x1e46f415 (stale) Mirror 18: 0x1e46f415 (stale) Mirror 19: 0x1e46f415 (stale) Mirror 20: 0x1e46f415 (stale) Mirror 23: 0x76aca1c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9a12): Mirror 17: 0x1e46f415 (stale) Mirror 18: 0x1e46f415 (stale) Mirror 19: 0x1e46f415 (stale) Mirror 20: 0x1e46f415 (stale) Mirror 23: 0x76aca1c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9a12: skipped 000729 1783517399.465120 trunc from 0x009830 to 0x009a11 (0x1e2 bytes) 000730 1783517399.466635 fallocate 0x0379fa thru 0x03a2a6 (0x28ad bytes) 000733 1783517399.469858 punch from 0x00ce4d to 0x013093 (0x6247 bytes) 000734 1783517399.471645 read 0x0017af thru 0x00e2f1 (0xcb43 bytes) 000735 1783517399.474490 trunc from 0x03a2a7 to 0x01c8a6 (0x1da00 bytes) 000736 1783517399.479485 read 0x017794 thru 0x01c8a6 (0x5113 bytes) 000737 1783517399.482517 trunc from 0x01c8a7 to 0x029a6c (0xd1c6 bytes) 000738 1783517399.487609 read 0x00e4f7 thru 0x00f7e9 (0x12f3 bytes) 000739 1783517399.488292 punch from 0x01e91b to 0x029a6c (0xb152 bytes) 000740 1783517399.490189 fallocate 0x0376aa thru 0x03b864 (0x41bb bytes) 000741 1783517399.492184 punch from 0x004391 to 0x00b65f (0x72cf bytes) 000742 1783517399.495601 trunc from 0x006511 to 0x00e5a8 (0x8098 bytes) 000743 1783517399.497468 punch from 0x007ea9 to 0x00fb38 (0x7c90 bytes) 000744 1783517399.499311 trunc from 0x01a76e to 0x025bb0 (0xb443 bytes) 000745 1783517399.502632 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x29a6d): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29a6d): Mirror 17: 0x9a74f3e0 (stale) Mirror 18: 0x9a74f3e0 (stale) Mirror 19: 0x9a74f3e0 (stale) Mirror 20: 0x9a74f3e0 (stale) Mirror 23: 0xbfa965bc (stale) CRC-32 checksum value for chunk [0, 0x29a6d): Mirror 1: 0xad9590fd Mirror 24: 0xad9590fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29a6d: skipped 000746 1783517399.727927 mapwrite 0x01dc82 thru 0x02d1f7 (0xf576 bytes) 000747 1783517399.759077 read 0x02345f thru 0x02d1f7 (0x9d99 bytes) 000748 1783517399.759525 read 0x0283cc thru 0x02c50b (0x4140 bytes) 000749 1783517399.761657 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d1f8): Mirror 17: 0x6f727890 (stale) Mirror 18: 0x6f727890 (stale) Mirror 20: 0x6f727890 (stale) Mirror 23: 0xe7099b88 (stale) Mirror 24: 0xdd43f3ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d1f8): Mirror 17: 0x6f727890 (stale) Mirror 18: 0x6f727890 (stale) Mirror 20: 0x6f727890 (stale) Mirror 23: 0xe7099b88 (stale) Mirror 24: 0xdd43f3ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d1f8: skipped 000750 1783517399.866506 trunc from 0x001ca5 to 0x00d60b (0xb967 bytes) 000751 1783517399.868335 mapwrite 0x000073 thru 0x00a198 (0xa126 bytes) 000752 1783517399.883634 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d1f8): Mirror 17: 0x6f727890 (stale) Mirror 18: 0x6f727890 (stale) Mirror 20: 0x6f727890 (stale) Mirror 24: 0xdd43f3ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d1f8): Mirror 17: 0x6f727890 (stale) Mirror 18: 0x6f727890 (stale) Mirror 20: 0x6f727890 (stale) Mirror 24: 0xdd43f3ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d1f8: skipped 000753 1783517399.982082 trunc from 0x01195a to 0x019ab2 (0x8159 bytes) 000754 1783517399.983966 trunc from 0x008d35 to 0x016d30 (0xdffc bytes) 000755 1783517399.985710 write 0x001c47 thru 0x00be8f (0xa249 bytes) 000756 1783517399.990122 write 0x01009e thru 0x01bb77 (0xbada bytes) 000757 1783517399.992884 read 0x01d999 thru 0x0244f2 (0x6b5a bytes) 000758 1783517399.995149 trunc from 0x00ee73 to 0x018a5f (0x9bed bytes) 000760 1783517399.999629 punch from 0x006e3f to 0x00e2e9 (0x74ab bytes) 000761 1783517400.001424 fallocate 0x01e655 thru 0x028d0e (0xa6ba bytes) 000762 1783517400.003004 trunc from 0x02c7eb to 0x02d1f7 (0xa0d bytes) 000763 1783517400.004526 mapwrite 0x0286d4 thru 0x02a5b5 (0x1ee2 bytes) 000764 1783517400.013603 mapread 0x00a7dc thru 0x018af5 (0xe31a bytes) 000765 1783517400.018374 fallocate 0x03c953 thru 0x03ffff (0x36ad bytes) 000766 1783517400.020091 trunc from 0x02d1f8 to 0x02a1b0 (0x3047 bytes) 000767 1783517400.023955 trunc from 0x0090e6 to 0x012274 (0x918f bytes) 000769 1783517400.025800 trunc from 0x02a1b1 to 0x030672 (0x64c2 bytes) 000770 1783517400.029649 trunc from 0x024e30 to 0x02b133 (0x6304 bytes) 000771 1783517400.031355 read 0x0218eb thru 0x0246b5 (0x2dcb bytes) 000772 1783517400.034981 mapread 0x002c08 thru 0x0118ad (0xeca6 bytes) 000773 1783517400.036030 punch from 0x00bee7 to 0x018b70 (0xcc8a bytes) 000774 1783517400.037970 read 0x0266f2 thru 0x02cf64 (0x6873 bytes) 000776 1783517400.038746 mapread 0x0078fa thru 0x016e2f (0xf536 bytes) 000777 1783517400.042362 punch from 0x02be89 to 0x030672 (0x47ea bytes) 000778 1783517400.045767 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30673): Mirror 17: 0x51d22bf6 (stale) Mirror 18: 0x51d22bf6 (stale) Mirror 20: 0x51d22bf6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30673): Mirror 17: 0x51d22bf6 (stale) Mirror 18: 0x51d22bf6 (stale) Mirror 20: 0x51d22bf6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30673: skipped 000779 1783517400.138932 write 0x01c7e6 thru 0x02421c (0x7a37 bytes) 000780 1783517400.143299 mapwrite 0x00fa85 thru 0x016b20 (0x709c bytes) 000781 1783517400.156546 trunc from 0x030673 to 0x0237ac (0xcec6 bytes) 000782 1783517400.160960 mapread 0x016e3f thru 0x01d46a (0x662c bytes) 000783 1783517400.164762 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x237ad): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x237ad): Mirror 17: 0x3a83b924 (stale) Mirror 18: 0x3a83b924 (stale) Mirror 20: 0x3a83b924 (stale) CRC-32 checksum value for chunk [0, 0x237ad): Mirror 1: 0x673e725c Mirror 21: 0x673e725c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x237ad: skipped 000784 1783517400.395289 trunc from 0x002aab to 0x00744c (0x49a2 bytes) 000785 1783517400.404581 punch from 0x019181 to 0x0237ac (0xa62c bytes) 000786 1783517400.406322 trunc from 0x018617 to 0x0237ac (0xb196 bytes) 000787 1783517400.407990 fallocate 0x03eab1 thru 0x03ffff (0x154f bytes) 000788 1783517400.409877 trunc from 0x0237ad to 0x005572 (0x1e23a bytes) 000789 1783517400.420298 write 0x01d801 thru 0x0230c0 (0x58c0 bytes) 000790 1783517400.421562 trunc from 0x0059e4 to 0x012732 (0xcd4f bytes) 000792 1783517400.423632 write 0x0030a7 thru 0x012f38 (0xfe92 bytes) 000793 1783517400.427180 write 0x0078eb thru 0x00a04a (0x2760 bytes) 000794 1783517400.428158 write 0x00dd21 thru 0x00dfd5 (0x2b5 bytes) 000795 1783517400.428731 write 0x017ece thru 0x0272a9 (0xf3dc bytes) 000796 1783517400.431251 fallocate 0x00bb86 thru 0x00db2b (0x1fa6 bytes) 000797 1783517400.434409 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x272aa): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x272aa): Mirror 17: 0xa37a2ce8 (stale) Mirror 18: 0xa37a2ce8 (stale) Mirror 20: 0xa37a2ce8 (stale) Mirror 21: 0x6138ca62 (stale) CRC-32 checksum value for chunk [0, 0x272aa): Mirror 1: 0x2b2e2ba1 Mirror 22: 0x2b2e2ba1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x272aa: skipped 000798 1783517400.658905 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x272aa): Mirror 17: 0xa37a2ce8 (stale) Mirror 18: 0xa37a2ce8 (stale) Mirror 20: 0xa37a2ce8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x272aa): Mirror 17: 0xa37a2ce8 (stale) Mirror 18: 0xa37a2ce8 (stale) Mirror 20: 0xa37a2ce8 (stale) CRC-32 checksum value for chunk [0, 0x272aa): Mirror 1: 0x2b2e2ba1 Mirror 22: 0x2b2e2ba1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x272aa: skipped 000799 1783517400.870702 MIRROR_RESYNC 5 mirrors 000800 1783517401.102672 read 0x026b27 thru 0x0272a9 (0x783 bytes) 000801 1783517401.104319 read 0x023696 thru 0x0272a9 (0x3c14 bytes) 000802 1783517401.107156 mapread 0x00f974 thru 0x011e50 (0x24dd bytes) 000803 1783517401.107700 write 0x00cc0e thru 0x01b334 (0xe727 bytes) 000805 1783517401.120630 fallocate 0x01c046 thru 0x021a7f (0x5a3a bytes) 000806 1783517401.124349 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x272aa): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x272aa): Mirror 17: 0x2b2e2ba1 (stale) Mirror 18: 0x2b2e2ba1 (stale) Mirror 20: 0x2b2e2ba1 (stale) Mirror 22: 0x2b2e2ba1 (stale) CRC-32 checksum value for chunk [0, 0x272aa): Mirror 1: 0xfa5070c0 Mirror 23: 0xfa5070c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x272aa: skipped 000807 1783517401.343587 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x272aa): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x272aa): Mirror 17: 0x2b2e2ba1 (stale) Mirror 18: 0x2b2e2ba1 (stale) Mirror 20: 0x2b2e2ba1 (stale) Mirror 22: 0x2b2e2ba1 (stale) CRC-32 checksum value for chunk [0, 0x272aa): Mirror 1: 0xfa5070c0 Mirror 23: 0xfa5070c0 Mirror 24: 0xfa5070c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x272aa: skipped 000808 1783517401.551946 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x272aa): Mirror 17: 0x2b2e2ba1 (stale) Mirror 18: 0x2b2e2ba1 (stale) Mirror 20: 0x2b2e2ba1 (stale) Mirror 22: 0x2b2e2ba1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x272aa): Mirror 17: 0x2b2e2ba1 (stale) Mirror 18: 0x2b2e2ba1 (stale) Mirror 20: 0x2b2e2ba1 (stale) Mirror 22: 0x2b2e2ba1 (stale) CRC-32 checksum value for chunk [0, 0x272aa): Mirror 1: 0xfa5070c0 Mirror 23: 0xfa5070c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x272aa: skipped 000809 1783517401.710910 trunc from 0x01cdf4 to 0x0272a9 (0xa4b6 bytes) 000810 1783517401.723369 mapwrite 0x014cfe thru 0x01f32a (0xa62d bytes) 000811 1783517401.738472 fallocate 0x0275b8 thru 0x0294aa (0x1ef3 bytes) 000812 1783517401.745037 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x294ab): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x294ab): Mirror 17: 0xdefcb935 (stale) Mirror 18: 0xdefcb935 (stale) Mirror 20: 0xdefcb935 (stale) Mirror 22: 0xdefcb935 (stale) Mirror 23: 0xafa5b4d4 (stale) CRC-32 checksum value for chunk [0, 0x294ab): Mirror 1: 0x9cfc6590 Mirror 24: 0x9cfc6590 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x294ab: skipped 000813 1783517401.967251 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x294ab): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x294ab): Mirror 17: 0xdefcb935 (stale) Mirror 18: 0xdefcb935 (stale) Mirror 20: 0xdefcb935 (stale) Mirror 22: 0xdefcb935 (stale) Mirror 23: 0xafa5b4d4 (stale) CRC-32 checksum value for chunk [0, 0x294ab): Mirror 1: 0x9cfc6590 Mirror 24: 0x9cfc6590 Mirror 25: 0x9cfc6590 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x294ab: skipped 000814 1783517402.208251 mapwrite 0x02d7a4 thru 0x02ed86 (0x15e3 bytes) 000815 1783517402.229090 trunc from 0x02ed87 to 0x020a85 (0xe301 bytes) 000816 1783517402.234397 read 0x01b9fd thru 0x020a85 (0x5089 bytes) 000817 1783517402.236911 trunc from 0x020a86 to 0x033239 (0x127b4 bytes) 000818 1783517402.240895 fallocate 0x03cea9 thru 0x03ffff (0x3157 bytes) 000819 1783517402.242708 mapwrite 0x025e5f thru 0x02cfac (0x714e bytes) 000820 1783517402.251075 trunc from 0x012f4d to 0x015d36 (0x2dea bytes) 000821 1783517402.252659 fallocate 0x00cf3e thru 0x01af3d (0xe000 bytes) 000822 1783517402.254413 trunc from 0x040000 to 0x03673b (0x98c4 bytes) 000823 1783517402.258459 punch from 0x022ba0 to 0x026116 (0x3577 bytes) 000824 1783517402.260082 punch from 0x0158d9 to 0x01cdab (0x74d3 bytes) 000825 1783517402.261453 read 0x02d4c6 thru 0x03673b (0x9276 bytes) 000826 1783517402.264898 trunc from 0x011e3c to 0x013ae2 (0x1ca7 bytes) 000827 1783517402.268125 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3673c): Mirror 17: 0x349f19a8 (stale) Mirror 18: 0x349f19a8 (stale) Mirror 20: 0x349f19a8 (stale) Mirror 23: 0x969c3d83 (stale) Mirror 24: 0x55e11dae (stale) Mirror 25: 0x55e11dae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3673c): Mirror 17: 0x349f19a8 (stale) Mirror 18: 0x349f19a8 (stale) Mirror 20: 0x349f19a8 (stale) Mirror 23: 0x969c3d83 (stale) Mirror 24: 0x55e11dae (stale) Mirror 25: 0x55e11dae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3673c: skipped 000828 1783517402.380038 write 0x015704 thru 0x01e62d (0x8f2a bytes) 000829 1783517402.384337 read 0x00811e thru 0x013035 (0xaf18 bytes) 000830 1783517402.387236 punch from 0x01e281 to 0x02d697 (0xf417 bytes) 000831 1783517402.391091 mapread 0x010c71 thru 0x0119ae (0xd3e bytes) 000832 1783517402.391725 mapread 0x01475c thru 0x017151 (0x29f6 bytes) 000833 1783517402.394061 mapwrite 0x01963b thru 0x02606d (0xca33 bytes) 000835 1783517402.408195 trunc from 0x03673c to 0x03faa7 (0x936c bytes) 000836 1783517402.413314 mapread 0x01f50f thru 0x027ac6 (0x85b8 bytes) 000838 1783517402.414904 write 0x011d85 thru 0x0134eb (0x1767 bytes) 000839 1783517402.417350 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3faa8): Mirror 17: 0x4e5f31d4 (stale) Mirror 18: 0x4e5f31d4 (stale) Mirror 20: 0x4e5f31d4 (stale) Mirror 24: 0xe4b1ec16 (stale) Mirror 25: 0xe4b1ec16 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3faa8): Mirror 17: 0x4e5f31d4 (stale) Mirror 18: 0x4e5f31d4 (stale) Mirror 20: 0x4e5f31d4 (stale) Mirror 24: 0xe4b1ec16 (stale) Mirror 25: 0xe4b1ec16 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3faa8: skipped 000840 1783517402.529942 mapread 0x002c7b thru 0x00d3ed (0xa773 bytes) 000841 1783517402.536010 mapread 0x02e4c7 thru 0x036e09 (0x8943 bytes) 000842 1783517402.539410 trunc from 0x039bb5 to 0x03faa7 (0x5ef3 bytes) 000843 1783517402.541192 punch from 0x007b09 to 0x015868 (0xdd60 bytes) 000844 1783517402.542884 read 0x0191e8 thru 0x024318 (0xb131 bytes) 000845 1783517402.545793 fallocate 0x0214ac thru 0x021f0e (0xa63 bytes) 000846 1783517402.549391 MIRROR_RESYNC 6 mirrors 000847 1783517402.855100 read 0x02061a thru 0x02f05e (0xea45 bytes) 000848 1783517402.858047 mapread 0x01ae42 thru 0x01debd (0x307c bytes) 000849 1783517402.863348 punch from 0x006543 to 0x0081b2 (0x1c70 bytes) 000850 1783517402.874164 fallocate 0x00cf97 thru 0x01c38b (0xf3f5 bytes) 000852 1783517402.876606 write 0x00d268 thru 0x0140c1 (0x6e5a bytes) 000853 1783517402.880150 write 0x020ba6 thru 0x026f5c (0x63b7 bytes) 000855 1783517402.884482 write 0x01dae7 thru 0x01fedb (0x23f5 bytes) 000856 1783517402.887655 mapread 0x0277cb thru 0x02e97c (0x71b2 bytes) 000857 1783517402.890885 trunc from 0x03faa8 to 0x03870b (0x739c bytes) 000858 1783517402.900532 trunc from 0x03870c to 0x02ec2e (0x9add bytes) 000859 1783517402.905621 MIRROR_RESYNC 6 mirrors 000860 1783517403.249631 mapwrite 0x008417 thru 0x013a3a (0xb624 bytes) 000861 1783517403.292305 mapread 0x00b18f thru 0x01a5df (0xf451 bytes) 000862 1783517403.293529 write 0x02d1aa thru 0x02dfb4 (0xe0b bytes) 000863 1783517403.296011 mapread 0x009bc5 thru 0x0173cd (0xd809 bytes) 000866 1783517403.297689 fallocate 0x02c54a thru 0x03562d (0x90e4 bytes) 000867 1783517403.299703 read 0x031148 thru 0x03562d (0x44e6 bytes) 000868 1783517403.303728 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3562e): Mirror 18: 0x28d0904d (stale) Mirror 20: 0x28d0904d (stale) Mirror 24: 0x28d0904d (stale) Mirror 25: 0x28d0904d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3562e): Mirror 18: 0x28d0904d (stale) Mirror 20: 0x28d0904d (stale) Mirror 24: 0x28d0904d (stale) Mirror 25: 0x28d0904d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3562e: skipped 000869 1783517403.423317 mapwrite 0x00ea13 thru 0x018841 (0x9e2f bytes) 000870 1783517403.437137 punch from 0x0126c7 to 0x017fae (0x58e8 bytes) 000871 1783517403.440512 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3562e): Mirror 20: 0x28d0904d (stale) Mirror 24: 0x28d0904d (stale) Mirror 25: 0x28d0904d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3562e): Mirror 20: 0x28d0904d (stale) Mirror 24: 0x28d0904d (stale) Mirror 25: 0x28d0904d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3562e: skipped 000872 1783517403.546423 write 0x00b659 thru 0x00dcad (0x2655 bytes) 000873 1783517403.553949 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3562e): Mirror 20: 0x28d0904d (stale) Mirror 25: 0x28d0904d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3562e): Mirror 20: 0x28d0904d (stale) Mirror 25: 0x28d0904d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3562e: skipped 000874 1783517403.656248 mapwrite 0x015f45 thru 0x01e6f4 (0x87b0 bytes) 000875 1783517403.672464 trunc from 0x002476 to 0x0064a9 (0x4034 bytes) 000876 1783517403.675184 trunc from 0x009186 to 0x015fc9 (0xce44 bytes) 000877 1783517403.677335 punch from 0x02413d to 0x033d50 (0xfc14 bytes) 000878 1783517403.679654 trunc from 0x027864 to 0x02dc7c (0x6419 bytes) 000879 1783517403.681454 fallocate 0x00cdcc thru 0x01788c (0xaac1 bytes) 000880 1783517403.683338 mapwrite 0x02a4d5 thru 0x0375ef (0xd11b bytes) 000881 1783517403.705179 read 0x02544a thru 0x02a754 (0x530b bytes) 000882 1783517403.705803 mapread 0x033842 thru 0x03674b (0x2f0a bytes) 000883 1783517403.706627 trunc from 0x0375f0 to 0x01b7c2 (0x1be2d bytes) 000884 1783517403.714378 mapwrite 0x02866f thru 0x02d8ca (0x525c bytes) 000885 1783517403.729461 trunc from 0x02b29d to 0x02d8ca (0x262e bytes) 000886 1783517403.731486 trunc from 0x02cbf8 to 0x02d8ca (0xcd3 bytes) 000887 1783517403.733723 punch from 0x008d41 to 0x016da1 (0xe061 bytes) 000888 1783517403.736119 punch from 0x02161b to 0x02d8ca (0xc2b0 bytes) 000889 1783517403.740111 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2d8cb): Mirror 20: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d8cb): Mirror 20: 0xbaf14f9 (stale) Mirror 25: 0xbaf14f9 (stale) CRC-32 checksum value for chunk [0, 0x2d8cb): Mirror 1: 0x4dbaf511 Mirror 26: 0x4dbaf511 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d8cb: skipped 000890 1783517404.005637 trunc from 0x01e497 to 0x02268a (0x41f4 bytes) 000891 1783517404.019533 mapread 0x012cd7 thru 0x01c75b (0x9a85 bytes) 000892 1783517404.026648 mapwrite 0x00d43a thru 0x010533 (0x30fa bytes) 000893 1783517404.034532 trunc from 0x002167 to 0x0064e6 (0x4380 bytes) 000894 1783517404.037058 trunc from 0x022fa2 to 0x02d8ca (0xa929 bytes) 000895 1783517404.039623 punch from 0x00d28b to 0x012a94 (0x580a bytes) 000896 1783517404.042122 mapread 0x01423f thru 0x017cb9 (0x3a7b bytes) 000897 1783517404.042955 mapwrite 0x0228a0 thru 0x02b689 (0x8dea bytes) 000898 1783517404.056568 mapwrite 0x037fe1 thru 0x03ffff (0x801f bytes) 000899 1783517404.083174 read 0x0001d9 thru 0x00a3e5 (0xa20d bytes) 000900 1783517404.087025 mapread 0x008195 thru 0x00a724 (0x2590 bytes) 000901 1783517404.090248 MIRROR_RESYNC 4 mirrors 000902 1783517404.573369 fallocate 0x025386 thru 0x02b55d (0x61d8 bytes) 000903 1783517404.586037 trunc from 0x0113b0 to 0x01564e (0x429f bytes) 000904 1783517404.588363 write 0x006b26 thru 0x00a8cf (0x3daa bytes) 000905 1783517404.591942 write 0x011adb thru 0x017dfa (0x6320 bytes) 000906 1783517404.595391 mapread 0x0147e1 thru 0x01e661 (0x9e81 bytes) 000907 1783517404.601171 punch from 0x03f202 to 0x03f711 (0x510 bytes) 000908 1783517404.603019 mapread 0x006d17 thru 0x00986c (0x2b56 bytes) 000909 1783517404.603931 trunc from 0x02ba23 to 0x02ed06 (0x32e4 bytes) 000910 1783517404.606142 write 0x014ca1 thru 0x020281 (0xb5e1 bytes) 000911 1783517404.607532 punch from 0x014c8d to 0x01c5be (0x7932 bytes) 000912 1783517404.612915 punch from 0x0032ab to 0x00b9d6 (0x872c bytes) 000913 1783517404.614925 write 0x025a7c thru 0x028d11 (0x3296 bytes) 000914 1783517404.617927 write 0x03a89b thru 0x03eaa7 (0x420d bytes) 000915 1783517404.622913 MIRROR_RESYNC 4 mirrors 000916 1783517404.941620 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) 000917 1783517405.051545 mapwrite 0x039db0 thru 0x03ffff (0x6250 bytes) 000918 1783517405.090631 write 0x02b31f thru 0x034281 (0x8f63 bytes) 000919 1783517405.095260 fallocate 0x03837e thru 0x03bde6 (0x3a69 bytes) 000920 1783517405.099879 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 25: 0x3f8c21d7 (stale) Mirror 26: 0x3f8c21d7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcb857935 Mirror 27: 0xcb857935 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000921 1783517405.431229 mapread 0x03482c thru 0x03ad5c (0x6531 bytes) 000922 1783517405.441879 punch from 0x004aa7 to 0x013720 (0xec7a bytes) 000924 1783517405.458485 write 0x00d224 thru 0x00f27b (0x2058 bytes) 000925 1783517405.464305 trunc from 0x040000 to 0x0089eb (0x37614 bytes) 000926 1783517405.472561 trunc from 0x0089ec to 0x02e4e6 (0x25afb bytes) 000927 1783517405.478218 mapwrite 0x03b92b thru 0x03ffff (0x46d5 bytes) 000928 1783517405.494012 fallocate 0x002830 thru 0x002f80 (0x751 bytes) 000929 1783517405.496144 fallocate 0x00dcdb thru 0x019c8d (0xbfb3 bytes) 000930 1783517405.499597 MIRROR_RESYNC 4 mirrors 000931 1783517405.742659 fallocate 0x002736 thru 0x006c5d (0x4528 bytes) 000932 1783517405.753235 fallocate 0x00d473 thru 0x00d544 (0xd2 bytes) 000934 1783517405.755921 trunc from 0x040000 to 0x02e446 (0x11bb9 bytes) 000935 1783517405.767648 trunc from 0x00c9bb to 0x014dff (0x8445 bytes) 000936 1783517405.769470 trunc from 0x02e447 to 0x01fd5b (0xe6eb bytes) 000937 1783517405.773734 trunc from 0x01fd5c to 0x0182c5 (0x7a96 bytes) 000938 1783517405.778272 trunc from 0x0156b9 to 0x0182c5 (0x2c0d bytes) 000939 1783517405.779991 mapwrite 0x039ed2 thru 0x03ffb9 (0x60e8 bytes) 000940 1783517405.811668 read 0x033bdd thru 0x03ffb9 (0xc3dd bytes) 000941 1783517405.814307 write 0x03c829 thru 0x03ffff (0x37d7 bytes) 000942 1783517405.815372 read 0x012c7f thru 0x01f1b4 (0xc536 bytes) 000943 1783517405.820731 read 0x000b97 thru 0x009a90 (0x8efa bytes) 000944 1783517405.821265 write 0x0124f0 thru 0x0128b1 (0x3c2 bytes) 000945 1783517405.822061 trunc from 0x0264a7 to 0x02821e (0x1d78 bytes) 000946 1783517405.825066 trunc from 0x01c1bf to 0x028211 (0xc053 bytes) 000947 1783517405.827463 read 0x010eb4 thru 0x01b859 (0xa9a6 bytes) 000948 1783517405.828063 punch from 0x02f24f to 0x02fc1d (0x9cf bytes) 000949 1783517405.830371 write 0x028e3b thru 0x0333bf (0xa585 bytes) 000950 1783517405.834262 fallocate 0x012258 thru 0x01ea1d (0xc7c6 bytes) 000951 1783517405.838218 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 25: 0xe18f49f7 (stale) Mirror 26: 0xe18f49f7 (stale) Mirror 27: 0xe18f49f7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x68707796 Mirror 28: 0x68707796 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000952 1783517406.120913 trunc from 0x040000 to 0x02a3d3 (0x15c2c bytes) 000953 1783517406.141396 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a3d4): Mirror 26: 0xd22a9d19 (stale) Mirror 27: 0xd22a9d19 (stale) Mirror 28: 0x6d49d7d8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a3d4): Mirror 26: 0xd22a9d19 (stale) Mirror 27: 0xd22a9d19 (stale) Mirror 28: 0x6d49d7d8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a3d4: skipped 000954 1783517406.251417 MIRROR_RESYNC 4 mirrors 000955 1783517406.526455 trunc from 0x02a3d4 to 0x0377bf (0xd3ec bytes) 000956 1783517406.536348 punch from 0x000993 to 0x0027ba (0x1e28 bytes) 000957 1783517406.538245 write 0x031e5d thru 0x03ffff (0xe1a3 bytes) 000958 1783517406.540791 mapread 0x031a39 thru 0x036f43 (0x550b bytes) 000959 1783517406.541430 punch from 0x011723 to 0x013472 (0x1d50 bytes) 000960 1783517406.543247 write 0x029324 thru 0x0323de (0x90bb bytes) 000961 1783517406.545302 trunc from 0x013420 to 0x0215b4 (0xe195 bytes) 000962 1783517406.547320 mapread 0x009980 thru 0x00b864 (0x1ee5 bytes) 000963 1783517406.553004 trunc from 0x040000 to 0x01bff4 (0x2400b bytes) 000964 1783517406.558596 mapread 0x01247e thru 0x01664a (0x41cd bytes) 000965 1783517406.561320 fallocate 0x02e661 thru 0x0379b5 (0x9355 bytes) 000966 1783517406.563029 fallocate 0x008807 thru 0x015234 (0xca2e bytes) 000967 1783517406.564649 trunc from 0x012873 to 0x01bff4 (0x9782 bytes) 000968 1783517406.566161 trunc from 0x00195e to 0x006aef (0x5192 bytes) 000969 1783517406.569176 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1bff5): Mirror 26: 0x66287d1d (stale) Mirror 28: 0x66287d1d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bff5): Mirror 26: 0x66287d1d (stale) Mirror 28: 0x66287d1d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bff5: skipped 000970 1783517406.669751 trunc from 0x01672a to 0x01788d (0x1164 bytes) 000971 1783517406.672054 trunc from 0x01bff5 to 0x018aba (0x353a bytes) 000972 1783517406.679026 trunc from 0x018abb to 0x02641e (0xd964 bytes) 000973 1783517406.683642 trunc from 0x02641f to 0x01d447 (0x8fd7 bytes) 000974 1783517406.688894 mapwrite 0x007231 thru 0x00baf3 (0x48c3 bytes) 000975 1783517406.706193 fallocate 0x00b94f thru 0x016c68 (0xb31a bytes) 000976 1783517406.709353 fallocate 0x02cda6 thru 0x02e210 (0x146b bytes) 000977 1783517406.711646 punch from 0x0211b5 to 0x028e53 (0x7c9f bytes) 000978 1783517406.713313 trunc from 0x02e211 to 0x03f086 (0x10e76 bytes) 000979 1783517406.718236 mapwrite 0x036ae1 thru 0x03e5c0 (0x7ae0 bytes) 000981 1783517406.728557 mapread 0x0386e9 thru 0x03cf42 (0x485a bytes) 000982 1783517406.729462 trunc from 0x03f087 to 0x0239b5 (0x1b6d1 bytes) 000983 1783517406.736062 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x76c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x239b6): Mirror 26: 0xf67ad376 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x239b6): Mirror 26: 0xf67ad376 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x239b6: skipped 000984 1783517406.812090 trunc from 0x0239b6 to 0x00368e (0x20327 bytes) 000985 1783517406.817933 read 0x000865 thru 0x00368e (0x2e2a bytes) 000986 1783517406.820430 mapwrite 0x02ce2c thru 0x02d575 (0x74a bytes) 000987 1783517406.832116 read 0x006ae5 thru 0x009e4a (0x3366 bytes) 000988 1783517406.835519 read 0x0230a4 thru 0x02cece (0x9e2b bytes) 000989 1783517406.835989 read 0x00e165 thru 0x01615b (0x7ff7 bytes) 000990 1783517406.836348 fallocate 0x0319f2 thru 0x035056 (0x3665 bytes) 000991 1783517406.840125 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2d576): Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d576): Mirror 26: 0x71b0bc9a (stale) CRC-32 checksum value for chunk [0, 0x2d576): Mirror 1: 0x63c604eb Mirror 27: 0x63c604eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d576: skipped 000992 1783517407.057977 mapread 0x01d683 thru 0x020464 (0x2de2 bytes) 000993 1783517407.068978 punch from 0x007637 to 0x012b10 (0xb4da bytes) 000994 1783517407.079666 fallocate 0x01ec60 thru 0x02659e (0x793f bytes) 000995 1783517407.082366 punch from 0x0192f3 to 0x021b3d (0x884b bytes) 000996 1783517407.084432 trunc from 0x02d576 to 0x0261f3 (0x7382 bytes) 000997 1783517407.098389 trunc from 0x01e1fc to 0x0261f3 (0x7ff8 bytes) 000998 1783517407.100572 read 0x0037f9 thru 0x004a22 (0x122a bytes) 000999 1783517407.103168 fallocate 0x038b11 thru 0x03ffff (0x74ef bytes) 001000 1783517407.105685 read 0x03517f thru 0x03a2d2 (0x5154 bytes) All operations completed A-OK!