== sanity test 17n: run e2fsck against master/slave MDT which contains remote dir ========================================================== 22:30:28 (1747794628) striped dir -i1 -c2 -H crush2 /mnt/lustre/d17n.sanity total: 10 open/close in 0.07 seconds: 144.63 ops/second total: 10 open/close in 0.07 seconds: 148.45 ops/second total: 10 open/close in 0.07 seconds: 151.81 ops/second total: 10 open/close in 0.07 seconds: 153.82 ops/second total: 10 open/close in 0.06 seconds: 155.49 ops/second total: 10 open/close in 0.07 seconds: 153.68 ops/second total: 10 open/close in 0.07 seconds: 144.15 ops/second total: 10 open/close in 0.06 seconds: 157.32 ops/second total: 10 open/close in 0.06 seconds: 177.85 ops/second total: 10 open/close in 0.06 seconds: 168.07 ops/second Stopping /mnt/lustre-mds1 (opts:) on oleg147-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg147-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg147-server: Use max possible thread num: 2 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 16) [Thread 1] Scan group range [16, 32) [Thread 1] jumping to group 16 [Thread 0] jumping to group 0 [Thread 1] e2fsck_pass1_run:2564: increase inode 512040 badness 0 to 2 for 10084 [Thread 1] group 17 finished [Thread 1] group 18 finished [Thread 1] group 19 finished [Thread 1] group 20 finished [Thread 1] group 21 finished [Thread 1] group 22 finished [Thread 1] group 23 finished [Thread 1] group 24 finished [Thread 1] group 25 finished [Thread 1] group 26 finished [Thread 1] group 27 finished [Thread 1] group 28 finished [Thread 1] group 29 finished [Thread 1] group 30 finished [Thread 1] group 31 finished [Thread 1] group 32 finished [Thread 1] Pass 1: Memory used: 740k/0k (508k/233k), time: 0.00/ 0.00/ 0.00 [Thread 1] Pass 1: I/O read: 1MB, write: 0MB, rate: 286.78MB/s [Thread 1] Scanned group range [16, 32), inodes 224 [Thread 0] e2fsck_pass1_run:2564: increase inode 78 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 79 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 80 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 86 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 87 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 108 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 124 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 125 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 126 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 127 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 128 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 129 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 130 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 133 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 134 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 141 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 145 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 154 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 155 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 156 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 32001 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32002 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32003 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32004 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32005 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32007 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32008 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 64001 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 64002 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 64003 badness 0 to 2 for 10084 [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] Pass 1: Memory used: 820k/0k (502k/319k), time: 0.01/ 0.01/ 0.01 [Thread 0] Pass 1: I/O read: 3MB, write: 0MB, rate: 223.80MB/s [Thread 0] Scanned group range [0, 16), inodes 730 Pass 2: Checking directory structure Pass 2: Memory used: 820k/0k (81k/740k), time: 0.01/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 111.06MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 820k/0k (82k/739k), time: 0.08/ 0.06/ 0.01 '..' in /REMOTE_PARENT_DIR/0x200000401:0xb:0x0 (32009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1a:0x0 (32011) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000403:0xb:0x0 (32012) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000403:0xc:0x0 (32013) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000403:0xd:0x0 (32014) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xc:0x0 (64005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xd:0x0 (64006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xe:0x0 (64007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x11:0x0 (64009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1b:0x0 (64011) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x12:0x0 (96001) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x13:0x0 (96003) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x14:0x0 (96004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x15:0x0 (96005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x16:0x0 (96006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x17:0x0 (96007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x18:0x0 (96008) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1c:0x0 (96009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1d:0x0 (96010) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1e:0x0 (96011) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x8:0x0 (512107) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x9:0x0 (512109) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000402:0xf:0x0 (512114) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xa:0x0 (512119) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xf:0x0 (512133) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x10:0x0 (512135) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x19:0x0 (512151) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000403:0x1:0x0 (512162) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000403:0x4:0x0 (512164) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000403:0x5:0x0 (512173) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000403:0x6:0x0 (512181) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000403:0x7:0x0 (512189) is pdsh@oleg147-client: oleg147-server: ssh exited with exit code 4 /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000403:0x8:0x0 (512198) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000403:0x9:0x0 (512206) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000403:0xa:0x0 (512215) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no Pass 3: Memory used: 820k/0k (79k/742k), time: 0.01/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 192.60MB/s Pass 4: Checking reference counts Inode 512004 ref count is 37, should be 2. Fix? no Inode 512005 ref count is 2, should be 37. Fix? no Pass 4: Memory used: 820k/0k (73k/748k), time: 0.03/ 0.03/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 820k/0k (71k/750k), time: 0.01/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 193.46MB/s lustre-MDT0000: ********** WARNING: Filesystem still has errors ********** 461 inodes used (0.05%, out of 1024000) 7 non-contiguous files (1.5%) 1 non-contiguous directory (0.2%) # of inodes with ind/dind/tind blocks: 2/0/0 284295 blocks used (44.42%, out of 640000) 0 bad blocks 1 large file 233 regular files 208 directories 0 character device files 0 block device files 0 fifos 0 links 10 symbolic links (6 fast symbolic links) 0 sockets ------------ 451 files Memory used: 820k/0k (70k/751k), time: 0.12/ 0.10/ 0.02 I/O read: 2MB, write: 0MB, rate: 16.69MB/s Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg147-server: oleg147-server.virtnet: executing set_default_debug all all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Started lustre-MDT0000 Stopping /mnt/lustre-mds2 (opts:) on oleg147-server e2fsck -d -v -t -t -f -n /dev/mapper/mds2_flakey -m8 oleg147-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg147-server: Use max possible thread num: 2 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 16) [Thread 1] Scan group range [16, 32) [Thread 0] jumping to group 0 [Thread 1] jumping to group 16 [Thread 1] group 17 finished [Thread 1] group 18 finished [Thread 1] group 19 finished [Thread 1] group 20 finished [Thread 1] group 21 finished [Thread 1] group 22 finished [Thread 1] group 23 finished [Thread 1] group 24 finished [Thread 1] group 25 finished [Thread 1] group 26 finished [Thread 1] group 27 finished [Thread 1] group 28 finished [Thread 1] group 29 finished [Thread 1] group 30 finished [Thread 1] group 31 finished [Thread 1] group 32 finished [Thread 1] Pass 1: Memory used: 672k/0k (428k/245k), time: 0.00/ 0.00/ 0.00 [Thread 1] Pass 1: I/O read: 1MB, write: 0MB, rate: 981.35MB/s [Thread 1] Scanned group range [16, 32), inodes 203 [Thread 0] e2fsck_pass1_run:2564: increase inode 78 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 79 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 80 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 84 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 108 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 111 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 112 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 124 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 125 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 126 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 127 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 128 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 129 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 130 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 133 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 134 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 144 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 32001 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32002 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32003 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32004 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] Pass 1: Memory used: 752k/0k (423k/330k), time: 0.01/ 0.01/ 0.00 [Thread 0] Pass 1: I/O read: 3MB, write: 0MB, rate: 320.31MB/s [Thread 0] Scanned group range [0, 16), inodes 730 Pass 2: Checking directory structure Pass 2: Memory used: 752k/0k (83k/670k), time: 0.01/ 0.00/ 0.00 Pass 2: I/O read: 2MB, write: 0MB, rate: 385.51MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 752k/0k (83k/670k), time: 0.05/ 0.04/ 0.01 '..' in /REMOTE_PARENT_DIR/0x240000401:0x7:0x0 (32006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x10:0x0 (32007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x11:0x0 (32009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2f:0x0 (32010) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x12:0x0 (64002) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x8:0x0 (64004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x9:0x0 (64005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x14:0x0 (64006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x15:0x0 (64008) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0xa:0x0 (96001) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x17:0x0 (96002) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0xb:0x0 (96004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x19:0x0 (96005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0xc:0x0 (96007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x1b:0x0 (96008) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x31:0x0 (96010) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x1d:0x0 (128001) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x1e:0x0 (128003) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x20:0x0 (128005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x21:0x0 (128007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x22:0x0 (128009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x26:0x0 (160002) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x29:0x0 (160004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2a:0x0 (160006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2c:0x0 (160007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2d:0x0 (160009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x7:0x0 (512106) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x8:0x0 (512109) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x5:0x0 (512112) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x6:0x0 (512114) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0xa:0x0 (512116) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0xb:0x0 (512117) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0xc:0x0 (512120) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x332:0x0 (512141) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x333:0x0 (512144) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x33f:0x0 (512162) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x347:0x0 (512174) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x34b:0x0 (512180) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x34f:0x0 (512186) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no Pass 3: Memory used: 752k/0k (80k/673k), time: 0.01/ 0.00/ 0.01 Pass 3: I/O read: 1MB, write: 0MB, rate: 96.80MB/s Pass 4: Checking reference counts Inode 512004 ref count is 41, should be 2. Fix? no Inpdsh@oleg147-client: oleg147-server: ssh exited with exit code 4 ode 512005 ref count is 2, should be 41. Fix? no Pass 4: Memory used: 752k/0k (73k/680k), time: 0.02/ 0.02/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 752k/0k (72k/681k), time: 0.01/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 124.08MB/s lustre-MDT0001: ********** WARNING: Filesystem still has errors ********** 417 inodes used (0.04%, out of 1024000) 4 non-contiguous files (1.0%) 1 non-contiguous directory (0.2%) # of inodes with ind/dind/tind blocks: 2/0/0 284283 blocks used (44.42%, out of 640000) 0 bad blocks 1 large file 175 regular files 224 directories 0 character device files 0 block device files 0 fifos 0 links 8 symbolic links (3 fast symbolic links) 0 sockets ------------ 407 files Memory used: 752k/0k (70k/683k), time: 0.09/ 0.07/ 0.02 I/O read: 2MB, write: 0MB, rate: 22.05MB/s Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg147-server: oleg147-server.virtnet: executing set_default_debug all all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Started lustre-MDT0001 Stopping /mnt/lustre-mds1 (opts:) on oleg147-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg147-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg147-server: Use max possible thread num: 2 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 16) [Thread 1] Scan group range [16, 32) [Thread 1] jumping to group 16 [Thread 0] jumping to group 0 [Thread 1] e2fsck_pass1_run:2564: increase inode 512040 badness 0 to 2 for 10084 [Thread 1] group 17 finished [Thread 1] group 18 finished [Thread 1] group 19 finished [Thread 1] group 20 finished [Thread 1] group 21 finished [Thread 1] group 22 finished [Thread 1] group 23 finished [Thread 1] group 24 finished [Thread 1] group 25 finished [Thread 1] group 26 finished [Thread 1] group 27 finished [Thread 1] group 28 finished [Thread 1] group 29 finished [Thread 1] group 30 finished [Thread 1] group 31 finished [Thread 1] group 32 finished [Thread 1] Pass 1: Memory used: 740k/0k (506k/235k), time: 0.00/ 0.00/ 0.00 [Thread 1] Pass 1: I/O read: 1MB, write: 0MB, rate: 455.58MB/s [Thread 1] Scanned group range [16, 32), inodes 224 [Thread 0] e2fsck_pass1_run:2564: increase inode 78 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 79 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 80 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 86 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 87 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 108 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 124 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 125 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 126 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 127 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 128 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 129 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 130 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 133 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 134 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 141 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 145 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 154 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 155 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 156 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 32001 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32002 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32003 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32004 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32005 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32007 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32008 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 64001 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 64002 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 64003 badness 0 to 2 for 10084 [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] Pass 1: Memory used: 816k/0k (499k/318k), time: 0.01/ 0.01/ 0.00 [Thread 0] Pass 1: I/O read: 3MB, write: 0MB, rate: 277.32MB/s [Thread 0] Scanned group range [0, 16), inodes 730 Pass 2: Checking directory structure Pass 2: Memory used: 816k/0k (79k/737k), time: 0.00/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 208.03MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 816k/0k (80k/737k), time: 0.05/ 0.04/ 0.01 '..' in /REMOTE_PARENT_DIR/0x200000401:0xb:0x0 (32009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1a:0x0 (32011) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xc:0x0 (64005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xd:0x0 (64006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xe:0x0 (64007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x11:0x0 (64009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1b:0x0 (64011) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x12:0x0 (96001) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x13:0x0 (96003) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x14:0x0 (96004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x15:0x0 (96005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x16:0x0 (96006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x17:0x0 (96007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x18:0x0 (96008) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1c:0x0 (96009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1d:0x0 (96010) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1e:0x0 (96011) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x8:0x0 (512107) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x9:0x0 (512109) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000402:0xf:0x0 (512114) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xa:0x0 (512119) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xf:0x0 (512133) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x10:0x0 (512135) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x19:0x0 (512151) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000403:0x1:0x0 (512162) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no Pass 3: Memory used: 816k/0k (77k/740k), time: 0.01/ 0.00/ 0.01 Pass 3: I/O read: 1MB, write: 0MB, rate: 162.71MB/s Pass 4: Checking reference counts Inode 512004 ref count is 27, should be 2. Fix? no Inode 512005 ref count is 2, should be 27. Fix? no Pass 4: Memory used: 816k/0k (72k/745k), time: 0.03/ 0.03/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 816k/0k (71k/746k), time: 0.01/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 165.65MB/s lustre-MDT0000: ********** WARNING: Filesystem still has errors ********** 377 inodes used (0.04%, out of 1024000) 6 non-contiguous files (1.6%) 1 non-contiguous directory (0.3%) # of inodes with ind/dind/tind blocks: 0/0/0 284253 blocks used (44.41%, out of 640000) 0 bad blocks pdsh@oleg147-client: oleg147-server: ssh exited with exit code 4 1 large file 164 regular files 193 directories 0 character device files 0 block device files 0 fifos 0 links 10 symbolic links (6 fast symbolic links) 0 sockets ------------ 367 files Memory used: 816k/0k (70k/747k), time: 0.09/ 0.07/ 0.02 I/O read: 2MB, write: 0MB, rate: 21.22MB/s Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg147-server: oleg147-server.virtnet: executing set_default_debug all all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Started lustre-MDT0000 Stopping /mnt/lustre-mds2 (opts:) on oleg147-server e2fsck -d -v -t -t -f -n /dev/mapper/mds2_flakey -m8 oleg147-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg147-server: Use max possible thread num: 2 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 16) [Thread 1] Scan group range [16, 32) [Thread 1] jumping to group 16 [Thread 0] jumping to group 0 [Thread 1] group 17 finished [Thread 1] group 18 finished [Thread 1] group 19 finished [Thread 1] group 20 finished [Thread 1] group 21 finished [Thread 1] group 22 finished [Thread 1] group 23 finished [Thread 1] group 24 finished [Thread 1] group 25 finished [Thread 1] group 26 finished [Thread 1] group 27 finished [Thread 1] group 28 finished [Thread 1] group 29 finished [Thread 1] group 30 finished [Thread 1] group 31 finished [Thread 1] group 32 finished [Thread 1] Pass 1: Memory used: 672k/0k (425k/248k), time: 0.00/ 0.00/ 0.00 [Thread 1] Pass 1: I/O read: 1MB, write: 0MB, rate: 513.08MB/s [Thread 1] Scanned group range [16, 32), inodes 203 [Thread 0] e2fsck_pass1_run:2564: increase inode 78 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 79 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 80 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 84 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 108 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 111 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 112 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 124 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 125 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 126 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 127 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 128 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 129 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 130 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 133 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 134 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 144 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 32001 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32002 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32003 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32004 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] Pass 1: Memory used: 748k/0k (418k/331k), time: 0.01/ 0.01/ 0.00 [Thread 0] Pass 1: I/O read: 3MB, write: 0MB, rate: 259.72MB/s [Thread 0] Scanned group range [0, 16), inodes 730 Pass 2: Checking directory structure Pass 2: Memory used: 748k/0k (80k/669k), time: 0.00/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 202.68MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 748k/0k (80k/669k), time: 0.05/ 0.04/ 0.01 '..' in /REMOTE_PARENT_DIR/0x240000401:0x7:0x0 (32006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x10:0x0 (32007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x11:0x0 (32009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2f:0x0 (32010) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x12:0x0 (64002) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x8:0x0 (64004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x9:0x0 (64005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x14:0x0 (64006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x15:0x0 (64008) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0xa:0x0 (96001) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x17:0x0 (96002) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0xb:0x0 (96004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x19:0x0 (96005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0xc:0x0 (96007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x1b:0x0 (96008) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x31:0x0 (96010) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x1d:0x0 (128001) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x1e:0x0 (128003) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x20:0x0 (128005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x21:0x0 (128007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x22:0x0 (128009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x26:0x0 (160002) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x29:0x0 (160004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2a:0x0 (160006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2c:0x0 (160007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2d:0x0 (160009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x7:0x0 (512106) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x8:0x0 (512109) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x5:0x0 (512112) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x6:0x0 (512114) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0xa:0x0 (512116) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0xb:0x0 (512117) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0xc:0x0 (512120) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x332:0x0 (512141) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no Pass 3: Memory used: 748k/0k (77k/672k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 201.05MB/s Pass 4: Checking reference counts Inode 512004 ref count is 36, should be 2. Fix? no Inode 512005 ref count is 2, should be 36. Fix? no Pass 4: Memory used: 748k/0k (73k/676k), time: 0.02/ 0.02/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 748k/0k (71k/678k), time: 0.01/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 125.19MB/s lustre-MDT0001: ********** WARNING: Filesystem still has errors ********** 357 inodes used (0.03%, out of 1024000) 3 non-contiguous files (0.8%) 1 non-contiguous directory (0.3%) # of inodes with ind/dind/tind blocks: 0/0/0 284225 blocks used (44.41%, out of 640000) 0 bad blocks 1 large file pdsh@oleg147-client: oleg147-server: ssh exited with exit code 4 145 regular files 194 directories 0 character device files 0 block device files 0 fifos 0 links 8 symbolic links (3 fast symbolic links) 0 sockets ------------ 347 files Memory used: 748k/0k (70k/679k), time: 0.09/ 0.07/ 0.01 I/O read: 2MB, write: 0MB, rate: 22.73MB/s Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg147-server: oleg147-server.virtnet: executing set_default_debug all all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Started lustre-MDT0001 total: 10 open/close in 0.11 seconds: 91.22 ops/second total: 10 open/close in 0.10 seconds: 101.38 ops/second total: 10 open/close in 0.05 seconds: 200.29 ops/second total: 10 open/close in 0.05 seconds: 196.41 ops/second total: 10 open/close in 0.05 seconds: 186.64 ops/second total: 10 open/close in 0.08 seconds: 120.56 ops/second total: 10 open/close in 0.05 seconds: 188.63 ops/second total: 10 open/close in 0.07 seconds: 153.21 ops/second total: 10 open/close in 0.05 seconds: 201.11 ops/second total: 10 open/close in 0.05 seconds: 191.93 ops/second Stopping /mnt/lustre-mds1 (opts:) on oleg147-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg147-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg147-server: Use max possible thread num: 2 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 16) [Thread 1] Scan group range [16, 32) [Thread 1] jumping to group 16 [Thread 0] jumping to group 0 [Thread 1] e2fsck_pass1_run:2564: increase inode 512040 badness 0 to 2 for 10084 [Thread 1] group 17 finished [Thread 1] group 18 finished [Thread 1] group 19 finished [Thread 1] group 20 finished [Thread 1] group 21 finished [Thread 1] group 22 finished [Thread 1] group 23 finished [Thread 1] group 24 finished [Thread 1] group 25 finished [Thread 1] group 26 finished [Thread 1] group 27 finished [Thread 1] group 28 finished [Thread 1] group 29 finished [Thread 1] group 30 finished [Thread 1] group 31 finished [Thread 1] group 32 finished [Thread 1] Pass 1: Memory used: 740k/0k (506k/235k), time: 0.00/ 0.00/ 0.00 [Thread 1] Pass 1: I/O read: 1MB, write: 0MB, rate: 518.67MB/s [Thread 1] Scanned group range [16, 32), inodes 224 [Thread 0] e2fsck_pass1_run:2564: increase inode 78 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 79 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 80 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 86 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 87 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 108 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 124 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 125 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 126 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 127 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 128 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 129 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 130 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 133 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 134 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 141 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 145 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 154 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 155 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 156 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 32001 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32002 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32003 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32004 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32005 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32007 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32008 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 64001 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 64002 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 64003 badness 0 to 2 for 10084 [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] Pass 1: Memory used: 816k/0k (500k/317k), time: 0.01/ 0.01/ 0.00 [Thread 0] Pass 1: I/O read: 3MB, write: 0MB, rate: 370.74MB/s [Thread 0] Scanned group range [0, 16), inodes 730 Pass 2: Checking directory structure Pass 2: Memory used: 816k/0k (80k/737k), time: 0.01/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 156.89MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 816k/0k (80k/737k), time: 0.06/ 0.04/ 0.01 '..' in /REMOTE_PARENT_DIR/0x200000401:0xb:0x0 (32009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1a:0x0 (32011) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xc:0x0 (64005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xd:0x0 (64006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xe:0x0 (64007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x11:0x0 (64009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1b:0x0 (64011) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x12:0x0 (96001) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x13:0x0 (96003) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x14:0x0 (96004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x15:0x0 (96005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x16:0x0 (96006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x17:0x0 (96007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x18:0x0 (96008) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1c:0x0 (96009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1d:0x0 (96010) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1e:0x0 (96011) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x8:0x0 (512107) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x9:0x0 (512109) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000402:0xf:0x0 (512114) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xa:0x0 (512119) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xf:0x0 (512133) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x10:0x0 (512135) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x19:0x0 (512151) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000403:0x1:0x0 (512162) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no Pass 3: Memory used: 816k/0k (77k/740k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 381.10MB/s Pass 4: Checking reference counts Inode 512004 ref count is 27, should be 2. Fix? no Inode 512005 ref count is 2, should be 27. Fix? no Pass 4: Memory used: 816k/0k (72k/745k), time: 0.02/ 0.02/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 816k/0k (71k/746k), time: 0.01/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 188.57MB/s lustre-MDT0000: ********** WARNING: Filesystem still has errors ********** 381 inodes used (0.04%, out of 1024000) 7 non-contiguous files (1.8%) 1 non-contiguous directory (0.3%) # of inodes with ind/dind/tind blocks: 1/0/0 284277 blocks used (44.42%, out of 640000) 0 bad blocks pdsh@oleg147-client: oleg147-server: ssh exited with exit code 4 1 large file 163 regular files 198 directories 0 character device files 0 block device files 0 fifos 0 links 10 symbolic links (6 fast symbolic links) 0 sockets ------------ 371 files Memory used: 816k/0k (70k/747k), time: 0.09/ 0.07/ 0.01 I/O read: 2MB, write: 0MB, rate: 22.68MB/s Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg147-server: oleg147-server.virtnet: executing set_default_debug all all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Started lustre-MDT0000 Stopping /mnt/lustre-mds2 (opts:) on oleg147-server e2fsck -d -v -t -t -f -n /dev/mapper/mds2_flakey -m8 oleg147-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg147-server: Use max possible thread num: 2 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 16) [Thread 1] Scan group range [16, 32) [Thread 0] jumping to group 0 [Thread 1] jumping to group 16 [Thread 1] group 17 finished [Thread 1] group 18 finished [Thread 1] group 19 finished [Thread 1] group 20 finished [Thread 1] group 21 finished [Thread 1] group 22 finished [Thread 1] group 23 finished [Thread 1] group 24 finished [Thread 1] group 25 finished [Thread 1] group 26 finished [Thread 1] group 27 finished [Thread 1] group 28 finished [Thread 1] group 29 finished [Thread 1] group 30 finished [Thread 1] group 31 finished [Thread 1] group 32 finished [Thread 1] Pass 1: Memory used: 672k/0k (427k/246k), time: 0.00/ 0.00/ 0.00 [Thread 1] Pass 1: I/O read: 1MB, write: 0MB, rate: 819.00MB/s [Thread 1] Scanned group range [16, 32), inodes 204 [Thread 0] e2fsck_pass1_run:2564: increase inode 78 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 79 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 80 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 84 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 108 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 111 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 112 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 124 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 125 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 126 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 127 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 128 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 129 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 130 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 133 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 134 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 144 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 32001 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32002 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32003 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32004 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] Pass 1: Memory used: 752k/0k (421k/332k), time: 0.01/ 0.01/ 0.01 [Thread 0] Pass 1: I/O read: 3MB, write: 0MB, rate: 259.79MB/s [Thread 0] Scanned group range [0, 16), inodes 734 Pass 2: Checking directory structure Pass 2: Memory used: 752k/0k (82k/671k), time: 0.01/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 141.44MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 752k/0k (82k/671k), time: 0.09/ 0.06/ 0.02 '..' in /REMOTE_PARENT_DIR/0x240000401:0x7:0x0 (32006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x10:0x0 (32007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x11:0x0 (32009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2f:0x0 (32010) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x3b3:0x0 (32011) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x3be:0x0 (32013) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x12:0x0 (64002) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x8:0x0 (64004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x9:0x0 (64005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x14:0x0 (64006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x15:0x0 (64008) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0xa:0x0 (96001) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x17:0x0 (96002) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0xb:0x0 (96004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x19:0x0 (96005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0xc:0x0 (96007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x1b:0x0 (96008) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x31:0x0 (96010) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x1d:0x0 (128001) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x1e:0x0 (128003) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x20:0x0 (128005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x21:0x0 (128007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x22:0x0 (128009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x26:0x0 (160002) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x29:0x0 (160004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2a:0x0 (160006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2c:0x0 (160007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2d:0x0 (160009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x7:0x0 (512106) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x8:0x0 (512109) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x5:0x0 (512112) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x6:0x0 (512114) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0xa:0x0 (512116) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0xb:0x0 (512117) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0xc:0x0 (512120) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x332:0x0 (512141) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x35b:0x0 (512144) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x392:0x0 (512168) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x3c9:0x0 (512181) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no Pass 3: Memory used: 752k/0k (79k/674k), time: 0.02/ 0.00/ 0.01 Pass 3: I/O read: 1MB, write: 0MB, rate: 66.53MB/s Pass 4: Checking reference counts Inode 512004 ref count is 41, should be 2. Fix? no Inodpdsh@oleg147-client: oleg147-server: ssh exited with exit code 4 e 512005 ref count is 2, should be 41. Fix? no Pass 4: Memory used: 752k/0k (73k/680k), time: 0.03/ 0.03/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 752k/0k (72k/681k), time: 0.01/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 126.41MB/s lustre-MDT0001: ********** WARNING: Filesystem still has errors ********** 471 inodes used (0.05%, out of 1024000) 3 non-contiguous files (0.6%) 1 non-contiguous directory (0.2%) # of inodes with ind/dind/tind blocks: 1/0/0 284251 blocks used (44.41%, out of 640000) 0 bad blocks 1 large file 244 regular files 209 directories 0 character device files 0 block device files 0 fifos 0 links 8 symbolic links (3 fast symbolic links) 0 sockets ------------ 461 files Memory used: 752k/0k (70k/682k), time: 0.14/ 0.10/ 0.03 I/O read: 2MB, write: 0MB, rate: 14.27MB/s Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg147-server: oleg147-server.virtnet: executing set_default_debug all all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Started lustre-MDT0001 Stopping /mnt/lustre-mds1 (opts:) on oleg147-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg147-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg147-server: Use max possible thread num: 2 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 16) [Thread 1] Scan group range [16, 32) [Thread 0] jumping to group 0 [Thread 1] jumping to group 16 [Thread 1] e2fsck_pass1_run:2564: increase inode 512040 badness 0 to 2 for 10084 [Thread 1] group 17 finished [Thread 1] group 18 finished [Thread 1] group 19 finished [Thread 1] group 20 finished [Thread 1] group 21 finished [Thread 1] group 22 finished [Thread 1] group 23 finished [Thread 1] group 24 finished [Thread 1] group 25 finished [Thread 1] group 26 finished [Thread 1] group 27 finished [Thread 1] group 28 finished [Thread 1] group 29 finished [Thread 1] group 30 finished [Thread 1] group 31 finished [Thread 1] group 32 finished [Thread 1] Pass 1: Memory used: 740k/0k (506k/235k), time: 0.00/ 0.00/ 0.00 [Thread 1] Pass 1: I/O read: 1MB, write: 0MB, rate: 473.48MB/s [Thread 1] Scanned group range [16, 32), inodes 224 [Thread 0] e2fsck_pass1_run:2564: increase inode 78 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 79 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 80 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 86 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 87 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 108 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 124 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 125 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 126 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 127 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 128 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 129 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 130 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 133 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 134 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 141 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 145 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 154 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 155 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 156 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 32001 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32002 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32003 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32004 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32005 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32007 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32008 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 64001 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 64002 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 64003 badness 0 to 2 for 10084 [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] Pass 1: Memory used: 816k/0k (500k/317k), time: 0.01/ 0.01/ 0.00 [Thread 0] Pass 1: I/O read: 3MB, write: 0MB, rate: 370.23MB/s [Thread 0] Scanned group range [0, 16), inodes 730 Pass 2: Checking directory structure Pass 2: Memory used: 816k/0k (80k/737k), time: 0.00/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 223.46MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 816k/0k (80k/737k), time: 0.05/ 0.04/ 0.01 '..' in /REMOTE_PARENT_DIR/0x200000401:0xb:0x0 (32009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1a:0x0 (32011) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xc:0x0 (64005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xd:0x0 (64006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xe:0x0 (64007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x11:0x0 (64009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1b:0x0 (64011) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x12:0x0 (96001) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x13:0x0 (96003) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x14:0x0 (96004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x15:0x0 (96005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x16:0x0 (96006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x17:0x0 (96007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x18:0x0 (96008) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1c:0x0 (96009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1d:0x0 (96010) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x1e:0x0 (96011) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x8:0x0 (512107) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x9:0x0 (512109) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000402:0xf:0x0 (512114) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xa:0x0 (512119) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0xf:0x0 (512133) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x10:0x0 (512135) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000401:0x19:0x0 (512151) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x200000403:0x1:0x0 (512162) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no Pass 3: Memory used: 816k/0k (77k/740k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 281.45MB/s Pass 4: Checking reference counts Inode 512004 ref count is 27, should be 2. Fix? no Inode 512005 ref count is 2, should be 27. Fix? no Pass 4: Memory used: 816k/0k (72k/745k), time: 0.02/ 0.02/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 816k/0k (71k/746k), time: 0.01/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 172.00MB/s lustre-MDT0000: ********** WARNING: Filesystem still has errors ********** 376 inodes used (0.04%, out of 1024000) 6 non-contiguous files (1.6%) 1 non-contiguous directory (0.3%) # of inodes with ind/dind/tind blocks: 1/0/0 284270 blocks used (44.42%, out of 640000) 0 bad blocks pdsh@oleg147-client: oleg147-server: ssh exited with exit code 4 1 large file 163 regular files 193 directories 0 character device files 0 block device files 0 fifos 0 links 10 symbolic links (6 fast symbolic links) 0 sockets ------------ 366 files Memory used: 816k/0k (70k/747k), time: 0.08/ 0.07/ 0.01 I/O read: 2MB, write: 0MB, rate: 24.90MB/s Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg147-server: oleg147-server.virtnet: executing set_default_debug all all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Started lustre-MDT0000 Stopping /mnt/lustre-mds2 (opts:) on oleg147-server e2fsck -d -v -t -t -f -n /dev/mapper/mds2_flakey -m8 oleg147-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg147-server: Use max possible thread num: 2 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 16) [Thread 1] Scan group range [16, 32) [Thread 1] jumping to group 16 [Thread 0] jumping to group 0 [Thread 1] group 17 finished [Thread 1] group 18 finished [Thread 1] group 19 finished [Thread 1] group 20 finished [Thread 1] group 21 finished [Thread 1] group 22 finished [Thread 1] group 23 finished [Thread 1] group 24 finished [Thread 1] group 25 finished [Thread 1] group 26 finished [Thread 1] group 27 finished [Thread 1] group 28 finished [Thread 1] group 29 finished [Thread 1] group 30 finished [Thread 1] group 31 finished [Thread 1] group 32 finished [Thread 1] Pass 1: Memory used: 672k/0k (425k/248k), time: 0.00/ 0.00/ 0.01 [Thread 1] Pass 1: I/O read: 1MB, write: 0MB, rate: 217.68MB/s [Thread 1] Scanned group range [16, 32), inodes 204 [Thread 0] e2fsck_pass1_run:2564: increase inode 78 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 79 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 80 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 84 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 108 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 111 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 112 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 124 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 125 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 126 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 127 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 128 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 129 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 130 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 133 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 134 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 144 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 32001 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32002 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32003 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 32004 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] Pass 1: Memory used: 748k/0k (418k/330k), time: 0.02/ 0.01/ 0.01 [Thread 0] Pass 1: I/O read: 3MB, write: 0MB, rate: 190.28MB/s [Thread 0] Scanned group range [0, 16), inodes 734 Pass 2: Checking directory structure Pass 2: Memory used: 748k/0k (80k/669k), time: 0.01/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 127.34MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 748k/0k (80k/669k), time: 0.09/ 0.06/ 0.03 '..' in /REMOTE_PARENT_DIR/0x240000401:0x7:0x0 (32006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x10:0x0 (32007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x11:0x0 (32009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2f:0x0 (32010) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x12:0x0 (64002) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x8:0x0 (64004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x9:0x0 (64005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x14:0x0 (64006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x15:0x0 (64008) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0xa:0x0 (96001) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x17:0x0 (96002) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0xb:0x0 (96004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x19:0x0 (96005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0xc:0x0 (96007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x1b:0x0 (96008) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x31:0x0 (96010) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x1d:0x0 (128001) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x1e:0x0 (128003) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x20:0x0 (128005) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x21:0x0 (128007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x22:0x0 (128009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x26:0x0 (160002) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x29:0x0 (160004) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2a:0x0 (160006) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2c:0x0 (160007) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x2d:0x0 (160009) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x7:0x0 (512106) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x8:0x0 (512109) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x5:0x0 (512112) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000401:0x6:0x0 (512114) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0xa:0x0 (512116) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0xb:0x0 (512117) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0xc:0x0 (512120) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no '..' in /REMOTE_PARENT_DIR/0x240000402:0x332:0x0 (512141) is /REMOTE_PARENT_DIR2 (512005), should be /REMOTE_PARENT_DIR (512004). Fix? no Pass 3: Memory used: 748k/0k (77k/672k), time: 0.01/ 0.00/ 0.01 Pass 3: I/O read: 1MB, write: 0MB, rate: 93.91MB/s Pass 4: Checking reference counts Inode 512004 ref count is 36, should be 2. Fix? no Inode 512005 ref count is 2, should be 36. Fix? no Pass 4: Memory used: 748k/0k (73k/676k), time: 0.03/ 0.03/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 748k/0k (72k/677k), time: 0.01/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 132.87MB/s lustre-MDT0001: ********** WARNING: Filesystem still has errors ********** 359 inodes used (0.04%, out of 1024000) 3 non-contiguous files (0.8%) 1 non-contiguous directory (0.3%) # of inodes with ind/dind/tind blocks: 1/0/0 284251 blocks used (44.41%, out of 640000) 0 bad blocks 1 large file pdsh@oleg147-client: oleg147-server: ssh exited with exit code 4 147 regular files 194 directories 0 character device files 0 block device files 0 fifos 0 links 8 symbolic links (3 fast symbolic links) 0 sockets ------------ 349 files Memory used: 748k/0k (70k/679k), time: 0.14/ 0.09/ 0.04 I/O read: 2MB, write: 0MB, rate: 14.70MB/s Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg147-server: oleg147-server.virtnet: executing set_default_debug all all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Started lustre-MDT0001