== conf-sanity-1 test 78: run resize2fs on MDT and OST filesystems ========================================================== 05:14:37 (1734257677) Stopping clients: oleg121-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg121-client.virtnet /mnt/lustre2 (opts:-f) oleg121-server: oleg121-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory loading modules on: 'oleg121-server' oleg121-server: oleg121-server.virtnet: executing load_modules_local oleg121-server: Loading modules from /home/green/git/lustre-release/lustre oleg121-server: detected 4 online CPUs by sysfs oleg121-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey start mds service on oleg121-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg121-server: oleg121-server.virtnet: executing set_default_debug -1 all pdsh@oleg121-client: oleg121-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 oleg121-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg121-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg121-server: oleg121-server.virtnet: executing set_default_debug -1 all pdsh@oleg121-client: oleg121-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg121-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg121-client.virtnet: -o user_xattr,flock 192.168.201.121@tcp:/lustre /mnt/lustre create test files UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 83240 1616 73832 3% /mnt/lustre[MDT:0] lustre-OST0000_UUID 124712 1388 110724 2% /mnt/lustre[OST:0] filesystem_summary: 124712 1388 110724 2% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 72000 272 71728 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 45008 302 44706 1% /mnt/lustre[OST:0] filesystem_summary: 44978 272 44706 1% /mnt/lustre 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0522189 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0485533 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0465567 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0424505 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0506197 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0431393 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.052386 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103864 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0677813 s, 15.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0549236 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0432966 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0535983 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.044188 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0520189 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0480765 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0426469 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0463192 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0459965 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.052657 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0511802 s, 20.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0464025 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0430265 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0472267 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0437885 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0420868 s, 24.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0424374 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0495471 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0469177 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0518944 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0504474 s, 20.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0402096 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0544586 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0539161 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0454297 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0631124 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0600278 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0589304 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.051754 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0468936 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0446183 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0470137 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0493152 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0432697 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0469308 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0553103 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0502168 s, 20.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0476689 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0525425 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0492129 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0618869 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0508238 s, 20.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0596894 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0432795 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0477697 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0472605 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.053969 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0454772 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0516922 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0704405 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0587144 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106648 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0523931 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0540568 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0525083 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0439649 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0569366 s, 18.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.052761 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0446554 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0526185 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.049013 s, 21.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0474671 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0554405 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0466036 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0477694 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.046088 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0528506 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0529248 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0464542 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0440837 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0603516 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0895018 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0537685 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0455916 s, 23.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0513019 s, 20.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0533898 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0991739 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.154189 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0610566 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0485199 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0490049 s, 21.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0553104 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0600552 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0449924 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0457143 s, 22.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0449175 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0500118 s, 21.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0495092 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.453711 s, 2.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0544421 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0833976 s, 12.6 MB/s umount lustre on /mnt/lustre..... Stopping client oleg121-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg121-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg121-server stop mds service on oleg121-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg121-server unloading modules via unload_modules_local on: 'oleg121-server' oleg121-server: oleg121-server.virtnet: executing unload_modules_local modules unloaded. e2fsck -d -v -t -t -f -y /dev/mapper/mds1_flakey -m8 oleg121-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg121-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 3) [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 84 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 86 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 87 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 108 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 111 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 112 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 124 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 125 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 126 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 127 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 128 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 129 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 130 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 133 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 134 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 141 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 145 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 151 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 152 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 154 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 155 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 156 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 157 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 158 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 159 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 160 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 24054 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24055 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24056 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24058 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24059 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 48009 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 48050 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 48051 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 48052 badness 0 to 2 for 10084 [Thread 0] group 3 finished [Thread 0] Pass 1: Memory used: 272k/0k (141k/132k), time: 0.01/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 186.43MB/s [Thread 0] Scanned group range [0, 3), inodes 373 Pass 2: Checking directory structure Pass 2: Memory used: 272k/0k (95k/178k), time: 0.01/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 135.46MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 272k/0k (95k/178k), time: 0.02/ 0.01/ 0.00 Pass 3A: Memory used: 272k/0k (95k/178k), time: 0.00/ 0.00/ 0.00 Pass 3A: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 3: Memory used: 272k/0k (93k/180k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 4608.30MB/s Pass 4: Checking reference counts Pass 4: Memory used: 272k/0k (67k/206k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 272k/0k (67k/206k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 366.03MB/s 372 inodes used (0.52%, out of 72000) 4 non-contiguous files (1.1%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 22546 blocks used (50.10%, out of 45000) 0 bad blocks 1 large file 244 regular files 118 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 362 files Memory used: 272k/0k (66k/207k), time: 0.04/ 0.01/ 0.01 I/O read: 1MB, write: 1MB, rate: 28.26MB/s e2fsck -d -v -t -t -f -y /dev/mapper/ost1_flakey -m8 oleg121-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg121-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 2) [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 161 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] group 2 finished [Thread 0] Pass 1: Memory used: 264k/0k (132k/133k), time: 0.01/ 0.00/ 0.01 [Thread 0] Pass 1: I/O read: 5MB, write: 0MB, rate: 354.64MB/s [Thread 0] Scanned group range [0, 2), inodes 398 Pass 2: Checking directory structure Pass 2: Memory used: 264k/0k (87k/178k), time: 0.01/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 196.54MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 264k/0k (92k/173k), time: 0.03/ 0.01/ 0.01 Pass 3A: Memory used: 264k/0k (92k/173k), time: 0.00/ 0.00/ 0.00 Pass 3A: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 3: Memory used: 264k/0k (84k/181k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 2840.91MB/s Pass 4: Checking reference counts Pass 4: Memory used: 264k/0k (65k/200k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 264k/0k (64k/201k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 221.48MB/s 398 inodes used (0.88%, out of 45008) 3 non-contiguous files (0.8%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 Extent depth histogram: 392 37721 blocks used (83.82%, out of 45000) 0 bad blocks 1 large file 216 regular files 172 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 388 files Memory used: 264k/0k (64k/201k), time: 0.04/ 0.01/ 0.02 I/O read: 2MB, write: 1MB, rate: 46.96MB/s oleg121-server: resize2fs 1.46.2.wc5 (26-Mar-2022) Resizing the filesystem on /dev/mapper/mds1_flakey to 640000 (4k) blocks. The filesystem on /dev/mapper/mds1_flakey is now 640000 (4k) blocks long. oleg121-server: resize2fs 1.46.2.wc5 (26-Mar-2022) Resizing the filesystem on /dev/mapper/ost1_flakey to 1048576 (4k) blocks. The filesystem on /dev/mapper/ost1_flakey is now 1048576 (4k) blocks long. e2fsck -d -v -t -t -f -y /dev/mapper/mds1_flakey -m8 oleg121-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg121-server: Use max possible thread num: 2 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 16) [Thread 1] Scan group range [16, 33) [Thread 0] jumping to group 0 [Thread 1] jumping to group 16 [Thread 1] group 17 finished [Thread 1] group 18 finished [Thread 1] group 19 finished [Thread 1] group 20 finished [Thread 1] group 21 finished [Thread 1] group 22 finished [Thread 1] group 23 finished [Thread 1] group 24 finished [Thread 1] group 25 finished [Thread 1] group 26 finished [Thread 1] group 27 finished [Thread 1] group 28 finished [Thread 1] group 29 finished [Thread 1] group 30 finished [Thread 1] group 31 finished [Thread 1] group 32 finished [Thread 1] group 33 finished [Thread 1] Pass 1: Memory used: 632k/0k (381k/252k), time: 0.00/ 0.00/ 0.00 [Thread 1] Pass 1: I/O read: 1MB, write: 0MB, rate: 3086.42MB/s [Thread 1] Scanned group range [16, 33), inodes 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 84 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 86 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 87 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 108 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 111 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 112 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 124 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 125 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 126 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 127 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 128 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 129 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 130 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 133 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 134 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 141 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 145 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 151 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 152 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 154 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 155 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 156 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 157 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 158 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 159 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 160 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 24054 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24055 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24056 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24058 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24059 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 48009 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 48050 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 48051 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 48052 badness 0 to 2 for 10084 [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] Pass 1: Memory used: 688k/0k (355k/334k), time: 0.01/ 0.01/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 111.77MB/s [Thread 0] Scanned group range [0, 16), inodes 373 Pass 2: Checking directory structure Pass 2: Memory used: 632k/0k (200k/433k), time: 0.01/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 132.94MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 632k/0k (200k/433k), time: 0.06/ 0.04/ 0.00 Pass 3A: Memory used: 632k/0k (200k/433k), time: 0.00/ 0.00/ 0.00 Pass 3A: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 3: Memory used: 632k/0k (198k/435k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 6329.11MB/s Pass 4: Checking reference counts Pass 4: Memory used: 632k/0k (72k/561k), time: 0.03/ 0.02/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 632k/0k (70k/563k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 230.04MB/s 372 inodes used (0.05%, out of 792000) 4 non-contiguous files (1.1%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 202726 blocks used (31.68%, out of 640000) 0 bad blocks 1 large file 244 regular files 118 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 362 files Memory used: 632k/0k (69k/564k), time: 0.10/ 0.07/ 0.00 I/O read: 1MB, write: 1MB, rate: 10.21MB/s e2fsck -d -v -t -t -f -y /dev/mapper/ost1_flakey -m8 oleg121-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg121-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 32) [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 161 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] group 17 finished [Thread 0] group 18 finished [Thread 0] group 19 finished [Thread 0] group 20 finished [Thread 0] group 21 finished [Thread 0] group 22 finished [Thread 0] group 23 finished [Thread 0] group 24 finished [Thread 0] group 25 finished [Thread 0] group 26 finished [Thread 0] group 27 finished [Thread 0] group 28 finished [Thread 0] group 29 finished [Thread 0] group 30 finished [Thread 0] group 31 finished [Thread 0] group 32 finished [Thread 0] Pass 1: Memory used: 472k/0k (344k/129k), time: 0.02/ 0.01/ 0.01 [Thread 0] Pass 1: I/O read: 5MB, write: 0MB, rate: 298.78MB/s [Thread 0] Scanned group range [0, 32), inodes 398 Pass 2: Checking directory structure Pass 2: Memory used: 684k/0k (299k/386k), time: 0.01/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 146.69MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 684k/0k (299k/386k), time: 0.05/ 0.02/ 0.01 Pass 3A: Memory used: 684k/0k (299k/386k), time: 0.00/ 0.00/ 0.00 Pass 3A: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 3: Memory used: 684k/0k (296k/389k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 7633.59MB/s Pass 4: Checking reference counts Pass 4: Memory used: 568k/0k (66k/503k), time: 0.02/ 0.02/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 568k/0k (65k/504k), time: 0.01/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 74.19MB/s 398 inodes used (0.06%, out of 720128) 3 non-contiguous files (0.8%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 Extent depth histogram: 392 128315 blocks used (12.24%, out of 1048576) 0 bad blocks 1 large file 216 regular files 172 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 388 files Memory used: 568k/0k (64k/505k), time: 0.09/ 0.05/ 0.01 I/O read: 2MB, write: 1MB, rate: 23.44MB/s start mds service on oleg121-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg121-server' oleg121-server: oleg121-server.virtnet: executing load_modules_local oleg121-server: Loading modules from /home/green/git/lustre-release/lustre oleg121-server: detected 4 online CPUs by sysfs oleg121-server: Force libcfs to create 2 CPU partitions oleg121-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg121-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg121-server: oleg121-server.virtnet: executing set_default_debug -1 all pdsh@oleg121-client: oleg121-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg121-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg121-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg121-server: oleg121-server.virtnet: executing set_default_debug -1 all pdsh@oleg121-client: oleg121-server: ssh exited with exit code 1 Started lustre-OST0000 oleg121-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg121-client.virtnet: -o user_xattr,flock 192.168.201.121@tcp:/lustre /mnt/lustre check files after expanding the MDT and OST filesystems /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-1 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-1 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-2 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-2 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-3 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-3 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-4 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-4 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-5 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-5 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-6 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-6 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-7 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-7 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-8 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-8 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-9 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-9 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-10 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-10 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-11 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-11 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-12 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-12 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-13 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-13 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-14 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-14 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-15 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-15 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-16 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-16 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-17 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-17 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-18 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-18 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-19 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-19 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-20 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-20 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-21 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-21 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-22 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-22 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-23 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-23 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-24 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-24 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-25 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-25 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-26 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-26 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-27 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-27 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-28 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-28 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-29 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-29 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-30 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-30 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-31 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-31 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-32 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-32 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-33 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-33 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-34 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-34 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-35 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-35 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-36 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-36 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-37 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-37 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-38 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-38 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-39 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-39 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-40 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-40 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-41 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-41 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-42 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-42 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-43 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-43 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-44 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-44 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-45 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-45 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-46 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-46 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-47 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-47 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-48 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-48 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-49 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-49 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-50 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-50 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-51 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-51 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-52 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-52 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-53 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-53 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-54 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-54 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-55 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-55 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-56 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-56 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-57 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-57 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-58 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-58 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-59 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-59 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-60 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-60 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-61 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-61 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-62 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-62 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-63 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-63 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-64 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-64 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-65 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-65 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-66 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-66 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-67 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-67 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-68 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-68 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-69 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-69 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-70 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-70 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-71 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-71 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-72 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-72 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-73 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-73 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-74 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-74 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-75 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-75 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-76 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-76 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-77 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-77 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-78 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-78 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-79 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-79 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-80 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-80 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-81 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-81 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-82 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-82 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-83 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-83 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-84 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-84 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-85 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-85 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-86 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-86 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-87 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-87 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-88 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-88 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-89 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-89 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-90 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-90 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-91 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-91 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-92 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-92 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-93 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-93 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-94 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-94 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-95 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-95 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-96 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-96 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-97 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-97 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-98 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-98 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-99 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-99 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-100 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-100 has size 1048576 OK create more files after expanding the MDT and OST filesystems 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0574086 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.058257 s, 18.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0516043 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.050695 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0555177 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0520189 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0500307 s, 21.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11825 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0785497 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0678198 s, 15.5 MB/s umount lustre on /mnt/lustre..... Stopping client oleg121-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg121-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg121-server stop mds service on oleg121-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg121-server unloading modules via unload_modules_local on: 'oleg121-server' oleg121-server: oleg121-server.virtnet: executing unload_modules_local modules unloaded. e2fsck -d -v -t -t -f -y /dev/mapper/mds1_flakey -m8 oleg121-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg121-server: Use max possible thread num: 2 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 16) [Thread 1] Scan group range [16, 33) [Thread 0] jumping to group 0 [Thread 1] jumping to group 16 [Thread 1] group 17 finished [Thread 1] group 18 finished [Thread 1] group 19 finished [Thread 1] group 20 finished [Thread 1] group 21 finished [Thread 1] group 22 finished [Thread 1] group 23 finished [Thread 1] group 24 finished [Thread 1] group 25 finished [Thread 1] group 26 finished [Thread 1] group 27 finished [Thread 1] group 28 finished [Thread 1] group 29 finished [Thread 1] group 30 finished [Thread 1] group 31 finished [Thread 1] group 32 finished [Thread 1] group 33 finished [Thread 1] Pass 1: Memory used: 632k/0k (381k/252k), time: 0.00/ 0.00/ 0.00 [Thread 1] Pass 1: I/O read: 1MB, write: 0MB, rate: 3105.59MB/s [Thread 1] Scanned group range [16, 33), inodes 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 84 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 86 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 87 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 108 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 111 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 112 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 124 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 125 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 126 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 127 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 128 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 129 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 130 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 133 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 134 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 141 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 145 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 151 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 152 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 154 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 155 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 156 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 157 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 158 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 159 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 160 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 24054 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24055 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24056 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24058 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24059 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 48009 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 48050 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 48051 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 48052 badness 0 to 2 for 10084 [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] Pass 1: Memory used: 688k/0k (355k/334k), time: 0.01/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 172.50MB/s [Thread 0] Scanned group range [0, 16), inodes 383 Pass 2: Checking directory structure Pass 2: Memory used: 632k/0k (200k/433k), time: 0.00/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 214.27MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 632k/0k (200k/433k), time: 0.05/ 0.04/ 0.00 Pass 3A: Memory used: 632k/0k (200k/433k), time: 0.00/ 0.00/ 0.00 Pass 3A: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 3: Memory used: 632k/0k (198k/435k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 3246.75MB/s Pass 4: Checking reference counts Pass 4: Memory used: 632k/0k (72k/561k), time: 0.02/ 0.02/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 632k/0k (70k/563k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 245.04MB/s 382 inodes used (0.05%, out of 792000) 4 non-contiguous files (1.0%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 202726 blocks used (31.68%, out of 640000) 0 bad blocks 1 large file 254 regular files 118 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 372 files Memory used: 632k/0k (69k/564k), time: 0.08/ 0.06/ 0.00 I/O read: 1MB, write: 1MB, rate: 12.28MB/s e2fsck -d -v -t -t -f -y /dev/mapper/ost1_flakey -m8 oleg121-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg121-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 32) [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 161 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] group 17 finished [Thread 0] group 18 finished [Thread 0] group 19 finished [Thread 0] group 20 finished [Thread 0] group 21 finished [Thread 0] group 22 finished [Thread 0] group 23 finished [Thread 0] group 24 finished [Thread 0] group 25 finished [Thread 0] group 26 finished [Thread 0] group 27 finished [Thread 0] group 28 finished [Thread 0] group 29 finished [Thread 0] group 30 finished [Thread 0] group 31 finished [Thread 0] group 32 finished [Thread 0] Pass 1: Memory used: 472k/0k (345k/128k), time: 0.01/ 0.01/ 0.00 [Thread 0] Pass 1: I/O read: 5MB, write: 0MB, rate: 387.60MB/s [Thread 0] Scanned group range [0, 32), inodes 402 Pass 2: Checking directory structure Pass 2: Memory used: 684k/0k (299k/386k), time: 0.01/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 90.35MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 684k/0k (299k/386k), time: 0.05/ 0.02/ 0.01 Pass 3A: Memory used: 684k/0k (299k/386k), time: 0.00/ 0.00/ 0.00 Pass 3A: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 3: Memory used: 684k/0k (296k/389k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 6944.44MB/s Pass 4: Checking reference counts Pass 4: Memory used: 568k/0k (67k/502k), time: 0.03/ 0.02/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 568k/0k (65k/504k), time: 0.01/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 180.70MB/s 402 inodes used (0.06%, out of 720128) 4 non-contiguous files (1.0%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 Extent depth histogram: 396 130875 blocks used (12.48%, out of 1048576) 0 bad blocks 1 large file 220 regular files 172 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 392 files Memory used: 568k/0k (64k/505k), time: 0.09/ 0.05/ 0.01 I/O read: 2MB, write: 1MB, rate: 22.84MB/s oleg121-server: resize2fs 1.46.2.wc5 (26-Mar-2022) Resizing the filesystem on /dev/mapper/mds1_flakey to 377837 (4k) blocks. The filesystem on /dev/mapper/mds1_flakey is now 377837 (4k) blocks long. oleg121-server: resize2fs 1.46.2.wc5 (26-Mar-2022) Resizing the filesystem on /dev/mapper/ost1_flakey to 591846 (4k) blocks. The filesystem on /dev/mapper/ost1_flakey is now 589824 (4k) blocks long. e2fsck -d -v -t -t -f -y /dev/mapper/mds1_flakey -m8 oleg121-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg121-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 20) [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 84 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 86 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 87 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 107 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 108 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 109 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 110 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 111 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 112 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 113 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 114 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 115 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 116 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 117 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 118 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 119 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 120 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 121 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 122 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 123 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 124 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 125 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 126 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 127 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 128 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 129 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 130 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 132 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 133 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 134 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 136 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 137 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 138 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 139 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 140 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 141 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 142 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 143 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 144 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 145 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 146 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 147 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 148 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 149 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 150 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 151 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 152 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 153 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 154 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 155 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 156 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 157 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 158 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 159 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 160 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 24054 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24055 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24056 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24058 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24059 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 48009 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 48050 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 48051 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 48052 badness 0 to 2 for 10084 [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] group 17 finished [Thread 0] group 18 finished [Thread 0] group 19 finished [Thread 0] group 20 finished [Thread 0] Pass 1: Memory used: 400k/0k (270k/131k), time: 0.01/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 1MB, write: 0MB, rate: 160.46MB/s [Thread 0] Scanned group range [0, 20), inodes 383 Pass 2: Checking directory structure Pass 2: Memory used: 576k/0k (224k/353k), time: 0.01/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 154.37MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 576k/0k (224k/353k), time: 0.04/ 0.02/ 0.00 Pass 3A: Memory used: 576k/0k (224k/353k), time: 0.00/ 0.00/ 0.00 Pass 3A: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 3: Memory used: 576k/0k (222k/355k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 7299.27MB/s Pass 4: Checking reference counts Pass 4: Memory used: 500k/0k (68k/433k), time: 0.02/ 0.01/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 500k/0k (67k/434k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 322.16MB/s 382 inodes used (0.08%, out of 480000) 4 non-contiguous files (1.0%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 124660 blocks used (32.99%, out of 377837) 0 bad blocks 1 large file 254 regular files 118 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 372 files Memory used: 500k/0k (66k/435k), time: 0.06/ 0.04/ 0.00 I/O read: 1MB, write: 1MB, rate: 16.62MB/s e2fsck -d -v -t -t -f -y /dev/mapper/ost1_flakey -m8 oleg121-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg121-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 18) [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 101 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 103 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 104 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 105 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 106 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 131 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 161 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] group 6 finished [Thread 0] group 7 finished [Thread 0] group 8 finished [Thread 0] group 9 finished [Thread 0] group 10 finished [Thread 0] group 11 finished [Thread 0] group 12 finished [Thread 0] group 13 finished [Thread 0] group 14 finished [Thread 0] group 15 finished [Thread 0] group 16 finished [Thread 0] group 17 finished [Thread 0] group 18 finished [Thread 0] Pass 1: Memory used: 372k/0k (246k/127k), time: 0.01/ 0.01/ 0.00 [Thread 0] Pass 1: I/O read: 5MB, write: 0MB, rate: 434.97MB/s [Thread 0] Scanned group range [0, 18), inodes 402 Pass 2: Checking directory structure Pass 2: Memory used: 532k/0k (200k/333k), time: 0.01/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 141.62MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 532k/0k (200k/333k), time: 0.04/ 0.02/ 0.01 Pass 3A: Memory used: 532k/0k (200k/332k), time: 0.00/ 0.00/ 0.00 Pass 3A: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 3: Memory used: 532k/0k (198k/335k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 5464.48MB/s Pass 4: Checking reference counts Pass 4: Memory used: 468k/0k (66k/403k), time: 0.01/ 0.01/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 468k/0k (65k/404k), time: 0.01/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 158.53MB/s 402 inodes used (0.10%, out of 405072) 4 non-contiguous files (1.0%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 Extent depth histogram: 396 89417 blocks used (15.16%, out of 589824) 0 bad blocks 1 large file 220 regular files 172 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 392 files Memory used: 468k/0k (64k/405k), time: 0.06/ 0.03/ 0.01 I/O read: 2MB, write: 1MB, rate: 32.10MB/s start mds service on oleg121-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg121-server' oleg121-server: oleg121-server.virtnet: executing load_modules_local oleg121-server: Loading modules from /home/green/git/lustre-release/lustre oleg121-server: detected 4 online CPUs by sysfs oleg121-server: Force libcfs to create 2 CPU partitions oleg121-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg121-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg121-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg121-server: oleg121-server.virtnet: executing set_default_debug -1 all pdsh@oleg121-client: oleg121-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg121-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg121-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=131072 oleg121-server: oleg121-server.virtnet: executing set_default_debug -1 all pdsh@oleg121-client: oleg121-server: ssh exited with exit code 1 Started lustre-OST0000 oleg121-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg121-client.virtnet: -o user_xattr,flock 192.168.201.121@tcp:/lustre /mnt/lustre check files after shrinking the MDT and OST filesystems /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-1 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-1 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-2 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-2 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-3 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-3 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-4 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-4 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-5 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-5 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-6 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-6 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-7 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-7 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-8 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-8 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-9 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-9 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-10 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-10 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-11 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-11 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-12 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-12 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-13 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-13 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-14 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-14 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-15 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-15 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-16 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-16 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-17 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-17 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-18 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-18 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-19 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-19 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-20 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-20 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-21 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-21 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-22 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-22 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-23 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-23 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-24 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-24 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-25 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-25 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-26 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-26 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-27 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-27 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-28 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-28 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-29 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-29 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-30 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-30 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-31 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-31 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-32 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-32 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-33 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-33 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-34 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-34 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-35 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-35 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-36 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-36 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-37 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-37 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-38 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-38 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-39 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-39 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-40 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-40 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-41 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-41 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-42 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-42 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-43 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-43 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-44 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-44 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-45 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-45 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-46 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-46 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-47 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-47 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-48 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-48 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-49 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-49 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-50 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-50 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-51 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-51 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-52 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-52 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-53 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-53 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-54 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-54 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-55 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-55 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-56 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-56 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-57 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-57 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-58 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-58 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-59 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-59 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-60 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-60 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-61 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-61 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-62 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-62 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-63 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-63 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-64 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-64 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-65 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-65 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-66 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-66 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-67 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-67 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-68 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-68 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-69 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-69 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-70 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-70 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-71 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-71 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-72 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-72 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-73 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-73 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-74 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-74 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-75 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-75 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-76 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-76 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-77 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-77 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-78 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-78 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-79 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-79 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-80 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-80 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-81 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-81 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-82 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-82 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-83 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-83 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-84 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-84 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-85 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-85 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-86 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-86 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-87 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-87 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-88 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-88 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-89 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-89 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-90 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-90 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-91 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-91 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-92 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-92 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-93 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-93 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-94 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-94 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-95 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-95 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-96 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-96 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-97 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-97 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-98 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-98 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-99 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-99 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-100 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-100 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-101 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-101 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-102 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-102 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-103 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-103 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-104 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-104 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-105 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-105 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-106 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-106 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-107 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-107 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-108 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-108 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-109 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-109 has size 1048576 OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-110 has type file OK /mnt/lustre/d78.conf-sanity-1/f78.conf-sanity-1-110 has size 1048576 OK umount lustre on /mnt/lustre..... Stopping client oleg121-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg121-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg121-server stop mds service on oleg121-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg121-server unloading modules via unload_modules_local on: 'oleg121-server' oleg121-server: oleg121-server.virtnet: executing unload_modules_local modules unloaded. Stopping clients: oleg121-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg121-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg121-client: oleg121-server: ssh exited with exit code 2 oleg121-server: oleg121-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg121-server' oleg121-server: oleg121-server.virtnet: executing load_modules_local oleg121-server: Loading modules from /home/green/git/lustre-release/lustre oleg121-server: detected 4 online CPUs by sysfs oleg121-server: Force libcfs to create 2 CPU partitions oleg121-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg121-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg121-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg121-server: oleg121-server.virtnet: executing set_default_debug -1 all pdsh@oleg121-client: oleg121-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 oleg121-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg121-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg121-server: oleg121-server.virtnet: executing set_default_debug -1 all pdsh@oleg121-client: oleg121-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg121-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg121-server: oleg121-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg121-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg121-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg121-server stop mds service on oleg121-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg121-server