== conf-sanity test 69: replace an OST with the same index ========================================================== 12:16:13 (1785773773) start mds service on oleg403-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg403-server' oleg403-server: oleg403-server.virtnet: executing load_modules_local oleg403-server: Loading modules from /home/green/git/lustre-release/lustre oleg403-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg403-server: detected 4 online CPUs by sysfs oleg403-server: MODOPTS_LIBCFS= oleg403-server: Force libcfs to create 2 CPU partitions oleg403-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg403-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg403-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg403-server: oleg403-server.virtnet: executing set_default_debug -1 all pdsh@oleg403-client: oleg403-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg403-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg403-server: oleg403-server.virtnet: executing set_default_debug -1 all pdsh@oleg403-client: oleg403-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg403-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg403-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg403-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg403-server: oleg403-server.virtnet: executing set_default_debug -1 all pdsh@oleg403-client: oleg403-server: ssh exited with exit code 1 Started lustre-OST0000 oleg403-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg403-client.virtnet: -o user_xattr,flock 192.168.204.103@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 49503 inodes available. Want 99872. rc=0 - open/close 510 (time 1785773917.60 total 10.03 last 50.86) - open/close 1186 (time 1785773927.61 total 20.04 last 67.55) - open/close 1961 (time 1785773937.62 total 30.04 last 77.45) - open/close 2654 (time 1785773947.62 total 40.04 last 69.29) - open/close 3216 (time 1785773957.62 total 50.05 last 56.18) - open/close 3777 (time 1785773967.63 total 60.05 last 56.06) - open/close 4270 (time 1785773977.63 total 70.06 last 49.29) - open/close 4757 (time 1785773987.64 total 80.07 last 48.65) - open/close 5321 (time 1785773997.64 total 90.07 last 56.39) - open/close 5821 (time 1785774007.65 total 100.07 last 49.97) - open/close 6266 (time 1785774017.65 total 110.08 last 44.49) - open/close 6785 (time 1785774027.66 total 120.08 last 51.88) - open/close 7308 (time 1785774037.67 total 130.10 last 52.21) - open/close 7826 (time 1785774047.68 total 140.11 last 51.76) - open/close 8257 (time 1785774057.70 total 150.13 last 43.01) - open/close 8656 (time 1785774067.72 total 160.15 last 39.82) - open/close 8995 (time 1785774077.78 total 170.20 last 33.72) - open/close 9463 (time 1785774087.79 total 180.21 last 46.75) - open/close 9875 (time 1785774097.80 total 190.22 last 41.17) total: 10000 open/close in 193.02 seconds: 51.81 ops/second - unlinked 0 (time 1785774106 ; total 0 ; last 0) total: 10000 unlinks in 118 seconds: 84.745766 unlinks/second - open/close 558 (time 1785774241.27 total 10.01 last 55.77) - open/close 1116 (time 1785774251.29 total 20.02 last 55.70) - open/close 1610 (time 1785774261.31 total 30.04 last 49.31) - open/close 1988 (time 1785774271.32 total 40.06 last 37.74) - open/close 2409 (time 1785774281.32 total 50.06 last 42.09) - open/close 2793 (time 1785774291.33 total 60.06 last 38.38) - open/close 3189 (time 1785774301.36 total 70.10 last 39.47) - open/close 3505 (time 1785774311.40 total 80.13 last 31.49) - open/close 3861 (time 1785774321.43 total 90.16 last 35.49) - open/close 4356 (time 1785774331.45 total 100.18 last 49.40) - open/close 4773 (time 1785774341.48 total 110.21 last 41.56) - open/close 5193 (time 1785774351.48 total 120.22 last 41.99) - open/close 5557 (time 1785774361.51 total 130.25 last 36.29) - open/close 6000 (time 1785774371.52 total 140.26 last 44.24) - open/close 6430 (time 1785774381.53 total 150.26 last 42.98) - open/close 6869 (time 1785774391.53 total 160.27 last 43.89) - open/close 7476 (time 1785774401.54 total 170.27 last 60.66) - open/close 8123 (time 1785774411.55 total 180.29 last 64.59) - open/close 8583 (time 1785774421.57 total 190.31 last 45.92) - open/close 9064 (time 1785774431.58 total 200.31 last 48.06) - open/close 9497 (time 1785774441.62 total 210.35 last 43.13) - open/close 9859 (time 1785774451.63 total 220.36 last 36.17) total: 10000 open/close in 224.32 seconds: 44.58 ops/second - unlinked 0 (time 1785774463 ; total 0 ; last 0) total: 10000 unlinks in 100 seconds: 100.000000 unlinks/second - open/close 594 (time 1785774579.07 total 10.01 last 59.36) - open/close 1084 (time 1785774589.08 total 20.01 last 48.96) - open/close 1846 (time 1785774599.10 total 30.04 last 76.04) - open/close 2605 (time 1785774609.10 total 40.04 last 75.88) - open/close 3139 (time 1785774619.10 total 50.04 last 53.38) - open/close 3847 (time 1785774629.12 total 60.05 last 70.71) - open/close 4393 (time 1785774639.12 total 70.06 last 54.56) - open/close 5083 (time 1785774649.14 total 80.07 last 68.92) - open/close 5594 (time 1785774659.15 total 90.09 last 51.04) - open/close 6196 (time 1785774669.16 total 100.10 last 60.11) - open/close 6632 (time 1785774679.18 total 110.12 last 43.50) - open/close 7030 (time 1785774689.19 total 120.13 last 39.77) - open/close 7615 (time 1785774699.20 total 130.13 last 58.48) - open/close 8194 (time 1785774709.20 total 140.13 last 57.90) - open/close 9050 (time 1785774719.20 total 150.14 last 85.57) - open/close 9548 (time 1785774729.21 total 160.15 last 49.73) total: 10000 open/close in 168.13 seconds: 59.48 ops/second - unlinked 0 (time 1785774743 ; total 0 ; last 0) total: 10000 unlinks in 100 seconds: 100.000000 unlinks/second - open/close 590 (time 1785774859.86 total 10.00 last 58.99) - open/close 1171 (time 1785774869.86 total 20.01 last 58.06) - open/close 1814 (time 1785774879.86 total 30.01 last 64.30) - open/close 2569 (time 1785774889.86 total 40.01 last 75.49) - open/close 3239 (time 1785774899.88 total 50.03 last 66.89) - open/close 3904 (time 1785774909.88 total 60.03 last 66.50) - open/close 4811 (time 1785774919.92 total 70.06 last 90.38) - open/close 5297 (time 1785774929.92 total 80.06 last 48.59) - open/close 5819 (time 1785774939.93 total 90.08 last 52.14) - open/close 6341 (time 1785774949.95 total 100.09 last 52.11) - open/close 6767 (time 1785774959.97 total 110.11 last 42.51) - open/close 7263 (time 1785774969.97 total 120.12 last 49.57) - open/close 7935 (time 1785774979.98 total 130.12 last 67.18) - open/close 8493 (time 1785774989.99 total 140.14 last 55.71) - open/close 8937 (time 1785774999.99 total 150.14 last 44.38) - open/close 9504 (time 1785775010.01 total 160.15 last 56.62) - open/close 9905 (time 1785775020.01 total 170.16 last 40.08) total: 10000 open/close in 173.26 seconds: 57.72 ops/second - unlinked 0 (time 1785775031 ; total 0 ; last 0) total: 10000 unlinks in 120 seconds: 83.333336 unlinks/second - open/close 453 (time 1785775168.42 total 10.01 last 45.25) - open/close 954 (time 1785775178.42 total 20.02 last 50.07) - open/close 1445 (time 1785775188.43 total 30.02 last 49.08) - open/close 1844 (time 1785775198.45 total 40.04 last 39.81) - open/close 2272 (time 1785775208.47 total 50.06 last 42.71) - open/close 2906 (time 1785775218.49 total 60.08 last 63.31) - open/close 3334 (time 1785775228.50 total 70.09 last 42.76) - open/close 3750 (time 1785775238.51 total 80.10 last 41.53) - open/close 4176 (time 1785775248.52 total 90.11 last 42.59) - open/close 4748 (time 1785775258.54 total 100.13 last 57.08) - open/close 5289 (time 1785775268.54 total 110.13 last 54.08) - open/close 5713 (time 1785775278.58 total 120.17 last 42.23) - open/close 6167 (time 1785775288.59 total 130.18 last 45.36) - open/close 6815 (time 1785775298.61 total 140.20 last 64.65) - open/close 7285 (time 1785775308.63 total 150.23 last 46.90) - open/close 7962 (time 1785775318.64 total 160.24 last 67.63) - open/close 8530 (time 1785775328.65 total 170.25 last 56.73) - open/close 9167 (time 1785775338.66 total 180.25 last 63.67) - open/close 9758 (time 1785775348.66 total 190.25 last 59.10) total: 10000 open/close in 194.51 seconds: 51.41 ops/second - unlinked 0 (time 1785775358 ; total 0 ; last 0) total: 10000 unlinks in 96 seconds: 104.166664 unlinks/second - open/close 470 (time 1785775469.37 total 10.00 last 46.99) - open/close 1015 (time 1785775479.37 total 20.00 last 54.49) - open/close 1643 (time 1785775489.38 total 30.01 last 62.74) - open/close 2121 (time 1785775499.39 total 40.02 last 47.79) - open/close 2745 (time 1785775509.40 total 50.03 last 62.33) - open/close 3509 (time 1785775519.41 total 60.04 last 76.28) - open/close 4148 (time 1785775529.42 total 70.06 last 63.83) - open/close 4669 (time 1785775539.43 total 80.06 last 52.08) - open/close 5225 (time 1785775549.43 total 90.06 last 55.59) - open/close 5899 (time 1785775559.44 total 100.07 last 67.31) - open/close 6405 (time 1785775569.46 total 110.09 last 50.53) - open/close 6858 (time 1785775579.47 total 120.10 last 45.27) - open/close 7385 (time 1785775589.47 total 130.10 last 52.66) - open/close 7879 (time 1785775599.50 total 140.13 last 49.29) - open/close 8409 (time 1785775609.50 total 150.13 last 52.96) - open/close 8893 (time 1785775619.51 total 160.14 last 48.35) - open/close 9420 (time 1785775629.54 total 170.17 last 52.57) total: 10000 open/close in 179.78 seconds: 55.62 ops/second - unlinked 0 (time 1785775644 ; total 0 ; last 0) total: 10000 unlinks in 108 seconds: 92.592590 unlinks/second - open/close 415 (time 1785775769.41 total 10.01 last 41.46) - open/close 945 (time 1785775779.43 total 20.03 last 52.90) - open/close 1402 (time 1785775789.43 total 30.03 last 45.69) - open/close 2268 (time 1785775799.43 total 40.03 last 86.60) - open/close 2778 (time 1785775809.46 total 50.06 last 50.86) - open/close 3202 (time 1785775819.46 total 60.06 last 42.39) - open/close 3692 (time 1785775829.47 total 70.07 last 48.94) - open/close 4262 (time 1785775839.47 total 80.08 last 56.99) - open/close 4709 (time 1785775849.48 total 90.08 last 44.67) - open/close 5215 (time 1785775859.49 total 100.09 last 50.54) - open/close 5658 (time 1785775869.52 total 110.12 last 44.20) - open/close 6200 (time 1785775879.53 total 120.13 last 54.11) - open/close 6710 (time 1785775889.54 total 130.14 last 50.94) - open/close 7266 (time 1785775899.56 total 140.16 last 55.52) - open/close 7682 (time 1785775909.56 total 150.17 last 41.57) - open/close 8159 (time 1785775919.57 total 160.18 last 47.65) - open/close 8805 (time 1785775929.58 total 170.18 last 64.56) - open/close 9256 (time 1785775939.61 total 180.21 last 44.98) - open/close 9630 (time 1785775949.65 total 190.25 last 37.25) - open/close 9941 (time 1785775959.69 total 200.29 last 30.97) total: 10000 open/close in 202.03 seconds: 49.50 ops/second - unlinked 0 (time 1785775971 ; total 0 ; last 0) total: 10000 unlinks in 115 seconds: 86.956520 unlinks/second - open/close 828 (time 1785776103.73 total 10.01 last 82.74) - open/close 1299 (time 1785776113.74 total 20.01 last 47.07) - open/close 1786 (time 1785776123.75 total 30.03 last 48.62) - open/close 2274 (time 1785776133.77 total 40.04 last 48.73) - open/close 2712 (time 1785776143.78 total 50.05 last 43.77) - open/close 3356 (time 1785776153.78 total 60.05 last 64.39) - open/close 4119 (time 1785776163.78 total 70.05 last 76.29) - open/close 4831 (time 1785776173.78 total 80.06 last 71.17) - open/close 5891 (time 1785776183.79 total 90.06 last 105.96) - open/close 6738 (time 1785776193.80 total 100.07 last 84.61) - open/close 7298 (time 1785776203.80 total 110.08 last 55.98) - open/close 7782 (time 1785776213.83 total 120.11 last 48.25) - open/close 8261 (time 1785776223.84 total 130.11 last 47.87) - open/close 8904 (time 1785776233.84 total 140.11 last 64.30) - open/close 9429 (time 1785776243.85 total 150.13 last 52.44) - open/close 9965 (time 1785776253.86 total 160.14 last 53.55) total: 10000 open/close in 160.79 seconds: 62.19 ops/second - unlinked 0 (time 1785776260 ; total 0 ; last 0) total: 10000 unlinks in 102 seconds: 98.039215 unlinks/second - open/close 591 (time 1785776381.13 total 10.01 last 59.03) - open/close 1128 (time 1785776391.14 total 20.02 last 53.65) - open/close 1634 (time 1785776401.16 total 30.04 last 50.50) - open/close 2162 (time 1785776411.19 total 40.07 last 52.65) - open/close 2594 (time 1785776421.21 total 50.09 last 43.12) - open/close 3055 (time 1785776431.21 total 60.09 last 46.08) - open/close 3755 (time 1785776441.22 total 70.09 last 69.99) - open/close 4406 (time 1785776451.22 total 80.10 last 65.08) - open/close 4978 (time 1785776461.23 total 90.11 last 57.13) - open/close 5567 (time 1785776471.24 total 100.12 last 58.85) - open/close 6011 (time 1785776481.26 total 110.14 last 44.31) - open/close 6827 (time 1785776491.26 total 120.14 last 81.56) - open/close 7343 (time 1785776501.26 total 130.14 last 51.60) - open/close 7798 (time 1785776511.27 total 140.15 last 45.49) - open/close 8237 (time 1785776521.27 total 150.15 last 43.88) - open/close 8812 (time 1785776531.30 total 160.18 last 57.32) - open/close 9357 (time 1785776541.32 total 170.20 last 54.41) - open/close 9853 (time 1785776551.34 total 180.22 last 49.51) total: 10000 open/close in 182.83 seconds: 54.70 ops/second - unlinked 0 (time 1785776559 ; total 0 ; last 0) total: 10000 unlinks in 100 seconds: 100.000000 unlinks/second - open/close 488 (time 1785776676.58 total 10.03 last 48.67) - open/close 1000 (time 1785776686.59 total 20.03 last 51.16) - open/close 1574 (time 1785776696.61 total 30.06 last 57.25) - open/close 2088 (time 1785776706.62 total 40.06 last 51.37) - open/close 2659 (time 1785776716.63 total 50.08 last 57.02) - open/close 3085 (time 1785776726.64 total 60.08 last 42.59) - open/close 3588 (time 1785776736.64 total 70.08 last 50.30) - open/close 3987 (time 1785776746.64 total 80.09 last 39.89) - open/close 4574 (time 1785776756.69 total 90.14 last 58.39) - open/close 5087 (time 1785776766.70 total 100.15 last 51.26) - open/close 5581 (time 1785776776.71 total 110.15 last 49.38) - open/close 6069 (time 1785776786.72 total 120.16 last 48.75) - open/close 6423 (time 1785776796.73 total 130.18 last 35.35) - open/close 6824 (time 1785776806.75 total 140.19 last 40.04) - open/close 7228 (time 1785776816.77 total 150.21 last 40.31) - open/close 7758 (time 1785776826.78 total 160.22 last 52.94) - open/close 8219 (time 1785776836.80 total 170.24 last 46.01) - open/close 8679 (time 1785776846.81 total 180.26 last 45.94) - open/close 9219 (time 1785776856.82 total 190.27 last 53.95) - open/close 9793 (time 1785776866.83 total 200.27 last 57.35) total: 10000 open/close in 202.37 seconds: 49.42 ops/second - unlinked 0 (time 1785776875 ; total 0 ; last 0) total: 10000 unlinks in 105 seconds: 95.238098 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg403-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg403-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg403-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.103@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre-OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre-OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k start ost1 service on oleg403-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg403-server: oleg403-server.virtnet: executing set_default_debug -1 all pdsh@oleg403-client: oleg403-server: ssh exited with exit code 1 Started lustre-OST0000 oleg403-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg403-server: oleg403-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg403-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg403-server: oleg403-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg403-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg403-client.virtnet: -o user_xattr,flock 192.168.204.103@tcp:/lustre /mnt/lustre On OST0, 20430 used inodes rc=0 pdsh@oleg403-client: oleg403-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg403-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg403-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg403-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.103@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre:OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k checking for existing Lustre data: found Read previous values: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.103@tcp sys.timeout=20 Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.103@tcp sys.timeout=20 start ost1 service on oleg403-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg403-server: oleg403-server.virtnet: executing set_default_debug -1 all pdsh@oleg403-client: oleg403-server: ssh exited with exit code 1 Started lustre-OST0000 oleg403-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg403-server: oleg403-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg403-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg403-server: oleg403-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg403-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg403-client.virtnet: -o user_xattr,flock 192.168.204.103@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg403-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg403-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg403-server stop mds service on oleg403-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg403-server stop mds service on oleg403-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg403-server unloading modules via unload_modules_local on: 'oleg403-server' oleg403-server: oleg403-server.virtnet: executing unload_modules_local oleg403-server: modules unloaded. pdsh@oleg403-client: oleg403-server: ssh exited with exit code 2 pdsh@oleg403-client: oleg403-client: ssh exited with exit code 2 pdsh@oleg403-client: oleg403-server: ssh exited with exit code 2 pdsh@oleg403-client: oleg403-client: ssh exited with exit code 2