== conf-sanity test 69: replace an OST with the same index ========================================================== 13:12:14 (1786036334) start mds service on oleg334-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg334-server' oleg334-server: oleg334-server.virtnet: executing load_modules_local oleg334-server: Loading modules from /home/green/git/lustre-release/lustre oleg334-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg334-server: detected 4 online CPUs by sysfs oleg334-server: MODOPTS_LIBCFS= oleg334-server: Force libcfs to create 2 CPU partitions oleg334-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg334-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg334-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg334-server: oleg334-server.virtnet: executing set_default_debug -1 all pdsh@oleg334-client: oleg334-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg334-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg334-server: oleg334-server.virtnet: executing set_default_debug -1 all pdsh@oleg334-client: oleg334-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg334-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg334-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg334-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg334-server: oleg334-server.virtnet: executing set_default_debug -1 all pdsh@oleg334-client: oleg334-server: ssh exited with exit code 1 Started lustre-OST0000 oleg334-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg334-client.virtnet: -o user_xattr,flock 192.168.203.134@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 49503 inodes available. Want 99872. rc=0 - open/close 509 (time 1786036482.50 total 10.02 last 50.78) - open/close 1074 (time 1786036492.52 total 20.05 last 56.35) - open/close 1633 (time 1786036502.53 total 30.06 last 55.84) - open/close 2205 (time 1786036512.57 total 40.09 last 57.01) - open/close 2712 (time 1786036522.57 total 50.10 last 50.69) - open/close 3211 (time 1786036532.59 total 60.11 last 49.81) - open/close 3852 (time 1786036542.61 total 70.14 last 63.94) - open/close 4396 (time 1786036552.62 total 80.14 last 54.37) - open/close 4950 (time 1786036562.63 total 90.15 last 55.36) - open/close 5478 (time 1786036572.65 total 100.17 last 52.69) - open/close 6012 (time 1786036582.65 total 110.18 last 53.38) - open/close 6617 (time 1786036592.65 total 120.18 last 60.50) - open/close 7180 (time 1786036602.67 total 130.19 last 56.21) - open/close 7711 (time 1786036612.67 total 140.20 last 53.07) - open/close 8213 (time 1786036622.71 total 150.24 last 50.01) - open/close 8669 (time 1786036632.73 total 160.26 last 45.50) - open/close 9187 (time 1786036642.74 total 170.27 last 51.74) - open/close 9780 (time 1786036652.75 total 180.28 last 59.25) total: 10000 open/close in 183.78 seconds: 54.41 ops/second - unlinked 0 (time 1786036662 ; total 0 ; last 0) total: 10000 unlinks in 103 seconds: 97.087379 unlinks/second - open/close 414 (time 1786036783.04 total 10.00 last 41.39) - open/close 1079 (time 1786036793.13 total 20.09 last 65.92) - open/close 1664 (time 1786036803.15 total 30.11 last 58.38) - open/close 2239 (time 1786036813.16 total 40.12 last 57.43) - open/close 2676 (time 1786036823.16 total 50.13 last 43.68) - open/close 3112 (time 1786036833.17 total 60.13 last 43.57) - open/close 3564 (time 1786036843.18 total 70.14 last 45.16) - open/close 4030 (time 1786036853.19 total 80.15 last 46.56) - open/close 4645 (time 1786036863.19 total 90.16 last 61.48) - open/close 5317 (time 1786036873.20 total 100.16 last 67.16) - open/close 5859 (time 1786036883.21 total 110.18 last 54.11) - open/close 6331 (time 1786036893.22 total 120.19 last 47.15) - open/close 6829 (time 1786036903.24 total 130.20 last 49.72) - open/close 7390 (time 1786036913.25 total 140.21 last 56.07) - open/close 7936 (time 1786036923.26 total 150.23 last 54.51) - open/close 8426 (time 1786036933.28 total 160.25 last 48.89) - open/close 8924 (time 1786036943.29 total 170.26 last 49.76) - open/close 9420 (time 1786036953.30 total 180.26 last 49.58) - open/close 9879 (time 1786036963.30 total 190.27 last 45.87) total: 10000 open/close in 192.54 seconds: 51.94 ops/second - unlinked 0 (time 1786036970 ; total 0 ; last 0) total: 10000 unlinks in 93 seconds: 107.526878 unlinks/second - open/close 464 (time 1786037081.08 total 10.02 last 46.31) - open/close 928 (time 1786037091.08 total 20.03 last 46.36) - open/close 1360 (time 1786037101.09 total 30.03 last 43.20) - open/close 1847 (time 1786037111.09 total 40.03 last 48.68) - open/close 2356 (time 1786037121.10 total 50.05 last 50.83) - open/close 2879 (time 1786037131.12 total 60.06 last 52.24) - open/close 3443 (time 1786037141.13 total 70.07 last 56.32) - open/close 4135 (time 1786037151.13 total 80.07 last 69.19) - open/close 4728 (time 1786037161.18 total 90.13 last 58.98) - open/close 5324 (time 1786037171.20 total 100.14 last 59.53) - open/close 5947 (time 1786037181.21 total 110.16 last 62.18) - open/close 6715 (time 1786037191.22 total 120.16 last 76.77) - open/close 7310 (time 1786037201.22 total 130.17 last 59.49) - open/close 7959 (time 1786037211.24 total 140.19 last 64.77) - open/close 8541 (time 1786037221.25 total 150.19 last 58.16) - open/close 9055 (time 1786037231.29 total 160.23 last 51.20) - open/close 9661 (time 1786037241.29 total 170.24 last 60.57) total: 10000 open/close in 177.21 seconds: 56.43 ops/second - unlinked 0 (time 1786037254 ; total 0 ; last 0) total: 10000 unlinks in 98 seconds: 102.040817 unlinks/second - open/close 569 (time 1786037368.65 total 10.02 last 56.80) - open/close 1055 (time 1786037378.69 total 20.05 last 48.43) - open/close 1542 (time 1786037388.69 total 30.06 last 48.69) - open/close 2239 (time 1786037398.72 total 40.08 last 69.52) - open/close 2916 (time 1786037408.72 total 50.09 last 67.66) - open/close 3418 (time 1786037418.76 total 60.12 last 50.02) - open/close 3960 (time 1786037428.76 total 70.12 last 54.19) - open/close 4386 (time 1786037438.76 total 80.13 last 42.59) - open/close 4911 (time 1786037448.79 total 90.15 last 52.37) - open/close 5454 (time 1786037458.80 total 100.17 last 54.23) - open/close 5937 (time 1786037468.81 total 110.18 last 48.25) - open/close 6491 (time 1786037478.82 total 120.18 last 55.39) - open/close 6946 (time 1786037488.82 total 130.18 last 45.48) - open/close 7536 (time 1786037498.83 total 140.20 last 58.92) - open/close 8101 (time 1786037508.84 total 150.20 last 56.47) - open/close 8487 (time 1786037518.88 total 160.24 last 38.46) - open/close 9076 (time 1786037528.89 total 170.26 last 58.79) - open/close 9625 (time 1786037538.91 total 180.27 last 54.83) total: 10000 open/close in 188.22 seconds: 53.13 ops/second - unlinked 0 (time 1786037553 ; total 0 ; last 0) total: 10000 unlinks in 105 seconds: 95.238098 unlinks/second - open/close 377 (time 1786037674.61 total 10.01 last 37.65) - open/close 950 (time 1786037684.61 total 20.01 last 57.28) - open/close 1427 (time 1786037694.61 total 30.02 last 47.69) - open/close 1867 (time 1786037704.62 total 40.02 last 43.97) - open/close 2259 (time 1786037714.63 total 50.03 last 39.16) - open/close 2732 (time 1786037724.67 total 60.08 last 47.09) - open/close 3209 (time 1786037734.68 total 70.09 last 47.66) - open/close 3589 (time 1786037744.69 total 80.09 last 37.97) - open/close 4023 (time 1786037754.70 total 90.11 last 43.34) - open/close 4383 (time 1786037764.71 total 100.11 last 35.98) - open/close 4857 (time 1786037774.72 total 110.12 last 47.37) - open/close 5354 (time 1786037784.72 total 120.12 last 49.69) - open/close 5765 (time 1786037794.72 total 130.12 last 41.10) - open/close 6202 (time 1786037804.73 total 140.13 last 43.65) - open/close 6676 (time 1786037814.73 total 150.14 last 47.39) - open/close 7201 (time 1786037824.75 total 160.16 last 52.39) - open/close 7715 (time 1786037834.76 total 170.17 last 51.35) - open/close 8204 (time 1786037844.77 total 180.18 last 48.84) - open/close 8587 (time 1786037854.79 total 190.20 last 38.23) - open/close 9138 (time 1786037864.83 total 200.23 last 54.92) - open/close 9680 (time 1786037874.85 total 210.25 last 54.08) total: 10000 open/close in 215.95 seconds: 46.31 ops/second - unlinked 0 (time 1786037886 ; total 0 ; last 0) total: 10000 unlinks in 101 seconds: 99.009903 unlinks/second - open/close 437 (time 1786038005.65 total 10.13 last 43.16) - open/close 985 (time 1786038015.66 total 20.13 last 54.79) - open/close 1632 (time 1786038025.69 total 30.16 last 64.52) - open/close 2122 (time 1786038035.69 total 40.16 last 49.00) - open/close 2611 (time 1786038045.69 total 50.16 last 48.90) - open/close 3118 (time 1786038055.69 total 60.16 last 50.70) - open/close 3778 (time 1786038065.69 total 70.16 last 65.99) - open/close 4270 (time 1786038075.69 total 80.17 last 49.17) - open/close 4842 (time 1786038085.70 total 90.17 last 57.19) - open/close 5358 (time 1786038095.71 total 100.18 last 51.54) - open/close 6012 (time 1786038105.71 total 110.19 last 65.35) - open/close 6575 (time 1786038115.72 total 120.19 last 56.27) - open/close 7007 (time 1786038125.74 total 130.21 last 43.11) - open/close 7419 (time 1786038135.76 total 140.23 last 41.14) - open/close 7985 (time 1786038145.76 total 150.23 last 56.58) - open/close 8637 (time 1786038155.80 total 160.27 last 64.94) - open/close 9181 (time 1786038165.80 total 170.28 last 54.38) - open/close 9630 (time 1786038175.81 total 180.28 last 44.90) total: 10000 open/close in 189.04 seconds: 52.90 ops/second - unlinked 0 (time 1786038192 ; total 0 ; last 0) total: 10000 unlinks in 97 seconds: 103.092781 unlinks/second - open/close 622 (time 1786038305.60 total 10.01 last 62.12) - open/close 1107 (time 1786038315.64 total 20.05 last 48.32) - open/close 1644 (time 1786038325.64 total 30.06 last 53.66) - open/close 2155 (time 1786038335.65 total 40.06 last 51.09) - open/close 2713 (time 1786038345.66 total 50.08 last 55.71) - open/close 3349 (time 1786038355.67 total 60.09 last 63.54) - open/close 3801 (time 1786038365.70 total 70.11 last 45.08) - open/close 4220 (time 1786038375.74 total 80.15 last 41.74) - open/close 4678 (time 1786038385.75 total 90.17 last 45.72) - open/close 5408 (time 1786038395.76 total 100.18 last 72.94) - open/close 5986 (time 1786038405.78 total 110.19 last 57.72) - open/close 6649 (time 1786038415.78 total 120.20 last 66.24) - open/close 7119 (time 1786038425.80 total 130.21 last 46.94) - open/close 7552 (time 1786038435.80 total 140.21 last 43.30) - open/close 8130 (time 1786038445.80 total 150.22 last 57.77) - open/close 8621 (time 1786038455.82 total 160.23 last 49.05) - open/close 9138 (time 1786038465.82 total 170.24 last 51.65) - open/close 9667 (time 1786038475.84 total 180.26 last 52.81) total: 10000 open/close in 187.00 seconds: 53.48 ops/second - unlinked 0 (time 1786038489 ; total 0 ; last 0) total: 10000 unlinks in 110 seconds: 90.909088 unlinks/second - open/close 331 (time 1786038616.62 total 10.01 last 33.07) - open/close 779 (time 1786038626.64 total 20.03 last 44.70) - open/close 1277 (time 1786038636.66 total 30.05 last 49.68) - open/close 1773 (time 1786038646.69 total 40.08 last 49.49) - open/close 2336 (time 1786038656.69 total 50.08 last 56.28) - open/close 2800 (time 1786038666.75 total 60.14 last 46.13) - open/close 3139 (time 1786038676.79 total 70.18 last 33.75) - open/close 3654 (time 1786038686.83 total 80.22 last 51.33) - open/close 4164 (time 1786038696.83 total 90.22 last 50.97) - open/close 4569 (time 1786038706.84 total 100.23 last 40.45) - open/close 5036 (time 1786038716.85 total 110.24 last 46.67) - open/close 5673 (time 1786038726.86 total 120.25 last 63.65) - open/close 6136 (time 1786038736.86 total 130.25 last 46.28) - open/close 6767 (time 1786038746.86 total 140.25 last 63.10) - open/close 7352 (time 1786038756.86 total 150.25 last 58.49) - open/close 7898 (time 1786038766.87 total 160.26 last 54.60) - open/close 8506 (time 1786038776.88 total 170.27 last 60.71) - open/close 9074 (time 1786038786.89 total 180.28 last 56.72) - open/close 9569 (time 1786038796.91 total 190.30 last 49.45) total: 10000 open/close in 199.12 seconds: 50.22 ops/second - unlinked 0 (time 1786038811 ; total 0 ; last 0) total: 10000 unlinks in 100 seconds: 100.000000 unlinks/second - open/close 586 (time 1786038926.98 total 10.00 last 58.59) - open/close 1160 (time 1786038936.99 total 20.01 last 57.35) - open/close 1752 (time 1786038946.99 total 30.01 last 59.19) - open/close 2259 (time 1786038957.00 total 40.03 last 50.63) - open/close 2802 (time 1786038967.02 total 50.05 last 54.20) - open/close 3412 (time 1786038977.04 total 60.06 last 60.92) - open/close 3943 (time 1786038987.04 total 70.07 last 53.05) - open/close 4554 (time 1786038997.05 total 80.07 last 61.08) - open/close 5006 (time 1786039007.07 total 90.09 last 45.11) - open/close 5611 (time 1786039017.08 total 100.10 last 60.42) - open/close 6174 (time 1786039027.09 total 110.11 last 56.23) - open/close 6713 (time 1786039037.10 total 120.12 last 53.87) - open/close 7254 (time 1786039047.11 total 130.13 last 54.06) - open/close 7792 (time 1786039057.13 total 140.15 last 53.66) - open/close 8372 (time 1786039067.14 total 150.16 last 57.96) - open/close 8903 (time 1786039077.14 total 160.16 last 53.10) - open/close 9396 (time 1786039087.14 total 170.16 last 49.30) - open/close 9728 (time 1786039097.16 total 180.18 last 33.15) total: 10000 open/close in 186.45 seconds: 53.63 ops/second - unlinked 0 (time 1786039110 ; total 0 ; last 0) total: 10000 unlinks in 111 seconds: 90.090088 unlinks/second - open/close 582 (time 1786039237.52 total 10.00 last 58.19) - open/close 1222 (time 1786039247.52 total 20.01 last 63.98) - open/close 1776 (time 1786039257.55 total 30.04 last 55.23) - open/close 2368 (time 1786039267.56 total 40.04 last 59.17) - open/close 3006 (time 1786039277.59 total 50.07 last 63.62) - open/close 3498 (time 1786039287.60 total 60.09 last 49.11) - open/close 3976 (time 1786039297.62 total 70.10 last 47.73) - open/close 4600 (time 1786039307.65 total 80.13 last 62.22) - open/close 5018 (time 1786039317.66 total 90.15 last 41.74) - open/close 5497 (time 1786039327.70 total 100.18 last 47.73) - open/close 5992 (time 1786039337.70 total 110.18 last 49.49) - open/close 6627 (time 1786039347.70 total 120.18 last 63.50) - open/close 7123 (time 1786039357.72 total 130.21 last 49.49) - open/close 7674 (time 1786039367.72 total 140.21 last 55.09) - open/close 8219 (time 1786039377.73 total 150.22 last 54.45) - open/close 8840 (time 1786039387.74 total 160.23 last 62.04) - open/close 9343 (time 1786039397.75 total 170.23 last 50.28) - open/close 9803 (time 1786039407.76 total 180.24 last 45.95) total: 10000 open/close in 183.87 seconds: 54.39 ops/second - unlinked 0 (time 1786039416 ; total 0 ; last 0) total: 10000 unlinks in 116 seconds: 86.206894 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg334-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg334-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg334-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.134@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre-OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre-OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k start ost1 service on oleg334-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg334-server: oleg334-server.virtnet: executing set_default_debug -1 all pdsh@oleg334-client: oleg334-server: ssh exited with exit code 1 Started lustre-OST0000 oleg334-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg334-server: oleg334-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg334-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg334-server: oleg334-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg334-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg334-client.virtnet: -o user_xattr,flock 192.168.203.134@tcp:/lustre /mnt/lustre On OST0, 20430 used inodes rc=0 pdsh@oleg334-client: oleg334-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg334-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg334-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg334-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.134@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre:OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k checking for existing Lustre data: found Read previous values: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.134@tcp sys.timeout=20 Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.134@tcp sys.timeout=20 start ost1 service on oleg334-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg334-server: oleg334-server.virtnet: executing set_default_debug -1 all pdsh@oleg334-client: oleg334-server: ssh exited with exit code 1 Started lustre-OST0000 oleg334-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg334-server: oleg334-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg334-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg334-server: oleg334-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg334-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg334-client.virtnet: -o user_xattr,flock 192.168.203.134@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg334-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg334-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg334-server stop mds service on oleg334-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg334-server stop mds service on oleg334-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg334-server unloading modules via unload_modules_local on: 'oleg334-server' oleg334-server: oleg334-server.virtnet: executing unload_modules_local oleg334-server: modules unloaded. pdsh@oleg334-client: oleg334-client: ssh exited with exit code 2 pdsh@oleg334-client: oleg334-server: ssh exited with exit code 2 pdsh@oleg334-client: oleg334-client: ssh exited with exit code 2 pdsh@oleg334-client: oleg334-server: ssh exited with exit code 2