== conf-sanity test 69: replace an OST with the same index ========================================================== 02:17:51 (1780381071)
start mds service on oleg440-server
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
ln: failed to create symbolic link '/sbin/.libs': Read-only file system
loading modules on: 'oleg440-server'
oleg440-server: oleg440-server.virtnet: executing load_modules_local
oleg440-server: Loading modules from /home/green/git/lustre-release/lustre
oleg440-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy
oleg440-server: detected 4 online CPUs by sysfs
oleg440-server: MODOPTS_LIBCFS=
oleg440-server: Force libcfs to create 2 CPU partitions
oleg440-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg440-server: quota/lquota options: 'hash_lqs_cur_bits=3'
oleg440-server: mdt/mdt options: 'mdt_enable_flr_ec=1'
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg440-server: oleg440-server.virtnet: executing set_default_debug -1 all
pdsh@oleg440-client: oleg440-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg440-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
start ost1 service on oleg440-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg440-server: oleg440-server.virtnet: executing set_default_debug -1 all
pdsh@oleg440-client: oleg440-server: ssh exited with exit code 1
Started lustre-OST0000
oleg440-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
mount lustre  on /mnt/lustre.....
Starting client: oleg440-client.virtnet:  -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre
seq.cli-lustre-OST0000-super.width=0x1ffffff
On OST0, 11904 inodes available. Want 99872. rc=0
 - open/close 581 (time 1780381155.91 total 10.01 last 58.04)
 - open/close 1193 (time 1780381165.92 total 20.02 last 61.15)
 - open/close 1796 (time 1780381175.93 total 30.03 last 60.21)
 - open/close 2406 (time 1780381185.95 total 40.06 last 60.87)
 - open/close 2881 (time 1780381195.96 total 50.07 last 47.45)
 - open/close 3511 (time 1780381205.98 total 60.08 last 62.90)
 - open/close 4115 (time 1780381215.99 total 70.09 last 60.34)
 - open/close 4670 (time 1780381226.00 total 80.10 last 55.46)
 - open/close 5304 (time 1780381236.00 total 90.11 last 63.36)
 - open/close 5873 (time 1780381246.01 total 100.12 last 56.85)
 - open/close 6494 (time 1780381256.02 total 110.13 last 62.02)
 - open/close 7131 (time 1780381266.04 total 120.14 last 63.62)
 - open/close 7804 (time 1780381276.05 total 130.15 last 67.23)
 - open/close 8418 (time 1780381286.06 total 140.16 last 61.35)
 - open/close 9080 (time 1780381296.07 total 150.17 last 66.11)
 - open/close 9585 (time 1780381306.08 total 160.18 last 50.46)
total: 10000 open/close in 167.71 seconds: 59.63 ops/second
 - unlinked 0 (time 1780381318 ; total 0 ; last 0)
total: 10000 unlinks in 113 seconds: 88.495575 unlinks/second
 - open/close 619 (time 1780381446.14 total 10.02 last 61.76)
 - open/close 1204 (time 1780381456.16 total 20.05 last 58.36)
 - open/close 1821 (time 1780381466.18 total 30.07 last 61.58)
 - open/close 2442 (time 1780381476.19 total 40.08 last 62.03)
 - open/close 3083 (time 1780381486.20 total 50.08 last 64.07)
 - open/close 3679 (time 1780381496.20 total 60.08 last 59.58)
 - open/close 4226 (time 1780381506.22 total 70.11 last 54.56)
 - open/close 4819 (time 1780381516.24 total 80.12 last 59.22)
 - open/close 5423 (time 1780381526.25 total 90.13 last 60.35)
 - open/close 6077 (time 1780381536.26 total 100.15 last 65.30)
 - open/close 6666 (time 1780381546.28 total 110.16 last 58.82)
 - open/close 7258 (time 1780381556.28 total 120.17 last 59.17)
 - open/close 7825 (time 1780381566.29 total 130.18 last 56.63)
 - open/close 8490 (time 1780381576.31 total 140.19 last 66.41)
 - open/close 9089 (time 1780381586.32 total 150.21 last 59.82)
 - open/close 9673 (time 1780381596.32 total 160.21 last 58.37)
total: 10000 open/close in 165.77 seconds: 60.33 ops/second
 - unlinked 0 (time 1780381606 ; total 0 ; last 0)
total: 10000 unlinks in 105 seconds: 95.238098 unlinks/second
 - open/close 512 (time 1780381726.62 total 10.02 last 51.12)
 - open/close 1104 (time 1780381736.62 total 20.02 last 59.15)
 - open/close 1733 (time 1780381746.63 total 30.03 last 62.84)
 - open/close 2331 (time 1780381756.64 total 40.04 last 59.74)
 - open/close 2908 (time 1780381766.68 total 50.08 last 57.50)
 - open/close 3329 (time 1780381776.68 total 60.08 last 42.08)
 - open/close 3805 (time 1780381786.68 total 70.09 last 47.59)
 - open/close 4331 (time 1780381796.72 total 80.12 last 52.41)
 - open/close 4872 (time 1780381806.73 total 90.13 last 54.08)
 - open/close 5437 (time 1780381816.73 total 100.13 last 56.49)
 - open/close 6020 (time 1780381826.74 total 110.14 last 58.22)
 - open/close 6629 (time 1780381836.75 total 120.15 last 60.87)
 - open/close 7216 (time 1780381846.75 total 130.15 last 58.65)
 - open/close 7739 (time 1780381856.77 total 140.17 last 52.22)
 - open/close 8260 (time 1780381866.78 total 150.18 last 52.06)
 - open/close 8852 (time 1780381876.79 total 160.19 last 59.12)
 - open/close 9451 (time 1780381886.79 total 170.19 last 59.88)
total: 10000 open/close in 179.35 seconds: 55.76 ops/second
 - unlinked 0 (time 1780381902 ; total 0 ; last 0)
total: 10000 unlinks in 107 seconds: 93.457947 unlinks/second
 - open/close 633 (time 1780382025.14 total 10.00 last 63.29)
 - open/close 1228 (time 1780382035.16 total 20.03 last 59.35)
 - open/close 1817 (time 1780382045.17 total 30.04 last 58.84)
 - open/close 2385 (time 1780382055.20 total 40.07 last 56.63)
 - open/close 3008 (time 1780382065.23 total 50.09 last 62.14)
 - open/close 3544 (time 1780382075.24 total 60.10 last 53.55)
 - open/close 4150 (time 1780382085.26 total 70.12 last 60.47)
 - open/close 4699 (time 1780382095.29 total 80.15 last 54.73)
 - open/close 5172 (time 1780382105.29 total 90.16 last 47.28)
 - open/close 5692 (time 1780382115.30 total 100.16 last 51.97)
 - open/close 6320 (time 1780382125.31 total 110.17 last 62.74)
 - open/close 6905 (time 1780382135.33 total 120.20 last 58.37)
 - open/close 7391 (time 1780382145.35 total 130.21 last 48.51)
 - open/close 7821 (time 1780382155.35 total 140.21 last 42.99)
 - open/close 8333 (time 1780382165.36 total 150.22 last 51.15)
 - open/close 8877 (time 1780382175.37 total 160.23 last 54.37)
 - open/close 9474 (time 1780382185.38 total 170.25 last 59.61)
total: 10000 open/close in 178.78 seconds: 55.93 ops/second
 - unlinked 0 (time 1780382198 ; total 0 ; last 0)
total: 10000 unlinks in 117 seconds: 85.470085 unlinks/second
 - open/close 455 (time 1780382331.87 total 10.01 last 45.47)
 - open/close 952 (time 1780382341.89 total 20.02 last 49.61)
 - open/close 1502 (time 1780382351.89 total 30.03 last 54.95)
 - open/close 2097 (time 1780382361.90 total 40.04 last 59.43)
 - open/close 2699 (time 1780382371.91 total 50.05 last 60.14)
 - open/close 3308 (time 1780382381.92 total 60.06 last 60.88)
 - open/close 3900 (time 1780382391.94 total 70.08 last 59.05)
 - open/close 4446 (time 1780382401.95 total 80.09 last 54.57)
 - open/close 4980 (time 1780382411.95 total 90.09 last 53.40)
 - open/close 5516 (time 1780382421.98 total 100.11 last 53.46)
 - open/close 6082 (time 1780382431.98 total 110.12 last 56.59)
 - open/close 6604 (time 1780382441.99 total 120.12 last 52.16)
 - open/close 7170 (time 1780382452.03 total 130.17 last 56.33)
 - open/close 7762 (time 1780382462.04 total 140.17 last 59.19)
 - open/close 8328 (time 1780382472.04 total 150.18 last 56.58)
 - open/close 8906 (time 1780382482.05 total 160.19 last 57.72)
 - open/close 9519 (time 1780382492.05 total 170.19 last 61.29)
total: 10000 open/close in 178.65 seconds: 55.97 ops/second
 - unlinked 0 (time 1780382505 ; total 0 ; last 0)
total: 10000 unlinks in 123 seconds: 81.300812 unlinks/second
 - open/close 462 (time 1780382644.98 total 10.00 last 46.20)
 - open/close 1005 (time 1780382654.98 total 20.01 last 54.27)
 - open/close 1542 (time 1780382664.99 total 30.01 last 53.66)
 - open/close 2055 (time 1780382675.00 total 40.02 last 51.25)
 - open/close 2552 (time 1780382685.02 total 50.05 last 49.59)
 - open/close 2972 (time 1780382695.04 total 60.06 last 41.95)
 - open/close 3485 (time 1780382705.04 total 70.06 last 51.29)
 - open/close 3926 (time 1780382715.05 total 80.08 last 44.02)
 - open/close 4493 (time 1780382725.09 total 90.11 last 56.53)
 - open/close 5028 (time 1780382735.10 total 100.12 last 53.44)
 - open/close 5576 (time 1780382745.11 total 110.13 last 54.72)
 - open/close 6063 (time 1780382755.14 total 120.16 last 48.57)
 - open/close 6510 (time 1780382765.14 total 130.16 last 44.68)
 - open/close 6958 (time 1780382775.15 total 140.17 last 44.77)
 - open/close 7493 (time 1780382785.16 total 150.18 last 53.45)
 - open/close 8107 (time 1780382795.17 total 160.19 last 61.36)
 - open/close 8692 (time 1780382805.18 total 170.20 last 58.42)
 - open/close 9229 (time 1780382815.19 total 180.22 last 53.62)
 - open/close 9706 (time 1780382825.24 total 190.26 last 47.48)
total: 10000 open/close in 195.51 seconds: 51.15 ops/second
 - unlinked 0 (time 1780382835 ; total 0 ; last 0)
total: 10000 unlinks in 108 seconds: 92.592590 unlinks/second
 - open/close 540 (time 1780382957.76 total 10.01 last 53.96)
 - open/close 1136 (time 1780382967.76 total 20.01 last 59.59)
 - open/close 1748 (time 1780382977.77 total 30.01 last 61.18)
 - open/close 2373 (time 1780382987.78 total 40.02 last 62.45)
 - open/close 2976 (time 1780382997.79 total 50.03 last 60.24)
 - open/close 3559 (time 1780383007.79 total 60.04 last 58.27)
 - open/close 4100 (time 1780383017.81 total 70.05 last 54.01)
 - open/close 4647 (time 1780383027.82 total 80.07 last 54.64)
 - open/close 5102 (time 1780383037.83 total 90.08 last 45.45)
 - open/close 5485 (time 1780383047.85 total 100.09 last 38.24)
 - open/close 5948 (time 1780383057.87 total 110.11 last 46.20)
 - open/close 6496 (time 1780383067.88 total 120.12 last 54.76)
 - open/close 7011 (time 1780383077.90 total 130.15 last 51.36)
 - open/close 7560 (time 1780383087.92 total 140.16 last 54.84)
 - open/close 8125 (time 1780383097.93 total 150.17 last 56.44)
 - open/close 8656 (time 1780383107.95 total 160.20 last 52.97)
 - open/close 9140 (time 1780383117.96 total 170.20 last 48.37)
 - open/close 9675 (time 1780383127.96 total 180.21 last 53.47)
total: 10000 open/close in 185.91 seconds: 53.79 ops/second
 - unlinked 0 (time 1780383138 ; total 0 ; last 0)
total: 10000 unlinks in 107 seconds: 93.457947 unlinks/second
 - open/close 461 (time 1780383261.68 total 10.00 last 46.09)
 - open/close 937 (time 1780383271.69 total 20.01 last 47.57)
 - open/close 1379 (time 1780383281.70 total 30.02 last 44.16)
 - open/close 1884 (time 1780383291.72 total 40.04 last 50.38)
 - open/close 2338 (time 1780383301.73 total 50.05 last 45.34)
 - open/close 2742 (time 1780383311.75 total 60.07 last 40.33)
 - open/close 3177 (time 1780383321.75 total 70.07 last 43.50)
 - open/close 3685 (time 1780383331.75 total 80.07 last 50.79)
 - open/close 4241 (time 1780383341.76 total 90.08 last 55.57)
 - open/close 4780 (time 1780383351.77 total 100.09 last 53.86)
 - open/close 5296 (time 1780383361.77 total 110.09 last 51.59)
 - open/close 5762 (time 1780383371.77 total 120.09 last 46.60)
 - open/close 6235 (time 1780383381.78 total 130.10 last 47.27)
 - open/close 6775 (time 1780383391.79 total 140.11 last 53.94)
 - open/close 7332 (time 1780383401.80 total 150.12 last 55.65)
 - open/close 7862 (time 1780383411.82 total 160.14 last 52.88)
 - open/close 8343 (time 1780383421.83 total 170.15 last 48.06)
 - open/close 8908 (time 1780383431.83 total 180.15 last 56.47)
 - open/close 9408 (time 1780383441.85 total 190.17 last 49.92)
 - open/close 9916 (time 1780383451.88 total 200.20 last 50.65)
total: 10000 open/close in 202.17 seconds: 49.46 ops/second
 - unlinked 0 (time 1780383459 ; total 0 ; last 0)
total: 10000 unlinks in 118 seconds: 84.745766 unlinks/second
 - open/close 606 (time 1780383592.28 total 10.01 last 60.57)
 - open/close 1196 (time 1780383602.28 total 20.01 last 58.95)
 - open/close 1783 (time 1780383612.30 total 30.03 last 58.62)
 - open/close 2396 (time 1780383622.30 total 40.03 last 61.27)
 - open/close 2950 (time 1780383632.32 total 50.05 last 55.29)
 - open/close 3438 (time 1780383642.35 total 60.08 last 48.67)
 - open/close 3964 (time 1780383652.36 total 70.09 last 52.53)
 - open/close 4376 (time 1780383662.42 total 80.15 last 40.99)
 - open/close 4847 (time 1780383672.42 total 90.15 last 47.09)
 - open/close 5376 (time 1780383682.42 total 100.15 last 52.90)
 - open/close 5911 (time 1780383692.42 total 110.15 last 53.49)
 - open/close 6458 (time 1780383702.43 total 120.16 last 54.67)
 - open/close 6901 (time 1780383712.43 total 130.16 last 44.29)
 - open/close 7301 (time 1780383722.43 total 140.16 last 39.99)
 - open/close 7842 (time 1780383732.45 total 150.18 last 53.99)
 - open/close 8379 (time 1780383742.46 total 160.19 last 53.67)
 - open/close 8920 (time 1780383752.47 total 170.20 last 54.04)
 - open/close 9398 (time 1780383762.48 total 180.21 last 47.74)
 - open/close 9767 (time 1780383772.51 total 190.24 last 36.79)
total: 10000 open/close in 197.37 seconds: 50.67 ops/second
 - unlinked 0 (time 1780383785 ; total 0 ; last 0)
total: 10000 unlinks in 113 seconds: 88.495575 unlinks/second
 - open/close 340 (time 1780383915.75 total 10.01 last 33.98)
 - open/close 741 (time 1780383925.77 total 20.02 last 40.03)
 - open/close 1345 (time 1780383935.77 total 30.03 last 60.38)
 - open/close 1937 (time 1780383945.78 total 40.03 last 59.17)
 - open/close 2431 (time 1780383955.80 total 50.05 last 49.31)
 - open/close 2936 (time 1780383965.81 total 60.07 last 50.41)
 - open/close 3495 (time 1780383975.83 total 70.09 last 55.79)
 - open/close 3979 (time 1780383985.84 total 80.10 last 48.35)
 - open/close 4511 (time 1780383995.85 total 90.10 last 53.19)
 - open/close 5049 (time 1780384005.86 total 100.11 last 53.75)
 - open/close 5552 (time 1780384015.88 total 110.14 last 50.15)
 - open/close 5987 (time 1780384025.89 total 120.14 last 43.48)
 - open/close 6399 (time 1780384035.89 total 130.15 last 41.19)
 - open/close 6846 (time 1780384045.91 total 140.16 last 44.65)
 - open/close 7321 (time 1780384055.91 total 150.16 last 47.47)
 - open/close 7892 (time 1780384065.92 total 160.17 last 57.07)
 - open/close 8455 (time 1780384075.93 total 170.18 last 56.25)
 - open/close 9047 (time 1780384085.94 total 180.20 last 59.09)
 - open/close 9656 (time 1780384095.95 total 190.21 last 60.85)
total: 10000 open/close in 196.10 seconds: 50.99 ops/second
 - unlinked 0 (time 1780384105 ; total 0 ; last 0)
total: 10000 unlinks in 106 seconds: 94.339622 unlinks/second
rm: missing operand
Try 'rm --help' for more information.
umount lustre on /mnt/lustre.....
Stopping client oleg440-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg440-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg440-server

   Permanent disk data:
Device:     lustre-ost1/ost1
Target:     lustre-OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x42
              (OST update )
Persistent mount opts: 
Parameters: mgsnode=192.168.204.140@tcp sys.timeout=20 autodegrade=on
mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde
mkfs_cmd = zfs create -o canmount=off  -o quota=409600000 lustre-ost1/ost1
  xattr=sa
  dnodesize=auto
  recordsize=1M
  compression=off
Writing lustre-ost1/ost1 properties
  lustre:mgsnode=192.168.204.140@tcp
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=66
  lustre:index=0
  lustre:fsname=lustre
  lustre:svname=lustre-OST0000
start ost1 service on oleg440-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg440-server: oleg440-server.virtnet: executing set_default_debug -1 all
pdsh@oleg440-client: oleg440-server: ssh exited with exit code 1
Started lustre-OST0000
oleg440-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
oleg440-server: oleg440-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50
oleg440-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
mount lustre  on /mnt/lustre.....
Starting client: oleg440-client.virtnet:  -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre
On OST0, 20326 used inodes rc=0
pdsh@oleg440-client: oleg440-server: ssh exited with exit code 22
umount lustre on /mnt/lustre.....
Stopping client oleg440-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg440-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg440-server

   Permanent disk data:
Device:     lustre-ost1/ost1
Target:     lustre:OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x62
              (OST first_time update )
Persistent mount opts: 
Parameters: mgsnode=192.168.204.140@tcp sys.timeout=20 autodegrade=on
mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde
mkfs_cmd = zfs create -o canmount=off  -o quota=409600000 lustre-ost1/ost1
  xattr=sa
  dnodesize=auto
  recordsize=1M
  compression=off
Writing lustre-ost1/ost1 properties
  lustre:mgsnode=192.168.204.140@tcp
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=98
  lustre:index=0
  lustre:fsname=lustre
  lustre:svname=lustre:OST0000
checking for existing Lustre data: found

   Read previous values:
Device:     lustre-ost1/ost1
Target:     lustre-OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x62
              (OST first_time update )
Persistent mount opts: 
Parameters: mgsnode=192.168.204.140@tcp autodegrade=on sys.timeout=20

   Permanent disk data:
Device:     lustre-ost1/ost1
Target:     lustre-OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x42
              (OST update )
Persistent mount opts: 
Parameters: mgsnode=192.168.204.140@tcp autodegrade=on sys.timeout=20 autodegrade=on
  lustre:svname=lustre-OST0000
Writing lustre-ost1/ost1 properties
  lustre:mgsnode=192.168.204.140@tcp
  lustre:autodegrade=on
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=66
  lustre:index=0
  lustre:fsname=lustre
  lustre:svname=lustre-OST0000
start ost1 service on oleg440-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg440-server: oleg440-server.virtnet: executing set_default_debug -1 all
pdsh@oleg440-client: oleg440-server: ssh exited with exit code 1
Started lustre-OST0000
oleg440-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
oleg440-server: oleg440-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50
oleg440-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
mount lustre  on /mnt/lustre.....
Starting client: oleg440-client.virtnet:  -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre
umount lustre on /mnt/lustre.....
Stopping client oleg440-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg440-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg440-server
stop mds service on oleg440-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg440-server

unloading modules via unload_modules_local on: 'oleg440-server'
oleg440-server: oleg440-server.virtnet: executing unload_modules_local
oleg440-server: 
modules unloaded.
pdsh@oleg440-client: oleg440-client: ssh exited with exit code 2
pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2
pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2
pdsh@oleg440-client: oleg440-client: ssh exited with exit code 2