== conf-sanity test 69: replace an OST with the same index ========================================================== 01:13:40 (1785388420)
start mds service on oleg221-server
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
ln: failed to create symbolic link '/sbin/.libs': Read-only file system
loading modules on: 'oleg221-server'
oleg221-server: oleg221-server.virtnet: executing load_modules_local
oleg221-server: Loading modules from /home/green/git/lustre-release/lustre
oleg221-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy
oleg221-server: detected 4 online CPUs by sysfs
oleg221-server: MODOPTS_LIBCFS=
oleg221-server: Force libcfs to create 2 CPU partitions
oleg221-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg221-server: quota/lquota options: 'hash_lqs_cur_bits=3'
oleg221-server: mdt/mdt options: 'mdt_enable_flr_ec=1'
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg221-server: oleg221-server.virtnet: executing set_default_debug -1 all
pdsh@oleg221-client: oleg221-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg221-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
start ost1 service on oleg221-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg221-server: oleg221-server.virtnet: executing set_default_debug -1 all
pdsh@oleg221-client: oleg221-server: ssh exited with exit code 1
Started lustre-OST0000
oleg221-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
mount lustre  on /mnt/lustre.....
Starting client: oleg221-client.virtnet:  -o user_xattr,flock 192.168.202.121@tcp:/lustre /mnt/lustre
seq.cli-lustre-OST0000-super.width=0x1ffffff
On OST0, 11904 inodes available. Want 99872. rc=0
 - open/close 677 (time 1785388535.74 total 10.01 last 67.65)
 - open/close 1176 (time 1785388545.74 total 20.01 last 49.88)
 - open/close 1730 (time 1785388555.77 total 30.03 last 55.28)
 - open/close 2175 (time 1785388565.78 total 40.04 last 44.45)
 - open/close 2537 (time 1785388575.78 total 50.04 last 36.20)
 - open/close 2940 (time 1785388585.78 total 60.05 last 40.28)
 - open/close 3472 (time 1785388595.81 total 70.07 last 53.07)
 - open/close 4094 (time 1785388605.81 total 80.08 last 62.16)
 - open/close 4554 (time 1785388615.84 total 90.10 last 45.89)
 - open/close 5115 (time 1785388625.85 total 100.12 last 56.01)
 - open/close 5965 (time 1785388635.86 total 110.13 last 84.91)
 - open/close 6659 (time 1785388645.90 total 120.17 last 69.14)
 - open/close 7109 (time 1785388655.91 total 130.17 last 44.98)
 - open/close 7789 (time 1785388665.91 total 140.18 last 67.97)
 - open/close 8224 (time 1785388675.93 total 150.20 last 43.42)
 - open/close 8615 (time 1785388685.94 total 160.20 last 39.07)
 - open/close 9115 (time 1785388695.96 total 170.23 last 49.87)
 - open/close 9678 (time 1785388705.98 total 180.24 last 56.21)
total: 10000 open/close in 186.52 seconds: 53.61 ops/second
 - unlinked 0 (time 1785388718 ; total 0 ; last 0)
total: 10000 unlinks in 131 seconds: 76.335876 unlinks/second
 - open/close 253 (time 1785388869.32 total 10.04 last 25.20)
 - open/close 566 (time 1785388879.33 total 20.05 last 31.26)
 - open/close 1051 (time 1785388889.35 total 30.07 last 48.43)
 - open/close 1632 (time 1785388899.36 total 40.08 last 58.04)
 - open/close 2204 (time 1785388909.38 total 50.10 last 57.08)
 - open/close 2660 (time 1785388919.39 total 60.10 last 45.57)
 - open/close 3245 (time 1785388929.39 total 70.11 last 58.45)
 - open/close 3787 (time 1785388939.40 total 80.12 last 54.17)
 - open/close 4236 (time 1785388949.41 total 90.13 last 44.83)
 - open/close 4911 (time 1785388959.43 total 100.14 last 67.43)
 - open/close 5543 (time 1785388969.43 total 110.14 last 63.20)
 - open/close 6078 (time 1785388979.44 total 120.16 last 53.43)
 - open/close 6613 (time 1785388989.44 total 130.16 last 53.47)
 - open/close 7121 (time 1785388999.45 total 140.17 last 50.76)
 - open/close 7546 (time 1785389009.46 total 150.18 last 42.44)
 - open/close 7918 (time 1785389019.49 total 160.21 last 37.11)
 - open/close 8381 (time 1785389029.51 total 170.23 last 46.22)
 - open/close 9061 (time 1785389039.54 total 180.26 last 67.79)
 - open/close 9697 (time 1785389049.55 total 190.26 last 63.55)
total: 10000 open/close in 197.78 seconds: 50.56 ops/second
 - unlinked 0 (time 1785389063 ; total 0 ; last 0)
total: 10000 unlinks in 105 seconds: 95.238098 unlinks/second
 - open/close 351 (time 1785389187.09 total 10.00 last 35.09)
 - open/close 757 (time 1785389197.10 total 20.01 last 40.57)
 - open/close 1424 (time 1785389207.11 total 30.01 last 66.67)
 - open/close 2255 (time 1785389217.12 total 40.02 last 83.04)
 - open/close 2781 (time 1785389227.12 total 50.03 last 52.55)
 - open/close 3151 (time 1785389237.14 total 60.05 last 36.94)
 - open/close 3728 (time 1785389247.14 total 70.05 last 57.68)
 - open/close 4338 (time 1785389257.15 total 80.05 last 60.99)
 - open/close 4981 (time 1785389267.16 total 90.07 last 64.21)
 - open/close 5321 (time 1785389277.18 total 100.08 last 33.95)
 - open/close 5737 (time 1785389287.18 total 110.09 last 41.59)
 - open/close 6312 (time 1785389297.18 total 120.09 last 57.47)
 - open/close 6880 (time 1785389307.18 total 130.09 last 56.79)
 - open/close 7353 (time 1785389317.19 total 140.10 last 47.25)
 - open/close 8030 (time 1785389327.20 total 150.11 last 67.65)
 - open/close 8746 (time 1785389337.21 total 160.12 last 71.54)
 - open/close 9381 (time 1785389347.21 total 170.12 last 63.50)
 - open/close 9829 (time 1785389357.21 total 180.12 last 44.78)
total: 10000 open/close in 184.45 seconds: 54.21 ops/second
 - unlinked 0 (time 1785389369 ; total 0 ; last 0)
total: 10000 unlinks in 106 seconds: 94.339622 unlinks/second
 - open/close 579 (time 1785389490.94 total 10.02 last 57.76)
 - open/close 933 (time 1785389500.95 total 20.03 last 35.37)
 - open/close 1269 (time 1785389510.97 total 30.06 last 33.51)
 - open/close 1648 (time 1785389521.01 total 40.10 last 37.75)
 - open/close 1980 (time 1785389531.05 total 50.13 last 33.09)
 - open/close 2401 (time 1785389541.05 total 60.14 last 42.09)
 - open/close 2809 (time 1785389551.06 total 70.15 last 40.76)
 - open/close 3299 (time 1785389561.08 total 80.17 last 48.91)
 - open/close 3739 (time 1785389571.10 total 90.18 last 43.93)
 - open/close 4216 (time 1785389581.12 total 100.20 last 47.61)
 - open/close 4717 (time 1785389591.12 total 110.20 last 50.08)
 - open/close 5235 (time 1785389601.13 total 120.21 last 51.75)
 - open/close 5927 (time 1785389611.14 total 130.22 last 69.13)
 - open/close 6416 (time 1785389621.15 total 140.23 last 48.85)
 - open/close 6847 (time 1785389631.16 total 150.24 last 43.05)
 - open/close 7299 (time 1785389641.16 total 160.25 last 45.19)
 - open/close 7892 (time 1785389651.17 total 170.26 last 59.22)
 - open/close 8477 (time 1785389661.18 total 180.27 last 58.44)
 - open/close 8907 (time 1785389671.22 total 190.30 last 42.86)
 - open/close 9387 (time 1785389681.25 total 200.34 last 47.83)
 - open/close 9772 (time 1785389691.26 total 210.35 last 38.46)
total: 10000 open/close in 216.73 seconds: 46.14 ops/second
 - unlinked 0 (time 1785389708 ; total 0 ; last 0)
total: 10000 unlinks in 125 seconds: 80.000000 unlinks/second
 - open/close 600 (time 1785389849.56 total 10.00 last 59.99)
 - open/close 1092 (time 1785389859.59 total 20.03 last 49.07)
 - open/close 1746 (time 1785389869.60 total 30.04 last 65.34)
 - open/close 2324 (time 1785389879.61 total 40.05 last 57.74)
 - open/close 2880 (time 1785389889.62 total 50.06 last 55.53)
 - open/close 3378 (time 1785389899.63 total 60.07 last 49.78)
 - open/close 3881 (time 1785389909.63 total 70.07 last 50.30)
 - open/close 4359 (time 1785389919.63 total 80.07 last 47.77)
 - open/close 4937 (time 1785389929.64 total 90.08 last 57.76)
 - open/close 5475 (time 1785389939.66 total 100.10 last 53.67)
 - open/close 5893 (time 1785389949.68 total 110.12 last 41.73)
 - open/close 6260 (time 1785389959.68 total 120.12 last 36.70)
 - open/close 6672 (time 1785389969.69 total 130.13 last 41.16)
 - open/close 7408 (time 1785389979.70 total 140.13 last 73.57)
 - open/close 8187 (time 1785389989.70 total 150.14 last 77.88)
 - open/close 8643 (time 1785389999.71 total 160.15 last 45.56)
 - open/close 9039 (time 1785390009.71 total 170.15 last 39.60)
 - open/close 9502 (time 1785390019.72 total 180.16 last 46.23)
total: 10000 open/close in 187.58 seconds: 53.31 ops/second
 - unlinked 0 (time 1785390033 ; total 0 ; last 0)
total: 10000 unlinks in 111 seconds: 90.090088 unlinks/second
 - open/close 601 (time 1785390160.62 total 10.01 last 60.05)
 - open/close 1146 (time 1785390170.65 total 20.04 last 54.33)
 - open/close 1716 (time 1785390180.67 total 30.06 last 56.86)
 - open/close 2223 (time 1785390190.68 total 40.07 last 50.67)
 - open/close 2681 (time 1785390200.70 total 50.09 last 45.70)
 - open/close 3083 (time 1785390210.70 total 60.09 last 40.19)
 - open/close 3686 (time 1785390220.70 total 70.09 last 60.30)
 - open/close 4309 (time 1785390230.71 total 80.10 last 62.26)
 - open/close 4781 (time 1785390240.71 total 90.11 last 47.18)
 - open/close 5323 (time 1785390250.72 total 100.11 last 54.18)
 - open/close 5860 (time 1785390260.72 total 110.11 last 53.69)
 - open/close 6489 (time 1785390270.73 total 120.12 last 62.85)
 - open/close 7080 (time 1785390280.74 total 130.13 last 59.01)
 - open/close 7866 (time 1785390290.75 total 140.14 last 78.56)
 - open/close 8629 (time 1785390300.76 total 150.15 last 76.23)
 - open/close 9165 (time 1785390310.77 total 160.16 last 53.52)
 - open/close 9717 (time 1785390320.80 total 170.20 last 55.02)
total: 10000 open/close in 175.81 seconds: 56.88 ops/second
 - unlinked 0 (time 1785390331 ; total 0 ; last 0)
total: 10000 unlinks in 106 seconds: 94.339622 unlinks/second
 - open/close 396 (time 1785390454.39 total 10.00 last 39.59)
 - open/close 969 (time 1785390464.40 total 20.01 last 57.27)
 - open/close 1507 (time 1785390474.40 total 30.01 last 53.79)
 - open/close 2172 (time 1785390484.40 total 40.01 last 66.46)
 - open/close 2834 (time 1785390494.41 total 50.02 last 66.18)
 - open/close 3285 (time 1785390504.41 total 60.02 last 45.09)
 - open/close 3766 (time 1785390514.42 total 70.03 last 48.05)
 - open/close 4540 (time 1785390524.44 total 80.05 last 77.23)
 - open/close 5043 (time 1785390534.44 total 90.05 last 50.28)
 - open/close 5888 (time 1785390544.45 total 100.06 last 84.45)
 - open/close 6668 (time 1785390554.47 total 110.08 last 77.83)
 - open/close 7392 (time 1785390564.48 total 120.09 last 72.37)
 - open/close 8220 (time 1785390574.49 total 130.10 last 82.68)
 - open/close 8759 (time 1785390584.50 total 140.11 last 53.83)
 - open/close 9265 (time 1785390594.51 total 150.12 last 50.56)
 - open/close 9785 (time 1785390604.52 total 160.13 last 51.97)
total: 10000 open/close in 165.85 seconds: 60.30 ops/second
 - unlinked 0 (time 1785390619 ; total 0 ; last 0)
total: 10000 unlinks in 129 seconds: 77.519379 unlinks/second
 - open/close 516 (time 1785390766.57 total 10.01 last 51.54)
 - open/close 1179 (time 1785390776.57 total 20.01 last 66.29)
 - open/close 1626 (time 1785390786.57 total 30.02 last 44.68)
 - open/close 2064 (time 1785390796.57 total 40.02 last 43.79)
 - open/close 2568 (time 1785390806.58 total 50.03 last 50.36)
 - open/close 3283 (time 1785390816.61 total 60.05 last 71.33)
 - open/close 3784 (time 1785390826.62 total 70.06 last 50.05)
 - open/close 4268 (time 1785390836.64 total 80.08 last 48.31)
 - open/close 4746 (time 1785390846.66 total 90.10 last 47.70)
 - open/close 5170 (time 1785390856.67 total 100.11 last 42.35)
 - open/close 5630 (time 1785390866.68 total 110.12 last 45.95)
 - open/close 6178 (time 1785390876.68 total 120.13 last 54.79)
 - open/close 7057 (time 1785390886.69 total 130.13 last 87.85)
 - open/close 7788 (time 1785390896.72 total 140.17 last 72.82)
 - open/close 8358 (time 1785390906.73 total 150.18 last 56.95)
 - open/close 8856 (time 1785390916.75 total 160.20 last 49.70)
 - open/close 9327 (time 1785390926.75 total 170.20 last 47.10)
 - open/close 9740 (time 1785390936.77 total 180.22 last 41.22)
total: 10000 open/close in 186.56 seconds: 53.60 ops/second
 - unlinked 0 (time 1785390950 ; total 0 ; last 0)
total: 10000 unlinks in 117 seconds: 85.470085 unlinks/second
 - open/close 567 (time 1785391083.02 total 10.01 last 56.65)
 - open/close 1003 (time 1785391093.02 total 20.01 last 43.59)
 - open/close 1549 (time 1785391103.02 total 30.01 last 54.59)
 - open/close 2093 (time 1785391113.04 total 40.03 last 54.32)
 - open/close 2651 (time 1785391123.05 total 50.04 last 55.71)
 - open/close 3295 (time 1785391133.06 total 60.05 last 64.36)
 - open/close 4178 (time 1785391143.06 total 70.05 last 88.30)
 - open/close 4777 (time 1785391153.07 total 80.06 last 59.83)
 - open/close 5306 (time 1785391163.09 total 90.08 last 52.82)
 - open/close 5793 (time 1785391173.09 total 100.08 last 48.67)
 - open/close 6290 (time 1785391183.11 total 110.10 last 49.62)
 - open/close 6761 (time 1785391193.12 total 120.11 last 47.05)
 - open/close 7385 (time 1785391203.13 total 130.12 last 62.31)
 - open/close 7871 (time 1785391213.13 total 140.12 last 48.60)
 - open/close 8542 (time 1785391223.14 total 150.13 last 67.03)
 - open/close 9205 (time 1785391233.15 total 160.15 last 66.23)
 - open/close 9776 (time 1785391243.16 total 170.15 last 57.08)
total: 10000 open/close in 174.56 seconds: 57.29 ops/second
 - unlinked 0 (time 1785391254 ; total 0 ; last 0)
total: 10000 unlinks in 128 seconds: 78.125000 unlinks/second
 - open/close 450 (time 1785391398.40 total 10.01 last 44.93)
 - open/close 857 (time 1785391408.41 total 20.03 last 40.65)
 - open/close 1394 (time 1785391418.41 total 30.03 last 53.70)
 - open/close 1776 (time 1785391428.44 total 40.05 last 38.11)
 - open/close 2234 (time 1785391438.44 total 50.06 last 45.78)
 - open/close 2792 (time 1785391448.44 total 60.06 last 55.78)
 - open/close 3481 (time 1785391458.44 total 70.06 last 68.89)
 - open/close 4368 (time 1785391468.45 total 80.06 last 88.69)
 - open/close 5272 (time 1785391478.47 total 90.08 last 90.21)
 - open/close 5738 (time 1785391488.47 total 100.09 last 46.58)
 - open/close 6450 (time 1785391498.48 total 110.10 last 71.13)
 - open/close 7578 (time 1785391508.49 total 120.10 last 112.71)
 - open/close 8321 (time 1785391518.49 total 130.11 last 74.27)
 - open/close 8846 (time 1785391528.50 total 140.12 last 52.46)
 - open/close 9559 (time 1785391538.50 total 150.12 last 71.27)
total: 10000 open/close in 156.02 seconds: 64.09 ops/second
 - unlinked 0 (time 1785391548 ; total 0 ; last 0)
total: 10000 unlinks in 114 seconds: 87.719299 unlinks/second
rm: missing operand
Try 'rm --help' for more information.
umount lustre on /mnt/lustre.....
Stopping client oleg221-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg221-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg221-server

   Permanent disk data:
Device:     lustre-ost1/ost1
Target:     lustre-OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x42
              (OST update )
Persistent mount opts: 
Parameters: mgsnode=192.168.202.121@tcp sys.timeout=20 autodegrade=on
mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde
mkfs_cmd = zfs create -o canmount=off  -o quota=409600000 lustre-ost1/ost1
  xattr=sa
  dnodesize=auto
  recordsize=1M
  compression=off
Writing lustre-ost1/ost1 properties
  lustre:mgsnode=192.168.202.121@tcp
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=66
  lustre:index=0
  lustre:fsname=lustre
  lustre:svname=lustre-OST0000
start ost1 service on oleg221-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg221-server: oleg221-server.virtnet: executing set_default_debug -1 all
pdsh@oleg221-client: oleg221-server: ssh exited with exit code 1
Started lustre-OST0000
oleg221-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
oleg221-server: oleg221-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50
oleg221-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
mount lustre  on /mnt/lustre.....
Starting client: oleg221-client.virtnet:  -o user_xattr,flock 192.168.202.121@tcp:/lustre /mnt/lustre
On OST0, 20326 used inodes rc=0
pdsh@oleg221-client: oleg221-server: ssh exited with exit code 22
umount lustre on /mnt/lustre.....
Stopping client oleg221-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg221-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg221-server

   Permanent disk data:
Device:     lustre-ost1/ost1
Target:     lustre:OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x62
              (OST first_time update )
Persistent mount opts: 
Parameters: mgsnode=192.168.202.121@tcp sys.timeout=20 autodegrade=on
mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde
mkfs_cmd = zfs create -o canmount=off  -o quota=409600000 lustre-ost1/ost1
  xattr=sa
  dnodesize=auto
  recordsize=1M
  compression=off
Writing lustre-ost1/ost1 properties
  lustre:mgsnode=192.168.202.121@tcp
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=98
  lustre:index=0
  lustre:fsname=lustre
  lustre:svname=lustre:OST0000
checking for existing Lustre data: found

   Read previous values:
Device:     lustre-ost1/ost1
Target:     lustre-OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x62
              (OST first_time update )
Persistent mount opts: 
Parameters: sys.timeout=20 autodegrade=on mgsnode=192.168.202.121@tcp

   Permanent disk data:
Device:     lustre-ost1/ost1
Target:     lustre-OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x42
              (OST update )
Persistent mount opts: 
Parameters: sys.timeout=20 autodegrade=on mgsnode=192.168.202.121@tcp autodegrade=on
  lustre:svname=lustre-OST0000
Writing lustre-ost1/ost1 properties
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:mgsnode=192.168.202.121@tcp
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=66
  lustre:index=0
  lustre:fsname=lustre
  lustre:svname=lustre-OST0000
start ost1 service on oleg221-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg221-server: oleg221-server.virtnet: executing set_default_debug -1 all
pdsh@oleg221-client: oleg221-server: ssh exited with exit code 1
Started lustre-OST0000
oleg221-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
oleg221-server: oleg221-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50
oleg221-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
mount lustre  on /mnt/lustre.....
Starting client: oleg221-client.virtnet:  -o user_xattr,flock 192.168.202.121@tcp:/lustre /mnt/lustre
umount lustre on /mnt/lustre.....
Stopping client oleg221-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg221-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg221-server
stop mds service on oleg221-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg221-server

unloading modules via unload_modules_local on: 'oleg221-server'
oleg221-server: oleg221-server.virtnet: executing unload_modules_local
oleg221-server: 
modules unloaded.
pdsh@oleg221-client: oleg221-server: ssh exited with exit code 2
pdsh@oleg221-client: oleg221-client: ssh exited with exit code 2
pdsh@oleg221-client: oleg221-server: ssh exited with exit code 2
pdsh@oleg221-client: oleg221-client: ssh exited with exit code 2