== conf-sanity test 69: replace an OST with the same index ========================================================== 17:26:35 (1785878795) start mds service on oleg344-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg344-server' oleg344-server: oleg344-server.virtnet: executing load_modules_local oleg344-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg344-server: Loading modules from /home/green/git/lustre-release/lustre oleg344-server: detected 4 online CPUs by sysfs oleg344-server: MODOPTS_LIBCFS= oleg344-server: Force libcfs to create 2 CPU partitions oleg344-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg344-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg344-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg344-server: oleg344-server.virtnet: executing set_default_debug -1 all pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg344-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg344-server: oleg344-server.virtnet: executing set_default_debug -1 all pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg344-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg344-server: oleg344-server.virtnet: executing set_default_debug -1 all pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 Started lustre-OST0000 oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg344-client.virtnet: -o user_xattr,flock 192.168.203.144@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 49503 inodes available. Want 99872. rc=0 - open/close 480 (time 1785878960.11 total 10.01 last 47.96) - open/close 987 (time 1785878970.13 total 20.02 last 50.63) - open/close 1562 (time 1785878980.13 total 30.02 last 57.49) - open/close 2019 (time 1785878990.14 total 40.03 last 45.66) - open/close 2526 (time 1785879000.14 total 50.04 last 50.67) - open/close 3163 (time 1785879010.16 total 60.05 last 63.60) - open/close 3693 (time 1785879020.18 total 70.07 last 52.92) - open/close 4158 (time 1785879030.19 total 80.09 last 46.42) - open/close 4650 (time 1785879040.20 total 90.09 last 49.17) - open/close 5202 (time 1785879050.20 total 100.10 last 55.18) - open/close 5719 (time 1785879060.22 total 110.11 last 51.62) - open/close 6207 (time 1785879070.23 total 120.13 last 48.72) - open/close 6767 (time 1785879080.25 total 130.14 last 55.93) - open/close 7235 (time 1785879090.25 total 140.14 last 46.78) - open/close 7792 (time 1785879100.28 total 150.17 last 55.53) - open/close 8352 (time 1785879110.28 total 160.18 last 55.98) - open/close 8849 (time 1785879120.33 total 170.23 last 49.46) - open/close 9387 (time 1785879130.35 total 180.24 last 53.72) - open/close 9918 (time 1785879140.36 total 190.25 last 53.04) total: 10000 open/close in 192.02 seconds: 52.08 ops/second - unlinked 0 (time 1785879147 ; total 0 ; last 0) total: 10000 unlinks in 102 seconds: 98.039215 unlinks/second - open/close 637 (time 1785879265.06 total 10.00 last 63.69) - open/close 1166 (time 1785879275.06 total 20.00 last 52.88) - open/close 1863 (time 1785879285.09 total 30.04 last 69.48) - open/close 2315 (time 1785879295.11 total 40.05 last 45.11) - open/close 2973 (time 1785879305.13 total 50.07 last 65.67) - open/close 3668 (time 1785879315.13 total 60.08 last 69.47) - open/close 4294 (time 1785879325.14 total 70.08 last 62.59) - open/close 4895 (time 1785879335.16 total 80.10 last 59.95) - open/close 5467 (time 1785879345.18 total 90.12 last 57.10) - open/close 5964 (time 1785879355.19 total 100.13 last 49.67) - open/close 6652 (time 1785879365.20 total 110.14 last 68.70) - open/close 7360 (time 1785879375.22 total 120.17 last 70.63) - open/close 7948 (time 1785879385.23 total 130.17 last 58.76) - open/close 8469 (time 1785879395.24 total 140.19 last 52.04) - open/close 9097 (time 1785879405.26 total 150.20 last 62.70) - open/close 9612 (time 1785879415.29 total 160.23 last 51.35) total: 10000 open/close in 166.33 seconds: 60.12 ops/second - unlinked 0 (time 1785879428 ; total 0 ; last 0) total: 10000 unlinks in 96 seconds: 104.166664 unlinks/second - open/close 461 (time 1785879540.49 total 10.03 last 45.98) - open/close 930 (time 1785879550.50 total 20.04 last 46.85) - open/close 1355 (time 1785879560.53 total 30.07 last 42.36) - open/close 1819 (time 1785879570.53 total 40.07 last 46.38) - open/close 2295 (time 1785879580.54 total 50.08 last 47.56) - open/close 2705 (time 1785879590.55 total 60.09 last 40.95) - open/close 3240 (time 1785879600.57 total 70.11 last 53.42) - open/close 3758 (time 1785879610.58 total 80.12 last 51.75) - open/close 4284 (time 1785879620.58 total 90.12 last 52.59) - open/close 4933 (time 1785879630.59 total 100.13 last 64.80) - open/close 5371 (time 1785879640.60 total 110.14 last 43.77) - open/close 5938 (time 1785879650.63 total 120.17 last 56.55) - open/close 6423 (time 1785879660.64 total 130.18 last 48.45) - open/close 6871 (time 1785879670.66 total 140.20 last 44.71) - open/close 7460 (time 1785879680.67 total 150.21 last 58.81) - open/close 7931 (time 1785879690.68 total 160.22 last 47.05) - open/close 8503 (time 1785879700.70 total 170.24 last 57.12) - open/close 9038 (time 1785879710.72 total 180.26 last 53.38) - open/close 9791 (time 1785879720.75 total 190.29 last 75.07) total: 10000 open/close in 194.71 seconds: 51.36 ops/second - unlinked 0 (time 1785879731 ; total 0 ; last 0) total: 10000 unlinks in 112 seconds: 89.285713 unlinks/second - open/close 446 (time 1785879861.27 total 10.01 last 44.54) - open/close 991 (time 1785879871.28 total 20.02 last 54.49) - open/close 1551 (time 1785879881.28 total 30.02 last 56.00) - open/close 2011 (time 1785879891.28 total 40.02 last 45.97) - open/close 2627 (time 1785879901.29 total 50.03 last 61.55) - open/close 3141 (time 1785879911.30 total 60.04 last 51.35) - open/close 3662 (time 1785879921.33 total 70.07 last 51.93) - open/close 4165 (time 1785879931.35 total 80.09 last 50.19) - open/close 4675 (time 1785879941.36 total 90.10 last 50.98) - open/close 5163 (time 1785879951.37 total 100.11 last 48.75) - open/close 5855 (time 1785879961.37 total 110.11 last 69.19) - open/close 6373 (time 1785879971.37 total 120.11 last 51.77) - open/close 6942 (time 1785879981.38 total 130.12 last 56.89) - open/close 7401 (time 1785879991.39 total 140.13 last 45.82) - open/close 7906 (time 1785880001.40 total 150.14 last 50.48) - open/close 8455 (time 1785880011.40 total 160.14 last 54.88) - open/close 8984 (time 1785880021.41 total 170.15 last 52.86) - open/close 9568 (time 1785880031.42 total 180.16 last 58.35) total: 10000 open/close in 188.74 seconds: 52.98 ops/second - unlinked 0 (time 1785880046 ; total 0 ; last 0) total: 10000 unlinks in 92 seconds: 108.695656 unlinks/second - open/close 489 (time 1785880153.83 total 10.01 last 48.87) - open/close 926 (time 1785880163.86 total 20.04 last 43.55) - open/close 1429 (time 1785880173.86 total 30.04 last 50.30) - open/close 1973 (time 1785880183.88 total 40.06 last 54.32) - open/close 2554 (time 1785880193.89 total 50.07 last 58.03) - open/close 3087 (time 1785880203.91 total 60.09 last 53.21) - open/close 3614 (time 1785880213.93 total 70.11 last 52.60) - open/close 4212 (time 1785880223.94 total 80.12 last 59.72) - open/close 4738 (time 1785880233.95 total 90.13 last 52.54) - open/close 5328 (time 1785880243.98 total 100.16 last 58.82) - open/close 6212 (time 1785880253.99 total 110.17 last 88.29) - open/close 6790 (time 1785880264.00 total 120.18 last 57.79) - open/close 7515 (time 1785880274.01 total 130.19 last 72.41) - open/close 8080 (time 1785880284.02 total 140.20 last 56.41) - open/close 8598 (time 1785880294.03 total 150.21 last 51.77) - open/close 9184 (time 1785880304.05 total 160.23 last 58.49) - open/close 9625 (time 1785880314.05 total 170.23 last 44.10) total: 10000 open/close in 176.03 seconds: 56.81 ops/second - unlinked 0 (time 1785880328 ; total 0 ; last 0) total: 10000 unlinks in 96 seconds: 104.166664 unlinks/second - open/close 506 (time 1785880441.13 total 10.02 last 50.51) - open/close 890 (time 1785880451.15 total 20.03 last 38.36) - open/close 1191 (time 1785880461.17 total 30.06 last 30.02) - open/close 1667 (time 1785880471.19 total 40.07 last 47.52) - open/close 2281 (time 1785880481.21 total 50.09 last 61.29) - open/close 2809 (time 1785880491.22 total 60.10 last 52.76) - open/close 3261 (time 1785880501.26 total 70.14 last 45.01) - open/close 3704 (time 1785880511.27 total 80.15 last 44.27) - open/close 4180 (time 1785880521.27 total 90.16 last 47.56) - open/close 4790 (time 1785880531.28 total 100.17 last 60.95) - open/close 5377 (time 1785880541.29 total 110.17 last 58.65) - open/close 5799 (time 1785880551.30 total 120.18 last 42.16) - open/close 6271 (time 1785880561.31 total 130.19 last 47.14) - open/close 6715 (time 1785880571.31 total 140.20 last 44.39) - open/close 7285 (time 1785880581.32 total 150.21 last 56.95) - open/close 7960 (time 1785880591.33 total 160.22 last 67.43) - open/close 8570 (time 1785880601.34 total 170.22 last 60.97) - open/close 9044 (time 1785880611.36 total 180.24 last 47.31) - open/close 9609 (time 1785880621.39 total 190.27 last 56.33) total: 10000 open/close in 195.37 seconds: 51.18 ops/second - unlinked 0 (time 1785880632 ; total 0 ; last 0) total: 10000 unlinks in 94 seconds: 106.382980 unlinks/second - open/close 512 (time 1785880742.33 total 10.03 last 51.06) - open/close 1015 (time 1785880752.34 total 20.04 last 50.23) - open/close 1420 (time 1785880762.35 total 30.05 last 40.47) - open/close 1971 (time 1785880772.35 total 40.05 last 55.10) - open/close 2539 (time 1785880782.35 total 50.06 last 56.75) - open/close 3065 (time 1785880792.36 total 60.07 last 52.55) - open/close 3532 (time 1785880802.39 total 70.09 last 46.60) - open/close 3964 (time 1785880812.39 total 80.09 last 43.19) - open/close 4502 (time 1785880822.39 total 90.09 last 53.78) - open/close 5035 (time 1785880832.39 total 100.09 last 53.29) - open/close 5627 (time 1785880842.41 total 110.11 last 59.09) - open/close 6273 (time 1785880852.43 total 120.14 last 64.46) - open/close 6815 (time 1785880862.44 total 130.14 last 54.18) - open/close 7353 (time 1785880872.44 total 140.14 last 53.79) - open/close 7925 (time 1785880882.46 total 150.16 last 57.10) - open/close 8465 (time 1785880892.48 total 160.18 last 53.88) - open/close 8991 (time 1785880902.48 total 170.18 last 52.59) - open/close 9496 (time 1785880912.49 total 180.19 last 50.44) total: 10000 open/close in 188.21 seconds: 53.13 ops/second - unlinked 0 (time 1785880926 ; total 0 ; last 0) total: 10000 unlinks in 100 seconds: 100.000000 unlinks/second - open/close 740 (time 1785881042.35 total 10.01 last 73.89) - open/close 1465 (time 1785881052.36 total 20.02 last 72.44) - open/close 1989 (time 1785881062.37 total 30.03 last 52.37) - open/close 2487 (time 1785881072.37 total 40.04 last 49.75) - open/close 2971 (time 1785881082.38 total 50.04 last 48.39) - open/close 3551 (time 1785881092.38 total 60.05 last 57.96) - open/close 4017 (time 1785881102.39 total 70.06 last 46.56) - open/close 4491 (time 1785881112.42 total 80.09 last 47.26) - open/close 4896 (time 1785881122.43 total 90.09 last 40.47) - open/close 5429 (time 1785881132.43 total 100.10 last 53.28) - open/close 5965 (time 1785881142.44 total 110.10 last 53.58) - open/close 6488 (time 1785881152.44 total 120.10 last 52.28) - open/close 6900 (time 1785881162.47 total 130.14 last 41.07) - open/close 7397 (time 1785881172.48 total 140.15 last 49.64) - open/close 8157 (time 1785881182.49 total 150.15 last 75.99) - open/close 8664 (time 1785881192.50 total 160.16 last 50.63) - open/close 9182 (time 1785881202.52 total 170.18 last 51.71) - open/close 9670 (time 1785881212.53 total 180.19 last 48.74) total: 10000 open/close in 186.09 seconds: 53.74 ops/second - unlinked 0 (time 1785881224 ; total 0 ; last 0) total: 10000 unlinks in 96 seconds: 104.166664 unlinks/second - open/close 533 (time 1785881336.67 total 10.03 last 53.16) - open/close 1175 (time 1785881346.69 total 20.05 last 64.05) - open/close 1571 (time 1785881356.70 total 30.06 last 39.57) - open/close 2100 (time 1785881366.72 total 40.08 last 52.79) - open/close 2536 (time 1785881376.72 total 50.08 last 43.59) - open/close 3032 (time 1785881386.74 total 60.10 last 49.50) - open/close 3612 (time 1785881396.75 total 70.11 last 57.96) - open/close 4125 (time 1785881406.77 total 80.13 last 51.19) - open/close 4780 (time 1785881416.78 total 90.14 last 65.43) - open/close 5531 (time 1785881426.79 total 100.15 last 75.02) - open/close 6077 (time 1785881436.80 total 110.16 last 54.56) - open/close 6558 (time 1785881446.82 total 120.18 last 48.01) - open/close 7211 (time 1785881456.82 total 130.18 last 65.30) - open/close 7655 (time 1785881466.85 total 140.21 last 44.25) - open/close 8103 (time 1785881476.85 total 150.21 last 44.79) - open/close 8546 (time 1785881486.86 total 160.22 last 44.27) - open/close 9171 (time 1785881496.86 total 170.22 last 62.47) - open/close 9860 (time 1785881506.88 total 180.24 last 68.78) total: 10000 open/close in 182.67 seconds: 54.74 ops/second - unlinked 0 (time 1785881515 ; total 0 ; last 0) total: 10000 unlinks in 112 seconds: 89.285713 unlinks/second - open/close 469 (time 1785881643.36 total 10.01 last 46.83) - open/close 1019 (time 1785881653.37 total 20.02 last 54.94) - open/close 1589 (time 1785881663.38 total 30.03 last 56.94) - open/close 2264 (time 1785881673.39 total 40.05 last 67.42) - open/close 2809 (time 1785881683.40 total 50.05 last 54.45) - open/close 3426 (time 1785881693.41 total 60.07 last 61.58) - open/close 3950 (time 1785881703.42 total 70.08 last 52.38) - open/close 4364 (time 1785881713.43 total 80.08 last 41.37) - open/close 4728 (time 1785881723.47 total 90.13 last 36.25) - open/close 5238 (time 1785881733.48 total 100.14 last 50.95) - open/close 5908 (time 1785881743.49 total 110.15 last 66.90) - open/close 6422 (time 1785881753.51 total 120.17 last 51.32) - open/close 6972 (time 1785881763.53 total 130.19 last 54.86) - open/close 7455 (time 1785881773.55 total 140.21 last 48.24) - open/close 7903 (time 1785881783.56 total 150.22 last 44.73) - open/close 8419 (time 1785881793.57 total 160.23 last 51.55) - open/close 9075 (time 1785881803.57 total 170.23 last 65.59) - open/close 9708 (time 1785881813.58 total 180.24 last 63.27) total: 10000 open/close in 186.23 seconds: 53.70 ops/second - unlinked 0 (time 1785881825 ; total 0 ; last 0) total: 10000 unlinks in 104 seconds: 96.153847 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg344-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg344-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg344-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.144@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre-OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre-OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k start ost1 service on oleg344-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg344-server: oleg344-server.virtnet: executing set_default_debug -1 all pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 Started lustre-OST0000 oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg344-server: oleg344-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg344-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg344-server: oleg344-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg344-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg344-client.virtnet: -o user_xattr,flock 192.168.203.144@tcp:/lustre /mnt/lustre On OST0, 20430 used inodes rc=0 pdsh@oleg344-client: oleg344-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg344-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg344-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg344-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.144@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre:OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k checking for existing Lustre data: found Read previous values: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.144@tcp sys.timeout=20 Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.203.144@tcp sys.timeout=20 start ost1 service on oleg344-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg344-server: oleg344-server.virtnet: executing set_default_debug -1 all pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 Started lustre-OST0000 oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg344-server: oleg344-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg344-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg344-server: oleg344-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg344-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg344-client.virtnet: -o user_xattr,flock 192.168.203.144@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg344-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg344-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg344-server stop mds service on oleg344-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg344-server stop mds service on oleg344-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg344-server unloading modules via unload_modules_local on: 'oleg344-server' oleg344-server: oleg344-server.virtnet: executing unload_modules_local oleg344-server: modules unloaded. pdsh@oleg344-client: oleg344-server: ssh exited with exit code 2 pdsh@oleg344-client: oleg344-client: ssh exited with exit code 2 pdsh@oleg344-client: oleg344-client: ssh exited with exit code 2 pdsh@oleg344-client: oleg344-server: ssh exited with exit code 2