== lnet-selftest test smoke: lst regression test ========= 02:23:50 (1787552630) oleg613-client: oleg613-client.virtnet: executing lst_cleanup oleg613-server: oleg613-server.virtnet: executing lst_cleanup oleg613-client: oleg613-client.virtnet: executing lst_setup oleg613-server: oleg613-server.virtnet: executing lst_setup #!/usr/bin/bash set -e cleanup () { trap 0; echo killing $1 ... ; kill -9 $1 || true; } /home/green/git/lustre-release/lustre/../lnet/utils/lst new_session --timeo 100000 hh /home/green/git/lustre-release/lustre/../lnet/utils/lst add_group c 192.168.206.13@tcp /home/green/git/lustre-release/lustre/../lnet/utils/lst add_group s 192.168.206.113@tcp echo '=====================================' echo 'Listing of bad_group should not crash' echo '=====================================' /home/green/git/lustre-release/lustre/../lnet/utils/lst list_group s bad_group c /home/green/git/lustre-release/lustre/../lnet/utils/lst add_batch b echo '=====================================' echo 'A bulk offset must not overrun the bulk' echo '=====================================' /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --from c --to s brw read check=full size=4096 off=8 echo '=====================================' echo 'A whole page offset must not be counted twice' echo '=====================================' /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --from c --to s brw read check=full size=4096 off=4096 /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from c --to s brw write check=full size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from s --to c brw write check=full size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from c --to s brw write size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from s --to c brw write size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from c --to s brw write check=discard size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from s --to c brw write check=discard size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from c --to s brw write check=full size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from s --to c brw write check=full size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from c --to s brw write size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from s --to c brw write size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from c --to s brw write check=discard size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from s --to c brw write check=discard size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from c --to s brw write check=full size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from s --to c brw write check=full size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from c --to s brw write size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from s --to c brw write size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from c --to s brw write check=discard size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from s --to c brw write check=discard size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from c --to s brw write check=full size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from s --to c brw write check=full size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from c --to s brw write size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from s --to c brw write size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from c --to s brw write check=discard size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from s --to c brw write check=discard size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from c --to s brw read check=full size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from s --to c brw read check=full size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from c --to s brw read size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from s --to c brw read size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from c --to s brw read check=discard size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from s --to c brw read check=discard size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from c --to s brw read check=full size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from s --to c brw read check=full size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from c --to s brw read size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from s --to c brw read size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from c --to s brw read check=discard size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from s --to c brw read check=discard size=4k /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from c --to s brw read check=full size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from s --to c brw read check=full size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from c --to s brw read size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from s --to c brw read size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from c --to s brw read check=discard size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from s --to c brw read check=discard size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from c --to s brw read check=full size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from s --to c brw read check=full size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from c --to s brw read size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from s --to c brw read size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from c --to s brw read check=discard size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from s --to c brw read check=discard size=1M /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from c --to s ping /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from s --to c ping /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from c --to s ping /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from s --to c ping /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from c --to s ping /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 1 --distribute 1:1 --from s --to c ping /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from c --to s ping /home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000 --concurrency 8 --distribute 1:1 --from s --to c ping /home/green/git/lustre-release/lustre/../lnet/utils/lst run b sleep 1 /home/green/git/lustre-release/lustre/../lnet/utils/lst stat --delay 10 --timeout 10 c s & pid=$! trap "cleanup $pid" INT TERM sleep 300 cleanup $pid SESSION: hh FEATURES: 1 TIMEOUT: 100000 FORCE: No 192.168.206.13@tcp are added to session 192.168.206.113@tcp are added to session ===================================== Listing of bad_group should not crash ===================================== 1 0 0 0 1 (null) 1 0 0 0 1 (null) ===================================== A bulk offset must not overrun the bulk ===================================== Test was added successfully ===================================== A whole page offset must not be counted twice ===================================== Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully Test was added successfully b is running now [LNet Rates of c] [R] Avg: 614 RPC/s Min: 614 RPC/s Max: 614 RPC/s [W] Avg: 620 RPC/s Min: 620 RPC/s Max: 620 RPC/s [LNet Bandwidth of c] [R] Avg: 70.32 MiB/s Min: 70.32 MiB/s Max: 70.32 MiB/s [W] Avg: 72.68 MiB/s Min: 72.68 MiB/s Max: 72.68 MiB/s [LNet Rates of s] [R] Avg: 623 RPC/s Min: 623 RPC/s Max: 623 RPC/s [W] Avg: 619 RPC/s Min: 619 RPC/s Max: 619 RPC/s [LNet Bandwidth of s] [R] Avg: 72.85 MiB/s Min: 72.85 MiB/s Max: 72.85 MiB/s [W] Avg: 70.48 MiB/s Min: 70.48 MiB/s Max: 70.48 MiB/s [LNet Rates of c] [R] Avg: 646 RPC/s Min: 646 RPC/s Max: 646 RPC/s [W] Avg: 650 RPC/s Min: 650 RPC/s Max: 650 RPC/s [LNet Bandwidth of c] [R] Avg: 75.32 MiB/s Min: 75.32 MiB/s Max: 75.32 MiB/s [W] Avg: 76.90 MiB/s Min: 76.90 MiB/s Max: 76.90 MiB/s [LNet Rates of s] [R] Avg: 653 RPC/s Min: 653 RPC/s Max: 653 RPC/s [W] Avg: 651 RPC/s Min: 651 RPC/s Max: 651 RPC/s [LNet Bandwidth of s] [R] Avg: 76.78 MiB/s Min: 76.78 MiB/s Max: 76.78 MiB/s [W] Avg: 75.30 MiB/s Min: 75.30 MiB/s Max: 75.30 MiB/s [LNet Rates of c] [R] Avg: 545 RPC/s Min: 545 RPC/s Max: 545 RPC/s [W] Avg: 520 RPC/s Min: 520 RPC/s Max: 520 RPC/s [LNet Bandwidth of c] [R] Avg: 60.56 MiB/s Min: 60.56 MiB/s Max: 60.56 MiB/s [W] Avg: 61.34 MiB/s Min: 61.34 MiB/s Max: 61.34 MiB/s [LNet Rates of s] [R] Avg: 541 RPC/s Min: 541 RPC/s Max: 541 RPC/s [W] Avg: 539 RPC/s Min: 539 RPC/s Max: 539 RPC/s [LNet Bandwidth of s] [R] Avg: 61.51 MiB/s Min: 61.51 MiB/s Max: 61.51 MiB/s [W] Avg: 60.27 MiB/s Min: 60.27 MiB/s Max: 60.27 MiB/s [LNet Rates of c] [R] Avg: 534 RPC/s Min: 534 RPC/s Max: 534 RPC/s [W] Avg: 564 RPC/s Min: 564 RPC/s Max: 564 RPC/s [LNet Bandwidth of c] [R] Avg: 63.02 MiB/s Min: 63.02 MiB/s Max: 63.02 MiB/s [W] Avg: 64.76 MiB/s Min: 64.76 MiB/s Max: 64.76 MiB/s [LNet Rates of s] [R] Avg: 549 RPC/s Min: 549 RPC/s Max: 549 RPC/s [W] Avg: 545 RPC/s Min: 545 RPC/s Max: 545 RPC/s [LNet Bandwidth of s] [R] Avg: 64.51 MiB/s Min: 64.51 MiB/s Max: 64.51 MiB/s [W] Avg: 63.67 MiB/s Min: 63.67 MiB/s Max: 63.67 MiB/s [LNet Rates of c] [R] Avg: 654 RPC/s Min: 654 RPC/s Max: 654 RPC/s [W] Avg: 651 RPC/s Min: 651 RPC/s Max: 651 RPC/s [LNet Bandwidth of c] [R] Avg: 77.93 MiB/s Min: 77.93 MiB/s Max: 77.93 MiB/s [W] Avg: 78.25 MiB/s Min: 78.25 MiB/s Max: 78.25 MiB/s [LNet Rates of s] [R] Avg: 653 RPC/s Min: 653 RPC/s Max: 653 RPC/s [W] Avg: 680 RPC/s Min: 680 RPC/s Max: 680 RPC/s [LNet Bandwidth of s] [R] Avg: 78.42 MiB/s Min: 78.42 MiB/s Max: 78.42 MiB/s [W] Avg: 77.68 MiB/s Min: 77.68 MiB/s Max: 77.68 MiB/s [LNet Rates of c] [R] Avg: 733 RPC/s Min: 733 RPC/s Max: 733 RPC/s [W] Avg: 713 RPC/s Min: 713 RPC/s Max: 713 RPC/s [LNet Bandwidth of c] [R] Avg: 83.21 MiB/s Min: 83.21 MiB/s Max: 83.21 MiB/s [W] Avg: 84.79 MiB/s Min: 84.79 MiB/s Max: 84.79 MiB/s [LNet Rates of s] [R] Avg: 737 RPC/s Min: 737 RPC/s Max: 737 RPC/s [W] Avg: 711 RPC/s Min: 711 RPC/s Max: 711 RPC/s [LNet Bandwidth of s] [R] Avg: 84.75 MiB/s Min: 84.75 MiB/s Max: 84.75 MiB/s [W] Avg: 83.17 MiB/s Min: 83.17 MiB/s Max: 83.17 MiB/s [LNet Rates of c] [R] Avg: 774 RPC/s Min: 774 RPC/s Max: 774 RPC/s [W] Avg: 798 RPC/s Min: 798 RPC/s Max: 798 RPC/s [LNet Bandwidth of c] [R] Avg: 90.56 MiB/s Min: 90.56 MiB/s Max: 90.56 MiB/s [W] Avg: 91.52 MiB/s Min: 91.52 MiB/s Max: 91.52 MiB/s [LNet Rates of s] [R] Avg: 780 RPC/s Min: 780 RPC/s Max: 780 RPC/s [W] Avg: 779 RPC/s Min: 779 RPC/s Max: 779 RPC/s [LNet Bandwidth of s] [R] Avg: 91.57 MiB/s Min: 91.57 MiB/s Max: 91.57 MiB/s [W] Avg: 90.61 MiB/s Min: 90.61 MiB/s Max: 90.61 MiB/s [LNet Rates of c] [R] Avg: 961 RPC/s Min: 961 RPC/s Max: 961 RPC/s [W] Avg: 958 RPC/s Min: 958 RPC/s Max: 958 RPC/s [LNet Bandwidth of c] [R] Avg: 111.70 MiB/s Min: 111.70 MiB/s Max: 111.70 MiB/s [W] Avg: 111.79 MiB/s Min: 111.79 MiB/s Max: 111.79 MiB/s [LNet Rates of s] [R] Avg: 958 RPC/s Min: 958 RPC/s Max: 958 RPC/s [W] Avg: 959 RPC/s Min: 959 RPC/s Max: 959 RPC/s [LNet Bandwidth of s] [R] Avg: 111.40 MiB/s Min: 111.40 MiB/s Max: 111.40 MiB/s [W] Avg: 111.70 MiB/s Min: 111.70 MiB/s Max: 111.70 MiB/s [LNet Rates of c] [R] Avg: 975 RPC/s Min: 975 RPC/s Max: 975 RPC/s [W] Avg: 978 RPC/s Min: 978 RPC/s Max: 978 RPC/s [LNet Bandwidth of c] [R] Avg: 113.59 MiB/s Min: 113.59 MiB/s Max: 113.59 MiB/s [W] Avg: 114.86 MiB/s Min: 114.86 MiB/s Max: 114.86 MiB/s [LNet Rates of s] [R] Avg: 986 RPC/s Min: 986 RPC/s Max: 986 RPC/s [W] Avg: 983 RPC/s Min: 983 RPC/s Max: 983 RPC/s [LNet Bandwidth of s] [R] Avg: 115.75 MiB/s Min: 115.75 MiB/s Max: 115.75 MiB/s [W] Avg: 113.62 MiB/s Min: 113.62 MiB/s Max: 113.62 MiB/s [LNet Rates of c] [R] Avg: 1089 RPC/s Min: 1089 RPC/s Max: 1089 RPC/s [W] Avg: 1091 RPC/s Min: 1091 RPC/s Max: 1091 RPC/s [LNet Bandwidth of c] [R] Avg: 127.49 MiB/s Min: 127.49 MiB/s Max: 127.49 MiB/s [W] Avg: 128.96 MiB/s Min: 128.96 MiB/s Max: 128.96 MiB/s [LNet Rates of s] [R] Avg: 1094 RPC/s Min: 1094 RPC/s Max: 1094 RPC/s [W] Avg: 1092 RPC/s Min: 1092 RPC/s Max: 1092 RPC/s [LNet Bandwidth of s] [R] Avg: 128.60 MiB/s Min: 128.60 MiB/s Max: 128.60 MiB/s [W] Avg: 127.32 MiB/s Min: 127.32 MiB/s Max: 127.32 MiB/s [LNet Rates of c] [R] Avg: 1075 RPC/s Min: 1075 RPC/s Max: 1075 RPC/s [W] Avg: 1065 RPC/s Min: 1065 RPC/s Max: 1065 RPC/s [LNet Bandwidth of c] [R] Avg: 123.16 MiB/s Min: 123.16 MiB/s Max: 123.16 MiB/s [W] Avg: 125.35 MiB/s Min: 125.35 MiB/s Max: 125.35 MiB/s [LNet Rates of s] [R] Avg: 1085 RPC/s Min: 1085 RPC/s Max: 1085 RPC/s [W] Avg: 1075 RPC/s Min: 1075 RPC/s Max: 1075 RPC/s [LNet Bandwidth of s] [R] Avg: 125.19 MiB/s Min: 125.19 MiB/s Max: 125.19 MiB/s [W] Avg: 123.02 MiB/s Min: 123.02 MiB/s Max: 123.02 MiB/s [LNet Rates of c] [R] Avg: 751 RPC/s Min: 751 RPC/s Max: 751 RPC/s [W] Avg: 767 RPC/s Min: 767 RPC/s Max: 767 RPC/s [LNet Bandwidth of c] [R] Avg: 88.13 MiB/s Min: 88.13 MiB/s Max: 88.13 MiB/s [W] Avg: 87.32 MiB/s Min: 87.32 MiB/s Max: 87.32 MiB/s [LNet Rates of s] [R] Avg: 751 RPC/s Min: 751 RPC/s Max: 751 RPC/s [W] Avg: 755 RPC/s Min: 755 RPC/s Max: 755 RPC/s [LNet Bandwidth of s] [R] Avg: 87.11 MiB/s Min: 87.11 MiB/s Max: 87.11 MiB/s [W] Avg: 88.52 MiB/s Min: 88.52 MiB/s Max: 88.52 MiB/s [LNet Rates of c] [R] Avg: 697 RPC/s Min: 697 RPC/s Max: 697 RPC/s [W] Avg: 693 RPC/s Min: 693 RPC/s Max: 693 RPC/s [LNet Bandwidth of c] [R] Avg: 81.96 MiB/s Min: 81.96 MiB/s Max: 81.96 MiB/s [W] Avg: 81.17 MiB/s Min: 81.17 MiB/s Max: 81.17 MiB/s [LNet Rates of s] [R] Avg: 696 RPC/s Min: 696 RPC/s Max: 696 RPC/s [W] Avg: 699 RPC/s Min: 699 RPC/s Max: 699 RPC/s [LNet Bandwidth of s] [R] Avg: 81.27 MiB/s Min: 81.27 MiB/s Max: 81.27 MiB/s [W] Avg: 81.68 MiB/s Min: 81.68 MiB/s Max: 81.68 MiB/s [LNet Rates of c] [R] Avg: 852 RPC/s Min: 852 RPC/s Max: 852 RPC/s [W] Avg: 854 RPC/s Min: 854 RPC/s Max: 854 RPC/s [LNet Bandwidth of c] [R] Avg: 99.43 MiB/s Min: 99.43 MiB/s Max: 99.43 MiB/s [W] Avg: 99.76 MiB/s Min: 99.76 MiB/s Max: 99.76 MiB/s [LNet Rates of s] [R] Avg: 857 RPC/s Min: 857 RPC/s Max: 857 RPC/s [W] Avg: 856 RPC/s Min: 856 RPC/s Max: 856 RPC/s [LNet Bandwidth of s] [R] Avg: 99.68 MiB/s Min: 99.68 MiB/s Max: 99.68 MiB/s [W] Avg: 99.56 MiB/s Min: 99.56 MiB/s Max: 99.56 MiB/s [LNet Rates of c] [R] Avg: 827 RPC/s Min: 827 RPC/s Max: 827 RPC/s [W] Avg: 809 RPC/s Min: 809 RPC/s Max: 809 RPC/s [LNet Bandwidth of c] [R] Avg: 95.45 MiB/s Min: 95.45 MiB/s Max: 95.45 MiB/s [W] Avg: 97.28 MiB/s Min: 97.28 MiB/s Max: 97.28 MiB/s [LNet Rates of s] [R] Avg: 826 RPC/s Min: 826 RPC/s Max: 826 RPC/s [W] Avg: 829 RPC/s Min: 829 RPC/s Max: 829 RPC/s [LNet Bandwidth of s] [R] Avg: 97.43 MiB/s Min: 97.43 MiB/s Max: 97.43 MiB/s [W] Avg: 95.32 MiB/s Min: 95.32 MiB/s Max: 95.32 MiB/s [LNet Rates of c] [R] Avg: 770 RPC/s Min: 770 RPC/s Max: 770 RPC/s [W] Avg: 759 RPC/s Min: 759 RPC/s Max: 759 RPC/s [LNet Bandwidth of c] [R] Avg: 88.54 MiB/s Min: 88.54 MiB/s Max: 88.54 MiB/s [W] Avg: 89.20 MiB/s Min: 89.20 MiB/s Max: 89.20 MiB/s [LNet Rates of s] [R] Avg: 762 RPC/s Min: 762 RPC/s Max: 762 RPC/s [W] Avg: 766 RPC/s Min: 766 RPC/s Max: 766 RPC/s [LNet Bandwidth of s] [R] Avg: 89.39 MiB/s Min: 89.39 MiB/s Max: 89.39 MiB/s [W] Avg: 88.45 MiB/s Min: 88.45 MiB/s Max: 88.45 MiB/s [LNet Rates of c] [R] Avg: 724 RPC/s Min: 724 RPC/s Max: 724 RPC/s [W] Avg: 743 RPC/s Min: 743 RPC/s Max: 743 RPC/s [LNet Bandwidth of c] [R] Avg: 86.34 MiB/s Min: 86.34 MiB/s Max: 86.34 MiB/s [W] Avg: 86.00 MiB/s Min: 86.00 MiB/s Max: 86.00 MiB/s [LNet Rates of s] [R] Avg: 724 RPC/s Min: 724 RPC/s Max: 724 RPC/s [W] Avg: 751 RPC/s Min: 751 RPC/s Max: 751 RPC/s [LNet Bandwidth of s] [R] Avg: 85.21 MiB/s Min: 85.21 MiB/s Max: 85.21 MiB/s [W] Avg: 85.88 MiB/s Min: 85.88 MiB/s Max: 85.88 MiB/s [LNet Rates of c] [R] Avg: 744 RPC/s Min: 744 RPC/s Max: 744 RPC/s [W] Avg: 739 RPC/s Min: 739 RPC/s Max: 739 RPC/s [LNet Bandwidth of c] [R] Avg: 86.80 MiB/s Min: 86.80 MiB/s Max: 86.80 MiB/s [W] Avg: 84.91 MiB/s Min: 84.91 MiB/s Max: 84.91 MiB/s [LNet Rates of s] [R] Avg: 747 RPC/s Min: 747 RPC/s Max: 747 RPC/s [W] Avg: 734 RPC/s Min: 734 RPC/s Max: 734 RPC/s [LNet Bandwidth of s] [R] Avg: 85.52 MiB/s Min: 85.52 MiB/s Max: 85.52 MiB/s [W] Avg: 87.31 MiB/s Min: 87.31 MiB/s Max: 87.31 MiB/s [LNet Rates of c] [R] Avg: 885 RPC/s Min: 885 RPC/s Max: 885 RPC/s [W] Avg: 884 RPC/s Min: 884 RPC/s Max: 884 RPC/s [LNet Bandwidth of c] [R] Avg: 101.53 MiB/s Min: 101.53 MiB/s Max: 101.53 MiB/s [W] Avg: 102.40 MiB/s Min: 102.40 MiB/s Max: 102.40 MiB/s [LNet Rates of s] [R] Avg: 887 RPC/s Min: 887 RPC/s Max: 887 RPC/s [W] Avg: 887 RPC/s Min: 887 RPC/s Max: 887 RPC/s [LNet Bandwidth of s] [R] Avg: 102.49 MiB/s Min: 102.49 MiB/s Max: 102.49 MiB/s [W] Avg: 101.33 MiB/s Min: 101.33 MiB/s Max: 101.33 MiB/s [LNet Rates of c] [R] Avg: 787 RPC/s Min: 787 RPC/s Max: 787 RPC/s [W] Avg: 783 RPC/s Min: 783 RPC/s Max: 783 RPC/s [LNet Bandwidth of c] [R] Avg: 92.11 MiB/s Min: 92.11 MiB/s Max: 92.11 MiB/s [W] Avg: 93.35 MiB/s Min: 93.35 MiB/s Max: 93.35 MiB/s [LNet Rates of s] [R] Avg: 781 RPC/s Min: 781 RPC/s Max: 781 RPC/s [W] Avg: 807 RPC/s Min: 807 RPC/s Max: 807 RPC/s [LNet Bandwidth of s] [R] Avg: 93.11 MiB/s Min: 93.11 MiB/s Max: 93.11 MiB/s [W] Avg: 91.67 MiB/s Min: 91.67 MiB/s Max: 91.67 MiB/s [LNet Rates of c] [R] Avg: 614 RPC/s Min: 614 RPC/s Max: 614 RPC/s [W] Avg: 614 RPC/s Min: 614 RPC/s Max: 614 RPC/s [LNet Bandwidth of c] [R] Avg: 71.35 MiB/s Min: 71.35 MiB/s Max: 71.35 MiB/s [W] Avg: 71.56 MiB/s Min: 71.56 MiB/s Max: 71.56 MiB/s [LNet Rates of s] [R] Avg: 618 RPC/s Min: 618 RPC/s Max: 618 RPC/s [W] Avg: 619 RPC/s Min: 619 RPC/s Max: 619 RPC/s [LNet Bandwidth of s] [R] Avg: 70.95 MiB/s Min: 70.95 MiB/s Max: 70.95 MiB/s [W] Avg: 71.85 MiB/s Min: 71.85 MiB/s Max: 71.85 MiB/s [LNet Rates of c] [R] Avg: 543 RPC/s Min: 543 RPC/s Max: 543 RPC/s [W] Avg: 518 RPC/s Min: 518 RPC/s Max: 518 RPC/s [LNet Bandwidth of c] [R] Avg: 61.40 MiB/s Min: 61.40 MiB/s Max: 61.40 MiB/s [W] Avg: 61.49 MiB/s Min: 61.49 MiB/s Max: 61.49 MiB/s [LNet Rates of s] [R] Avg: 541 RPC/s Min: 541 RPC/s Max: 541 RPC/s [W] Avg: 519 RPC/s Min: 519 RPC/s Max: 519 RPC/s [LNet Bandwidth of s] [R] Avg: 61.83 MiB/s Min: 61.83 MiB/s Max: 61.83 MiB/s [W] Avg: 61.26 MiB/s Min: 61.26 MiB/s Max: 61.26 MiB/s [LNet Rates of c] [R] Avg: 585 RPC/s Min: 585 RPC/s Max: 585 RPC/s [W] Avg: 609 RPC/s Min: 609 RPC/s Max: 609 RPC/s [LNet Bandwidth of c] [R] Avg: 68.42 MiB/s Min: 68.42 MiB/s Max: 68.42 MiB/s [W] Avg: 69.56 MiB/s Min: 69.56 MiB/s Max: 69.56 MiB/s [LNet Rates of s] [R] Avg: 593 RPC/s Min: 593 RPC/s Max: 593 RPC/s [W] Avg: 592 RPC/s Min: 592 RPC/s Max: 592 RPC/s [LNet Bandwidth of s] [R] Avg: 69.50 MiB/s Min: 69.50 MiB/s Max: 69.50 MiB/s [W] Avg: 68.74 MiB/s Min: 68.74 MiB/s Max: 68.74 MiB/s [LNet Rates of c] [R] Avg: 751 RPC/s Min: 751 RPC/s Max: 751 RPC/s [W] Avg: 750 RPC/s Min: 750 RPC/s Max: 750 RPC/s [LNet Bandwidth of c] [R] Avg: 88.03 MiB/s Min: 88.03 MiB/s Max: 88.03 MiB/s [W] Avg: 89.93 MiB/s Min: 89.93 MiB/s Max: 89.93 MiB/s [LNet Rates of s] [R] Avg: 757 RPC/s Min: 757 RPC/s Max: 757 RPC/s [W] Avg: 757 RPC/s Min: 757 RPC/s Max: 757 RPC/s [LNet Bandwidth of s] [R] Avg: 90.05 MiB/s Min: 90.05 MiB/s Max: 90.05 MiB/s [W] Avg: 88.03 MiB/s Min: 88.03 MiB/s Max: 88.03 MiB/s [LNet Rates of c] [R] Avg: 550 RPC/s Min: 550 RPC/s Max: 550 RPC/s [W] Avg: 548 RPC/s Min: 548 RPC/s Max: 548 RPC/s [LNet Bandwidth of c] [R] Avg: 65.13 MiB/s Min: 65.13 MiB/s Max: 65.13 MiB/s [W] Avg: 64.53 MiB/s Min: 64.53 MiB/s Max: 64.53 MiB/s [LNet Rates of s] [R] Avg: 551 RPC/s Min: 551 RPC/s Max: 551 RPC/s [W] Avg: 567 RPC/s Min: 567 RPC/s Max: 567 RPC/s [LNet Bandwidth of s] [R] Avg: 64.54 MiB/s Min: 64.54 MiB/s Max: 64.54 MiB/s [W] Avg: 65.23 MiB/s Min: 65.23 MiB/s Max: 65.23 MiB/s [LNet Rates of c] [R] Avg: 650 RPC/s Min: 650 RPC/s Max: 650 RPC/s [W] Avg: 628 RPC/s Min: 628 RPC/s Max: 628 RPC/s [LNet Bandwidth of c] [R] Avg: 72.61 MiB/s Min: 72.61 MiB/s Max: 72.61 MiB/s [W] Avg: 74.09 MiB/s Min: 74.09 MiB/s Max: 74.09 MiB/s [LNet Rates of s] [R] Avg: 644 RPC/s Min: 644 RPC/s Max: 644 RPC/s [W] Avg: 626 RPC/s Min: 626 RPC/s Max: 626 RPC/s [LNet Bandwidth of s] [R] Avg: 74.56 MiB/s Min: 74.56 MiB/s Max: 74.56 MiB/s [W] Avg: 71.85 MiB/s Min: 71.85 MiB/s Max: 71.85 MiB/s [LNet Rates of c] [R] Avg: 535 RPC/s Min: 535 RPC/s Max: 535 RPC/s [W] Avg: 565 RPC/s Min: 565 RPC/s Max: 565 RPC/s [LNet Bandwidth of c] [R] Avg: 63.87 MiB/s Min: 63.87 MiB/s Max: 63.87 MiB/s [W] Avg: 64.49 MiB/s Min: 64.49 MiB/s Max: 64.49 MiB/s [LNet Rates of s] [R] Avg: 544 RPC/s Min: 544 RPC/s Max: 544 RPC/s [W] Avg: 544 RPC/s Min: 544 RPC/s Max: 544 RPC/s [LNet Bandwidth of s] [R] Avg: 63.68 MiB/s Min: 63.68 MiB/s Max: 63.68 MiB/s [W] Avg: 64.31 MiB/s Min: 64.31 MiB/s Max: 64.31 MiB/s [LNet Rates of c] [R] Avg: 639 RPC/s Min: 639 RPC/s Max: 639 RPC/s [W] Avg: 640 RPC/s Min: 640 RPC/s Max: 640 RPC/s [LNet Bandwidth of c] [R] Avg: 74.86 MiB/s Min: 74.86 MiB/s Max: 74.86 MiB/s [W] Avg: 75.24 MiB/s Min: 75.24 MiB/s Max: 75.24 MiB/s [LNet Rates of s] [R] Avg: 648 RPC/s Min: 648 RPC/s Max: 648 RPC/s [W] Avg: 646 RPC/s Min: 646 RPC/s Max: 646 RPC/s [LNet Bandwidth of s] [R] Avg: 75.53 MiB/s Min: 75.53 MiB/s Max: 75.53 MiB/s [W] Avg: 75.05 MiB/s Min: 75.05 MiB/s Max: 75.05 MiB/s [LNet Rates of c] [R] Avg: 668 RPC/s Min: 668 RPC/s Max: 668 RPC/s [W] Avg: 641 RPC/s Min: 641 RPC/s Max: 641 RPC/s [LNet Bandwidth of c] [R] Avg: 76.57 MiB/s Min: 76.57 MiB/s Max: 76.57 MiB/s [W] Avg: 76.47 MiB/s Min: 76.47 MiB/s Max: 76.47 MiB/s [LNet Rates of s] [R] Avg: 650 RPC/s Min: 650 RPC/s Max: 650 RPC/s [W] Avg: 654 RPC/s Min: 654 RPC/s Max: 654 RPC/s [LNet Bandwidth of s] [R] Avg: 75.46 MiB/s Min: 75.46 MiB/s Max: 75.46 MiB/s [W] Avg: 75.65 MiB/s Min: 75.65 MiB/s Max: 75.65 MiB/s killing 9837 ... 1 batch in stopping Batch is stopped c: Total 0 error nodes in c s: Total 0 error nodes in s Total 0 error nodes in c Total 0 error nodes in s oleg613-client: oleg613-client.virtnet: executing lst_cleanup oleg613-server: oleg613-server.virtnet: executing lst_cleanup