== lnet-selftest test smoke: lst regression test ========= 00:27:51 (1708838871)
oleg350-client: oleg350-client.virtnet: executing lst_cleanup
oleg350-server: oleg350-server.virtnet: executing lst_cleanup
oleg350-client: oleg350-client.virtnet: executing lst_setup
oleg350-server: oleg350-server.virtnet: executing lst_setup
#!/bin/bash
set -e
cleanup () { trap 0; echo killing $1 ... ; kill -9 $1 || true; }
/home/green/git/lustre-release/lustre/../lnet/utils/lst new_session --timeo 100000 hh
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_group c 192.168.203.50@tcp
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_group s 192.168.203.150@tcp
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_batch b
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from c --to s brw write  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from s --to c brw write  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from c --to s brw write  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from s --to c brw write  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from c --to s brw write  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from s --to c brw write  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from c --to s brw write  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from s --to c brw write  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from c --to s brw read  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from s --to c brw read  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from c --to s brw read  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from s --to c brw read  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from c --to s brw read  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from s --to c brw read  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from c --to s brw read  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from s --to c brw read  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from c --to s ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from s --to c ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from c --to s ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from s --to c ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from c --to s ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from s --to c ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from c --to s ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from s --to c ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst run b
sleep 1
/home/green/git/lustre-release/lustre/../lnet/utils/lst stat --delay 10 --timeout 10 c s &
pid=$!
trap "cleanup $pid" INT TERM
sleep 300
cleanup $pid
SESSION: hh FEATURES: 1 TIMEOUT: 100000 FORCE: No
192.168.203.50@tcp are added to session
192.168.203.150@tcp are added to session
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
b is running now
[LNet Rates of c]
[R] Avg: 4403     RPC/s Min: 4403     RPC/s Max: 4403     RPC/s
[W] Avg: 4469     RPC/s Min: 4469     RPC/s Max: 4469     RPC/s
[LNet Bandwidth of c]
[R] Avg: 423.24   MiB/s Min: 423.24   MiB/s Max: 423.24   MiB/s 
[W] Avg: 417.16   MiB/s Min: 417.16   MiB/s Max: 417.16   MiB/s 
[LNet Rates of s]
[R] Avg: 4471     RPC/s Min: 4471     RPC/s Max: 4471     RPC/s
[W] Avg: 4405     RPC/s Min: 4405     RPC/s Max: 4405     RPC/s
[LNet Bandwidth of s]
[R] Avg: 417.48   MiB/s Min: 417.48   MiB/s Max: 417.48   MiB/s 
[W] Avg: 423.17   MiB/s Min: 423.17   MiB/s Max: 423.17   MiB/s 
[LNet Rates of c]
[R] Avg: 4309     RPC/s Min: 4309     RPC/s Max: 4309     RPC/s
[W] Avg: 4366     RPC/s Min: 4366     RPC/s Max: 4366     RPC/s
[LNet Bandwidth of c]
[R] Avg: 417.78   MiB/s Min: 417.78   MiB/s Max: 417.78   MiB/s 
[W] Avg: 408.79   MiB/s Min: 408.79   MiB/s Max: 408.79   MiB/s 
[LNet Rates of s]
[R] Avg: 4369     RPC/s Min: 4369     RPC/s Max: 4369     RPC/s
[W] Avg: 4320     RPC/s Min: 4320     RPC/s Max: 4320     RPC/s
[LNet Bandwidth of s]
[R] Avg: 409.04   MiB/s Min: 409.04   MiB/s Max: 409.04   MiB/s 
[W] Avg: 418.02   MiB/s Min: 418.02   MiB/s Max: 418.02   MiB/s 
[LNet Rates of c]
[R] Avg: 3516     RPC/s Min: 3516     RPC/s Max: 3516     RPC/s
[W] Avg: 3565     RPC/s Min: 3565     RPC/s Max: 3565     RPC/s
[LNet Bandwidth of c]
[R] Avg: 430.16   MiB/s Min: 430.16   MiB/s Max: 430.16   MiB/s 
[W] Avg: 423.87   MiB/s Min: 423.87   MiB/s Max: 423.87   MiB/s 
[LNet Rates of s]
[R] Avg: 3570     RPC/s Min: 3570     RPC/s Max: 3570     RPC/s
[W] Avg: 3511     RPC/s Min: 3511     RPC/s Max: 3511     RPC/s
[LNet Bandwidth of s]
[R] Avg: 423.66   MiB/s Min: 423.66   MiB/s Max: 423.66   MiB/s 
[W] Avg: 429.96   MiB/s Min: 429.96   MiB/s Max: 429.96   MiB/s 
[LNet Rates of c]
[R] Avg: 3071     RPC/s Min: 3071     RPC/s Max: 3071     RPC/s
[W] Avg: 2898     RPC/s Min: 2898     RPC/s Max: 2898     RPC/s
[LNet Bandwidth of c]
[R] Avg: 486.09   MiB/s Min: 486.09   MiB/s Max: 486.09   MiB/s 
[W] Avg: 390.32   MiB/s Min: 390.32   MiB/s Max: 390.32   MiB/s 
[LNet Rates of s]
[R] Avg: 2898     RPC/s Min: 2898     RPC/s Max: 2898     RPC/s
[W] Avg: 3075     RPC/s Min: 3075     RPC/s Max: 3075     RPC/s
[LNet Bandwidth of s]
[R] Avg: 389.91   MiB/s Min: 389.91   MiB/s Max: 389.91   MiB/s 
[W] Avg: 486.17   MiB/s Min: 486.17   MiB/s Max: 486.17   MiB/s 
[LNet Rates of c]
[R] Avg: 367      RPC/s Min: 367      RPC/s Max: 367      RPC/s
[W] Avg: 366      RPC/s Min: 366      RPC/s Max: 366      RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.03     MiB/s Min: 0.03     MiB/s Max: 0.03     MiB/s 
[W] Avg: 117.25   MiB/s Min: 117.25   MiB/s Max: 117.25   MiB/s 
[LNet Rates of s]
[R] Avg: 370      RPC/s Min: 370      RPC/s Max: 370      RPC/s
[W] Avg: 370      RPC/s Min: 370      RPC/s Max: 370      RPC/s
[LNet Bandwidth of s]
[R] Avg: 117.76   MiB/s Min: 117.76   MiB/s Max: 117.76   MiB/s 
[W] Avg: 0.03     MiB/s Min: 0.03     MiB/s Max: 0.03     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
killing 8557 ...
Batch is stopped
c:
Total 0 error nodes in c
s:
Total 0 error nodes in s
Total 0 error nodes in c
Total 0 error nodes in s
oleg350-server: oleg350-server.virtnet: executing lst_cleanup
oleg350-client: oleg350-client.virtnet: executing lst_cleanup