-----============= acceptance-small: lnet-selftest ============----- Fri Oct 24 09:13:28 EDT 2025
oleg311-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/lnet-selftest.*ex': No such file or directory
excepting tests: 
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg311-server'
oleg311-server: oleg311-server.virtnet: executing load_modules_local
oleg311-server: Loading modules from /home/green/git/lustre-release/lustre
oleg311-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy
oleg311-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy
oleg311-server: detected 4 online CPUs by sysfs
oleg311-server: Force libcfs to create 2 CPU partitions
Stopping clients: oleg311-client.virtnet /mnt/lustre (opts:)
Stopping client oleg311-client.virtnet /mnt/lustre opts:

== lnet-selftest test smoke: lst regression test ========= 09:13:53 (1761311633)
oleg311-client: oleg311-client.virtnet: executing lst_cleanup
oleg311-server: oleg311-server.virtnet: executing lst_cleanup
oleg311-client: oleg311-client.virtnet: executing lst_setup
oleg311-server: oleg311-server.virtnet: executing lst_setup
#!/bin/bash
set -e
cleanup () { trap 0; echo killing $1 ... ; kill -9 $1 || true; }
/home/green/git/lustre-release/lustre/../lnet/utils/lst new_session --timeo 100000 hh
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_group c 192.168.203.11@tcp
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_group s 192.168.203.111@tcp
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_batch b
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from c --to s brw write  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from s --to c brw write  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from c --to s brw write  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from s --to c brw write  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from c --to s brw write  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from s --to c brw write  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from c --to s brw write  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from s --to c brw write  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from c --to s brw read  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from s --to c brw read  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from c --to s brw read  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from s --to c brw read  check=full size=4k
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from c --to s brw read  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from s --to c brw read  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from c --to s brw read  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from s --to c brw read  check=full size=1M
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from c --to s ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from s --to c ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from c --to s ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from s --to c ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from c --to s ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 1  --distribute 1:1 --from s --to c ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from c --to s ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst add_test --batch b --loop 1000  --concurrency 8  --distribute 1:1 --from s --to c ping
/home/green/git/lustre-release/lustre/../lnet/utils/lst run b
sleep 1
/home/green/git/lustre-release/lustre/../lnet/utils/lst stat --delay 10 --timeout 10 c s &
pid=$!
trap "cleanup $pid" INT TERM
sleep 300
cleanup $pid
SESSION: hh FEATURES: 1 TIMEOUT: 100000 FORCE: No
192.168.203.11@tcp are added to session
192.168.203.111@tcp are added to session
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
Test was added successfully
b is running now
[LNet Rates of c]
[R] Avg: 896      RPC/s Min: 896      RPC/s Max: 896      RPC/s
[W] Avg: 906      RPC/s Min: 906      RPC/s Max: 906      RPC/s
[LNet Bandwidth of c]
[R] Avg: 78.51    MiB/s Min: 78.51    MiB/s Max: 78.51    MiB/s 
[W] Avg: 87.78    MiB/s Min: 87.78    MiB/s Max: 87.78    MiB/s 
[LNet Rates of s]
[R] Avg: 917      RPC/s Min: 917      RPC/s Max: 917      RPC/s
[W] Avg: 898      RPC/s Min: 898      RPC/s Max: 898      RPC/s
[LNet Bandwidth of s]
[R] Avg: 87.98    MiB/s Min: 87.98    MiB/s Max: 87.98    MiB/s 
[W] Avg: 78.52    MiB/s Min: 78.52    MiB/s Max: 78.52    MiB/s 
[LNet Rates of c]
[R] Avg: 979      RPC/s Min: 979      RPC/s Max: 979      RPC/s
[W] Avg: 1013     RPC/s Min: 1013     RPC/s Max: 1013     RPC/s
[LNet Bandwidth of c]
[R] Avg: 86.00    MiB/s Min: 86.00    MiB/s Max: 86.00    MiB/s 
[W] Avg: 98.12    MiB/s Min: 98.12    MiB/s Max: 98.12    MiB/s 
[LNet Rates of s]
[R] Avg: 1005     RPC/s Min: 1005     RPC/s Max: 1005     RPC/s
[W] Avg: 980      RPC/s Min: 980      RPC/s Max: 980      RPC/s
[LNet Bandwidth of s]
[R] Avg: 97.90    MiB/s Min: 97.90    MiB/s Max: 97.90    MiB/s 
[W] Avg: 86.08    MiB/s Min: 86.08    MiB/s Max: 86.08    MiB/s 
[LNet Rates of c]
[R] Avg: 972      RPC/s Min: 972      RPC/s Max: 972      RPC/s
[W] Avg: 985      RPC/s Min: 985      RPC/s Max: 985      RPC/s
[LNet Bandwidth of c]
[R] Avg: 87.81    MiB/s Min: 87.81    MiB/s Max: 87.81    MiB/s 
[W] Avg: 94.57    MiB/s Min: 94.57    MiB/s Max: 94.57    MiB/s 
[LNet Rates of s]
[R] Avg: 986      RPC/s Min: 986      RPC/s Max: 986      RPC/s
[W] Avg: 975      RPC/s Min: 975      RPC/s Max: 975      RPC/s
[LNet Bandwidth of s]
[R] Avg: 94.72    MiB/s Min: 94.72    MiB/s Max: 94.72    MiB/s 
[W] Avg: 87.49    MiB/s Min: 87.49    MiB/s Max: 87.49    MiB/s 
[LNet Rates of c]
[R] Avg: 926      RPC/s Min: 926      RPC/s Max: 926      RPC/s
[W] Avg: 945      RPC/s Min: 945      RPC/s Max: 945      RPC/s
[LNet Bandwidth of c]
[R] Avg: 79.81    MiB/s Min: 79.81    MiB/s Max: 79.81    MiB/s 
[W] Avg: 92.33    MiB/s Min: 92.33    MiB/s Max: 92.33    MiB/s 
[LNet Rates of s]
[R] Avg: 955      RPC/s Min: 955      RPC/s Max: 955      RPC/s
[W] Avg: 932      RPC/s Min: 932      RPC/s Max: 932      RPC/s
[LNet Bandwidth of s]
[R] Avg: 92.32    MiB/s Min: 92.32    MiB/s Max: 92.32    MiB/s 
[W] Avg: 80.20    MiB/s Min: 80.20    MiB/s Max: 80.20    MiB/s 
[LNet Rates of c]
[R] Avg: 910      RPC/s Min: 910      RPC/s Max: 910      RPC/s
[W] Avg: 930      RPC/s Min: 930      RPC/s Max: 930      RPC/s
[LNet Bandwidth of c]
[R] Avg: 81.01    MiB/s Min: 81.01    MiB/s Max: 81.01    MiB/s 
[W] Avg: 89.73    MiB/s Min: 89.73    MiB/s Max: 89.73    MiB/s 
[LNet Rates of s]
[R] Avg: 932      RPC/s Min: 932      RPC/s Max: 932      RPC/s
[W] Avg: 909      RPC/s Min: 909      RPC/s Max: 909      RPC/s
[LNet Bandwidth of s]
[R] Avg: 90.10    MiB/s Min: 90.10    MiB/s Max: 90.10    MiB/s 
[W] Avg: 80.83    MiB/s Min: 80.83    MiB/s Max: 80.83    MiB/s 
[LNet Rates of c]
[R] Avg: 896      RPC/s Min: 896      RPC/s Max: 896      RPC/s
[W] Avg: 920      RPC/s Min: 920      RPC/s Max: 920      RPC/s
[LNet Bandwidth of c]
[R] Avg: 79.35    MiB/s Min: 79.35    MiB/s Max: 79.35    MiB/s 
[W] Avg: 88.25    MiB/s Min: 88.25    MiB/s Max: 88.25    MiB/s 
[LNet Rates of s]
[R] Avg: 915      RPC/s Min: 915      RPC/s Max: 915      RPC/s
[W] Avg: 902      RPC/s Min: 902      RPC/s Max: 902      RPC/s
[LNet Bandwidth of s]
[R] Avg: 87.73    MiB/s Min: 87.73    MiB/s Max: 87.73    MiB/s 
[W] Avg: 79.33    MiB/s Min: 79.33    MiB/s Max: 79.33    MiB/s 
[LNet Rates of c]
[R] Avg: 974      RPC/s Min: 974      RPC/s Max: 974      RPC/s
[W] Avg: 995      RPC/s Min: 995      RPC/s Max: 995      RPC/s
[LNet Bandwidth of c]
[R] Avg: 85.03    MiB/s Min: 85.03    MiB/s Max: 85.03    MiB/s 
[W] Avg: 95.86    MiB/s Min: 95.86    MiB/s Max: 95.86    MiB/s 
[LNet Rates of s]
[R] Avg: 1005     RPC/s Min: 1005     RPC/s Max: 1005     RPC/s
[W] Avg: 975      RPC/s Min: 975      RPC/s Max: 975      RPC/s
[LNet Bandwidth of s]
[R] Avg: 95.98    MiB/s Min: 95.98    MiB/s Max: 95.98    MiB/s 
[W] Avg: 85.26    MiB/s Min: 85.26    MiB/s Max: 85.26    MiB/s 
[LNet Rates of c]
[R] Avg: 989      RPC/s Min: 989      RPC/s Max: 989      RPC/s
[W] Avg: 1011     RPC/s Min: 1011     RPC/s Max: 1011     RPC/s
[LNet Bandwidth of c]
[R] Avg: 85.77    MiB/s Min: 85.77    MiB/s Max: 85.77    MiB/s 
[W] Avg: 98.33    MiB/s Min: 98.33    MiB/s Max: 98.33    MiB/s 
[LNet Rates of s]
[R] Avg: 1015     RPC/s Min: 1015     RPC/s Max: 1015     RPC/s
[W] Avg: 993      RPC/s Min: 993      RPC/s Max: 993      RPC/s
[LNet Bandwidth of s]
[R] Avg: 98.58    MiB/s Min: 98.58    MiB/s Max: 98.58    MiB/s 
[W] Avg: 85.76    MiB/s Min: 85.76    MiB/s Max: 85.76    MiB/s 
[LNet Rates of c]
[R] Avg: 873      RPC/s Min: 873      RPC/s Max: 873      RPC/s
[W] Avg: 903      RPC/s Min: 903      RPC/s Max: 903      RPC/s
[LNet Bandwidth of c]
[R] Avg: 77.73    MiB/s Min: 77.73    MiB/s Max: 77.73    MiB/s 
[W] Avg: 87.15    MiB/s Min: 87.15    MiB/s Max: 87.15    MiB/s 
[LNet Rates of s]
[R] Avg: 900      RPC/s Min: 900      RPC/s Max: 900      RPC/s
[W] Avg: 873      RPC/s Min: 873      RPC/s Max: 873      RPC/s
[LNet Bandwidth of s]
[R] Avg: 86.93    MiB/s Min: 86.93    MiB/s Max: 86.93    MiB/s 
[W] Avg: 77.66    MiB/s Min: 77.66    MiB/s Max: 77.66    MiB/s 
[LNet Rates of c]
[R] Avg: 893      RPC/s Min: 893      RPC/s Max: 893      RPC/s
[W] Avg: 909      RPC/s Min: 909      RPC/s Max: 909      RPC/s
[LNet Bandwidth of c]
[R] Avg: 80.24    MiB/s Min: 80.24    MiB/s Max: 80.24    MiB/s 
[W] Avg: 89.87    MiB/s Min: 89.87    MiB/s Max: 89.87    MiB/s 
[LNet Rates of s]
[R] Avg: 912      RPC/s Min: 912      RPC/s Max: 912      RPC/s
[W] Avg: 895      RPC/s Min: 895      RPC/s Max: 895      RPC/s
[LNet Bandwidth of s]
[R] Avg: 89.91    MiB/s Min: 89.91    MiB/s Max: 89.91    MiB/s 
[W] Avg: 80.17    MiB/s Min: 80.17    MiB/s Max: 80.17    MiB/s 
[LNet Rates of c]
[R] Avg: 664      RPC/s Min: 664      RPC/s Max: 664      RPC/s
[W] Avg: 678      RPC/s Min: 678      RPC/s Max: 678      RPC/s
[LNet Bandwidth of c]
[R] Avg: 73.30    MiB/s Min: 73.30    MiB/s Max: 73.30    MiB/s 
[W] Avg: 79.85    MiB/s Min: 79.85    MiB/s Max: 79.85    MiB/s 
[LNet Rates of s]
[R] Avg: 681      RPC/s Min: 681      RPC/s Max: 681      RPC/s
[W] Avg: 668      RPC/s Min: 668      RPC/s Max: 668      RPC/s
[LNet Bandwidth of s]
[R] Avg: 79.89    MiB/s Min: 79.89    MiB/s Max: 79.89    MiB/s 
[W] Avg: 73.54    MiB/s Min: 73.54    MiB/s Max: 73.54    MiB/s 
[LNet Rates of c]
[R] Avg: 692      RPC/s Min: 692      RPC/s Max: 692      RPC/s
[W] Avg: 704      RPC/s Min: 704      RPC/s Max: 704      RPC/s
[LNet Bandwidth of c]
[R] Avg: 75.92    MiB/s Min: 75.92    MiB/s Max: 75.92    MiB/s 
[W] Avg: 85.64    MiB/s Min: 85.64    MiB/s Max: 85.64    MiB/s 
[LNet Rates of s]
[R] Avg: 710      RPC/s Min: 710      RPC/s Max: 710      RPC/s
[W] Avg: 692      RPC/s Min: 692      RPC/s Max: 692      RPC/s
[LNet Bandwidth of s]
[R] Avg: 85.40    MiB/s Min: 85.40    MiB/s Max: 85.40    MiB/s 
[W] Avg: 75.82    MiB/s Min: 75.82    MiB/s Max: 75.82    MiB/s 
[LNet Rates of c]
[R] Avg: 542      RPC/s Min: 542      RPC/s Max: 542      RPC/s
[W] Avg: 559      RPC/s Min: 559      RPC/s Max: 559      RPC/s
[LNet Bandwidth of c]
[R] Avg: 71.03    MiB/s Min: 71.03    MiB/s Max: 71.03    MiB/s 
[W] Avg: 76.66    MiB/s Min: 76.66    MiB/s Max: 76.66    MiB/s 
[LNet Rates of s]
[R] Avg: 556      RPC/s Min: 556      RPC/s Max: 556      RPC/s
[W] Avg: 549      RPC/s Min: 549      RPC/s Max: 549      RPC/s
[LNet Bandwidth of s]
[R] Avg: 76.65    MiB/s Min: 76.65    MiB/s Max: 76.65    MiB/s 
[W] Avg: 70.65    MiB/s Min: 70.65    MiB/s Max: 70.65    MiB/s 
[LNet Rates of c]
[R] Avg: 630      RPC/s Min: 630      RPC/s Max: 630      RPC/s
[W] Avg: 643      RPC/s Min: 643      RPC/s Max: 643      RPC/s
[LNet Bandwidth of c]
[R] Avg: 85.15    MiB/s Min: 85.15    MiB/s Max: 85.15    MiB/s 
[W] Avg: 95.47    MiB/s Min: 95.47    MiB/s Max: 95.47    MiB/s 
[LNet Rates of s]
[R] Avg: 654      RPC/s Min: 654      RPC/s Max: 654      RPC/s
[W] Avg: 629      RPC/s Min: 629      RPC/s Max: 629      RPC/s
[LNet Bandwidth of s]
[R] Avg: 95.79    MiB/s Min: 95.79    MiB/s Max: 95.79    MiB/s 
[W] Avg: 85.20    MiB/s Min: 85.20    MiB/s Max: 85.20    MiB/s 
[LNet Rates of c]
[R] Avg: 719      RPC/s Min: 719      RPC/s Max: 719      RPC/s
[W] Avg: 741      RPC/s Min: 741      RPC/s Max: 741      RPC/s
[LNet Bandwidth of c]
[R] Avg: 99.24    MiB/s Min: 99.24    MiB/s Max: 99.24    MiB/s 
[W] Avg: 107.40   MiB/s Min: 107.40   MiB/s Max: 107.40   MiB/s 
[LNet Rates of s]
[R] Avg: 741      RPC/s Min: 741      RPC/s Max: 741      RPC/s
[W] Avg: 730      RPC/s Min: 730      RPC/s Max: 730      RPC/s
[LNet Bandwidth of s]
[R] Avg: 107.40   MiB/s Min: 107.40   MiB/s Max: 107.40   MiB/s 
[W] Avg: 99.81    MiB/s Min: 99.81    MiB/s Max: 99.81    MiB/s 
[LNet Rates of c]
[R] Avg: 811      RPC/s Min: 811      RPC/s Max: 811      RPC/s
[W] Avg: 838      RPC/s Min: 838      RPC/s Max: 838      RPC/s
[LNet Bandwidth of c]
[R] Avg: 110.30   MiB/s Min: 110.30   MiB/s Max: 110.30   MiB/s 
[W] Avg: 123.19   MiB/s Min: 123.19   MiB/s Max: 123.19   MiB/s 
[LNet Rates of s]
[R] Avg: 839      RPC/s Min: 839      RPC/s Max: 839      RPC/s
[W] Avg: 815      RPC/s Min: 815      RPC/s Max: 815      RPC/s
[LNet Bandwidth of s]
[R] Avg: 123.35   MiB/s Min: 123.35   MiB/s Max: 123.35   MiB/s 
[W] Avg: 110.41   MiB/s Min: 110.41   MiB/s Max: 110.41   MiB/s 
[LNet Rates of c]
[R] Avg: 775      RPC/s Min: 775      RPC/s Max: 775      RPC/s
[W] Avg: 739      RPC/s Min: 739      RPC/s Max: 739      RPC/s
[LNet Bandwidth of c]
[R] Avg: 114.17   MiB/s Min: 114.17   MiB/s Max: 114.17   MiB/s 
[W] Avg: 117.68   MiB/s Min: 117.68   MiB/s Max: 117.68   MiB/s 
[LNet Rates of s]
[R] Avg: 742      RPC/s Min: 742      RPC/s Max: 742      RPC/s
[W] Avg: 773      RPC/s Min: 773      RPC/s Max: 773      RPC/s
[LNet Bandwidth of s]
[R] Avg: 117.66   MiB/s Min: 117.66   MiB/s Max: 117.66   MiB/s 
[W] Avg: 114.03   MiB/s Min: 114.03   MiB/s Max: 114.03   MiB/s 
[LNet Rates of c]
[R] Avg: 945      RPC/s Min: 945      RPC/s Max: 945      RPC/s
[W] Avg: 783      RPC/s Min: 783      RPC/s Max: 783      RPC/s
[LNet Bandwidth of c]
[R] Avg: 152.34   MiB/s Min: 152.34   MiB/s Max: 152.34   MiB/s 
[W] Avg: 78.31    MiB/s Min: 78.31    MiB/s Max: 78.31    MiB/s 
[LNet Rates of s]
[R] Avg: 786      RPC/s Min: 786      RPC/s Max: 786      RPC/s
[W] Avg: 947      RPC/s Min: 947      RPC/s Max: 947      RPC/s
[LNet Bandwidth of s]
[R] Avg: 78.15    MiB/s Min: 78.15    MiB/s Max: 78.15    MiB/s 
[W] Avg: 152.34   MiB/s Min: 152.34   MiB/s Max: 152.34   MiB/s 
[LNet Rates of c]
[R] Avg: 688      RPC/s Min: 688      RPC/s Max: 688      RPC/s
[W] Avg: 592      RPC/s Min: 592      RPC/s Max: 592      RPC/s
[LNet Bandwidth of c]
[R] Avg: 118.18   MiB/s Min: 118.18   MiB/s Max: 118.18   MiB/s 
[W] Avg: 63.07    MiB/s Min: 63.07    MiB/s Max: 63.07    MiB/s 
[LNet Rates of s]
[R] Avg: 594      RPC/s Min: 594      RPC/s Max: 594      RPC/s
[W] Avg: 692      RPC/s Min: 692      RPC/s Max: 692      RPC/s
[LNet Bandwidth of s]
[R] Avg: 63.09    MiB/s Min: 63.09    MiB/s Max: 63.09    MiB/s 
[W] Avg: 118.22   MiB/s Min: 118.22   MiB/s Max: 118.22   MiB/s 
[LNet Rates of c]
[R] Avg: 397      RPC/s Min: 397      RPC/s Max: 397      RPC/s
[W] Avg: 374      RPC/s Min: 374      RPC/s Max: 374      RPC/s
[LNet Bandwidth of c]
[R] Avg: 84.68    MiB/s Min: 84.68    MiB/s Max: 84.68    MiB/s 
[W] Avg: 56.09    MiB/s Min: 56.09    MiB/s Max: 56.09    MiB/s 
[LNet Rates of s]
[R] Avg: 378      RPC/s Min: 378      RPC/s Max: 378      RPC/s
[W] Avg: 398      RPC/s Min: 398      RPC/s Max: 398      RPC/s
[LNet Bandwidth of s]
[R] Avg: 56.23    MiB/s Min: 56.23    MiB/s Max: 56.23    MiB/s 
[W] Avg: 84.24    MiB/s Min: 84.24    MiB/s Max: 84.24    MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 2        RPC/s Min: 2        RPC/s Max: 2        RPC/s
[W] Avg: 2        RPC/s Min: 2        RPC/s Max: 2        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of c]
[R] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[W] Avg: 0        RPC/s Min: 0        RPC/s Max: 0        RPC/s
[LNet Bandwidth of c]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[LNet Rates of s]
[R] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[W] Avg: 3        RPC/s Min: 3        RPC/s Max: 3        RPC/s
[LNet Bandwidth of s]
[R] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
[W] Avg: 0.00     MiB/s Min: 0.00     MiB/s Max: 0.00     MiB/s 
killing 9153 ...
Batch is stopped
c:
Total 0 error nodes in c
s:
Total 0 error nodes in s
session is ended
Total 0 error nodes in c
Total 0 error nodes in s
oleg311-client: oleg311-client.virtnet: executing lst_cleanup
oleg311-server: oleg311-server.virtnet: executing lst_cleanup
PASS smoke (323s)
== lnet-selftest test complete, duration 346 sec ========= 09:19:16 (1761311956)
Starting client oleg311-client.virtnet:  -o user_xattr,flock oleg311-server@tcp:/lustre /mnt/lustre
Started clients oleg311-client.virtnet: 
192.168.203.111@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt)