== lnet-selftest test brw_offset: lst BRW offset handling (LU-20104) ========================================================== 11:20:17 (1788535217) oleg455-server: oleg455-server.virtnet: executing lst_cleanup oleg455-client: oleg455-client.virtnet: executing lst_cleanup oleg455-client: oleg455-client.virtnet: executing lst_setup oleg455-server: oleg455-server.virtnet: executing lst_setup === BRW read off=0 size=4k === Test was added successfully b_r_0_4k is running now [LNet Rates of c] [R] Avg: 867 RPC/s Min: 867 RPC/s Max: 867 RPC/s [W] Avg: 434 RPC/s Min: 434 RPC/s Max: 434 RPC/s [LNet Bandwidth of c] [R] Avg: 1.76 MiB/s Min: 1.76 MiB/s Max: 1.76 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 427 RPC/s Min: 427 RPC/s Max: 427 RPC/s [W] Avg: 862 RPC/s Min: 862 RPC/s Max: 862 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.75 MiB/s Min: 1.75 MiB/s Max: 1.75 MiB/s [LNet Rates of c] [R] Avg: 756 RPC/s Min: 756 RPC/s Max: 756 RPC/s [W] Avg: 379 RPC/s Min: 379 RPC/s Max: 379 RPC/s [LNet Bandwidth of c] [R] Avg: 1.53 MiB/s Min: 1.53 MiB/s Max: 1.53 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 393 RPC/s Min: 393 RPC/s Max: 393 RPC/s [W] Avg: 769 RPC/s Min: 769 RPC/s Max: 769 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.53 MiB/s Min: 1.53 MiB/s Max: 1.53 MiB/s [LNet Rates of c] [R] Avg: 628 RPC/s Min: 628 RPC/s Max: 628 RPC/s [W] Avg: 315 RPC/s Min: 315 RPC/s Max: 315 RPC/s [LNet Bandwidth of c] [R] Avg: 1.26 MiB/s Min: 1.26 MiB/s Max: 1.26 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 318 RPC/s Min: 318 RPC/s Max: 318 RPC/s [W] Avg: 630 RPC/s Min: 630 RPC/s Max: 630 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.28 MiB/s Min: 1.28 MiB/s Max: 1.28 MiB/s [LNet Rates of c] [R] Avg: 1203 RPC/s Min: 1203 RPC/s Max: 1203 RPC/s [W] Avg: 605 RPC/s Min: 605 RPC/s Max: 605 RPC/s [LNet Bandwidth of c] [R] Avg: 2.44 MiB/s Min: 2.44 MiB/s Max: 2.44 MiB/s [W] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [LNet Rates of s] [R] Avg: 602 RPC/s Min: 602 RPC/s Max: 602 RPC/s [W] Avg: 1209 RPC/s Min: 1209 RPC/s Max: 1209 RPC/s [LNet Bandwidth of s] [R] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [W] Avg: 2.45 MiB/s Min: 2.45 MiB/s Max: 2.45 MiB/s [LNet Rates of c] [R] Avg: 714 RPC/s Min: 714 RPC/s Max: 714 RPC/s [W] Avg: 357 RPC/s Min: 357 RPC/s Max: 357 RPC/s [LNet Bandwidth of c] [R] Avg: 1.44 MiB/s Min: 1.44 MiB/s Max: 1.44 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 358 RPC/s Min: 358 RPC/s Max: 358 RPC/s [W] Avg: 709 RPC/s Min: 709 RPC/s Max: 709 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.44 MiB/s Min: 1.44 MiB/s Max: 1.44 MiB/s [LNet Rates of c] [R] Avg: 578 RPC/s Min: 578 RPC/s Max: 578 RPC/s [W] Avg: 292 RPC/s Min: 292 RPC/s Max: 292 RPC/s [LNet Bandwidth of c] [R] Avg: 1.17 MiB/s Min: 1.17 MiB/s Max: 1.17 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 285 RPC/s Min: 285 RPC/s Max: 285 RPC/s [W] Avg: 567 RPC/s Min: 567 RPC/s Max: 567 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 1.15 MiB/s Min: 1.15 MiB/s Max: 1.15 MiB/s [LNet Rates of c] [R] Avg: 651 RPC/s Min: 651 RPC/s Max: 651 RPC/s [W] Avg: 326 RPC/s Min: 326 RPC/s Max: 326 RPC/s [LNet Bandwidth of c] [R] Avg: 1.32 MiB/s Min: 1.32 MiB/s Max: 1.32 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 341 RPC/s Min: 341 RPC/s Max: 341 RPC/s [W] Avg: 669 RPC/s Min: 669 RPC/s Max: 669 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.33 MiB/s Min: 1.33 MiB/s Max: 1.33 MiB/s [LNet Rates of c] [R] Avg: 540 RPC/s Min: 540 RPC/s Max: 540 RPC/s [W] Avg: 270 RPC/s Min: 270 RPC/s Max: 270 RPC/s [LNet Bandwidth of c] [R] Avg: 1.10 MiB/s Min: 1.10 MiB/s Max: 1.10 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 269 RPC/s Min: 269 RPC/s Max: 269 RPC/s [W] Avg: 541 RPC/s Min: 541 RPC/s Max: 541 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 1.09 MiB/s Min: 1.09 MiB/s Max: 1.09 MiB/s [LNet Rates of c] [R] Avg: 509 RPC/s Min: 509 RPC/s Max: 509 RPC/s [W] Avg: 257 RPC/s Min: 257 RPC/s Max: 257 RPC/s [LNet Bandwidth of c] [R] Avg: 1.03 MiB/s Min: 1.03 MiB/s Max: 1.03 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 253 RPC/s Min: 253 RPC/s Max: 253 RPC/s [W] Avg: 504 RPC/s Min: 504 RPC/s Max: 504 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 1.02 MiB/s Min: 1.02 MiB/s Max: 1.02 MiB/s [LNet Rates of c] [R] Avg: 703 RPC/s Min: 703 RPC/s Max: 703 RPC/s [W] Avg: 354 RPC/s Min: 354 RPC/s Max: 354 RPC/s [LNet Bandwidth of c] [R] Avg: 1.41 MiB/s Min: 1.41 MiB/s Max: 1.41 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 352 RPC/s Min: 352 RPC/s Max: 352 RPC/s [W] Avg: 701 RPC/s Min: 701 RPC/s Max: 701 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.43 MiB/s Min: 1.43 MiB/s Max: 1.43 MiB/s 1 batch in stopping Batch is stopped === BRW read off=0 size=64k === Test was added successfully b_r_0_64k is running now [LNet Rates of c] [R] Avg: 240 RPC/s Min: 240 RPC/s Max: 240 RPC/s [W] Avg: 122 RPC/s Min: 122 RPC/s Max: 122 RPC/s [LNet Bandwidth of c] [R] Avg: 7.35 MiB/s Min: 7.35 MiB/s Max: 7.35 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 123 RPC/s Min: 123 RPC/s Max: 123 RPC/s [W] Avg: 242 RPC/s Min: 242 RPC/s Max: 242 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 7.42 MiB/s Min: 7.42 MiB/s Max: 7.42 MiB/s [LNet Rates of c] [R] Avg: 298 RPC/s Min: 298 RPC/s Max: 298 RPC/s [W] Avg: 147 RPC/s Min: 147 RPC/s Max: 147 RPC/s [LNet Bandwidth of c] [R] Avg: 9.22 MiB/s Min: 9.22 MiB/s Max: 9.22 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 149 RPC/s Min: 149 RPC/s Max: 149 RPC/s [W] Avg: 296 RPC/s Min: 296 RPC/s Max: 296 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.23 MiB/s Min: 9.23 MiB/s Max: 9.23 MiB/s [LNet Rates of c] [R] Avg: 308 RPC/s Min: 308 RPC/s Max: 308 RPC/s [W] Avg: 159 RPC/s Min: 159 RPC/s Max: 159 RPC/s [LNet Bandwidth of c] [R] Avg: 9.60 MiB/s Min: 9.60 MiB/s Max: 9.60 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 153 RPC/s Min: 153 RPC/s Max: 153 RPC/s [W] Avg: 306 RPC/s Min: 306 RPC/s Max: 306 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.58 MiB/s Min: 9.58 MiB/s Max: 9.58 MiB/s [LNet Rates of c] [R] Avg: 429 RPC/s Min: 429 RPC/s Max: 429 RPC/s [W] Avg: 215 RPC/s Min: 215 RPC/s Max: 215 RPC/s [LNet Bandwidth of c] [R] Avg: 13.41 MiB/s Min: 13.41 MiB/s Max: 13.41 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 213 RPC/s Min: 213 RPC/s Max: 213 RPC/s [W] Avg: 426 RPC/s Min: 426 RPC/s Max: 426 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.33 MiB/s Min: 13.33 MiB/s Max: 13.33 MiB/s [LNet Rates of c] [R] Avg: 297 RPC/s Min: 297 RPC/s Max: 297 RPC/s [W] Avg: 151 RPC/s Min: 151 RPC/s Max: 151 RPC/s [LNet Bandwidth of c] [R] Avg: 9.15 MiB/s Min: 9.15 MiB/s Max: 9.15 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 160 RPC/s Min: 160 RPC/s Max: 160 RPC/s [W] Avg: 304 RPC/s Min: 304 RPC/s Max: 304 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 9.14 MiB/s Min: 9.14 MiB/s Max: 9.14 MiB/s [LNet Rates of c] [R] Avg: 268 RPC/s Min: 268 RPC/s Max: 268 RPC/s [W] Avg: 134 RPC/s Min: 134 RPC/s Max: 134 RPC/s [LNet Bandwidth of c] [R] Avg: 8.41 MiB/s Min: 8.41 MiB/s Max: 8.41 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 137 RPC/s Min: 137 RPC/s Max: 137 RPC/s [W] Avg: 271 RPC/s Min: 271 RPC/s Max: 271 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.44 MiB/s Min: 8.44 MiB/s Max: 8.44 MiB/s [LNet Rates of c] [R] Avg: 454 RPC/s Min: 454 RPC/s Max: 454 RPC/s [W] Avg: 229 RPC/s Min: 229 RPC/s Max: 229 RPC/s [LNet Bandwidth of c] [R] Avg: 14.06 MiB/s Min: 14.06 MiB/s Max: 14.06 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 228 RPC/s Min: 228 RPC/s Max: 228 RPC/s [W] Avg: 456 RPC/s Min: 456 RPC/s Max: 456 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 14.16 MiB/s Min: 14.16 MiB/s Max: 14.16 MiB/s [LNet Rates of c] [R] Avg: 350 RPC/s Min: 350 RPC/s Max: 350 RPC/s [W] Avg: 175 RPC/s Min: 175 RPC/s Max: 175 RPC/s [LNet Bandwidth of c] [R] Avg: 10.86 MiB/s Min: 10.86 MiB/s Max: 10.86 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 177 RPC/s Min: 177 RPC/s Max: 177 RPC/s [W] Avg: 348 RPC/s Min: 348 RPC/s Max: 348 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.84 MiB/s Min: 10.84 MiB/s Max: 10.84 MiB/s [LNet Rates of c] [R] Avg: 458 RPC/s Min: 458 RPC/s Max: 458 RPC/s [W] Avg: 232 RPC/s Min: 232 RPC/s Max: 232 RPC/s [LNet Bandwidth of c] [R] Avg: 14.27 MiB/s Min: 14.27 MiB/s Max: 14.27 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 228 RPC/s Min: 228 RPC/s Max: 228 RPC/s [W] Avg: 456 RPC/s Min: 456 RPC/s Max: 456 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 14.27 MiB/s Min: 14.27 MiB/s Max: 14.27 MiB/s [LNet Rates of c] [R] Avg: 529 RPC/s Min: 529 RPC/s Max: 529 RPC/s [W] Avg: 266 RPC/s Min: 266 RPC/s Max: 266 RPC/s [LNet Bandwidth of c] [R] Avg: 16.47 MiB/s Min: 16.47 MiB/s Max: 16.47 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 276 RPC/s Min: 276 RPC/s Max: 276 RPC/s [W] Avg: 541 RPC/s Min: 541 RPC/s Max: 541 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 16.55 MiB/s Min: 16.55 MiB/s Max: 16.55 MiB/s Batch is stopped === BRW read off=512 size=4k === Test was added successfully b_r_512_4k is running now [LNet Rates of c] [R] Avg: 953 RPC/s Min: 953 RPC/s Max: 953 RPC/s [W] Avg: 475 RPC/s Min: 475 RPC/s Max: 475 RPC/s [LNet Bandwidth of c] [R] Avg: 1.93 MiB/s Min: 1.93 MiB/s Max: 1.93 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 481 RPC/s Min: 481 RPC/s Max: 481 RPC/s [W] Avg: 948 RPC/s Min: 948 RPC/s Max: 948 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.92 MiB/s Min: 1.92 MiB/s Max: 1.92 MiB/s [LNet Rates of c] [R] Avg: 937 RPC/s Min: 937 RPC/s Max: 937 RPC/s [W] Avg: 473 RPC/s Min: 473 RPC/s Max: 473 RPC/s [LNet Bandwidth of c] [R] Avg: 1.90 MiB/s Min: 1.90 MiB/s Max: 1.90 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 467 RPC/s Min: 467 RPC/s Max: 467 RPC/s [W] Avg: 936 RPC/s Min: 936 RPC/s Max: 936 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.90 MiB/s Min: 1.90 MiB/s Max: 1.90 MiB/s [LNet Rates of c] [R] Avg: 873 RPC/s Min: 873 RPC/s Max: 873 RPC/s [W] Avg: 439 RPC/s Min: 439 RPC/s Max: 439 RPC/s [LNet Bandwidth of c] [R] Avg: 1.77 MiB/s Min: 1.77 MiB/s Max: 1.77 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 437 RPC/s Min: 437 RPC/s Max: 437 RPC/s [W] Avg: 872 RPC/s Min: 872 RPC/s Max: 872 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.76 MiB/s Min: 1.76 MiB/s Max: 1.76 MiB/s [LNet Rates of c] [R] Avg: 1026 RPC/s Min: 1026 RPC/s Max: 1026 RPC/s [W] Avg: 514 RPC/s Min: 514 RPC/s Max: 514 RPC/s [LNet Bandwidth of c] [R] Avg: 2.08 MiB/s Min: 2.08 MiB/s Max: 2.08 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 512 RPC/s Min: 512 RPC/s Max: 512 RPC/s [W] Avg: 1023 RPC/s Min: 1023 RPC/s Max: 1023 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.08 MiB/s Min: 2.08 MiB/s Max: 2.08 MiB/s [LNet Rates of c] [R] Avg: 1161 RPC/s Min: 1161 RPC/s Max: 1161 RPC/s [W] Avg: 581 RPC/s Min: 581 RPC/s Max: 581 RPC/s [LNet Bandwidth of c] [R] Avg: 2.35 MiB/s Min: 2.35 MiB/s Max: 2.35 MiB/s [W] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [LNet Rates of s] [R] Avg: 590 RPC/s Min: 590 RPC/s Max: 590 RPC/s [W] Avg: 1175 RPC/s Min: 1175 RPC/s Max: 1175 RPC/s [LNet Bandwidth of s] [R] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [W] Avg: 2.36 MiB/s Min: 2.36 MiB/s Max: 2.36 MiB/s [LNet Rates of c] [R] Avg: 1066 RPC/s Min: 1066 RPC/s Max: 1066 RPC/s [W] Avg: 536 RPC/s Min: 536 RPC/s Max: 536 RPC/s [LNet Bandwidth of c] [R] Avg: 2.15 MiB/s Min: 2.15 MiB/s Max: 2.15 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 536 RPC/s Min: 536 RPC/s Max: 536 RPC/s [W] Avg: 1063 RPC/s Min: 1063 RPC/s Max: 1063 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.15 MiB/s Min: 2.15 MiB/s Max: 2.15 MiB/s [LNet Rates of c] [R] Avg: 1030 RPC/s Min: 1030 RPC/s Max: 1030 RPC/s [W] Avg: 516 RPC/s Min: 516 RPC/s Max: 516 RPC/s [LNet Bandwidth of c] [R] Avg: 2.08 MiB/s Min: 2.08 MiB/s Max: 2.08 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 514 RPC/s Min: 514 RPC/s Max: 514 RPC/s [W] Avg: 1027 RPC/s Min: 1027 RPC/s Max: 1027 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.08 MiB/s Min: 2.08 MiB/s Max: 2.08 MiB/s [LNet Rates of c] [R] Avg: 1037 RPC/s Min: 1037 RPC/s Max: 1037 RPC/s [W] Avg: 517 RPC/s Min: 517 RPC/s Max: 517 RPC/s [LNet Bandwidth of c] [R] Avg: 2.10 MiB/s Min: 2.10 MiB/s Max: 2.10 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 518 RPC/s Min: 518 RPC/s Max: 518 RPC/s [W] Avg: 1040 RPC/s Min: 1040 RPC/s Max: 1040 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.11 MiB/s Min: 2.11 MiB/s Max: 2.11 MiB/s [LNet Rates of c] [R] Avg: 1073 RPC/s Min: 1073 RPC/s Max: 1073 RPC/s [W] Avg: 540 RPC/s Min: 540 RPC/s Max: 540 RPC/s [LNet Bandwidth of c] [R] Avg: 2.17 MiB/s Min: 2.17 MiB/s Max: 2.17 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 536 RPC/s Min: 536 RPC/s Max: 536 RPC/s [W] Avg: 1072 RPC/s Min: 1072 RPC/s Max: 1072 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.17 MiB/s Min: 2.17 MiB/s Max: 2.17 MiB/s [LNet Rates of c] [R] Avg: 946 RPC/s Min: 946 RPC/s Max: 946 RPC/s [W] Avg: 475 RPC/s Min: 475 RPC/s Max: 475 RPC/s [LNet Bandwidth of c] [R] Avg: 1.92 MiB/s Min: 1.92 MiB/s Max: 1.92 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 491 RPC/s Min: 491 RPC/s Max: 491 RPC/s [W] Avg: 969 RPC/s Min: 969 RPC/s Max: 969 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 1.94 MiB/s Min: 1.94 MiB/s Max: 1.94 MiB/s 1 batch in stopping Batch is stopped === BRW read off=512 size=64k === Test was added successfully b_r_512_64k is running now [LNet Rates of c] [R] Avg: 480 RPC/s Min: 480 RPC/s Max: 480 RPC/s [W] Avg: 241 RPC/s Min: 241 RPC/s Max: 241 RPC/s [LNet Bandwidth of c] [R] Avg: 14.97 MiB/s Min: 14.97 MiB/s Max: 14.97 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 241 RPC/s Min: 241 RPC/s Max: 241 RPC/s [W] Avg: 482 RPC/s Min: 482 RPC/s Max: 482 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.03 MiB/s Min: 15.03 MiB/s Max: 15.03 MiB/s [LNet Rates of c] [R] Avg: 409 RPC/s Min: 409 RPC/s Max: 409 RPC/s [W] Avg: 205 RPC/s Min: 205 RPC/s Max: 205 RPC/s [LNet Bandwidth of c] [R] Avg: 12.78 MiB/s Min: 12.78 MiB/s Max: 12.78 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 201 RPC/s Min: 201 RPC/s Max: 201 RPC/s [W] Avg: 405 RPC/s Min: 405 RPC/s Max: 405 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 12.67 MiB/s Min: 12.67 MiB/s Max: 12.67 MiB/s [LNet Rates of c] [R] Avg: 447 RPC/s Min: 447 RPC/s Max: 447 RPC/s [W] Avg: 227 RPC/s Min: 227 RPC/s Max: 227 RPC/s [LNet Bandwidth of c] [R] Avg: 13.83 MiB/s Min: 13.83 MiB/s Max: 13.83 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 227 RPC/s Min: 227 RPC/s Max: 227 RPC/s [W] Avg: 446 RPC/s Min: 446 RPC/s Max: 446 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 14.02 MiB/s Min: 14.02 MiB/s Max: 14.02 MiB/s [LNet Rates of c] [R] Avg: 446 RPC/s Min: 446 RPC/s Max: 446 RPC/s [W] Avg: 225 RPC/s Min: 225 RPC/s Max: 225 RPC/s [LNet Bandwidth of c] [R] Avg: 13.85 MiB/s Min: 13.85 MiB/s Max: 13.85 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 234 RPC/s Min: 234 RPC/s Max: 234 RPC/s [W] Avg: 453 RPC/s Min: 453 RPC/s Max: 453 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 13.73 MiB/s Min: 13.73 MiB/s Max: 13.73 MiB/s [LNet Rates of c] [R] Avg: 477 RPC/s Min: 477 RPC/s Max: 477 RPC/s [W] Avg: 240 RPC/s Min: 240 RPC/s Max: 240 RPC/s [LNet Bandwidth of c] [R] Avg: 14.89 MiB/s Min: 14.89 MiB/s Max: 14.89 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 242 RPC/s Min: 242 RPC/s Max: 242 RPC/s [W] Avg: 482 RPC/s Min: 482 RPC/s Max: 482 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.01 MiB/s Min: 15.01 MiB/s Max: 15.01 MiB/s [LNet Rates of c] [R] Avg: 467 RPC/s Min: 467 RPC/s Max: 467 RPC/s [W] Avg: 236 RPC/s Min: 236 RPC/s Max: 236 RPC/s [LNet Bandwidth of c] [R] Avg: 14.52 MiB/s Min: 14.52 MiB/s Max: 14.52 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 235 RPC/s Min: 235 RPC/s Max: 235 RPC/s [W] Avg: 465 RPC/s Min: 465 RPC/s Max: 465 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 14.47 MiB/s Min: 14.47 MiB/s Max: 14.47 MiB/s [LNet Rates of c] [R] Avg: 501 RPC/s Min: 501 RPC/s Max: 501 RPC/s [W] Avg: 251 RPC/s Min: 251 RPC/s Max: 251 RPC/s [LNet Bandwidth of c] [R] Avg: 15.71 MiB/s Min: 15.71 MiB/s Max: 15.71 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 249 RPC/s Min: 249 RPC/s Max: 249 RPC/s [W] Avg: 502 RPC/s Min: 502 RPC/s Max: 502 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.69 MiB/s Min: 15.69 MiB/s Max: 15.69 MiB/s [LNet Rates of c] [R] Avg: 496 RPC/s Min: 496 RPC/s Max: 496 RPC/s [W] Avg: 250 RPC/s Min: 250 RPC/s Max: 250 RPC/s [LNet Bandwidth of c] [R] Avg: 15.40 MiB/s Min: 15.40 MiB/s Max: 15.40 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 248 RPC/s Min: 248 RPC/s Max: 248 RPC/s [W] Avg: 494 RPC/s Min: 494 RPC/s Max: 494 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.43 MiB/s Min: 15.43 MiB/s Max: 15.43 MiB/s [LNet Rates of c] [R] Avg: 524 RPC/s Min: 524 RPC/s Max: 524 RPC/s [W] Avg: 263 RPC/s Min: 263 RPC/s Max: 263 RPC/s [LNet Bandwidth of c] [R] Avg: 16.28 MiB/s Min: 16.28 MiB/s Max: 16.28 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 274 RPC/s Min: 274 RPC/s Max: 274 RPC/s [W] Avg: 534 RPC/s Min: 534 RPC/s Max: 534 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 16.33 MiB/s Min: 16.33 MiB/s Max: 16.33 MiB/s [LNet Rates of c] [R] Avg: 462 RPC/s Min: 462 RPC/s Max: 462 RPC/s [W] Avg: 233 RPC/s Min: 233 RPC/s Max: 233 RPC/s [LNet Bandwidth of c] [R] Avg: 14.38 MiB/s Min: 14.38 MiB/s Max: 14.38 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 231 RPC/s Min: 231 RPC/s Max: 231 RPC/s [W] Avg: 459 RPC/s Min: 459 RPC/s Max: 459 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 14.27 MiB/s Min: 14.27 MiB/s Max: 14.27 MiB/s 1 batch in stopping Batch is stopped === BRW read off=1024 size=4k === Test was added successfully b_r_1024_4k is running now [LNet Rates of c] [R] Avg: 831 RPC/s Min: 831 RPC/s Max: 831 RPC/s [W] Avg: 420 RPC/s Min: 420 RPC/s Max: 420 RPC/s [LNet Bandwidth of c] [R] Avg: 1.68 MiB/s Min: 1.68 MiB/s Max: 1.68 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 420 RPC/s Min: 420 RPC/s Max: 420 RPC/s [W] Avg: 845 RPC/s Min: 845 RPC/s Max: 845 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.71 MiB/s Min: 1.71 MiB/s Max: 1.71 MiB/s [LNet Rates of c] [R] Avg: 820 RPC/s Min: 820 RPC/s Max: 820 RPC/s [W] Avg: 411 RPC/s Min: 411 RPC/s Max: 411 RPC/s [LNet Bandwidth of c] [R] Avg: 1.66 MiB/s Min: 1.66 MiB/s Max: 1.66 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 409 RPC/s Min: 409 RPC/s Max: 409 RPC/s [W] Avg: 817 RPC/s Min: 817 RPC/s Max: 817 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.66 MiB/s Min: 1.66 MiB/s Max: 1.66 MiB/s [LNet Rates of c] [R] Avg: 861 RPC/s Min: 861 RPC/s Max: 861 RPC/s [W] Avg: 432 RPC/s Min: 432 RPC/s Max: 432 RPC/s [LNet Bandwidth of c] [R] Avg: 1.74 MiB/s Min: 1.74 MiB/s Max: 1.74 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 447 RPC/s Min: 447 RPC/s Max: 447 RPC/s [W] Avg: 875 RPC/s Min: 875 RPC/s Max: 875 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.74 MiB/s Min: 1.74 MiB/s Max: 1.74 MiB/s [LNet Rates of c] [R] Avg: 897 RPC/s Min: 897 RPC/s Max: 897 RPC/s [W] Avg: 446 RPC/s Min: 446 RPC/s Max: 446 RPC/s [LNet Bandwidth of c] [R] Avg: 1.81 MiB/s Min: 1.81 MiB/s Max: 1.81 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 450 RPC/s Min: 450 RPC/s Max: 450 RPC/s [W] Avg: 899 RPC/s Min: 899 RPC/s Max: 899 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.82 MiB/s Min: 1.82 MiB/s Max: 1.82 MiB/s [LNet Rates of c] [R] Avg: 956 RPC/s Min: 956 RPC/s Max: 956 RPC/s [W] Avg: 483 RPC/s Min: 483 RPC/s Max: 483 RPC/s [LNet Bandwidth of c] [R] Avg: 1.93 MiB/s Min: 1.93 MiB/s Max: 1.93 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 478 RPC/s Min: 478 RPC/s Max: 478 RPC/s [W] Avg: 951 RPC/s Min: 951 RPC/s Max: 951 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.93 MiB/s Min: 1.93 MiB/s Max: 1.93 MiB/s [LNet Rates of c] [R] Avg: 893 RPC/s Min: 893 RPC/s Max: 893 RPC/s [W] Avg: 447 RPC/s Min: 447 RPC/s Max: 447 RPC/s [LNet Bandwidth of c] [R] Avg: 1.81 MiB/s Min: 1.81 MiB/s Max: 1.81 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 446 RPC/s Min: 446 RPC/s Max: 446 RPC/s [W] Avg: 891 RPC/s Min: 891 RPC/s Max: 891 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.81 MiB/s Min: 1.81 MiB/s Max: 1.81 MiB/s [LNet Rates of c] [R] Avg: 777 RPC/s Min: 777 RPC/s Max: 777 RPC/s [W] Avg: 391 RPC/s Min: 391 RPC/s Max: 391 RPC/s [LNet Bandwidth of c] [R] Avg: 1.57 MiB/s Min: 1.57 MiB/s Max: 1.57 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 387 RPC/s Min: 387 RPC/s Max: 387 RPC/s [W] Avg: 780 RPC/s Min: 780 RPC/s Max: 780 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.58 MiB/s Min: 1.58 MiB/s Max: 1.58 MiB/s [LNet Rates of c] [R] Avg: 715 RPC/s Min: 715 RPC/s Max: 715 RPC/s [W] Avg: 359 RPC/s Min: 359 RPC/s Max: 359 RPC/s [LNet Bandwidth of c] [R] Avg: 1.44 MiB/s Min: 1.44 MiB/s Max: 1.44 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 371 RPC/s Min: 371 RPC/s Max: 371 RPC/s [W] Avg: 726 RPC/s Min: 726 RPC/s Max: 726 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.44 MiB/s Min: 1.44 MiB/s Max: 1.44 MiB/s [LNet Rates of c] [R] Avg: 995 RPC/s Min: 995 RPC/s Max: 995 RPC/s [W] Avg: 497 RPC/s Min: 497 RPC/s Max: 497 RPC/s [LNet Bandwidth of c] [R] Avg: 2.02 MiB/s Min: 2.02 MiB/s Max: 2.02 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 499 RPC/s Min: 499 RPC/s Max: 499 RPC/s [W] Avg: 989 RPC/s Min: 989 RPC/s Max: 989 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.01 MiB/s Min: 2.01 MiB/s Max: 2.01 MiB/s [LNet Rates of c] [R] Avg: 1146 RPC/s Min: 1146 RPC/s Max: 1146 RPC/s [W] Avg: 575 RPC/s Min: 575 RPC/s Max: 575 RPC/s [LNet Bandwidth of c] [R] Avg: 2.32 MiB/s Min: 2.32 MiB/s Max: 2.32 MiB/s [W] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [LNet Rates of s] [R] Avg: 567 RPC/s Min: 567 RPC/s Max: 567 RPC/s [W] Avg: 1135 RPC/s Min: 1135 RPC/s Max: 1135 RPC/s [LNet Bandwidth of s] [R] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [W] Avg: 2.31 MiB/s Min: 2.31 MiB/s Max: 2.31 MiB/s 1 batch in stopping Batch is stopped === BRW read off=1024 size=64k === Test was added successfully b_r_1024_64k is running now [LNet Rates of c] [R] Avg: 407 RPC/s Min: 407 RPC/s Max: 407 RPC/s [W] Avg: 204 RPC/s Min: 204 RPC/s Max: 204 RPC/s [LNet Bandwidth of c] [R] Avg: 12.71 MiB/s Min: 12.71 MiB/s Max: 12.71 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 202 RPC/s Min: 202 RPC/s Max: 202 RPC/s [W] Avg: 405 RPC/s Min: 405 RPC/s Max: 405 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 12.68 MiB/s Min: 12.68 MiB/s Max: 12.68 MiB/s [LNet Rates of c] [R] Avg: 470 RPC/s Min: 470 RPC/s Max: 470 RPC/s [W] Avg: 236 RPC/s Min: 236 RPC/s Max: 236 RPC/s [LNet Bandwidth of c] [R] Avg: 14.65 MiB/s Min: 14.65 MiB/s Max: 14.65 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 247 RPC/s Min: 247 RPC/s Max: 247 RPC/s [W] Avg: 479 RPC/s Min: 479 RPC/s Max: 479 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 14.49 MiB/s Min: 14.49 MiB/s Max: 14.49 MiB/s [LNet Rates of c] [R] Avg: 502 RPC/s Min: 502 RPC/s Max: 502 RPC/s [W] Avg: 252 RPC/s Min: 252 RPC/s Max: 252 RPC/s [LNet Bandwidth of c] [R] Avg: 15.57 MiB/s Min: 15.57 MiB/s Max: 15.57 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 254 RPC/s Min: 254 RPC/s Max: 254 RPC/s [W] Avg: 505 RPC/s Min: 505 RPC/s Max: 505 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.80 MiB/s Min: 15.80 MiB/s Max: 15.80 MiB/s [LNet Rates of c] [R] Avg: 374 RPC/s Min: 374 RPC/s Max: 374 RPC/s [W] Avg: 188 RPC/s Min: 188 RPC/s Max: 188 RPC/s [LNet Bandwidth of c] [R] Avg: 11.67 MiB/s Min: 11.67 MiB/s Max: 11.67 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 186 RPC/s Min: 186 RPC/s Max: 186 RPC/s [W] Avg: 373 RPC/s Min: 373 RPC/s Max: 373 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.67 MiB/s Min: 11.67 MiB/s Max: 11.67 MiB/s [LNet Rates of c] [R] Avg: 411 RPC/s Min: 411 RPC/s Max: 411 RPC/s [W] Avg: 208 RPC/s Min: 208 RPC/s Max: 208 RPC/s [LNet Bandwidth of c] [R] Avg: 12.76 MiB/s Min: 12.76 MiB/s Max: 12.76 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 204 RPC/s Min: 204 RPC/s Max: 204 RPC/s [W] Avg: 409 RPC/s Min: 409 RPC/s Max: 409 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 12.70 MiB/s Min: 12.70 MiB/s Max: 12.70 MiB/s [LNet Rates of c] [R] Avg: 313 RPC/s Min: 313 RPC/s Max: 313 RPC/s [W] Avg: 159 RPC/s Min: 159 RPC/s Max: 159 RPC/s [LNet Bandwidth of c] [R] Avg: 9.65 MiB/s Min: 9.65 MiB/s Max: 9.65 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 157 RPC/s Min: 157 RPC/s Max: 157 RPC/s [W] Avg: 315 RPC/s Min: 315 RPC/s Max: 315 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.87 MiB/s Min: 9.87 MiB/s Max: 9.87 MiB/s [LNet Rates of c] [R] Avg: 346 RPC/s Min: 346 RPC/s Max: 346 RPC/s [W] Avg: 172 RPC/s Min: 172 RPC/s Max: 172 RPC/s [LNet Bandwidth of c] [R] Avg: 10.88 MiB/s Min: 10.88 MiB/s Max: 10.88 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 190 RPC/s Min: 190 RPC/s Max: 190 RPC/s [W] Avg: 359 RPC/s Min: 359 RPC/s Max: 359 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.68 MiB/s Min: 10.68 MiB/s Max: 10.68 MiB/s [LNet Rates of c] [R] Avg: 450 RPC/s Min: 450 RPC/s Max: 450 RPC/s [W] Avg: 226 RPC/s Min: 226 RPC/s Max: 226 RPC/s [LNet Bandwidth of c] [R] Avg: 13.92 MiB/s Min: 13.92 MiB/s Max: 13.92 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 222 RPC/s Min: 222 RPC/s Max: 222 RPC/s [W] Avg: 444 RPC/s Min: 444 RPC/s Max: 444 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.95 MiB/s Min: 13.95 MiB/s Max: 13.95 MiB/s [LNet Rates of c] [R] Avg: 419 RPC/s Min: 419 RPC/s Max: 419 RPC/s [W] Avg: 214 RPC/s Min: 214 RPC/s Max: 214 RPC/s [LNet Bandwidth of c] [R] Avg: 13.05 MiB/s Min: 13.05 MiB/s Max: 13.05 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 210 RPC/s Min: 210 RPC/s Max: 210 RPC/s [W] Avg: 419 RPC/s Min: 419 RPC/s Max: 419 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.04 MiB/s Min: 13.04 MiB/s Max: 13.04 MiB/s [LNet Rates of c] [R] Avg: 456 RPC/s Min: 456 RPC/s Max: 456 RPC/s [W] Avg: 230 RPC/s Min: 230 RPC/s Max: 230 RPC/s [LNet Bandwidth of c] [R] Avg: 14.17 MiB/s Min: 14.17 MiB/s Max: 14.17 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 227 RPC/s Min: 227 RPC/s Max: 227 RPC/s [W] Avg: 451 RPC/s Min: 451 RPC/s Max: 451 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 14.11 MiB/s Min: 14.11 MiB/s Max: 14.11 MiB/s 1 batch in stopping Batch is stopped === BRW read off=2048 size=4k === Test was added successfully b_r_2048_4k is running now [LNet Rates of c] [R] Avg: 707 RPC/s Min: 707 RPC/s Max: 707 RPC/s [W] Avg: 356 RPC/s Min: 356 RPC/s Max: 356 RPC/s [LNet Bandwidth of c] [R] Avg: 1.43 MiB/s Min: 1.43 MiB/s Max: 1.43 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 360 RPC/s Min: 360 RPC/s Max: 360 RPC/s [W] Avg: 709 RPC/s Min: 709 RPC/s Max: 709 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.43 MiB/s Min: 1.43 MiB/s Max: 1.43 MiB/s [LNet Rates of c] [R] Avg: 878 RPC/s Min: 878 RPC/s Max: 878 RPC/s [W] Avg: 441 RPC/s Min: 441 RPC/s Max: 441 RPC/s [LNet Bandwidth of c] [R] Avg: 1.78 MiB/s Min: 1.78 MiB/s Max: 1.78 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 440 RPC/s Min: 440 RPC/s Max: 440 RPC/s [W] Avg: 879 RPC/s Min: 879 RPC/s Max: 879 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.78 MiB/s Min: 1.78 MiB/s Max: 1.78 MiB/s [LNet Rates of c] [R] Avg: 954 RPC/s Min: 954 RPC/s Max: 954 RPC/s [W] Avg: 479 RPC/s Min: 479 RPC/s Max: 479 RPC/s [LNet Bandwidth of c] [R] Avg: 1.93 MiB/s Min: 1.93 MiB/s Max: 1.93 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 475 RPC/s Min: 475 RPC/s Max: 475 RPC/s [W] Avg: 951 RPC/s Min: 951 RPC/s Max: 951 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.93 MiB/s Min: 1.93 MiB/s Max: 1.93 MiB/s [LNet Rates of c] [R] Avg: 893 RPC/s Min: 893 RPC/s Max: 893 RPC/s [W] Avg: 448 RPC/s Min: 448 RPC/s Max: 448 RPC/s [LNet Bandwidth of c] [R] Avg: 1.81 MiB/s Min: 1.81 MiB/s Max: 1.81 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 442 RPC/s Min: 442 RPC/s Max: 442 RPC/s [W] Avg: 879 RPC/s Min: 879 RPC/s Max: 879 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.78 MiB/s Min: 1.78 MiB/s Max: 1.78 MiB/s [LNet Rates of c] [R] Avg: 885 RPC/s Min: 885 RPC/s Max: 885 RPC/s [W] Avg: 442 RPC/s Min: 442 RPC/s Max: 442 RPC/s [LNet Bandwidth of c] [R] Avg: 1.80 MiB/s Min: 1.80 MiB/s Max: 1.80 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 456 RPC/s Min: 456 RPC/s Max: 456 RPC/s [W] Avg: 905 RPC/s Min: 905 RPC/s Max: 905 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.82 MiB/s Min: 1.82 MiB/s Max: 1.82 MiB/s [LNet Rates of c] [R] Avg: 920 RPC/s Min: 920 RPC/s Max: 920 RPC/s [W] Avg: 462 RPC/s Min: 462 RPC/s Max: 462 RPC/s [LNet Bandwidth of c] [R] Avg: 1.86 MiB/s Min: 1.86 MiB/s Max: 1.86 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 465 RPC/s Min: 465 RPC/s Max: 465 RPC/s [W] Avg: 920 RPC/s Min: 920 RPC/s Max: 920 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.86 MiB/s Min: 1.86 MiB/s Max: 1.86 MiB/s [LNet Rates of c] [R] Avg: 866 RPC/s Min: 866 RPC/s Max: 866 RPC/s [W] Avg: 435 RPC/s Min: 435 RPC/s Max: 435 RPC/s [LNet Bandwidth of c] [R] Avg: 1.75 MiB/s Min: 1.75 MiB/s Max: 1.75 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 431 RPC/s Min: 431 RPC/s Max: 431 RPC/s [W] Avg: 864 RPC/s Min: 864 RPC/s Max: 864 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.75 MiB/s Min: 1.75 MiB/s Max: 1.75 MiB/s [LNet Rates of c] [R] Avg: 913 RPC/s Min: 913 RPC/s Max: 913 RPC/s [W] Avg: 458 RPC/s Min: 458 RPC/s Max: 458 RPC/s [LNet Bandwidth of c] [R] Avg: 1.85 MiB/s Min: 1.85 MiB/s Max: 1.85 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 459 RPC/s Min: 459 RPC/s Max: 459 RPC/s [W] Avg: 914 RPC/s Min: 914 RPC/s Max: 914 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.85 MiB/s Min: 1.85 MiB/s Max: 1.85 MiB/s [LNet Rates of c] [R] Avg: 617 RPC/s Min: 617 RPC/s Max: 617 RPC/s [W] Avg: 310 RPC/s Min: 310 RPC/s Max: 310 RPC/s [LNet Bandwidth of c] [R] Avg: 1.24 MiB/s Min: 1.24 MiB/s Max: 1.24 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 304 RPC/s Min: 304 RPC/s Max: 304 RPC/s [W] Avg: 611 RPC/s Min: 611 RPC/s Max: 611 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.24 MiB/s Min: 1.24 MiB/s Max: 1.24 MiB/s [LNet Rates of c] [R] Avg: 951 RPC/s Min: 951 RPC/s Max: 951 RPC/s [W] Avg: 476 RPC/s Min: 476 RPC/s Max: 476 RPC/s [LNet Bandwidth of c] [R] Avg: 1.93 MiB/s Min: 1.93 MiB/s Max: 1.93 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 486 RPC/s Min: 486 RPC/s Max: 486 RPC/s [W] Avg: 960 RPC/s Min: 960 RPC/s Max: 960 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.92 MiB/s Min: 1.92 MiB/s Max: 1.92 MiB/s Batch is stopped === BRW read off=2048 size=64k === Test was added successfully b_r_2048_64k is running now [LNet Rates of c] [R] Avg: 358 RPC/s Min: 358 RPC/s Max: 358 RPC/s [W] Avg: 182 RPC/s Min: 182 RPC/s Max: 182 RPC/s [LNet Bandwidth of c] [R] Avg: 11.08 MiB/s Min: 11.08 MiB/s Max: 11.08 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 183 RPC/s Min: 183 RPC/s Max: 183 RPC/s [W] Avg: 363 RPC/s Min: 363 RPC/s Max: 363 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.25 MiB/s Min: 11.25 MiB/s Max: 11.25 MiB/s [LNet Rates of c] [R] Avg: 388 RPC/s Min: 388 RPC/s Max: 388 RPC/s [W] Avg: 195 RPC/s Min: 195 RPC/s Max: 195 RPC/s [LNet Bandwidth of c] [R] Avg: 12.10 MiB/s Min: 12.10 MiB/s Max: 12.10 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 193 RPC/s Min: 193 RPC/s Max: 193 RPC/s [W] Avg: 390 RPC/s Min: 390 RPC/s Max: 390 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 12.17 MiB/s Min: 12.17 MiB/s Max: 12.17 MiB/s [LNet Rates of c] [R] Avg: 376 RPC/s Min: 376 RPC/s Max: 376 RPC/s [W] Avg: 189 RPC/s Min: 189 RPC/s Max: 189 RPC/s [LNet Bandwidth of c] [R] Avg: 11.62 MiB/s Min: 11.62 MiB/s Max: 11.62 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 189 RPC/s Min: 189 RPC/s Max: 189 RPC/s [W] Avg: 375 RPC/s Min: 375 RPC/s Max: 375 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.71 MiB/s Min: 11.71 MiB/s Max: 11.71 MiB/s [LNet Rates of c] [R] Avg: 405 RPC/s Min: 405 RPC/s Max: 405 RPC/s [W] Avg: 204 RPC/s Min: 204 RPC/s Max: 204 RPC/s [LNet Bandwidth of c] [R] Avg: 12.67 MiB/s Min: 12.67 MiB/s Max: 12.67 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 201 RPC/s Min: 201 RPC/s Max: 201 RPC/s [W] Avg: 401 RPC/s Min: 401 RPC/s Max: 401 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 12.49 MiB/s Min: 12.49 MiB/s Max: 12.49 MiB/s [LNet Rates of c] [R] Avg: 292 RPC/s Min: 292 RPC/s Max: 292 RPC/s [W] Avg: 147 RPC/s Min: 147 RPC/s Max: 147 RPC/s [LNet Bandwidth of c] [R] Avg: 9.02 MiB/s Min: 9.02 MiB/s Max: 9.02 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 155 RPC/s Min: 155 RPC/s Max: 155 RPC/s [W] Avg: 296 RPC/s Min: 296 RPC/s Max: 296 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.88 MiB/s Min: 8.88 MiB/s Max: 8.88 MiB/s [LNet Rates of c] [R] Avg: 306 RPC/s Min: 306 RPC/s Max: 306 RPC/s [W] Avg: 154 RPC/s Min: 154 RPC/s Max: 154 RPC/s [LNet Bandwidth of c] [R] Avg: 9.54 MiB/s Min: 9.54 MiB/s Max: 9.54 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 156 RPC/s Min: 156 RPC/s Max: 156 RPC/s [W] Avg: 315 RPC/s Min: 315 RPC/s Max: 315 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.74 MiB/s Min: 9.74 MiB/s Max: 9.74 MiB/s [LNet Rates of c] [R] Avg: 346 RPC/s Min: 346 RPC/s Max: 346 RPC/s [W] Avg: 175 RPC/s Min: 175 RPC/s Max: 175 RPC/s [LNet Bandwidth of c] [R] Avg: 10.75 MiB/s Min: 10.75 MiB/s Max: 10.75 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 173 RPC/s Min: 173 RPC/s Max: 173 RPC/s [W] Avg: 344 RPC/s Min: 344 RPC/s Max: 344 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.73 MiB/s Min: 10.73 MiB/s Max: 10.73 MiB/s [LNet Rates of c] [R] Avg: 351 RPC/s Min: 351 RPC/s Max: 351 RPC/s [W] Avg: 174 RPC/s Min: 174 RPC/s Max: 174 RPC/s [LNet Bandwidth of c] [R] Avg: 10.81 MiB/s Min: 10.81 MiB/s Max: 10.81 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 176 RPC/s Min: 176 RPC/s Max: 176 RPC/s [W] Avg: 345 RPC/s Min: 345 RPC/s Max: 345 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.79 MiB/s Min: 10.79 MiB/s Max: 10.79 MiB/s [LNet Rates of c] [R] Avg: 277 RPC/s Min: 277 RPC/s Max: 277 RPC/s [W] Avg: 144 RPC/s Min: 144 RPC/s Max: 144 RPC/s [LNet Bandwidth of c] [R] Avg: 8.59 MiB/s Min: 8.59 MiB/s Max: 8.59 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 138 RPC/s Min: 138 RPC/s Max: 138 RPC/s [W] Avg: 274 RPC/s Min: 274 RPC/s Max: 274 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.56 MiB/s Min: 8.56 MiB/s Max: 8.56 MiB/s [LNet Rates of c] [R] Avg: 263 RPC/s Min: 263 RPC/s Max: 263 RPC/s [W] Avg: 132 RPC/s Min: 132 RPC/s Max: 132 RPC/s [LNet Bandwidth of c] [R] Avg: 8.20 MiB/s Min: 8.20 MiB/s Max: 8.20 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 143 RPC/s Min: 143 RPC/s Max: 143 RPC/s [W] Avg: 275 RPC/s Min: 275 RPC/s Max: 275 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.22 MiB/s Min: 8.22 MiB/s Max: 8.22 MiB/s 1 batch in stopping Batch is stopped c: Total 0 error nodes in c s: Total 0 error nodes in s Total 0 error nodes in c Total 0 error nodes in s === BRW write off=2048 size=1M (off+len > LNET_MTU) === operation add test failed on 0-200@<204:43200>: Invalid argument === BRW read off=4096 size=4k (rejected) === operation add test failed on 0-200@<204:43200>: Invalid argument oleg455-client: oleg455-client.virtnet: executing lst_cleanup oleg455-server: oleg455-server.virtnet: executing lst_cleanup