== lnet-selftest test brw_offset: lst BRW offset handling (LU-20104) ========================================================== 11:26:20 (1788535580) oleg437-client: oleg437-client.virtnet: executing lst_cleanup oleg437-server: oleg437-server.virtnet: executing lst_cleanup oleg437-client: oleg437-client.virtnet: executing lst_setup oleg437-server: oleg437-server.virtnet: executing lst_setup === BRW read off=0 size=4k === Test was added successfully b_r_0_4k is running now [LNet Rates of c] [R] Avg: 369 RPC/s Min: 369 RPC/s Max: 369 RPC/s [W] Avg: 186 RPC/s Min: 186 RPC/s Max: 186 RPC/s [LNet Bandwidth of c] [R] Avg: 0.75 MiB/s Min: 0.75 MiB/s Max: 0.75 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 186 RPC/s Min: 186 RPC/s Max: 186 RPC/s [W] Avg: 363 RPC/s Min: 363 RPC/s Max: 363 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 0.74 MiB/s Min: 0.74 MiB/s Max: 0.74 MiB/s [LNet Rates of c] [R] Avg: 423 RPC/s Min: 423 RPC/s Max: 423 RPC/s [W] Avg: 213 RPC/s Min: 213 RPC/s Max: 213 RPC/s [LNet Bandwidth of c] [R] Avg: 0.85 MiB/s Min: 0.85 MiB/s Max: 0.85 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 213 RPC/s Min: 213 RPC/s Max: 213 RPC/s [W] Avg: 423 RPC/s Min: 423 RPC/s Max: 423 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 0.85 MiB/s Min: 0.85 MiB/s Max: 0.85 MiB/s [LNet Rates of c] [R] Avg: 443 RPC/s Min: 443 RPC/s Max: 443 RPC/s [W] Avg: 223 RPC/s Min: 223 RPC/s Max: 223 RPC/s [LNet Bandwidth of c] [R] Avg: 0.89 MiB/s Min: 0.89 MiB/s Max: 0.89 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 222 RPC/s Min: 222 RPC/s Max: 222 RPC/s [W] Avg: 444 RPC/s Min: 444 RPC/s Max: 444 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 0.90 MiB/s Min: 0.90 MiB/s Max: 0.90 MiB/s [LNet Rates of c] [R] Avg: 578 RPC/s Min: 578 RPC/s Max: 578 RPC/s [W] Avg: 290 RPC/s Min: 290 RPC/s Max: 290 RPC/s [LNet Bandwidth of c] [R] Avg: 1.17 MiB/s Min: 1.17 MiB/s Max: 1.17 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 292 RPC/s Min: 292 RPC/s Max: 292 RPC/s [W] Avg: 576 RPC/s Min: 576 RPC/s Max: 576 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.15 MiB/s Min: 1.15 MiB/s Max: 1.15 MiB/s [LNet Rates of c] [R] Avg: 448 RPC/s Min: 448 RPC/s Max: 448 RPC/s [W] Avg: 225 RPC/s Min: 225 RPC/s Max: 225 RPC/s [LNet Bandwidth of c] [R] Avg: 0.91 MiB/s Min: 0.91 MiB/s Max: 0.91 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 227 RPC/s Min: 227 RPC/s Max: 227 RPC/s [W] Avg: 450 RPC/s Min: 450 RPC/s Max: 450 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 0.91 MiB/s Min: 0.91 MiB/s Max: 0.91 MiB/s [LNet Rates of c] [R] Avg: 790 RPC/s Min: 790 RPC/s Max: 790 RPC/s [W] Avg: 396 RPC/s Min: 396 RPC/s Max: 396 RPC/s [LNet Bandwidth of c] [R] Avg: 1.59 MiB/s Min: 1.59 MiB/s Max: 1.59 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 396 RPC/s Min: 396 RPC/s Max: 396 RPC/s [W] Avg: 784 RPC/s Min: 784 RPC/s Max: 784 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.58 MiB/s Min: 1.58 MiB/s Max: 1.58 MiB/s [LNet Rates of c] [R] Avg: 496 RPC/s Min: 496 RPC/s Max: 496 RPC/s [W] Avg: 250 RPC/s Min: 250 RPC/s Max: 250 RPC/s [LNet Bandwidth of c] [R] Avg: 1.00 MiB/s Min: 1.00 MiB/s Max: 1.00 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 249 RPC/s Min: 249 RPC/s Max: 249 RPC/s [W] Avg: 499 RPC/s Min: 499 RPC/s Max: 499 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 1.01 MiB/s Min: 1.01 MiB/s Max: 1.01 MiB/s [LNet Rates of c] [R] Avg: 775 RPC/s Min: 775 RPC/s Max: 775 RPC/s [W] Avg: 389 RPC/s Min: 389 RPC/s Max: 389 RPC/s [LNet Bandwidth of c] [R] Avg: 1.57 MiB/s Min: 1.57 MiB/s Max: 1.57 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 389 RPC/s Min: 389 RPC/s Max: 389 RPC/s [W] Avg: 778 RPC/s Min: 778 RPC/s Max: 778 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.58 MiB/s Min: 1.58 MiB/s Max: 1.58 MiB/s [LNet Rates of c] [R] Avg: 535 RPC/s Min: 535 RPC/s Max: 535 RPC/s [W] Avg: 269 RPC/s Min: 269 RPC/s Max: 269 RPC/s [LNet Bandwidth of c] [R] Avg: 1.08 MiB/s Min: 1.08 MiB/s Max: 1.08 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 279 RPC/s Min: 279 RPC/s Max: 279 RPC/s [W] Avg: 544 RPC/s Min: 544 RPC/s Max: 544 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 1.08 MiB/s Min: 1.08 MiB/s Max: 1.08 MiB/s [LNet Rates of c] [R] Avg: 657 RPC/s Min: 657 RPC/s Max: 657 RPC/s [W] Avg: 330 RPC/s Min: 330 RPC/s Max: 330 RPC/s [LNet Bandwidth of c] [R] Avg: 1.33 MiB/s Min: 1.33 MiB/s Max: 1.33 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 330 RPC/s Min: 330 RPC/s Max: 330 RPC/s [W] Avg: 659 RPC/s Min: 659 RPC/s Max: 659 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.33 MiB/s Min: 1.33 MiB/s Max: 1.33 MiB/s Batch is stopped === BRW read off=0 size=64k === Test was added successfully b_r_0_64k is running now [LNet Rates of c] [R] Avg: 180 RPC/s Min: 180 RPC/s Max: 180 RPC/s [W] Avg: 92 RPC/s Min: 92 RPC/s Max: 92 RPC/s [LNet Bandwidth of c] [R] Avg: 5.52 MiB/s Min: 5.52 MiB/s Max: 5.52 MiB/s [W] Avg: 0.01 MiB/s Min: 0.01 MiB/s Max: 0.01 MiB/s [LNet Rates of s] [R] Avg: 92 RPC/s Min: 92 RPC/s Max: 92 RPC/s [W] Avg: 181 RPC/s Min: 181 RPC/s Max: 181 RPC/s [LNet Bandwidth of s] [R] Avg: 0.01 MiB/s Min: 0.01 MiB/s Max: 0.01 MiB/s [W] Avg: 5.58 MiB/s Min: 5.58 MiB/s Max: 5.58 MiB/s [LNet Rates of c] [R] Avg: 350 RPC/s Min: 350 RPC/s Max: 350 RPC/s [W] Avg: 176 RPC/s Min: 176 RPC/s Max: 176 RPC/s [LNet Bandwidth of c] [R] Avg: 10.89 MiB/s Min: 10.89 MiB/s Max: 10.89 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 173 RPC/s Min: 173 RPC/s Max: 173 RPC/s [W] Avg: 346 RPC/s Min: 346 RPC/s Max: 346 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.87 MiB/s Min: 10.87 MiB/s Max: 10.87 MiB/s [LNet Rates of c] [R] Avg: 334 RPC/s Min: 334 RPC/s Max: 334 RPC/s [W] Avg: 169 RPC/s Min: 169 RPC/s Max: 169 RPC/s [LNet Bandwidth of c] [R] Avg: 10.30 MiB/s Min: 10.30 MiB/s Max: 10.30 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 168 RPC/s Min: 168 RPC/s Max: 168 RPC/s [W] Avg: 332 RPC/s Min: 332 RPC/s Max: 332 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.29 MiB/s Min: 10.29 MiB/s Max: 10.29 MiB/s [LNet Rates of c] [R] Avg: 257 RPC/s Min: 257 RPC/s Max: 257 RPC/s [W] Avg: 130 RPC/s Min: 130 RPC/s Max: 130 RPC/s [LNet Bandwidth of c] [R] Avg: 7.95 MiB/s Min: 7.95 MiB/s Max: 7.95 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 140 RPC/s Min: 140 RPC/s Max: 140 RPC/s [W] Avg: 267 RPC/s Min: 267 RPC/s Max: 267 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 7.93 MiB/s Min: 7.93 MiB/s Max: 7.93 MiB/s [LNet Rates of c] [R] Avg: 324 RPC/s Min: 324 RPC/s Max: 324 RPC/s [W] Avg: 163 RPC/s Min: 163 RPC/s Max: 163 RPC/s [LNet Bandwidth of c] [R] Avg: 10.05 MiB/s Min: 10.05 MiB/s Max: 10.05 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 165 RPC/s Min: 165 RPC/s Max: 165 RPC/s [W] Avg: 325 RPC/s Min: 325 RPC/s Max: 325 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.06 MiB/s Min: 10.06 MiB/s Max: 10.06 MiB/s [LNet Rates of c] [R] Avg: 365 RPC/s Min: 365 RPC/s Max: 365 RPC/s [W] Avg: 182 RPC/s Min: 182 RPC/s Max: 182 RPC/s [LNet Bandwidth of c] [R] Avg: 11.47 MiB/s Min: 11.47 MiB/s Max: 11.47 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 181 RPC/s Min: 181 RPC/s Max: 181 RPC/s [W] Avg: 365 RPC/s Min: 365 RPC/s Max: 365 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.44 MiB/s Min: 11.44 MiB/s Max: 11.44 MiB/s [LNet Rates of c] [R] Avg: 301 RPC/s Min: 301 RPC/s Max: 301 RPC/s [W] Avg: 153 RPC/s Min: 153 RPC/s Max: 153 RPC/s [LNet Bandwidth of c] [R] Avg: 9.28 MiB/s Min: 9.28 MiB/s Max: 9.28 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 150 RPC/s Min: 150 RPC/s Max: 150 RPC/s [W] Avg: 296 RPC/s Min: 296 RPC/s Max: 296 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.27 MiB/s Min: 9.27 MiB/s Max: 9.27 MiB/s [LNet Rates of c] [R] Avg: 341 RPC/s Min: 341 RPC/s Max: 341 RPC/s [W] Avg: 171 RPC/s Min: 171 RPC/s Max: 171 RPC/s [LNet Bandwidth of c] [R] Avg: 10.64 MiB/s Min: 10.64 MiB/s Max: 10.64 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 170 RPC/s Min: 170 RPC/s Max: 170 RPC/s [W] Avg: 344 RPC/s Min: 344 RPC/s Max: 344 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.73 MiB/s Min: 10.73 MiB/s Max: 10.73 MiB/s [LNet Rates of c] [R] Avg: 426 RPC/s Min: 426 RPC/s Max: 426 RPC/s [W] Avg: 216 RPC/s Min: 216 RPC/s Max: 216 RPC/s [LNet Bandwidth of c] [R] Avg: 13.12 MiB/s Min: 13.12 MiB/s Max: 13.12 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 228 RPC/s Min: 228 RPC/s Max: 228 RPC/s [W] Avg: 435 RPC/s Min: 435 RPC/s Max: 435 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 13.13 MiB/s Min: 13.13 MiB/s Max: 13.13 MiB/s [LNet Rates of c] [R] Avg: 367 RPC/s Min: 367 RPC/s Max: 367 RPC/s [W] Avg: 184 RPC/s Min: 184 RPC/s Max: 184 RPC/s [LNet Bandwidth of c] [R] Avg: 11.51 MiB/s Min: 11.51 MiB/s Max: 11.51 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 183 RPC/s Min: 183 RPC/s Max: 183 RPC/s [W] Avg: 367 RPC/s Min: 367 RPC/s Max: 367 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.48 MiB/s Min: 11.48 MiB/s Max: 11.48 MiB/s 1 batch in stopping Batch is stopped === BRW read off=512 size=4k === Test was added successfully b_r_512_4k is running now [LNet Rates of c] [R] Avg: 511 RPC/s Min: 511 RPC/s Max: 511 RPC/s [W] Avg: 256 RPC/s Min: 256 RPC/s Max: 256 RPC/s [LNet Bandwidth of c] [R] Avg: 1.04 MiB/s Min: 1.04 MiB/s Max: 1.04 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 261 RPC/s Min: 261 RPC/s Max: 261 RPC/s [W] Avg: 514 RPC/s Min: 514 RPC/s Max: 514 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 1.04 MiB/s Min: 1.04 MiB/s Max: 1.04 MiB/s [LNet Rates of c] [R] Avg: 776 RPC/s Min: 776 RPC/s Max: 776 RPC/s [W] Avg: 390 RPC/s Min: 390 RPC/s Max: 390 RPC/s [LNet Bandwidth of c] [R] Avg: 1.57 MiB/s Min: 1.57 MiB/s Max: 1.57 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 388 RPC/s Min: 388 RPC/s Max: 388 RPC/s [W] Avg: 783 RPC/s Min: 783 RPC/s Max: 783 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.59 MiB/s Min: 1.59 MiB/s Max: 1.59 MiB/s [LNet Rates of c] [R] Avg: 812 RPC/s Min: 812 RPC/s Max: 812 RPC/s [W] Avg: 407 RPC/s Min: 407 RPC/s Max: 407 RPC/s [LNet Bandwidth of c] [R] Avg: 1.64 MiB/s Min: 1.64 MiB/s Max: 1.64 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 418 RPC/s Min: 418 RPC/s Max: 418 RPC/s [W] Avg: 813 RPC/s Min: 813 RPC/s Max: 813 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.62 MiB/s Min: 1.62 MiB/s Max: 1.62 MiB/s [LNet Rates of c] [R] Avg: 667 RPC/s Min: 667 RPC/s Max: 667 RPC/s [W] Avg: 335 RPC/s Min: 335 RPC/s Max: 335 RPC/s [LNet Bandwidth of c] [R] Avg: 1.35 MiB/s Min: 1.35 MiB/s Max: 1.35 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 335 RPC/s Min: 335 RPC/s Max: 335 RPC/s [W] Avg: 669 RPC/s Min: 669 RPC/s Max: 669 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.35 MiB/s Min: 1.35 MiB/s Max: 1.35 MiB/s [LNet Rates of c] [R] Avg: 702 RPC/s Min: 702 RPC/s Max: 702 RPC/s [W] Avg: 353 RPC/s Min: 353 RPC/s Max: 353 RPC/s [LNet Bandwidth of c] [R] Avg: 1.42 MiB/s Min: 1.42 MiB/s Max: 1.42 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 350 RPC/s Min: 350 RPC/s Max: 350 RPC/s [W] Avg: 703 RPC/s Min: 703 RPC/s Max: 703 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.42 MiB/s Min: 1.42 MiB/s Max: 1.42 MiB/s [LNet Rates of c] [R] Avg: 806 RPC/s Min: 806 RPC/s Max: 806 RPC/s [W] Avg: 405 RPC/s Min: 405 RPC/s Max: 405 RPC/s [LNet Bandwidth of c] [R] Avg: 1.63 MiB/s Min: 1.63 MiB/s Max: 1.63 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 406 RPC/s Min: 406 RPC/s Max: 406 RPC/s [W] Avg: 814 RPC/s Min: 814 RPC/s Max: 814 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.65 MiB/s Min: 1.65 MiB/s Max: 1.65 MiB/s [LNet Rates of c] [R] Avg: 490 RPC/s Min: 490 RPC/s Max: 490 RPC/s [W] Avg: 246 RPC/s Min: 246 RPC/s Max: 246 RPC/s [LNet Bandwidth of c] [R] Avg: 0.99 MiB/s Min: 0.99 MiB/s Max: 0.99 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 236 RPC/s Min: 236 RPC/s Max: 236 RPC/s [W] Avg: 471 RPC/s Min: 471 RPC/s Max: 471 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 0.95 MiB/s Min: 0.95 MiB/s Max: 0.95 MiB/s [LNet Rates of c] [R] Avg: 713 RPC/s Min: 713 RPC/s Max: 713 RPC/s [W] Avg: 357 RPC/s Min: 357 RPC/s Max: 357 RPC/s [LNet Bandwidth of c] [R] Avg: 1.44 MiB/s Min: 1.44 MiB/s Max: 1.44 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 376 RPC/s Min: 376 RPC/s Max: 376 RPC/s [W] Avg: 733 RPC/s Min: 733 RPC/s Max: 733 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.46 MiB/s Min: 1.46 MiB/s Max: 1.46 MiB/s [LNet Rates of c] [R] Avg: 645 RPC/s Min: 645 RPC/s Max: 645 RPC/s [W] Avg: 325 RPC/s Min: 325 RPC/s Max: 325 RPC/s [LNet Bandwidth of c] [R] Avg: 1.30 MiB/s Min: 1.30 MiB/s Max: 1.30 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 326 RPC/s Min: 326 RPC/s Max: 326 RPC/s [W] Avg: 645 RPC/s Min: 645 RPC/s Max: 645 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.30 MiB/s Min: 1.30 MiB/s Max: 1.30 MiB/s [LNet Rates of c] [R] Avg: 426 RPC/s Min: 426 RPC/s Max: 426 RPC/s [W] Avg: 214 RPC/s Min: 214 RPC/s Max: 214 RPC/s [LNet Bandwidth of c] [R] Avg: 0.86 MiB/s Min: 0.86 MiB/s Max: 0.86 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 212 RPC/s Min: 212 RPC/s Max: 212 RPC/s [W] Avg: 424 RPC/s Min: 424 RPC/s Max: 424 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 0.86 MiB/s Min: 0.86 MiB/s Max: 0.86 MiB/s 1 batch in stopping Batch is stopped === BRW read off=512 size=64k === Test was added successfully b_r_512_64k is running now [LNet Rates of c] [R] Avg: 191 RPC/s Min: 191 RPC/s Max: 191 RPC/s [W] Avg: 96 RPC/s Min: 96 RPC/s Max: 96 RPC/s [LNet Bandwidth of c] [R] Avg: 5.88 MiB/s Min: 5.88 MiB/s Max: 5.88 MiB/s [W] Avg: 0.01 MiB/s Min: 0.01 MiB/s Max: 0.01 MiB/s [LNet Rates of s] [R] Avg: 107 RPC/s Min: 107 RPC/s Max: 107 RPC/s [W] Avg: 204 RPC/s Min: 204 RPC/s Max: 204 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 6.03 MiB/s Min: 6.03 MiB/s Max: 6.03 MiB/s [LNet Rates of c] [R] Avg: 226 RPC/s Min: 226 RPC/s Max: 226 RPC/s [W] Avg: 115 RPC/s Min: 115 RPC/s Max: 115 RPC/s [LNet Bandwidth of c] [R] Avg: 7.02 MiB/s Min: 7.02 MiB/s Max: 7.02 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 118 RPC/s Min: 118 RPC/s Max: 118 RPC/s [W] Avg: 229 RPC/s Min: 229 RPC/s Max: 229 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 7.02 MiB/s Min: 7.02 MiB/s Max: 7.02 MiB/s [LNet Rates of c] [R] Avg: 467 RPC/s Min: 467 RPC/s Max: 467 RPC/s [W] Avg: 236 RPC/s Min: 236 RPC/s Max: 236 RPC/s [LNet Bandwidth of c] [R] Avg: 14.44 MiB/s Min: 14.44 MiB/s Max: 14.44 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 233 RPC/s Min: 233 RPC/s Max: 233 RPC/s [W] Avg: 466 RPC/s Min: 466 RPC/s Max: 466 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 14.51 MiB/s Min: 14.51 MiB/s Max: 14.51 MiB/s [LNet Rates of c] [R] Avg: 419 RPC/s Min: 419 RPC/s Max: 419 RPC/s [W] Avg: 210 RPC/s Min: 210 RPC/s Max: 210 RPC/s [LNet Bandwidth of c] [R] Avg: 13.10 MiB/s Min: 13.10 MiB/s Max: 13.10 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 209 RPC/s Min: 209 RPC/s Max: 209 RPC/s [W] Avg: 417 RPC/s Min: 417 RPC/s Max: 417 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.09 MiB/s Min: 13.09 MiB/s Max: 13.09 MiB/s [LNet Rates of c] [R] Avg: 428 RPC/s Min: 428 RPC/s Max: 428 RPC/s [W] Avg: 216 RPC/s Min: 216 RPC/s Max: 216 RPC/s [LNet Bandwidth of c] [R] Avg: 13.28 MiB/s Min: 13.28 MiB/s Max: 13.28 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 215 RPC/s Min: 215 RPC/s Max: 215 RPC/s [W] Avg: 427 RPC/s Min: 427 RPC/s Max: 427 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.33 MiB/s Min: 13.33 MiB/s Max: 13.33 MiB/s [LNet Rates of c] [R] Avg: 343 RPC/s Min: 343 RPC/s Max: 343 RPC/s [W] Avg: 174 RPC/s Min: 174 RPC/s Max: 174 RPC/s [LNet Bandwidth of c] [R] Avg: 10.63 MiB/s Min: 10.63 MiB/s Max: 10.63 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 182 RPC/s Min: 182 RPC/s Max: 182 RPC/s [W] Avg: 351 RPC/s Min: 351 RPC/s Max: 351 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.57 MiB/s Min: 10.57 MiB/s Max: 10.57 MiB/s [LNet Rates of c] [R] Avg: 366 RPC/s Min: 366 RPC/s Max: 366 RPC/s [W] Avg: 185 RPC/s Min: 185 RPC/s Max: 185 RPC/s [LNet Bandwidth of c] [R] Avg: 11.39 MiB/s Min: 11.39 MiB/s Max: 11.39 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 186 RPC/s Min: 186 RPC/s Max: 186 RPC/s [W] Avg: 368 RPC/s Min: 368 RPC/s Max: 368 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.44 MiB/s Min: 11.44 MiB/s Max: 11.44 MiB/s [LNet Rates of c] [R] Avg: 500 RPC/s Min: 500 RPC/s Max: 500 RPC/s [W] Avg: 500 RPC/s Min: 500 RPC/s Max: 500 RPC/s [LNet Bandwidth of c] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 143 RPC/s Min: 143 RPC/s Max: 143 RPC/s [W] Avg: 143 RPC/s Min: 143 RPC/s Max: 143 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of c] [R] Avg: 429 RPC/s Min: 429 RPC/s Max: 429 RPC/s [W] Avg: 215 RPC/s Min: 215 RPC/s Max: 215 RPC/s [LNet Bandwidth of c] [R] Avg: 13.38 MiB/s Min: 13.38 MiB/s Max: 13.38 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 214 RPC/s Min: 214 RPC/s Max: 214 RPC/s [W] Avg: 429 RPC/s Min: 429 RPC/s Max: 429 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.41 MiB/s Min: 13.41 MiB/s Max: 13.41 MiB/s [LNet Rates of c] [R] Avg: 437 RPC/s Min: 437 RPC/s Max: 437 RPC/s [W] Avg: 219 RPC/s Min: 219 RPC/s Max: 219 RPC/s [LNet Bandwidth of c] [R] Avg: 13.66 MiB/s Min: 13.66 MiB/s Max: 13.66 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 219 RPC/s Min: 219 RPC/s Max: 219 RPC/s [W] Avg: 437 RPC/s Min: 437 RPC/s Max: 437 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.64 MiB/s Min: 13.64 MiB/s Max: 13.64 MiB/s 1 batch in stopping Batch is stopped === BRW read off=1024 size=4k === Test was added successfully b_r_1024_4k is running now [LNet Rates of c] [R] Avg: 453 RPC/s Min: 453 RPC/s Max: 453 RPC/s [W] Avg: 226 RPC/s Min: 226 RPC/s Max: 226 RPC/s [LNet Bandwidth of c] [R] Avg: 0.91 MiB/s Min: 0.91 MiB/s Max: 0.91 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 250 RPC/s Min: 250 RPC/s Max: 250 RPC/s [W] Avg: 478 RPC/s Min: 478 RPC/s Max: 478 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 0.94 MiB/s Min: 0.94 MiB/s Max: 0.94 MiB/s [LNet Rates of c] [R] Avg: 641 RPC/s Min: 641 RPC/s Max: 641 RPC/s [W] Avg: 323 RPC/s Min: 323 RPC/s Max: 323 RPC/s [LNet Bandwidth of c] [R] Avg: 1.30 MiB/s Min: 1.30 MiB/s Max: 1.30 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 320 RPC/s Min: 320 RPC/s Max: 320 RPC/s [W] Avg: 641 RPC/s Min: 641 RPC/s Max: 641 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.30 MiB/s Min: 1.30 MiB/s Max: 1.30 MiB/s [LNet Rates of c] [R] Avg: 622 RPC/s Min: 622 RPC/s Max: 622 RPC/s [W] Avg: 312 RPC/s Min: 312 RPC/s Max: 312 RPC/s [LNet Bandwidth of c] [R] Avg: 1.26 MiB/s Min: 1.26 MiB/s Max: 1.26 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 314 RPC/s Min: 314 RPC/s Max: 314 RPC/s [W] Avg: 626 RPC/s Min: 626 RPC/s Max: 626 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.27 MiB/s Min: 1.27 MiB/s Max: 1.27 MiB/s [LNet Rates of c] [R] Avg: 701 RPC/s Min: 701 RPC/s Max: 701 RPC/s [W] Avg: 352 RPC/s Min: 352 RPC/s Max: 352 RPC/s [LNet Bandwidth of c] [R] Avg: 1.41 MiB/s Min: 1.41 MiB/s Max: 1.41 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 350 RPC/s Min: 350 RPC/s Max: 350 RPC/s [W] Avg: 702 RPC/s Min: 702 RPC/s Max: 702 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.42 MiB/s Min: 1.42 MiB/s Max: 1.42 MiB/s [LNet Rates of c] [R] Avg: 708 RPC/s Min: 708 RPC/s Max: 708 RPC/s [W] Avg: 355 RPC/s Min: 355 RPC/s Max: 355 RPC/s [LNet Bandwidth of c] [R] Avg: 1.43 MiB/s Min: 1.43 MiB/s Max: 1.43 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 352 RPC/s Min: 352 RPC/s Max: 352 RPC/s [W] Avg: 699 RPC/s Min: 699 RPC/s Max: 699 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.42 MiB/s Min: 1.42 MiB/s Max: 1.42 MiB/s [LNet Rates of c] [R] Avg: 821 RPC/s Min: 821 RPC/s Max: 821 RPC/s [W] Avg: 412 RPC/s Min: 412 RPC/s Max: 412 RPC/s [LNet Bandwidth of c] [R] Avg: 1.66 MiB/s Min: 1.66 MiB/s Max: 1.66 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 421 RPC/s Min: 421 RPC/s Max: 421 RPC/s [W] Avg: 827 RPC/s Min: 827 RPC/s Max: 827 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.65 MiB/s Min: 1.65 MiB/s Max: 1.65 MiB/s [LNet Rates of c] [R] Avg: 551 RPC/s Min: 551 RPC/s Max: 551 RPC/s [W] Avg: 277 RPC/s Min: 277 RPC/s Max: 277 RPC/s [LNet Bandwidth of c] [R] Avg: 1.11 MiB/s Min: 1.11 MiB/s Max: 1.11 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 273 RPC/s Min: 273 RPC/s Max: 273 RPC/s [W] Avg: 544 RPC/s Min: 544 RPC/s Max: 544 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 1.10 MiB/s Min: 1.10 MiB/s Max: 1.10 MiB/s [LNet Rates of c] [R] Avg: 635 RPC/s Min: 635 RPC/s Max: 635 RPC/s [W] Avg: 318 RPC/s Min: 318 RPC/s Max: 318 RPC/s [LNet Bandwidth of c] [R] Avg: 1.29 MiB/s Min: 1.29 MiB/s Max: 1.29 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 326 RPC/s Min: 326 RPC/s Max: 326 RPC/s [W] Avg: 647 RPC/s Min: 647 RPC/s Max: 647 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.31 MiB/s Min: 1.31 MiB/s Max: 1.31 MiB/s [LNet Rates of c] [R] Avg: 679 RPC/s Min: 679 RPC/s Max: 679 RPC/s [W] Avg: 342 RPC/s Min: 342 RPC/s Max: 342 RPC/s [LNet Bandwidth of c] [R] Avg: 1.37 MiB/s Min: 1.37 MiB/s Max: 1.37 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 337 RPC/s Min: 337 RPC/s Max: 337 RPC/s [W] Avg: 675 RPC/s Min: 675 RPC/s Max: 675 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.37 MiB/s Min: 1.37 MiB/s Max: 1.37 MiB/s [LNet Rates of c] [R] Avg: 417 RPC/s Min: 417 RPC/s Max: 417 RPC/s [W] Avg: 210 RPC/s Min: 210 RPC/s Max: 210 RPC/s [LNet Bandwidth of c] [R] Avg: 0.84 MiB/s Min: 0.84 MiB/s Max: 0.84 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 206 RPC/s Min: 206 RPC/s Max: 206 RPC/s [W] Avg: 418 RPC/s Min: 418 RPC/s Max: 418 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 0.85 MiB/s Min: 0.85 MiB/s Max: 0.85 MiB/s 1 batch in stopping Batch is stopped === BRW read off=1024 size=64k === Test was added successfully b_r_1024_64k is running now [LNet Rates of c] [R] Avg: 344 RPC/s Min: 344 RPC/s Max: 344 RPC/s [W] Avg: 174 RPC/s Min: 174 RPC/s Max: 174 RPC/s [LNet Bandwidth of c] [R] Avg: 10.65 MiB/s Min: 10.65 MiB/s Max: 10.65 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 176 RPC/s Min: 176 RPC/s Max: 176 RPC/s [W] Avg: 344 RPC/s Min: 344 RPC/s Max: 344 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.58 MiB/s Min: 10.58 MiB/s Max: 10.58 MiB/s [LNet Rates of c] [R] Avg: 276 RPC/s Min: 276 RPC/s Max: 276 RPC/s [W] Avg: 140 RPC/s Min: 140 RPC/s Max: 140 RPC/s [LNet Bandwidth of c] [R] Avg: 8.52 MiB/s Min: 8.52 MiB/s Max: 8.52 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 138 RPC/s Min: 138 RPC/s Max: 138 RPC/s [W] Avg: 275 RPC/s Min: 275 RPC/s Max: 275 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.58 MiB/s Min: 8.58 MiB/s Max: 8.58 MiB/s [LNet Rates of c] [R] Avg: 296 RPC/s Min: 296 RPC/s Max: 296 RPC/s [W] Avg: 148 RPC/s Min: 148 RPC/s Max: 148 RPC/s [LNet Bandwidth of c] [R] Avg: 9.30 MiB/s Min: 9.30 MiB/s Max: 9.30 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 145 RPC/s Min: 145 RPC/s Max: 145 RPC/s [W] Avg: 296 RPC/s Min: 296 RPC/s Max: 296 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.24 MiB/s Min: 9.24 MiB/s Max: 9.24 MiB/s [LNet Rates of c] [R] Avg: 286 RPC/s Min: 286 RPC/s Max: 286 RPC/s [W] Avg: 146 RPC/s Min: 146 RPC/s Max: 146 RPC/s [LNet Bandwidth of c] [R] Avg: 8.78 MiB/s Min: 8.78 MiB/s Max: 8.78 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 145 RPC/s Min: 145 RPC/s Max: 145 RPC/s [W] Avg: 281 RPC/s Min: 281 RPC/s Max: 281 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.78 MiB/s Min: 8.78 MiB/s Max: 8.78 MiB/s [LNet Rates of c] [R] Avg: 317 RPC/s Min: 317 RPC/s Max: 317 RPC/s [W] Avg: 159 RPC/s Min: 159 RPC/s Max: 159 RPC/s [LNet Bandwidth of c] [R] Avg: 9.93 MiB/s Min: 9.93 MiB/s Max: 9.93 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 172 RPC/s Min: 172 RPC/s Max: 172 RPC/s [W] Avg: 330 RPC/s Min: 330 RPC/s Max: 330 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 9.88 MiB/s Min: 9.88 MiB/s Max: 9.88 MiB/s [LNet Rates of c] [R] Avg: 380 RPC/s Min: 380 RPC/s Max: 380 RPC/s [W] Avg: 193 RPC/s Min: 193 RPC/s Max: 193 RPC/s [LNet Bandwidth of c] [R] Avg: 11.68 MiB/s Min: 11.68 MiB/s Max: 11.68 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 188 RPC/s Min: 188 RPC/s Max: 188 RPC/s [W] Avg: 381 RPC/s Min: 381 RPC/s Max: 381 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.85 MiB/s Min: 11.85 MiB/s Max: 11.85 MiB/s [LNet Rates of c] [R] Avg: 246 RPC/s Min: 246 RPC/s Max: 246 RPC/s [W] Avg: 121 RPC/s Min: 121 RPC/s Max: 121 RPC/s [LNet Bandwidth of c] [R] Avg: 7.66 MiB/s Min: 7.66 MiB/s Max: 7.66 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 123 RPC/s Min: 123 RPC/s Max: 123 RPC/s [W] Avg: 240 RPC/s Min: 240 RPC/s Max: 240 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 7.48 MiB/s Min: 7.48 MiB/s Max: 7.48 MiB/s [LNet Rates of c] [R] Avg: 272 RPC/s Min: 272 RPC/s Max: 272 RPC/s [W] Avg: 140 RPC/s Min: 140 RPC/s Max: 140 RPC/s [LNet Bandwidth of c] [R] Avg: 8.43 MiB/s Min: 8.43 MiB/s Max: 8.43 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 135 RPC/s Min: 135 RPC/s Max: 135 RPC/s [W] Avg: 269 RPC/s Min: 269 RPC/s Max: 269 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.39 MiB/s Min: 8.39 MiB/s Max: 8.39 MiB/s [LNet Rates of c] [R] Avg: 262 RPC/s Min: 262 RPC/s Max: 262 RPC/s [W] Avg: 132 RPC/s Min: 132 RPC/s Max: 132 RPC/s [LNet Bandwidth of c] [R] Avg: 8.08 MiB/s Min: 8.08 MiB/s Max: 8.08 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 131 RPC/s Min: 131 RPC/s Max: 131 RPC/s [W] Avg: 266 RPC/s Min: 266 RPC/s Max: 266 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.34 MiB/s Min: 8.34 MiB/s Max: 8.34 MiB/s [LNet Rates of c] [R] Avg: 347 RPC/s Min: 347 RPC/s Max: 347 RPC/s [W] Avg: 176 RPC/s Min: 176 RPC/s Max: 176 RPC/s [LNet Bandwidth of c] [R] Avg: 10.83 MiB/s Min: 10.83 MiB/s Max: 10.83 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 188 RPC/s Min: 188 RPC/s Max: 188 RPC/s [W] Avg: 355 RPC/s Min: 355 RPC/s Max: 355 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.65 MiB/s Min: 10.65 MiB/s Max: 10.65 MiB/s 1 batch in stopping Batch is stopped === BRW read off=2048 size=4k === Test was added successfully b_r_2048_4k is running now [LNet Rates of c] [R] Avg: 432 RPC/s Min: 432 RPC/s Max: 432 RPC/s [W] Avg: 218 RPC/s Min: 218 RPC/s Max: 218 RPC/s [LNet Bandwidth of c] [R] Avg: 0.87 MiB/s Min: 0.87 MiB/s Max: 0.87 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 221 RPC/s Min: 221 RPC/s Max: 221 RPC/s [W] Avg: 434 RPC/s Min: 434 RPC/s Max: 434 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 0.88 MiB/s Min: 0.88 MiB/s Max: 0.88 MiB/s [LNet Rates of c] [R] Avg: 415 RPC/s Min: 415 RPC/s Max: 415 RPC/s [W] Avg: 208 RPC/s Min: 208 RPC/s Max: 208 RPC/s [LNet Bandwidth of c] [R] Avg: 0.84 MiB/s Min: 0.84 MiB/s Max: 0.84 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 205 RPC/s Min: 205 RPC/s Max: 205 RPC/s [W] Avg: 411 RPC/s Min: 411 RPC/s Max: 411 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 0.84 MiB/s Min: 0.84 MiB/s Max: 0.84 MiB/s [LNet Rates of c] [R] Avg: 655 RPC/s Min: 655 RPC/s Max: 655 RPC/s [W] Avg: 330 RPC/s Min: 330 RPC/s Max: 330 RPC/s [LNet Bandwidth of c] [R] Avg: 1.32 MiB/s Min: 1.32 MiB/s Max: 1.32 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 341 RPC/s Min: 341 RPC/s Max: 341 RPC/s [W] Avg: 668 RPC/s Min: 668 RPC/s Max: 668 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.33 MiB/s Min: 1.33 MiB/s Max: 1.33 MiB/s [LNet Rates of c] [R] Avg: 716 RPC/s Min: 716 RPC/s Max: 716 RPC/s [W] Avg: 358 RPC/s Min: 358 RPC/s Max: 358 RPC/s [LNet Bandwidth of c] [R] Avg: 1.45 MiB/s Min: 1.45 MiB/s Max: 1.45 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 361 RPC/s Min: 361 RPC/s Max: 361 RPC/s [W] Avg: 721 RPC/s Min: 721 RPC/s Max: 721 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.46 MiB/s Min: 1.46 MiB/s Max: 1.46 MiB/s [LNet Rates of c] [R] Avg: 800 RPC/s Min: 800 RPC/s Max: 800 RPC/s [W] Avg: 399 RPC/s Min: 399 RPC/s Max: 399 RPC/s [LNet Bandwidth of c] [R] Avg: 1.62 MiB/s Min: 1.62 MiB/s Max: 1.62 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 400 RPC/s Min: 400 RPC/s Max: 400 RPC/s [W] Avg: 794 RPC/s Min: 794 RPC/s Max: 794 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.61 MiB/s Min: 1.61 MiB/s Max: 1.61 MiB/s [LNet Rates of c] [R] Avg: 425 RPC/s Min: 425 RPC/s Max: 425 RPC/s [W] Avg: 217 RPC/s Min: 217 RPC/s Max: 217 RPC/s [LNet Bandwidth of c] [R] Avg: 0.86 MiB/s Min: 0.86 MiB/s Max: 0.86 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 210 RPC/s Min: 210 RPC/s Max: 210 RPC/s [W] Avg: 423 RPC/s Min: 423 RPC/s Max: 423 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 0.86 MiB/s Min: 0.86 MiB/s Max: 0.86 MiB/s [LNet Rates of c] [R] Avg: 442 RPC/s Min: 442 RPC/s Max: 442 RPC/s [W] Avg: 221 RPC/s Min: 221 RPC/s Max: 221 RPC/s [LNet Bandwidth of c] [R] Avg: 0.89 MiB/s Min: 0.89 MiB/s Max: 0.89 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 223 RPC/s Min: 223 RPC/s Max: 223 RPC/s [W] Avg: 441 RPC/s Min: 441 RPC/s Max: 441 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 0.89 MiB/s Min: 0.89 MiB/s Max: 0.89 MiB/s [LNet Rates of c] [R] Avg: 739 RPC/s Min: 739 RPC/s Max: 739 RPC/s [W] Avg: 374 RPC/s Min: 374 RPC/s Max: 374 RPC/s [LNet Bandwidth of c] [R] Avg: 1.49 MiB/s Min: 1.49 MiB/s Max: 1.49 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 381 RPC/s Min: 381 RPC/s Max: 381 RPC/s [W] Avg: 751 RPC/s Min: 751 RPC/s Max: 751 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.50 MiB/s Min: 1.50 MiB/s Max: 1.50 MiB/s [LNet Rates of c] [R] Avg: 569 RPC/s Min: 569 RPC/s Max: 569 RPC/s [W] Avg: 283 RPC/s Min: 283 RPC/s Max: 283 RPC/s [LNet Bandwidth of c] [R] Avg: 1.15 MiB/s Min: 1.15 MiB/s Max: 1.15 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 284 RPC/s Min: 284 RPC/s Max: 284 RPC/s [W] Avg: 563 RPC/s Min: 563 RPC/s Max: 563 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 1.13 MiB/s Min: 1.13 MiB/s Max: 1.13 MiB/s [LNet Rates of c] [R] Avg: 448 RPC/s Min: 448 RPC/s Max: 448 RPC/s [W] Avg: 226 RPC/s Min: 226 RPC/s Max: 226 RPC/s [LNet Bandwidth of c] [R] Avg: 0.91 MiB/s Min: 0.91 MiB/s Max: 0.91 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 225 RPC/s Min: 225 RPC/s Max: 225 RPC/s [W] Avg: 453 RPC/s Min: 453 RPC/s Max: 453 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 0.91 MiB/s Min: 0.91 MiB/s Max: 0.91 MiB/s 1 batch in stopping Batch is stopped === BRW read off=2048 size=64k === Test was added successfully b_r_2048_64k is running now [LNet Rates of c] [R] Avg: 366 RPC/s Min: 366 RPC/s Max: 366 RPC/s [W] Avg: 186 RPC/s Min: 186 RPC/s Max: 186 RPC/s [LNet Bandwidth of c] [R] Avg: 11.32 MiB/s Min: 11.32 MiB/s Max: 11.32 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 184 RPC/s Min: 184 RPC/s Max: 184 RPC/s [W] Avg: 365 RPC/s Min: 365 RPC/s Max: 365 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.30 MiB/s Min: 11.30 MiB/s Max: 11.30 MiB/s [LNet Rates of c] [R] Avg: 382 RPC/s Min: 382 RPC/s Max: 382 RPC/s [W] Avg: 191 RPC/s Min: 191 RPC/s Max: 191 RPC/s [LNet Bandwidth of c] [R] Avg: 11.85 MiB/s Min: 11.85 MiB/s Max: 11.85 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 202 RPC/s Min: 202 RPC/s Max: 202 RPC/s [W] Avg: 398 RPC/s Min: 398 RPC/s Max: 398 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 12.07 MiB/s Min: 12.07 MiB/s Max: 12.07 MiB/s [LNet Rates of c] [R] Avg: 395 RPC/s Min: 395 RPC/s Max: 395 RPC/s [W] Avg: 200 RPC/s Min: 200 RPC/s Max: 200 RPC/s [LNet Bandwidth of c] [R] Avg: 12.33 MiB/s Min: 12.33 MiB/s Max: 12.33 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 199 RPC/s Min: 199 RPC/s Max: 199 RPC/s [W] Avg: 389 RPC/s Min: 389 RPC/s Max: 389 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 12.13 MiB/s Min: 12.13 MiB/s Max: 12.13 MiB/s [LNet Rates of c] [R] Avg: 368 RPC/s Min: 368 RPC/s Max: 368 RPC/s [W] Avg: 186 RPC/s Min: 186 RPC/s Max: 186 RPC/s [LNet Bandwidth of c] [R] Avg: 11.41 MiB/s Min: 11.41 MiB/s Max: 11.41 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 186 RPC/s Min: 186 RPC/s Max: 186 RPC/s [W] Avg: 369 RPC/s Min: 369 RPC/s Max: 369 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.50 MiB/s Min: 11.50 MiB/s Max: 11.50 MiB/s [LNet Rates of c] [R] Avg: 364 RPC/s Min: 364 RPC/s Max: 364 RPC/s [W] Avg: 183 RPC/s Min: 183 RPC/s Max: 183 RPC/s [LNet Bandwidth of c] [R] Avg: 11.35 MiB/s Min: 11.35 MiB/s Max: 11.35 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 179 RPC/s Min: 179 RPC/s Max: 179 RPC/s [W] Avg: 358 RPC/s Min: 358 RPC/s Max: 358 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.18 MiB/s Min: 11.18 MiB/s Max: 11.18 MiB/s [LNet Rates of c] [R] Avg: 238 RPC/s Min: 238 RPC/s Max: 238 RPC/s [W] Avg: 122 RPC/s Min: 122 RPC/s Max: 122 RPC/s [LNet Bandwidth of c] [R] Avg: 7.31 MiB/s Min: 7.31 MiB/s Max: 7.31 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 120 RPC/s Min: 120 RPC/s Max: 120 RPC/s [W] Avg: 239 RPC/s Min: 239 RPC/s Max: 239 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 7.45 MiB/s Min: 7.45 MiB/s Max: 7.45 MiB/s [LNet Rates of c] [R] Avg: 382 RPC/s Min: 382 RPC/s Max: 382 RPC/s [W] Avg: 192 RPC/s Min: 192 RPC/s Max: 192 RPC/s [LNet Bandwidth of c] [R] Avg: 11.84 MiB/s Min: 11.84 MiB/s Max: 11.84 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 203 RPC/s Min: 203 RPC/s Max: 203 RPC/s [W] Avg: 393 RPC/s Min: 393 RPC/s Max: 393 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.88 MiB/s Min: 11.88 MiB/s Max: 11.88 MiB/s [LNet Rates of c] [R] Avg: 343 RPC/s Min: 343 RPC/s Max: 343 RPC/s [W] Avg: 173 RPC/s Min: 173 RPC/s Max: 173 RPC/s [LNet Bandwidth of c] [R] Avg: 10.68 MiB/s Min: 10.68 MiB/s Max: 10.68 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 174 RPC/s Min: 174 RPC/s Max: 174 RPC/s [W] Avg: 346 RPC/s Min: 346 RPC/s Max: 346 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.74 MiB/s Min: 10.74 MiB/s Max: 10.74 MiB/s [LNet Rates of c] [R] Avg: 466 RPC/s Min: 466 RPC/s Max: 466 RPC/s [W] Avg: 234 RPC/s Min: 234 RPC/s Max: 234 RPC/s [LNet Bandwidth of c] [R] Avg: 14.54 MiB/s Min: 14.54 MiB/s Max: 14.54 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 233 RPC/s Min: 233 RPC/s Max: 233 RPC/s [W] Avg: 468 RPC/s Min: 468 RPC/s Max: 468 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 14.59 MiB/s Min: 14.59 MiB/s Max: 14.59 MiB/s [LNet Rates of c] [R] Avg: 368 RPC/s Min: 368 RPC/s Max: 368 RPC/s [W] Avg: 186 RPC/s Min: 186 RPC/s Max: 186 RPC/s [LNet Bandwidth of c] [R] Avg: 11.41 MiB/s Min: 11.41 MiB/s Max: 11.41 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 184 RPC/s Min: 184 RPC/s Max: 184 RPC/s [W] Avg: 361 RPC/s Min: 361 RPC/s Max: 361 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.23 MiB/s Min: 11.23 MiB/s Max: 11.23 MiB/s 1 batch in stopping Batch is stopped c: Total 0 error nodes in c s: Total 0 error nodes in s Total 0 error nodes in c Total 0 error nodes in s === BRW write off=2048 size=1M (off+len > LNET_MTU) === operation add test failed on 0-200@<204:43200>: Invalid argument === BRW read off=4096 size=4k (rejected) === operation add test failed on 0-200@<204:43200>: Invalid argument oleg437-client: oleg437-client.virtnet: executing lst_cleanup oleg437-server: oleg437-server.virtnet: executing lst_cleanup