== lnet-selftest test brw_offset: lst BRW offset handling (LU-20104) ========================================================== 11:30:41 (1788535841) oleg222-server: oleg222-server.virtnet: executing lst_cleanup oleg222-client: oleg222-client.virtnet: executing lst_cleanup oleg222-server: oleg222-server.virtnet: executing lst_setup oleg222-client: oleg222-client.virtnet: executing lst_setup === BRW read off=0 size=4k === Test was added successfully b_r_0_4k is running now [LNet Rates of c] [R] Avg: 784 RPC/s Min: 784 RPC/s Max: 784 RPC/s [W] Avg: 395 RPC/s Min: 395 RPC/s Max: 395 RPC/s [LNet Bandwidth of c] [R] Avg: 1.58 MiB/s Min: 1.58 MiB/s Max: 1.58 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 393 RPC/s Min: 393 RPC/s Max: 393 RPC/s [W] Avg: 786 RPC/s Min: 786 RPC/s Max: 786 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.59 MiB/s Min: 1.59 MiB/s Max: 1.59 MiB/s [LNet Rates of c] [R] Avg: 973 RPC/s Min: 973 RPC/s Max: 973 RPC/s [W] Avg: 487 RPC/s Min: 487 RPC/s Max: 487 RPC/s [LNet Bandwidth of c] [R] Avg: 1.97 MiB/s Min: 1.97 MiB/s Max: 1.97 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 494 RPC/s Min: 494 RPC/s Max: 494 RPC/s [W] Avg: 964 RPC/s Min: 964 RPC/s Max: 964 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 1.91 MiB/s Min: 1.91 MiB/s Max: 1.91 MiB/s [LNet Rates of c] [R] Avg: 664 RPC/s Min: 664 RPC/s Max: 664 RPC/s [W] Avg: 333 RPC/s Min: 333 RPC/s Max: 333 RPC/s [LNet Bandwidth of c] [R] Avg: 1.34 MiB/s Min: 1.34 MiB/s Max: 1.34 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 338 RPC/s Min: 338 RPC/s Max: 338 RPC/s [W] Avg: 681 RPC/s Min: 681 RPC/s Max: 681 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.38 MiB/s Min: 1.38 MiB/s Max: 1.38 MiB/s [LNet Rates of c] [R] Avg: 702 RPC/s Min: 702 RPC/s Max: 702 RPC/s [W] Avg: 352 RPC/s Min: 352 RPC/s Max: 352 RPC/s [LNet Bandwidth of c] [R] Avg: 1.42 MiB/s Min: 1.42 MiB/s Max: 1.42 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 362 RPC/s Min: 362 RPC/s Max: 362 RPC/s [W] Avg: 711 RPC/s Min: 711 RPC/s Max: 711 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.43 MiB/s Min: 1.43 MiB/s Max: 1.43 MiB/s [LNet Rates of c] [R] Avg: 815 RPC/s Min: 815 RPC/s Max: 815 RPC/s [W] Avg: 406 RPC/s Min: 406 RPC/s Max: 406 RPC/s [LNet Bandwidth of c] [R] Avg: 1.65 MiB/s Min: 1.65 MiB/s Max: 1.65 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 402 RPC/s Min: 402 RPC/s Max: 402 RPC/s [W] Avg: 799 RPC/s Min: 799 RPC/s Max: 799 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.62 MiB/s Min: 1.62 MiB/s Max: 1.62 MiB/s [LNet Rates of c] [R] Avg: 881 RPC/s Min: 881 RPC/s Max: 881 RPC/s [W] Avg: 445 RPC/s Min: 445 RPC/s Max: 445 RPC/s [LNet Bandwidth of c] [R] Avg: 1.78 MiB/s Min: 1.78 MiB/s Max: 1.78 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 445 RPC/s Min: 445 RPC/s Max: 445 RPC/s [W] Avg: 891 RPC/s Min: 891 RPC/s Max: 891 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.81 MiB/s Min: 1.81 MiB/s Max: 1.81 MiB/s [LNet Rates of c] [R] Avg: 628 RPC/s Min: 628 RPC/s Max: 628 RPC/s [W] Avg: 316 RPC/s Min: 316 RPC/s Max: 316 RPC/s [LNet Bandwidth of c] [R] Avg: 1.27 MiB/s Min: 1.27 MiB/s Max: 1.27 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 337 RPC/s Min: 337 RPC/s Max: 337 RPC/s [W] Avg: 648 RPC/s Min: 648 RPC/s Max: 648 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.26 MiB/s Min: 1.26 MiB/s Max: 1.26 MiB/s [LNet Rates of c] [R] Avg: 713 RPC/s Min: 713 RPC/s Max: 713 RPC/s [W] Avg: 358 RPC/s Min: 358 RPC/s Max: 358 RPC/s [LNet Bandwidth of c] [R] Avg: 1.44 MiB/s Min: 1.44 MiB/s Max: 1.44 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 356 RPC/s Min: 356 RPC/s Max: 356 RPC/s [W] Avg: 707 RPC/s Min: 707 RPC/s Max: 707 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.43 MiB/s Min: 1.43 MiB/s Max: 1.43 MiB/s [LNet Rates of c] [R] Avg: 387 RPC/s Min: 387 RPC/s Max: 387 RPC/s [W] Avg: 193 RPC/s Min: 193 RPC/s Max: 193 RPC/s [LNet Bandwidth of c] [R] Avg: 0.77 MiB/s Min: 0.77 MiB/s Max: 0.77 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 202 RPC/s Min: 202 RPC/s Max: 202 RPC/s [W] Avg: 392 RPC/s Min: 392 RPC/s Max: 392 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 0.78 MiB/s Min: 0.78 MiB/s Max: 0.78 MiB/s [LNet Rates of c] [R] Avg: 432 RPC/s Min: 432 RPC/s Max: 432 RPC/s [W] Avg: 219 RPC/s Min: 219 RPC/s Max: 219 RPC/s [LNet Bandwidth of c] [R] Avg: 0.88 MiB/s Min: 0.88 MiB/s Max: 0.88 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 219 RPC/s Min: 219 RPC/s Max: 219 RPC/s [W] Avg: 442 RPC/s Min: 442 RPC/s Max: 442 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 0.90 MiB/s Min: 0.90 MiB/s Max: 0.90 MiB/s 1 batch in stopping Batch is stopped === BRW read off=0 size=64k === Test was added successfully b_r_0_64k is running now [LNet Rates of c] [R] Avg: 585 RPC/s Min: 585 RPC/s Max: 585 RPC/s [W] Avg: 295 RPC/s Min: 295 RPC/s Max: 295 RPC/s [LNet Bandwidth of c] [R] Avg: 18.18 MiB/s Min: 18.18 MiB/s Max: 18.18 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 287 RPC/s Min: 287 RPC/s Max: 287 RPC/s [W] Avg: 574 RPC/s Min: 574 RPC/s Max: 574 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 17.94 MiB/s Min: 17.94 MiB/s Max: 17.94 MiB/s [LNet Rates of c] [R] Avg: 325 RPC/s Min: 325 RPC/s Max: 325 RPC/s [W] Avg: 165 RPC/s Min: 165 RPC/s Max: 165 RPC/s [LNet Bandwidth of c] [R] Avg: 10.07 MiB/s Min: 10.07 MiB/s Max: 10.07 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 172 RPC/s Min: 172 RPC/s Max: 172 RPC/s [W] Avg: 341 RPC/s Min: 341 RPC/s Max: 341 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.41 MiB/s Min: 10.41 MiB/s Max: 10.41 MiB/s [LNet Rates of c] [R] Avg: 262 RPC/s Min: 262 RPC/s Max: 262 RPC/s [W] Avg: 132 RPC/s Min: 132 RPC/s Max: 132 RPC/s [LNet Bandwidth of c] [R] Avg: 8.11 MiB/s Min: 8.11 MiB/s Max: 8.11 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 131 RPC/s Min: 131 RPC/s Max: 131 RPC/s [W] Avg: 255 RPC/s Min: 255 RPC/s Max: 255 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.01 MiB/s Min: 8.01 MiB/s Max: 8.01 MiB/s [LNet Rates of c] [R] Avg: 317 RPC/s Min: 317 RPC/s Max: 317 RPC/s [W] Avg: 158 RPC/s Min: 158 RPC/s Max: 158 RPC/s [LNet Bandwidth of c] [R] Avg: 9.93 MiB/s Min: 9.93 MiB/s Max: 9.93 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 156 RPC/s Min: 156 RPC/s Max: 156 RPC/s [W] Avg: 319 RPC/s Min: 319 RPC/s Max: 319 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.91 MiB/s Min: 9.91 MiB/s Max: 9.91 MiB/s [LNet Rates of c] [R] Avg: 300 RPC/s Min: 300 RPC/s Max: 300 RPC/s [W] Avg: 152 RPC/s Min: 152 RPC/s Max: 152 RPC/s [LNet Bandwidth of c] [R] Avg: 9.24 MiB/s Min: 9.24 MiB/s Max: 9.24 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 175 RPC/s Min: 175 RPC/s Max: 175 RPC/s [W] Avg: 317 RPC/s Min: 317 RPC/s Max: 317 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 9.16 MiB/s Min: 9.16 MiB/s Max: 9.16 MiB/s [LNet Rates of c] [R] Avg: 258 RPC/s Min: 258 RPC/s Max: 258 RPC/s [W] Avg: 130 RPC/s Min: 130 RPC/s Max: 130 RPC/s [LNet Bandwidth of c] [R] Avg: 8.02 MiB/s Min: 8.02 MiB/s Max: 8.02 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 128 RPC/s Min: 128 RPC/s Max: 128 RPC/s [W] Avg: 259 RPC/s Min: 259 RPC/s Max: 259 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.14 MiB/s Min: 8.14 MiB/s Max: 8.14 MiB/s [LNet Rates of c] [R] Avg: 205 RPC/s Min: 205 RPC/s Max: 205 RPC/s [W] Avg: 105 RPC/s Min: 105 RPC/s Max: 105 RPC/s [LNet Bandwidth of c] [R] Avg: 6.25 MiB/s Min: 6.25 MiB/s Max: 6.25 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 109 RPC/s Min: 109 RPC/s Max: 109 RPC/s [W] Avg: 205 RPC/s Min: 205 RPC/s Max: 205 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 6.09 MiB/s Min: 6.09 MiB/s Max: 6.09 MiB/s [LNet Rates of c] [R] Avg: 232 RPC/s Min: 232 RPC/s Max: 232 RPC/s [W] Avg: 115 RPC/s Min: 115 RPC/s Max: 115 RPC/s [LNet Bandwidth of c] [R] Avg: 7.29 MiB/s Min: 7.29 MiB/s Max: 7.29 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 116 RPC/s Min: 116 RPC/s Max: 116 RPC/s [W] Avg: 236 RPC/s Min: 236 RPC/s Max: 236 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 7.38 MiB/s Min: 7.38 MiB/s Max: 7.38 MiB/s [LNet Rates of c] [R] Avg: 317 RPC/s Min: 317 RPC/s Max: 317 RPC/s [W] Avg: 162 RPC/s Min: 162 RPC/s Max: 162 RPC/s [LNet Bandwidth of c] [R] Avg: 9.71 MiB/s Min: 9.71 MiB/s Max: 9.71 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 160 RPC/s Min: 160 RPC/s Max: 160 RPC/s [W] Avg: 313 RPC/s Min: 313 RPC/s Max: 313 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.71 MiB/s Min: 9.71 MiB/s Max: 9.71 MiB/s [LNet Rates of c] [R] Avg: 392 RPC/s Min: 392 RPC/s Max: 392 RPC/s [W] Avg: 195 RPC/s Min: 195 RPC/s Max: 195 RPC/s [LNet Bandwidth of c] [R] Avg: 12.25 MiB/s Min: 12.25 MiB/s Max: 12.25 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 218 RPC/s Min: 218 RPC/s Max: 218 RPC/s [W] Avg: 417 RPC/s Min: 417 RPC/s Max: 417 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 12.29 MiB/s Min: 12.29 MiB/s Max: 12.29 MiB/s 1 batch in stopping Batch is stopped === BRW read off=512 size=4k === Test was added successfully b_r_512_4k is running now [LNet Rates of c] [R] Avg: 743 RPC/s Min: 743 RPC/s Max: 743 RPC/s [W] Avg: 373 RPC/s Min: 373 RPC/s Max: 373 RPC/s [LNet Bandwidth of c] [R] Avg: 1.50 MiB/s Min: 1.50 MiB/s Max: 1.50 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 380 RPC/s Min: 380 RPC/s Max: 380 RPC/s [W] Avg: 753 RPC/s Min: 753 RPC/s Max: 753 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.52 MiB/s Min: 1.52 MiB/s Max: 1.52 MiB/s [LNet Rates of c] [R] Avg: 899 RPC/s Min: 899 RPC/s Max: 899 RPC/s [W] Avg: 451 RPC/s Min: 451 RPC/s Max: 451 RPC/s [LNet Bandwidth of c] [R] Avg: 1.82 MiB/s Min: 1.82 MiB/s Max: 1.82 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 448 RPC/s Min: 448 RPC/s Max: 448 RPC/s [W] Avg: 892 RPC/s Min: 892 RPC/s Max: 892 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.81 MiB/s Min: 1.81 MiB/s Max: 1.81 MiB/s [LNet Rates of c] [R] Avg: 774 RPC/s Min: 774 RPC/s Max: 774 RPC/s [W] Avg: 387 RPC/s Min: 387 RPC/s Max: 387 RPC/s [LNet Bandwidth of c] [R] Avg: 1.57 MiB/s Min: 1.57 MiB/s Max: 1.57 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 384 RPC/s Min: 384 RPC/s Max: 384 RPC/s [W] Avg: 772 RPC/s Min: 772 RPC/s Max: 772 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.56 MiB/s Min: 1.56 MiB/s Max: 1.56 MiB/s [LNet Rates of c] [R] Avg: 635 RPC/s Min: 635 RPC/s Max: 635 RPC/s [W] Avg: 319 RPC/s Min: 319 RPC/s Max: 319 RPC/s [LNet Bandwidth of c] [R] Avg: 1.28 MiB/s Min: 1.28 MiB/s Max: 1.28 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 343 RPC/s Min: 343 RPC/s Max: 343 RPC/s [W] Avg: 660 RPC/s Min: 660 RPC/s Max: 660 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.30 MiB/s Min: 1.30 MiB/s Max: 1.30 MiB/s [LNet Rates of c] [R] Avg: 806 RPC/s Min: 806 RPC/s Max: 806 RPC/s [W] Avg: 406 RPC/s Min: 406 RPC/s Max: 406 RPC/s [LNet Bandwidth of c] [R] Avg: 1.63 MiB/s Min: 1.63 MiB/s Max: 1.63 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 406 RPC/s Min: 406 RPC/s Max: 406 RPC/s [W] Avg: 809 RPC/s Min: 809 RPC/s Max: 809 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.64 MiB/s Min: 1.64 MiB/s Max: 1.64 MiB/s [LNet Rates of c] [R] Avg: 458 RPC/s Min: 458 RPC/s Max: 458 RPC/s [W] Avg: 231 RPC/s Min: 231 RPC/s Max: 231 RPC/s [LNet Bandwidth of c] [R] Avg: 0.92 MiB/s Min: 0.92 MiB/s Max: 0.92 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 239 RPC/s Min: 239 RPC/s Max: 239 RPC/s [W] Avg: 465 RPC/s Min: 465 RPC/s Max: 465 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 0.92 MiB/s Min: 0.92 MiB/s Max: 0.92 MiB/s [LNet Rates of c] [R] Avg: 611 RPC/s Min: 611 RPC/s Max: 611 RPC/s [W] Avg: 306 RPC/s Min: 306 RPC/s Max: 306 RPC/s [LNet Bandwidth of c] [R] Avg: 1.24 MiB/s Min: 1.24 MiB/s Max: 1.24 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 302 RPC/s Min: 302 RPC/s Max: 302 RPC/s [W] Avg: 603 RPC/s Min: 603 RPC/s Max: 603 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.22 MiB/s Min: 1.22 MiB/s Max: 1.22 MiB/s [LNet Rates of c] [R] Avg: 644 RPC/s Min: 644 RPC/s Max: 644 RPC/s [W] Avg: 324 RPC/s Min: 324 RPC/s Max: 324 RPC/s [LNet Bandwidth of c] [R] Avg: 1.30 MiB/s Min: 1.30 MiB/s Max: 1.30 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 323 RPC/s Min: 323 RPC/s Max: 323 RPC/s [W] Avg: 648 RPC/s Min: 648 RPC/s Max: 648 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.31 MiB/s Min: 1.31 MiB/s Max: 1.31 MiB/s [LNet Rates of c] [R] Avg: 770 RPC/s Min: 770 RPC/s Max: 770 RPC/s [W] Avg: 386 RPC/s Min: 386 RPC/s Max: 386 RPC/s [LNet Bandwidth of c] [R] Avg: 1.56 MiB/s Min: 1.56 MiB/s Max: 1.56 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 410 RPC/s Min: 410 RPC/s Max: 410 RPC/s [W] Avg: 791 RPC/s Min: 791 RPC/s Max: 791 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.56 MiB/s Min: 1.56 MiB/s Max: 1.56 MiB/s [LNet Rates of c] [R] Avg: 597 RPC/s Min: 597 RPC/s Max: 597 RPC/s [W] Avg: 300 RPC/s Min: 300 RPC/s Max: 300 RPC/s [LNet Bandwidth of c] [R] Avg: 1.21 MiB/s Min: 1.21 MiB/s Max: 1.21 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 295 RPC/s Min: 295 RPC/s Max: 295 RPC/s [W] Avg: 589 RPC/s Min: 589 RPC/s Max: 589 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.20 MiB/s Min: 1.20 MiB/s Max: 1.20 MiB/s 1 batch in stopping Batch is stopped === BRW read off=512 size=64k === Test was added successfully b_r_512_64k is running now [LNet Rates of c] [R] Avg: 488 RPC/s Min: 488 RPC/s Max: 488 RPC/s [W] Avg: 244 RPC/s Min: 244 RPC/s Max: 244 RPC/s [LNet Bandwidth of c] [R] Avg: 15.25 MiB/s Min: 15.25 MiB/s Max: 15.25 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 244 RPC/s Min: 244 RPC/s Max: 244 RPC/s [W] Avg: 491 RPC/s Min: 491 RPC/s Max: 491 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.33 MiB/s Min: 15.33 MiB/s Max: 15.33 MiB/s [LNet Rates of c] [R] Avg: 474 RPC/s Min: 474 RPC/s Max: 474 RPC/s [W] Avg: 238 RPC/s Min: 238 RPC/s Max: 238 RPC/s [LNet Bandwidth of c] [R] Avg: 14.76 MiB/s Min: 14.76 MiB/s Max: 14.76 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 239 RPC/s Min: 239 RPC/s Max: 239 RPC/s [W] Avg: 473 RPC/s Min: 473 RPC/s Max: 473 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 14.91 MiB/s Min: 14.91 MiB/s Max: 14.91 MiB/s [LNet Rates of c] [R] Avg: 287 RPC/s Min: 287 RPC/s Max: 287 RPC/s [W] Avg: 146 RPC/s Min: 146 RPC/s Max: 146 RPC/s [LNet Bandwidth of c] [R] Avg: 8.80 MiB/s Min: 8.80 MiB/s Max: 8.80 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 168 RPC/s Min: 168 RPC/s Max: 168 RPC/s [W] Avg: 310 RPC/s Min: 310 RPC/s Max: 310 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 8.78 MiB/s Min: 8.78 MiB/s Max: 8.78 MiB/s [LNet Rates of c] [R] Avg: 292 RPC/s Min: 292 RPC/s Max: 292 RPC/s [W] Avg: 146 RPC/s Min: 146 RPC/s Max: 146 RPC/s [LNet Bandwidth of c] [R] Avg: 9.14 MiB/s Min: 9.14 MiB/s Max: 9.14 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 146 RPC/s Min: 146 RPC/s Max: 146 RPC/s [W] Avg: 293 RPC/s Min: 293 RPC/s Max: 293 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.15 MiB/s Min: 9.15 MiB/s Max: 9.15 MiB/s [LNet Rates of c] [R] Avg: 235 RPC/s Min: 235 RPC/s Max: 235 RPC/s [W] Avg: 120 RPC/s Min: 120 RPC/s Max: 120 RPC/s [LNet Bandwidth of c] [R] Avg: 7.26 MiB/s Min: 7.26 MiB/s Max: 7.26 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 124 RPC/s Min: 124 RPC/s Max: 124 RPC/s [W] Avg: 241 RPC/s Min: 241 RPC/s Max: 241 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 7.32 MiB/s Min: 7.32 MiB/s Max: 7.32 MiB/s [LNet Rates of c] [R] Avg: 250 RPC/s Min: 250 RPC/s Max: 250 RPC/s [W] Avg: 126 RPC/s Min: 126 RPC/s Max: 126 RPC/s [LNet Bandwidth of c] [R] Avg: 7.67 MiB/s Min: 7.67 MiB/s Max: 7.67 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 122 RPC/s Min: 122 RPC/s Max: 122 RPC/s [W] Avg: 237 RPC/s Min: 237 RPC/s Max: 237 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 7.41 MiB/s Min: 7.41 MiB/s Max: 7.41 MiB/s [LNet Rates of c] [R] Avg: 283 RPC/s Min: 283 RPC/s Max: 283 RPC/s [W] Avg: 143 RPC/s Min: 143 RPC/s Max: 143 RPC/s [LNet Bandwidth of c] [R] Avg: 8.79 MiB/s Min: 8.79 MiB/s Max: 8.79 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 145 RPC/s Min: 145 RPC/s Max: 145 RPC/s [W] Avg: 295 RPC/s Min: 295 RPC/s Max: 295 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.18 MiB/s Min: 9.18 MiB/s Max: 9.18 MiB/s [LNet Rates of c] [R] Avg: 389 RPC/s Min: 389 RPC/s Max: 389 RPC/s [W] Avg: 222 RPC/s Min: 222 RPC/s Max: 222 RPC/s [LNet Bandwidth of c] [R] Avg: 12.18 MiB/s Min: 12.18 MiB/s Max: 12.18 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 139 RPC/s Min: 139 RPC/s Max: 139 RPC/s [W] Avg: 167 RPC/s Min: 167 RPC/s Max: 167 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 5.22 MiB/s Min: 5.22 MiB/s Max: 5.22 MiB/s [LNet Rates of c] [R] Avg: 253 RPC/s Min: 253 RPC/s Max: 253 RPC/s [W] Avg: 129 RPC/s Min: 129 RPC/s Max: 129 RPC/s [LNet Bandwidth of c] [R] Avg: 7.78 MiB/s Min: 7.78 MiB/s Max: 7.78 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 153 RPC/s Min: 153 RPC/s Max: 153 RPC/s [W] Avg: 282 RPC/s Min: 282 RPC/s Max: 282 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 7.97 MiB/s Min: 7.97 MiB/s Max: 7.97 MiB/s [LNet Rates of c] [R] Avg: 234 RPC/s Min: 234 RPC/s Max: 234 RPC/s [W] Avg: 119 RPC/s Min: 119 RPC/s Max: 119 RPC/s [LNet Bandwidth of c] [R] Avg: 7.23 MiB/s Min: 7.23 MiB/s Max: 7.23 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 118 RPC/s Min: 118 RPC/s Max: 118 RPC/s [W] Avg: 234 RPC/s Min: 234 RPC/s Max: 234 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 7.30 MiB/s Min: 7.30 MiB/s Max: 7.30 MiB/s 1 batch in stopping Batch is stopped === BRW read off=1024 size=4k === Test was added successfully b_r_1024_4k is running now [LNet Rates of c] [R] Avg: 830 RPC/s Min: 830 RPC/s Max: 830 RPC/s [W] Avg: 416 RPC/s Min: 416 RPC/s Max: 416 RPC/s [LNet Bandwidth of c] [R] Avg: 1.68 MiB/s Min: 1.68 MiB/s Max: 1.68 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 417 RPC/s Min: 417 RPC/s Max: 417 RPC/s [W] Avg: 825 RPC/s Min: 825 RPC/s Max: 825 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.67 MiB/s Min: 1.67 MiB/s Max: 1.67 MiB/s [LNet Rates of c] [R] Avg: 728 RPC/s Min: 728 RPC/s Max: 728 RPC/s [W] Avg: 366 RPC/s Min: 366 RPC/s Max: 366 RPC/s [LNet Bandwidth of c] [R] Avg: 1.47 MiB/s Min: 1.47 MiB/s Max: 1.47 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 394 RPC/s Min: 394 RPC/s Max: 394 RPC/s [W] Avg: 759 RPC/s Min: 759 RPC/s Max: 759 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.49 MiB/s Min: 1.49 MiB/s Max: 1.49 MiB/s [LNet Rates of c] [R] Avg: 1035 RPC/s Min: 1035 RPC/s Max: 1035 RPC/s [W] Avg: 519 RPC/s Min: 519 RPC/s Max: 519 RPC/s [LNet Bandwidth of c] [R] Avg: 2.09 MiB/s Min: 2.09 MiB/s Max: 2.09 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 514 RPC/s Min: 514 RPC/s Max: 514 RPC/s [W] Avg: 1028 RPC/s Min: 1028 RPC/s Max: 1028 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.09 MiB/s Min: 2.09 MiB/s Max: 2.09 MiB/s [LNet Rates of c] [R] Avg: 999 RPC/s Min: 999 RPC/s Max: 999 RPC/s [W] Avg: 500 RPC/s Min: 500 RPC/s Max: 500 RPC/s [LNet Bandwidth of c] [R] Avg: 2.02 MiB/s Min: 2.02 MiB/s Max: 2.02 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 509 RPC/s Min: 509 RPC/s Max: 509 RPC/s [W] Avg: 1009 RPC/s Min: 1009 RPC/s Max: 1009 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.03 MiB/s Min: 2.03 MiB/s Max: 2.03 MiB/s [LNet Rates of c] [R] Avg: 1002 RPC/s Min: 1002 RPC/s Max: 1002 RPC/s [W] Avg: 503 RPC/s Min: 503 RPC/s Max: 503 RPC/s [LNet Bandwidth of c] [R] Avg: 2.03 MiB/s Min: 2.03 MiB/s Max: 2.03 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 499 RPC/s Min: 499 RPC/s Max: 499 RPC/s [W] Avg: 996 RPC/s Min: 996 RPC/s Max: 996 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.02 MiB/s Min: 2.02 MiB/s Max: 2.02 MiB/s [LNet Rates of c] [R] Avg: 844 RPC/s Min: 844 RPC/s Max: 844 RPC/s [W] Avg: 420 RPC/s Min: 420 RPC/s Max: 420 RPC/s [LNet Bandwidth of c] [R] Avg: 1.71 MiB/s Min: 1.71 MiB/s Max: 1.71 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 422 RPC/s Min: 422 RPC/s Max: 422 RPC/s [W] Avg: 846 RPC/s Min: 846 RPC/s Max: 846 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.71 MiB/s Min: 1.71 MiB/s Max: 1.71 MiB/s [LNet Rates of c] [R] Avg: 899 RPC/s Min: 899 RPC/s Max: 899 RPC/s [W] Avg: 452 RPC/s Min: 452 RPC/s Max: 452 RPC/s [LNet Bandwidth of c] [R] Avg: 1.82 MiB/s Min: 1.82 MiB/s Max: 1.82 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 473 RPC/s Min: 473 RPC/s Max: 473 RPC/s [W] Avg: 916 RPC/s Min: 916 RPC/s Max: 916 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.81 MiB/s Min: 1.81 MiB/s Max: 1.81 MiB/s [LNet Rates of c] [R] Avg: 885 RPC/s Min: 885 RPC/s Max: 885 RPC/s [W] Avg: 445 RPC/s Min: 445 RPC/s Max: 445 RPC/s [LNet Bandwidth of c] [R] Avg: 1.79 MiB/s Min: 1.79 MiB/s Max: 1.79 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 443 RPC/s Min: 443 RPC/s Max: 443 RPC/s [W] Avg: 886 RPC/s Min: 886 RPC/s Max: 886 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.80 MiB/s Min: 1.80 MiB/s Max: 1.80 MiB/s [LNet Rates of c] [R] Avg: 880 RPC/s Min: 880 RPC/s Max: 880 RPC/s [W] Avg: 440 RPC/s Min: 440 RPC/s Max: 440 RPC/s [LNet Bandwidth of c] [R] Avg: 1.79 MiB/s Min: 1.79 MiB/s Max: 1.79 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 446 RPC/s Min: 446 RPC/s Max: 446 RPC/s [W] Avg: 888 RPC/s Min: 888 RPC/s Max: 888 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.78 MiB/s Min: 1.78 MiB/s Max: 1.78 MiB/s [LNet Rates of c] [R] Avg: 1092 RPC/s Min: 1092 RPC/s Max: 1092 RPC/s [W] Avg: 547 RPC/s Min: 547 RPC/s Max: 547 RPC/s [LNet Bandwidth of c] [R] Avg: 2.20 MiB/s Min: 2.20 MiB/s Max: 2.20 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 550 RPC/s Min: 550 RPC/s Max: 550 RPC/s [W] Avg: 1091 RPC/s Min: 1091 RPC/s Max: 1091 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.21 MiB/s Min: 2.21 MiB/s Max: 2.21 MiB/s 1 batch in stopping Batch is stopped === BRW read off=1024 size=64k === Test was added successfully b_r_1024_64k is running now [LNet Rates of c] [R] Avg: 390 RPC/s Min: 390 RPC/s Max: 390 RPC/s [W] Avg: 196 RPC/s Min: 196 RPC/s Max: 196 RPC/s [LNet Bandwidth of c] [R] Avg: 12.20 MiB/s Min: 12.20 MiB/s Max: 12.20 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 223 RPC/s Min: 223 RPC/s Max: 223 RPC/s [W] Avg: 413 RPC/s Min: 413 RPC/s Max: 413 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 12.09 MiB/s Min: 12.09 MiB/s Max: 12.09 MiB/s [LNet Rates of c] [R] Avg: 284 RPC/s Min: 284 RPC/s Max: 284 RPC/s [W] Avg: 143 RPC/s Min: 143 RPC/s Max: 143 RPC/s [LNet Bandwidth of c] [R] Avg: 8.84 MiB/s Min: 8.84 MiB/s Max: 8.84 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 140 RPC/s Min: 140 RPC/s Max: 140 RPC/s [W] Avg: 285 RPC/s Min: 285 RPC/s Max: 285 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.93 MiB/s Min: 8.93 MiB/s Max: 8.93 MiB/s [LNet Rates of c] [R] Avg: 600 RPC/s Min: 600 RPC/s Max: 600 RPC/s [W] Avg: 600 RPC/s Min: 600 RPC/s Max: 600 RPC/s [LNet Bandwidth of c] [R] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [W] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [LNet Rates of s] [R] Avg: 400 RPC/s Min: 400 RPC/s Max: 400 RPC/s [W] Avg: 200 RPC/s Min: 200 RPC/s Max: 200 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of c] [R] Avg: 434 RPC/s Min: 434 RPC/s Max: 434 RPC/s [W] Avg: 219 RPC/s Min: 219 RPC/s Max: 219 RPC/s [LNet Bandwidth of c] [R] Avg: 13.49 MiB/s Min: 13.49 MiB/s Max: 13.49 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 225 RPC/s Min: 225 RPC/s Max: 225 RPC/s [W] Avg: 439 RPC/s Min: 439 RPC/s Max: 439 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 13.48 MiB/s Min: 13.48 MiB/s Max: 13.48 MiB/s [LNet Rates of c] [R] Avg: 393 RPC/s Min: 393 RPC/s Max: 393 RPC/s [W] Avg: 197 RPC/s Min: 197 RPC/s Max: 197 RPC/s [LNet Bandwidth of c] [R] Avg: 12.29 MiB/s Min: 12.29 MiB/s Max: 12.29 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 196 RPC/s Min: 196 RPC/s Max: 196 RPC/s [W] Avg: 395 RPC/s Min: 395 RPC/s Max: 395 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 12.34 MiB/s Min: 12.34 MiB/s Max: 12.34 MiB/s [LNet Rates of c] [R] Avg: 410 RPC/s Min: 410 RPC/s Max: 410 RPC/s [W] Avg: 207 RPC/s Min: 207 RPC/s Max: 207 RPC/s [LNet Bandwidth of c] [R] Avg: 12.69 MiB/s Min: 12.69 MiB/s Max: 12.69 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 205 RPC/s Min: 205 RPC/s Max: 205 RPC/s [W] Avg: 404 RPC/s Min: 404 RPC/s Max: 404 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 12.64 MiB/s Min: 12.64 MiB/s Max: 12.64 MiB/s [LNet Rates of c] [R] Avg: 647 RPC/s Min: 647 RPC/s Max: 647 RPC/s [W] Avg: 325 RPC/s Min: 325 RPC/s Max: 325 RPC/s [LNet Bandwidth of c] [R] Avg: 20.21 MiB/s Min: 20.21 MiB/s Max: 20.21 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 353 RPC/s Min: 353 RPC/s Max: 353 RPC/s [W] Avg: 678 RPC/s Min: 678 RPC/s Max: 678 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 20.34 MiB/s Min: 20.34 MiB/s Max: 20.34 MiB/s [LNet Rates of c] [R] Avg: 427 RPC/s Min: 427 RPC/s Max: 427 RPC/s [W] Avg: 215 RPC/s Min: 215 RPC/s Max: 215 RPC/s [LNet Bandwidth of c] [R] Avg: 13.29 MiB/s Min: 13.29 MiB/s Max: 13.29 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 214 RPC/s Min: 214 RPC/s Max: 214 RPC/s [W] Avg: 423 RPC/s Min: 423 RPC/s Max: 423 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.19 MiB/s Min: 13.19 MiB/s Max: 13.19 MiB/s [LNet Rates of c] [R] Avg: 350 RPC/s Min: 350 RPC/s Max: 350 RPC/s [W] Avg: 175 RPC/s Min: 175 RPC/s Max: 175 RPC/s [LNet Bandwidth of c] [R] Avg: 10.93 MiB/s Min: 10.93 MiB/s Max: 10.93 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 182 RPC/s Min: 182 RPC/s Max: 182 RPC/s [W] Avg: 355 RPC/s Min: 355 RPC/s Max: 355 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.84 MiB/s Min: 10.84 MiB/s Max: 10.84 MiB/s [LNet Rates of c] [R] Avg: 503 RPC/s Min: 503 RPC/s Max: 503 RPC/s [W] Avg: 250 RPC/s Min: 250 RPC/s Max: 250 RPC/s [LNet Bandwidth of c] [R] Avg: 15.57 MiB/s Min: 15.57 MiB/s Max: 15.57 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 250 RPC/s Min: 250 RPC/s Max: 250 RPC/s [W] Avg: 501 RPC/s Min: 501 RPC/s Max: 501 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.69 MiB/s Min: 15.69 MiB/s Max: 15.69 MiB/s 1 batch in stopping Batch is stopped === BRW read off=2048 size=4k === Test was added successfully b_r_2048_4k is running now [LNet Rates of c] [R] Avg: 589 RPC/s Min: 589 RPC/s Max: 589 RPC/s [W] Avg: 296 RPC/s Min: 296 RPC/s Max: 296 RPC/s [LNet Bandwidth of c] [R] Avg: 1.19 MiB/s Min: 1.19 MiB/s Max: 1.19 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 327 RPC/s Min: 327 RPC/s Max: 327 RPC/s [W] Avg: 619 RPC/s Min: 619 RPC/s Max: 619 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.20 MiB/s Min: 1.20 MiB/s Max: 1.20 MiB/s [LNet Rates of c] [R] Avg: 660 RPC/s Min: 660 RPC/s Max: 660 RPC/s [W] Avg: 331 RPC/s Min: 331 RPC/s Max: 331 RPC/s [LNet Bandwidth of c] [R] Avg: 1.34 MiB/s Min: 1.34 MiB/s Max: 1.34 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 330 RPC/s Min: 330 RPC/s Max: 330 RPC/s [W] Avg: 656 RPC/s Min: 656 RPC/s Max: 656 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.33 MiB/s Min: 1.33 MiB/s Max: 1.33 MiB/s [LNet Rates of c] [R] Avg: 780 RPC/s Min: 780 RPC/s Max: 780 RPC/s [W] Avg: 393 RPC/s Min: 393 RPC/s Max: 393 RPC/s [LNet Bandwidth of c] [R] Avg: 1.57 MiB/s Min: 1.57 MiB/s Max: 1.57 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 399 RPC/s Min: 399 RPC/s Max: 399 RPC/s [W] Avg: 789 RPC/s Min: 789 RPC/s Max: 789 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.59 MiB/s Min: 1.59 MiB/s Max: 1.59 MiB/s [LNet Rates of c] [R] Avg: 659 RPC/s Min: 659 RPC/s Max: 659 RPC/s [W] Avg: 331 RPC/s Min: 331 RPC/s Max: 331 RPC/s [LNet Bandwidth of c] [R] Avg: 1.33 MiB/s Min: 1.33 MiB/s Max: 1.33 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 330 RPC/s Min: 330 RPC/s Max: 330 RPC/s [W] Avg: 660 RPC/s Min: 660 RPC/s Max: 660 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.34 MiB/s Min: 1.34 MiB/s Max: 1.34 MiB/s [LNet Rates of c] [R] Avg: 809 RPC/s Min: 809 RPC/s Max: 809 RPC/s [W] Avg: 405 RPC/s Min: 405 RPC/s Max: 405 RPC/s [LNet Bandwidth of c] [R] Avg: 1.64 MiB/s Min: 1.64 MiB/s Max: 1.64 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 402 RPC/s Min: 402 RPC/s Max: 402 RPC/s [W] Avg: 806 RPC/s Min: 806 RPC/s Max: 806 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.63 MiB/s Min: 1.63 MiB/s Max: 1.63 MiB/s [LNet Rates of c] [R] Avg: 706 RPC/s Min: 706 RPC/s Max: 706 RPC/s [W] Avg: 355 RPC/s Min: 355 RPC/s Max: 355 RPC/s [LNet Bandwidth of c] [R] Avg: 1.42 MiB/s Min: 1.42 MiB/s Max: 1.42 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 378 RPC/s Min: 378 RPC/s Max: 378 RPC/s [W] Avg: 730 RPC/s Min: 730 RPC/s Max: 730 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.44 MiB/s Min: 1.44 MiB/s Max: 1.44 MiB/s [LNet Rates of c] [R] Avg: 677 RPC/s Min: 677 RPC/s Max: 677 RPC/s [W] Avg: 338 RPC/s Min: 338 RPC/s Max: 338 RPC/s [LNet Bandwidth of c] [R] Avg: 1.37 MiB/s Min: 1.37 MiB/s Max: 1.37 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 328 RPC/s Min: 328 RPC/s Max: 328 RPC/s [W] Avg: 660 RPC/s Min: 660 RPC/s Max: 660 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.34 MiB/s Min: 1.34 MiB/s Max: 1.34 MiB/s [LNet Rates of c] [R] Avg: 563 RPC/s Min: 563 RPC/s Max: 563 RPC/s [W] Avg: 285 RPC/s Min: 285 RPC/s Max: 285 RPC/s [LNet Bandwidth of c] [R] Avg: 1.13 MiB/s Min: 1.13 MiB/s Max: 1.13 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 299 RPC/s Min: 299 RPC/s Max: 299 RPC/s [W] Avg: 583 RPC/s Min: 583 RPC/s Max: 583 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.17 MiB/s Min: 1.17 MiB/s Max: 1.17 MiB/s [LNet Rates of c] [R] Avg: 929 RPC/s Min: 929 RPC/s Max: 929 RPC/s [W] Avg: 466 RPC/s Min: 466 RPC/s Max: 466 RPC/s [LNet Bandwidth of c] [R] Avg: 1.88 MiB/s Min: 1.88 MiB/s Max: 1.88 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 462 RPC/s Min: 462 RPC/s Max: 462 RPC/s [W] Avg: 923 RPC/s Min: 923 RPC/s Max: 923 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.87 MiB/s Min: 1.87 MiB/s Max: 1.87 MiB/s [LNet Rates of c] [R] Avg: 998 RPC/s Min: 998 RPC/s Max: 998 RPC/s [W] Avg: 500 RPC/s Min: 500 RPC/s Max: 500 RPC/s [LNet Bandwidth of c] [R] Avg: 2.02 MiB/s Min: 2.02 MiB/s Max: 2.02 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 495 RPC/s Min: 495 RPC/s Max: 495 RPC/s [W] Avg: 989 RPC/s Min: 989 RPC/s Max: 989 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.01 MiB/s Min: 2.01 MiB/s Max: 2.01 MiB/s 1 batch in stopping Batch is stopped === BRW read off=2048 size=64k === Test was added successfully b_r_2048_64k is running now [LNet Rates of c] [R] Avg: 455 RPC/s Min: 455 RPC/s Max: 455 RPC/s [W] Avg: 230 RPC/s Min: 230 RPC/s Max: 230 RPC/s [LNet Bandwidth of c] [R] Avg: 14.08 MiB/s Min: 14.08 MiB/s Max: 14.08 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 235 RPC/s Min: 235 RPC/s Max: 235 RPC/s [W] Avg: 459 RPC/s Min: 459 RPC/s Max: 459 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 14.17 MiB/s Min: 14.17 MiB/s Max: 14.17 MiB/s [LNet Rates of c] [R] Avg: 273 RPC/s Min: 273 RPC/s Max: 273 RPC/s [W] Avg: 137 RPC/s Min: 137 RPC/s Max: 137 RPC/s [LNet Bandwidth of c] [R] Avg: 8.49 MiB/s Min: 8.49 MiB/s Max: 8.49 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 136 RPC/s Min: 136 RPC/s Max: 136 RPC/s [W] Avg: 271 RPC/s Min: 271 RPC/s Max: 271 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.46 MiB/s Min: 8.46 MiB/s Max: 8.46 MiB/s [LNet Rates of c] [R] Avg: 307 RPC/s Min: 307 RPC/s Max: 307 RPC/s [W] Avg: 154 RPC/s Min: 154 RPC/s Max: 154 RPC/s [LNet Bandwidth of c] [R] Avg: 9.63 MiB/s Min: 9.63 MiB/s Max: 9.63 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 152 RPC/s Min: 152 RPC/s Max: 152 RPC/s [W] Avg: 308 RPC/s Min: 308 RPC/s Max: 308 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.56 MiB/s Min: 9.56 MiB/s Max: 9.56 MiB/s [LNet Rates of c] [R] Avg: 340 RPC/s Min: 340 RPC/s Max: 340 RPC/s [W] Avg: 173 RPC/s Min: 173 RPC/s Max: 173 RPC/s [LNet Bandwidth of c] [R] Avg: 10.53 MiB/s Min: 10.53 MiB/s Max: 10.53 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 197 RPC/s Min: 197 RPC/s Max: 197 RPC/s [W] Avg: 364 RPC/s Min: 364 RPC/s Max: 364 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.55 MiB/s Min: 10.55 MiB/s Max: 10.55 MiB/s [LNet Rates of c] [R] Avg: 503 RPC/s Min: 503 RPC/s Max: 503 RPC/s [W] Avg: 254 RPC/s Min: 254 RPC/s Max: 254 RPC/s [LNet Bandwidth of c] [R] Avg: 15.62 MiB/s Min: 15.62 MiB/s Max: 15.62 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 253 RPC/s Min: 253 RPC/s Max: 253 RPC/s [W] Avg: 501 RPC/s Min: 501 RPC/s Max: 501 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.63 MiB/s Min: 15.63 MiB/s Max: 15.63 MiB/s [LNet Rates of c] [R] Avg: 459 RPC/s Min: 459 RPC/s Max: 459 RPC/s [W] Avg: 232 RPC/s Min: 232 RPC/s Max: 232 RPC/s [LNet Bandwidth of c] [R] Avg: 14.26 MiB/s Min: 14.26 MiB/s Max: 14.26 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 237 RPC/s Min: 237 RPC/s Max: 237 RPC/s [W] Avg: 466 RPC/s Min: 466 RPC/s Max: 466 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 14.35 MiB/s Min: 14.35 MiB/s Max: 14.35 MiB/s [LNet Rates of c] [R] Avg: 426 RPC/s Min: 426 RPC/s Max: 426 RPC/s [W] Avg: 214 RPC/s Min: 214 RPC/s Max: 214 RPC/s [LNet Bandwidth of c] [R] Avg: 13.32 MiB/s Min: 13.32 MiB/s Max: 13.32 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 213 RPC/s Min: 213 RPC/s Max: 213 RPC/s [W] Avg: 426 RPC/s Min: 426 RPC/s Max: 426 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.28 MiB/s Min: 13.28 MiB/s Max: 13.28 MiB/s [LNet Rates of c] [R] Avg: 466 RPC/s Min: 466 RPC/s Max: 466 RPC/s [W] Avg: 233 RPC/s Min: 233 RPC/s Max: 233 RPC/s [LNet Bandwidth of c] [R] Avg: 14.52 MiB/s Min: 14.52 MiB/s Max: 14.52 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 230 RPC/s Min: 230 RPC/s Max: 230 RPC/s [W] Avg: 465 RPC/s Min: 465 RPC/s Max: 465 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 14.54 MiB/s Min: 14.54 MiB/s Max: 14.54 MiB/s [LNet Rates of c] [R] Avg: 433 RPC/s Min: 433 RPC/s Max: 433 RPC/s [W] Avg: 219 RPC/s Min: 219 RPC/s Max: 219 RPC/s [LNet Bandwidth of c] [R] Avg: 13.43 MiB/s Min: 13.43 MiB/s Max: 13.43 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 242 RPC/s Min: 242 RPC/s Max: 242 RPC/s [W] Avg: 454 RPC/s Min: 454 RPC/s Max: 454 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 13.54 MiB/s Min: 13.54 MiB/s Max: 13.54 MiB/s [LNet Rates of c] [R] Avg: 317 RPC/s Min: 317 RPC/s Max: 317 RPC/s [W] Avg: 159 RPC/s Min: 159 RPC/s Max: 159 RPC/s [LNet Bandwidth of c] [R] Avg: 9.88 MiB/s Min: 9.88 MiB/s Max: 9.88 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 154 RPC/s Min: 154 RPC/s Max: 154 RPC/s [W] Avg: 308 RPC/s Min: 308 RPC/s Max: 308 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.61 MiB/s Min: 9.61 MiB/s Max: 9.61 MiB/s 1 batch in stopping Batch is stopped c: Total 0 error nodes in c s: Total 0 error nodes in s Total 0 error nodes in c Total 0 error nodes in s === BRW write off=2048 size=1M (off+len > LNET_MTU) === operation add test failed on 0-200@<202:43200>: Invalid argument === BRW read off=4096 size=4k (rejected) === operation add test failed on 0-200@<202:43200>: Invalid argument oleg222-server: oleg222-server.virtnet: executing lst_cleanup oleg222-client: oleg222-client.virtnet: executing lst_cleanup