== lnet-selftest test brw_offset: lst BRW offset handling (LU-20104) ========================================================== 11:22:38 (1788535358) oleg614-client: oleg614-client.virtnet: executing lst_cleanup oleg614-server: oleg614-server.virtnet: executing lst_cleanup oleg614-client: oleg614-client.virtnet: executing lst_setup oleg614-server: oleg614-server.virtnet: executing lst_setup === BRW read off=0 size=4k === Test was added successfully b_r_0_4k is running now [LNet Rates of c] [R] Avg: 672 RPC/s Min: 672 RPC/s Max: 672 RPC/s [W] Avg: 335 RPC/s Min: 335 RPC/s Max: 335 RPC/s [LNet Bandwidth of c] [R] Avg: 1.35 MiB/s Min: 1.35 MiB/s Max: 1.35 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 338 RPC/s Min: 338 RPC/s Max: 338 RPC/s [W] Avg: 666 RPC/s Min: 666 RPC/s Max: 666 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.35 MiB/s Min: 1.35 MiB/s Max: 1.35 MiB/s [LNet Rates of c] [R] Avg: 501 RPC/s Min: 501 RPC/s Max: 501 RPC/s [W] Avg: 253 RPC/s Min: 253 RPC/s Max: 253 RPC/s [LNet Bandwidth of c] [R] Avg: 1.01 MiB/s Min: 1.01 MiB/s Max: 1.01 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 247 RPC/s Min: 247 RPC/s Max: 247 RPC/s [W] Avg: 494 RPC/s Min: 494 RPC/s Max: 494 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 1.00 MiB/s Min: 1.00 MiB/s Max: 1.00 MiB/s [LNet Rates of c] [R] Avg: 795 RPC/s Min: 795 RPC/s Max: 795 RPC/s [W] Avg: 399 RPC/s Min: 399 RPC/s Max: 399 RPC/s [LNet Bandwidth of c] [R] Avg: 1.62 MiB/s Min: 1.62 MiB/s Max: 1.62 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 398 RPC/s Min: 398 RPC/s Max: 398 RPC/s [W] Avg: 801 RPC/s Min: 801 RPC/s Max: 801 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.62 MiB/s Min: 1.62 MiB/s Max: 1.62 MiB/s [LNet Rates of c] [R] Avg: 733 RPC/s Min: 733 RPC/s Max: 733 RPC/s [W] Avg: 366 RPC/s Min: 366 RPC/s Max: 366 RPC/s [LNet Bandwidth of c] [R] Avg: 1.48 MiB/s Min: 1.48 MiB/s Max: 1.48 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 369 RPC/s Min: 369 RPC/s Max: 369 RPC/s [W] Avg: 727 RPC/s Min: 727 RPC/s Max: 727 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.47 MiB/s Min: 1.47 MiB/s Max: 1.47 MiB/s [LNet Rates of c] [R] Avg: 665 RPC/s Min: 665 RPC/s Max: 665 RPC/s [W] Avg: 338 RPC/s Min: 338 RPC/s Max: 338 RPC/s [LNet Bandwidth of c] [R] Avg: 1.34 MiB/s Min: 1.34 MiB/s Max: 1.34 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 351 RPC/s Min: 351 RPC/s Max: 351 RPC/s [W] Avg: 690 RPC/s Min: 690 RPC/s Max: 690 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.38 MiB/s Min: 1.38 MiB/s Max: 1.38 MiB/s [LNet Rates of c] [R] Avg: 977 RPC/s Min: 977 RPC/s Max: 977 RPC/s [W] Avg: 489 RPC/s Min: 489 RPC/s Max: 489 RPC/s [LNet Bandwidth of c] [R] Avg: 1.98 MiB/s Min: 1.98 MiB/s Max: 1.98 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 483 RPC/s Min: 483 RPC/s Max: 483 RPC/s [W] Avg: 971 RPC/s Min: 971 RPC/s Max: 971 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.97 MiB/s Min: 1.97 MiB/s Max: 1.97 MiB/s [LNet Rates of c] [R] Avg: 720 RPC/s Min: 720 RPC/s Max: 720 RPC/s [W] Avg: 361 RPC/s Min: 361 RPC/s Max: 361 RPC/s [LNet Bandwidth of c] [R] Avg: 1.46 MiB/s Min: 1.46 MiB/s Max: 1.46 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 359 RPC/s Min: 359 RPC/s Max: 359 RPC/s [W] Avg: 716 RPC/s Min: 716 RPC/s Max: 716 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.45 MiB/s Min: 1.45 MiB/s Max: 1.45 MiB/s [LNet Rates of c] [R] Avg: 807 RPC/s Min: 807 RPC/s Max: 807 RPC/s [W] Avg: 403 RPC/s Min: 403 RPC/s Max: 403 RPC/s [LNet Bandwidth of c] [R] Avg: 1.63 MiB/s Min: 1.63 MiB/s Max: 1.63 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 403 RPC/s Min: 403 RPC/s Max: 403 RPC/s [W] Avg: 805 RPC/s Min: 805 RPC/s Max: 805 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.63 MiB/s Min: 1.63 MiB/s Max: 1.63 MiB/s [LNet Rates of c] [R] Avg: 601 RPC/s Min: 601 RPC/s Max: 601 RPC/s [W] Avg: 305 RPC/s Min: 305 RPC/s Max: 305 RPC/s [LNet Bandwidth of c] [R] Avg: 1.21 MiB/s Min: 1.21 MiB/s Max: 1.21 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 303 RPC/s Min: 303 RPC/s Max: 303 RPC/s [W] Avg: 596 RPC/s Min: 596 RPC/s Max: 596 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.20 MiB/s Min: 1.20 MiB/s Max: 1.20 MiB/s [LNet Rates of c] [R] Avg: 659 RPC/s Min: 659 RPC/s Max: 659 RPC/s [W] Avg: 331 RPC/s Min: 331 RPC/s Max: 331 RPC/s [LNet Bandwidth of c] [R] Avg: 1.33 MiB/s Min: 1.33 MiB/s Max: 1.33 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 336 RPC/s Min: 336 RPC/s Max: 336 RPC/s [W] Avg: 662 RPC/s Min: 662 RPC/s Max: 662 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.33 MiB/s Min: 1.33 MiB/s Max: 1.33 MiB/s Batch is stopped === BRW read off=0 size=64k === Test was added successfully b_r_0_64k is running now [LNet Rates of c] [R] Avg: 370 RPC/s Min: 370 RPC/s Max: 370 RPC/s [W] Avg: 259 RPC/s Min: 259 RPC/s Max: 259 RPC/s [LNet Bandwidth of c] [R] Avg: 6.98 MiB/s Min: 6.98 MiB/s Max: 6.98 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 136 RPC/s Min: 136 RPC/s Max: 136 RPC/s [W] Avg: 273 RPC/s Min: 273 RPC/s Max: 273 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.54 MiB/s Min: 8.54 MiB/s Max: 8.54 MiB/s [LNet Rates of c] [R] Avg: 376 RPC/s Min: 376 RPC/s Max: 376 RPC/s [W] Avg: 187 RPC/s Min: 187 RPC/s Max: 187 RPC/s [LNet Bandwidth of c] [R] Avg: 11.74 MiB/s Min: 11.74 MiB/s Max: 11.74 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 186 RPC/s Min: 186 RPC/s Max: 186 RPC/s [W] Avg: 372 RPC/s Min: 372 RPC/s Max: 372 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.65 MiB/s Min: 11.65 MiB/s Max: 11.65 MiB/s [LNet Rates of c] [R] Avg: 398 RPC/s Min: 398 RPC/s Max: 398 RPC/s [W] Avg: 203 RPC/s Min: 203 RPC/s Max: 203 RPC/s [LNet Bandwidth of c] [R] Avg: 12.30 MiB/s Min: 12.30 MiB/s Max: 12.30 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 203 RPC/s Min: 203 RPC/s Max: 203 RPC/s [W] Avg: 401 RPC/s Min: 401 RPC/s Max: 401 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 12.41 MiB/s Min: 12.41 MiB/s Max: 12.41 MiB/s [LNet Rates of c] [R] Avg: 355 RPC/s Min: 355 RPC/s Max: 355 RPC/s [W] Avg: 179 RPC/s Min: 179 RPC/s Max: 179 RPC/s [LNet Bandwidth of c] [R] Avg: 11.03 MiB/s Min: 11.03 MiB/s Max: 11.03 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 177 RPC/s Min: 177 RPC/s Max: 177 RPC/s [W] Avg: 352 RPC/s Min: 352 RPC/s Max: 352 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.99 MiB/s Min: 10.99 MiB/s Max: 10.99 MiB/s [LNet Rates of c] [R] Avg: 292 RPC/s Min: 292 RPC/s Max: 292 RPC/s [W] Avg: 147 RPC/s Min: 147 RPC/s Max: 147 RPC/s [LNet Bandwidth of c] [R] Avg: 9.13 MiB/s Min: 9.13 MiB/s Max: 9.13 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 154 RPC/s Min: 154 RPC/s Max: 154 RPC/s [W] Avg: 302 RPC/s Min: 302 RPC/s Max: 302 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.13 MiB/s Min: 9.13 MiB/s Max: 9.13 MiB/s [LNet Rates of c] [R] Avg: 321 RPC/s Min: 321 RPC/s Max: 321 RPC/s [W] Avg: 162 RPC/s Min: 162 RPC/s Max: 162 RPC/s [LNet Bandwidth of c] [R] Avg: 9.91 MiB/s Min: 9.91 MiB/s Max: 9.91 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 163 RPC/s Min: 163 RPC/s Max: 163 RPC/s [W] Avg: 320 RPC/s Min: 320 RPC/s Max: 320 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.93 MiB/s Min: 9.93 MiB/s Max: 9.93 MiB/s [LNet Rates of c] [R] Avg: 322 RPC/s Min: 322 RPC/s Max: 322 RPC/s [W] Avg: 163 RPC/s Min: 163 RPC/s Max: 163 RPC/s [LNet Bandwidth of c] [R] Avg: 10.04 MiB/s Min: 10.04 MiB/s Max: 10.04 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 154 RPC/s Min: 154 RPC/s Max: 154 RPC/s [W] Avg: 309 RPC/s Min: 309 RPC/s Max: 309 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.72 MiB/s Min: 9.72 MiB/s Max: 9.72 MiB/s [LNet Rates of c] [R] Avg: 287 RPC/s Min: 287 RPC/s Max: 287 RPC/s [W] Avg: 144 RPC/s Min: 144 RPC/s Max: 144 RPC/s [LNet Bandwidth of c] [R] Avg: 8.93 MiB/s Min: 8.93 MiB/s Max: 8.93 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 149 RPC/s Min: 149 RPC/s Max: 149 RPC/s [W] Avg: 301 RPC/s Min: 301 RPC/s Max: 301 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.27 MiB/s Min: 9.27 MiB/s Max: 9.27 MiB/s [LNet Rates of c] [R] Avg: 314 RPC/s Min: 314 RPC/s Max: 314 RPC/s [W] Avg: 158 RPC/s Min: 158 RPC/s Max: 158 RPC/s [LNet Bandwidth of c] [R] Avg: 9.72 MiB/s Min: 9.72 MiB/s Max: 9.72 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 158 RPC/s Min: 158 RPC/s Max: 158 RPC/s [W] Avg: 308 RPC/s Min: 308 RPC/s Max: 308 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.61 MiB/s Min: 9.61 MiB/s Max: 9.61 MiB/s [LNet Rates of c] [R] Avg: 445 RPC/s Min: 445 RPC/s Max: 445 RPC/s [W] Avg: 223 RPC/s Min: 223 RPC/s Max: 223 RPC/s [LNet Bandwidth of c] [R] Avg: 13.83 MiB/s Min: 13.83 MiB/s Max: 13.83 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 232 RPC/s Min: 232 RPC/s Max: 232 RPC/s [W] Avg: 452 RPC/s Min: 452 RPC/s Max: 452 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 13.77 MiB/s Min: 13.77 MiB/s Max: 13.77 MiB/s 1 batch in stopping Batch is stopped === BRW read off=512 size=4k === Test was added successfully b_r_512_4k is running now [LNet Rates of c] [R] Avg: 833 RPC/s Min: 833 RPC/s Max: 833 RPC/s [W] Avg: 417 RPC/s Min: 417 RPC/s Max: 417 RPC/s [LNet Bandwidth of c] [R] Avg: 1.69 MiB/s Min: 1.69 MiB/s Max: 1.69 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 418 RPC/s Min: 418 RPC/s Max: 418 RPC/s [W] Avg: 830 RPC/s Min: 830 RPC/s Max: 830 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.69 MiB/s Min: 1.69 MiB/s Max: 1.69 MiB/s [LNet Rates of c] [R] Avg: 884 RPC/s Min: 884 RPC/s Max: 884 RPC/s [W] Avg: 445 RPC/s Min: 445 RPC/s Max: 445 RPC/s [LNet Bandwidth of c] [R] Avg: 1.79 MiB/s Min: 1.79 MiB/s Max: 1.79 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 443 RPC/s Min: 443 RPC/s Max: 443 RPC/s [W] Avg: 884 RPC/s Min: 884 RPC/s Max: 884 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.79 MiB/s Min: 1.79 MiB/s Max: 1.79 MiB/s [LNet Rates of c] [R] Avg: 745 RPC/s Min: 745 RPC/s Max: 745 RPC/s [W] Avg: 374 RPC/s Min: 374 RPC/s Max: 374 RPC/s [LNet Bandwidth of c] [R] Avg: 1.51 MiB/s Min: 1.51 MiB/s Max: 1.51 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 372 RPC/s Min: 372 RPC/s Max: 372 RPC/s [W] Avg: 740 RPC/s Min: 740 RPC/s Max: 740 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.50 MiB/s Min: 1.50 MiB/s Max: 1.50 MiB/s [LNet Rates of c] [R] Avg: 910 RPC/s Min: 910 RPC/s Max: 910 RPC/s [W] Avg: 454 RPC/s Min: 454 RPC/s Max: 454 RPC/s [LNet Bandwidth of c] [R] Avg: 1.85 MiB/s Min: 1.85 MiB/s Max: 1.85 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 470 RPC/s Min: 470 RPC/s Max: 470 RPC/s [W] Avg: 925 RPC/s Min: 925 RPC/s Max: 925 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.85 MiB/s Min: 1.85 MiB/s Max: 1.85 MiB/s [LNet Rates of c] [R] Avg: 851 RPC/s Min: 851 RPC/s Max: 851 RPC/s [W] Avg: 427 RPC/s Min: 427 RPC/s Max: 427 RPC/s [LNet Bandwidth of c] [R] Avg: 1.72 MiB/s Min: 1.72 MiB/s Max: 1.72 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 417 RPC/s Min: 417 RPC/s Max: 417 RPC/s [W] Avg: 842 RPC/s Min: 842 RPC/s Max: 842 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.71 MiB/s Min: 1.71 MiB/s Max: 1.71 MiB/s [LNet Rates of c] [R] Avg: 651 RPC/s Min: 651 RPC/s Max: 651 RPC/s [W] Avg: 327 RPC/s Min: 327 RPC/s Max: 327 RPC/s [LNet Bandwidth of c] [R] Avg: 1.32 MiB/s Min: 1.32 MiB/s Max: 1.32 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 317 RPC/s Min: 317 RPC/s Max: 317 RPC/s [W] Avg: 629 RPC/s Min: 629 RPC/s Max: 629 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.28 MiB/s Min: 1.28 MiB/s Max: 1.28 MiB/s [LNet Rates of c] [R] Avg: 841 RPC/s Min: 841 RPC/s Max: 841 RPC/s [W] Avg: 422 RPC/s Min: 422 RPC/s Max: 422 RPC/s [LNet Bandwidth of c] [R] Avg: 1.70 MiB/s Min: 1.70 MiB/s Max: 1.70 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 436 RPC/s Min: 436 RPC/s Max: 436 RPC/s [W] Avg: 873 RPC/s Min: 873 RPC/s Max: 873 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.76 MiB/s Min: 1.76 MiB/s Max: 1.76 MiB/s [LNet Rates of c] [R] Avg: 744 RPC/s Min: 744 RPC/s Max: 744 RPC/s [W] Avg: 374 RPC/s Min: 374 RPC/s Max: 374 RPC/s [LNet Bandwidth of c] [R] Avg: 1.50 MiB/s Min: 1.50 MiB/s Max: 1.50 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 365 RPC/s Min: 365 RPC/s Max: 365 RPC/s [W] Avg: 728 RPC/s Min: 728 RPC/s Max: 728 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.48 MiB/s Min: 1.48 MiB/s Max: 1.48 MiB/s [LNet Rates of c] [R] Avg: 784 RPC/s Min: 784 RPC/s Max: 784 RPC/s [W] Avg: 393 RPC/s Min: 393 RPC/s Max: 393 RPC/s [LNet Bandwidth of c] [R] Avg: 1.59 MiB/s Min: 1.59 MiB/s Max: 1.59 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 412 RPC/s Min: 412 RPC/s Max: 412 RPC/s [W] Avg: 809 RPC/s Min: 809 RPC/s Max: 809 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.62 MiB/s Min: 1.62 MiB/s Max: 1.62 MiB/s [LNet Rates of c] [R] Avg: 986 RPC/s Min: 986 RPC/s Max: 986 RPC/s [W] Avg: 493 RPC/s Min: 493 RPC/s Max: 493 RPC/s [LNet Bandwidth of c] [R] Avg: 2.00 MiB/s Min: 2.00 MiB/s Max: 2.00 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 494 RPC/s Min: 494 RPC/s Max: 494 RPC/s [W] Avg: 984 RPC/s Min: 984 RPC/s Max: 984 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.00 MiB/s Min: 2.00 MiB/s Max: 2.00 MiB/s 1 batch in stopping Batch is stopped === BRW read off=512 size=64k === Test was added successfully b_r_512_64k is running now [LNet Rates of c] [R] Avg: 291 RPC/s Min: 291 RPC/s Max: 291 RPC/s [W] Avg: 147 RPC/s Min: 147 RPC/s Max: 147 RPC/s [LNet Bandwidth of c] [R] Avg: 8.99 MiB/s Min: 8.99 MiB/s Max: 8.99 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 144 RPC/s Min: 144 RPC/s Max: 144 RPC/s [W] Avg: 286 RPC/s Min: 286 RPC/s Max: 286 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.90 MiB/s Min: 8.90 MiB/s Max: 8.90 MiB/s [LNet Rates of c] [R] Avg: 651 RPC/s Min: 651 RPC/s Max: 651 RPC/s [W] Avg: 327 RPC/s Min: 327 RPC/s Max: 327 RPC/s [LNet Bandwidth of c] [R] Avg: 20.30 MiB/s Min: 20.30 MiB/s Max: 20.30 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 334 RPC/s Min: 334 RPC/s Max: 334 RPC/s [W] Avg: 666 RPC/s Min: 666 RPC/s Max: 666 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 20.84 MiB/s Min: 20.84 MiB/s Max: 20.84 MiB/s [LNet Rates of c] [R] Avg: 600 RPC/s Min: 600 RPC/s Max: 600 RPC/s [W] Avg: 301 RPC/s Min: 301 RPC/s Max: 301 RPC/s [LNet Bandwidth of c] [R] Avg: 18.75 MiB/s Min: 18.75 MiB/s Max: 18.75 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 312 RPC/s Min: 312 RPC/s Max: 312 RPC/s [W] Avg: 610 RPC/s Min: 610 RPC/s Max: 610 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 18.66 MiB/s Min: 18.66 MiB/s Max: 18.66 MiB/s [LNet Rates of c] [R] Avg: 536 RPC/s Min: 536 RPC/s Max: 536 RPC/s [W] Avg: 270 RPC/s Min: 270 RPC/s Max: 270 RPC/s [LNet Bandwidth of c] [R] Avg: 16.67 MiB/s Min: 16.67 MiB/s Max: 16.67 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 266 RPC/s Min: 266 RPC/s Max: 266 RPC/s [W] Avg: 530 RPC/s Min: 530 RPC/s Max: 530 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 16.60 MiB/s Min: 16.60 MiB/s Max: 16.60 MiB/s [LNet Rates of c] [R] Avg: 329 RPC/s Min: 329 RPC/s Max: 329 RPC/s [W] Avg: 165 RPC/s Min: 165 RPC/s Max: 165 RPC/s [LNet Bandwidth of c] [R] Avg: 10.26 MiB/s Min: 10.26 MiB/s Max: 10.26 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 165 RPC/s Min: 165 RPC/s Max: 165 RPC/s [W] Avg: 327 RPC/s Min: 327 RPC/s Max: 327 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.11 MiB/s Min: 10.11 MiB/s Max: 10.11 MiB/s [LNet Rates of c] [R] Avg: 374 RPC/s Min: 374 RPC/s Max: 374 RPC/s [W] Avg: 190 RPC/s Min: 190 RPC/s Max: 190 RPC/s [LNet Bandwidth of c] [R] Avg: 11.56 MiB/s Min: 11.56 MiB/s Max: 11.56 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 186 RPC/s Min: 186 RPC/s Max: 186 RPC/s [W] Avg: 378 RPC/s Min: 378 RPC/s Max: 378 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.80 MiB/s Min: 11.80 MiB/s Max: 11.80 MiB/s [LNet Rates of c] [R] Avg: 352 RPC/s Min: 352 RPC/s Max: 352 RPC/s [W] Avg: 176 RPC/s Min: 176 RPC/s Max: 176 RPC/s [LNet Bandwidth of c] [R] Avg: 10.98 MiB/s Min: 10.98 MiB/s Max: 10.98 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 179 RPC/s Min: 179 RPC/s Max: 179 RPC/s [W] Avg: 350 RPC/s Min: 350 RPC/s Max: 350 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.88 MiB/s Min: 10.88 MiB/s Max: 10.88 MiB/s [LNet Rates of c] [R] Avg: 444 RPC/s Min: 444 RPC/s Max: 444 RPC/s [W] Avg: 224 RPC/s Min: 224 RPC/s Max: 224 RPC/s [LNet Bandwidth of c] [R] Avg: 13.85 MiB/s Min: 13.85 MiB/s Max: 13.85 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 230 RPC/s Min: 230 RPC/s Max: 230 RPC/s [W] Avg: 450 RPC/s Min: 450 RPC/s Max: 450 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 13.73 MiB/s Min: 13.73 MiB/s Max: 13.73 MiB/s [LNet Rates of c] [R] Avg: 449 RPC/s Min: 449 RPC/s Max: 449 RPC/s [W] Avg: 227 RPC/s Min: 227 RPC/s Max: 227 RPC/s [LNet Bandwidth of c] [R] Avg: 13.87 MiB/s Min: 13.87 MiB/s Max: 13.87 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 226 RPC/s Min: 226 RPC/s Max: 226 RPC/s [W] Avg: 453 RPC/s Min: 453 RPC/s Max: 453 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 14.14 MiB/s Min: 14.14 MiB/s Max: 14.14 MiB/s [LNet Rates of c] [R] Avg: 407 RPC/s Min: 407 RPC/s Max: 407 RPC/s [W] Avg: 204 RPC/s Min: 204 RPC/s Max: 204 RPC/s [LNet Bandwidth of c] [R] Avg: 12.72 MiB/s Min: 12.72 MiB/s Max: 12.72 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 205 RPC/s Min: 205 RPC/s Max: 205 RPC/s [W] Avg: 405 RPC/s Min: 405 RPC/s Max: 405 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 12.60 MiB/s Min: 12.60 MiB/s Max: 12.60 MiB/s 1 batch in stopping Batch is stopped === BRW read off=1024 size=4k === Test was added successfully b_r_1024_4k is running now [LNet Rates of c] [R] Avg: 842 RPC/s Min: 842 RPC/s Max: 842 RPC/s [W] Avg: 423 RPC/s Min: 423 RPC/s Max: 423 RPC/s [LNet Bandwidth of c] [R] Avg: 1.70 MiB/s Min: 1.70 MiB/s Max: 1.70 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 422 RPC/s Min: 422 RPC/s Max: 422 RPC/s [W] Avg: 840 RPC/s Min: 840 RPC/s Max: 840 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.70 MiB/s Min: 1.70 MiB/s Max: 1.70 MiB/s [LNet Rates of c] [R] Avg: 1221 RPC/s Min: 1221 RPC/s Max: 1221 RPC/s [W] Avg: 608 RPC/s Min: 608 RPC/s Max: 608 RPC/s [LNet Bandwidth of c] [R] Avg: 2.47 MiB/s Min: 2.47 MiB/s Max: 2.47 MiB/s [W] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [LNet Rates of s] [R] Avg: 622 RPC/s Min: 622 RPC/s Max: 622 RPC/s [W] Avg: 1231 RPC/s Min: 1231 RPC/s Max: 1231 RPC/s [LNet Bandwidth of s] [R] Avg: 0.10 MiB/s Min: 0.10 MiB/s Max: 0.10 MiB/s [W] Avg: 2.47 MiB/s Min: 2.47 MiB/s Max: 2.47 MiB/s [LNet Rates of c] [R] Avg: 1179 RPC/s Min: 1179 RPC/s Max: 1179 RPC/s [W] Avg: 594 RPC/s Min: 594 RPC/s Max: 594 RPC/s [LNet Bandwidth of c] [R] Avg: 2.39 MiB/s Min: 2.39 MiB/s Max: 2.39 MiB/s [W] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [LNet Rates of s] [R] Avg: 588 RPC/s Min: 588 RPC/s Max: 588 RPC/s [W] Avg: 1175 RPC/s Min: 1175 RPC/s Max: 1175 RPC/s [LNet Bandwidth of s] [R] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [W] Avg: 2.39 MiB/s Min: 2.39 MiB/s Max: 2.39 MiB/s [LNet Rates of c] [R] Avg: 1101 RPC/s Min: 1101 RPC/s Max: 1101 RPC/s [W] Avg: 552 RPC/s Min: 552 RPC/s Max: 552 RPC/s [LNet Bandwidth of c] [R] Avg: 2.24 MiB/s Min: 2.24 MiB/s Max: 2.24 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 552 RPC/s Min: 552 RPC/s Max: 552 RPC/s [W] Avg: 1102 RPC/s Min: 1102 RPC/s Max: 1102 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.23 MiB/s Min: 2.23 MiB/s Max: 2.23 MiB/s [LNet Rates of c] [R] Avg: 1252 RPC/s Min: 1252 RPC/s Max: 1252 RPC/s [W] Avg: 627 RPC/s Min: 627 RPC/s Max: 627 RPC/s [LNet Bandwidth of c] [R] Avg: 2.54 MiB/s Min: 2.54 MiB/s Max: 2.54 MiB/s [W] Avg: 0.10 MiB/s Min: 0.10 MiB/s Max: 0.10 MiB/s [LNet Rates of s] [R] Avg: 626 RPC/s Min: 626 RPC/s Max: 626 RPC/s [W] Avg: 1249 RPC/s Min: 1249 RPC/s Max: 1249 RPC/s [LNet Bandwidth of s] [R] Avg: 0.10 MiB/s Min: 0.10 MiB/s Max: 0.10 MiB/s [W] Avg: 2.53 MiB/s Min: 2.53 MiB/s Max: 2.53 MiB/s [LNet Rates of c] [R] Avg: 1055 RPC/s Min: 1055 RPC/s Max: 1055 RPC/s [W] Avg: 531 RPC/s Min: 531 RPC/s Max: 531 RPC/s [LNet Bandwidth of c] [R] Avg: 2.13 MiB/s Min: 2.13 MiB/s Max: 2.13 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 527 RPC/s Min: 527 RPC/s Max: 527 RPC/s [W] Avg: 1050 RPC/s Min: 1050 RPC/s Max: 1050 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.13 MiB/s Min: 2.13 MiB/s Max: 2.13 MiB/s [LNet Rates of c] [R] Avg: 1080 RPC/s Min: 1080 RPC/s Max: 1080 RPC/s [W] Avg: 542 RPC/s Min: 542 RPC/s Max: 542 RPC/s [LNet Bandwidth of c] [R] Avg: 2.19 MiB/s Min: 2.19 MiB/s Max: 2.19 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 549 RPC/s Min: 549 RPC/s Max: 549 RPC/s [W] Avg: 1096 RPC/s Min: 1096 RPC/s Max: 1096 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.20 MiB/s Min: 2.20 MiB/s Max: 2.20 MiB/s [LNet Rates of c] [R] Avg: 978 RPC/s Min: 978 RPC/s Max: 978 RPC/s [W] Avg: 491 RPC/s Min: 491 RPC/s Max: 491 RPC/s [LNet Bandwidth of c] [R] Avg: 1.98 MiB/s Min: 1.98 MiB/s Max: 1.98 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 488 RPC/s Min: 488 RPC/s Max: 488 RPC/s [W] Avg: 967 RPC/s Min: 967 RPC/s Max: 967 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.96 MiB/s Min: 1.96 MiB/s Max: 1.96 MiB/s [LNet Rates of c] [R] Avg: 904 RPC/s Min: 904 RPC/s Max: 904 RPC/s [W] Avg: 453 RPC/s Min: 453 RPC/s Max: 453 RPC/s [LNet Bandwidth of c] [R] Avg: 1.83 MiB/s Min: 1.83 MiB/s Max: 1.83 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 452 RPC/s Min: 452 RPC/s Max: 452 RPC/s [W] Avg: 905 RPC/s Min: 905 RPC/s Max: 905 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.84 MiB/s Min: 1.84 MiB/s Max: 1.84 MiB/s [LNet Rates of c] [R] Avg: 965 RPC/s Min: 965 RPC/s Max: 965 RPC/s [W] Avg: 484 RPC/s Min: 484 RPC/s Max: 484 RPC/s [LNet Bandwidth of c] [R] Avg: 1.95 MiB/s Min: 1.95 MiB/s Max: 1.95 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 487 RPC/s Min: 487 RPC/s Max: 487 RPC/s [W] Avg: 968 RPC/s Min: 968 RPC/s Max: 968 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.96 MiB/s Min: 1.96 MiB/s Max: 1.96 MiB/s 1 batch in stopping Batch is stopped === BRW read off=1024 size=64k === Test was added successfully b_r_1024_64k is running now [LNet Rates of c] [R] Avg: 491 RPC/s Min: 491 RPC/s Max: 491 RPC/s [W] Avg: 247 RPC/s Min: 247 RPC/s Max: 247 RPC/s [LNet Bandwidth of c] [R] Avg: 15.32 MiB/s Min: 15.32 MiB/s Max: 15.32 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 246 RPC/s Min: 246 RPC/s Max: 246 RPC/s [W] Avg: 492 RPC/s Min: 492 RPC/s Max: 492 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.37 MiB/s Min: 15.37 MiB/s Max: 15.37 MiB/s [LNet Rates of c] [R] Avg: 586 RPC/s Min: 586 RPC/s Max: 586 RPC/s [W] Avg: 295 RPC/s Min: 295 RPC/s Max: 295 RPC/s [LNet Bandwidth of c] [R] Avg: 18.25 MiB/s Min: 18.25 MiB/s Max: 18.25 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 292 RPC/s Min: 292 RPC/s Max: 292 RPC/s [W] Avg: 583 RPC/s Min: 583 RPC/s Max: 583 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 18.23 MiB/s Min: 18.23 MiB/s Max: 18.23 MiB/s [LNet Rates of c] [R] Avg: 520 RPC/s Min: 520 RPC/s Max: 520 RPC/s [W] Avg: 262 RPC/s Min: 262 RPC/s Max: 262 RPC/s [LNet Bandwidth of c] [R] Avg: 16.21 MiB/s Min: 16.21 MiB/s Max: 16.21 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 259 RPC/s Min: 259 RPC/s Max: 259 RPC/s [W] Avg: 515 RPC/s Min: 515 RPC/s Max: 515 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 16.08 MiB/s Min: 16.08 MiB/s Max: 16.08 MiB/s [LNet Rates of c] [R] Avg: 499 RPC/s Min: 499 RPC/s Max: 499 RPC/s [W] Avg: 250 RPC/s Min: 250 RPC/s Max: 250 RPC/s [LNet Bandwidth of c] [R] Avg: 15.57 MiB/s Min: 15.57 MiB/s Max: 15.57 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 250 RPC/s Min: 250 RPC/s Max: 250 RPC/s [W] Avg: 502 RPC/s Min: 502 RPC/s Max: 502 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.76 MiB/s Min: 15.76 MiB/s Max: 15.76 MiB/s [LNet Rates of c] [R] Avg: 525 RPC/s Min: 525 RPC/s Max: 525 RPC/s [W] Avg: 263 RPC/s Min: 263 RPC/s Max: 263 RPC/s [LNet Bandwidth of c] [R] Avg: 16.45 MiB/s Min: 16.45 MiB/s Max: 16.45 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 272 RPC/s Min: 272 RPC/s Max: 272 RPC/s [W] Avg: 537 RPC/s Min: 537 RPC/s Max: 537 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 16.33 MiB/s Min: 16.33 MiB/s Max: 16.33 MiB/s [LNet Rates of c] [R] Avg: 506 RPC/s Min: 506 RPC/s Max: 506 RPC/s [W] Avg: 255 RPC/s Min: 255 RPC/s Max: 255 RPC/s [LNet Bandwidth of c] [R] Avg: 15.74 MiB/s Min: 15.74 MiB/s Max: 15.74 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 254 RPC/s Min: 254 RPC/s Max: 254 RPC/s [W] Avg: 502 RPC/s Min: 502 RPC/s Max: 502 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.80 MiB/s Min: 15.80 MiB/s Max: 15.80 MiB/s [LNet Rates of c] [R] Avg: 426 RPC/s Min: 426 RPC/s Max: 426 RPC/s [W] Avg: 215 RPC/s Min: 215 RPC/s Max: 215 RPC/s [LNet Bandwidth of c] [R] Avg: 13.19 MiB/s Min: 13.19 MiB/s Max: 13.19 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 213 RPC/s Min: 213 RPC/s Max: 213 RPC/s [W] Avg: 424 RPC/s Min: 424 RPC/s Max: 424 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.23 MiB/s Min: 13.23 MiB/s Max: 13.23 MiB/s [LNet Rates of c] [R] Avg: 508 RPC/s Min: 508 RPC/s Max: 508 RPC/s [W] Avg: 256 RPC/s Min: 256 RPC/s Max: 256 RPC/s [LNet Bandwidth of c] [R] Avg: 15.83 MiB/s Min: 15.83 MiB/s Max: 15.83 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 256 RPC/s Min: 256 RPC/s Max: 256 RPC/s [W] Avg: 508 RPC/s Min: 508 RPC/s Max: 508 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.76 MiB/s Min: 15.76 MiB/s Max: 15.76 MiB/s [LNet Rates of c] [R] Avg: 531 RPC/s Min: 531 RPC/s Max: 531 RPC/s [W] Avg: 266 RPC/s Min: 266 RPC/s Max: 266 RPC/s [LNet Bandwidth of c] [R] Avg: 16.61 MiB/s Min: 16.61 MiB/s Max: 16.61 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 265 RPC/s Min: 265 RPC/s Max: 265 RPC/s [W] Avg: 531 RPC/s Min: 531 RPC/s Max: 531 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 16.64 MiB/s Min: 16.64 MiB/s Max: 16.64 MiB/s [LNet Rates of c] [R] Avg: 564 RPC/s Min: 564 RPC/s Max: 564 RPC/s [W] Avg: 284 RPC/s Min: 284 RPC/s Max: 284 RPC/s [LNet Bandwidth of c] [R] Avg: 17.56 MiB/s Min: 17.56 MiB/s Max: 17.56 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 283 RPC/s Min: 283 RPC/s Max: 283 RPC/s [W] Avg: 563 RPC/s Min: 563 RPC/s Max: 563 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 17.56 MiB/s Min: 17.56 MiB/s Max: 17.56 MiB/s 1 batch in stopping Batch is stopped === BRW read off=2048 size=4k === Test was added successfully b_r_2048_4k is running now [LNet Rates of c] [R] Avg: 916 RPC/s Min: 916 RPC/s Max: 916 RPC/s [W] Avg: 463 RPC/s Min: 463 RPC/s Max: 463 RPC/s [LNet Bandwidth of c] [R] Avg: 1.85 MiB/s Min: 1.85 MiB/s Max: 1.85 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 459 RPC/s Min: 459 RPC/s Max: 459 RPC/s [W] Avg: 917 RPC/s Min: 917 RPC/s Max: 917 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.86 MiB/s Min: 1.86 MiB/s Max: 1.86 MiB/s [LNet Rates of c] [R] Avg: 1171 RPC/s Min: 1171 RPC/s Max: 1171 RPC/s [W] Avg: 585 RPC/s Min: 585 RPC/s Max: 585 RPC/s [LNet Bandwidth of c] [R] Avg: 2.36 MiB/s Min: 2.36 MiB/s Max: 2.36 MiB/s [W] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [LNet Rates of s] [R] Avg: 588 RPC/s Min: 588 RPC/s Max: 588 RPC/s [W] Avg: 1176 RPC/s Min: 1176 RPC/s Max: 1176 RPC/s [LNet Bandwidth of s] [R] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [W] Avg: 2.38 MiB/s Min: 2.38 MiB/s Max: 2.38 MiB/s [LNet Rates of c] [R] Avg: 1166 RPC/s Min: 1166 RPC/s Max: 1166 RPC/s [W] Avg: 584 RPC/s Min: 584 RPC/s Max: 584 RPC/s [LNet Bandwidth of c] [R] Avg: 2.37 MiB/s Min: 2.37 MiB/s Max: 2.37 MiB/s [W] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [LNet Rates of s] [R] Avg: 577 RPC/s Min: 577 RPC/s Max: 577 RPC/s [W] Avg: 1155 RPC/s Min: 1155 RPC/s Max: 1155 RPC/s [LNet Bandwidth of s] [R] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [W] Avg: 2.35 MiB/s Min: 2.35 MiB/s Max: 2.35 MiB/s [LNet Rates of c] [R] Avg: 780 RPC/s Min: 780 RPC/s Max: 780 RPC/s [W] Avg: 391 RPC/s Min: 391 RPC/s Max: 391 RPC/s [LNet Bandwidth of c] [R] Avg: 1.57 MiB/s Min: 1.57 MiB/s Max: 1.57 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 407 RPC/s Min: 407 RPC/s Max: 407 RPC/s [W] Avg: 796 RPC/s Min: 796 RPC/s Max: 796 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.58 MiB/s Min: 1.58 MiB/s Max: 1.58 MiB/s [LNet Rates of c] [R] Avg: 1173 RPC/s Min: 1173 RPC/s Max: 1173 RPC/s [W] Avg: 589 RPC/s Min: 589 RPC/s Max: 589 RPC/s [LNet Bandwidth of c] [R] Avg: 2.38 MiB/s Min: 2.38 MiB/s Max: 2.38 MiB/s [W] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [LNet Rates of s] [R] Avg: 585 RPC/s Min: 585 RPC/s Max: 585 RPC/s [W] Avg: 1173 RPC/s Min: 1173 RPC/s Max: 1173 RPC/s [LNet Bandwidth of s] [R] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [W] Avg: 2.38 MiB/s Min: 2.38 MiB/s Max: 2.38 MiB/s [LNet Rates of c] [R] Avg: 1138 RPC/s Min: 1138 RPC/s Max: 1138 RPC/s [W] Avg: 571 RPC/s Min: 571 RPC/s Max: 571 RPC/s [LNet Bandwidth of c] [R] Avg: 2.30 MiB/s Min: 2.30 MiB/s Max: 2.30 MiB/s [W] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [LNet Rates of s] [R] Avg: 571 RPC/s Min: 571 RPC/s Max: 571 RPC/s [W] Avg: 1135 RPC/s Min: 1135 RPC/s Max: 1135 RPC/s [LNet Bandwidth of s] [R] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [W] Avg: 2.30 MiB/s Min: 2.30 MiB/s Max: 2.30 MiB/s [LNet Rates of c] [R] Avg: 1198 RPC/s Min: 1198 RPC/s Max: 1198 RPC/s [W] Avg: 601 RPC/s Min: 601 RPC/s Max: 601 RPC/s [LNet Bandwidth of c] [R] Avg: 2.42 MiB/s Min: 2.42 MiB/s Max: 2.42 MiB/s [W] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [LNet Rates of s] [R] Avg: 597 RPC/s Min: 597 RPC/s Max: 597 RPC/s [W] Avg: 1199 RPC/s Min: 1199 RPC/s Max: 1199 RPC/s [LNet Bandwidth of s] [R] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [W] Avg: 2.43 MiB/s Min: 2.43 MiB/s Max: 2.43 MiB/s [LNet Rates of c] [R] Avg: 937 RPC/s Min: 937 RPC/s Max: 937 RPC/s [W] Avg: 470 RPC/s Min: 470 RPC/s Max: 470 RPC/s [LNet Bandwidth of c] [R] Avg: 1.90 MiB/s Min: 1.90 MiB/s Max: 1.90 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 470 RPC/s Min: 470 RPC/s Max: 470 RPC/s [W] Avg: 933 RPC/s Min: 933 RPC/s Max: 933 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.89 MiB/s Min: 1.89 MiB/s Max: 1.89 MiB/s [LNet Rates of c] [R] Avg: 1021 RPC/s Min: 1021 RPC/s Max: 1021 RPC/s [W] Avg: 512 RPC/s Min: 512 RPC/s Max: 512 RPC/s [LNet Bandwidth of c] [R] Avg: 2.07 MiB/s Min: 2.07 MiB/s Max: 2.07 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 523 RPC/s Min: 523 RPC/s Max: 523 RPC/s [W] Avg: 1034 RPC/s Min: 1034 RPC/s Max: 1034 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.07 MiB/s Min: 2.07 MiB/s Max: 2.07 MiB/s [LNet Rates of c] [R] Avg: 803 RPC/s Min: 803 RPC/s Max: 803 RPC/s [W] Avg: 403 RPC/s Min: 403 RPC/s Max: 403 RPC/s [LNet Bandwidth of c] [R] Avg: 1.62 MiB/s Min: 1.62 MiB/s Max: 1.62 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 402 RPC/s Min: 402 RPC/s Max: 402 RPC/s [W] Avg: 807 RPC/s Min: 807 RPC/s Max: 807 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.63 MiB/s Min: 1.63 MiB/s Max: 1.63 MiB/s 1 batch in stopping Batch is stopped === BRW read off=2048 size=64k === Test was added successfully b_r_2048_64k is running now [LNet Rates of c] [R] Avg: 487 RPC/s Min: 487 RPC/s Max: 487 RPC/s [W] Avg: 245 RPC/s Min: 245 RPC/s Max: 245 RPC/s [LNet Bandwidth of c] [R] Avg: 15.17 MiB/s Min: 15.17 MiB/s Max: 15.17 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 245 RPC/s Min: 245 RPC/s Max: 245 RPC/s [W] Avg: 482 RPC/s Min: 482 RPC/s Max: 482 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.02 MiB/s Min: 15.02 MiB/s Max: 15.02 MiB/s [LNet Rates of c] [R] Avg: 502 RPC/s Min: 502 RPC/s Max: 502 RPC/s [W] Avg: 251 RPC/s Min: 251 RPC/s Max: 251 RPC/s [LNet Bandwidth of c] [R] Avg: 15.73 MiB/s Min: 15.73 MiB/s Max: 15.73 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 250 RPC/s Min: 250 RPC/s Max: 250 RPC/s [W] Avg: 504 RPC/s Min: 504 RPC/s Max: 504 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.82 MiB/s Min: 15.82 MiB/s Max: 15.82 MiB/s [LNet Rates of c] [R] Avg: 486 RPC/s Min: 486 RPC/s Max: 486 RPC/s [W] Avg: 246 RPC/s Min: 246 RPC/s Max: 246 RPC/s [LNet Bandwidth of c] [R] Avg: 15.07 MiB/s Min: 15.07 MiB/s Max: 15.07 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 258 RPC/s Min: 258 RPC/s Max: 258 RPC/s [W] Avg: 498 RPC/s Min: 498 RPC/s Max: 498 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.09 MiB/s Min: 15.09 MiB/s Max: 15.09 MiB/s [LNet Rates of c] [R] Avg: 503 RPC/s Min: 503 RPC/s Max: 503 RPC/s [W] Avg: 253 RPC/s Min: 253 RPC/s Max: 253 RPC/s [LNet Bandwidth of c] [R] Avg: 15.71 MiB/s Min: 15.71 MiB/s Max: 15.71 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 250 RPC/s Min: 250 RPC/s Max: 250 RPC/s [W] Avg: 500 RPC/s Min: 500 RPC/s Max: 500 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.59 MiB/s Min: 15.59 MiB/s Max: 15.59 MiB/s [LNet Rates of c] [R] Avg: 455 RPC/s Min: 455 RPC/s Max: 455 RPC/s [W] Avg: 227 RPC/s Min: 227 RPC/s Max: 227 RPC/s [LNet Bandwidth of c] [R] Avg: 8.57 MiB/s Min: 8.57 MiB/s Max: 8.57 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 324 RPC/s Min: 324 RPC/s Max: 324 RPC/s [W] Avg: 500 RPC/s Min: 500 RPC/s Max: 500 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 14.75 MiB/s Min: 14.75 MiB/s Max: 14.75 MiB/s [LNet Rates of c] [R] Avg: 479 RPC/s Min: 479 RPC/s Max: 479 RPC/s [W] Avg: 243 RPC/s Min: 243 RPC/s Max: 243 RPC/s [LNet Bandwidth of c] [R] Avg: 14.91 MiB/s Min: 14.91 MiB/s Max: 14.91 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 236 RPC/s Min: 236 RPC/s Max: 236 RPC/s [W] Avg: 473 RPC/s Min: 473 RPC/s Max: 473 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 14.86 MiB/s Min: 14.86 MiB/s Max: 14.86 MiB/s [LNet Rates of c] [R] Avg: 533 RPC/s Min: 533 RPC/s Max: 533 RPC/s [W] Avg: 268 RPC/s Min: 268 RPC/s Max: 268 RPC/s [LNet Bandwidth of c] [R] Avg: 16.56 MiB/s Min: 16.56 MiB/s Max: 16.56 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 265 RPC/s Min: 265 RPC/s Max: 265 RPC/s [W] Avg: 527 RPC/s Min: 527 RPC/s Max: 527 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 16.36 MiB/s Min: 16.36 MiB/s Max: 16.36 MiB/s [LNet Rates of c] [R] Avg: 510 RPC/s Min: 510 RPC/s Max: 510 RPC/s [W] Avg: 257 RPC/s Min: 257 RPC/s Max: 257 RPC/s [LNet Bandwidth of c] [R] Avg: 15.85 MiB/s Min: 15.85 MiB/s Max: 15.85 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 259 RPC/s Min: 259 RPC/s Max: 259 RPC/s [W] Avg: 515 RPC/s Min: 515 RPC/s Max: 515 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 16.11 MiB/s Min: 16.11 MiB/s Max: 16.11 MiB/s [LNet Rates of c] [R] Avg: 445 RPC/s Min: 445 RPC/s Max: 445 RPC/s [W] Avg: 224 RPC/s Min: 224 RPC/s Max: 224 RPC/s [LNet Bandwidth of c] [R] Avg: 13.89 MiB/s Min: 13.89 MiB/s Max: 13.89 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 234 RPC/s Min: 234 RPC/s Max: 234 RPC/s [W] Avg: 455 RPC/s Min: 455 RPC/s Max: 455 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 13.83 MiB/s Min: 13.83 MiB/s Max: 13.83 MiB/s [LNet Rates of c] [R] Avg: 496 RPC/s Min: 496 RPC/s Max: 496 RPC/s [W] Avg: 250 RPC/s Min: 250 RPC/s Max: 250 RPC/s [LNet Bandwidth of c] [R] Avg: 15.45 MiB/s Min: 15.45 MiB/s Max: 15.45 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 246 RPC/s Min: 246 RPC/s Max: 246 RPC/s [W] Avg: 494 RPC/s Min: 494 RPC/s Max: 494 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.42 MiB/s Min: 15.42 MiB/s Max: 15.42 MiB/s 1 batch in stopping Batch is stopped c: Total 0 error nodes in c s: Total 0 error nodes in s Total 0 error nodes in c Total 0 error nodes in s === BRW write off=2048 size=1M (off+len > LNET_MTU) === operation add test failed on 0-200@<206:43200>: Invalid argument === BRW read off=4096 size=4k (rejected) === operation add test failed on 0-200@<206:43200>: Invalid argument oleg614-client: oleg614-client.virtnet: executing lst_cleanup oleg614-server: oleg614-server.virtnet: executing lst_cleanup