== lnet-selftest test brw_offset: lst BRW offset handling (LU-20104) ========================================================== 11:26:59 (1788535619) oleg354-client: oleg354-client.virtnet: executing lst_cleanup oleg354-server: oleg354-server.virtnet: executing lst_cleanup oleg354-server: oleg354-server.virtnet: executing lst_setup oleg354-client: oleg354-client.virtnet: executing lst_setup === BRW read off=0 size=4k === Test was added successfully b_r_0_4k is running now [LNet Rates of c] [R] Avg: 255 RPC/s Min: 255 RPC/s Max: 255 RPC/s [W] Avg: 149 RPC/s Min: 149 RPC/s Max: 149 RPC/s [LNet Bandwidth of c] [R] Avg: 0.44 MiB/s Min: 0.44 MiB/s Max: 0.44 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 125 RPC/s Min: 125 RPC/s Max: 125 RPC/s [W] Avg: 250 RPC/s Min: 250 RPC/s Max: 250 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 0.51 MiB/s Min: 0.51 MiB/s Max: 0.51 MiB/s [LNet Rates of c] [R] Avg: 823 RPC/s Min: 823 RPC/s Max: 823 RPC/s [W] Avg: 414 RPC/s Min: 414 RPC/s Max: 414 RPC/s [LNet Bandwidth of c] [R] Avg: 1.66 MiB/s Min: 1.66 MiB/s Max: 1.66 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 428 RPC/s Min: 428 RPC/s Max: 428 RPC/s [W] Avg: 840 RPC/s Min: 840 RPC/s Max: 840 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.68 MiB/s Min: 1.68 MiB/s Max: 1.68 MiB/s [LNet Rates of c] [R] Avg: 536 RPC/s Min: 536 RPC/s Max: 536 RPC/s [W] Avg: 268 RPC/s Min: 268 RPC/s Max: 268 RPC/s [LNet Bandwidth of c] [R] Avg: 1.09 MiB/s Min: 1.09 MiB/s Max: 1.09 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 258 RPC/s Min: 258 RPC/s Max: 258 RPC/s [W] Avg: 521 RPC/s Min: 521 RPC/s Max: 521 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 1.06 MiB/s Min: 1.06 MiB/s Max: 1.06 MiB/s [LNet Rates of c] [R] Avg: 808 RPC/s Min: 808 RPC/s Max: 808 RPC/s [W] Avg: 405 RPC/s Min: 405 RPC/s Max: 405 RPC/s [LNet Bandwidth of c] [R] Avg: 1.64 MiB/s Min: 1.64 MiB/s Max: 1.64 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 417 RPC/s Min: 417 RPC/s Max: 417 RPC/s [W] Avg: 832 RPC/s Min: 832 RPC/s Max: 832 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.69 MiB/s Min: 1.69 MiB/s Max: 1.69 MiB/s [LNet Rates of c] [R] Avg: 707 RPC/s Min: 707 RPC/s Max: 707 RPC/s [W] Avg: 357 RPC/s Min: 357 RPC/s Max: 357 RPC/s [LNet Bandwidth of c] [R] Avg: 1.42 MiB/s Min: 1.42 MiB/s Max: 1.42 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 354 RPC/s Min: 354 RPC/s Max: 354 RPC/s [W] Avg: 700 RPC/s Min: 700 RPC/s Max: 700 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.42 MiB/s Min: 1.42 MiB/s Max: 1.42 MiB/s [LNet Rates of c] [R] Avg: 914 RPC/s Min: 914 RPC/s Max: 914 RPC/s [W] Avg: 456 RPC/s Min: 456 RPC/s Max: 456 RPC/s [LNet Bandwidth of c] [R] Avg: 1.85 MiB/s Min: 1.85 MiB/s Max: 1.85 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 458 RPC/s Min: 458 RPC/s Max: 458 RPC/s [W] Avg: 914 RPC/s Min: 914 RPC/s Max: 914 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.85 MiB/s Min: 1.85 MiB/s Max: 1.85 MiB/s [LNet Rates of c] [R] Avg: 584 RPC/s Min: 584 RPC/s Max: 584 RPC/s [W] Avg: 295 RPC/s Min: 295 RPC/s Max: 295 RPC/s [LNet Bandwidth of c] [R] Avg: 1.17 MiB/s Min: 1.17 MiB/s Max: 1.17 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 306 RPC/s Min: 306 RPC/s Max: 306 RPC/s [W] Avg: 595 RPC/s Min: 595 RPC/s Max: 595 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.18 MiB/s Min: 1.18 MiB/s Max: 1.18 MiB/s [LNet Rates of c] [R] Avg: 1308 RPC/s Min: 1308 RPC/s Max: 1308 RPC/s [W] Avg: 656 RPC/s Min: 656 RPC/s Max: 656 RPC/s [LNet Bandwidth of c] [R] Avg: 2.65 MiB/s Min: 2.65 MiB/s Max: 2.65 MiB/s [W] Avg: 0.10 MiB/s Min: 0.10 MiB/s Max: 0.10 MiB/s [LNet Rates of s] [R] Avg: 650 RPC/s Min: 650 RPC/s Max: 650 RPC/s [W] Avg: 1305 RPC/s Min: 1305 RPC/s Max: 1305 RPC/s [LNet Bandwidth of s] [R] Avg: 0.10 MiB/s Min: 0.10 MiB/s Max: 0.10 MiB/s [W] Avg: 2.65 MiB/s Min: 2.65 MiB/s Max: 2.65 MiB/s [LNet Rates of c] [R] Avg: 784 RPC/s Min: 784 RPC/s Max: 784 RPC/s [W] Avg: 391 RPC/s Min: 391 RPC/s Max: 391 RPC/s [LNet Bandwidth of c] [R] Avg: 1.58 MiB/s Min: 1.58 MiB/s Max: 1.58 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 395 RPC/s Min: 395 RPC/s Max: 395 RPC/s [W] Avg: 784 RPC/s Min: 784 RPC/s Max: 784 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.59 MiB/s Min: 1.59 MiB/s Max: 1.59 MiB/s [LNet Rates of c] [R] Avg: 1428 RPC/s Min: 1428 RPC/s Max: 1428 RPC/s [W] Avg: 716 RPC/s Min: 716 RPC/s Max: 716 RPC/s [LNet Bandwidth of c] [R] Avg: 2.89 MiB/s Min: 2.89 MiB/s Max: 2.89 MiB/s [W] Avg: 0.11 MiB/s Min: 0.11 MiB/s Max: 0.11 MiB/s [LNet Rates of s] [R] Avg: 709 RPC/s Min: 709 RPC/s Max: 709 RPC/s [W] Avg: 1423 RPC/s Min: 1423 RPC/s Max: 1423 RPC/s [LNet Bandwidth of s] [R] Avg: 0.11 MiB/s Min: 0.11 MiB/s Max: 0.11 MiB/s [W] Avg: 2.89 MiB/s Min: 2.89 MiB/s Max: 2.89 MiB/s 1 batch in stopping Batch is stopped === BRW read off=0 size=64k === Test was added successfully b_r_0_64k is running now [LNet Rates of c] [R] Avg: 285 RPC/s Min: 285 RPC/s Max: 285 RPC/s [W] Avg: 145 RPC/s Min: 145 RPC/s Max: 145 RPC/s [LNet Bandwidth of c] [R] Avg: 8.84 MiB/s Min: 8.84 MiB/s Max: 8.84 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 155 RPC/s Min: 155 RPC/s Max: 155 RPC/s [W] Avg: 294 RPC/s Min: 294 RPC/s Max: 294 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.86 MiB/s Min: 8.86 MiB/s Max: 8.86 MiB/s [LNet Rates of c] [R] Avg: 350 RPC/s Min: 350 RPC/s Max: 350 RPC/s [W] Avg: 176 RPC/s Min: 176 RPC/s Max: 176 RPC/s [LNet Bandwidth of c] [R] Avg: 10.86 MiB/s Min: 10.86 MiB/s Max: 10.86 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 170 RPC/s Min: 170 RPC/s Max: 170 RPC/s [W] Avg: 339 RPC/s Min: 339 RPC/s Max: 339 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.57 MiB/s Min: 10.57 MiB/s Max: 10.57 MiB/s [LNet Rates of c] [R] Avg: 290 RPC/s Min: 290 RPC/s Max: 290 RPC/s [W] Avg: 146 RPC/s Min: 146 RPC/s Max: 146 RPC/s [LNet Bandwidth of c] [R] Avg: 9.01 MiB/s Min: 9.01 MiB/s Max: 9.01 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 146 RPC/s Min: 146 RPC/s Max: 146 RPC/s [W] Avg: 290 RPC/s Min: 290 RPC/s Max: 290 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.99 MiB/s Min: 8.99 MiB/s Max: 8.99 MiB/s [LNet Rates of c] [R] Avg: 264 RPC/s Min: 264 RPC/s Max: 264 RPC/s [W] Avg: 133 RPC/s Min: 133 RPC/s Max: 133 RPC/s [LNet Bandwidth of c] [R] Avg: 8.18 MiB/s Min: 8.18 MiB/s Max: 8.18 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 134 RPC/s Min: 134 RPC/s Max: 134 RPC/s [W] Avg: 268 RPC/s Min: 268 RPC/s Max: 268 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.39 MiB/s Min: 8.39 MiB/s Max: 8.39 MiB/s [LNet Rates of c] [R] Avg: 427 RPC/s Min: 427 RPC/s Max: 427 RPC/s [W] Avg: 216 RPC/s Min: 216 RPC/s Max: 216 RPC/s [LNet Bandwidth of c] [R] Avg: 13.21 MiB/s Min: 13.21 MiB/s Max: 13.21 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 214 RPC/s Min: 214 RPC/s Max: 214 RPC/s [W] Avg: 426 RPC/s Min: 426 RPC/s Max: 426 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.21 MiB/s Min: 13.21 MiB/s Max: 13.21 MiB/s [LNet Rates of c] [R] Avg: 380 RPC/s Min: 380 RPC/s Max: 380 RPC/s [W] Avg: 192 RPC/s Min: 192 RPC/s Max: 192 RPC/s [LNet Bandwidth of c] [R] Avg: 11.81 MiB/s Min: 11.81 MiB/s Max: 11.81 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 205 RPC/s Min: 205 RPC/s Max: 205 RPC/s [W] Avg: 394 RPC/s Min: 394 RPC/s Max: 394 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.93 MiB/s Min: 11.93 MiB/s Max: 11.93 MiB/s [LNet Rates of c] [R] Avg: 343 RPC/s Min: 343 RPC/s Max: 343 RPC/s [W] Avg: 172 RPC/s Min: 172 RPC/s Max: 172 RPC/s [LNet Bandwidth of c] [R] Avg: 10.68 MiB/s Min: 10.68 MiB/s Max: 10.68 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 169 RPC/s Min: 169 RPC/s Max: 169 RPC/s [W] Avg: 339 RPC/s Min: 339 RPC/s Max: 339 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.56 MiB/s Min: 10.56 MiB/s Max: 10.56 MiB/s [LNet Rates of c] [R] Avg: 489 RPC/s Min: 489 RPC/s Max: 489 RPC/s [W] Avg: 246 RPC/s Min: 246 RPC/s Max: 246 RPC/s [LNet Bandwidth of c] [R] Avg: 15.23 MiB/s Min: 15.23 MiB/s Max: 15.23 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 244 RPC/s Min: 244 RPC/s Max: 244 RPC/s [W] Avg: 486 RPC/s Min: 486 RPC/s Max: 486 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.26 MiB/s Min: 15.26 MiB/s Max: 15.26 MiB/s [LNet Rates of c] [R] Avg: 265 RPC/s Min: 265 RPC/s Max: 265 RPC/s [W] Avg: 135 RPC/s Min: 135 RPC/s Max: 135 RPC/s [LNet Bandwidth of c] [R] Avg: 8.14 MiB/s Min: 8.14 MiB/s Max: 8.14 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 132 RPC/s Min: 132 RPC/s Max: 132 RPC/s [W] Avg: 262 RPC/s Min: 262 RPC/s Max: 262 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 8.13 MiB/s Min: 8.13 MiB/s Max: 8.13 MiB/s [LNet Rates of c] [R] Avg: 254 RPC/s Min: 254 RPC/s Max: 254 RPC/s [W] Avg: 127 RPC/s Min: 127 RPC/s Max: 127 RPC/s [LNet Bandwidth of c] [R] Avg: 7.95 MiB/s Min: 7.95 MiB/s Max: 7.95 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 128 RPC/s Min: 128 RPC/s Max: 128 RPC/s [W] Avg: 258 RPC/s Min: 258 RPC/s Max: 258 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 7.98 MiB/s Min: 7.98 MiB/s Max: 7.98 MiB/s 1 batch in stopping Batch is stopped === BRW read off=512 size=4k === Test was added successfully b_r_512_4k is running now [LNet Rates of c] [R] Avg: 507 RPC/s Min: 507 RPC/s Max: 507 RPC/s [W] Avg: 255 RPC/s Min: 255 RPC/s Max: 255 RPC/s [LNet Bandwidth of c] [R] Avg: 1.02 MiB/s Min: 1.02 MiB/s Max: 1.02 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 259 RPC/s Min: 259 RPC/s Max: 259 RPC/s [W] Avg: 509 RPC/s Min: 509 RPC/s Max: 509 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 1.03 MiB/s Min: 1.03 MiB/s Max: 1.03 MiB/s [LNet Rates of c] [R] Avg: 595 RPC/s Min: 595 RPC/s Max: 595 RPC/s [W] Avg: 299 RPC/s Min: 299 RPC/s Max: 299 RPC/s [LNet Bandwidth of c] [R] Avg: 1.21 MiB/s Min: 1.21 MiB/s Max: 1.21 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 298 RPC/s Min: 298 RPC/s Max: 298 RPC/s [W] Avg: 596 RPC/s Min: 596 RPC/s Max: 596 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.21 MiB/s Min: 1.21 MiB/s Max: 1.21 MiB/s [LNet Rates of c] [R] Avg: 600 RPC/s Min: 600 RPC/s Max: 600 RPC/s [W] Avg: 302 RPC/s Min: 302 RPC/s Max: 302 RPC/s [LNet Bandwidth of c] [R] Avg: 1.21 MiB/s Min: 1.21 MiB/s Max: 1.21 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 299 RPC/s Min: 299 RPC/s Max: 299 RPC/s [W] Avg: 601 RPC/s Min: 601 RPC/s Max: 601 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.22 MiB/s Min: 1.22 MiB/s Max: 1.22 MiB/s [LNet Rates of c] [R] Avg: 622 RPC/s Min: 622 RPC/s Max: 622 RPC/s [W] Avg: 313 RPC/s Min: 313 RPC/s Max: 313 RPC/s [LNet Bandwidth of c] [R] Avg: 1.26 MiB/s Min: 1.26 MiB/s Max: 1.26 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 313 RPC/s Min: 313 RPC/s Max: 313 RPC/s [W] Avg: 623 RPC/s Min: 623 RPC/s Max: 623 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.26 MiB/s Min: 1.26 MiB/s Max: 1.26 MiB/s [LNet Rates of c] [R] Avg: 1104 RPC/s Min: 1104 RPC/s Max: 1104 RPC/s [W] Avg: 553 RPC/s Min: 553 RPC/s Max: 553 RPC/s [LNet Bandwidth of c] [R] Avg: 2.24 MiB/s Min: 2.24 MiB/s Max: 2.24 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 567 RPC/s Min: 567 RPC/s Max: 567 RPC/s [W] Avg: 1117 RPC/s Min: 1117 RPC/s Max: 1117 RPC/s [LNet Bandwidth of s] [R] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [W] Avg: 2.23 MiB/s Min: 2.23 MiB/s Max: 2.23 MiB/s [LNet Rates of c] [R] Avg: 725 RPC/s Min: 725 RPC/s Max: 725 RPC/s [W] Avg: 363 RPC/s Min: 363 RPC/s Max: 363 RPC/s [LNet Bandwidth of c] [R] Avg: 1.47 MiB/s Min: 1.47 MiB/s Max: 1.47 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 359 RPC/s Min: 359 RPC/s Max: 359 RPC/s [W] Avg: 720 RPC/s Min: 720 RPC/s Max: 720 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.46 MiB/s Min: 1.46 MiB/s Max: 1.46 MiB/s [LNet Rates of c] [R] Avg: 913 RPC/s Min: 913 RPC/s Max: 913 RPC/s [W] Avg: 456 RPC/s Min: 456 RPC/s Max: 456 RPC/s [LNet Bandwidth of c] [R] Avg: 1.84 MiB/s Min: 1.84 MiB/s Max: 1.84 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 453 RPC/s Min: 453 RPC/s Max: 453 RPC/s [W] Avg: 900 RPC/s Min: 900 RPC/s Max: 900 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.82 MiB/s Min: 1.82 MiB/s Max: 1.82 MiB/s [LNet Rates of c] [R] Avg: 626 RPC/s Min: 626 RPC/s Max: 626 RPC/s [W] Avg: 317 RPC/s Min: 317 RPC/s Max: 317 RPC/s [LNet Bandwidth of c] [R] Avg: 1.26 MiB/s Min: 1.26 MiB/s Max: 1.26 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 314 RPC/s Min: 314 RPC/s Max: 314 RPC/s [W] Avg: 630 RPC/s Min: 630 RPC/s Max: 630 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.28 MiB/s Min: 1.28 MiB/s Max: 1.28 MiB/s [LNet Rates of c] [R] Avg: 834 RPC/s Min: 834 RPC/s Max: 834 RPC/s [W] Avg: 417 RPC/s Min: 417 RPC/s Max: 417 RPC/s [LNet Bandwidth of c] [R] Avg: 1.69 MiB/s Min: 1.69 MiB/s Max: 1.69 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 423 RPC/s Min: 423 RPC/s Max: 423 RPC/s [W] Avg: 842 RPC/s Min: 842 RPC/s Max: 842 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.70 MiB/s Min: 1.70 MiB/s Max: 1.70 MiB/s [LNet Rates of c] [R] Avg: 628 RPC/s Min: 628 RPC/s Max: 628 RPC/s [W] Avg: 318 RPC/s Min: 318 RPC/s Max: 318 RPC/s [LNet Bandwidth of c] [R] Avg: 1.27 MiB/s Min: 1.27 MiB/s Max: 1.27 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 327 RPC/s Min: 327 RPC/s Max: 327 RPC/s [W] Avg: 642 RPC/s Min: 642 RPC/s Max: 642 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.28 MiB/s Min: 1.28 MiB/s Max: 1.28 MiB/s 1 batch in stopping Batch is stopped === BRW read off=512 size=64k === Test was added successfully b_r_512_64k is running now [LNet Rates of c] [R] Avg: 384 RPC/s Min: 384 RPC/s Max: 384 RPC/s [W] Avg: 194 RPC/s Min: 194 RPC/s Max: 194 RPC/s [LNet Bandwidth of c] [R] Avg: 11.98 MiB/s Min: 11.98 MiB/s Max: 11.98 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 191 RPC/s Min: 191 RPC/s Max: 191 RPC/s [W] Avg: 385 RPC/s Min: 385 RPC/s Max: 385 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 12.04 MiB/s Min: 12.04 MiB/s Max: 12.04 MiB/s [LNet Rates of c] [R] Avg: 433 RPC/s Min: 433 RPC/s Max: 433 RPC/s [W] Avg: 219 RPC/s Min: 219 RPC/s Max: 219 RPC/s [LNet Bandwidth of c] [R] Avg: 13.43 MiB/s Min: 13.43 MiB/s Max: 13.43 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 221 RPC/s Min: 221 RPC/s Max: 221 RPC/s [W] Avg: 433 RPC/s Min: 433 RPC/s Max: 433 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.52 MiB/s Min: 13.52 MiB/s Max: 13.52 MiB/s [LNet Rates of c] [R] Avg: 320 RPC/s Min: 320 RPC/s Max: 320 RPC/s [W] Avg: 161 RPC/s Min: 161 RPC/s Max: 161 RPC/s [LNet Bandwidth of c] [R] Avg: 9.95 MiB/s Min: 9.95 MiB/s Max: 9.95 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 174 RPC/s Min: 174 RPC/s Max: 174 RPC/s [W] Avg: 335 RPC/s Min: 335 RPC/s Max: 335 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 9.96 MiB/s Min: 9.96 MiB/s Max: 9.96 MiB/s [LNet Rates of c] [R] Avg: 349 RPC/s Min: 349 RPC/s Max: 349 RPC/s [W] Avg: 177 RPC/s Min: 177 RPC/s Max: 177 RPC/s [LNet Bandwidth of c] [R] Avg: 10.79 MiB/s Min: 10.79 MiB/s Max: 10.79 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 175 RPC/s Min: 175 RPC/s Max: 175 RPC/s [W] Avg: 345 RPC/s Min: 345 RPC/s Max: 345 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.79 MiB/s Min: 10.79 MiB/s Max: 10.79 MiB/s [LNet Rates of c] [R] Avg: 370 RPC/s Min: 370 RPC/s Max: 370 RPC/s [W] Avg: 186 RPC/s Min: 186 RPC/s Max: 186 RPC/s [LNet Bandwidth of c] [R] Avg: 11.52 MiB/s Min: 11.52 MiB/s Max: 11.52 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 184 RPC/s Min: 184 RPC/s Max: 184 RPC/s [W] Avg: 370 RPC/s Min: 370 RPC/s Max: 370 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.60 MiB/s Min: 11.60 MiB/s Max: 11.60 MiB/s [LNet Rates of c] [R] Avg: 338 RPC/s Min: 338 RPC/s Max: 338 RPC/s [W] Avg: 169 RPC/s Min: 169 RPC/s Max: 169 RPC/s [LNet Bandwidth of c] [R] Avg: 10.56 MiB/s Min: 10.56 MiB/s Max: 10.56 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 167 RPC/s Min: 167 RPC/s Max: 167 RPC/s [W] Avg: 335 RPC/s Min: 335 RPC/s Max: 335 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.51 MiB/s Min: 10.51 MiB/s Max: 10.51 MiB/s [LNet Rates of c] [R] Avg: 500 RPC/s Min: 500 RPC/s Max: 500 RPC/s [W] Avg: 253 RPC/s Min: 253 RPC/s Max: 253 RPC/s [LNet Bandwidth of c] [R] Avg: 15.46 MiB/s Min: 15.46 MiB/s Max: 15.46 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 253 RPC/s Min: 253 RPC/s Max: 253 RPC/s [W] Avg: 498 RPC/s Min: 498 RPC/s Max: 498 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.40 MiB/s Min: 15.40 MiB/s Max: 15.40 MiB/s [LNet Rates of c] [R] Avg: 423 RPC/s Min: 423 RPC/s Max: 423 RPC/s [W] Avg: 212 RPC/s Min: 212 RPC/s Max: 212 RPC/s [LNet Bandwidth of c] [R] Avg: 13.17 MiB/s Min: 13.17 MiB/s Max: 13.17 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 222 RPC/s Min: 222 RPC/s Max: 222 RPC/s [W] Avg: 433 RPC/s Min: 433 RPC/s Max: 433 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.18 MiB/s Min: 13.18 MiB/s Max: 13.18 MiB/s [LNet Rates of c] [R] Avg: 471 RPC/s Min: 471 RPC/s Max: 471 RPC/s [W] Avg: 237 RPC/s Min: 237 RPC/s Max: 237 RPC/s [LNet Bandwidth of c] [R] Avg: 14.67 MiB/s Min: 14.67 MiB/s Max: 14.67 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 236 RPC/s Min: 236 RPC/s Max: 236 RPC/s [W] Avg: 470 RPC/s Min: 470 RPC/s Max: 470 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 14.72 MiB/s Min: 14.72 MiB/s Max: 14.72 MiB/s [LNet Rates of c] [R] Avg: 446 RPC/s Min: 446 RPC/s Max: 446 RPC/s [W] Avg: 225 RPC/s Min: 225 RPC/s Max: 225 RPC/s [LNet Bandwidth of c] [R] Avg: 13.88 MiB/s Min: 13.88 MiB/s Max: 13.88 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 221 RPC/s Min: 221 RPC/s Max: 221 RPC/s [W] Avg: 447 RPC/s Min: 447 RPC/s Max: 447 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.96 MiB/s Min: 13.96 MiB/s Max: 13.96 MiB/s Batch is stopped === BRW read off=1024 size=4k === Test was added successfully b_r_1024_4k is running now [LNet Rates of c] [R] Avg: 882 RPC/s Min: 882 RPC/s Max: 882 RPC/s [W] Avg: 443 RPC/s Min: 443 RPC/s Max: 443 RPC/s [LNet Bandwidth of c] [R] Avg: 1.79 MiB/s Min: 1.79 MiB/s Max: 1.79 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 438 RPC/s Min: 438 RPC/s Max: 438 RPC/s [W] Avg: 875 RPC/s Min: 875 RPC/s Max: 875 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.77 MiB/s Min: 1.77 MiB/s Max: 1.77 MiB/s [LNet Rates of c] [R] Avg: 589 RPC/s Min: 589 RPC/s Max: 589 RPC/s [W] Avg: 297 RPC/s Min: 297 RPC/s Max: 297 RPC/s [LNet Bandwidth of c] [R] Avg: 1.19 MiB/s Min: 1.19 MiB/s Max: 1.19 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 296 RPC/s Min: 296 RPC/s Max: 296 RPC/s [W] Avg: 591 RPC/s Min: 591 RPC/s Max: 591 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.19 MiB/s Min: 1.19 MiB/s Max: 1.19 MiB/s [LNet Rates of c] [R] Avg: 885 RPC/s Min: 885 RPC/s Max: 885 RPC/s [W] Avg: 443 RPC/s Min: 443 RPC/s Max: 443 RPC/s [LNet Bandwidth of c] [R] Avg: 1.79 MiB/s Min: 1.79 MiB/s Max: 1.79 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 458 RPC/s Min: 458 RPC/s Max: 458 RPC/s [W] Avg: 900 RPC/s Min: 900 RPC/s Max: 900 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.80 MiB/s Min: 1.80 MiB/s Max: 1.80 MiB/s [LNet Rates of c] [R] Avg: 1005 RPC/s Min: 1005 RPC/s Max: 1005 RPC/s [W] Avg: 504 RPC/s Min: 504 RPC/s Max: 504 RPC/s [LNet Bandwidth of c] [R] Avg: 2.03 MiB/s Min: 2.03 MiB/s Max: 2.03 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 499 RPC/s Min: 499 RPC/s Max: 499 RPC/s [W] Avg: 999 RPC/s Min: 999 RPC/s Max: 999 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.03 MiB/s Min: 2.03 MiB/s Max: 2.03 MiB/s [LNet Rates of c] [R] Avg: 1208 RPC/s Min: 1208 RPC/s Max: 1208 RPC/s [W] Avg: 607 RPC/s Min: 607 RPC/s Max: 607 RPC/s [LNet Bandwidth of c] [R] Avg: 2.44 MiB/s Min: 2.44 MiB/s Max: 2.44 MiB/s [W] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [LNet Rates of s] [R] Avg: 614 RPC/s Min: 614 RPC/s Max: 614 RPC/s [W] Avg: 1220 RPC/s Min: 1220 RPC/s Max: 1220 RPC/s [LNet Bandwidth of s] [R] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [W] Avg: 2.47 MiB/s Min: 2.47 MiB/s Max: 2.47 MiB/s [LNet Rates of c] [R] Avg: 929 RPC/s Min: 929 RPC/s Max: 929 RPC/s [W] Avg: 466 RPC/s Min: 466 RPC/s Max: 466 RPC/s [LNet Bandwidth of c] [R] Avg: 1.88 MiB/s Min: 1.88 MiB/s Max: 1.88 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 461 RPC/s Min: 461 RPC/s Max: 461 RPC/s [W] Avg: 929 RPC/s Min: 929 RPC/s Max: 929 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.88 MiB/s Min: 1.88 MiB/s Max: 1.88 MiB/s [LNet Rates of c] [R] Avg: 803 RPC/s Min: 803 RPC/s Max: 803 RPC/s [W] Avg: 403 RPC/s Min: 403 RPC/s Max: 403 RPC/s [LNet Bandwidth of c] [R] Avg: 1.62 MiB/s Min: 1.62 MiB/s Max: 1.62 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 398 RPC/s Min: 398 RPC/s Max: 398 RPC/s [W] Avg: 793 RPC/s Min: 793 RPC/s Max: 793 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.61 MiB/s Min: 1.61 MiB/s Max: 1.61 MiB/s [LNet Rates of c] [R] Avg: 630 RPC/s Min: 630 RPC/s Max: 630 RPC/s [W] Avg: 315 RPC/s Min: 315 RPC/s Max: 315 RPC/s [LNet Bandwidth of c] [R] Avg: 1.27 MiB/s Min: 1.27 MiB/s Max: 1.27 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 325 RPC/s Min: 325 RPC/s Max: 325 RPC/s [W] Avg: 635 RPC/s Min: 635 RPC/s Max: 635 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.26 MiB/s Min: 1.26 MiB/s Max: 1.26 MiB/s [LNet Rates of c] [R] Avg: 707 RPC/s Min: 707 RPC/s Max: 707 RPC/s [W] Avg: 356 RPC/s Min: 356 RPC/s Max: 356 RPC/s [LNet Bandwidth of c] [R] Avg: 1.43 MiB/s Min: 1.43 MiB/s Max: 1.43 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 355 RPC/s Min: 355 RPC/s Max: 355 RPC/s [W] Avg: 711 RPC/s Min: 711 RPC/s Max: 711 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 1.44 MiB/s Min: 1.44 MiB/s Max: 1.44 MiB/s [LNet Rates of c] [R] Avg: 750 RPC/s Min: 750 RPC/s Max: 750 RPC/s [W] Avg: 376 RPC/s Min: 376 RPC/s Max: 376 RPC/s [LNet Bandwidth of c] [R] Avg: 1.52 MiB/s Min: 1.52 MiB/s Max: 1.52 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 374 RPC/s Min: 374 RPC/s Max: 374 RPC/s [W] Avg: 748 RPC/s Min: 748 RPC/s Max: 748 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.52 MiB/s Min: 1.52 MiB/s Max: 1.52 MiB/s 1 batch in stopping Batch is stopped === BRW read off=1024 size=64k === Test was added successfully b_r_1024_64k is running now [LNet Rates of c] [R] Avg: 315 RPC/s Min: 315 RPC/s Max: 315 RPC/s [W] Avg: 156 RPC/s Min: 156 RPC/s Max: 156 RPC/s [LNet Bandwidth of c] [R] Avg: 9.76 MiB/s Min: 9.76 MiB/s Max: 9.76 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 160 RPC/s Min: 160 RPC/s Max: 160 RPC/s [W] Avg: 315 RPC/s Min: 315 RPC/s Max: 315 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.75 MiB/s Min: 9.75 MiB/s Max: 9.75 MiB/s [LNet Rates of c] [R] Avg: 402 RPC/s Min: 402 RPC/s Max: 402 RPC/s [W] Avg: 205 RPC/s Min: 205 RPC/s Max: 205 RPC/s [LNet Bandwidth of c] [R] Avg: 12.54 MiB/s Min: 12.54 MiB/s Max: 12.54 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 215 RPC/s Min: 215 RPC/s Max: 215 RPC/s [W] Avg: 415 RPC/s Min: 415 RPC/s Max: 415 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 12.53 MiB/s Min: 12.53 MiB/s Max: 12.53 MiB/s [LNet Rates of c] [R] Avg: 391 RPC/s Min: 391 RPC/s Max: 391 RPC/s [W] Avg: 198 RPC/s Min: 198 RPC/s Max: 198 RPC/s [LNet Bandwidth of c] [R] Avg: 12.13 MiB/s Min: 12.13 MiB/s Max: 12.13 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 193 RPC/s Min: 193 RPC/s Max: 193 RPC/s [W] Avg: 389 RPC/s Min: 389 RPC/s Max: 389 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 12.23 MiB/s Min: 12.23 MiB/s Max: 12.23 MiB/s [LNet Rates of c] [R] Avg: 429 RPC/s Min: 429 RPC/s Max: 429 RPC/s [W] Avg: 215 RPC/s Min: 215 RPC/s Max: 215 RPC/s [LNet Bandwidth of c] [R] Avg: 13.42 MiB/s Min: 13.42 MiB/s Max: 13.42 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 214 RPC/s Min: 214 RPC/s Max: 214 RPC/s [W] Avg: 423 RPC/s Min: 423 RPC/s Max: 423 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.14 MiB/s Min: 13.14 MiB/s Max: 13.14 MiB/s [LNet Rates of c] [R] Avg: 484 RPC/s Min: 484 RPC/s Max: 484 RPC/s [W] Avg: 245 RPC/s Min: 245 RPC/s Max: 245 RPC/s [LNet Bandwidth of c] [R] Avg: 15.02 MiB/s Min: 15.02 MiB/s Max: 15.02 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 244 RPC/s Min: 244 RPC/s Max: 244 RPC/s [W] Avg: 488 RPC/s Min: 488 RPC/s Max: 488 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.28 MiB/s Min: 15.28 MiB/s Max: 15.28 MiB/s [LNet Rates of c] [R] Avg: 393 RPC/s Min: 393 RPC/s Max: 393 RPC/s [W] Avg: 198 RPC/s Min: 198 RPC/s Max: 198 RPC/s [LNet Bandwidth of c] [R] Avg: 12.26 MiB/s Min: 12.26 MiB/s Max: 12.26 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 197 RPC/s Min: 197 RPC/s Max: 197 RPC/s [W] Avg: 397 RPC/s Min: 397 RPC/s Max: 397 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 12.36 MiB/s Min: 12.36 MiB/s Max: 12.36 MiB/s [LNet Rates of c] [R] Avg: 523 RPC/s Min: 523 RPC/s Max: 523 RPC/s [W] Avg: 264 RPC/s Min: 264 RPC/s Max: 264 RPC/s [LNet Bandwidth of c] [R] Avg: 16.26 MiB/s Min: 16.26 MiB/s Max: 16.26 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 275 RPC/s Min: 275 RPC/s Max: 275 RPC/s [W] Avg: 532 RPC/s Min: 532 RPC/s Max: 532 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 16.14 MiB/s Min: 16.14 MiB/s Max: 16.14 MiB/s [LNet Rates of c] [R] Avg: 497 RPC/s Min: 497 RPC/s Max: 497 RPC/s [W] Avg: 249 RPC/s Min: 249 RPC/s Max: 249 RPC/s [LNet Bandwidth of c] [R] Avg: 15.54 MiB/s Min: 15.54 MiB/s Max: 15.54 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 251 RPC/s Min: 251 RPC/s Max: 251 RPC/s [W] Avg: 499 RPC/s Min: 499 RPC/s Max: 499 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.60 MiB/s Min: 15.60 MiB/s Max: 15.60 MiB/s [LNet Rates of c] [R] Avg: 385 RPC/s Min: 385 RPC/s Max: 385 RPC/s [W] Avg: 194 RPC/s Min: 194 RPC/s Max: 194 RPC/s [LNet Bandwidth of c] [R] Avg: 11.93 MiB/s Min: 11.93 MiB/s Max: 11.93 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 188 RPC/s Min: 188 RPC/s Max: 188 RPC/s [W] Avg: 378 RPC/s Min: 378 RPC/s Max: 378 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 11.80 MiB/s Min: 11.80 MiB/s Max: 11.80 MiB/s [LNet Rates of c] [R] Avg: 445 RPC/s Min: 445 RPC/s Max: 445 RPC/s [W] Avg: 223 RPC/s Min: 223 RPC/s Max: 223 RPC/s [LNet Bandwidth of c] [R] Avg: 13.90 MiB/s Min: 13.90 MiB/s Max: 13.90 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 221 RPC/s Min: 221 RPC/s Max: 221 RPC/s [W] Avg: 447 RPC/s Min: 447 RPC/s Max: 447 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.99 MiB/s Min: 13.99 MiB/s Max: 13.99 MiB/s Batch is stopped === BRW read off=2048 size=4k === Test was added successfully b_r_2048_4k is running now [LNet Rates of c] [R] Avg: 667 RPC/s Min: 667 RPC/s Max: 667 RPC/s [W] Avg: 444 RPC/s Min: 444 RPC/s Max: 444 RPC/s [LNet Bandwidth of c] [R] Avg: 0.94 MiB/s Min: 0.94 MiB/s Max: 0.94 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 333 RPC/s Min: 333 RPC/s Max: 333 RPC/s [W] Avg: 667 RPC/s Min: 667 RPC/s Max: 667 RPC/s [LNet Bandwidth of s] [R] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [W] Avg: 0.73 MiB/s Min: 0.73 MiB/s Max: 0.73 MiB/s [LNet Rates of c] [R] Avg: 991 RPC/s Min: 991 RPC/s Max: 991 RPC/s [W] Avg: 497 RPC/s Min: 497 RPC/s Max: 497 RPC/s [LNet Bandwidth of c] [R] Avg: 2.01 MiB/s Min: 2.01 MiB/s Max: 2.01 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 497 RPC/s Min: 497 RPC/s Max: 497 RPC/s [W] Avg: 992 RPC/s Min: 992 RPC/s Max: 992 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.01 MiB/s Min: 2.01 MiB/s Max: 2.01 MiB/s [LNet Rates of c] [R] Avg: 729 RPC/s Min: 729 RPC/s Max: 729 RPC/s [W] Avg: 366 RPC/s Min: 366 RPC/s Max: 366 RPC/s [LNet Bandwidth of c] [R] Avg: 1.47 MiB/s Min: 1.47 MiB/s Max: 1.47 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 379 RPC/s Min: 379 RPC/s Max: 379 RPC/s [W] Avg: 739 RPC/s Min: 739 RPC/s Max: 739 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.47 MiB/s Min: 1.47 MiB/s Max: 1.47 MiB/s [LNet Rates of c] [R] Avg: 959 RPC/s Min: 959 RPC/s Max: 959 RPC/s [W] Avg: 481 RPC/s Min: 481 RPC/s Max: 481 RPC/s [LNet Bandwidth of c] [R] Avg: 1.94 MiB/s Min: 1.94 MiB/s Max: 1.94 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 469 RPC/s Min: 469 RPC/s Max: 469 RPC/s [W] Avg: 942 RPC/s Min: 942 RPC/s Max: 942 RPC/s [LNet Bandwidth of s] [R] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [W] Avg: 1.92 MiB/s Min: 1.92 MiB/s Max: 1.92 MiB/s [LNet Rates of c] [R] Avg: 710 RPC/s Min: 710 RPC/s Max: 710 RPC/s [W] Avg: 357 RPC/s Min: 357 RPC/s Max: 357 RPC/s [LNet Bandwidth of c] [R] Avg: 1.43 MiB/s Min: 1.43 MiB/s Max: 1.43 MiB/s [W] Avg: 0.05 MiB/s Min: 0.05 MiB/s Max: 0.05 MiB/s [LNet Rates of s] [R] Avg: 364 RPC/s Min: 364 RPC/s Max: 364 RPC/s [W] Avg: 723 RPC/s Min: 723 RPC/s Max: 723 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.46 MiB/s Min: 1.46 MiB/s Max: 1.46 MiB/s [LNet Rates of c] [R] Avg: 995 RPC/s Min: 995 RPC/s Max: 995 RPC/s [W] Avg: 499 RPC/s Min: 499 RPC/s Max: 499 RPC/s [LNet Bandwidth of c] [R] Avg: 2.01 MiB/s Min: 2.01 MiB/s Max: 2.01 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 496 RPC/s Min: 496 RPC/s Max: 496 RPC/s [W] Avg: 998 RPC/s Min: 998 RPC/s Max: 998 RPC/s [LNet Bandwidth of s] [R] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [W] Avg: 2.02 MiB/s Min: 2.02 MiB/s Max: 2.02 MiB/s [LNet Rates of c] [R] Avg: 808 RPC/s Min: 808 RPC/s Max: 808 RPC/s [W] Avg: 404 RPC/s Min: 404 RPC/s Max: 404 RPC/s [LNet Bandwidth of c] [R] Avg: 1.64 MiB/s Min: 1.64 MiB/s Max: 1.64 MiB/s [W] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [LNet Rates of s] [R] Avg: 402 RPC/s Min: 402 RPC/s Max: 402 RPC/s [W] Avg: 798 RPC/s Min: 798 RPC/s Max: 798 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.61 MiB/s Min: 1.61 MiB/s Max: 1.61 MiB/s [LNet Rates of c] [R] Avg: 1090 RPC/s Min: 1090 RPC/s Max: 1090 RPC/s [W] Avg: 548 RPC/s Min: 548 RPC/s Max: 548 RPC/s [LNet Bandwidth of c] [R] Avg: 2.20 MiB/s Min: 2.20 MiB/s Max: 2.20 MiB/s [W] Avg: 0.08 MiB/s Min: 0.08 MiB/s Max: 0.08 MiB/s [LNet Rates of s] [R] Avg: 565 RPC/s Min: 565 RPC/s Max: 565 RPC/s [W] Avg: 1113 RPC/s Min: 1113 RPC/s Max: 1113 RPC/s [LNet Bandwidth of s] [R] Avg: 0.09 MiB/s Min: 0.09 MiB/s Max: 0.09 MiB/s [W] Avg: 2.23 MiB/s Min: 2.23 MiB/s Max: 2.23 MiB/s [LNet Rates of c] [R] Avg: 865 RPC/s Min: 865 RPC/s Max: 865 RPC/s [W] Avg: 434 RPC/s Min: 434 RPC/s Max: 434 RPC/s [LNet Bandwidth of c] [R] Avg: 1.75 MiB/s Min: 1.75 MiB/s Max: 1.75 MiB/s [W] Avg: 0.07 MiB/s Min: 0.07 MiB/s Max: 0.07 MiB/s [LNet Rates of s] [R] Avg: 426 RPC/s Min: 426 RPC/s Max: 426 RPC/s [W] Avg: 855 RPC/s Min: 855 RPC/s Max: 855 RPC/s [LNet Bandwidth of s] [R] Avg: 0.06 MiB/s Min: 0.06 MiB/s Max: 0.06 MiB/s [W] Avg: 1.74 MiB/s Min: 1.74 MiB/s Max: 1.74 MiB/s [LNet Rates of c] [R] Avg: 537 RPC/s Min: 537 RPC/s Max: 537 RPC/s [W] Avg: 266 RPC/s Min: 266 RPC/s Max: 266 RPC/s [LNet Bandwidth of c] [R] Avg: 1.08 MiB/s Min: 1.08 MiB/s Max: 1.08 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 266 RPC/s Min: 266 RPC/s Max: 266 RPC/s [W] Avg: 530 RPC/s Min: 530 RPC/s Max: 530 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 1.08 MiB/s Min: 1.08 MiB/s Max: 1.08 MiB/s 1 batch in stopping Batch is stopped === BRW read off=2048 size=64k === Test was added successfully b_r_2048_64k is running now [LNet Rates of c] [R] Avg: 328 RPC/s Min: 328 RPC/s Max: 328 RPC/s [W] Avg: 165 RPC/s Min: 165 RPC/s Max: 165 RPC/s [LNet Bandwidth of c] [R] Avg: 10.22 MiB/s Min: 10.22 MiB/s Max: 10.22 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 163 RPC/s Min: 163 RPC/s Max: 163 RPC/s [W] Avg: 324 RPC/s Min: 324 RPC/s Max: 324 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.07 MiB/s Min: 10.07 MiB/s Max: 10.07 MiB/s [LNet Rates of c] [R] Avg: 289 RPC/s Min: 289 RPC/s Max: 289 RPC/s [W] Avg: 147 RPC/s Min: 147 RPC/s Max: 147 RPC/s [LNet Bandwidth of c] [R] Avg: 8.90 MiB/s Min: 8.90 MiB/s Max: 8.90 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 158 RPC/s Min: 158 RPC/s Max: 158 RPC/s [W] Avg: 298 RPC/s Min: 298 RPC/s Max: 298 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 8.94 MiB/s Min: 8.94 MiB/s Max: 8.94 MiB/s [LNet Rates of c] [R] Avg: 472 RPC/s Min: 472 RPC/s Max: 472 RPC/s [W] Avg: 238 RPC/s Min: 238 RPC/s Max: 238 RPC/s [LNet Bandwidth of c] [R] Avg: 14.67 MiB/s Min: 14.67 MiB/s Max: 14.67 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 241 RPC/s Min: 241 RPC/s Max: 241 RPC/s [W] Avg: 481 RPC/s Min: 481 RPC/s Max: 481 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 15.02 MiB/s Min: 15.02 MiB/s Max: 15.02 MiB/s [LNet Rates of c] [R] Avg: 475 RPC/s Min: 475 RPC/s Max: 475 RPC/s [W] Avg: 237 RPC/s Min: 237 RPC/s Max: 237 RPC/s [LNet Bandwidth of c] [R] Avg: 14.81 MiB/s Min: 14.81 MiB/s Max: 14.81 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 231 RPC/s Min: 231 RPC/s Max: 231 RPC/s [W] Avg: 467 RPC/s Min: 467 RPC/s Max: 467 RPC/s [LNet Bandwidth of s] [R] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [W] Avg: 14.59 MiB/s Min: 14.59 MiB/s Max: 14.59 MiB/s [LNet Rates of c] [R] Avg: 455 RPC/s Min: 455 RPC/s Max: 455 RPC/s [W] Avg: 230 RPC/s Min: 230 RPC/s Max: 230 RPC/s [LNet Bandwidth of c] [R] Avg: 14.13 MiB/s Min: 14.13 MiB/s Max: 14.13 MiB/s [W] Avg: 0.04 MiB/s Min: 0.04 MiB/s Max: 0.04 MiB/s [LNet Rates of s] [R] Avg: 226 RPC/s Min: 226 RPC/s Max: 226 RPC/s [W] Avg: 446 RPC/s Min: 446 RPC/s Max: 446 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 13.94 MiB/s Min: 13.94 MiB/s Max: 13.94 MiB/s [LNet Rates of c] [R] Avg: 304 RPC/s Min: 304 RPC/s Max: 304 RPC/s [W] Avg: 153 RPC/s Min: 153 RPC/s Max: 153 RPC/s [LNet Bandwidth of c] [R] Avg: 9.50 MiB/s Min: 9.50 MiB/s Max: 9.50 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 153 RPC/s Min: 153 RPC/s Max: 153 RPC/s [W] Avg: 308 RPC/s Min: 308 RPC/s Max: 308 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.55 MiB/s Min: 9.55 MiB/s Max: 9.55 MiB/s [LNet Rates of c] [R] Avg: 348 RPC/s Min: 348 RPC/s Max: 348 RPC/s [W] Avg: 175 RPC/s Min: 175 RPC/s Max: 175 RPC/s [LNet Bandwidth of c] [R] Avg: 10.85 MiB/s Min: 10.85 MiB/s Max: 10.85 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 187 RPC/s Min: 187 RPC/s Max: 187 RPC/s [W] Avg: 357 RPC/s Min: 357 RPC/s Max: 357 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.77 MiB/s Min: 10.77 MiB/s Max: 10.77 MiB/s [LNet Rates of c] [R] Avg: 356 RPC/s Min: 356 RPC/s Max: 356 RPC/s [W] Avg: 181 RPC/s Min: 181 RPC/s Max: 181 RPC/s [LNet Bandwidth of c] [R] Avg: 10.98 MiB/s Min: 10.98 MiB/s Max: 10.98 MiB/s [W] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [LNet Rates of s] [R] Avg: 177 RPC/s Min: 177 RPC/s Max: 177 RPC/s [W] Avg: 353 RPC/s Min: 353 RPC/s Max: 353 RPC/s [LNet Bandwidth of s] [R] Avg: 0.03 MiB/s Min: 0.03 MiB/s Max: 0.03 MiB/s [W] Avg: 10.99 MiB/s Min: 10.99 MiB/s Max: 10.99 MiB/s [LNet Rates of c] [R] Avg: 291 RPC/s Min: 291 RPC/s Max: 291 RPC/s [W] Avg: 147 RPC/s Min: 147 RPC/s Max: 147 RPC/s [LNet Bandwidth of c] [R] Avg: 9.01 MiB/s Min: 9.01 MiB/s Max: 9.01 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 141 RPC/s Min: 141 RPC/s Max: 141 RPC/s [W] Avg: 286 RPC/s Min: 286 RPC/s Max: 286 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.04 MiB/s Min: 9.04 MiB/s Max: 9.04 MiB/s [LNet Rates of c] [R] Avg: 292 RPC/s Min: 292 RPC/s Max: 292 RPC/s [W] Avg: 147 RPC/s Min: 147 RPC/s Max: 147 RPC/s [LNet Bandwidth of c] [R] Avg: 9.09 MiB/s Min: 9.09 MiB/s Max: 9.09 MiB/s [W] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [LNet Rates of s] [R] Avg: 148 RPC/s Min: 148 RPC/s Max: 148 RPC/s [W] Avg: 294 RPC/s Min: 294 RPC/s Max: 294 RPC/s [LNet Bandwidth of s] [R] Avg: 0.02 MiB/s Min: 0.02 MiB/s Max: 0.02 MiB/s [W] Avg: 9.10 MiB/s Min: 9.10 MiB/s Max: 9.10 MiB/s 1 batch in stopping Batch is stopped c: Total 0 error nodes in c s: Total 0 error nodes in s Total 0 error nodes in c Total 0 error nodes in s === BRW write off=2048 size=1M (off+len > LNET_MTU) === operation add test failed on 0-200@<203:43200>: Invalid argument === BRW read off=4096 size=4k (rejected) === operation add test failed on 0-200@<203:43200>: Invalid argument oleg354-client: oleg354-client.virtnet: executing lst_cleanup oleg354-server: oleg354-server.virtnet: executing lst_cleanup