== sanityn test 77ub: Testing for TBF rate control in BPS performance mode ========================================================== 17:58:26 (1788818306) ost.OSS.ost_io.nrs_policies=tbf nid+opcode ost.OSS.ost_io.nrs_tbf_rule=start nidrd nid={0@lo 192.168.201.53@tcp}&opcode={ost_read} bps=5 ost.OSS.ost_io.nrs_tbf_rule=start nidwr nid={0@lo 192.168.201.53@tcp}&opcode={ost_write} bps=15 ost.OSS.ost_io.nrs_tbf_rule= regular_requests: CPT 0: nidwr nid={0@lo 192.168.201.53@tcp}&opcode={ost_write} 15, seq 3, type=nid+opcode, ref 0 bps=15728640 nidrd nid={0@lo 192.168.201.53@tcp}&opcode={ost_read} 5, seq 2, type=nid+opcode, ref 0 bps=5242880 default * 10000, seq 1, type=nid+opcode, ref 0 high_priority_requests: CPT 0: nidwr nid={0@lo 192.168.201.53@tcp}&opcode={ost_write} 15, seq 3, type=nid+opcode, ref 0 bps=15728640 nidrd nid={0@lo 192.168.201.53@tcp}&opcode={ost_read} 5, seq 2, type=nid+opcode, ref 0 bps=5242880 default * 10000, seq 1, type=nid+opcode, ref 0 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 1.31422 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0855562 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125875 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.177672 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.186592 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.372568 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.449478 s, 2.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.493968 s, 2.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.556329 s, 1.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.641401 s, 1.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.680069 s, 1.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.735106 s, 1.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.685022 s, 1.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.735149 s, 1.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.713995 s, 1.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.73806 s, 1.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.842601 s, 1.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.325209 s, 3.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.334706 s, 3.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.351661 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.312215 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.324207 s, 3.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.364997 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.320938 s, 3.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.367192 s, 2.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.366201 s, 2.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.352047 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.377842 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.361264 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.359669 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.360198 s, 2.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.356299 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.394062 s, 2.7 MB/s removed '/mnt/lustre/d77ub.sanityn/nrs_r_oleg153-client.virtnet' removed '/mnt/lustre/d77ub.sanityn/nrs_w_oleg153-client.virtnet' removed directory '/mnt/lustre/d77ub.sanityn' not_under_control: 0 cpu_npartitions on ost1 is 1 Limited write rate: 15, read rate: 5, bs: 4096 Verify the write rate is under TBF control 25600+0 records in 25600+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 1682.41 s, 62.3 kB/s Write runtime is 1683 s, speed is .059417 vs. 15 Verify the read rate is under TBF control 25600+0 records in 25600+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 205.323 s, 511 kB/s Read runtime is 207 s, speed is .483091 vs. 5 cleanup_tbf /mnt/lustre/d77ub.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete not_under_control: 0 cpu_npartitions on ost1 is 1 Limited write rate: 15, read rate: 5, bs: 65536 Verify the write rate is under TBF control 1600+0 records in 1600+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 138.396 s, 758 kB/s Write runtime is 139 s, speed is .719424 vs. 15 Verify the read rate is under TBF control 1600+0 records in 1600+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 28.9016 s, 3.6 MB/s Read runtime is 30 s, speed is 3.333333 vs. 5 cleanup_tbf /mnt/lustre/d77ub.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete not_under_control: 0 cpu_npartitions on ost1 is 1 Limited write rate: 15, read rate: 5, bs: 131072 Verify the write rate is under TBF control 800+0 records in 800+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 46.7457 s, 2.2 MB/s Write runtime is 48 s, speed is 2.083333 vs. 15 Verify the read rate is under TBF control 800+0 records in 800+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 24.2016 s, 4.3 MB/s Read runtime is 25 s, speed is 4.000000 vs. 5 cleanup_tbf /mnt/lustre/d77ub.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete not_under_control: 0 cpu_npartitions on ost1 is 1 Limited write rate: 15, read rate: 5, bs: 262144 Verify the write rate is under TBF control 400+0 records in 400+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 32.2436 s, 3.3 MB/s Write runtime is 33 s, speed is 3.030303 vs. 15 Verify the read rate is under TBF control 400+0 records in 400+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 21.0789 s, 5.0 MB/s Read runtime is 22 s, speed is 4.545454 vs. 5 cleanup_tbf /mnt/lustre/d77ub.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete not_under_control: 0 cpu_npartitions on ost1 is 1 Limited write rate: 15, read rate: 5, bs: 1048576 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 10.0442 s, 10.4 MB/s Write runtime is 11 s, speed is 9.090909 vs. 15 Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 20.023 s, 5.2 MB/s Read runtime is 21 s, speed is 4.761904 vs. 5 cleanup_tbf /mnt/lustre/d77ub.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete Cleanup TBF ost.OSS.ost_io.nrs_tbf_rule=stop nidrd ost.OSS.ost_io.nrs_tbf_rule=stop nidwr ost.OSS.ost_io.nrs_policies=fifo Cleanup TBF ost.OSS.ost_io.nrs_policies=fifo