== sanityn test 77ti: TBF: a late rule reaches a class bucket that exists ========================================================== 16:56:15 (1789764975)
ost.OSS.ost_io.nrs_policies=tbf uid classify=dynamic allow=uid
ost.OSS.ost_io.nrs_tbf_rule=start r5000 uid={5000} rate=1000
ost.OSS.ost_io.nrs_tbf_rule=start r5001 uid={5001} rate=1000
ost.OSS.ost_io.nrs_tbf_rule=start r5002 uid={5002} rate=1000
ost.OSS.ost_io.nrs_tbf_rule=start r5003 uid={5003} rate=1000
ost.OSS.ost_io.nrs_tbf_rule=start r5004 uid={5004} rate=1000
ost.OSS.ost_io.nrs_tbf_rule=start r5005 uid={5005} rate=1000
ost.OSS.ost_io.nrs_tbf_rule=start r5006 uid={5006} rate=1000
ost.OSS.ost_io.nrs_tbf_rule=start r5007 uid={5007} rate=1000
ost.OSS.ost_io.nrs_tbf_rule=start r5008 uid={5008} rate=1000
ost.OSS.ost_io.nrs_tbf_rule=start r5009 uid={5009} rate=1000
ost.OSS.ost_io.nrs_tbf_rule=start r5010 uid={5010} rate=1000
ost.OSS.ost_io.nrs_tbf_rule=start r5011 uid={5011} rate=1000
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ti.sanityn/nrs_r_oleg329-client.virtnet] [bs=1M] [count=16]
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.530628 s, 31.6 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_w]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0785783 s, 13.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.070584 s, 14.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0603247 s, 17.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0415938 s, 25.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305274 s, 34.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.1367 s, 7.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135288 s, 7.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0813309 s, 12.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141457 s, 7.4 MB/s
ldlm.namespaces.lustre-OST0001-osc-ffff8bd04a163800.lock_unused_count=3
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217899 s, 48.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.212668 s, 4.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.146074 s, 7.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125991 s, 8.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0800815 s, 13.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180637 s, 5.8 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_r]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.252248 s, 4.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211614 s, 49.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.061111 s, 17.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0576978 s, 18.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0677528 s, 15.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0391607 s, 26.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0441611 s, 23.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.051153 s, 20.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0683412 s, 15.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0679235 s, 15.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0477429 s, 22.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0543185 s, 19.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0502055 s, 20.9 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff8bd04a163800.lock_unused_count=1
ldlm.namespaces.lustre-OST0001-osc-ffff8bd04a163800.lock_unused_count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0550844 s, 19.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0792142 s, 13.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0796255 s, 13.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0829419 s, 12.6 MB/s
removed '/mnt/lustre/d77ti.sanityn/nrs_r_oleg329-client.virtnet'
removed '/mnt/lustre/d77ti.sanityn/nrs_w_oleg329-client.virtnet'
removed directory '/mnt/lustre/d77ti.sanityn'
ost.OSS.ost_io.nrs_tbf_rule=start late uid={500} rate=2
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 2, read rate: 2
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ti.sanityn/tbf] [bs=1M] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 48.8044 s, 2.1 MB/s
Write runtime is 50 s, speed is 2.000000 IOPS
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77ti.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 49.8854 s, 2.1 MB/s
Read runtime is 51 s, speed is 1.960784 IOPS
cleanup_tbf /mnt/lustre/d77ti.sanityn
sleep 5 for ZFS MDS
sleep 5 for ZFS OST
Waiting for MDT destroys to complete
Cleanup TBF
ost.OSS.ost_io.nrs_policies=fifo