-----============= acceptance-small: sanityn ============----- Mon Sep  7 18:53:50 EDT 2026
MGS_OS_ID_LIKE=rhel centos fedora rocky
MGS_OS_VERSION_ID=8.10
MGS_OS_ID=rocky
MGS_OS_VERSION_CODE=134873088
MDS1_OS_VERSION_ID=8.10
MDS1_OS_VERSION_CODE=134873088
MDS1_OS_ID_LIKE=rhel centos fedora rocky
MDS1_OS_ID=rocky
OST1_OS_VERSION_CODE=134873088
OST1_OS_ID_LIKE=rhel centos fedora rocky
OST1_OS_VERSION_ID=8.10
OST1_OS_ID=rocky
CLIENT_OS_ID=rocky
CLIENT_OS_VERSION_CODE=134873088
CLIENT_OS_VERSION_ID=8.10
CLIENT_OS_ID_LIKE=rhel centos fedora rocky
oleg133-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory
excepting tests: 40a
skipping tests SLOW=no: 33a
=== sanityn: start setup 18:54:12 (1788821652) ===
Starting client oleg133-client.virtnet:  -o user_xattr,flock 192.168.201.133@tcp:/lustre /mnt/lustre2
Mount client oleg133-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.201.133@tcp:/lustre /mnt/lustre2
Started clients oleg133-client.virtnet: 
192.168.201.133@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose)
oleg133-client.virtnet: executing check_config_client /mnt/lustre
oleg133-client.virtnet: Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients oleg133-client.virtnet environments
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8a33469fd000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8a33478f9800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8a33469fd000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8a33478f9800.idle_timeout=debug
disable quota as required
oleg133-server: oleg133-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
osd-ldiskfs.track_declares_assert=1
=== sanityn: finish setup 18:54:56 (1788821696) ===
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197303 s, 53.1 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [true]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d0_runas_test/f8251]

== sanityn test 77j: check TBF-OPCode NRS policy ========= 18:54:59 (1788821699)
jobid_var=procname_uid
ost.OSS.ost_io.nrs_policies=tbf opcode
ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5
ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.426438 s, 39.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0887564 s, 11.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152892 s, 6.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104356 s, 10.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.15488 s, 6.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.215539 s, 4.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.184875 s, 5.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.282828 s, 3.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.174129 s, 6.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.385166 s, 2.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.193694 s, 5.4 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff8a33469fd000.lock_unused_count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.386514 s, 2.7 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553599 s, 189 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.095012 s, 11.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110173 s, 95.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.176836 s, 5.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245044 s, 42.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.053143 s, 19.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.056575 s, 18.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00223585 s, 469 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.1683 s, 6.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00247816 s, 423 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00261421 s, 401 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195057 s, 53.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158876 s, 66.0 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0685748 s, 15.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00406945 s, 258 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260039 s, 40.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.740416 s, 1.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.633481 s, 1.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.768896 s, 1.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.599014 s, 1.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.633986 s, 1.7 MB/s
removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg133-client.virtnet'
removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg133-client.virtnet'
removed directory '/mnt/lustre/d77j.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 5, bs: 1048576
Verify the write rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.47262 s, 19.2 MB/s
Write runtime is 7 s, speed is 14.285714 vs. 20
Verify the read rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 19.6396 s, 5.3 MB/s
Read runtime is 20 s, speed is 5.000000 vs. 5
cleanup_tbf /mnt/lustre/d77j.sanityn
Waiting for MDT destroys to complete
ost.OSS.ost_io.nrs_tbf_rule=stop ost_r
ost.OSS.ost_io.nrs_tbf_rule=stop ost_w
ost.OSS.ost_io.nrs_policies=fifo
PASS 77j (55s)

== sanityn test 77k: check TBF policy with UID/GID/JobID/OPCode expression ========================================================== 18:55:54 (1788821754)
ost.OSS.ost_io.nrs_policies=tbf jobid+opcode+nid+uid+gid
ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20
ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg133-client.virtnet] [bs=1M] [count=16]
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.288563 s, 58.1 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_w]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0954771 s, 11.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0899457 s, 11.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152632 s, 6.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137091 s, 7.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0800086 s, 13.1 MB/s1+0 records in
1+0 records out

1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0946961 s, 11.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11605 s, 9.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.243163 s, 4.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129364 s, 8.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.16243 s, 6.5 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_r]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.300028 s, 3.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.380739 s, 2.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.381364 s, 2.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00410353 s, 256 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00829827 s, 126 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.158958 s, 6.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0852952 s, 12.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.051117 s, 20.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0561005 s, 18.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.074856 s, 14.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.401455 s, 2.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.463369 s, 2.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0047324 s, 222 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00539365 s, 194 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00338171 s, 310 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.547921 s, 1.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00469335 s, 223 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00340186 s, 308 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134881 s, 77.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679508 s, 154 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317786 s, 33.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607022 s, 173 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff8a33469fd000.lock_unused_count=1
ldlm.namespaces.lustre-OST0001-osc-ffff8a33469fd000.lock_unused_count=6
removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg133-client.virtnet'
removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg133-client.virtnet'
removed directory '/mnt/lustre/d77k.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 10, bs: 1048576
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1048576] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.96202 s, 17.6 MB/s
Write runtime is 7 s, speed is 14.285714 vs. 20
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1048576] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 9.96846 s, 10.5 MB/s
Read runtime is 11 s, speed is 9.090909 vs. 10
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
ost.OSS.ost_io.nrs_tbf_rule=stop ext_w
ost.OSS.ost_io.nrs_tbf_rule=stop ext_r
ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.201.33@tcp}&opcode={ost_write} rate=20
ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.201.33@tcp}&opcode={ost_read} rate=10
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.949029 s, 17.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148871 s, 7.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.167222 s, 6.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.314959 s, 3.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.214599 s, 4.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.316124 s, 3.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.320203 s, 3.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.487369 s, 2.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.487906 s, 2.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.389844 s, 2.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.485764 s, 2.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.492315 s, 2.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.465522 s, 2.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.573299 s, 1.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.491447 s, 2.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.583023 s, 1.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.664279 s, 1.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0605157 s, 17.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0424059 s, 24.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.056555 s, 18.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0544802 s, 19.2 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0652725 s, 16.1 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111215 s, 9.4 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163332 s, 6.4 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0810836 s, 12.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00302702 s, 346 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109698 s, 9.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014193 s, 73.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.318689 s, 3.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00313449 s, 335 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.233988 s, 4.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0628725 s, 16.7 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201225 s, 52.1 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff8a33469fd000.lock_unused_count=4
ldlm.namespaces.lustre-OST0001-osc-ffff8a33469fd000.lock_unused_count=1
removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg133-client.virtnet'
removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg133-client.virtnet'
removed directory '/mnt/lustre/d77k.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 10, bs: 1048576
Verify the write rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.36928 s, 19.5 MB/s
Write runtime is 7 s, speed is 14.285714 vs. 20
Verify the read rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 9.87461 s, 10.6 MB/s
Read runtime is 11 s, speed is 9.090909 vs. 10
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
ost.OSS.ost_io.nrs_tbf_rule=stop ext_w
ost.OSS.ost_io.nrs_tbf_rule=stop ext_r
ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.201.33@tcp}&jobid={dd.500} rate=20
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg133-client.virtnet] [bs=1M] [count=16]
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.386161 s, 43.4 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_w]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0347975 s, 30.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0825861 s, 12.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105507 s, 9.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.039982 s, 26.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.201849 s, 5.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163054 s, 6.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.164819 s, 6.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.217282 s, 4.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.233975 s, 4.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.209526 s, 5.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.26604 s, 3.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.206513 s, 5.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.255367 s, 4.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.255387 s, 4.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.218767 s, 4.8 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff8a33469fd000.lock_unused_count=5
ldlm.namespaces.lustre-OST0001-osc-ffff8a33469fd000.lock_unused_count=1
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_r]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.238552 s, 4.4 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0750021 s, 14.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596039 s, 176 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210431 s, 49.8 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0505838 s, 20.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00371317 s, 282 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00293751 s, 357 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204198 s, 51.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255558 s, 41.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0439042 s, 23.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0050629 s, 207 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114554 s, 91.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127764 s, 82.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00441939 s, 237 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120214 s, 87.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175218 s, 59.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985372 s, 106 MB/s
removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg133-client.virtnet'
removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg133-client.virtnet'
removed directory '/mnt/lustre/d77k.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 20, bs: 1048576
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1048576] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.31443 s, 19.7 MB/s
Write runtime is 6 s, speed is 16.666666 vs. 20
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1048576] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.29975 s, 19.8 MB/s
Read runtime is 6 s, speed is 16.666666 vs. 20
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
ost.OSS.ost_io.nrs_tbf_rule=stop ext
ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20
ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg133-client.virtnet] [bs=1M] [count=16]
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.348872 s, 48.1 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_w]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0472804 s, 22.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0403682 s, 26.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.052168 s, 20.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.138584 s, 7.6 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.164406 s, 6.4 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.193541 s, 5.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.19379 s, 5.4 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.202473 s, 5.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.207622 s, 5.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.211979 s, 4.9 MB/s1+0 records in
1+0 records out

1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.217614 s, 4.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.210564 s, 5.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.227555 s, 4.6 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.226933 s, 4.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.211956 s, 4.9 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_r]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.192537 s, 5.4 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.149246 s, 7.0 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0384122 s, 27.3 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793195 s, 132 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00198875 s, 527 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0715297 s, 14.7 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0405185 s, 25.9 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.127596 s, 8.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0600552 s, 17.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0371499 s, 28.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131509 s, 8.0 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0587648 s, 17.8 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0629233 s, 16.7 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.052276 s, 20.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141456 s, 7.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0716075 s, 14.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.17768 s, 5.9 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff8a33469fd000.lock_unused_count=4
ldlm.namespaces.lustre-OST0001-osc-ffff8a33469fd000.lock_unused_count=1
removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg133-client.virtnet'
removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg133-client.virtnet'
removed directory '/mnt/lustre/d77k.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 10, read rate: 10, bs: 1048576
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1048576] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 9.95073 s, 10.5 MB/s
Write runtime is 11 s, speed is 9.090909 vs. 10
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1048576] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 9.96409 s, 10.5 MB/s
Read runtime is 11 s, speed is 9.090909 vs. 10
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 10, bs: 1048576
Verify the write rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.217 s, 20.1 MB/s
Write runtime is 6 s, speed is 16.666666 vs. 20
Verify the read rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 10.0149 s, 10.5 MB/s
Read runtime is 11 s, speed is 9.090909 vs. 10
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
ost.OSS.ost_io.nrs_tbf_rule=stop ext_a
ost.OSS.ost_io.nrs_tbf_rule=stop ext_b
ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={500} rate=5
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg133-client.virtnet] [bs=1M] [count=16]
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.820897 s, 20.4 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_w]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0978889 s, 10.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103602 s, 10.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.202018 s, 5.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.320657 s, 3.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.331119 s, 3.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.336556 s, 3.1 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_r]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.341968 s, 3.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.374033 s, 2.8 MB/s1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.295385 s, 3.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.300778 s, 3.5 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.345444 s, 3.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.364237 s, 2.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.42973 s, 2.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.39181 s, 2.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.423069 s, 2.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.452248 s, 2.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970216 s, 108 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0782187 s, 13.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104898 s, 10.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0920408 s, 11.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690499 s, 152 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.192348 s, 5.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155654 s, 6.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0565164 s, 18.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.044449 s, 23.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0421432 s, 24.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.033444 s, 31.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015655 s, 67.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326863 s, 32.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201745 s, 52.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288497 s, 36.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280806 s, 37.3 MB/s
removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg133-client.virtnet'
removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg133-client.virtnet'
removed directory '/mnt/lustre/d77k.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 5, read rate: 5, bs: 1048576
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1048576] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 19.7978 s, 5.3 MB/s
Write runtime is 21 s, speed is 4.761904 vs. 5
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1048576] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 19.636 s, 5.3 MB/s
Read runtime is 21 s, speed is 4.761904 vs. 5
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug
ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20
ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg133-client.virtnet] [bs=1M] [count=16]
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 1.33339 s, 12.6 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_w]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117302 s, 8.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.160565 s, 6.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.190507 s, 5.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.175238 s, 6.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0769948 s, 13.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.182558 s, 5.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.195007 s, 5.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.398003 s, 2.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.320573 s, 3.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.343924 s, 3.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.41842 s, 2.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.531728 s, 2.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.626764 s, 1.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.66968 s, 1.6 MB/sldlm.namespaces.lustre-OST0001-osc-ffff8a33469fd000.lock_unused_count=2

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122579 s, 8.6 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_r]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.878216 s, 1.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.243202 s, 4.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.149972 s, 7.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0449525 s, 23.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.173344 s, 6.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0950512 s, 11.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.185712 s, 5.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0943109 s, 11.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0845022 s, 12.4 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff8a33469fd000.lock_unused_count=1
ldlm.namespaces.lustre-OST0001-osc-ffff8a33469fd000.lock_unused_count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103917 s, 10.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.347459 s, 3.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108982 s, 96.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.200078 s, 5.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.085015 s, 12.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0869403 s, 12.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.048123 s, 21.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0826569 s, 12.7 MB/s
removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg133-client.virtnet'
removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg133-client.virtnet'
removed directory '/mnt/lustre/d77k.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 10, bs: 1048576
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1048576] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.6641 s, 18.5 MB/s
Write runtime is 7 s, speed is 14.285714 vs. 20
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1048576] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 10.0332 s, 10.5 MB/s
Read runtime is 11 s, speed is 9.090909 vs. 10
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw
ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur
ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20
ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg133-client.virtnet] [bs=1M] [count=16]
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.803414 s, 20.9 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_w]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130839 s, 8.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125947 s, 8.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.171419 s, 6.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125351 s, 8.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.275649 s, 3.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119993 s, 8.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.397899 s, 2.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154697 s, 6.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.366987 s, 2.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0869868 s, 12.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.211457 s, 5.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.22256 s, 4.7 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_r]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.449537 s, 2.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.595215 s, 1.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.611166 s, 1.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.899155 s, 1.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.260766 s, 4.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0357315 s, 29.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.287496 s, 3.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0568952 s, 18.4 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.319363 s, 3.3 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.284194 s, 3.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0423965 s, 24.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.202296 s, 5.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0541145 s, 19.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.052626 s, 19.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022749 s, 46.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.334145 s, 3.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.353572 s, 3.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.206528 s, 5.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.20669 s, 5.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0641918 s, 16.3 MB/s
removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg133-client.virtnet'
removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg133-client.virtnet'
removed directory '/mnt/lustre/d77k.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 10, read rate: 10, bs: 1048576
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1048576] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 10.196 s, 10.3 MB/s
Write runtime is 12 s, speed is 8.333333 vs. 10
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1048576] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 10.0439 s, 10.4 MB/s
Read runtime is 11 s, speed is 9.090909 vs. 10
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 10, bs: 1048576
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1048576] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 9.97614 s, 10.5 MB/s
Write runtime is 11 s, speed is 9.090909 vs. 20
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1048576] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 9.94263 s, 10.5 MB/s
Read runtime is 11 s, speed is 9.090909 vs. 10
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
Cleanup TBF
ost.OSS.ost_io.nrs_tbf_rule=stop ext_a
ost.OSS.ost_io.nrs_tbf_rule=stop ext_b
ost.OSS.ost_io.nrs_policies=fifo
PASS 77k (364s)

== sanityn test 77ub: Testing for TBF rate control in BPS performance mode ========================================================== 19:01:58 (1788822118)
ost.OSS.ost_io.nrs_policies=tbf nid+opcode
ost.OSS.ost_io.nrs_tbf_rule=start nidrd nid={0@lo 192.168.201.33@tcp}&opcode={ost_read} bps=5
ost.OSS.ost_io.nrs_tbf_rule=start nidwr nid={0@lo 192.168.201.33@tcp}&opcode={ost_write} bps=15
ost.OSS.ost_io.nrs_tbf_rule=
regular_requests:
CPT 0:
nidwr nid={0@lo 192.168.201.33@tcp}&opcode={ost_write} 15, seq 3, type=nid+opcode, ref 0 bps=15728640
nidrd nid={0@lo 192.168.201.33@tcp}&opcode={ost_read} 5, seq 2, type=nid+opcode, ref 0 bps=5242880
default * 10000, seq 1, type=nid+opcode, ref 0
high_priority_requests:
CPT 0:
nidwr nid={0@lo 192.168.201.33@tcp}&opcode={ost_write} 15, seq 3, type=nid+opcode, ref 0 bps=15728640
nidrd nid={0@lo 192.168.201.33@tcp}&opcode={ost_read} 5, seq 2, type=nid+opcode, ref 0 bps=5242880
default * 10000, seq 1, type=nid+opcode, ref 0
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.746819 s, 22.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101379 s, 10.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128174 s, 8.2 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.339909 s, 3.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.383154 s, 2.7 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.388284 s, 2.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.372041 s, 2.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.428949 s, 2.4 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.369871 s, 2.8 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.414178 s, 2.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.399089 s, 2.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.403682 s, 2.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.396313 s, 2.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.441178 s, 2.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.468643 s, 2.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.441059 s, 2.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.439038 s, 2.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.263102 s, 4.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.257881 s, 4.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.263116 s, 4.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.273673 s, 3.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.281979 s, 3.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.277139 s, 3.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.292376 s, 3.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.292684 s, 3.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.282327 s, 3.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.307264 s, 3.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.352195 s, 3.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.303702 s, 3.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.314535 s, 3.3 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.314335 s, 3.3 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.308387 s, 3.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.307303 s, 3.4 MB/s
removed '/mnt/lustre/d77ub.sanityn/nrs_r_oleg133-client.virtnet'
removed '/mnt/lustre/d77ub.sanityn/nrs_w_oleg133-client.virtnet'
removed directory '/mnt/lustre/d77ub.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 15, read rate: 5, bs: 4096
Verify the write rate is under TBF control
25600+0 records in
25600+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 448.926 s, 234 kB/s
Write runtime is 450 s, speed is .222222 vs. 15
Verify the read rate is under TBF control
25600+0 records in
25600+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 223.934 s, 468 kB/s
Read runtime is 225 s, speed is .444444 vs. 5
cleanup_tbf /mnt/lustre/d77ub.sanityn
Waiting for MDT destroys to complete
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 15, read rate: 5, bs: 65536
Verify the write rate is under TBF control
1600+0 records in
1600+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 33.9975 s, 3.1 MB/s
Write runtime is 35 s, speed is 2.857142 vs. 15
Verify the read rate is under TBF control
1600+0 records in
1600+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 25.5055 s, 4.1 MB/s
Read runtime is 26 s, speed is 3.846153 vs. 5
cleanup_tbf /mnt/lustre/d77ub.sanityn
Waiting for MDT destroys to complete
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 15, read rate: 5, bs: 131072
Verify the write rate is under TBF control
800+0 records in
800+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 18.7488 s, 5.6 MB/s
Write runtime is 20 s, speed is 5.000000 vs. 15
Verify the read rate is under TBF control
800+0 records in
800+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 23.7359 s, 4.4 MB/s
Read runtime is 24 s, speed is 4.166666 vs. 5
cleanup_tbf /mnt/lustre/d77ub.sanityn
Waiting for MDT destroys to complete
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 15, read rate: 5, bs: 262144
Verify the write rate is under TBF control
400+0 records in
400+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 11.7796 s, 8.9 MB/s
Write runtime is 13 s, speed is 7.692307 vs. 15
Verify the read rate is under TBF control
400+0 records in
400+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 21.3355 s, 4.9 MB/s
Read runtime is 23 s, speed is 4.347826 vs. 5
cleanup_tbf /mnt/lustre/d77ub.sanityn
Waiting for MDT destroys to complete
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 15, read rate: 5, bs: 1048576
Verify the write rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 6.94077 s, 15.1 MB/s
Write runtime is 8 s, speed is 12.500000 vs. 15
Verify the read rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 19.9493 s, 5.3 MB/s
Read runtime is 21 s, speed is 4.761904 vs. 5
cleanup_tbf /mnt/lustre/d77ub.sanityn
Waiting for MDT destroys to complete
Cleanup TBF
ost.OSS.ost_io.nrs_tbf_rule=stop nidrd
ost.OSS.ost_io.nrs_tbf_rule=stop nidwr
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ub (934s)

== sanityn test 77ve: mClock: rule Reserved and Limit rate setting ========================================================== 19:17:32 (1788823052)
ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 limit=1
oleg133-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start proj100 projid={100} resvd_rate=100 limit_rate=50: Numerical result out of range
oleg133-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start proj100 projid={100} resvd_rate=100 limit_rate=50': Numerical result out of range
pdsh@oleg133-client: oleg133-server: ssh exited with exit code 34
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} iops=100
Rule rate: limit_iops 100
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} rate=5MiB/s
Rule rate: limit_bps 5
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_rate=300MiB/s
Rule rate: limit_bps 300
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=100 limit_rate=300
Rule rate: iops 100-300
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=10MiB limit_rate=30MiB
Rule rate: bps 10-30
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=10MiB limit_rate=30MiB resvd_iops=5 limit_iops=25
Rule rate: iops 5-25 bps 10-30
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} bps=5MiB/s
Rule rate: limit_bps 5
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_bps=10MiB/s
ost.OSS.ost_io.nrs_mclock_rule=change proj100 limit_rate=100
ost.OSS.ost_io.nrs_mclock_rule=
regular_requests:
CPT 0:
proj100 projid={100}, limit_iops 100, seq 9, type=projid, ref 0
default *, limit_iops 10000, seq 1, type=projid, ref 0
high_priority_requests:
CPT 0:
proj100 projid={100}, limit_iops 100, seq 9, type=projid, ref 0
default *, limit_iops 10000, seq 1, type=projid, ref 0
Rule rate: limit_iops 100
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=10 limit_rate=300
ost.OSS.ost_io.nrs_mclock_rule=change proj100 limit_rate=200
Rule rate: iops 10-200
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_bps=5000B/s
Rule rate: limit_bps 5000B/s
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_bps=1536KiB/s
Rule rate: limit_bps 1572864B/s
Cleanup TBF
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ve (44s)

== sanityn test 77vf: mClock: I/O testing with both Reserved and Limit rate control ========================================================== 19:18:16 (1788823096)
using SAVE_PROJECT_SUPPORTED=0
ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 limit=1
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=5 limit_rate=20
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.515693 s, 32.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101047 s, 10.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.20394 s, 5.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118623 s, 8.8 MB/s1+0 records in
1+0 records out

1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.302052 s, 3.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0881202 s, 11.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.367527 s, 2.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.447372 s, 2.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.370684 s, 2.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.411099 s, 2.6 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.333357 s, 3.1 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.401553 s, 2.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.484487 s, 2.2 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff8a33469fd000.lock_unused_count=1
ldlm.namespaces.lustre-OST0001-osc-ffff8a33469fd000.lock_unused_count=4
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.482596 s, 2.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.48093 s, 2.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.540056 s, 1.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.599261 s, 1.7 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0537267 s, 19.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0555068 s, 18.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.058042 s, 18.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0640209 s, 16.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0899045 s, 11.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0771167 s, 13.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141666 s, 7.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.166994 s, 6.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.13231 s, 7.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109376 s, 9.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133625 s, 7.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.144785 s, 7.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107509 s, 9.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109252 s, 9.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117942 s, 8.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143313 s, 7.3 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff8a33469fd000.lock_unused_count=1
removed '/mnt/lustre/d77vf.sanityn/nrs_r_oleg133-client.virtnet'
removed '/mnt/lustre/d77vf.sanityn/nrs_w_oleg133-client.virtnet'
removed directory '/mnt/lustre/d77vf.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 20, bs: 1048576
Verify the write rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 6.2937 s, 16.7 MB/s
Write runtime is 8 s, speed is 12.500000 vs. 20
Verify the read rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.98076 s, 17.5 MB/s
Read runtime is 7 s, speed is 14.285714 vs. 20
cleanup_tbf /mnt/lustre/d77vf.sanityn
Waiting for MDT destroys to complete
Cleanup TBF
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_policies=fifo
PASS 77vf (51s)

== sanityn test 77vg: mClock: multiple flows with different reserved and limit rates ========================================================== 19:19:08 (1788823148)
using SAVE_PROJECT_SUPPORTED=0
  100 P /mnt/lustre/d77vg.sanityn/f77vg.sanityn.100
  200 P /mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200
ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 limit=1
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=5 limit_rate=20
ost.OSS.ost_io.nrs_mclock_rule=start proj200 projid={200} resvd_rate=10 limit_rate=15
cpu_npartitions on ost1 is 1
mClock: Run 2 flows in parallel
mClock - file: /mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200
mClock - rw: w, resvd: 10, limit: 15
WRITE: resvd=10 limit=15 file=/mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200 (np=1)
mClock - file: /mnt/lustre/d77vg.sanityn/f77vg.sanityn.100
mClock - rw: w, resvd: 5, limit: 20
WRITE: resvd=5 limit=20 file=/mnt/lustre/d77vg.sanityn/f77vg.sanityn.100 (np=1)
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.76407 s, 18.2 MB/s
Write runtime is 7 s, speed is 14.285714 IOPS
=== DONE: rate=14.285714 within 5-20 and np=1 ===
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 7.29583 s, 14.4 MB/s
Write runtime is 8 s, speed is 12.500000 IOPS
=== DONE: rate=12.500000 within 10-15 and np=1 ===
cpu_npartitions on ost1 is 1
mClock: Run 2 flows in parallel
mClock - file: /mnt/lustre/d77vg.sanityn/f77vg.sanityn.100
mClock - rw: r, resvd: 5, limit: 20
READ: resvd=5 limit=20 file=/mnt/lustre/d77vg.sanityn/f77vg.sanityn.100 (np=1)
mClock - file: /mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200
mClock - rw: r, resvd: 10, limit: 15
READ: resvd=10 limit=15 file=/mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200 (np=1)
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.59536 s, 18.7 MB/s
Read runtime is 7 s, speed is 14.285714 IOPS
=== DONE: rate=14.285714 within 5-20 and np=1 ===
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 6.9567 s, 15.1 MB/s
Read runtime is 8 s, speed is 12.500000 IOPS
=== DONE: rate=12.500000 within 10-15 and np=1 ===
cpu_npartitions on ost1 is 1
mClock: Run 2 flows in parallel
mClock - file: /mnt/lustre/d77vg.sanityn/f77vg.sanityn.100
mClock - rw: r, resvd: 5, limit: 20
mClock - file: /mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200
READ: resvd=5 limit=20 file=/mnt/lustre/d77vg.sanityn/f77vg.sanityn.100 (np=1)
mClock - rw: w, resvd: 10, limit: 15
WRITE: resvd=10 limit=15 file=/mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200 (np=1)
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.4665 s, 19.2 MB/s
Read runtime is 7 s, speed is 14.285714 IOPS
=== DONE: rate=14.285714 within 5-20 and np=1 ===
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 6.97508 s, 15.0 MB/s
Write runtime is 8 s, speed is 12.500000 IOPS
=== DONE: rate=12.500000 within 10-15 and np=1 ===
cpu_npartitions on ost1 is 1
mClock: Run 2 flows in parallel
mClock - file: /mnt/lustre/d77vg.sanityn/f77vg.sanityn.100
mClock - rw: w, resvd: 5, limit: 20
WRITE: resvd=5 limit=20 file=/mnt/lustre/d77vg.sanityn/f77vg.sanityn.100 (np=1)
mClock - file: /mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200
mClock - rw: r, resvd: 10, limit: 15
READ: resvd=10 limit=15 file=/mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200 (np=1)
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.92312 s, 17.7 MB/s
Write runtime is 7 s, speed is 14.285714 IOPS
=== DONE: rate=14.285714 within 5-20 and np=1 ===
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 7.03832 s, 14.9 MB/s
Read runtime is 8 s, speed is 12.500000 IOPS
=== DONE: rate=12.500000 within 10-15 and np=1 ===
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=stop proj200
ost.OSS.ost_io.nrs_policies=fifo
removed '/mnt/lustre/d77vg.sanityn/f77vg.sanityn.100'
removed '/mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200'
PASS 77vg (56s)

== sanityn test 77vm: mClock: reserve=0 turns the reserve dimension off ========================================================== 19:20:04 (1788823204)
oleg133-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=mclock projid reserve=0: Invalid argument
oleg133-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='mclock projid reserve=0': Invalid argument
pdsh@oleg133-client: oleg133-server: ssh exited with exit code 22
ost.OSS.ost_io.nrs_policies=mclock projid reserve=0 limit=1
ost.OSS.ost_io.nrs_mclock_rule=start lim100 projid={100} limit_rate=100
Rule rate: limit_iops 100
oleg133-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start res100 projid={200} resvd_rate=100: Invalid argument
oleg133-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start res100 projid={200} resvd_rate=100': Invalid argument
pdsh@oleg133-client: oleg133-server: ssh exited with exit code 22
Cleanup TBF
ost.OSS.ost_io.nrs_mclock_rule=stop lim100
ost.OSS.ost_io.nrs_policies=fifo
PASS 77vm (22s)

== sanityn test 77vr: mClock: a reserve only policy schedules the default class ========================================================== 19:20:27 (1788823227)
using SAVE_PROJECT_SUPPORTED=0
ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 limit=0
Default rule rate: resvd_iops 10000
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=100
8+0 records in
8+0 records out
8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.412572 s, 20.3 MB/s
8+0 records in
8+0 records out
8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.138409 s, 60.6 MB/s
Cleanup TBF
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_policies=fifo
PASS 77vr (23s)
cleanup: ======================================================
== sanityn test complete, duration 1621 sec ============== 19:20:52 (1788823252)
=== sanityn: start cleanup 19:20:55 (1788823255) ===
Stopping clients: oleg133-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg133-client.virtnet /mnt/lustre2 opts:
=== sanityn: finish cleanup 19:21:03 (1788823263) ===